Business Wire

Vectara Launches Factual Consistency Score Powered by Upgraded Hughes Hallucination Evaluation Model to Enhance Transparency in GenAI Responses

Share

Vectara, the trusted Generative AI product platform, announced the inclusion of a Factual Consistency Score (FCS) for all generative responses based on an evolved version of the groundbreaking Hughes Hallucination Evaluation Model (HHEM)—the #1 hallucination detection model on Hugging Face with 100,000+ downloads since its launch last November. The associated Hallucination Leaderboard is now the industry standard for how LLMs benchmark their average factual consistency. Vectara’s end-to-end Retrieval Augmented Generation-as-a-service (RAGaaS) platform is setting a new standard as an industry-first feature for GenAI response transparency by providing real-time end-to-end RAG observability. This innovative metric provides unprecedented visibility into the factual consistency of summarized responses within Vectara’s RAGaaS platform, empowering users to set personalized thresholds for response acceptance based on a detailed accuracy score.

With average hallucination rates of LLMs on the market ranging from 3% to 16.2%, the risk of unknown inaccuracies in their response remains a major concern, preventing widespread business adoption of this powerful technology. Vectara mitigates this ambiguity for enterprises by providing a Factual Consistency Score grading the likelihood that the generated response is a hallucination or not. Only with a standardized, scientifically calculated method for grading responses can businesses responsibly introduce GenAI into business critical applications. Users have the ability to set thresholds for response acceptance based on a detailed accuracy score, giving product teams the flexibility to act on this information according to their preferences.

Vectara’s Factual Consistency Score is a groundbreaking tool in GenAI, setting a new benchmark for real-time hallucination detection and offering superior performance, affordability, and speed, thus marking a significant leap forward in trust. Its efficiency and effectiveness enable businesses to deploy GenAI into critical product use cases without being worried about exposure to liabilities that might arise from hallucinated responses.

Vectara's Factual Consistency Score equips developers with the capability to refine and enhance a wide range of applications, from internal Q&A systems to the quality of interactions with end consumers. The strength of this score lies in its calibration, making it interpretable as a direct probability—for instance, a score of 0.98 indicates a 98% probability of factual consistency. This contrasts sharply with many contemporary ML classifiers that disregard calibration, thus sacrificing clarity and direct interpretability.

"Integrating Vectara's Factual Consistency Score into the Yobi app will revolutionize how we handle AI transparency and accuracy for business use cases. By providing visibility and accountability into answers provided by our platform, we can stay true to our commitment to responsible AI that enterprises can depend on,” said Ahmed Reza, Founder and CEO of the Yobi app. “As a Co-Innovate Partner with Vectara, we're thrilled to see such advanced technology directly incorporated into the Vectara platform.”

The advanced HHEM that powers the Factual Consistency Score gives greater visibility than previously released open-sourced versions, offering enhanced accuracy and extended language support. This initiative is part of Vectara's commitment to transparency and control, empowering businesses with the autonomy to manage AI responses effectively.

"Just as we were early in pioneering RAG to enhance the relevance and quality of generated content, we are once again at the forefront of responsible AI by being completely open about our efforts to mitigate hallucinations in Generative AI," said Amr Awadallah, co-founder and CEO of Vectara. "By providing our customers with real-time access to factual consistency scores, we're not just engineering trust; we're handing over the control, enabling them to make informed decisions on how to utilize the responses generated by our RAGaaS platform."

About Vectara

Vectara is an end-to-end platform for embedding powerful generative AI features into applications with extraordinary results. As an end-to-end Retrieval Augmented Generation (RAG) platform, Vectara delivers the shortest path to a correct answer/action through a safe, secure, and trusted entry point. Vectara never trains on your data, allowing businesses to embed generative AI capabilities without the risk of data or privacy violations. To learn more, visit vectara.com.

To view this piece of content from cts.businesswire.com, please give your consent at the top of this page.

Contact information

Carly Bourne
carly@bulleitgroup.com
423-443-0449

About Business Wire

Business Wire
Business Wire
24 Martin Lane
EC4R 0DR London

+44 20 7626 1982http://www.businesswire.co.uk

(c) 2018 Business Wire, Inc., All rights reserved.

Business Wire, a Berkshire Hathaway company, is the global leader in multiplatform press release distribution.

Subscribe to releases from Business Wire

Subscribe to all the latest releases from Business Wire by registering your e-mail address below. You can unsubscribe at any time.

Latest releases from Business Wire

H.I.G. Capital Announces the Sale of DGS S.p.A.11.6.2024 12:00:00 CEST | Press release

H.I.G. Capital (“H.I.G.”), a leading global alternative investment firm with $62 billion of capital under management, is pleased to announce that an affiliate has signed a definitive agreement to sell its portfolio company, DGS S.p.A. (“DGS” or the “Group”), a leading firm in the Italian Information Technology market, to DGS Co-Founders and management team in partnership with ICG, a global alternative asset manager. Since its inception in 1997, DGShas supported blue-chip customers in the design, integration, and maintenance of complex IT systems, with a specialization in digital transformation and cybersecurity services. The Group currently has over 1,900 employees, revenues of approximately €300 million, and maintains a group of highly loyal clientele. During H.I.G.’s ownership, DGS has tripled in size and consolidated its position as a leading Italian firm in cybersecurity services and digital transformation. DGS offers its clients sophisticated and proprietary digital transformation

Evertas Names Nick Selby Head of European Underwriting11.6.2024 12:00:00 CEST | Press release

Evertas, the world’s first crypto insurance company, has named Nick Selby as its new Head of European Underwriting. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240611141887/en/ Nick Selby, Executive Vice President and Head of European Underwriting at Evertas (Photo: Business Wire) Selby, an accomplished information and physical security professional, brings two decades of expertise in public and private sector information security, physical security, and complex incident handling, as well as seven years of experience leading teams securing billions of dollars in cryptoassets. Previously, his roles included VP of the Software Assurance Practice at Trail of Bits, Chief Security Officer at Paxos Trust Company, and Director of Cyber Intelligence and Investigations at the NYPD Intelligence Bureau. “Nick is an extremely valuable addition to our European team,” said Evertas CEO and Co-Founder J. Gdanski. “His public and private

Owlet utvider globalt fotavtrykk med lanseringen av medisinsk-sertifisert Dream Sock™ i Storbritannia og over hele Europa11.6.2024 11:00:00 CEST | Pressemelding

Owlet, Inc. («Owlet» or the «Company») (NYSE:OWLT), pioneren innen smart spedbarnsovervåking, kunngjør i dag den britiske og europeiske lanseringen av Dream Sock. Dette er en smart babymonitor med levende helseavlesninger og varsler for friske spedbarn mellom 0-18 måneder og 2,5-13,6 kg. Dette innovative medisinske utstyret gir foreldre helse og viktig informasjon i sanntid, noe som gir uovertruffen trygghet. Denne pressemeldingen inneholder multimedia. Se hele pressemeldingen her: https://www.businesswire.com/news/home/20240611820341/no/ (Photo: Business Wire) «Vi er svært stolte over å lansere Dream Sock til omsorgspersoner over hele Storbritannia og Europa og gi millioner av foreldre mer trygghet mens babyen sover,» sa Kurt Workman, Owlets administrerende direktør og medgründer. «Dream Sock er nå et globalt produkt som er anerkjent som medisinsk nøyaktig og trygt, etter å ha gjennomgått regulatoriske autorisasjoner og sertifiseringer innenfor flere geografier. I dag er misjonen vår

V-Nova Surpasses 1000 Patent Milestone in Media Technology Innovation11.6.2024 10:00:00 CEST | Press release

V-Nova, a leading provider of data compression solutions, video compression technology, XR technology, AI acceleration and parallel processing for a multitude of industries including media and entertainment, today announced its milestone achievement of 1000 active technology patents. This accomplishment underscores V-Nova’s dedication to research and development and its commitment to protecting its intellectual property globally. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240611724561/en/ V-Nova’s patent portfolio spans more than 50 different jurisdictions. Including over 400 patents in Europe, over 200 in the Americas, over 100 in the United States specifically, and over 200 in Asia. V-Nova forged new directions in data processing to enhance digital experiences, maximize efficiency, reduce costs, and increase sustainability. The company leads the way with key international data compression standards for the video indust

Alipay+ Reveals Top Scorer Trophy Design for UEFA EURO 2024™11.6.2024 09:24:00 CEST | Press release

Alipay+, a suite of cross-border mobile payment and digitalization technology solutions operated by Ant International and an Official Partner of UEFA EURO 2024™, today revealed the trophy that will be awarded to the most prolific marksman at the UEFA EURO 2024™ finale on July 14 in Berlin, Germany. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240610328619/en/ The UEFA Top Scorer Trophy presented by Alipay+ is unveiled for UEFA EURO 2024™ (Photo: Business Wire) Sculpted in the shape of the Chinese character “支” (pronounced zhi, and meaning payment as well as support), the trophy reflects Alipay+’s dedication to supporting consumers to enjoy seamless payment and a broad choice of deals using their preferred payment methods while traveling abroad. The character also resembles the fleeting moment of a barefooted striker poised to shoot, evoking the original beauty and power of football – a game that united people across the wo

World GlobeA line styled icon from Orion Icon Library.HiddenA line styled icon from Orion Icon Library.Eye