Business Wire

Vectara Launches Factual Consistency Score Powered by Upgraded Hughes Hallucination Evaluation Model to Enhance Transparency in GenAI Responses

Share

Vectara, the trusted Generative AI product platform, announced the inclusion of a Factual Consistency Score (FCS) for all generative responses based on an evolved version of the groundbreaking Hughes Hallucination Evaluation Model (HHEM)—the #1 hallucination detection model on Hugging Face with 100,000+ downloads since its launch last November. The associated Hallucination Leaderboard is now the industry standard for how LLMs benchmark their average factual consistency. Vectara’s end-to-end Retrieval Augmented Generation-as-a-service (RAGaaS) platform is setting a new standard as an industry-first feature for GenAI response transparency by providing real-time end-to-end RAG observability. This innovative metric provides unprecedented visibility into the factual consistency of summarized responses within Vectara’s RAGaaS platform, empowering users to set personalized thresholds for response acceptance based on a detailed accuracy score.

With average hallucination rates of LLMs on the market ranging from 3% to 16.2%, the risk of unknown inaccuracies in their response remains a major concern, preventing widespread business adoption of this powerful technology. Vectara mitigates this ambiguity for enterprises by providing a Factual Consistency Score grading the likelihood that the generated response is a hallucination or not. Only with a standardized, scientifically calculated method for grading responses can businesses responsibly introduce GenAI into business critical applications. Users have the ability to set thresholds for response acceptance based on a detailed accuracy score, giving product teams the flexibility to act on this information according to their preferences.

Vectara’s Factual Consistency Score is a groundbreaking tool in GenAI, setting a new benchmark for real-time hallucination detection and offering superior performance, affordability, and speed, thus marking a significant leap forward in trust. Its efficiency and effectiveness enable businesses to deploy GenAI into critical product use cases without being worried about exposure to liabilities that might arise from hallucinated responses.

Vectara's Factual Consistency Score equips developers with the capability to refine and enhance a wide range of applications, from internal Q&A systems to the quality of interactions with end consumers. The strength of this score lies in its calibration, making it interpretable as a direct probability—for instance, a score of 0.98 indicates a 98% probability of factual consistency. This contrasts sharply with many contemporary ML classifiers that disregard calibration, thus sacrificing clarity and direct interpretability.

"Integrating Vectara's Factual Consistency Score into the Yobi app will revolutionize how we handle AI transparency and accuracy for business use cases. By providing visibility and accountability into answers provided by our platform, we can stay true to our commitment to responsible AI that enterprises can depend on,” said Ahmed Reza, Founder and CEO of the Yobi app. “As a Co-Innovate Partner with Vectara, we're thrilled to see such advanced technology directly incorporated into the Vectara platform.”

The advanced HHEM that powers the Factual Consistency Score gives greater visibility than previously released open-sourced versions, offering enhanced accuracy and extended language support. This initiative is part of Vectara's commitment to transparency and control, empowering businesses with the autonomy to manage AI responses effectively.

"Just as we were early in pioneering RAG to enhance the relevance and quality of generated content, we are once again at the forefront of responsible AI by being completely open about our efforts to mitigate hallucinations in Generative AI," said Amr Awadallah, co-founder and CEO of Vectara. "By providing our customers with real-time access to factual consistency scores, we're not just engineering trust; we're handing over the control, enabling them to make informed decisions on how to utilize the responses generated by our RAGaaS platform."

About Vectara

Vectara is an end-to-end platform for embedding powerful generative AI features into applications with extraordinary results. As an end-to-end Retrieval Augmented Generation (RAG) platform, Vectara delivers the shortest path to a correct answer/action through a safe, secure, and trusted entry point. Vectara never trains on your data, allowing businesses to embed generative AI capabilities without the risk of data or privacy violations. To learn more, visit vectara.com.

To view this piece of content from cts.businesswire.com, please give your consent at the top of this page.

Contact information

Carly Bourne
carly@bulleitgroup.com
423-443-0449

About Business Wire

Business Wire
Business Wire
24 Martin Lane
EC4R 0DR London

+44 20 7626 1982http://www.businesswire.co.uk

(c) 2018 Business Wire, Inc., All rights reserved.

Business Wire, a Berkshire Hathaway company, is the global leader in multiplatform press release distribution.

Subscribe to releases from Business Wire

Subscribe to all the latest releases from Business Wire by registering your e-mail address below. You can unsubscribe at any time.

Latest releases from Business Wire

IFF to Release First Quarter 2024 Results on May 6, 202416.4.2024 22:15:00 CEST | Press release

IFF (NYSE:IFF) today announced that it will release its first quarter 2024 earnings results following the market close on Monday, May 6, 2024. The management team will host a live webcast on Tuesday, May 7, 2024 at 9:00 a.m. ET to discuss results and outlook with the investor community. Investors may access the live webcast and accompanying slide presentation on the Company's website at ir.iff.com. For those unable to listen to the live webcast, a recorded version will be made available for replay. Welcome to IFF At IFF (NYSE: IFF), an industry leader in food, beverage, health, biosciences and scent, science and creativity meet to create essential solutions for a better world – from global icons to unexpected innovations and experiences. With the beauty of art and the precision of science, we are an international collective of thinkers who partners with customers to bring scents, tastes, experiences, ingredients and solutions for products the world craves. Together, we will do more goo

A new chapter for Medisca: Sanjay D. Goorachurn appointed as Chief Executive Officer16.4.2024 19:58:00 CEST | Press release

Medisca, a global company specializing in personalized pharmaceutical solutions, is pleased to announce the appointment of Sanjay D. Goorachurn as the company’s new CEO, as founders, Tony Dos Santos and Maria Zaccardo, transition into strategic advisory roles as Chair and Vice Chair, respectively. Coinciding with the company’s 35th anniversary, this decision marks a significant milestone in Medisca’s history. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240416663563/en/ Left to right: Tony Dos Santos, Founder | Maria Zaccardo, Co-founder | Sanjay D. Goorachurn, CEO (Photo: Business Wire) In 1989, Medisca opened its doors as a team of three with two products and a vision to bridge the gaps in patient care. Today, Medisca is a global leader in personalized medicine with more than 10 locations spanning 5 countries. Powered by a workforce of over 450 employees, Medisca offers a vast portfolio of more than 2,000 product solutio

Bona Releases 2023 Sustainability Report16.4.2024 18:00:00 CEST | Press release

Bona®, a global, sustainably-driven company that supplies products for installing, renovating, maintaining, and restoring premium floors, today released its Sustainability Report for 2023. This year, Bona has included a narrative summary of its sustainability progress following by its audited statutory sustainability report. This is another important step by Bona to move its sustainability efforts forward and align with the demands of the Corporate Sustainability Reporting Directive (CSRD). “We are currently in the midst of developing our sustainability work in line with our ambitions and stakeholder expectations. This year’s report reflects this ongoing journey and presents many examples of the progress we are making, among which are our advances in reducing fossil-based plastics in our packaging, the introduction of bio-based products, and the launch of our Sustainability Board,” said Magnus Andersson, Bona CEO. Most notably, Bona announced in its report the establishment of a Sustai

Unforgettable Experiences Await: Secure Your Spot at NPE202416.4.2024 16:42:00 CEST | Press release

Anticipation for the largest plastics trade show in the Americas is nearly over; registration for NPE2024: The Plastics Show closes in less than a month. Held in the Orange County Convention Center in Orlando, Florida, the show spans over 1.1 million net square feet of exhibit space. NPE2024 will be the most impactful trade show of the year for all plastics industry sectors in the U.S. and globally, with more than 55,000 professionals expected and over 2,100 exhibitors. Attendees will come from over 115 countries, representing the entire plastics ecosystem and nearly every part of the global industry. NPE2024 is back, and a completely reimagined experience. The show’s slogan “Made For You,” highlights its focus on personalization, offering various education, networking and innovation for professionals in the automotive, building and construction, consumer products, packaging and medical industries. NPE2024 is returning bigger and better than ever with the announcement of new features s

Lenovo Embraces the AI PC Era with New ThinkCentre Desktops Powered by AMD Ryzen PRO 8000 Series Desktop Processors16.4.2024 15:00:00 CEST | Press release

Lenovo™ has unveiled a selection of ThinkCentre™ desktops powered by AMD Ryzen™ PRO 8000 Series desktop processors with up to 16 TOPS (trillion operations per second) of integrated NPU capability dedicated to process AI workloads, including the performance focused ThinkCentre M75t Gen 5, the flexible ThinkCentre M75s Gen 5, and the compact ThinkCentre M75q Gen 5. Designed to meet the diverse needs of modern business, the ThinkCentre M75 Gen 5 family of desktops harnesses the AI capability of its component while optimizing its energy efficiency to deliver impressive results. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240416990902/en/ Lenovo ThinkCentre M75s Gen 5 (Photo: Business Wire) “The AI PC era is already here and at Lenovo we are embracing it to unlock new possibilities,” said Sanjeev Menon, vice president and general manager, Worldwide Desktop Business in Intelligent Devices Group, Lenovo. “The need for businesses

HiddenA line styled icon from Orion Icon Library.Eye