Business Wire

Technology Innovation Institute Announces Launch of NOOR, the World’s Largest Arabic NLP Model

Share

Technology Innovation Institute (TII), a global research center and applied research pillar of Abu Dhabi’s Advanced Technology Research Council, today announced the launch of NOOR, the world’s largest Arabic natural language processing (NLP) model to date.

This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20220411005085/en/

To view this piece of content from mms.businesswire.com, please give your consent at the top of this page.

Noor, the world's largest Arabic NLP Model - AI Cross-Center Unit, Technology Innovation Institute (Photo: AETOSWire)

TII’s team of advanced researchers and Artificial Intelligence (AI) specialists, has joined forces with LightOn, a technology company that unlocks extreme-scale machine intelligence for businesses, to transform the Arabic NLP model. The NOOR model has the capability to carry out tasks beyond the domain of language - offering end-to-end pipeline high quality data, including crawling, filtering, and curation at scale. The model facilitates extreme-scale distributed training and serving – to deliver applications with efficient inference and model specialization.

Dr. Ray O. Johnson, CEO, TII and ASPIRE, said: “With this development, we are well on track to enhance our research capabilities and credentials as well as elevate the status of Abu Dhabi and the UAE as a serious research ecosystem. Our expert teams have demonstrated yet again that this region can achieve breakthrough R&D outcomes to impact the world.”

Dr. Ebtesam Almazrouei, Director, AI Cross-Center Unit, TII, said: “Large language models have taken the world of natural language processing by storm, and we are proud to introduce this cutting-edge model with 10 billion parameters - the world’s largest Arabic NLP model. The uniquely large Arabic dataset collected to train the model is the result of months of work that included curating, scrapping, and filtering of varied sources. A special thank you to the entire team that worked on this project to make NOOR the go-to exploration model in Arabic for academicians and businesses everywhere.”

Speaking on the launch, Prof. Mérouane Debbah, Chief Researcher, Digital Science Research Center and AI Cross-Center Unit, TII, said: “With NOOR, TII has expanded the scope of the modern standard Arabic model by leveraging know-how in large language models to build cross-disciplinary, cutting-edge expertise in this new generation of AI research.”

To curate the world’s largest high-quality cross-domain Arabic datasets, NOOR’s unique dataset of more than 30 billion words combines web data with books, poetry, news articles, and technical information to significantly widen the applicability of the model.

Dr. Ebtesam Almazrouei said the NOOR model is based on the popular Transformer architecture. As a decoder-only model, similar in structure to GPT-3, it is programmed to tackle generative tasks with architecture upgraded to reflect the latest developments in the world of machine learning, including improvements such as better positional embeddings. To help ensure quality at scale in the NOOR dataset, the TII team designed an automated filtering pipeline based on machine learning techniques. These tools identify text like quality references and safeguard the model from exposure to spam content.

Leveraging state-of-the-art 3D parallelism, NOOR was trained on a High-Performance Computing resource with 128 A100 GPUs, allowing for the distribution of computations and ensuring efficient use of the available hardware resources.

The Director of the AI Cross-Center Unit noted that this was only the first step in the Unit’s efforts to contribute to the wider UAE Strategy for Artificial Intelligence.

Named for the Arabic word "light", the model has been so called to establish the correlation of the Arabic language model to enlightening the mind.

About Technology Innovation Institute (TII)

For more information, visit www.tii.ae

*Source: AETOSWire

To view this piece of content from cts.businesswire.com, please give your consent at the top of this page.

Contact information

Technology Innovation Institute
Sneha Sivanand, sneha.sivanand@tii.ae

About Business Wire

Business Wire
Business Wire
24 Martin Lane
EC4R 0DR London

+44 20 7626 1982http://www.businesswire.co.uk

(c) 2018 Business Wire, Inc., All rights reserved.

Business Wire, a Berkshire Hathaway company, is the global leader in multiplatform press release distribution.

Subscribe to releases from Business Wire

Subscribe to all the latest releases from Business Wire by registering your e-mail address below. You can unsubscribe at any time.

Latest releases from Business Wire

Grovara Partners with Dubai Global Connect, Establishes Middle East HQ and Showroom19.5.2022 13:00:00 CEST | Press release

Grovara, the easy global wholesale experience, announces it has signed a lease agreement and become formally incorporated to do business in Dubai as part of a partnership with Dubai Global Connect (DGC), a permanent wholesale market that facilitates business between international buyers and sellers. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20220519005017/en/ Grovara and Dubai Global Connect cemented their partnership on April 26, 2022 at DGC's new Visitor Centre in Dubai. Standing, from left are Grovara Sales Director Eugenia Schlitter, Grovara Executive Chairman David Pottruck, Grovara Chief Innovation Officer/Co-founder Peter Groverman, Dubai Global Connect Food Business Development Lead Badreddine Soukarie, and Grovara VP of Global Supply Chain Juliana Rogenski; Seated, from left are Dubai Global Connect Head of Business Development Paul Boots and Grovara CEO/Co-founder Abu Kamara. (Photo: Business Wire) The partnersh

Zilliant Launches Quick Start Program to Speed Time to Value and First Quick Start Package, Transforming How Companies Manage Pricing in Response to Inflation19.5.2022 13:00:00 CEST | Press release

Zilliant, the industry leader in intelligent end-to-end pricing solutions and sales guidance software, today announced its Zilliant Quick Start Program, which enables significantly faster deployment times for its software and faster time-to-value for customers. The first Quick Start package of this transformative program is Zilliant Quick Start for Global and Country Price Lists, which is available beginning today. In the past, deploying price optimization and management software may have seemed time intensive or difficult to implement. As a direct result, pricing and commercial teams rely on spreadsheets to manage pricing, sales operations and commercial functions, a method that is insufficient to respond to today’s volatile market conditions. The Zilliant Quick Start program flips this paradigm, offering packaged solutions to address specific pricing and sales challenges, each of which can be up and running within the span of three to eight weeks, work seamlessly with each other on t

Eaton Introduces DC-DC Converters for 48-Volt Commercial Vehicle Architectures19.5.2022 12:30:00 CEST | Press release

Power management company Eaton today introduced a family of 48-volt DC-DC converters for diesel-powered commercial vehicles that can be used to power accessories such as antilock brakes and lighting. Unlike competitive offerings, Eaton’s DC-DC converters are operational in ambient temperatures up to 85 degrees Celsius and boast 97% design efficiency. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20220519005093/en/ Eaton’s family of 48-volt DC-DC converters can be used to power accessories such as antilock brakes and lighting and are operational in ambient temperatures up to 85 degrees Celsius. (Graphic: Business Wire) “DC-DC converters are an essential part of our eMobility product portfolio and are used in a variety of vehicle applications,” said Ben Karrer, director, Technology Development, Eaton’s eMobility business. “Many commercial vehicle manufacturers are transitioning to 48-volt architectures, so having the ability to

UZ Brussel First to Treat Breast Cancer Patients with New Brainlab Deep Inspiration Breath Hold with Instant X-Ray Confirmation19.5.2022 12:01:00 CEST | Press release

Brainlab announced today that clinicians at UZ Brussel are the first to treat patients with the company’s new Deep Inspiration Breath Hold (DIBH)* technology designed to streamline image guided and surface guided radiation therapy (IGRT and SGRT) and deliver the highest quality of care for breast cancer patients. UZ Brussel is a university hospital at the Vrije Universiteit Brussel with 721 hospital beds and almost 4,000 employees. UZ Brussel successfully validated the technology and presented research at the Novalis Circle Symposium at ESTRO on May 8, 2022. The research demonstrates that Brainlab ExacTrac Dynamic® DIBH streamlines the process and increases positioning confidence through “on-the-fly” X-Ray confirmation. Internal anatomy verification at the breath hold level may increase confidence in dose sparing of critical structures like the heart. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20220518005985/en/ CE-marked

Booba and Silent Seeds Announce the Launch of a New Strain of Cannabis (THC), the B-45!19.5.2022 11:35:00 CEST | Press release

Alexandre Lacarré, the co-founder of the Silent Seeds seed bank (formerly Dinafem) and the famous French rapper Booba, have announced a unique cooperation to create B-45, a seed specially designed for the artist. A first in Europe! This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20220519005106/en/ (Photo: Silent Seeds) With 20 years of experience and R&D, Silent Seeds was Booba's partner of choice for the creation and distribution of his own strain of cannabis, entirely tailor-made for an exceptional result. Friday 20 May 2022 will mark the launch of B-45, an Indica-dominant hybrid resulting from crossing (Florida OG x Pre'98 Bubba Kush) x Orange Punch #66. This strain has a record THC content of more than 30%. "If you want to visit Jamaica, you just have to taste my weed". -Booba "From our first meeting, Booba knew exactly what he wanted. We soon came to the conclusion that the cannabis plant held no secrets for him. We would