Business Wire

Technology Innovation Institute Announces Launch of NOOR, the World’s Largest Arabic NLP Model

Share

Technology Innovation Institute (TII), a global research center and applied research pillar of Abu Dhabi’s Advanced Technology Research Council, today announced the launch of NOOR, the world’s largest Arabic natural language processing (NLP) model to date.

This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20220411005085/en/

To view this piece of content from mms.businesswire.com, please give your consent at the top of this page.

Noor, the world's largest Arabic NLP Model - AI Cross-Center Unit, Technology Innovation Institute (Photo: AETOSWire)

TII’s team of advanced researchers and Artificial Intelligence (AI) specialists, has joined forces with LightOn, a technology company that unlocks extreme-scale machine intelligence for businesses, to transform the Arabic NLP model. The NOOR model has the capability to carry out tasks beyond the domain of language - offering end-to-end pipeline high quality data, including crawling, filtering, and curation at scale. The model facilitates extreme-scale distributed training and serving – to deliver applications with efficient inference and model specialization.

Dr. Ray O. Johnson, CEO, TII and ASPIRE, said: “With this development, we are well on track to enhance our research capabilities and credentials as well as elevate the status of Abu Dhabi and the UAE as a serious research ecosystem. Our expert teams have demonstrated yet again that this region can achieve breakthrough R&D outcomes to impact the world.”

Dr. Ebtesam Almazrouei, Director, AI Cross-Center Unit, TII, said: “Large language models have taken the world of natural language processing by storm, and we are proud to introduce this cutting-edge model with 10 billion parameters - the world’s largest Arabic NLP model. The uniquely large Arabic dataset collected to train the model is the result of months of work that included curating, scrapping, and filtering of varied sources. A special thank you to the entire team that worked on this project to make NOOR the go-to exploration model in Arabic for academicians and businesses everywhere.”

Speaking on the launch, Prof. Mérouane Debbah, Chief Researcher, Digital Science Research Center and AI Cross-Center Unit, TII, said: “With NOOR, TII has expanded the scope of the modern standard Arabic model by leveraging know-how in large language models to build cross-disciplinary, cutting-edge expertise in this new generation of AI research.”

To curate the world’s largest high-quality cross-domain Arabic datasets, NOOR’s unique dataset of more than 30 billion words combines web data with books, poetry, news articles, and technical information to significantly widen the applicability of the model.

Dr. Ebtesam Almazrouei said the NOOR model is based on the popular Transformer architecture. As a decoder-only model, similar in structure to GPT-3, it is programmed to tackle generative tasks with architecture upgraded to reflect the latest developments in the world of machine learning, including improvements such as better positional embeddings. To help ensure quality at scale in the NOOR dataset, the TII team designed an automated filtering pipeline based on machine learning techniques. These tools identify text like quality references and safeguard the model from exposure to spam content.

Leveraging state-of-the-art 3D parallelism, NOOR was trained on a High-Performance Computing resource with 128 A100 GPUs, allowing for the distribution of computations and ensuring efficient use of the available hardware resources.

The Director of the AI Cross-Center Unit noted that this was only the first step in the Unit’s efforts to contribute to the wider UAE Strategy for Artificial Intelligence.

Named for the Arabic word "light", the model has been so called to establish the correlation of the Arabic language model to enlightening the mind.

About Technology Innovation Institute (TII)

For more information, visit www.tii.ae

*Source: AETOSWire

To view this piece of content from cts.businesswire.com, please give your consent at the top of this page.

Contact information

Technology Innovation Institute
Sneha Sivanand, sneha.sivanand@tii.ae

About Business Wire

Business Wire
Business Wire
24 Martin Lane
EC4R 0DR London

+44 20 7626 1982http://www.businesswire.co.uk

(c) 2018 Business Wire, Inc., All rights reserved.

Business Wire, a Berkshire Hathaway company, is the global leader in multiplatform press release distribution.

Subscribe to releases from Business Wire

Subscribe to all the latest releases from Business Wire by registering your e-mail address below. You can unsubscribe at any time.

Latest releases from Business Wire

Blue Yonder Announces Binding Agreement To Acquire One Network Enterprises for Approximately $839 Million To Create Multi-Enterprise Supply Chain Ecosystem29.3.2024 13:13:00 CET | Press release

Blue Yonder, a leader in digital supply chain transformations, continues its forward momentum to revolutionize the supply chain and has today announced the signing of an agreement to acquire One Network Enterprises (One Network) for approximately $839 million, subject to adjustments. One Network, provider of the Digital Supply Chain Network™, is known for its autonomous and resilience services and is a leading global provider of intelligent control towers. Upon completion, Blue Yonder will be well positioned to serve customers’ needs across planning, execution, commerce, and networks. “Supply chains have become more complex, and as more and more companies reduce risk by diversifying sourcing of products globally, there is an increased demand for the sharing of information and resources across the whole value chain. This, along with increased disruptions and geopolitical risks, have put the pressure on organizations to build more resilient and robust supply chains,” said Duncan Angove,

Dubai Electricity and Water Authority PJSC Shareholders Approve Payment of AED 3.1 Billion in Dividends29.3.2024 13:12:00 CET | Press release

Dubai Electricity and Water Authority PJSC (ISIN: AED001801011) (Symbol: DEWA), the Emirate of Dubai’s exclusive electricity and water services provider and majority owner of the largest cooling services provider, which is listed on the Dubai Financial Market (DFM), reported that its shareholders have, in the general assembly held on March 28th, 2024, approved the payment of total dividend of AED 3.1 billion with a record date of April 8th, 2024. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240329162756/en/ Dubai Electricity and Water Authority PJSC shareholders approve payment of AED 3.1 billion in dividends (Photo: AETOSWire) General Assembly Details The meeting, chaired by HE Matar Humaid Al Tayer, Chairman of the Board of Directors of DEWA, was attended by HE Saeed Mohammed Al Tayer, MD & CEO of DEWA and Members of the Board of Directors of DEWA as well as 85.9% of the shareholders. The assembly was held on Thursday (2

PAN Finance Names Libertex ‘Global CFD Broker of the Year’29.3.2024 06:25:00 CET | Press release

As the first quarter of 2024 draws to a close, Libertex is thrilled to announce its first accolade of the new year! The established global financial publication PAN Finance has determined Libertex to be the ‘CFD Broker of the Year – Global 2024’ following a rigorous evaluation process conducted by the publication's highly experienced editorial and research teams. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240328235325/en/ (Graphic: Libertex) PAN Finance is a trusted source of global financial intelligence with an impressively wide readership across 150 countries. Its ecosystem includes a quarterly magazine, special reports, a news website, and various social media channels. As an organisation, PAN Finance is committed to providing concise, intelligent, and up-to-date news for a worldwide readership of specialists spanning the entire finance industry. The company's awards programme aims to serve as a true indicator of exc

Midea Group releases its first-ever ESG brand story with an unexpected VIP visit highlighting its commitment to sustainability.29.3.2024 02:39:00 CET | Press release

Midea Group: This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240328526418/en/ Background: Midea Group, a leading global technology group, recently released its 2023 Environmental, Social, and Governance (ESG) Report with ambitious sustainable development goals set for 2030. They include achieving over 500 megawatts of photovoltaic power generation, reducing greenhouse gas emission intensity (scopes 1 and 2) by 0.040, secure Energy Management System Certification for 50 factories, and achieve 100% carbon footprint accounting for major categories of smart home appliances. This is aligned with the Sustainable Development Report Standards of the Global Report Standards of the Global Reporting Initiative (GRI). The new report and campaign focuses on four dimensions: Protect the Blue Planet, Build a Harmonious Community, Practice 'Bring Great Innovations to Life', and Jointly Create the Prosperous Ecology. The campaign: Midea’s ESG

DC Secretary Announces Annual Determinations Committees Outcome28.3.2024 21:14:00 CET | Press release

DC Administration Services, Inc. has today announced the composition of five regional Determinations Committees (DCs), effective from April 27, 2024. Voting Dealers (for all regions): Voting Non-Dealers (for all regions): Bank of America N.A. Citadel LLC Barclays Bank plc Elliott Management Corporation BNP Paribas Pacific Investment Management Company LLC Citibank, N.A. Deutsche Bank AG Goldman Sachs International JPMorgan Chase Bank, N.A. Voting Dealer for the Americas, EMEA, AEJ, and Japan Determination Committees: Mizuho Securities Co., Ltd. The process for selecting DC members is specified in the DC rules. The DC rules, along with more information about the Determinations Committees and what they do can be found at the Determinations Committees website: https://www.cdsdeterminationscommittees.org/. View source version on businesswire.com: https://www.businesswire.com/news/home/20240328441002/en/Contact information Press Inquiries: Orlando Figueroa orlando.figueroa@citadelspv.com

HiddenA line styled icon from Orion Icon Library.Eye