The Technology Innovation Institute (TII), Abu Dhabi's premier scientific research centre under the Advanced Technology Research Council (ATRC), has launched the Falcon Mamba 7B, a new addition to its Falcon series of AI models.
This latest model is recognized as the top-performing open-source State Space Language Model (SSLM) globally, according to independent verification by Hugging Face.
Falcon Mamba 7B is a significant departure from previous Falcon models, utilizing an SSLM architecture rather than the traditional transformer-based design. This advancement underscores TII's commitment to pioneering research and providing cutting-edge tools to the global community in an open-source format.
Faisal Al Bannai, Secretary-General of ATRC, highlighted the model's launch as a testament to Abu Dhabi's position as a global hub for AI research, reflecting the UAE's dedication to innovation. The Falcon Mamba 7B outperforms leading models like Meta’s Llama 3.1 8B and Mistral’s 7B on new benchmarks, cementing its place at the top of the leaderboard.
Dr. Najwa Aaraj, CEO of TII, praised the Falcon Mamba 7B as a breakthrough that paves the way for future AI innovations. The model's SSLM architecture excels in tasks requiring understanding of complex, time-evolving situations, while also being effective in Natural Language Processing (NLP), machine translation, and more.
Falcon Mamba 7B’s development is a result of TII's collaborative ecosystem, according to Dr. Hakim Hacid, Acting Chief Researcher of TII’s AI Cross-Centre Unit. The model has already garnered significant interest, with over 45 million downloads of previous Falcon LLMs. It will be released under the TII Falcon Licence 2.0, which promotes responsible AI usage.
More details about the Falcon Mamba 7B can be found on TII's dedicated Falcon LLM website.
News Source: Emirates News Agency
