LightOn's Large Language Model of 40 billion parameters: MINI

Boasting an impressive 40 billion parameters, Mini is a formidable addition to the growing array of language models available in the market today. Despite its diminutive size that allows deployment at scale, the model packs a powerful punch and delivers  results that are on par or better than much larger models.

The amount of data in Mini corpus is 1 trillion tokens. We mainly used data from the public web to pre-train our model, with strong filtering, toxicity reduction, and deduplication to ensure that only high-quality data is retained.

Mini is now the flagship model of the Paradigm offer, with a unique focus on data sovereignty and security. With Paradigm, the Mini model is fully deployed within the company's infrastructure (on premises or private clouds), ensuring that data is kept confidential and secure. This is of utmost importance to firms dealing with sensitive information, such as  high-tech, financial and healthcare institutions.

Mini's extraordinary ability to perform any natural language processing (NLP) / natural language generation (NLG) tasks with exceptional precision enables double-digit productivity gains across the Enterprise, including marketing, client support, production, and human resources. Mini  is capable of comprehending intricate language structures and generating responses that are both articulate and natural-sounding, making it an ideal solution for a wide range of applications, including chatbots, sentiment analysis, classification, and summarization. Not only does this compact yet potent model exhibit exceptional performance, but it also boasts multilingual capabilities, seamlessly functioning across a diverse range of languages including but not limited to English, French, Italian, Spanish, German, and Portuguese.

LightOn's focus on data sovereignty is a reflection of its unwavering commitment to ensuring the protection of sensitive data. Mini represents LightOn's latest effort to provide Enterprise clients with a solution that addresses these concerns, while simultaneously delivering unparalleled accuracy and performance.

For more information on Mini, Paradigm, and LightOn's other AI solutions, please visit the website or contact the team today.