July 7th, 2022 | Des chats et des fromages, ou De l’importance des modèles de langage nativement entraînés
May 30th, 2022 | Of Cats and Cheese: The importance of natively trained language models
In this blog post we show that using an English language model plus translation layers can lead to generated text that does not take into account cultural and regional preferences. In contrast, a natively trained model avoids these pitfalls and consequently produces text that is more appropriate to the target audience.
April 12th, 2022 | LightOn publicly launches Muse, an API to VLM-4 Large Language Models trained natively in five European Languages
Paris-based LightOn today announced the public release of Muse, an API that leverages state-of-the-art AI to democratize Natural Language Processing (NLP) for everyone, everywhere.
December 28th, 2021 | LightOn Photonic coprocessor integrated into European AI Supercomputer
It is with immense pride and pleasure to announce that LightOn’s OPU has been installed in one of the world’s Top500 supercomputers as part of a pilot program with GENCI and IDRIS/CNRS.
October 7th, 2021 | Bringing containers to light
At LightOn, we keep the innovation going on all aspects of hardware and software, to better serve our users. We recently moved our cloud infrastructure into containers, with great features for LightOn Cloud users. We had fun, and wanted to share some of the details that stood out during this project.
June 17th, 2021 | LightOn Qore in a Nutshell
At LightOn, we recently announced a future quantum product called Qore. This blog post explains what this new product is and how it is a radical departure from traditional approaches to Quantum Computing. You may want to read the initial press release.
June 4th, 2021 | Summary of LightOn AI Meetup #14: “WeightWatcher: a Diagnostic Tool for Deep Neural Networks” – Invited Speaker: Charles Martin
It is about the one-year mark since we started our (virtual) LightOn AI Meetups, and to mark the anniversary 🥳, we had Charles Martin as a guest speaker. Charles is the Chief Scientist at Calculation Consulting and presented his work on WeightWatcher: a Diagnostic Tool for Deep Neural Networks, a Python package built around a series of papers.
April 23rd, 2021 | Summary of LightOn AI meetup #13: “Efficient Neural Networks Training through Locality Sensitive Hashing” – Invited Speaker: Beidi Chen
Beidi Chen, a Postdoc Researcher at Stanford, was the guest of LightOn’s 13th AI Meetup and presented her work on SLIDE&MONGOOSE: LSH Frameworks for Efficient Neural Networks Training⚡ to appear at ICLR 2021. The 📺 recording of the meetup is on LightOn’s Youtube channel. Subscribe to the channel and subscribe to our Meetup to get notified of the next videos and events!
April 6th, 2021 | The $1,000 GPT-3
Progress usually comes from a steady technology bootstrap…until it doesn’t. Take for instance the race for the $1,000 genome that started in the early 2000s. Initially, sequencing the human genome meant a race between the well-funded public and private sectors but more importantly, the resources for the first breakthrough ended up costing upwards of $450M.
March 24th, 2021 | Computing with Light: How LightOn intends to unlock Transformative AI
Igor Carron, our CEO and co-founder, gave a talk at #mathia2021 conference on March 9th, 2021 where he drew a parallel between the scaling laws that enabled industrialization in the 1920s and the new scaling laws in AI of the 2020s. AI is at its infancy and it needs to have guiding principles (as embedded in these empirical laws) while also needs to develop new hardware. Igor showed how, in this context, LightOn can help unlock Transformative AI. Enjoy!
March 20th, 2021 | Summary of LightOn AI meetup #12: “Fast Graph Classification with LightOn Optical Processing Units” – Invited Speaker: Hashem Ghanem
At the 12th LightOn AI Meetup, we hosted Hashem Ghanem, a Ph.D. student at GIPSA-Lab, Grenoble, and IMB, Dijon, who presented his work on🕸️ Fast Graph Kernel with Optical Random Features ⚡ to appear at ICASSP 2021. The 📺 recording of the meetup is on LightOn’s Youtube channel. Subscribe to the channel and subscribe to our Meetup to get notified of the next videos and events!
March 8th, 2021 | LightOn Appliance, a photonic co-processor sets a new pathway for Transformative AI computing
Several months ago, we released LightOn Appliance, the world’s most powerful photonic co-processor for AI and HPC. We originally had our technology available on the cloud with a nascent community, however, now it can be installed on-premises, as a 2U rackable unit.
February 19th, 2021 | Summary of LightOn AI meetup #11: “Reservoir Transformers: train faster with fewer parameters, and get better results” – Invited Speaker: Douwe Kiela
The 11th edition of the LightOn AI Meetup featured Douwe Kiela, Research Scientist at Facebook AI Research, who was presenting Reservoir Transformers 🛢️ The 📺 recording of the meetup is on LightOn’s Youtube channel. Subscribe to the channel and subscribe to our Meetup to get notified of the next videos and events!
January 18th, 2021 | Summary of LightOn AI meetup #10: “Rethinking Attention with Performers: Towards New Transformers’ Revolution” – Invited Speaker: Krzysztof Choromanski
For the 10th edition of the LightOn AI Meetup we had Krzysztof Choromanski, Research Scientist at Google Robotics NYC and Adjunct Assistant Professor at Columbia University, presenting his work on Rethinking Attention with Performers, which will appear as an oral presentation at ICLR 2021. Congratulations Krzysztof and co-authors!
October 13th, 2020 | Summary of LightOn AI meetup #6: “Slash the training cost of your models with random learning signals and without feedback”. Invited Speakers: Charlotte Frenkel and Martin Lefevbre