June 17th, 2021 | LightOn Qore in a Nutshell
June 4th, 2021 | Summary of LightOn AI Meetup #14: “WeightWatcher: a Diagnostic Tool for Deep Neural Networks” – Invited Speaker: Charles Martin
It is about the one-year mark since we started our (virtual) LightOn AI Meetups, and to mark the anniversary 🥳, we had Charles Martin as a guest speaker. Charles is the Chief Scientist at Calculation Consulting and presented his work on WeightWatcher: a Diagnostic Tool for Deep Neural Networks, a Python package built around a series of papers.
April 23rd, 2021 | Summary of LightOn AI meetup #13: “Efficient Neural Networks Training through Locality Sensitive Hashing” – Invited Speaker: Beidi Chen
Beidi Chen, a Postdoc Researcher at Stanford, was the guest of LightOn’s 13th AI Meetup and presented her work on SLIDE&MONGOOSE: LSH Frameworks for Efficient Neural Networks Training⚡ to appear at ICLR 2021. The 📺 recording of the meetup is on LightOn’s Youtube channel. Subscribe to the channel and subscribe to our Meetup to get notified of the next videos and events!
April 6th, 2021 | The $1,000 GPT-3
Progress usually comes from a steady technology bootstrap…until it doesn’t. Take for instance the race for the $1,000 genome that started in the early 2000s. Initially, sequencing the human genome meant a race between the well-funded public and private sectors but more importantly, the resources for the first breakthrough ended up costing upwards of $450M.
March 24th, 2021 | Computing with Light: How LightOn intends to unlock Transformative AI
Igor Carron, our CEO and co-founder, gave a talk at #mathia2021 conference on March 9th, 2021 where he drew a parallel between the scaling laws that enabled industrialization in the 1920s and the new scaling laws in AI of the 2020s. AI is at its infancy and it needs to have guiding principles (as embedded in these empirical laws) while also needs to develop new hardware. Igor showed how, in this context, LightOn can help unlock Transformative AI. Enjoy!
March 20th, 2021 | Summary of LightOn AI meetup #12: “Fast Graph Classification with LightOn Optical Processing Units” – Invited Speaker: Hashem Ghanem
At the 12th LightOn AI Meetup, we hosted Hashem Ghanem, a Ph.D. student at GIPSA-Lab, Grenoble, and IMB, Dijon, who presented his work on🕸️ Fast Graph Kernel with Optical Random Features ⚡ to appear at ICASSP 2021. The 📺 recording of the meetup is on LightOn’s Youtube channel. Subscribe to the channel and subscribe to our Meetup to get notified of the next videos and events!
March 8th, 2021 | LightOn Appliance, a photonic co-processor sets a new pathway for Transformative AI computing
Several months ago, we released LightOn Appliance, the world’s most powerful photonic co-processor for AI and HPC. We originally had our technology available on the cloud with a nascent community, however, now it can be installed on-premises, as a 2U rackable unit.
February 19th, 2021 | Summary of LightOn AI meetup #11: “Reservoir Transformers: train faster with fewer parameters, and get better results” – Invited Speaker: Douwe Kiela
The 11th edition of the LightOn AI Meetup featured Douwe Kiela, Research Scientist at Facebook AI Research, who was presenting Reservoir Transformers 🛢️ The 📺 recording of the meetup is on LightOn’s Youtube channel. Subscribe to the channel and subscribe to our Meetup to get notified of the next videos and events!
January 18th, 2021 | Summary of LightOn AI meetup #10: “Rethinking Attention with Performers: Towards New Transformers’ Revolution” – Invited Speaker: Krzysztof Choromanski
For the 10th edition of the LightOn AI Meetup we had Krzysztof Choromanski, Research Scientist at Google Robotics NYC and Adjunct Assistant Professor at Columbia University, presenting his work on Rethinking Attention with Performers, which will appear as an oral presentation at ICLR 2021. Congratulations Krzysztof and co-authors!
October 13th, 2020 | Summary of LightOn AI meetup #6: “Slash the training cost of your models with random learning signals and without feedback”. Invited Speakers: Charlotte Frenkel and Martin Lefevbre