Blog

LightOn Pulse #1

Innovations and Advancements (2024.07)

Training Mamba Models on AMD MI250/MI250X GPUs with Custom Kernels

In this blogpost we show how we can train a Mamba model interchangeably on both NVIDIA and AMD and we compare both training performance and convergence in both cases. This shows that our training stack is becoming more GPU-agnostic.

LightOn delivers an Artificial Intelligence solution with support from Hewlett Packard Enterprise

Paris, July 17, 2024 - LightOn, a French deeptech company specializing in generative AI for enterprises, Today announced that it is collaborating with Hewlett Packard Enterprise (HPE)

Transforming LLMs into Agents for Enterprise Automation

Developing Agentic Capabilities for LLMs to automate business workflows and create smart assistants.

Passing the Torch: Training a Mamba Model for Smooth Handover

We present our explorations on training language models based on the new Mamba architecture, which deviates from the traditional Transformer architecture.

LightOn AI Meetup Creating a Large Dataset for Pretraining LLMs

Partnership LightOn & Orange Business

Orange Business, LightOn, and HPE partner to offer trusted AI generative solutions

Elevating Enterprise AI: Paradigm and Key Insights

WAICF 2024

The Magic of Tokens in Generative AI: A Deep Dive