Paris-based startup LightOn, maker of photonic co-processors for large-scale AI, unveils today PAGnol, a 1.5 billion parameter language model. PAGnol is a collection of large French language models, geared towards free-form text generation — with PAG standing for pré-apprentissage génératif.
Paris-based startup LightOn, maker of photonic co-processors for large-scale AI, unveils today PAGnol, a 1.5 billion parameter language model. PAGnol is a collection of large French language models, geared towards free-form text generation — with PAG standing for pré-apprentissage génératif.
Paris-based startup LightOn, maker of photonic co-processors for large-scale AI, unveils today PAGnol, a 1.5 billion parameter language model. PAGnol is a collection of large French language models, geared towards free-form text generation — with PAG standing for pré-apprentissage génératif.
The 11th edition of the LightOn AI Meetup featured Douwe Kiela, Research Scientist at Facebook AI Research, who was presenting Reservoir Transformers
