Of Cats and Cheese: The importance of natively trained language models
Paris-based startup LightOn, maker of photonic co-processors for large-scale AI, unveils today PAGnol, a 1.5 billion parameter language model. PAGnol is a collection of large French language models, geared towards free-form text generation — with PAG standing for pré-apprentissage génératif.