Ignorance is Bliss: Adversarial Robustness by Design with LightOn OPUs
Paris-based startup LightOn, maker of photonic co-processors for large-scale AI, unveils today PAGnol, a 1.5 billion parameter language model. PAGnol is a collection of large French language models, geared towards free-form text generation — with PAG standing for pré-apprentissage génératif.