The aim of DeepR3 is to investigate new efficient methods to extend, reuse and adapt existing pre-trained language models for Spanish, Catalan, Basque, Galician plus English. The models will be exploited in new domains, genres and languages and applied to different use cases such as the biomedical domain, machine translation or text generation from meteorological data.

The results of DeepR3 will have a direct impact on both the Ecological Transition by avoiding unnecessary waste of energy.

Partners: