Albertina PT-PT base is a foundation, large language model for European Portuguese from Portugal.

It is an encoder of the BERT family, based on the neural architecture Transformer and developed over the DeBERTa model, with most competitive performance for this language. It is distributed free of charge and under a most permissible license.

You may be also interested in Albertina PT-PT. This is a larger version, and to the best of our knowledge, this is an encoder specifically for this language and variant that, at the time of its initial distribution, sets a new state of the art for it, and is made publicly available and distributed for reuse.

Albertina PT-PT base is developed by a joint team from the University of Lisbon and the University of Porto, Portugal.