Albertina PT-BR base is a foundation, large language model for American Portuguese from Brazil.

It is an encoder of the BERT family, based on the neural architecture Transformer and developed over the DeBERTa model, with most competitive performance for this language. It is distributed free of charge and under a most permissible license.

You may be also interested in Albertina PT-BR and in Albertina PT-BR No-brWaC. These are larger versions, and to the best of our knowledge, these are encoders specifically for this language and variant that, at the time of its initial distribution, set a new state of the art for it, and are made publicly available and distributed for reuse.

Albertina PT-BR base is developed by a joint team from the University of Lisbon and the University of Porto, Portugal.