Skip to content

EthenEthenEthen

Open Source Model Profile · dccuchile

bert-base-spanish-wwm-uncased

bert-base-spanish-wwm-uncased is the uncased BETO Spanish BERT fill-mask model from dccuchile, trained with whole-word masking on a big Spanish corpus.

Publisher
dccuchile
Task
fill-mask
Model type
bert
License
Unknown
Library
transformers
Publication status
Accepted · not indexed

Model overview

bert-base-spanish-wwm-uncased is published by dccuchile as a BERT fill-mask model. The captured configuration identifies BertForMaskedLM with model type bert and Transformers support. According to the model card, it is the uncased BETO variant, a Spanish BERT model trained on a big Spanish corpus with Whole Word Masking.

Recorded capabilities

Spanish BERT fill-mask model

According to the model card, BETO is a BERT model trained on a big Spanish corpus, captured as BertForMaskedLM for the fill-mask task.

Whole-word masking with 31k vocabulary

According to the model card, the model uses Whole Word Masking with about 31k BPE subwords built with SentencePiece and 2M training steps.

Transformers multi-framework record

Hub data records Transformers support with PyTorch, TensorFlow, JAX, and endpoints-compatible markers.

Use cases in the source record

  • Spanish masked-language-modeling and fill-mask experiments using the publisher's documented uncased BETO checkpoint.
  • Spanish NLP evaluations that revisit the card's comparison of BETO against multilingual BERT baselines.

Limitations and unknowns

  • No parameter count was extracted from this record.
  • No context-window value was extracted from this record.
  • License is unresolved: structured metadata carries no license and the card's CC BY 4.0 statement is an uncertain intent disclaimer.
  • Benchmark tables are referenced but no numeric scores were extracted; comparison claims reflect literature as of October 2019.
  • Provider state is historical snapshot data and should be refreshed before being presented as current.

Source and provenance

Source: dccuchile/bert-base-spanish-wwm-uncased

Captured: Unknown. Processed: 2026-09-07T19:34:43.428916+00:00.

BETO: Spanish BERT BETO is a BERT model trained on a big Spanish corpus . BETO is of size similar to a BERT-Base and was trained with the Whole Word Masking technique. Below you find Tensorflow and Pytorch checkpoints for the uncased and cased versions, as well as some results for Spanish benchmarks comparing BETO with Multilingual BERT as well as other (not BERT-based) models. Download BETO uncased tensorflow_weights pytorch_weights vocab , config BETO cased tensorflow_weights pytorch_weights vocab , config All models use a vocabulary of about 31k BPE subwords constructed using SentencePiece and were trained for 2M steps. Benchmark…

F001F002F003F004F005F006F007F008F009F010F011F012F014