Skip to content

EthenEthenEthen

Open Source Model Profile · hfl

rbtl3

rbtl3 is a fill-mask model from hfl. The model card describes it as a re-trained 3-layer RoBERTa-wwm-ext-large model for Chinese natural language processing.

Publisher
hfl
Task
fill-mask
Model type
bert
License
apache-2.0
Library
transformers
Publication status
Accepted · not indexed

Model overview

rbtl3 is published by hfl as a fill-mask model. The captured configuration identifies BertForMaskedLM with model type bert. According to the model card, it is a re-trained 3-layer RoBERTa-wwm-ext-large model associated with Chinese BERT with Whole Word Masking.

Recorded capabilities

3-layer RoBERTa-wwm-ext-large description

The model card describes rbtl3 as a re-trained 3-layer RoBERTa-wwm-ext-large model.

Chinese Whole Word Masking focus

According to the model card, the work concerns Chinese BERT with Whole Word Masking for Chinese natural language processing.

Research and citation context

The model card points to the google-research/bert repository and lists related Chinese BERT-series resources with two arXiv citations.

Use cases in the source record

  • Chinese fill-mask workflows using a model associated with Whole Word Masking pre-training.
  • Research reference for Chinese BERT whole-word-masking reports cited in the model card.

Limitations and unknowns

  • No parameter count was extracted from this record.
  • No evaluation results were extracted from this record.
  • Provider state is historical snapshot data, not independently refreshed current availability.
  • Training and lineage details come from the publisher model card and have not been independently verified by Ethen.

Source and provenance

Source: hfl/rbtl3

Captured: Unknown. Processed: 2026-09-07T19:34:46.469635+00:00.

This is a re-trained 3-layer RoBERTa-wwm-ext-large model. Chinese BERT with Whole Word Masking For further accelerating Chinese natural language processing, we provide Chinese pre-trained BERT with Whole Word Masking . Pre-Training with Whole Word Masking for Chinese BERT Yiming Cui, Wanxiang Che, Ting Liu, Bing Qin, Ziqing Yang, Shijin Wang, Guoping Hu This repository is developed based on: https://github.com/google-research/bert You may also interested in, Chinese BERT series: https://github.com/ymcui/Chinese-BERT-wwm Chinese MacBERT: https://github.com/ymcui/MacBERT Chinese ELECTRA: https://github.com/ymcui/Chinese-ELECTRA Chines…

F001F002F003F004F005F006F007F009F010F011F012F013