Compact RoBERTa masked LM
The captured record identifies RobertaForMaskedLM with model type roberta for the fill-mask task.
Open Source Model Profile · sshleifer
tiny-distilroberta-base
tiny-distilroberta-base is a compact RoBERTa fill-mask model from sshleifer. The captured record identifies RobertaForMaskedLM with Transformers support.
- Publisher
- sshleifer
- Task
- fill-mask
- Model type
- roberta
- License
- Unknown
- Library
- transformers
- Publication status
- Accepted · not indexed
Model overview
tiny-distilroberta-base is published by sshleifer as a fill-mask model. The captured configuration identifies RobertaForMaskedLM with model type roberta. No model card was captured for this record, so behavioral detail is limited to hub metadata.
Recorded capabilities
Broad Transformers runtimes
Hub tags record transformers with pytorch, tf, and jax compatibility and endpoints support.
Use cases in the source record
- Lightweight masked-language-modeling experiments where a compact RoBERTa checkpoint is sufficient.
Limitations and unknowns
- No model card was captured for this record.
- No parameter count was extracted from this record.
- No license value was extracted from this record.
- No evaluation results were extracted from this record.
- No context-window value was extracted from this record.
- Provider state is historical snapshot data, not independently refreshed current availability.
Source and provenance
Source: sshleifer/tiny-distilroberta-base
Captured: Unknown. Processed: 2026-09-07T19:34:58.497567+00:00.
F001F002F003F004F005F006F007F008