BERT2BERT mini fine-tune
According to the model card, the checkpoint is a warm-started BERT2BERT mini model fine-tuned on CNN/DailyMail.
Open Source Model Profile · mrm8488
bert-mini2bert-mini-finetuned-cnn_daily_mail-summarization is a 23.43M-parameter EncoderDecoder summarization fine-tune from mrm8488. According to the model card, it is a warm-started BERT2BERT mini model fine-tuned on CNN/DailyMail.
The model is published by mrm8488 as a summarization checkpoint. The captured configuration identifies EncoderDecoderModel with model type encoder-decoder, and Safetensors metadata reports 23,427,898 parameters. According to the model card, it was fine-tuned on the CNN/DailyMail summarization dataset.
According to the model card, the checkpoint is a warm-started BERT2BERT mini model fine-tuned on CNN/DailyMail.
According to the model card, the model achieves 16.51 ROUGE-2 on the CNN/DailyMail test set.
According to the model card, inference uses BertTokenizerFast and EncoderDecoderModel with 512-token truncation.
Source: mrm8488/bert-mini2bert-mini-finetuned-cnn_daily_mail-summarization
Captured: Unknown. Processed: 2026-09-07T19:34:52.613194+00:00.
Bert-mini2Bert-mini Summarization with 🤗EncoderDecoder Framework This model is a warm-started BERT2BERT ( mini ) model fine-tuned on the CNN/Dailymail summarization dataset. The model achieves a 16.51 ROUGE-2 score on CNN/Dailymail 's test dataset. For more details on how the model was fine-tuned, please refer to this notebook. Results on test set 📝 Metric # Value ROUGE-2 16.51 Model in Action 🚀 from transformers import BertTokenizerFast, EncoderDecoderModel import torch device = torch.device( 'cuda' if torch.cuda.is_available() else 'cpu' ) tokenizer = BertTokenizerFast.from_pretrained( 'mrm8488/bert-mini2bert-mini-finetuned-cnn…
F001F002F003F004F005F006F007F008F009F010F011F012F014