Mistral-7B-OpenOrca

Model overview

Mistral-7B-OpenOrca is published by Open-Orca as a text-generation model. The captured configuration identifies MistralForCausalLM with model type mistral. According to the model card, it fine-tunes Mistral 7B on OpenOrca data with OpenChat packing in Axolotl and ChatML formatting.

Recorded capabilities

Use cases in the source record

• Conversational text generation using the documented ChatML format and MistralOrca system prompt.
• Instruction-tuning comparison using the card's publisher-reported leaderboard and AGI Eval figures as attributed claims.

Limitations and unknowns

• No parameter count was extracted from structured metadata.
• No context-window value was extracted from this record.
• Leaderboard, AGI Eval, and BigBench-Hard figures are publisher-reported claims, not independently verified.
• Provider state is historical snapshot data, not independently refreshed current availability.

Source and provenance

Source: Open-Orca/Mistral-7B-OpenOrca

Captured: Unknown. Processed: 2026-09-07T19:34:35.347641+00:00.

🐋 Mistral-7B-OpenOrca 🐋 OpenOrca - Mistral - 7B - 8k We have used our own OpenOrca dataset to fine-tune on top of Mistral 7B . This dataset is our attempt to reproduce the dataset generated for Microsoft Research's Orca Paper . We use OpenChat packing, trained with Axolotl . This release is trained on a curated filtered subset of most of our GPT-4 augmented data. It is the same subset of our data as was used in our OpenOrcaxOpenChat-Preview2-13B model . HF Leaderboard evals place this model as #1 for all models smaller than 30B at release time, outperforming all other 7B and 13B models! This release provides a first: a fully open…