Skip to content

EthenEthenEthen

Open Source Model Profile · rmihaylov

Llama-3-DARE-v2-8B

Llama-3-DARE-v2-8B is an 8.03B-parameter Llama merge from rmihaylov built with mergekit. Its card documents DARE TIES merging on Meta-Llama-3-8B.

Publisher
rmihaylov
Task
text-generation
Model type
llama
License
llama3
Library
transformers
Publication status
Accepted · not indexed

Model overview

Llama-3-DARE-v2-8B is published by rmihaylov as a text-generation model. The captured configuration identifies LlamaForCausalLM with model type llama, and Safetensors metadata reports 8,030,261,248 parameters. According to the model card, it merges pre-trained models with mergekit using the DARE TIES method on meta-llama/Meta-Llama-3-8B as base.

Recorded capabilities

8.03B Llama merge record

Captured Safetensors metadata reports 8,030,261,248 parameters for a LlamaForCausalLM record with model type llama.

DARE TIES merge method

According to the model card, the model was merged with the DARE TIES method using meta-llama/Meta-Llama-3-8B as base.

Instruct model included

The card names meta-llama/Meta-Llama-3-8B-Instruct among the merged models and shows a bfloat16 dare_ties YAML configuration.

Use cases in the source record

  • Conversational text-generation experiments matching the record’s conversational and text-generation-inference markers.
  • Transformers-based Llama merge workflows that can load the LlamaForCausalLM record through the documented library stack.

Limitations and unknowns

  • No evaluation results were extracted from this record.
  • No context-window value was extracted from this record.
  • The detailed YAML density and filter values are publisher-provided merge configuration and were not independently validated.
  • Provider state is historical snapshot data and should be refreshed before being presented as current.

Source and provenance

Source: rmihaylov/Llama-3-DARE-v2-8B

Captured: Unknown. Processed: 2026-09-07T19:34:56.791910+00:00.

Llama-3-DARE-v2-8B This is a merge of pre-trained language models created using mergekit . Merge Details Merge Method This model was merged using the DARE TIES merge method using meta-llama/Meta-Llama-3-8B as a base. Models Merged The following models were included in the merge: meta-llama/Meta-Llama-3-8B-Instruct Configuration The following YAML configuration was used to produce this model: base_model: model: path: meta-llama/Meta-Llama-3-8B dtype: bfloat16 merge_method: dare_ties parameters: int8_mask: 1.0 normalize: 0.0 slices: - sources: - layer_range: [ 0 , 32 ] model: model: path: meta-llama/Meta-Llama-3-8B-Instruct parameters…

F001F002F003F004F005F006F007F008F009F010F011F012F013F014F015F016F017