Intelligence
5 scoreNous Research · Flagships Analysis
Hermes 3 - Llama-3.1 70B
Intelligence, Performance & Price Analysis
Canonical slug: hermes-3-llama-3-1-70b · Canonical model registry at build time
Speed
34.9 output tokens/secLatency
2.17s TTFTInput Price
$0.70 / 1M tokensOutput Price
$0.70 / 1M tokensExecutive Assessment
Routing Verdict & Tradeoffs
Ethen Routing Verdict
Budget-friendly / task-specific model
Hermes 3 - Llama-3.1 70B scores 5 (estimated) on the Artificial Analysis Intelligence Index, placing it below average among other open weight non-reasoning models of similar size (median: 7). Hermes 3 - Llama-3.1 70B generates output at 34.9 tokens per second (based on the median across providers serving the model), which is at the lower end compared to other open weight non-reasoning models of similar size (median: 81.5 t/s). Hermes 3 - Llama-3.1 70B costs $0.70 per 1M input tokens (somewhat higher than average, median: $0.53) and $0.70 per 1M output tokens (better than average, median: $1.05), based on the median across providers serving the model.
Best for high-volume, simple, or domain-specific tasks where cost or speed matters more than deep reasoning.
Task Fit Assessment
| Workload | Rating | Notes |
|---|---|---|
| Complex reasoning & agentic workflows | suboptimal | Intelligence score 5 is better suited for straightforward tasks than multi-step reasoning. |
| High-volume chat & customer-facing | viable | Output speed may be a bottleneck for real-time chat at scale. |
| Latency-sensitive applications | optimal | TTFT 2.17s — adequate latency for most interactive use cases. |
| Cost-sensitive pipelines | optimal | Output pricing at $0.70 is reasonable for moderate volume. |
Cost Pressure Analysis
Medium
Pricing is moderate — input $0.70, output $0.70. Costs accumulate at volume but are manageable for valuable tasks.
Technical Specifications
Architecture and Limits
| Specification | Value | Validation Authority |
|---|---|---|
| Model type | Open weights | inferred |
| Reasoning | No | faq |
| Input modalities | Hermes 3 - Llama-3.1 70B supports text only input. | faq |
| Output modalities | Hermes 3 - Llama-3.1 70B supports text only output. | faq |
| Context window | 130k tokens | faq |
| Open weights / source | Yes, Hermes 3 - Llama-3.1 70B is open weights. The model weights are publicly available and can be downloaded for self-hosting. | faq |
| Parameters | Hermes 3 - Llama-3.1 70B has 70.6 billion parameters. | faq |
| License | Hermes 3 - Llama-3.1 70B is released under the LLAMA 3.1 COMMUNITY LICENSE AGREEMENT license. This license allows commercial use. | faq |
| Knowledge cutoff | Hermes 3 - Llama-3.1 70B has a knowledge cutoff of December 2023. The model's training data includes information up to this date. | faq |
| API availability | Yes, Hermes 3 - Llama-3.1 70B is available via API through 1 provider. | faq |
Evidence charts
Profile visualizations
Charts are the same canonical evidence cards previously published for this slug, contained inside the D18D page grammar.
Artificial Analysis Intelligence Index by Open Weights / Proprietary
Artificial Analysis Intelligence Index v4.1 incorporates 9 evaluations: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Higher values indicate stronger overall capability. Bars show how models compare on composite intelligence metrics.
Artificial Analysis Intelligence Index
Artificial Analysis Intelligence Index v4.1 incorporates 9 evaluations: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Higher values indicate stronger overall capability. Bars show how models compare on composite intelligence metrics.
Artificial Analysis Openness Index: Score
Openness Index assesses model openness on a 0 to 100 normalized scale (higher is more open) · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Bars intentionally show many models at once so the page feels like a benchmark report rather than a dashboard.
Intelligence
Artificial Analysis Intelligence Index · Higher is better · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Higher values indicate stronger overall capability. Bars show how models compare on composite intelligence metrics.
Output Speed
Output tokens per second · Higher is better · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Speed should be read together with latency and cost; fast output does not always mean better user-perceived performance.
Speed
Output tokens per second · Higher is better · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Speed should be read together with latency and cost; fast output does not always mean better user-perceived performance.
End-to-End Response Time
Seconds to output 500 tokens, including reasoning model 'thinking' time · Lower is better · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Bars intentionally show many models at once so the page feels like a benchmark report rather than a dashboard.
Latency: Time To First Answer Token
Seconds to first answer token received · Accounts for reasoning model 'thinking' time · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Latency includes thinking / reasoning time when applicable. Lower is better for interactive use cases.
Context Window
Context window: tokens limit · Higher is better · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Larger context windows enable complex multi-turn tasks but may increase latency and cost for long inputs.
Cost per Intelligence Index Task
Weighted average cost (USD) per Artificial Analysis Intelligence Index task, segmented by token type. Lower is better · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Higher values indicate stronger overall capability. Bars show how models compare on composite intelligence metrics.
Ethen Gateway should route away from this model when the task is simple, repetitive, or likely to generate many output tokens.
Cost per Task
Weighted average cost (USD) per Intelligence Index task · Lower is better · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Ethen Gateway should route away from this model when the task is simple, repetitive, or likely to generate many output tokens.
Cost to Run Artificial Analysis Intelligence Index
Cost (USD) to run all evaluations in the Artificial Analysis Intelligence Index · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Higher values indicate stronger overall capability. Bars show how models compare on composite intelligence metrics.
Ethen Gateway should route away from this model when the task is simple, repetitive, or likely to generate many output tokens.
Pricing: Cache Hit, Input, and Output
Price (USD per M Tokens) · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Bars intentionally show many models at once so the page feels like a benchmark report rather than a dashboard.
Time per Intelligence Index Task
Weighted average decode time (minutes) per task; excludes TTFT and overhead time · Lower is better · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Higher values indicate stronger overall capability. Bars show how models compare on composite intelligence metrics.
Model Size: Total and Active Parameters
Comparison between total model parameters and parameters active during inference · Evaluation results measured independently by Artificial Analysis
Retrieved 2026-07-08
Chart source and provenance are listed in Methodology & sources below.
- Source:
- Published benchmark dataset
- Retrieval date:
- 2026-07-08
- Methodology:
- Independent test run by Artificial Analysis on dedicated hardware.
Larger models generally perform better but cost more to serve. Active parameter count matters for inference efficiency.
Methodology
Methodology & Provenance
This page is rendered from the normalized profile and page JSON for Hermes 3 - Llama-3.1 70B.
Benchmark values are preserved as normalized; only layout, disclosure ordering, and typography are adjusted for readability.
Frequently Asked Questions
Model FAQs & Technical Disclosures
Hermes 3 - Llama-3.1 70B was released on August 15, 2024.
Hermes 3 - Llama-3.1 70B was created by Nous Research.
Hermes 3 - Llama-3.1 70B scores 5 (estimated) on the Artificial Analysis Intelligence Index, placing it below average among other open weight non-reasoning models of similar size (median: 7).
Hermes 3 - Llama-3.1 70B generates output at 34.9 tokens per second (based on the median across providers serving the model), which is at the lower end compared to other open weight non-reasoning models of similar size (median: 81.5 t/s).
Hermes 3 - Llama-3.1 70B has a time to first token (TTFT) of 2.17s (based on the median across providers serving the model), which is somewhat higher than average compared to other open weight non-reasoning models of similar size (median: 1.59s).
Hermes 3 - Llama-3.1 70B costs $0.70 per 1M input tokens (somewhat higher than average, median: $0.53) and $0.70 per 1M output tokens (better than average, median: $1.05), based on the median across providers serving the model.
Hermes 3 - Llama-3.1 70B costs $0.70 per 1M input tokens and $0.70 per 1M output tokens (based on the median across providers serving the model). For a blended rate (7:2:1 cache hit/input/output ratio), this is $0.70 per 1M tokens. Pricing may vary by provider.
No, Hermes 3 - Llama-3.1 70B is not a reasoning model. It provides direct responses without extended chain-of-thought reasoning.
Hermes 3 - Llama-3.1 70B supports text only input.
Hermes 3 - Llama-3.1 70B supports text only output.
No, Hermes 3 - Llama-3.1 70B does not support image input. It can only process text.
No, Hermes 3 - Llama-3.1 70B is not multimodal. It only supports text only input.
Hermes 3 - Llama-3.1 70B has a context window of 130k tokens. This determines how much text and conversation history the model can process in a single request.
Yes, Hermes 3 - Llama-3.1 70B is open weights. The model weights are publicly available and can be downloaded for self-hosting.
Hermes 3 - Llama-3.1 70B has 70.6 billion parameters.
Hermes 3 - Llama-3.1 70B is released under the LLAMA 3.1 COMMUNITY LICENSE AGREEMENT license. This license allows commercial use.
Hermes 3 - Llama-3.1 70B achieves a score of 5 on the Artificial Analysis Intelligence Index. This composite benchmark evaluates models across reasoning, knowledge, mathematics, and coding.
Hermes 3 - Llama-3.1 70B has a knowledge cutoff of December 2023. The model's training data includes information up to this date.
Yes, Hermes 3 - Llama-3.1 70B is available via API through 1 provider.
Hermes 3 - Llama-3.1 70B is available through 1 API provider.