Model Library
MetaReleased July 23, 2024Llama 3.1 405B
Meta · Released July 23, 2024
Intelligence score
9
At a glance
- Intelligence
- 9
- Speed
- 84.7tokens/sec
- Latency
- 2.45stime to first token
- Input price
- $2.75per 1M tokens
- Output price
- $6.50per 1M tokens
- Context window
- 130Ktokens
- Parameters
- 405billions
Summary
Comparison summary
Llama 3.1 Instruct 405B scores 9 (estimated) on the Artificial Analysis Intelligence Index, placing it below average among other open weight non-reasoning models of similar size (median: 17). Llama 3.1 Instruct 405B generates output at 84.7 tokens per second (based on the median across providers serving the model), which is well above average compared to other open weight non-reasoning models of similar size (median: 58.3 t/s). Llama 3.1 Instruct 405B costs $2.75 per 1M input tokens (at the higher end, median: $0.60) and $6.50 per 1M output tokens (at the higher end, median: $2.40), based on the median across providers serving the model.
Specifications
Technical specifications
| Model name | Llama 3.1 405B |
|---|---|
| Provider | Meta |
| Release date | July 23, 2024 |
| Intelligence score | 9 |
| Speed | 84.7 tokens/sec |
| Latency (TTFT) | 2.45s |
| Input price | $2.75 / 1M tokens |
| Output price | $6.50 / 1M tokens |
| Context window | 130,000 tokens |
| Parameters | 405B |
| Reasoning | No |
| Input modalities | text |
| Output modalities | — |
| Open weights | Yes |
| License | LLAMA 3 |
| API availability | — |
| Source | Model Intelligence legacy profile: llama-3-1-instruct-405b |
Pricing
Token prices
Price per 1M tokens
Llama 3.1 405B, as listed in the catalog record
- Input$2.75
- Output$6.50
| Token type | Price per 1M |
|---|---|
| Input | $2.75 |
| Output | $6.50 |
Model Intelligence legacy profile: llama-3-1-instruct-405b
FAQ · 20
Frequently asked questions
Llama 3.1 Instruct 405B was released on July 23, 2024.
Llama 3.1 Instruct 405B was created by Meta.
Llama 3.1 Instruct 405B scores 9 (estimated) on the Artificial Analysis Intelligence Index, placing it below average among other open weight non-reasoning models of similar size (median: 17).
Llama 3.1 Instruct 405B generates output at 84.7 tokens per second (based on the median across providers serving the model), which is well above average compared to other open weight non-reasoning models of similar size (median: 58.3 t/s).
Llama 3.1 Instruct 405B has a time to first token (TTFT) of 2.45s (based on the median across providers serving the model), which is somewhat higher than average compared to other open weight non-reasoning models of similar size (median: 2.33s).
Llama 3.1 Instruct 405B costs $2.75 per 1M input tokens (at the higher end, median: $0.60) and $6.50 per 1M output tokens (at the higher end, median: $2.40), based on the median across providers serving the model.
Llama 3.1 Instruct 405B costs $2.75 per 1M input tokens and $6.50 per 1M output tokens (based on the median across providers serving the model). For a blended rate (7:2:1 cache hit/input/output ratio), this is $3.13 per 1M tokens. Pricing may vary by provider.
No, Llama 3.1 Instruct 405B is not a reasoning model. It provides direct responses without extended chain-of-thought reasoning.
Llama 3.1 Instruct 405B supports text only input.
Llama 3.1 Instruct 405B supports text only output.
No, Llama 3.1 Instruct 405B does not support image input. It can only process text.
No, Llama 3.1 Instruct 405B is not multimodal. It only supports text only input.
Llama 3.1 Instruct 405B has a context window of 130k tokens. This determines how much text and conversation history the model can process in a single request.
Yes, Llama 3.1 Instruct 405B is open weights. The model weights are publicly available and can be downloaded for self-hosting.
Llama 3.1 Instruct 405B has 405 billion parameters.
Llama 3.1 Instruct 405B is released under the LLAMA 3.1 COMMUNITY LICENSE AGREEMENT license. This license allows commercial use.
Llama 3.1 Instruct 405B achieves a score of 9 on the Artificial Analysis Intelligence Index. This composite benchmark evaluates models across reasoning, knowledge, mathematics, and coding.
Llama 3.1 Instruct 405B has a knowledge cutoff of December 2023. The model's training data includes information up to this date.
Yes, Llama 3.1 Instruct 405B is available via API through 4 providers.
Llama 3.1 Instruct 405B is available through 4 API providers.