Model Library
MetaReleased September 25, 2024Llama 3.2 90B (Vision)
Meta · Released September 25, 2024
Intelligence score
6
At a glance
- Intelligence
- 6
- Speed
- 58.9tokens/sec
- Latency
- 1.20stime to first token
- Input price
- $1.38per 1M tokens
- Output price
- $1.38per 1M tokens
- Context window
- 130Ktokens
- Parameters
- 90billions
Summary
Comparison summary
Llama 3.2 Instruct 90B (Vision) scores 6 (estimated) on the Artificial Analysis Intelligence Index, placing it below average among other open weight non-reasoning models of similar size (median: 7). Llama 3.2 Instruct 90B (Vision) generates output at 58.9 tokens per second (based on the median across providers serving the model), which is below average compared to other open weight non-reasoning models of similar size (median: 81.5 t/s). Llama 3.2 Instruct 90B (Vision) costs $1.38 per 1M input tokens (at the higher end, median: $0.53) and $1.38 per 1M output tokens (somewhat higher than average, median: $1.05), based on the median across providers serving the model.
Specifications
Technical specifications
| Model name | Llama 3.2 90B (Vision) |
|---|---|
| Provider | Meta |
| Release date | September 25, 2024 |
| Intelligence score | 6 |
| Speed | 58.9 tokens/sec |
| Latency (TTFT) | 1.20s |
| Input price | $1.38 / 1M tokens |
| Output price | $1.38 / 1M tokens |
| Context window | 130,000 tokens |
| Parameters | 90B |
| Reasoning | No |
| Input modalities | image |
| Output modalities | — |
| Open weights | Yes |
| License | LLAMA 3 |
| API availability | — |
| Source | Model Intelligence legacy profile: llama-3-2-instruct-90b-vision |
Pricing
Token prices
Price per 1M tokens
Llama 3.2 90B (Vision), as listed in the catalog record
- Input$1.38
- Output$1.38
| Token type | Price per 1M |
|---|---|
| Input | $1.38 |
| Output | $1.38 |
Model Intelligence legacy profile: llama-3-2-instruct-90b-vision
FAQ · 20
Frequently asked questions
Llama 3.2 Instruct 90B (Vision) was released on September 25, 2024.
Llama 3.2 Instruct 90B (Vision) was created by Meta.
Llama 3.2 Instruct 90B (Vision) scores 6 (estimated) on the Artificial Analysis Intelligence Index, placing it below average among other open weight non-reasoning models of similar size (median: 7).
Llama 3.2 Instruct 90B (Vision) generates output at 58.9 tokens per second (based on the median across providers serving the model), which is below average compared to other open weight non-reasoning models of similar size (median: 81.5 t/s).
Llama 3.2 Instruct 90B (Vision) has a time to first token (TTFT) of 1.20s (based on the median across providers serving the model), which is very competitive compared to other open weight non-reasoning models of similar size (median: 1.59s).
Llama 3.2 Instruct 90B (Vision) costs $1.38 per 1M input tokens (at the higher end, median: $0.53) and $1.38 per 1M output tokens (somewhat higher than average, median: $1.05), based on the median across providers serving the model.
Llama 3.2 Instruct 90B (Vision) costs $1.38 per 1M input tokens and $1.38 per 1M output tokens (based on the median across providers serving the model). For a blended rate (7:2:1 cache hit/input/output ratio), this is $1.38 per 1M tokens. Pricing may vary by provider.
No, Llama 3.2 Instruct 90B (Vision) is not a reasoning model. It provides direct responses without extended chain-of-thought reasoning.
Llama 3.2 Instruct 90B (Vision) supports image input.
Llama 3.2 Instruct 90B (Vision) supports text only output.
Yes, Llama 3.2 Instruct 90B (Vision) supports image input and can analyze, describe, and answer questions about images.
No, Llama 3.2 Instruct 90B (Vision) is not multimodal. It only supports image input.
Llama 3.2 Instruct 90B (Vision) has a context window of 130k tokens. This determines how much text and conversation history the model can process in a single request.
Yes, Llama 3.2 Instruct 90B (Vision) is open weights. The model weights are publicly available and can be downloaded for self-hosting.
Llama 3.2 Instruct 90B (Vision) has 90 billion parameters.
Llama 3.2 Instruct 90B (Vision) is released under the LLAMA 3.2 COMMUNITY LICENSE AGREEMENT license. This license allows commercial use.
Llama 3.2 Instruct 90B (Vision) achieves a score of 6 on the Artificial Analysis Intelligence Index. This composite benchmark evaluates models across reasoning, knowledge, mathematics, and coding.
Llama 3.2 Instruct 90B (Vision) has a knowledge cutoff of December 2023. The model's training data includes information up to this date.
Yes, Llama 3.2 Instruct 90B (Vision) is available via API through 2 providers.
Llama 3.2 Instruct 90B (Vision) is available through 2 API providers.