Back
Meta: Llama 3.1 8B Instruct
Llama3
Input: text
Output: text
Released: Jul 23, 2024•Updated: Mar 28, 2025
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient.
It has demonstrated strong performance compared to leading closed-source models in human evaluations.
To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.
131,000 Token Context
Process and analyze large documents and conversations.
Advanced Coding
Improved capabilities in front-end development and full-stack updates.
Agentic Workflows
Autonomously navigate multi-step processes with improved reliability.
Available On
| Provider | Model ID | Context | Max Output | Input Cost | Output Cost | Throughput | Latency |
|---|---|---|---|---|---|---|---|
| Kluster | klusterAi | 131K | 131K | $0.02/M | $0.03/M | 43.7 t/s | 791 ms |
| InferenceNet | inferenceNet | 16K | 16K | $0.02/M | $0.03/M | 49.6 t/s | 1414 ms |
| DeepInfra | deepInfra (turbo) | 131K | 16K | $0.02/M | $0.03/M | 106.2 t/s | 542 ms |
| Novita | novitaAi | 16K | 131K | $0.02/M | $0.05/M | 86.1 t/s | 817 ms |
| Nebius | nebiusAiStudio | 131K | - | $0.02/M | $0.06/M | 66.9 t/s | 462 ms |
| Lambda | lambda | 131K | 131K | $0.02/M | $0.04/M | 25.5 t/s | 531 ms |
| DeepInfra | deepInfra | 131K | 16K | $0.03/M | $0.05/M | 54.5 t/s | 332 ms |
| Cloudflare | cloudflare | 32K | - | $0.04/M | $0.38/M | 23.7 t/s | 798 ms |
| Groq | groq | 131K | 131K | $0.05/M | $0.08/M | 1428.6 t/s | 286 ms |
| Hyperbolic | hyperbolic | 131K | - | $0.10/M | $0.10/M | 249.5 t/s | 1170 ms |
| Cerebras | cerebras | 32K | 32K | $0.10/M | $0.10/M | 3568.3 t/s | 141 ms |
| Friendli | friendli | 131K | 8K | $0.10/M | $0.10/M | 294.9 t/s | 149 ms |
| SambaNova | sambaNova | 16K | 4K | $0.10/M | $0.20/M | 887.2 t/s | 215 ms |
| Together | together | 131K | - | $0.18/M | $0.18/M | 227.8 t/s | 279 ms |
| Fireworks | fireworks | 131K | - | $0.20/M | $0.20/M | 289.8 t/s | 287 ms |
| Avian | avianIo | 131K | - | $0.20/M | $0.20/M | - | - |
Standard Pricing
Input Tokens
$0.000000019
per 1K tokens
Output Tokens
$0.00000003
per 1K tokens