Microsoft: Phi-3 Medium 128K Instruct
Phi-3 128K Medium is a powerful 14-billion parameter model designed for advanced language understanding, reasoning, and instruction following. Optimized through supervised fine-tuning and preference adjustments, it excels in tasks involving common sense, mathematics, logical reasoning, and code processing.
At time of release, Phi-3 Medium demonstrated state-of-the-art performance among lightweight models. In the MMLU-Pro eval, the model even comes close to a Llama3 70B level of performance.
For 4k context length, try Phi-3 Medium 4K.
131,072 Token Context
Process and analyze large documents and conversations.
Advanced Coding
Improved capabilities in front-end development and full-stack updates.
Agentic Workflows
Autonomously navigate multi-step processes with improved reliability.
Available On
| Provider | Model ID | Context | Max Output | Input Cost | Output Cost | Throughput | Latency |
|---|---|---|---|---|---|---|---|
| Nebius AI Studio | nebiusAiStudio | 131K | - | $0.10/M | $0.30/M | 129.3 t/s | 253 ms |
| Azure | azure | 128K | - | $1.00/M | $1.00/M | 58.1 t/s | 738 ms |
per 1K tokens
per 1K tokens