Meta: Llama 3.1 8B Instruct

Public pricingIntelligence 65/100Small memoryTool use

Meta: Llama 3.1 8B Instruct is a text model for general chat, analysis, and production use. It combines low latency and efficient inference with a 16K tokens context window and a low-cost profile. Use it for general chat, analysis, and production workloads when latency, cost, and throughput matters.

Input

$0.02/1M

Output

$0.05/1M

Cached

$0.01/1M

Batch

$0.01/1M

Calculate your Llama 3.1 8B Instruct bill.

Set your workload — see cost at your exact volume.

What would Llama 3.1 8B Instruct cost you?

Adjust the workload to see your monthly bill.

1,00010,00050,000250,0001M10M

Technical specifications

Llama 3.1 8B Instruct at a glance.

Memory

16,384

tokens

Max reply

16,384

tokens

Memory tier

Small

a few emails or a short document

Tokenizer

llama3

Released

Jul 2024

Training cutoff

Dec 2023

Availability

Public pricing

Status

active

Benchmarks

Quality benchmarks

Independent evaluations from public leaderboards. Higher is better.

  • mmlu

    73

  • mmlu_pro

    48.3

  • gpqa_diamond

    30.4

  • humaneval

    72.6

  • math

    51.9

  • ifeval

    80.4

  • chatbot_arena_elo

    1175

  • scipredict

    14.65

What it can do

Capabilities & limits.

  • Understands images
  • Deep step-by-step thinking
  • Uses tools / calls functions
  • Strict JSON output
  • Streams replies
  • Fine-tunable on your data

When to pick Llama 3.1 8B Instruct

  • Agentic workflows that call tools or APIs.
  • High-volume workloads where unit cost matters.

When to look elsewhere

  • Your workload involves images — pick a vision-capable model instead.
  • Your inputs routinely exceed short documents.

Alternatives

Similar models to compare.

FAQ

Llama 3.1 8B Instruct — the questions we see most.

Pricing, capabilities, alternatives — generated from the same data that powers the calculator above.

Get instant answers from our AI agent

At a typical workload of 50,000 conversations a month with 1,500-token prompts and 800-token replies, Llama 3.1 8B Instruct costs roughly $4 per month. Input is $0.02 /1M tokens and output is $0.05 /1M tokens.
Llama 3.1 8B Instruct has a 16,384-token context window (small memory — a few emails or a short document). That means you can fit about 3,072 words of input and history in a single call.
Beyond text generation, Llama 3.1 8B Instruct supports calling functions / tools, strict JSON output, fine-tuning on your own data. It streams replies by default.
Llama 3.1 8B Instruct was released in July 2024, with training data cut off around December 2023.
Models in a similar class include Llama 3.2 1B Instruct, Llama 3 8B Instruct, Llama 3.2 3B Instruct. The "Similar models" section below this FAQ links into each.

Still unsure?

Compare Llama 3.1 8B Instruct against 100+ other models.

Open the full wizard — pick a use case, set your usage, and see side-by-side monthly costs in under a minute.

Open the comparison wizard