Meta: Llama 3 8B Instruct

Public pricingIntelligence 71/100Small memoryTool use

Meta: Llama 3 8B Instruct is a text model for general chat, analysis, and production use. It combines steady general-purpose performance with a 8K tokens context window and a low-cost profile. Use it for general chat, analysis, and production workloads when quality, speed, and cost matters.

Input

$0.03/1M

Output

$0.04/1M

Cached

$0.01/1M

Batch

$0.01/1M

Calculate your Llama 3 8B Instruct bill.

Set your workload — see cost at your exact volume.

What would Llama 3 8B Instruct cost you?

Adjust the workload to see your monthly bill.

1,00010,00050,000250,0001M10M

Technical specifications

Llama 3 8B Instruct at a glance.

Memory

8,192

tokens

Max reply

16,384

tokens

Memory tier

Small

a few emails or a short document

Tokenizer

llama3

Released

Apr 2024

Training cutoff

Mar 2023

Availability

Public pricing

Status

active

Benchmarks

Quality benchmarks

Independent evaluations from public leaderboards. Higher is better.

  • mmlu

    66.6

  • humaneval

    62.2

  • ifeval

    74.08

  • bbh

    28.24

  • mmlu_pro

    29.6

What it can do

Capabilities & limits.

  • Understands images
  • Deep step-by-step thinking
  • Uses tools / calls functions
  • Strict JSON output
  • Streams replies
  • Fine-tunable on your data

When to pick Llama 3 8B Instruct

  • Agentic workflows that call tools or APIs.
  • High-volume workloads where unit cost matters.

When to look elsewhere

  • Your workload involves images — pick a vision-capable model instead.
  • Your inputs routinely exceed short documents.

Alternatives

Similar models to compare.

FAQ

Llama 3 8B Instruct — the questions we see most.

Pricing, capabilities, alternatives — generated from the same data that powers the calculator above.

Get instant answers from our AI agent

At a typical workload of 50,000 conversations a month with 1,500-token prompts and 800-token replies, Llama 3 8B Instruct costs roughly $4 per month. Input is $0.03 /1M tokens and output is $0.04 /1M tokens.
Llama 3 8B Instruct has a 8,192-token context window (small memory — a few emails or a short document). That means you can fit about 1,536 words of input and history in a single call.
Beyond text generation, Llama 3 8B Instruct supports calling functions / tools, strict JSON output, fine-tuning on your own data. It streams replies by default.
Llama 3 8B Instruct was released in April 2024, with training data cut off around March 2023.
Models in a similar class include Llama 3.2 1B Instruct, Llama 3.1 8B Instruct, Llama 3.2 3B Instruct. The "Similar models" section below this FAQ links into each.

Still unsure?

Compare Llama 3 8B Instruct against 100+ other models.

Open the full wizard — pick a use case, set your usage, and see side-by-side monthly costs in under a minute.

Open the comparison wizard