Meta: Llama 3 70B Instruct

Public pricingIntelligence 79/100Small memoryTool use

Meta: Llama 3 70B Instruct is a text model for general chat, analysis, and production use. It combines steady general-purpose performance with a 8K tokens context window and a balanced-cost profile. Use it for general chat, analysis, and production workloads when quality, speed, and cost matters.

Input

$0.51/1M

Output

$0.74/1M

Cached

$0.10/1M

Batch

$0.20/1M

Calculate your Llama 3 70B Instruct bill.

Set your workload — see cost at your exact volume.

What would Llama 3 70B Instruct cost you?

Adjust the workload to see your monthly bill.

1,00010,00050,000250,0001M10M

Technical specifications

Llama 3 70B Instruct at a glance.

Memory

8,192

tokens

Max reply

8,000

tokens

Memory tier

Small

a few emails or a short document

Tokenizer

llama3

Released

Apr 2024

Training cutoff

Dec 2023

Availability

Public pricing

Status

active

Benchmarks

Quality benchmarks

Independent evaluations from public leaderboards. Higher is better.

  • bbh

    50.19

  • humaneval

    81.7

  • ifeval

    80.99

  • mmlu

    82

  • mmlu_pro

    46.74

What it can do

Capabilities & limits.

  • Understands images
  • Deep step-by-step thinking
  • Uses tools / calls functions
  • Strict JSON output
  • Streams replies
  • Fine-tunable on your data

When to pick Llama 3 70B Instruct

  • Agentic workflows that call tools or APIs.
  • High-volume workloads where unit cost matters.

When to look elsewhere

  • Your workload involves images — pick a vision-capable model instead.
  • Your inputs routinely exceed short documents.

Alternatives

Similar models to compare.

FAQ

Llama 3 70B Instruct — the questions we see most.

Pricing, capabilities, alternatives — generated from the same data that powers the calculator above.

Get instant answers from our AI agent

At a typical workload of 50,000 conversations a month with 1,500-token prompts and 800-token replies, Llama 3 70B Instruct costs roughly $68 per month. Input is $0.51 /1M tokens and output is $0.74 /1M tokens.
Llama 3 70B Instruct has a 8,192-token context window (small memory — a few emails or a short document). That means you can fit about 1,536 words of input and history in a single call.
Beyond text generation, Llama 3 70B Instruct supports calling functions / tools, strict JSON output, fine-tuning on your own data. It streams replies by default.
Llama 3 70B Instruct was released in April 2024, with training data cut off around December 2023.
Models in a similar class include Llama Guard 3 8B, Llama 3.1 70B Instruct, Llama 3.2 11B Vision Instruct. The "Similar models" section below this FAQ links into each.

Still unsure?

Compare Llama 3 70B Instruct against 100+ other models.

Open the full wizard — pick a use case, set your usage, and see side-by-side monthly costs in under a minute.

Open the comparison wizard