NVIDIA: Llama 3.1 Nemotron 70B Instruct

Public pricingIntelligence 69/100Medium memoryTool use

NVIDIA: Llama 3.1 Nemotron 70B Instruct is a text model for general chat, analysis, and production use. It combines steady general-purpose performance with a 131K tokens context window and a balanced-cost profile. Use it for general chat, analysis, and production workloads when quality, speed, and cost matters.

Input

$1.20/1M

Output

$1.20/1M

Cached

$0.01/1M

Batch

$0.06/1M

Calculate your Llama 3.1 Nemotron 70B Instruct bill.

Set your workload — see cost at your exact volume.

What would Llama 3.1 Nemotron 70B Instruct cost you?

Adjust the workload to see your monthly bill.

1,00010,00050,000250,0001M10M

Technical specifications

Llama 3.1 Nemotron 70B Instruct at a glance.

Memory

131,072

tokens

Max reply

16,384

tokens

Memory tier

Medium

a long report or a codebase file

Tokenizer

llama3

Released

Oct 2024

Training cutoff

Dec 2023

Availability

Public pricing

Status

active

Benchmarks

Quality benchmarks

Independent evaluations from public leaderboards. Higher is better.

  • mt_bench

    8.98

  • chatbot_arena_elo

    1267

  • ifeval

    73.81

  • bbh

    47.11

  • mmlu_pro

    43.54

What it can do

Capabilities & limits.

  • Understands images
  • Deep step-by-step thinking
  • Uses tools / calls functions
  • Strict JSON output
  • Streams replies
  • Fine-tunable on your data

When to pick Llama 3.1 Nemotron 70B Instruct

  • Agentic workflows that call tools or APIs.

When to look elsewhere

  • Your workload involves images — pick a vision-capable model instead.

Alternatives

Similar models to compare.

FAQ

Llama 3.1 Nemotron 70B Instruct — the questions we see most.

Pricing, capabilities, alternatives — generated from the same data that powers the calculator above.

Get instant answers from our AI agent

At a typical workload of 50,000 conversations a month with 1,500-token prompts and 800-token replies, Llama 3.1 Nemotron 70B Instruct costs roughly $138 per month. Input is $1.20 /1M tokens and output is $1.20 /1M tokens.
Llama 3.1 Nemotron 70B Instruct has a 131,072-token context window (medium memory — a long report or a codebase file). That means you can fit about 24,576 words of input and history in a single call.
Beyond text generation, Llama 3.1 Nemotron 70B Instruct supports calling functions / tools, strict JSON output, fine-tuning on your own data. It streams replies by default.
Llama 3.1 Nemotron 70B Instruct was released in October 2024, with training data cut off around December 2023.
Models in a similar class include Nemotron Nano 12B 2 VL, Llama 3.3 Nemotron Super 49B V1.5, Nemotron 3 Super. The "Similar models" section below this FAQ links into each.

Still unsure?

Compare Llama 3.1 Nemotron 70B Instruct against 100+ other models.

Open the full wizard — pick a use case, set your usage, and see side-by-side monthly costs in under a minute.

Open the comparison wizard