NVIDIA NIM

NVIDIA NIM: Nemotron 70B Instruct

stable

Nemotron 70B Instruct is available through Everstack's OpenAI-compatible gateway with routing, fallback, retries, and observability.

nvidia__llama-3.1-nemotron-70b-instructnemotronreleased Apr 15, 2025
ProviderQuick start
Context
128K
tokens
Max output
8.2K
tokens
Input
-
per 1M
Output
-
per 1M

Activity

Daily period usage
Aggregated managed Everstack traffic. Buckets below 5 tenants or 100 requests are withheld.

Providers

ProviderContextInput /MOutput /M
NVIDIA NIM
NVIDIA NIM
128K--

Pricing

ItemPriceUnit
Input-per 1M tokens
Output-per 1M tokens

Performance

Reliability

Compare

Compare usage and performance
Place this model beside up to three other catalog models.

Capabilities

Capabilities
Modalities
Input
Output
Details
Model ID
nvidia__llama-3.1-nemotron-70b-instruct
Family
nemotron
Status
stable
Knowledge
-
Released
Apr 15, 2025
Gateway Config
API
2024-01-01
Auth
NVIDIA_API_KEY
Discovery
static
Provider type
meta

Quick Start

index.ts
import Everstack from "@everstack/node";const client = new Everstack({  apiKey: process.env.EVERSTACK_API_KEY!,  baseUrl: "https://{instance}.{region}.everstack.ai",});const completion = await client.chat.completions.create({  model: "@nvidia-nim/nvidia__llama-3.1-nemotron-70b-instruct",  messages: [{ role: "user", content: "Explain vector cache routing." }],});console.log(completion.choices[0]?.message?.content);

Endpoint

Base URL
https://integrate.api.nvidia.com/v1
Chat completions
https://integrate.api.nvidia.com/v1/chat/completions
Model
nvidia__llama-3.1-nemotron-70b-instruct
Auth env
NVIDIA_API_KEY

Nemotron 70B Instruct FAQ

What is the context window of Nemotron 70B Instruct?

Nemotron 70B Instruct accepts up to 128K tokens of context and returns up to 8.2K output tokens on NVIDIA NIM.

What can Nemotron 70B Instruct do?

Nemotron 70B Instruct supports chat and function calling. It accepts text input.

How do I call Nemotron 70B Instruct through Everstack?

Point any OpenAI-compatible SDK at your Everstack gateway and set the model to @nvidia-nim/nvidia__llama-3.1-nemotron-70b-instruct. Everstack adds retries, provider fallback, caching, per-tenant budgets and OpenTelemetry traces for every request.