Together AI: Llama 3.1 8B Instruct Turbo

Name: Llama 3.1 8B Instruct Turbo API
Brand: Meta

deprecated

Llama 3.1 8B Instruct Turbo is available through Everstack's OpenAI-compatible gateway with routing, fallback, retries, and observability.

meta-llama__Llama-3.1-8B-Instruct-Turbollama

Provider Quick start

Context

131.1K

tokens

Max output

16.4K

tokens

Input

$0.18

per 1M

Output

$0.18

per 1M

Activity

Daily period usage

Aggregated managed Everstack traffic. Buckets below 5 tenants or 100 requests are withheld.

Providers

ProviderContextInput /MOutput /M

Together AI

131.1K$0.18$0.18

Pricing

Item	Price	Unit
Input	$0.18	per 1M tokens
Output	$0.18	per 1M tokens

Performance

Reliability

Compare

Compare usage and performance

Place this model beside up to three other catalog models.

Capabilities

Modalities

Input

Output

Details

Model ID: meta-llama__Llama-3.1-8B-Instruct-Turbo
Family: llama
Status: deprecated
Knowledge: -
Released: -

Gateway Config

API: 2024-01-01
Auth: TOGETHER_API_KEY
Discovery: static
Provider type: meta

Quick Start

index.ts

import Everstack from "@everstack/node";const client = new Everstack({  apiKey: process.env.EVERSTACK_API_KEY!,  baseUrl: "https://{instance}.{region}.everstack.ai",});const completion = await client.chat.completions.create({  model: "@together/meta-llama__Llama-3.1-8B-Instruct-Turbo",  messages: [{ role: "user", content: "Explain vector cache routing." }],});console.log(completion.choices[0]?.message?.content);

Endpoint

Base URL

https://api.together.xyz/v1

Chat completions

https://api.together.xyz/v1/chat/completions

Model

meta-llama__Llama-3.1-8B-Instruct-Turbo

Auth env

TOGETHER_API_KEY

Llama 3.1 8B Instruct Turbo FAQ

How much does the Llama 3.1 8B Instruct Turbo API cost?

Through Together AI, Llama 3.1 8B Instruct Turbo costs $0.18 per 1M input tokens and $0.18 per 1M output tokens.

What is the context window of Llama 3.1 8B Instruct Turbo?

Llama 3.1 8B Instruct Turbo accepts up to 131.1K tokens of context and returns up to 16.4K output tokens on Together AI.

What can Llama 3.1 8B Instruct Turbo do?

Llama 3.1 8B Instruct Turbo supports chat and function calling. It accepts text input.

How do I call Llama 3.1 8B Instruct Turbo through Everstack?

Point any OpenAI-compatible SDK at your Everstack gateway and set the model to @together/meta-llama__Llama-3.1-8B-Instruct-Turbo. Everstack adds retries, provider fallback, caching, per-tenant budgets and OpenTelemetry traces for every request.