Groq

Groq: ALLaM-2-7b

stable

ALLaM-2-7b is available through Everstack's OpenAI-compatible gateway with routing, fallback, retries, and observability.

allam-2-7ballam-2-7breleased Jan 23, 2025
Context
4.1K
tokens
Max output
4.1K
tokens
Input
-
per 1M
Output
-
per 1M

Activity

Daily period usage
Aggregated managed Everstack traffic. Buckets below 5 tenants or 100 requests are withheld.

Providers

ProviderContextInput /MOutput /M

Pricing

ItemPriceUnit
Input-per 1M tokens
Output-per 1M tokens

Performance

Reliability

Compare

Compare usage and performance
Place this model beside up to three other catalog models.

Capabilities

Capabilities
Modalities
Input
Output
Details
Model ID
allam-2-7b
Family
allam-2-7b
Status
stable
Knowledge
-
Released
Jan 23, 2025
Gateway Config
API
2024-01-01
Auth
GROQ_API_KEY
Discovery
static
Provider type
meta

Quick Start

index.ts
import Everstack from "@everstack/node";const client = new Everstack({  apiKey: process.env.EVERSTACK_API_KEY!,  baseUrl: "https://{instance}.{region}.everstack.ai",});const completion = await client.chat.completions.create({  model: "@groq/allam-2-7b",  messages: [{ role: "user", content: "Explain vector cache routing." }],});console.log(completion.choices[0]?.message?.content);

Endpoint

Base URL
https://api.groq.com/openai/v1
Chat completions
https://api.groq.com/openai/v1/chat/completions
Model
allam-2-7b
Auth env
GROQ_API_KEY

ALLaM-2-7b FAQ

What is the context window of ALLaM-2-7b?

ALLaM-2-7b accepts up to 4.1K tokens of context and returns up to 4.1K output tokens on Groq.

What can ALLaM-2-7b do?

ALLaM-2-7b supports chat. It accepts text input.

How do I call ALLaM-2-7b through Everstack?

Point any OpenAI-compatible SDK at your Everstack gateway and set the model to @groq/allam-2-7b. Everstack adds retries, provider fallback, caching, per-tenant budgets and OpenTelemetry traces for every request.