Groq plans.
Fast inference for open models on LPU hardware. Groq runs Llama 4 Scout at 594 TPS, Llama 3.3 70B at 394 TPS and Llama 3.1 8B Instant at 840 TPS, with linear per-million-token pricing and no surprise bills. Free API key available; the Batch API gives 50% off and prompt caching is supported on selected models.
Included plans
Free API key - get started - linear PAYG after
Llama 3.1 8B $0.05 in/$0.08 out - 840 TPS - no markup
Asynchronous batches - 24h-7d window - no rate-limit impact
Price & launch history
Groq pricing verified: free API key; per-Mtok pricing for Llama 3.1 8B ($0.05/$0.08), Llama 4 Scout ($0.11/$0.34), Llama 3.3 70B ($0.59/$0.79), Qwen3 32B ($0.29/$0.59), GPT OSS 120B ($0.15/$0.60). Batch API 50% off.
Groq runs open models on LPU hardware at 394-840 tokens/second with linear per-million-token pricing. Free API key, Batch API at 50% off.
Groq FAQ
Is Groq free?+
Groq offers a free API key to get started. Beyond the free tier you pay per million tokens at linear, predictable rates with no hidden costs or idle infrastructure.
What are Groq's per-million-token prices?+
Examples (input/output per million tokens): Llama 3.1 8B Instant $0.05 / $0.08 (840 TPS), Llama 4 Scout $0.11 / $0.34 (594 TPS), Qwen3 32B $0.29 / $0.59 (662 TPS), Llama 3.3 70B Versatile $0.59 / $0.79 (394 TPS), GPT OSS 120B $0.15 / $0.60. The Batch API gives 50% off.
How fast is Groq?+
Groq runs open models on LPU hardware at very high throughput - Llama 3.1 8B Instant at ~840 tokens/second, Llama 4 Scout at ~594 TPS and Llama 3.3 70B at ~394 TPS. Prompt caching is supported on selected models such as Kimi K2 and GPT-OSS.
New models & deals, once a month (incl. Groq)
New proprietary and open-source models worth trying, price drops, and the best deals on AI coding plans. No spam.
Sources: official sites · r/ClaudeAI · r/LocalLLaMA · r/ZaiGLM · r/ChatGPT. Plans and features may vary - check official sites for the latest.