Groq
Groq
Low-latency inference for open-weights models on custom LPU chips.
GroqCloud serves open-weights models (Llama, DeepSeek, Qwen, Kimi) on Groq's purpose-built LPU hardware, hitting hundreds of tokens per second where GPUs manage tens. OpenAI-compatible API with a free tier; the default when token latency is the product.
- inference
- low-latency
- lpu
- open-weights