Inference
Cerebras Inference
Open-weight models at thousands of tokens per second on wafer-scale chips
DeepInfra
Pay-as-you-go inference for 100+ open and proprietary models, plus GPUs
Featherless AI
Serverless access to 40,000+ open models, flat-rate chat or per-token API
Fireworks AI
Serverless inference, GPU deployments and fine-tuning for open models
Acquired by NVIDIA in 2025, now DGX Cloud Lepton.
Cheap open-model API, dedicated endpoints and GPU rental
One API key and one credit balance for 450+ language models
Parasail
Open-model inference: serverless per token, dedicated per GPU-hour
Shanghai model-API and agent-sandbox cloud, refiling for a Hong Kong IPO
Replicate
Run, fine-tune and deploy AI models with one API call
SiliconFlow 硅基流动
One OpenAI-compatible API for 170+ models, billed per token
Together AI
AI cloud for running, fine-tuning and training open models at scale
Volcengine Ark 火山方舟 (ByteDance)
ByteDance's model platform for Doubao Seed, DeepSeek, GLM and more
OSChina's model API and compute market, built around Chinese AI chips
VMware's AMD AI Factory Still Requires VMware Cloud Foundation
Supporting AMD's open software stack sounds like a route away from concentration. It requires VMware Cloud Fou...
KE
1 Sep
OpenAI's Jalapeño Beat Blackwell on Work Per Watt, Which Is the Expected Result
A chip that only serves inference outperformed one that also trains, measured on a public third-party benchmar...
EV
27 Aug
Nvidia Is Talking To The Korean Startup Whose Chips Compete Where Nvidia Is Weakest
Jensen Huang met Rebellions' chief executive in Santa Clara. The company designs inference NPUs, is valued nea...
KE
22 Aug
Lablup open-sources MLXcel, an Apple-Silicon inference engine, under Apache 2.0
Lablup has released MLXcel, an open-source engine for running AI models on Apple Silicon, under the permissive...
KE
2 Jun
Baseten is in talks to raise US$1 billion at a valuation of US$11 billion as inference money keeps flowing
Baseten, which rents Nvidia servers for AI models, is in talks to raise US$1bn at a US$11bn valuation, more th...
AI
2 Jun