Tested on Semianalysis’s InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt ...

GLM-5.3-Flash, the AI model Z.ai previewed anonymously as Ox Alpha, ran on 100,000 Chinese chips during its launch week ...

Cerebras Systems (NASDAQ:CBRS) outlined a product roadmap centered on faster AI inference, expanded data-center capacity and ...

Whatever your approach to AI development, you’ll be more than a little concerned by the spiraling costs of tokens. Analysis ...

The pilot stage is the best time to consider the implications of architecture, security, and operations for running AI ...

The Toronto-based startup, founded in 2023, has raised $219 million and builds chips hardwired for specific AI models ...

In June, OpenAI unveiled the chip program in partnership with Broadcom, built from a blank slate exclusively for LLM ...

SAN FRANCISCO, Aug. 16, 2026 /PRNewswire/ -- ScitiX unveiled the full scope of its production inference platform, purpose-built for enterprises running AI at scale. As organizations move from ...

Nvidia CEO Jensen Huang unveils a high-speed AI inference system using Groq technology, targeting growing demand.

Already the winner in AI model training, Nvidia now has its sights on the inference market. The company's big move to capture share was its "acquisition" of Groq and its language processing units ...

As agents reason, replan, call other agents, and work continuously in the background, Gartner predicts inference costs per workflow will rise more than fivefold through 2028.

General Compute, an AI inference cloud startup, has landed a $400 million loan from Upper90, a tech investment firm. It might be the first deal to put up inference-specific chips as collateral — chips ...