Hot French startup ZML releases free product to speed inference across lots of AI chips

ZML, a hot French AI startup endorsed by Turing Award winner Yann LeCun, has now released ZML/LLMD, software that could make ...

Tomorrow’s AI networks need to adapt to stay ahead of the inference curve

Tomorrow's AI services depend on networks built for massive inference growth.

Fast token generation emerges as the key differentiator as heterogeneous inference takes hold

Discover how heterogeneous compute templates optimize fast token generation and lower total cost of ownership for enterprise ...
GlobalData on MSN

SambaNova to power on-prem AI inference for JPMorgan

SambaNova raised $1bn as part of a Series F round, giving it a post-money valuation of $11bn.

Inference chip startup SambaNova valued at $11B in $1B funding round

Chip startup SambaNova Inc. today announced that it has raised $1 billion in funding at a $11 billion valuation. General ...

DeepSeek's Silicon Gambit: Chinese AI Star Begins Building Its Own Inference Chip

DeepSeek is developing its own AI inference chip, seeking to reduce reliance on Nvidia and Huawei amid rising demand and US ...

Faster AI, lower costs: DSpark eases inference bottlenecks and chip strain, says DeepSeek

Start-up unveils speculative decoding framework that speeds up inference by up to 85 per cent amid China's push to overcome US AI curbs Chinese artificial intelligence start-up DeepSeek has rolled out ...

OpenAI reportedly reduced inference costs by more than half

According to a media report, OpenAI engineers have found optimizations that reduce the cost of operating existing AI models ...
DatacenterDynamics

DigitalOcean signs "multiple" nine-figure customer agreements for inference and cloud services

Cloud provider DigitalOcean has revealed that it has secured multiple contracts worth hundreds of millions of dollars in ...
DatacenterDynamics

Inference chip startup Etched emerges from stealth with $800m funding, unveils working chip

Inference chip startup Etched had launched from stealth with $800 million in funding. The company also announced it had ...

Why Enterprises Are Rethinking Infrastructure for the AI Inference Era

Enterprise conversations around artificial intelligence are beginning to shift noticeably. For the past few years, much of ...

OpenAI and Broadcom announce chip designed for LLM inference at scale

OpenAI, the company behind ChatGPT and Codex and the models those tools use, and Broadcom, an established silicon supplier, have announced a new chip, called Jalapeño, designed specifically for large ...