inference
-
SambaNova reaches $11 billion valuation driven by inference demand
SambaNova Systems achieved an $11 billion post-money valuation following a $1 billion Series F round. The company is pivoting toward premium inference…
-
The chip architects behind Groq’s TSP architecture and NVIDIA’s challenge
Groq’s LPU architecture provides 80 TB/s of internal memory bandwidth to challenge NVIDIA’s dominance in AI inference. Founded by Jonathan Ross, the…
-
Deploying FuriosaAI RNGD for Korean Cloud Inference
FuriosaAI’s RNGD NPU delivers 2.25x better performance per watt for LLMs than GPU solutions. Samsung SDS hosts these accelerators at its Dongtan…
-
Positron Asimov vs Lightmatter Passage for data center inference
Positron’s Asimov silicon targets 5x more tokens per watt than Nvidia’s Rubin, while Lightmatter’s Passage platform provides up to 256 Tbps of…
-
Memory Bandwidth, Not FLOPs, Is What Limits LLM Inference
Accelerators are sold on peak FLOPs, but token generation is bound by how fast weights move out of memory. What to actually…
Trending Now
- The economics of Physical Intelligence’s pi0 robot foundation model
- Helsing scales defense autonomy amid Ukraine drone setbacks
- How to use Harvey’s $715M AI legal assistant for Big Law workflows
- The economics of Devin and the shift from replacement to task delegation
- Perplexity valuation hits $3 billion as enterprise demand scales