Hardware & Compute
Chips, data centres and the infrastructure behind AI.
-
Deploying open-source LLMs with Tenstorrent Wormhole and TT-Metalium
Tenstorrent Wormhole n150 hardware and the TT-Metalium SDK enable efficient local LLM inference. The hardware features Tensix cores and GDDR6 memory, allowing…
-
Rain Neuromorphics analog chip deal and Sandisk audio strategy
Rain Neuromorphics secured a $75M analog chip deal with Sandisk to enhance edge AI audio processing. This strategic shift into neuromorphic technology…
-
The shift toward wafer-scale AI scaling
The Condor Galaxy network reaches 16 exaFLOPs of capacity through the deployment of Condor Galaxy 3, utilizing 64 Cerebras CS-3 systems. These…
-
AMD Instinct MI350X vs NVIDIA Blackwell B200
AMD’s Instinct MI350X offers 288GB of HBM3e memory, providing a significant capacity advantage over the 192GB found in NVIDIA’s Blackwell B200. While…
-
The history of Google’s TPU v1 and the custom AI accelerator race
Google’s TPU v1 achieved 92 trillion 8-bit operations per second using a systolic array design. This specialized hardware powered the AlphaGo series…
-
Why your ARM migration fails to beat Graviton4 performance-per-dollar
Improper machine-native code porting can negate the 45 percent cost advantage of AWS Graviton instances. Engineers also face significant budget leaks from…
-
Fujitsu’s Monaka chip and the FugakuNEXT zetta-scale targets
Fujitsu is developing the 288-core Monaka CPU using 2nm technology to drive the FugakuNEXT supercomputer. This $740 million project targets zetta-scale AI…
-
Meta’s MTIA v2 outperforms GPUs for Instagram recommendation models
Meta’s MTIA v2 architecture delivers 3.5x more dense compute performance than its predecessor to optimize Instagram Reels. The custom silicon provides 128…
-
d-Matrix moves Corsair into production to meet AI inference demand
d-Matrix has launched its Corsair inference accelerator platform to support massive AI workloads, delivering 30,000 tokens per second for Llama 70B models.…
-
Deploying Llama 3.2 90B Vision on Groq LPU for Real-Time Performance
Groq’s LPU architecture delivers 750 to 800 tokens per second for Llama 3 70B, significantly outperforming NVIDIA H100 clusters by eliminating memory-bandwidth…
-
SN40L performance and trillion-parameter expert scaling
SambaNova’s SN40L RDU node achieves a 3.7x speedup over DGX H100 when running 150 7B experts totaling over 1 trillion parameters. The…
-
Positron AI reaches $5 billion valuation with Asimov chip
Positron AI secured $875 million in Series C funding to advance its Asimov inference chip, which targets five times more tokens per…