infrastructure
-
Graphcore Bow IPU: The 350W push against NVIDIA dominance
Graphcore’s Bow IPU utilizes wafer-on-wafer technology to deliver 350 trillion floating point per second of AI arithmetic. The BOW POD-16 offers a…
-
The economic scale of AI infrastructure and research resources
AI infrastructure costs for a 1 GW compound reach between $60 billion and $80 billion, according to Jensen Huang. The National Science…
-
Lambda capitalizes on debt markets as CoreWeave faces earnings pressure
Lambda secured a $1.008 billion senior secured loan to fund GPU infrastructure while CoreWeave reported a second-quarter adjusted loss of 27 cents…
-
Positron AI scales inference infrastructure with Asimov chip
Positron AI secured $875 million to scale its Asimov photonic AI chip, which offers 3.5x better performance per dollar than Nvidia H100…
-
Avoiding HBM bottlenecks in Gaudi 3 LLaMA 405B clusters
Intel Gaudi 3 provides 3.7 TB/s of HBM bandwidth, but failing to use dynamic memory allocation can cause a 20% drop in…
-
NVIDIA history from 1993 founding to the CUDA AI revolution
NVIDIA transitioned from a gaming chip manufacturer to an AI powerhouse following the 2006 launch of CUDA. This parallel computing platform enabled…
-
Deploying Llama 3.2 90B Vision on SambaNova SN40L
SambaNova’s SN40L RDU provides enterprise infrastructure for Llama 3.2 90B Vision, delivering a 3.7x speedup over the DGX H100. The hardware uses…
-
Metis delivers high throughput for edge vision
Axelera AI’s Metis platform utilizes a quad-core RISC-V architecture and Digital In-Memory Computing to achieve 15 TOPS/W at INT8 precision. The hardware…
-
CoreWeave revenue grows to $2.1 billion amid massive contract backlogs
CoreWeave generated $2.1 billion in revenue in Q1 2026, representing a 112% increase over the previous year. The company maintains a $99.4…
-
H200 memory bandwidth inefficiencies in distributed training
Improper NUMA settings and hardware selection can waste the 4.8 TB/s memory bandwidth of the NVIDIA H200. Communication errors with the Power…
-
The cost of scaling AI interconnects
Marvell’s $3.25 billion acquisition of Celestial AI targets the 16 Tbps Photonic Fabric platform to scale XPU connections. This optical interconnect offers…
-
Graphcore acquisition by SoftBank and AI chip inference performance
SoftBank acquired Graphcore amid reports of a $500 million deal following a 46 percent revenue drop. While SambaNova’s SN40L delivers up to…