AI Chip Wars: OpenAI Teams with Broadcom and Meta's Nvidia GPU Setbacks
Update: 2024-07-29
Description
OpenAI is collaborating with Broadcom, a $700 billion chip giant larger than Intel, AMD, Arm, and Qualcomm combined, to develop a new chip that could rival Nvidia. Issues with faulty Nvidia H100 GPUs and HBM3 memory led to failures every three hours during Meta's LLama 3 training, as detailed in a whitepaper about a 16,384 GPU cluster.
Comments
In Channel




