Tag: GPUs

Alibaba Cloud ditches Nvidia’s interconnect in favor of Ethernet — tech giant uses own High Performance Network to connect 15,000 GPUs inside data center

Alibaba Cloud engineer and researcher Ennan Zhai shared his research paper via GitHub, revealing the Cloud provider’s design for its data centers used for LLM training. The PDF document, entitled “Alibaba HPN: A Data Center Network for Large Language Model Training,” outlines how Alibaba used Ethernet to allow its 15,000 GPUs to communicate with each […]

AI titans Microsoft and Nvidia reportedly had a standoff over Microsoft’s use of B200 AI GPUs in its own server rooms

Credit: Nvidia Nvidia is well known for its high-performance gaming GPUs and industry-leading AI GPUs. However, the trillion-dollar GPU manufacturer is also known for controlling how its GPUs are used beyond company walls. For example, it can be quite restrictive with its AIB partners’ graphics card designs. Perhaps not surprisingly, this level of control also […]

Elon Musk’s xAI plans to build ‘Gigafactory of Compute’ by fall 2025 — using 100,000 Nvidia’s H100 GPUs

xAI, Elon Musk’s AI startup, plans to build a massive supercomputer to enhance its AI chatbot, Grok, reports Reuters citing The Information. The supercomputer, which Elon Musk refers to as the Gigafactory of Compute, is projected to be ready by fall 2025 and might involve a collaboration with Oracle. With this development, Musk aims to significantly surpass rival […]

Nvidia’s unannounced R100 AI GPUs reportedly coming in late 2025 — ‘Vera Rubin’ multi-chip designs using 3nm and CoWoS-L

Nvidia’s post-Blackwell next generation Vera Rubin GPUs for AI and HPC applications will enter mass production in late 2025, according to renowned analyst Ming-Chi Kuo on Medium.com. Nvidia will focus on the power consumption of its data center GPUs with the R100 processors based on the Rubin architecture, as the extreme amounts of power devoured by […]