OpenAI engineers cut ChatGPT guest traffic to a few hundred Nvidia GPUs, with no new hardware deployed.

OpenAI inference cost reduction cut ChatGPT guest traffic from tens of thousands of Nvidia GPUs to just a couple hundred, using software optimization alone. Engineers achieved more than 50% savings ...
Tech Times

OpenAI Halves Inference Costs With Software Alone: GPUs Drop to Hundreds

OpenAI inference cost reduction cut ChatGPT guest traffic from tens of thousands of Nvidia GPUs to just a couple hundred, ...

The only AI glossary you’ll need this year

The rise of AI has brought an avalanche of new terms and slang. Here is a glossary with definitions of some of the most ...

Anthropic's Claude wants to help Micron design better HBM, DRAM, and SSD for AI

Anthropic and Micron Technology have announced a new strategic agreement which will see the latter use Claude AI models to better oversee parts of its infrastructure stack. However the move does have ...