by Karl Freund | Nov 22, 2024 | In the News
Data center cooling is hot. At least it’s becoming a hot market, with industry projections likely to increase as the Nvidia Blackwell GPU push increases the percentage of silicon that requires liquid cooling. Goldman Sachs estimates the server cooling market is...
by Karl Freund | Nov 19, 2024 | In the News
This could be quite telling, as IBM had previously been using Nvidia for it’s internal cloud AI research. IBM has selected AMD to provide AI accelerators for the IBM Cloud. This is another milestone for AMD, which needs cloud adoption to achieve its goals. And IBM...
by Karl Freund | Nov 19, 2024 | In the News
Startup launches “Corsair” AI platform with Digital In-Memory Computing, using on-chip SRAM memory that can produce 30,000 tokens/second at 2 ms/token latency for Llama3 70B in a single rack. Using Generative AI, called inference processing, is a memory-intensive...
by Karl Freund | Nov 19, 2024 | In the News
The company tackled inferencing the Llama-3.1 405B foundation model and just crushed it. And for the crowds at SC24 this week in Atlanta, the company also announced it is 700 times faster than Frontier, the worlds fastest supercomputer, on a molecular dynamics...
by Karl Freund | Nov 18, 2024 | In the News
I awoke Sunday morning to an article in The Information written to instigate fear, uncertainty and doubt amongst Nvidia investors and users. Don’t worry. Nvidia’s got this. The article circulating this weekend highlighted the thermal challenges some customers face...
