by Karl Freund | Aug 30, 2023 | In the News
I’m getting a lot of inquiries from investors about the potential for this new GPU and for good reasons; it is fast! NVIDIA announced a new passively-cooled GPU at SIGGRAPH, the PCIe-based L40S, and most of us analysts just considered this to be an upgrade to the...
by Karl Freund | Aug 8, 2023 | In the News
The company’s new high bandwidth memory version is only available with the CPU-GPU Superchip. In addition, a new dual Grace-Hopper MGX Board offers 282GB of fast memory for large model inferencing. The AI landscape continues to change rapidly, and fast memory (HBM)...
by Karl Freund | Jun 30, 2023 | In the News
MosaicML, just acquired by DataBricks for $1.3B, published some interesting benchmarks for training LLMs on the AMD MI250 GPU, and said it is ~80% as fast as an NVIDIA A100. Did the world just change? To be brutally honest, everyone wants to see a fight, between AMD...
by Karl Freund | Jun 27, 2023 | In the News
Let’s look into the results and explore why so many competitors chose not to play ball. Those who follow me know the drill: MLCommons publishes benchmarking results every 3 months, alternating between inferencing and training. Then I explain the results and whine...
by Karl Freund | Jun 16, 2023 | In the News
Intel stock is up 35% in the last three weeks on a string of good news. Is there more to come? Semiconductors have been one of the fastest growing segments on Wall Street this year. Intel has quietly recovered its losses over the last year, with the bulk of the...
