by Karl Freund | Oct 5, 2023 | In the News
NVIDIA’s offering integrates the company’s best GPU hardware and software into AI Supercomputers of virtually any size in the cloud, enabling enterprises to build and deploy AI without infrastructure hassles. While some may confuse this as NVIDIA competing with cloud...
by Karl Freund | Sep 25, 2023 | In the News
The AIHW and Edge AI Summit had a treasure trove of insightful presentations from luminaries such as Andrew Ng, Lip-Bu Tan, Marc Tremblay, and many others. I hope to get around to writing about what I learned, but first, I want to share the innovations from a startup...
by Karl Freund | Sep 11, 2023 | In the News
In the latest inference processing MLPerf benchmark contest, Gaudi 2 came surprisingly close to Nvidia H100. But Nvidia promised faster software soon, which is a constantly changing picture. In the latest round of AI benchmarks, all eyes were on the new Large Language...
by Karl Freund | Sep 8, 2023 | In the News
TensorRT-LLM adds a slew of new performance-enhancing features to all NVIDIA GPUs. Just ahead of the next round of MLPerf benchmarks, NVIDIA has announced a new TensorRT software for Large Language Models (LLMs) that can dramatically improve performance and efficiency...
by Karl Freund | Aug 30, 2023 | In the News
I’m getting a lot of inquiries from investors about the potential for this new GPU and for good reasons; it is fast! NVIDIA announced a new passively-cooled GPU at SIGGRAPH, the PCIe-based L40S, and most of us analysts just considered this to be an upgrade to the...