The Latest News in AI

We publish news articles on Forbes, which are copied here for your convenience.

Cadence Design And Nvidia Team To Create AI Data Center Digital Twin

by Karl Freund | Sep 19, 2025 | In the News

The data center business is in a bit of a panic. Demand is skyrocketing. Rack power requirements have increased from ~12KW per rack to over 125 KW in just the last year. Now they are preparing for a Gigawatt rack in the next two to three years (Nvidia Rubin Ultra)....

Nvidia Announces Rubin CPX GPU To Speed Long-Context AI

by Karl Freund | Sep 9, 2025 | In the News

In an industry-first, Nvidia has announced a new GPU, the Rubin CPX, to offload the compute-intensive “context processing” off another GPU. Yep, now, for some AI, you will need two GPUs to achieve maximize performance and profit. I would be surprised if the...

MLPerf 5.1: Nvidia Stays In The Lead While AMD Shows Off Its Latest

by Karl Freund | Sep 9, 2025 | In the News

The Nvidia juggernaught faces increased competition, but keeps innovating in silicon, software and systems design to keep its No. 1 position in the AI market. The industry standard MLCommons organization has just released the latest benchmarks for inference...

As we said, Google is the Exception to the Rule!

by Karl Freund | Sep 5, 2025 | In the News

The latest TPU and the upcoming Ironwood supercomputer were just the start Google is taking the next step in its quest to become a serious challenger to Nvidia GPUs. As I recently noted in my post on CSP silicon costs and failures, Google is the exception. Google...

Qualcomm Readies CPUs For The Data Center Using Nvidia NVLink Fusion

by Karl Freund | Sep 5, 2025 | In the News

NVLink has become a second, and perhaps deeper, moat for Nvidia, following its CUDA software tools and libraries. There's a reason the AI community prefers NVLink for connecting multiple GPUs: it is mind-blowingly fast, more than three times the performance of the...

« Older Entries

Next Entries »

AMD Acquires ZT, Addressing A Key Nvidia Advantage. Still, Two To Go

by Karl Freund | August 20, 2024 | In the News | 0 Comments

By acquiring ZT Systems, a favorite Hyperscale systems designer, AMD addresses a fundamental weakness it faces versus Nvidia: AI requires a complete system design, not just a fast chip. What else must it do to grab a 20% share? At a recent investment conference hosted...

Cerebras Publishes 7 Trained Generative AI Models To Open Source

by Karl Freund | March 28, 2023 | In the News | 0 Comments

The AI company is the first to use Non-GPU tech to train GPT-based Large Language Models and make available to the AI community. The early days of an open AI community, sharing work and building on each other’s success, is over. As there is now much more money at...

d-Matrix Emerges From Stealth With Strong AI Performance And Efficiency

by Karl Freund | November 19, 2024 | In the News | 0 Comments

Startup launches “Corsair” AI platform with Digital In-Memory Computing, using on-chip SRAM memory that can produce 30,000 tokens/second at 2 ms/token latency for Llama3 70B in a single rack. Using Generative AI, called inference processing, is a memory-intensive...

NVIDIA Dominates A Near-Empty Field In AI Benchmarks Again

by Karl Freund | April 21, 2021 | In the News, Semiconductor | 0 Comments

The Qualcomm AI chip also looks pretty efficient, but where is everyone else? MLCommons, the not-for-profit organization that manages the AI benchmarks collectively known as MLPerf, has just released the V1.0 inference results. While NVIDIA once again dominated the...

Esperanto Sees A Bright Future For RISC-V In AI And HPC

by Karl Freund | May 12, 2023 | In the News | 0 Comments

The company is shipping its first-gen chip globally, with over 1000 cores at only 25 watts of power. Can it break into Generative AI? Suddenly, AI has become the hottest investment and cocktail party topic de jour. But the estimates for power consumption are pretty...

Two Can’t-Miss Events For AI Hardware

by Karl Freund | October 3, 2019 | AI and Machine Learning, In the News | 0 Comments

There are two conferences coming up that AI developers, executives, and investors should consider attending to get the latest from the industry’s leaders and challengers. I will attend both and I hope to see many of my readers there! Let’s take a closer look at what’s...

How Might OpenAI Outcomes Impact Nvidia, AMD, Intel And Microsoft?

by Karl Freund | November 20, 2023 | In the News | 0 Comments

The story keeps changing, but one thing is for sure. There will be one more AI vendor who will need tens of thousands of new GPUs. As the Loony Tunes saga continues, thanks to the OpenAI board of directors (”Th.. Th.. Th.. That’s all, Folks!”), a ton of meetings in...

How To Run Large AI Models On An Edge Device

by Karl Freund | July 10, 2023 | In the News | 0 Comments

It can be done, but it requires the edge device vendor to work to optimize the model. A hybrid approach can also extend the applicability of LLMs by combining Cloud and Edge processing. When most people think of Artificial Intelligence (AI), they imagine a berserk...

The Graphcore Data Center Architecture

by Karl Freund | April 7, 2021 | DataCenter AI, In the News | 0 Comments

The Graphcore disaggregated accelerator could be a game changer. I have recently finished a research paper looking into the data center architecture for deploying the Graphcore IPU-Machine, which is a network-attached accelerator for highly-parallel workloads. Lets...

IBM Teams With AMD For Cloud AI Acceleration

by Karl Freund | November 19, 2024 | In the News | 0 Comments

This could be quite telling, as IBM had previously been using Nvidia for it’s internal cloud AI research. IBM has selected AMD to provide AI accelerators for the IBM Cloud. This is another milestone for AMD, which needs cloud adoption to achieve its goals. And IBM...