The Latest News in AI

We publish news articles on Forbes, which are copied here for your convenience.

Cerebras Now The Fastest LLM Inference Processor; Its Not Even Close

by Karl Freund | Nov 19, 2024 | In the News

The company tackled inferencing the Llama-3.1 405B foundation model and just crushed it. And for the crowds at SC24 this week in Atlanta, the company also announced it is 700 times faster than Frontier, the worlds fastest supercomputer, on a molecular dynamics...

Nvidia’s New HW Alleviates Concerns For Blackwell Transition

by Karl Freund | Nov 18, 2024 | In the News

I awoke Sunday morning to an article in The Information written to instigate fear, uncertainty and doubt amongst Nvidia investors and users. Don’t worry. Nvidia’s got this. The article circulating this weekend highlighted the thermal challenges some customers face...

Nvidia Leads The HPC Landscape At SuperComputing ’24

by Karl Freund | Nov 18, 2024 | In the News

Nvidia has gone from a niche provider of HPC technology to becoming a dominant force in the industry. This year’s SC event reinforces that leadership. The annual SuperComputing event in North America is taking place this week in Atlanta, Georgia, and as usual the show...

Nvidia Sweeps Benchmarks. AMD Is MIA, Again

by Karl Freund | Nov 14, 2024 | In the News

It should not surprise anyone: Nvidia is still the fastest AI and HPC accelerator across all MLPerf benchmarks. And while Google submitted results, AMD was a no-show. This blog has been corrected on 11/14 with a fresh TPU Trillium vs. Blackwell comparison. Say what...

Who Has The Fastest AI Inference, And Why Does It Matter?

by Karl Freund | Nov 1, 2024 | In the News

A food fight erupted at the AI HW Summit earlier this year, where three companies all claimed to offer the fastest AI processing. All were faster than GPUs. Now Cerebras has claimed insanely fast AI performance with their latest software running on the company’s...

« Older Entries

Next Entries »

AMD Launches New GPU And EPYC CPU Right Across NVIDIA’s Bow

by Karl Freund | November 8, 2021 | In the News | 0 Comments

The Instinct MI200 is nearly five times faster than the NVIDIA A100 for HPC, but is theoretically only 20% faster for AI. One year ago I complained that the newly announced AMD MI100 GPU was great for HPC, but inadequate for most AI workloads. Now AMD has announced...

AMD Narrows The gap With Nvidia In New MLPerf Benchmarks

by Karl Freund | August 28, 2024 | In the News | 0 Comments

New benchmark results from AMD, Untether AI, Google, Intel, and Nvidia demonstrate the converging AI silicon performance competition. However, system design, networking, and software make AI sing and dance. And that’s where Nvidia excels. Finally, I can stop whining...

Cerebras Publishes 7 Trained Generative AI Models To Open Source

by Karl Freund | March 28, 2023 | In the News | 0 Comments

The AI company is the first to use Non-GPU tech to train GPT-based Large Language Models and make available to the AI community. The early days of an open AI community, sharing work and building on each other’s success, is over. As there is now much more money at...

AI Inference Is King; Do You Know Which Chip is Best?

by Karl Freund | April 2, 2025 | In the News | 0 Comments

Everyone is not just talking about AI inference processing; they are doing it. Analyst firm Gartner released a new report this week forecasting that global generative AI spending will hit $644 billion in 2025, growing 76.4% year-over-year. Meanwhile, MarketsandMarkets...

Skipping Nvidia Left Amazon, Apple And Tesla Behind In AI

by Karl Freund | August 11, 2025 | In the News | 0 Comments

Everyone thinks they are a comic. And everyone in big cap high tech thinks they can design better and/or cheaper AI chip alternatives to the industry-leader, Nvidia. Turns out, it’s simply not that easy. Apple and AWS have recently run aground in AI growth, and Tesla...

Nvidia Takes Major Step To Leverage Its Rack-Scale Ecosystem

by Karl Freund | May 20, 2025 | In the News | 0 Comments

While few dispute the incredible performance of Nvidia AI platforms, many complain that it is a closed system. You can’t replace the Arm CPUs with, say, a CPU from a RISC-V , or take advantage of a new AI ASIC like the Meta MTIA accelerator, without redesigning and...

How AI Changes The Role Of Memory Companies And Their Value

by Karl Freund | October 14, 2024 | In the News | 0 Comments

As GPU’s become a bigger part of data center spend, the companies that provide the HBM memory needed to make them sing are benefitting tremendously. AI system performance is highly dependent on memory capacity, bandwidth and latency. Consequently, memory technology is...

Story Correction: TechSpot Now Says AMD Believes That “AI Will Be Important To All Our Products Going Forward”

by Karl Freund | September 20, 2023 | In the News | 0 Comments

TechSpot has issued a retraction, says the reporter ‘misrepresented’ AMD spokesperson… this article has been subsequently updated…. TechSpot issued a correction on their interview with Justin Galton of AMD, noting “…unfortunately the source for that story...

IBM Launches Granite 3.0 AI Models; Smaller, Faster, And 97% Cheaper

by Karl Freund | October 21, 2024 | In the News | 0 Comments

The newly optimized LLMs underpin AI transformation client engagements with IBM Consulting Advantage and Watsonx. The industry has been abuzz about the affordability of LLM-based generative AI. If we don’t improve the efficiency, users will struggle to achieve an...

An Update On Intel And Habana Labs

by Karl Freund | February 21, 2020 | AI and Machine Learning, In the News | 0 Comments

Last week, I reported that Intel plans to switch its AI acceleration from Nervana technology to Habana Labs, which it acquired in December. Since Intel had planned to bring out both the inference and the training versions of Nervana’s second generation, this came as...