The Latest News in AI

We publish news articles on Forbes, which are copied here for your convenience.  

How To Run Large AI Models On An Edge Device

It can be done, but it requires the edge device vendor to work to optimize the model. A hybrid approach can also extend the applicability of LLMs by combining Cloud and Edge processing. When most people think of Artificial Intelligence (AI), they imagine a berserk...

Microsoft Announces Maia AI, Arm CPU, AMD MI300, & New Nvidia for Azure

In case you missed Satya Nadella’s keynote, here is a summary of vast array of news and my perspectives. Big impact on MSFT, AMD, AWS, and NVDA. CEO Satya Nadella presented a keynote packed with new product announcements. In case you didn’t watch it, here’s the news...

Esperanto Launches AI Accelerator With Over 1000 RISC-V Cores

After delays, the company now has working silicon back from TSMC, with high power efficiency for recommendation engines. Esperanto has announced more details at Hot Chips about its much-anticipated AI accelerator designed for power-efficient inference processing....

Competitive Landscape Excerpt: AMD

As a bookend to AMD’s EPYC3 launch earlier this week, I thought I should share my thoughts on the company’s AI chip, the MI100, excerpted and updated from the Q1 Competitive Landscape Report. The company’s new GPU is a solid first effort for AMD’s revived data center...

Who Won The Latest AI Drag Race? AWS Or NVIDIA?

Of course the answer depends on who you ask. There is a quiet drama simmering over AI chip benchmarks. This isn’t the first time, and will certainly not be the last. Keeps me busy. This time, it is between Amazon Web Services (AWS) and NVIDIA. It is always NVIDIA. Not...

Can Groq Really Take On Nvidia?

The Silicon Valley startup has just raised an astonishing $640M in additional funding, and is valued at $2.8B. Have they captured AI Lightning in a bottle? Groq has announced a $640M Series D round at a valuation of $2.8B, led by BlackRock Private Equity Partners....

Nvidia Takes Major Step To Leverage Its Rack-Scale Ecosystem

While few dispute the incredible performance of Nvidia AI platforms, many complain that it is a closed system. You can’t replace the Arm CPUs with, say, a CPU from a RISC-V , or take advantage of a new AI ASIC like the Meta MTIA accelerator, without redesigning and...

If The Arm Deal Fails, NVIDIA Is Fine, But Arm May Struggle

European regulators are again expressing concerns about the impact on competition. But the alternatives for Arm could be worse. NVIDIA does not need to acquire Arm to keep growing like a weed. The acquisition would add to NVIDIA’s revenue and growth, to be sure, but...

New MLPerf Benchmarks Show Why NVIDIA Reworked Its Product Roadmap

Every six months, NVIDIA, Intel and Google show how much their AI training hardware and software have improved while their competitors hide in the bushes. NVIDIA is starting to see some competitive threats but remains the leader, especially in the scale of its...

SiMa.ai Creates Drag-And-Drop Platform For Building AI Workflows

Assuming it is the software that enables or prevents the adoption of a new AI chip, a reasonable assumption, SiMa has created a new tool called Palette Edgematic to simplify AI solution creation greatly. And build demand for their silicon. As everyone says, “It’s the...