The Latest News in AI

We publish news articles on Forbes, which are copied here for your convenience.  

d-Matrix Emerges From Stealth With Strong AI Performance And Efficiency

Startup launches “Corsair” AI platform with Digital In-Memory Computing, using on-chip SRAM memory that can produce 30,000 tokens/second at 2 ms/token latency for Llama3 70B in a single rack. Using Generative AI, called inference processing, is a memory-intensive...

Qualcomm Could Benefit Most From DeepSeek’s New, Smaller AI

While the Deep Seek Moment crashed most semiconductor stocks as investors feared lower demand for data center AI chips, these new, smaller AI models are just the ticket for on-device AI. “DeepSeek R1 and other similar models recently demonstrated that AI models are...

The IBM Research AI Hardware Center: Solid Progress, Aggressive Goals

IBM AI acceleration technologies are becoming so good, most AI chip companies would be better off licensing core AI tech from IBM. Creating and using massive AI networks is quickly becoming unaffordable: Open.AI’s GPT-3 cost over $12M to train using thousands of GPU’s...

MLPerf 5.1: Nvidia Stays In The Lead While AMD Shows Off Its Latest

The Nvidia juggernaught faces increased competition, but keeps innovating in silicon, software and systems design to keep its No. 1 position in the AI market. The industry standard MLCommons organization has just released the latest benchmarks for inference...

Following MSFT & GOOG Lead, AWS Embraces Nvidia And Upgrades Own Chips

As expected, Amazon AWS CEO Adam Selipsky announced updated AWS-engineered AI Training and Arm CPU chips to lower the cost of cloud services. But AWS has a problem: they have kept Nvidia at arm’s length to their detriment as Microsoft Azure increases market share. To...

Can Groq Really Take On Nvidia?

The Silicon Valley startup has just raised an astonishing $640M in additional funding, and is valued at $2.8B. Have they captured AI Lightning in a bottle? Groq has announced a $640M Series D round at a valuation of $2.8B, led by BlackRock Private Equity Partners....

Nvidia GTC-DC Event Highlights AI, Quantum, And 6G Advances

Nvidia GTC has become not only a key event for AI but has also branched out to Asia, Europe, and Washington, DC to keep developers and buyers up to date on the latest advances in high-performance computing technology. This year's DC event, which kicked off with a...

Qualcomm Readies Rack-Scale AI With New Chips And Roadmap

Qualcomm announcement omits many details, but Humain will be a key customer. Qualcomm has quietly been in the AI data center since the company introduced the Qualcomm AI100 in 2019. Now, Qualcomm has taken a big step forward, launching a data center AI chip, PCIe...

As we said, Google is the Exception to the Rule!

The latest TPU and the upcoming Ironwood supercomputer were just the start Google is taking the next step in its quest to become a serious challenger to Nvidia GPUs. As I recently noted in my post on CSP silicon costs and failures, Google is the exception. Google...

Q2 Competitive Update: The AI Cambrian Explosion Rolls On

A lot of new AI Silicon and Software has been announced since March and it can be tough to keep track of it all. To help users, vendors, and investors keep track, our June Competitive Landscape Report is now available, and for a limited time, the ~70-page report is...