The Latest News in AI

We publish news articles on Forbes, which are copied here for your convenience.  

How To Run Large AI Models On An Edge Device

It can be done, but it requires the edge device vendor to work to optimize the model. A hybrid approach can also extend the applicability of LLMs by combining Cloud and Edge processing. When most people think of Artificial Intelligence (AI), they imagine a berserk...

Qualcomm Readies CPUs For The Data Center Using Nvidia NVLink Fusion

NVLink has become a second, and perhaps deeper, moat for Nvidia, following its CUDA software tools and libraries. There's a reason the AI community prefers NVLink for connecting multiple GPUs: it is mind-blowingly fast, more than three times the performance of the...

NVIDIA Completely Re-Imagines The Data Center For AI

It is all about tighter integration with memory, CPUs, and accelerators for trillion-parameter AI models. For 12 years, NVIDIA has used its Spring GPU Technology Conference (GTC) to amaze its customers and investors with new GPUs for graphics and application...

Synopsys Creates Cloud OpenLink For Cross-Vendor EDA Collaboration

When you put a chip project in the hands of a cloud service like Synopsys Cloud, how do you integrate the “other” vendor tools in your EDA workflow? That's the question Synopsys is trying to answer. Synopsys launched its Synopsys Cloud offering last year and is seeing...

AI Training: “I’m Not Dead Yet!”

With so much focus on inference processing, it is easy to overlook the AI training market, which continues to drive gigawatts of AI computing capacity. The latest benchmarks show that the training of AI models, an immense investment in power and compute, continues to...

AMD Launches New GPU And EPYC CPU Right Across NVIDIA’s Bow

The Instinct MI200 is nearly five times faster than the NVIDIA A100 for HPC, but is theoretically only 20% faster for AI. One year ago I complained that the newly announced AMD MI100 GPU was great for HPC, but inadequate for most AI workloads. Now AMD has announced...

NVIDIA Runs The Mlperf Table

When the mlperf (machine learning performance) organization released the first standardized AI training benchmarks, which NVIDIA dominated last December, we were somewhat disappointed that only a few companies, namely NVIDIA, Google and Intel, were able to muster the...

SiFive Is Leading The Way For Innovation On RISC-V

The company appears well positioned to challenge CPU incumbents with high performance RISC-V CPUs and Vector Extensions to the open ISA architecture. The RISC-V CPU Instruction Set Architecture (ISA) is emerging as a serious challenger to current CPUs based on...

Qualcomm Could Benefit Most From DeepSeek’s New, Smaller AI

While the Deep Seek Moment crashed most semiconductor stocks as investors feared lower demand for data center AI chips, these new, smaller AI models are just the ticket for on-device AI. “DeepSeek R1 and other similar models recently demonstrated that AI models are...

Qualcomm Snapdragon Takes Aim At PC Rivals Intel, AMD And Apple

Snapdragon sponsored my trip to Maui to see the new hardware being announced at the annual Snapdragon Summit in Maui. Qualcomm has rolled out new Snapdragon 8 for mobile and X2 Elite for Laptops that take on the competition with faster performance and lower power than...