The Latest News in AI

We publish news articles on Forbes, which are copied here for your convenience.

NVIDIA L40S: A Datacenter GPU For Omniverse And Graphics That Can Also Accelerate AI Training & Inference

by Karl Freund | Aug 30, 2023 | In the News

I’m getting a lot of inquiries from investors about the potential for this new GPU and for good reasons; it is fast! NVIDIA announced a new passively-cooled GPU at SIGGRAPH, the PCIe-based L40S, and most of us analysts just considered this to be an upgrade to the...

BrainChip Sees Gold In Sequential Data Analysis At The Edge

by Karl Freund | Aug 22, 2023 | In the News

Unlike in image processing or large language models, few AI startups are focused on sequential data processing, which includes video processing and time-series analysis. BrainChip is just fine with that. With all the buzz around LLM generative AI, it is understandable...

Enhanced Memory Grace Hopper Superchip Could Shift Demand To NVIDIA CPU And Away From X86

by Karl Freund | Aug 8, 2023 | In the News

The company’s new high bandwidth memory version is only available with the CPU-GPU Superchip. In addition, a new dual Grace-Hopper MGX Board offers 282GB of fast memory for large model inferencing. The AI landscape continues to change rapidly, and fast memory (HBM)...

Hyundai And Samsung Lead $100M Investment Round In Tenstorrent

by Karl Freund | Aug 2, 2023 | In the News

Partners make great investors because their intent is to secure influence and gain access to advanced technology. Hyundai Motor Group and the Samsung Catalyst Fund have co-led a $100M investment in Tenstorrent, and both companies plan to use Tenstorrent’ tech. I love...

Micron Looks To Be First To Market With HBM3 Update For Generative AI And HPC

by Karl Freund | Jul 26, 2023 | In the News

According to the company, the new Gen-2 of HBM increases memory capacity by 50%, with another bump in the works for 2024. As you may have heard, in addition to NVIDIA GPUs, generative AI eats memory for lunch. And dinner. In fact, running ChatGPT takes 8 or 16 GPUs...

« Older Entries

Next Entries »

INTEL Lays Down The Gauntlet For AMD And NVIDIA GPUs

by Karl Freund | September 15, 2021 | In the News | 0 Comments

The company’s Xe GPU for HPC looks pretty good, but will it be good enough to catch up to AMD and NVIDIA? Intel has adopted a "Domain-Specific Architecture" strategy espoused by John L. Hennessy, Alphabet Chairman and former President of Stanford...

What Is Physical AI, And Why It Could Change The World

by Karl Freund | August 9, 2024 | In the News | 0 Comments

Nvidia CEO Jensen Huang believes Physical AI will be the next big thing. Emerging robots will take many forms, all powered by AI. Recently Nvidia has been extolling a future where robots will be everywhere. Intelligence machines will be in the kitchen, the factory,...

Nvidia Contributes Blackwell And Ethernet Tech To Meta’s Open Compute

by Karl Freund | October 15, 2024 | In the News | 0 Comments

Many think of Nvidia as a closed ecosystem. But as AI transitions from fast chips to address a full-system challenge, Nvidia is helping drive an open industry. Yes, CUDA is closed. Nvidia says it has to be closed in order to develolp an optimized software abstraction...

Is The New AMD MI300X Better Than The NVIDIA H100?

by Karl Freund | June 13, 2023 | In the News | 0 Comments

AMD disclosed a few more details on the MI300 GPU, due later this year, with support for 192GB of memory on the MI300X. Here’s what we know. In today’s world of ChatGPT, everyone keeps asking if the NVIDIA A100 and H100 GPUs are the only platforms that can deliver the...

World-Record AI Chip Announced By Habana Labs

by Karl Freund | June 20, 2019 | AI and Machine Learning, In the News | 0 Comments

Out of the tsunami of AI chip startups that hit the scene in the last few years, Israeli startup Habana Labs stands out from the crowd. The company surprised and impressed many with the announcement last fall of a chip designed to process a trained neural network (a...

The 2024 AI HW Summit: Here’s What Caught My Attention

by Karl Freund | September 18, 2024 | In the News | 0 Comments

The Summit drew over 1000 attendees this year, with scores of presentations and hundreds of AI leaders from large companies as well as many startups. Every September since 2019, the AI HW Summit in the Bay Area has been the focal point for new technologies around AI....

Xilinx Enters The SmartNIC Market

by Karl Freund | March 20, 2020 | AI and Machine Learning, In the News | 0 Comments

The CPU in today’s data center is increasingly burdened by the need to process networking jobs. According to Xilinx’s VP Marketing for Data Center Products, Donna Yasay, networking stacks can tax CPUs up to 30%, robbing them of the cycles needed to run users’...

NVIDIA GTC: “DPU” Smart NIC And More

by Karl Freund | October 22, 2020 | AI and Machine Learning, In the News | 0 Comments

NVIDIA Co-founder and CEO Jensen Huang rarely disappoints his audience nor his investors. This week he once again delivered the goods at the GPU Technology Conference. Announcing a broad range of hardware and software innovations, Jensen made it clear that he intends...

How To Run Large AI Models On An Edge Device

by Karl Freund | July 10, 2023 | In the News | 0 Comments

It can be done, but it requires the edge device vendor to work to optimize the model. A hybrid approach can also extend the applicability of LLMs by combining Cloud and Edge processing. When most people think of Artificial Intelligence (AI), they imagine a berserk...

Cerebras Systems Wins A Major New Client: The Mayo Clinic

by Karl Freund | January 8, 2024 | In the News | 0 Comments

The Mayo Clinic has one of the world’s most extensive and valuable health data sets. AI can now transform that treasure trove into better health outcomes and scientific understanding, and Cerebras has been selected to help. As we noted last Fall, Cerebras is one of...