The Latest News in AI

We publish news articles on Forbes, which are copied here for your convenience.

d-Matrix Emerges From Stealth With Strong AI Performance And Efficiency

by Karl Freund | Nov 19, 2024 | In the News

Startup launches “Corsair” AI platform with Digital In-Memory Computing, using on-chip SRAM memory that can produce 30,000 tokens/second at 2 ms/token latency for Llama3 70B in a single rack. Using Generative AI, called inference processing, is a memory-intensive...

Cerebras Now The Fastest LLM Inference Processor; Its Not Even Close

by Karl Freund | Nov 19, 2024 | In the News

The company tackled inferencing the Llama-3.1 405B foundation model and just crushed it. And for the crowds at SC24 this week in Atlanta, the company also announced it is 700 times faster than Frontier, the worlds fastest supercomputer, on a molecular dynamics...

Nvidia’s New HW Alleviates Concerns For Blackwell Transition

by Karl Freund | Nov 18, 2024 | In the News

I awoke Sunday morning to an article in The Information written to instigate fear, uncertainty and doubt amongst Nvidia investors and users. Don’t worry. Nvidia’s got this. The article circulating this weekend highlighted the thermal challenges some customers face...

Nvidia Leads The HPC Landscape At SuperComputing ’24

by Karl Freund | Nov 18, 2024 | In the News

Nvidia has gone from a niche provider of HPC technology to becoming a dominant force in the industry. This year’s SC event reinforces that leadership. The annual SuperComputing event in North America is taking place this week in Atlanta, Georgia, and as usual the show...

Nvidia Sweeps Benchmarks. AMD Is MIA, Again

by Karl Freund | Nov 14, 2024 | In the News

It should not surprise anyone: Nvidia is still the fastest AI and HPC accelerator across all MLPerf benchmarks. And while Google submitted results, AMD was a no-show. This blog has been corrected on 11/14 with a fresh TPU Trillium vs. Blackwell comparison. Say what...

« Older Entries

Next Entries »

Graphcore And Spell Collaborate For End-To-End ML Operations

by Karl Freund | February 25, 2022 | In the News | 0 Comments

Companies also announce free IPU Test Drive with Graphcore AI hardware and Spell software. Building, training, optimizing, and deploying AI models at scale can be excruciatingly difficult. Especially for large models that need to be optimized to run well at scale and...

NVIDIA Dominates A Near-Empty Field In AI Benchmarks Again

by Karl Freund | April 21, 2021 | In the News, Semiconductor | 0 Comments

The Qualcomm AI chip also looks pretty efficient, but where is everyone else? MLCommons, the not-for-profit organization that manages the AI benchmarks collectively known as MLPerf, has just released the V1.0 inference results. While NVIDIA once again dominated the...

MediaTek Aims To Become A Player In Huge Markets

by Karl Freund | May 10, 2024 | In the News | 0 Comments

MediaTek mobile phone SoCs have historically been considered a) Asian, and b) low end. Thats all about to change with their Dimensity 9300 chip, which also enables entry into markets like the IoT and automotive, where the company is partnering with Nvidia for Advanced...

NVIDIA Adds New Software That Can Double H100 Inference Performance

by Karl Freund | September 8, 2023 | In the News | 0 Comments

TensorRT-LLM adds a slew of new performance-enhancing features to all NVIDIA GPUs. Just ahead of the next round of MLPerf benchmarks, NVIDIA has announced a new TensorRT software for Large Language Models (LLMs) that can dramatically improve performance and efficiency...

Cadence AI Can Increase Chip Design Quality And Chip Designer Productivity Over 1000%

by Karl Freund | June 13, 2023 | In the News | 0 Comments

EDA company’s clients have finished hundreds of new tapeouts using Cadence Cerebrus AI to speed development and make chips that run faster, use less energy, and cost less. For Cadence, AI is all about increasing engineering teams’ productivity, speeding higher...

The Cambrian AI Landscape: Qualcomm

by Karl Freund | March 4, 2021 | In the News | 0 Comments

Can the mobile chip giant finally break into the data center? Qualcomm began sampling the Cloud AI100 to select data center customers last quarter. The performance looks to be promising, based on the limited benchmarks we have seen, and the power efficiency for...

Following MSFT & GOOG Lead, AWS Embraces Nvidia And Upgrades Own Chips

by Karl Freund | November 29, 2023 | In the News | 0 Comments

As expected, Amazon AWS CEO Adam Selipsky announced updated AWS-engineered AI Training and Arm CPU chips to lower the cost of cloud services. But AWS has a problem: they have kept Nvidia at arm’s length to their detriment as Microsoft Azure increases market share. To...

Synopsys Moves To RISC-V To Help SoC Developers

by Karl Freund | November 8, 2023 | In the News | 0 Comments

When the number two provider of CPU designs jumps on the RISC-V train, it is a significant milestone. The open-source RISC-V design is on a roll, displacing Arm in many SoC development plans. ARC and Arm are both companies that design and license microprocessor (CPU)...

AI Is Reshaping Chip Design. But Where Will It End?

by Karl Freund | December 19, 2023 | In the News | 0 Comments

Using AI reduces design costs, improves yields and performance, and shortens time-to-market for better chips. Synopsys, Cadence Design Systems, and many hyperscal chip designers are now adopting generative AI capabilities to facilitate chip design. Think of this as...

IBM Helps Clients Prepare For A Quantum-Safe World

by Karl Freund | May 10, 2023 | In the News | 0 Comments

IBM unveils new software to help clients protect data that someday could become threatened by quantum code-breakers. Quantum computing has the potential to create immense business benefits, and the social implications of quantum technologies are likely to be...