The Latest News in AI

The second AI HW Summit took place in the heart of Silicon Valley on September 17-18, with nearly fifty speakers presenting to over 500 attendees (almost twice the size of last year’s inaugural audience). While I cannot possibly cover all the interesting companies on...

The company tackled inferencing the Llama-3.1 405B foundation model and just crushed it. And for the crowds at SC24 this week in Atlanta, the company also announced it is 700 times faster than Frontier, the worlds fastest supercomputer, on a molecular dynamics...

At the MI300 launch, AMD claimed it had significantly better performance than Nvidia. While the AMD chip does look good, and will probably run most AI just fine out of the box, the company did not use the fastest Nvidia software. The difference is enormous. At a...

For the first time, IBM has used a quantum computer to solve a problem that that stumps the leading classical methods. This accomplishment marks a significant milestone in the path towards useful quantum computing systems and software. IBM has published a paper in...

While the new H100 GPU shows off its Transformer Engine in MLPerf, Intel advances with Gaudi-2 accelerator, and MosaicML shows A100 results nearly as good as H100 with their software. Every six months, MLCommons orchestrates and publishes on mlcommons.org over one...

Startup launches “Corsair” AI platform with Digital In-Memory Computing, using on-chip SRAM memory that can produce 30,000 tokens/second at 2 ms/token latency for Llama3 70B in a single rack. Using Generative AI, called inference processing, is a memory-intensive...

Preparing for the next leap ahead. Qualcomm Technologies, Inc. (QTI) has been researching, developing, and shipping AI acceleration on their Snapdragon processors for the past decade. QTI’s state-of-the-art AI technology is born from smartphones. It leverages its...