The Latest News in AI

We publish news articles on Forbes, which are copied here for your convenience.

IBM Launches Granite 3.0 AI Models; Smaller, Faster, And 97% Cheaper

by Karl Freund | Oct 21, 2024 | In the News

The newly optimized LLMs underpin AI transformation client engagements with IBM Consulting Advantage and Watsonx. The industry has been abuzz about the affordability of LLM-based generative AI. If we don’t improve the efficiency, users will struggle to achieve an...

Eliminating Zombie Servers Could Save Billions

by Karl Freund | Oct 16, 2024 | In the News

A Digital Twin of your Data Center can help identify and reduce wasted IT infrastructure, even before you build it. Nvidia uses one to plan and operate its AI supercomputers, as eliminating wasted IT has an enormous economic impact and improves reliability and...

Nvidia Contributes Blackwell And Ethernet Tech To Meta’s Open Compute

by Karl Freund | Oct 15, 2024 | In the News

Many think of Nvidia as a closed ecosystem. But as AI transitions from fast chips to address a full-system challenge, Nvidia is helping drive an open industry. Yes, CUDA is closed. Nvidia says it has to be closed in order to develolp an optimized software abstraction...

How AI Changes The Role Of Memory Companies And Their Value

by Karl Freund | Oct 14, 2024 | In the News

As GPU’s become a bigger part of data center spend, the companies that provide the HBM memory needed to make them sing are benefitting tremendously. AI system performance is highly dependent on memory capacity, bandwidth and latency. Consequently, memory technology is...

Flex Announces Liquid-Cooled Rack And Power Solutions At OCP Event

by Karl Freund | Oct 14, 2024 | In the News

Flex is expanding its role in the AI data center market with power, cooling and infrastructure solutions for the most demanding AI servers. Artificial Intelligence (AI) is reshaping the data center, creating opportunities to help manage the flow of power and cooling...

« Older Entries

Next Entries »

IBM Research Touts AI Supercomputer For Foundation AI

by Karl Freund | February 2, 2023 | In the News | 0 Comments

IBM has built a supercomputer, named Vela, in the IBM Cloud to help its scientists create and optimize new AI models.AI needs a lot of horsepower. IBM AI Research, which has been investigating new digital and analog processor technologies to speed the calculations AI...

Hot Chips Concludes An Amazing Lineup of AI Chip Companies.

by Karl Freund | August 24, 2021 | In the News | 0 Comments

Every year, I promise not to attend this tech-heavy confab of fast chips. And every year, I break that promise. Just too much to ignore! I can deal with it: some technology is just beyond my pay grade. My masters in CS is decades old, and the deep technology...

NVIDIA Adds New Software That Can Double H100 Inference Performance

by Karl Freund | September 8, 2023 | In the News | 0 Comments

TensorRT-LLM adds a slew of new performance-enhancing features to all NVIDIA GPUs. Just ahead of the next round of MLPerf benchmarks, NVIDIA has announced a new TensorRT software for Large Language Models (LLMs) that can dramatically improve performance and efficiency...

Cerebras Builds Its Own AI Supercomputer, Andromeda

by Karl Freund | November 20, 2022 | In the News | 0 Comments

Company stood up an AI Exaflop system in just three days! At Supercomputing ‘22 in Dallas, Texas, startup Cerebras has announced the company has created its own supercomputer, much like NVIDIA has done with Selene. The system, called Andromeda, is composed of 16 CS-2...

Could Graphcore’s Second Chip Challenge NVIDIA?

by Karl Freund | July 29, 2020 | AI and Machine Learning, In the News | 0 Comments

Graphcore, a UK-based startup, launched its first Intelligence Processing Unit (IPU) for AI acceleration in 2018. Today it introduced its second-generation product for AI, a massively parallel chip with 59.4 billion transistors that delivers some 250 Trillion...

How Might OpenAI Outcomes Impact Nvidia, AMD, Intel And Microsoft?

by Karl Freund | November 20, 2023 | In the News | 0 Comments

The story keeps changing, but one thing is for sure. There will be one more AI vendor who will need tens of thousands of new GPUs. As the Loony Tunes saga continues, thanks to the OpenAI board of directors (”Th.. Th.. Th.. That’s all, Folks!”), a ton of meetings in...

Need A Chat-Bot For Your Business? Try NVIDIA NeMo.

by Karl Freund | March 16, 2023 | In the News | 0 Comments

Nemo can help organizations tailor AI Models to focus on a smaller domain; and perhaps avoid costly mistakes! Lesley Stahl: “Oh, my god. It's wrong!” The veteran reporter was aghast that Microsoft Bing could get something so easy so wrong. Ms. Stahl was interviewing...

Tenstorrent Could Reshape The AI And CPU Competitive Landscape

by Karl Freund | April 11, 2023 | In the News | 0 Comments

Now led by Jim Keller, the company has built a new leadership team and a new strategy. It has tremendous potential. Now it must execute. Introduction It is hard to believe the difference a year makes. In 2021, there were over 100 public and venture-backed startups...

As Nvidia Approaches $1 Trillion, It Announces AI Tech To Surpass $2 Trillion

by Karl Freund | May 29, 2023 | In the News | 0 Comments

New tech shows the synergies that combining CPU, DPU and GPU can enable in AI. Especially in very large AI. After steering a 25% rise in Nvidia shares last week, CEO Jensen Huang flew to Computex in Taipei to announce a slew of new products demonstrating how his...

SiMa.ai Sets A New Standard In Embedded Edge Power Efficiency

by Karl Freund | April 7, 2023 | In the News | 0 Comments

For power-constrained edge applications, SiMa tops the leader, NVIDIA Orin, according to the company’s recent MLPerf results and more. There’s big AI like ChatGPT, and then there is useful AI embedded at the edge. At in these environments, available power could be...