Qualcomm, Nvidia spar for top spot in AI chip efficiency tests
Reuters
Published Apr 07, 2023 04:06PM ET
Updated Apr 07, 2023 05:05PM ET
By Stephen Nellis
(Reuters) - (This April 5 story has been corrected to clarify that Neuchips did not beat Qualcomm (NASDAQ:QCOM) and Nvidia (NASDAQ:NVDA) in one category of testing as it didn't compete in the categories previously described, and Qualcomm's results and rankings have been rectified in paragraphs 6-8)
Artificial intelligence chips from Qualcomm Inc beat Nvidia Corp in two out of three measures of power efficiency in a new set of test data published on Wednesday.
Nvidia dominates the market for training AI models with huge amounts of data. But after those AI models are trained, they are put to wider use in what is called "inference" by doing tasks like generating text responses to prompts and deciding whether an image contains a cat.
Analysts believe that the market for data center inference chips will grow quickly as businesses put AI technologies into their products, but companies such as Alphabet (NASDAQ:GOOGL) Inc's Google are already exploring how to keep the lid on the extra costs that doing so will add.
One of those major costs is electricity, and Qualcomm has used its history designing chips for battery-powered devices such as smartphones to create a chip called the Cloud AI 100 that aims for parsimonious power consumption.
In testing data published on Wednesday by MLCommons, an engineering consortium that maintains testing benchmarks widely used in the AI chip industry, Qualcomm's AI 100 beat Nvidia's flagship H100 chip at classifying images, based on how many data center server queries each chip can carry out per watt.
Qualcomm's chips hit 227.4 server queries per watt versus 108.4 queries per watt for Nvidia.
Qualcomm also beat Nvidia at object detection with a score of 3.8 queries per watt versus Nvidia's 2.4 queries per watt. Object detection can be used in applications like analyzing footage from retail stores to see where shoppers go most often.
Nvidia, however, took the top spot in both absolute performance terms and power efficiency terms in a test of natural language processing, which is the AI technology most widely used in systems like chatbots. Nvidia hit 10.8 queries per watt, while Qualcomm ranked second at 8.9 queries per watt.
Get The News You Want
Written By: Reuters
Trading in financial instruments and/or cryptocurrencies involves high risks including the risk of losing some, or all, of your investment amount, and may not be suitable for all investors. Prices of cryptocurrencies are extremely volatile and may be affected by external factors such as financial, regulatory or political events. Trading on margin increases the financial risks.
Before deciding to trade in financial instrument or cryptocurrencies you should be fully informed of the risks and costs associated with trading the financial markets, carefully consider your investment objectives, level of experience, and risk appetite, and seek professional advice where needed.
Fusion Media would like to remind you that the data contained in this website is not necessarily real-time nor accurate. The data and prices on the website are not necessarily provided by any market or exchange, but may be provided by market makers, and so prices may not be accurate and may differ from the actual price at any given market, meaning prices are indicative and not appropriate for trading purposes. Fusion Media and any provider of the data contained in this website will not accept liability for any loss or damage as a result of your trading, or your reliance on the information contained within this website.
It is prohibited to use, store, reproduce, display, modify, transmit or distribute the data contained in this website without the explicit prior written permission of Fusion Media and/or the data provider. All intellectual property rights are reserved by the providers and/or the exchange providing the data contained in this website.
Fusion Media may be compensated by the advertisers that appear on the website, based on your interaction with the advertisements or advertisers.