This story is part of our coverage of Computex, the world’s biggest computing conference.
TOPS — also known as trillions of operations per second.
The acronym has quickly become the go-to measurement for expressing the AI horsepower of a system, and the biggest tech companies in the world are duking it out to outdo each other.
Microsoft really kicked things off with the requirement of a 40 TOPS NPU, but AMD just launched its new Strix Point Ryzen AI processors — and they’re the real deal. AMD is the first to launch capable NPUs (neural processing units) in systems that also have discrete GPUs on board — and that’s a game-changer.
The battle over TOPS begins
Microsoft’s push into on-device has meant a rapid increase in the performance of NPUs. The new hardware was first introduced in Intel’s Meteor Lake chips, which could handle just 10 TOPS. The acronym is quickly becoming the go-to way to measure the AI horsepower of a system, standing for trillions of operations per second. As it turns out, those 10 TOPS weren’t all that useful in these initial laptops, despite being marketed as “AI PCs.” It just wasn’t enough performance to be favored over the CPU or GPU in most tasks.
The jump to 40 TOPS in Copilot+ PCs is important, especially for background tasks like the new Recall feature. As Microsoft and Qualcomm noted, that NPU is critical to producing devices with long battery life too. That’s because the initial group of laptops under the Copilot+ PC banner all belong to the same class of laptop. These are highly portable MacBook Air competitors meant for light work on the go.
But let’s get real — the most powerful AI PC in the world is never going to be a device without a powerful GPU. Despite what Microsoft has been saying, GPUs remain the most important component in raw AI performance. Modern graphics cards have loads of AI power under the hood, thanks to the Nvidia’s heavy investment in the technology early on. And that’s what makes these new AMD laptops so exciting. They combine a 50 TOPS NPU with an additional 320 TOPS of the RTX 4070 — all in a stunningly sleek package. The NPU can handle the lighter background tasks, but as of now, you still need a GPU to handle more-intensive AI tasks, especially ones in content creation applications.
For me, the star of the lineup of the first Ryzen AI laptops is the Asus ProArt P16. While devices like the new Surface Laptop 13 are a solid alternative to the M3 MacBook Air, they’re not meant to compete with the MacBook Pro. But that’s exactly what the ProArt P16 looks to do. Despite having the new Ryzen AI 9 HX chips and up to an RTX 4070, the device is just 0.59 inches thick. You read that right — the ProArt P16 is considerably thinner than the 16-inch MacBook Pro. There’s been plenty of attempts at creating MacBook Pro alternatives recently, but none that undercut its design in this way.
Even beyond that, the ProArt P16 is only marginally thicker than the Qualcomm-powered Copilot+ PCs, despite having way more headroom for GPU and AI performance. For some, it’s within 0.02 inches.
As a sidenote, the design is extremely modern, using a massive trackpad and some oversized stereo speaker grills flanking the keyboard. It even has a high-resolution OLED panel.
Of course, I’m not expecting the ProArt P16 to get the kind of battery life the MacBook Pro or the Qualcomm laptops achieve. That kind of efficiency is hard to replicate without switching to Arm, especially in a laptop this powerful. The lack of a discrete GPU in the MacBook Pro M3 Max also helps it achieve its incredible battery life. Until Qualcomm can scale up its integrated graphics in the same way Apple has, these discrete Nvidia GPUs will remain the best way to go.
Things are about to heat up
The race for AI performance is only just getting started. Qualcomm was the first out of the gate with its Snapdragon X chips, but the achievement has only poured oil on the fire for these other companies. AMD’s Ryzen AI is the first up to take back the crown and integrate more capable NPUs in more powerful systems. But you can bet that Intel, Apple, and even Qualcomm won’t be idly watching.
Apple is about to crank the nob on its own AI features at WWDC, having just released the M4 for the iPad Pro, which has a neural engine capable of 38 TOPS. The rollout to MacBooks on those may take a bit, but they may come just in time to take use of these new AI features built into macOS.
Intel is also gearing up for its own comeback later this year with Lunar Lake, which is said to also hit the 40+ TOPS requirement for Copilot+.
As you might guess, laptop manufacturers are caught in the middle of this situation. It’s hard enough for companies like Asus, Dell, and Lenovo to figure out which CPU platforms to support — let alone know how to brand these changes to their existing customers. We’ve seen a mix of approaches, which is what you’d expect. But it leads to a whole lot of confusion on the part of the average laptop buyer, who’s stuck having to choose among these different CPU platforms.
Here’s what’s clear for now, though. When it comes to Windows laptops, the most efficient and long-lasting devices will likely continue to be the Qualcomm-based devices, such as the new Surface Pro and Surface Laptop. When it comes to raw power, whether it’s for video editing, gaming, or even heavy AI workloads, you’ll want something like the ProArt P16 that has both a strong NPU and discrete GPU. Outside of the MacBook Pro, AMD has the exclusivity on such devices right now — even if that lead won’t last for long.
Editors’ Recommendations
- Asus is fixing the most controversial part of the Zephyrus G16
- AMD’s new Ryzen AI 300 chips look like the real deal
- Nvidia’s G-Assist AI assistant actually sounds incredible
- Asus is axing one major feature with the ROG Ally X
- How to watch AMD’s big Computex 2024 keynote — and what to expect
The numbers are in. Is AMD abandoning gamers for AI?
The data for the first quarter of 2024 is in, and it’s bad news for the giants behind some of the best graphics cards. GPU shipments have decreased, and while every GPU vendor experienced this, AMD saw the biggest drop in shipments. Combined with the fact that AMD’s gaming revenue is down significantly, it’s hard not to wonder about the company’s future in the gaming segment.
Nvidia just hinted at AI that can play games for you
“The future is never far away.” That’s the comment Nvidia made yesterday on social media about an old April Fool’s joke about AI in games.
Here’s the context: In 2017, Nvidia made a silly April Fool’s joke video about something called GTX G-Assist, a dongle that could add some outlandish AI features to gaming. Then again, what was outlandish in 2017 feels possible seven years later.
Perplexity, one of our favorite AI apps, just got a big update
If you’ve been looking for more than just traditional search engines, you may have turned to Perplexity. The app allows users to ask questions and receive quick, accurate answers from a carefully selected set of sources, all powered by ChatGPT. Now, a new software update is making Perplexity AI even better.
Perplexity Pages allows you to transform your research into visually engaging and comprehensive content. Whether you are creating detailed articles, reports, or informative guides, Perplexity Pages brings your ideas to life. This new tool simplifies organizing and sharing information, giving you more control. You also have the option to publish your work to Perplexity’s library of user-generated content, where you can showcase your expertise.
Source: www.digitaltrends.com