Technology and Scienceupdated 57m ago2 min read
Amazon Launches TorchNeuron to Challenge Nvidia’s AI Chip Dominance
This article is an automated aggregation of coverage from news outlets. Our editorials offer in-depth analysis curated by the NewsCord team.
Amazon unveiled TorchNeuron to run PyTorch on AWS Trainium without rewriting code. TorchNeuron will be released as free, open-source software.
5 outlets told this the same way.
Outlets did split on Elon Musk Ordered Starlink Slowdown That Hampered Ukraine Drone Missions, WSJ Report Says →
TorchNeuron and TorchTPU
Amazon announced TorchNeuron to challenge Nvidia’s AI chip dominance, and the company said the software will be publicly released as a free and open-source offering at a developer conference in Silicon Valley on Monday. Google announced TorchTPU as an open-source project, aiming to make it easier for PyTorch-created applications to run on its AI chips and in Google Cloud.
TorchTPU, its long-awaited version of PyTorch, is now available as an open-source project. TorchTPU seeks to enable AI applications built with that popular environment to run on Google’s tensor processing units, known as TPUs, and to facilitate their transfer to Google Cloud.
Porting without rewriting
Amazon said TorchNeuron would allow AI apps to be ported to Amazon’s homegrown AI chip, Trainium, and to AWS with no rewriting, and TechCrunch framed the move as an attempt to break Nvidia’s stranglehold on the AI industry. TorchNeuron is meant to bring applications to its Trainium chips and also proposes changes to PyTorch’s main project.
Google said it worked directly with Meta, Hugging Face, Inferact, and RadixArk to ensure TorchTPU’s features and code libraries work well with popular AI development tools, and TechCrunch described this as making TorchTPU compatible with the original PyTorch experience. TorchTPU aims to allow migrating PyTorch applications to Google's TPUs via a configuration change, without rewriting them.
A direct software ecosystem fight
Amazon also said it is submitting code to the main PyTorch project that decouples various features from Nvidia’s chips, and TechCrunch described the effort as making the framework more open to different types of hardware by default. Amazon is contributing code to the main PyTorch project to decouple various Nvidia GPU functions, aiming to make the framework more open to different types of hardware by default.
The initiatives do not mean AI app developers will automatically ditch Nvidia’s hardware en masse, but Amazon and Google are working to end Nvidia’s advantage. The availability of alternatives does not guarantee a mass migration from Nvidia, and the outcome depends on whether the tools work reliably with applications and libraries developers already use.