Apple plans to use M2 Ultra chips in the cloud for AI

Apple plans to begin its foray into generative AI by moving complex queries to the M2 Ultra chips running in data centers before moving to its more advanced M4 chips.

Bloomberg reports that Apple plans to place its M2 Ultra on cloud servers to run more complex AI queries, while simple tasks are processed on devices. The Wall Street Journal previously reported that Apple wanted to make custom chips to bring to data centers to ensure security and privacy in a project that, according to the publication, is called Project ACDC, or Apple Chips in Data Center. But the company now believes its existing processors already have enough security and privacy components.

The chips will be deployed in Apple’s data centers and eventually on servers managed by third parties. Apple runs its own servers in the United States and is working on a new center in Waukee, Iowa, first announced in 2017.

Although Apple hasn’t progressed as quickly in generative AI as competitors like Google, Meta, and Microsoft, the company has conducted research on the technology. In December, Apple’s machine learning research team released MLX, a machine learning framework that allows AI models to run efficiently on Apple silicon. The company also released other research on AI models that suggests what AI might look like on its devices and how existing products, like Siri, could benefit from an upgrade.

Apple emphasized AI performance in its announcement of the new M4 chip, saying its new Neural Engine is “an outrageously powerful chip for AI.”