Cloud Hosting

TL;DR

Google and Qualcomm have partnered to bring powerful generative AI experiences to Android phones. The two companies announced their tie-up to bring more on-device AI to Android devices during the Snapdragon 8 Gen 3 launch. Googles state-of-the-art foundation AI models will run on Qualcomms Hexagon NPU. These are likely the same foundation models that also run on the Pixel 8 Pro and power AI features like on-device recorder summaries, Smart Reply in Gboard, and the upcoming Video Boost feature.

With Googles AI models running on-device on the Snapdragon 8 Gen 3, more Android phones will be able to perform on-device AI tasks, making way for new features, performance improvements, and power savings.

Among the first generative AI models you see running on Snapdragon will come from none other than Google. Over the past few months, researchers at Google have been working to take their massive next-generation large language models and distill them to fit on a mobile device. Soon, youll be able to do more on-device with Google applications than ever before, said Alex Katouzian, SVP and GM of Mobile, Compute, and XR at Qualcomm.

Googles VP of engineering for Android, Dave Burke, also joined the conversation on stage during the Snapdragon 8 Gen 3 launch to confirm that the companys partnership with Qualcomm will enable complex AI models to run on-device on upcoming Android flagship phones, removing the need for internet connectivity and round trips to cloud servers.

Simply put, we can now expect smarter and faster AI processing on premium Android phones with the latest Snapdragon chip. The Qualcomm Snapdragon 8 Gen 3 processor supports large language models with over 10 billion parameters running at almost 15 tokens per second. You can read more about the Snapdragon 8 Gen 3 here. Qualcomm also gave us a glimpse at what to expect from its next flagship processor. You can read about the Snapdragon 8 Gen 4 here.

Link:
Google's Gen-AI models are coming to more Android phones with ... - Android Authority