Gemini Intelligence update: controlling your phone

Google expands Gemini with Gemini Intelligence, adding task automation, image-based actions, widgets, Chrome features, and optional autofill.
Google is pushing Gemini deeper into Android life, and the pitch this time is straightforward: let your phone do more of the work for you, with less manual tapping.
During its pre-I/O Android showcase, the company announced a batch of Gemini updates designed to put the assistant in more places across the OS. Google also introduced a new umbrella name, “Gemini Intelligence,” describing how it packages Gemini capabilities for its most advanced Android devices.
Google said Gemini Intelligence “brings the very best of Gemini to our most advanced Android devices.” The rollout appears geared toward premium phones first. with Galaxy and Pixel models early to receive updates starting this summer.. Google’s director of Android experiences. Ben Greenwood. framed the effort as a gradual expansion. with features arriving in “waves” through the year as they become ready.
Task automation is one of the centerpiece additions.. It’s already available on some recent Pixel and Samsung Galaxy phones. where Gemini can use certain apps on your behalf.. Until now. the feature has been limited to a handful of rideshare and food delivery apps. but Google says task automation will open up to a wider range of apps “soon. ” expanding the set of workflows Gemini can handle.
The company is also adding multimodality to Gemini Intelligence.. Previously, Gemini could take voice or text prompts to guide its actions.. Now, users will be able to include a screenshot or photo as part of the request.. Google’s example makes the idea tangible: you can share an image of a grocery list from your notes app. and Gemini can add the listed items to your cart—assuming your Android device supports Gemini Intelligence.
Another new feature under the Gemini Intelligence banner is Create My Widget.. Google describes it as an early step toward “generative UI. ” allowing you to describe the functionality you want in natural language and then have AI generate a custom widget.. The examples Google shared include a cyclist-focused weather widget that surfaces wind speed and precipitation at a glance. as well as a recipe dashboard that can display specific suggestions on a weekly schedule. such as multiple high-protein meal prep ideas.
Create My Widget is also designed to extend beyond phones. Google says the widgets will carry over to Wear OS, meaning the same AI-generated widget experience can reach watches as well.
While widgets may look small, the concept shifts how people think about customizing a home screen.. Instead of building or selecting from a fixed list of options. the promise here is that parts of the interface can be generated from what you describe. potentially changing how quickly new surfaces for information or actions can appear.
Google is also bringing Gemini features from desktop Chrome to the Android Chrome app. That means you’ll see a Gemini button in Chrome, letting you share the contents of a webpage and ask Gemini questions directly inside the browser.
For subscribers to Google’s AI Pro or Ultra plans, Google also plans to roll out “auto browse.” The feature is intended to help complete tasks—Google’s example includes booking appointments—and it is scheduled to start rolling out in late June.
Beyond Chrome, Gemini will optionally be integrated into Android autofill.. Users will be able to choose whether to connect Gemini to help fill out forms. leveraging Gemini’s Personal Intelligence connection.. In theory. this could draw from user data such as Google Photos and Gmail to find relevant information to complete fields.. Google specifically points to the possibility of pulling a license plate number from Photos as an example of what that could look like.
That optionality is likely to matter because it sits right on the boundary between convenience and how much data access a user is comfortable with.. Google’s message suggests a smarter form-filling experience. but it also raises the natural question of where the line should be when personal context is used to act on your behalf.
For now, the company’s overall framing is a steady expansion rather than a single big switch. Gemini Intelligence features will “roll out in waves” through the rest of this year, with Galaxy and Pixel phones first to receive updates starting in the summer.
And if you’re already tracking big Android moments ahead of the I/O keynote, Google’s updates add another item to watch: whether the company will say more about “generative UI,” a phrase that’s now tied directly to the ability to create custom, AI-generated widgets on demand.
Gemini Intelligence Android updates task automation AI widgets multimodality Chrome Gemini autofill