Google's AI Mode is now capable of searching through your emails and photos as well - here's how it functions

  

Google will create personalized search results through its AI Mode in Search by enabling users to connect their Gmail and Photos accounts with the new search system, which will provide better personalized results. 

The Personal Intelligence feature from Google, which first launched last week, now provides its latest update through the new function that connects Gemini with Google proprietary software. The development team wants to convert Gemini, which first developed as a general conversation tool, into a personalized virtual assistant that adapts to user needs and preferences through machine learning.

"Personal Intelligence transforms Search into an experience that feels uniquely yours by connecting the dots across your Google apps," Robby Stein, VP of product in Google's Search division, wrote in a blog post. "With this new experience, you can tap into your own personal context and insights to unlock even more helpful Search responses that are tailored to you."

How it works

Google's latest Search feature uses time-saving capabilities because saving time on basic tasks has become a critical performance metric for AI developers who create tools for consumers. The AI Mode allows users to use Gmail and Photos data as their search prompt; however, Stein states that users can make broad personal inquiries without showing specific details about their daily activities and personal information. 

The system operates like ChatGPT's memory feature for Google Search, which enables the AI to create personalized results through its use of previous email and photo data instead of requiring users to share information about their daily routine. 

Imagine you request a few suggestions for your upcoming journey. From that seemingly vague prompt, Gemini may access your Gmail account to locate messages detailing your plan to travel to Sydney in February with your entire family, as well as various photos of you and your children in museums and art galleries throughout the globe, to create personalized recommendations.

Alternatively, if you plan to shop for new clothing online ahead of the trip, the system can consider your previous purchases along with images of you to understand your style, while keeping in mind the Australian warmth (suggesting something light and breathable instead of a heavy jacket)

Confidentiality concerns

Using AI Mode in Google Search, like any tailored AI feature, clearly indicates that you are providing more of your personal information to Google.

In the blog post, Stein mentioned that the new feature is available on an opt-in basis, that users can disable the connections later if they reconsider, and that Gmail messages or photos will not be utilized for training new models.

Keeping those privacy measures in consideration, it's important to remember that allowing AI Mode in Search to access your Gmail and Photos will influence the search results you encounter, and this could lead to unexpected outcomes. If you possess numerous pictures of a friend's dog, the system may mistake you for a dog owner and create suggestions based on that.

"Personal Intelligence is still developing, similar to various new AI features," a spokesperson from Google informed in the Press meet. "This technology can make errors -- such as misunderstanding context or drawing false conclusions about your actions."

You will also have the choice to improve the system's replies by sending immediate follow-up messages in the prompt area or by rating undesired responses with a thumbs-down.

It's important to highlight that this is presently a trial feature being introduced solely to individual users, not to enterprise or educational accounts, suggesting that there are still numerous bugs to address before it's launched on a broader, organizational scale

Ways to gain access

Stein reports that the AI Mode link with Gmail and Google Photos is being introduced in English to Google AI Pro and Ultra users in the US within the next few days. A notification should be sent to them directly in AI Mode to utilize the feature.

When it becomes fully available, eligible users can access the feature by opening their profile in Search and choosing Search personalization —> Connected Content Apps —> Connect Workspace and Google Photos.