When Now on Tap was first introduced nearly a decade ago, it promised users a seamless experience of accessing contextual information related to what was on their screen with just a simple tap and hold of the home button. As a recent college graduate at the time, I was thrilled by the possibilities this feature offered – the ability to effortlessly retrieve details about a movie, restaurant, or any other topic without leaving the current app felt truly futuristic. However, over the years, Now on Tap evolved into Google Assistant, losing some of its initial charm along the way.
At the recent Google I/O developer conference, Google unveiled new features in its Android operating system that harken back to the days of Now on Tap. These features leverage the power of advancements in large language models developed over the past decade to provide users with a more intuitive and efficient smartphone experience. According to Dave Burke, vice president of engineering on Android, the enhanced technology now allows for the creation of truly exciting assistants that can understand and predict user actions based on on-screen content. It’s a testament to how far we’ve come in terms of AI capabilities.
One of the standout features of Google’s latest Android update is Circle to Search, a novel approach to mobile search that aims to make the process more interactive and engaging. Unlike traditional search methods, Circle to Search involves literally circling the desired content on the screen to initiate a search. This innovative feature, introduced a few months ago, has been well-received by users and is especially popular among younger demographics due to its playful nature.
According to Sameer Samat, president of the Android ecosystem at Google, Circle to Search has received positive feedback from students in particular. The latest enhancement to this feature allows users to circle physics and math problems to receive step-by-step instructions on solving them without leaving the app. This new functionality ensures that users not only get the answers they need but also gain a deeper understanding of the problem-solving process. In the future, Circle to Search will be able to handle more complex tasks such as diagrams and graphs, thanks to Google’s specialized LearnLM models tailored for educational purposes.
Gemini, Google’s AI assistant, has been making waves in the Android ecosystem and is poised to overshadow Google Assistant in many ways. With the option to replace Google Assistant with Gemini on most Android phones, users are given a glimpse of the future of AI-powered assistants. When asked about the potential demise of Google Assistant in light of Gemini’s rise, Sameer Samat clarified that Gemini is an opt-in experience, offering consumers a choice to switch to this new assistant.
The evolution of Android’s features, especially with the introduction of Circle to Search and Gemini, represents a significant shift in how users interact with their devices. By harnessing the power of advanced AI technologies, Google is paving the way for a more personalized, intuitive, and efficient smartphone experience. As we continue to witness the rapid advancements in digital assistant capabilities, it’s clear that the future of Android is bright and full of exciting possibilities.