Introduction
The Gemini app has introduced a new feature called “Talk Live about this” for users of the Pixel 9 series, allowing for real-time conversations about various media types such as images, files, and YouTube videos. This enhancement marks a significant shift from the previous functionality, which was primarily focused on general knowledge inquiries. The rollout of this feature is part of a broader effort to improve user interaction with the app and is currently available on specific devices, with plans for wider availability in the near future.
New Features of Gemini App
With the launch of “Talk Live about this,” users can initiate discussions about different content types directly through the Gemini interface. The feature is accessible via a floating overlay that presents a suggestion chip above the existing “Ask about…” button. Depending on the context, users will see options like “Talk Live about video” when in YouTube, “Talk Live about PDF” in Files by Google, and “Talk Live about this” for images. This new functionality enhances the app's interactivity, allowing for more focused conversations based on specific content.
How to Use the Feature
To engage with this feature, users must access the Gemini Live interface, which requires them to upload images through a ‘plus’ menu rather than using the automatic screenshot shortcut. Once the content is uploaded, a preview appears alongside sound wave indicators to facilitate the conversation. The initial interaction with Gemini provides users with guidance on how to utilize the feature effectively, including an option to manage the auto-submit function for prompts. Users can choose to manually submit content or allow for automatic submissions based on their preferences.
Device Availability and Future Plans
Currently, the “Talk Live about this” feature is being tested on Pixel 9 devices that are running the Google app version 16.3.32, which is still in beta. Additionally, users of the Galaxy S24 will receive this feature shortly, while it will be available out of the box for Galaxy S25 owners upon launch. The company has announced plans to expand this feature to more Android devices in the coming weeks, indicating a commitment to enhancing user experience across a broader range of devices.
Looking Ahead: Project Astra
This rollout comes ahead of the anticipated Project Astra, which aims to further enhance the Gemini app's capabilities by enabling users to share their screens and stream video content in real-time while engaging in conversations with Gemini Live. This upcoming feature promises to expand the interactive possibilities for users, making the app a more versatile tool for communication and media engagement.
Conclusion
The introduction of the “Talk Live about this” feature in the Gemini app represents a significant advancement in how users can interact with digital content. By allowing real-time discussions about specific media types, the app not only enhances user engagement but also sets the stage for future innovations like Project Astra. As Gemini continues to evolve, it reflects broader trends in technology aimed at creating more interactive and user-friendly experiences across various platforms.