Apple's iOS 26 Redefines Visual Intelligence with Enhanced On-Screen Content Recognition and ChatGPT Integration
June 14, 2025
Apple's Visual Intelligence feature in iOS 26 has undergone significant upgrades, enhancing its capabilities beyond camera use to include on-screen content identification and information retrieval.
Users can now capture screenshots using the power and volume buttons, unlocking new features such as Ask, Highlight to Search, and Image Search.
The Highlight to Search feature allows users to draw over objects in screenshots to search for specific items, leveraging Google Image Search by default, while also supporting potential integration with other apps.
This feature enables users to select specific objects in photos for web searches, closely resembling Google's Circle to Search functionality.
When an object is recognized, a glowing icon appears, allowing users to tap for more information, whether they are using the live camera or a saved photo.
The Ask button introduces a conversational element, enabling users to chat with ChatGPT about the content displayed on their screens.
In addition to the Ask button, users can query ChatGPT for information about their screenshots, while the Search button provides results from Google.
Visual Intelligence can search for similar images online, offering results from both Google and other platforms like Etsy and Pinterest.
The feature can automatically identify individual objects in images, similar to its functionality within the Photos app, without requiring the Highlight to Search tool.
The updated Visual Intelligence supports quick identification of various objects, including art, books, landmarks, and sculptures, in addition to its existing capabilities for animals and plants.
This advanced feature requires devices that support Apple Intelligence, specifically the iPhone 15 Pro and iPhone 16 models, and is activated via the Camera Control button or Action Button.
Currently in beta testing, iOS 26 is set to launch publicly in September 2025, promising to transform how users interact with screenshots on their iPhones.
Summary based on 2 sources