Apple has released the first developer beta of iOS 18.2, featuring numerous new Apple Intelligence capabilities. One of the highly anticipated additions is the integration with ChatGPT, allowing users to ask Siri for detailed information about content displayed on their device screens.
By integrating ChatGPT into Siri, Apple's virtual assistant will utilize the OpenAI platform to answer complex queries. Additionally, it can read content from the screens of iPhones, iPads, or Macs. For instance, if you're watching a video or viewing someone's photo on Instagram, you can ask questions like "Where is this?" or "What building is in that photo?"
Source: 9to5mac
Siri captures a screenshot and uploads it to ChatGPT, which can understand the context and provide answers using its database. Of course, for privacy reasons, Siri always seeks your permission before capturing a screenshot of your device and sending it to ChatGPT.
This feature is particularly intriguing for those without the iPhone 16, as the iPhone 16 is currently the only device equipped with Visual Intelligence. With this feature, users can press "Camera Control" to get information about what they see through the camera. Visual Intelligence leverages Apple Intelligence, ChatGPT, and Google to provide answers.
Apple is also developing its own screen perception feature using the Apple Intelligence language model. However, this feature will be released with another update to iOS 18—possibly next year. Once available, Siri will understand context and act based on content on the screen—all processing is done on the device.
Source: 9to5mac
In addition to ChatGPT integration, iOS 18.2 also includes Image Playground, Genmoji, and a redesigned Mail app.
Currently, the iOS 18.2 beta is only available for devices compatible with Apple Intelligence, meaning iPhone 15 Pro or higher and M1 iPad or higher. This update will eventually be available for other devices as well.
Apple previously hinted that iOS 18.2 will be released to the public in December. iOS 18.1, which includes Apple's intelligent writing tools as well as notifications and text summaries, will be released next week.
