Recently, OpenAI has made significant updates to the advanced voice mode interface of its macOS application, introducing a brand new image upload feature. Previously, this function was non-clickable, but now users can finally upload images via the voice UI, and the uploaded images will be displayed on the interface.

image.png

However, it is important to note that ChatGPT will not prompt users that it cannot see the uploaded images. Users can upload an image and engage in relevant discussions with ChatGPT, making the process more intuitive.

In addition to uploading images, users can also directly use their laptop's camera to take photos, allowing for instant sharing of the captured content. However, features such as screen sharing, camera sharing, and video sharing are still pending.

image.png

In this update, there have been minor adjustments to the display of certain messages. For example, the prompts on how to start a new chat to use the advanced voice mode have been redesigned. It is worth mentioning that after a session involving video sharing, ChatGPT may prompt users to explicitly share videos to help improve the model. This prompt appears when users have enabled the option to share video data for model training. However, this option is not yet available in the UI and may be released together with the screen and video sharing features.

This update may foreshadow the upcoming release of the Canvas editor, a feature previously discovered in development. The full rollout of the voice mode may take longer, unless OpenAI decides to release it ahead of time without considering video and screen sharing features.

Key Points:

🌟 New Image Upload Feature: Users can now upload and discuss images via the voice UI, enhancing interaction experience.

📸 Direct Photo Sharing: Users can use their laptop's camera to take photos, but video sharing is not yet available.

🔍 Future Outlook: The Canvas editor is即将推出, and the full release of the voice mode may be postponed.