TechFlow news — OpenAI plans to roll out voice and image conversation features for ChatGPT. The new capabilities will be available to Plus and enterprise users within the next two weeks. Voice conversation will launch on both iOS and Android devices, while image conversation will be accessible across all platforms.
The voice feature is powered by a new text-to-speech model capable of generating human-like audio from just text and a few seconds of example speech. It uses the open-source speech recognition system Whisper to transcribe spoken words into text, generates a response, and then converts that response back into speech for the user. The image capability is supported by multimodal versions of GPT-3.5 and GPT-4, applying language reasoning to various types of images—including photos, screenshots, and documents containing both text and visuals. This allows users to show ChatGPT one or more images, after which the model attempts to understand the query and provide relevant answers—such as suggesting meal ideas based on the contents of a refrigerator, or analyzing complex data charts related to work.
