OpenAI Unveils GPT-4o: A Leap Forward in Real-Time Multimodal AI Interaction
Summary:
OpenAI has introduced a new AI model, GPT-4o, an advanced chatbot capable of processing and responding to audio, visual, and text inputs in real-time. Demonstrations of the technology showcased its diverse capabilities, from assisting users in various tasks such as interview preparation to detecting users' emotions. The model, which significantly outperforms OpenAI's previous AI tools, is expected to spur more natural human-computer interactions. Its rollout began on May 13th, starting with text and image inputs, and voice and video input updates will be launched in the following weeks.
OpenAI, the creator of ChatGPT, has unveiled its latest AI offering, GPT-4o, a largerly conversational and uncannily humanlike AI chat companion that can analyze and react to both audio and visual user inputs in real time. Series of demonstrations provided by the company reveal GPT-4 Omni assisting potential users in various tasks, including preparing for a job interview visually, contacting customer service for an iPhone replacement, and judging a game of rock-paper-scissors between two individuals. The AI chatbot was even shown delivering dad jokes, translating bilingual conversations in real time, and responding wittily, as exhibited in one of the demos when it was introduced to a user's puppy for the first time.
OpenAI formally presented GPT-4o, an advanced model with abilities across audio, visual and textual interaction in real time: https://t.co/MYHZB79UqN
The rollout for text and image inputs in API and ChatGPT begins today, with the voice and video updates to follow in the upcoming weeks. pic.twitter.com/uuthKZyzYx— OpenAI (@OpenAI) May 13, 2024
“It's akin to the AI you see in films, and I'm still a bit startled by its reality,” confessed OpenAI's CEO, Sam Altman, in a blog post dated May 13. “Achieving humanlike response times and expressivity is quite a milestone.” On May 13, a text and image input-only version was launched initially, with the complete version scheduled to be released in the weeks ahead, as per OpenAI's statement in a recent X post. Both free and paid ChatGPT users will have access to GPT-4o from ChatGPT’s API. The “o” in GPT-4o stands for "omni”, signaling a leap towards more natural modes of interaction between humans and computers.
GPT-4o pushes the boundaries in AI innovation by simultaneously processing text, audio, and image inputs, a milestone improvement from OpenAI’s previous AI tools like ChatGPT-4 that commonly “left a significant amount of information” on the table when tasked to multitask. OpenAI voices that “GPT-4o outperforms preceding models in terms of audio and visual understanding,” including detecting users' emotions and breathing patterns. It’s also “significantly quicker” and “50% less expensive” as compared to GPT-4 Turbo in OpenAI’s API. OpenAI claims that the newly launched AI tool can reply to audio inputs as quickly as 2.3 seconds, averaging at about 3.2 seconds, conforming to typical human response durations in an everyday conversation.
Published At
5/14/2024 3:32:23 AM
Disclaimer: Algoine does not endorse any content or product on this page. Readers should conduct their own research before taking any actions related to the asset, company, or any information in this article and assume full responsibility for their decisions. This article should not be considered as investment advice. Our news is prepared with AI support.
Do you suspect this content may be misleading, incomplete, or inappropriate in any way, requiring modification or removal?
We appreciate your report.