OpenAI Launches GPT-4o: Real-Time Voice and Video Chat That Hears and Sees

At its latest event on May 13, OpenAI unveiled GPT-4o, a powerful language model.

The “o” in GPT-4o stands for omni, from the Latin omnis, meaning “all” or “every”.

We can read this as OpenAI saying that GPT-4o is all-encompassing and all-capable. It also shows that OpenAI’s goal is to further lower the barriers to using AI, so that everyone can use AI tools at work, in learning and in creative work.

GPT-4o is not only fluent in text; it can also talk with you in real time using voice and images. It recognizes images and emotions, can sing, and responds quickly and expressively, just like talking with a real person.

What’s new with the launch of ChatGPT-4o:

Better voice understanding and interaction: GPT-4o uses new technology in voice conversation mode, making conversations with ChatGPT smoother and more natural. In voice conversation tests, it could even perceive breathing, as if talking with a real person.
Support for multiple input and output types (text, image, audio): The new model can process and generate not only text but also images and other media, enabling more interactive and visual communication. This will drive AI-generated content (AIGC) forward in video, audio and image generation.
Faster processing and lower operating costs: Compared with previous models, processing speed has doubled while operating costs have been halved. When talking with people, it can respond as quickly as a human.
Support for more languages: The new model lets ChatGPT handle 50 different languages with better speed and quality. It is also available through OpenAI’s API, so developers can start building applications with it.
An improved user interface: OpenAI released a ChatGPT desktop app and a web version of ChatGPT with an updated UI, and demonstrated live on an iPhone ChatGPT’s real-time voice, text and image interaction powered by the new GPT-4o model.

Industries GPT-4o may affect

Translation: GPT-4o’s real-time multilingual translation may reduce reliance on human translators.
Travel: With real-time multilingual translation, people may choose independent travel over group tours in the future.
Education: It can provide personalized tutoring, changing traditional teaching models.
Customer service: GPT-4o’s conversational understanding and emotion recognition will greatly improve the service experience and may reduce traditional customer service jobs.
Medical consultation: By recognizing facial images, it can offer preliminary health advice, changing how patients get information.
Software development: GPT-4o’s ability to understand code and solve problems will raise development efficiency and may affect the work of junior engineers.
Entertainment: It can write stories and songs, bringing new tools for content creation.
News media: AI’s text generation can produce news content quickly.
Finance and accounting staff: GPT-4o’s data analysis capabilities will improve work efficiency.

On May 29 (North American time), OpenAI announced that GPT-4o is free for all users. Users can upload files in the browser and use data analysis and vision features. GPT-4o can handle a wide range of tasks to a high standard, is available around the clock without food, drink or rest, and even meets users’ emotional needs. It may affect every industry in the future.

Have you caught the wave of digital transformation yet?

ESi AIM is an all-in-one LINE marketing platform. It offers lively solutions for running LINE and a clear picture of your friends, backed by in-depth data analysis, so you can grow friends more efficiently, avoid blocks and convert friends into real customers.

By providing comprehensive, real-time and personalized data, a CDP helps businesses adapt to the digital environment, improve operational efficiency, customer experience and competitiveness, and drive digital transformation.

Want more information about customer data platforms (CDPs) and how to get started? Visit our website now to learn more.

Open up new channels for growth

See your members in full and build momentum for revenue growth.

Talk to an expert