Всё о новой нейросети GPT-4o за 7 минут!

Summary

On May 13, Open AI introduced the new multimodal, large language model GPT-4o. The video script, presented by Open AI's Technical Director Mira Murati, covers three main topics: the free distribution of the service, a desktop application version, and an updated web interface. It also highlights the new flagship model GPT-4o, which can be tested through the Telegram bot 'JIPTI Ask Bot'. The bot offers text and voice responses, and can be customized with different roles or prompts. The company aims to make AI tools accessible to everyone, now possible without registration. A desktop version of ChatGPT is available for Mac users with a Plus subscription, with broader access and a Windows version planned for later this year. The web interface has been simplified for ease of use. GPT-4o provides the intelligence of GPT 4 but with improved speed and performance in text, vision, and audio. It interacts natively with these modalities, eliminating the need for complex model structures. The intelligence of GPT 4o will be free for all users, with over 100 million people already using ChatGPT for various purposes. The GPT Store is actively developing, and over 1 million users have created custom GPTs for niche use. The model also supports vision through screenshots, photos, and documents with text and images, utilizing GPT's memory. ChatGPT's quality and speed have been enhanced in 50 different languages. Paid users will have five times the limits compared to free users, and GPT 4o is also available via API, offering developers faster interaction, lower costs, and higher limits than GPT 4 Turbo. Open AI has focused on security, integrating measures against misuse. The video demonstrates GPT-4o's practical applications, including audio capabilities in the mobile app, real-time voice interaction, and emotion detection. It also showcases vision capabilities, allowing users to interact with ChatGPT through video. The model can answer complex questions, provide coding assistance, and translate in real-time. Open AI plans to implement these features for all users in the coming weeks, with more significant achievements to be announced soon.

Takeaways

• 🚀 OpenAI introduced a new version of its multimodal, large language model GPT-4o on May 13th.
• 📢 The presentation was led by Mira Murati, the technical director of OpenAI, covering three main topics: free distribution of the service, a desktop application, and an updated web interface.
• 🆓 Users can test all the new features of GPT-4o immediately through the Telegram bot 'DJPTI Ask Bot', which is more convenient and cost-effective than the original Chat GPT.
• 🔊 The bot can provide responses not only in text but also in voice, upon the user's request via the /voice command.
• 📞 Direct voice output in ChatGPT is not yet available, but it will be implemented in the API and subsequently in the DJPTI Ask Bot.
• 👾 The bot excels in image and voice recognition and can be customized to take on different roles or behaviors based on user prompts.
• 💬 The bot can be added to group chats to summarize chat history or answer questions to the entire group.
• 📊 Basic functions of the DJPTI Ask Bot are free with a limited number of requests, with a flexible tariff system for extended use.
• 💼 The company's mission is to make AI tools accessible to everyone, now possible without registration.
• 🖥️ A desktop version of ChatGPT is available, with early access for Mac users with a Plus subscription and a Windows version planned for the end of the year.
• 🌐 The web interface has been updated with a focus on simplicity and natural interaction, minimizing interface inconveniences.
• 🧠 The new GPT-4o model provides the intelligence of GPT 4 but operates faster and better in text, vision, and audio, natively interacting with these modalities without complex constructions.
• 🌟 GPT 4o intelligence will be free for all users, with over 100 million people already using ChatGPT for various purposes.
• 📈 The GPT Store is actively developing, with over 1 million users creating custom GPTs for niche use, and the ability to utilize GPT's memory.
• 🔍 Improved quality and speed of ChatGPT across 50 different languages.
• 💰 Paid users will have 5 times larger limits compared to free users.
• 📈 GPT 4o is also available via API, offering developers faster interaction, at half the cost, and with 5 times larger limits than GPT 4 Turbo.
• 🛡️ OpenAI has focused on security, integrating measures against misuse.
• 📱 Audio capabilities in the mobile app are accessible through an icon in the lower right corner.
• 🗣️ Users can now converse with ChatGPT like traditional voice assistants, with high-quality speech recognition, fast response times, and in-depth, meaningful answers.
• 🎭 The model can generate speech in various emotional styles with a wide dynamic range.
• 👀 Vision capabilities allow interaction through video, with the system recognizing and responding to the video feed in real-time.
• 🤖 The model can answer more complex questions, such as the practical use of linear equations, and offers real-time communication.
• 💻 Traditional programming questions are easily resolved, with the ability to insert code into the chat for analysis and explanation.
• 📈 The developers conducted a survey on Twitter to understand what questions users would like to ask ChatGPT.
• 🌐 ChatGPT is capable of real-time translation, for example, from Italian to English and vice versa.
• 😀 The model can determine emotions through facial expressions via a front-facing camera.
• ⏱️ Open AI will be rolling out the demonstrated capabilities to all users in the coming weeks, with more significant achievements to be announced soon.

Q & A

What is the new version of the multimodal, large language model introduced by Open AI?

The new version introduced by Open AI is GPT-4o, which is a multimodal, large language model.

Who presented the presentation about the new version of GPT?

Mira Murati, the technical director of OpenAI, presented the presentation.

What are the three main topics discussed in the presentation?

The three main topics discussed were the free distribution of the service, the desktop version of the application, the update of the web interface, and the new flagship model GPT-4o.

How can users test the new features of GPT-4o?

Users can test the new features of GPT-4o by using the Telegram bot called Djipti Ask Bot.

What is the command to receive responses in voice format?

To receive responses in voice format, users can simply write the command /voice.

What is the current limitation regarding the direct voice output in ChatGPT?

As of the time of the presentation, direct voice output has not been implemented in ChatGPT, neither in the chat itself nor in the API.

What is the mission of the company behind GPT-4o?

The mission of the company is to make AI tools accessible to everyone.

What is the status of the desktop version of ChatGPT for Mac and Windows users?

Mac users with a Plus subscription already have early access to the desktop version of ChatGPT, with broader access and a Windows version planned for the end of the year.

How has the web interface of ChatGPT been updated?

The web interface has been updated with a focus on simplicity and naturalness, aiming to minimize interface inconveniences and allow users to focus on interacting with ChatGPT.

What are the improvements in the new model GPT-4o over its predecessor?

GPT-4o provides the intelligence of GPT 4 but operates faster and better in areas of text, vision, and audio. It natively interacts with these elements without the need for a complex structure of combined models.

How does the new model GPT-4o benefit its users in terms of cost?

The intelligence class GPT 4o will be free for all users.

What is the current usage of ChatGPT worldwide?

ChatGPT is used by over 100 million people for learning, creation, and work.

What are the benefits of using GPT-4o through its API for developers?

Developers can interact with GPT-4o through its API, offering twice the speed, 50% lower cost, and five times greater limits compared to GPT 4 Turbo.

What steps has OpenAI taken regarding the security of GPT-4o?

OpenAI has integrated measures against misuse and is continuously working on improving the security aspects of GPT-4o.

How does the audio capability in the mobile application of GPT-4o work?

The audio capabilities are accessible through an icon in the lower right corner of the mobile application, allowing users to converse with ChatGPT similarly to traditional voice assistants like Alexa or Siri.

What are the key differences in the voice mode of GPT-4o compared to previous versions?

Key differences include the ability to interrupt the model, real-time response without 2-3 second delays, emotion detection, and the generation of voice in various emotional styles with a wide dynamic range.

How can users interact with GPT-4o using its vision capabilities?

Users can interact with GPT-4o through video by tapping the camera icon and transmitting a video feed, which ChatGPT will recognize and respond to.

What kind of programming-related tasks can ChatGPT assist with?

ChatGPT can assist with traditional programming questions, provide explanations for functions in code, and give a brief description of the code when inserted into the chat.

How does the translation capability of GPT-4o work?

GPT-4o is capable of real-time translation, for example, from Italian to English and vice versa.

What additional feature does GPT-4o have regarding facial recognition?

GPT-4o can determine emotions based on facial expressions through a front-facing camera.