OpenAI DevDay: Opening Keynote

At the inaugural OpenAI DevDay, CEO Sam Altman welcomed attendees and highlighted the company's achievements over the past year, including the launch of ChatGPT, GPT-4, and DALL-E 3. With two million developers using their API and a hundred million weekly active users on ChatGPT, OpenAI has solidified its position as a leading AI platform. The event introduced GPT-4 Turbo, a new model with significant improvements such as extended context length, enhanced control, better world knowledge, and new modalities like text-to-speech. The company also announced the upcoming GPT store for sharing custom GPTs, the Assistants API to simplify building assistive experiences, and a stronger partnership with Microsoft. The keynote emphasized OpenAI's commitment to empowering developers and users through AI, fostering a future where intelligence is integrated into every aspect of life, providing superpowers on demand.

Takeaways

• 🎉 OpenAI DevDay marked the launch of GPT-4 Turbo, a significant upgrade from GPT-4, offering improved capabilities and reduced costs.
• 📈 GPT-4 Turbo introduces a major increase in context length, supporting up to 128,000 tokens, which is 16 times longer than the previous 8K context limit.
• 📄 The new model provides developers with more control over responses through features like JSON Mode, function calling improvements, and reproducible outputs.
• 🌐 GPT-4 Turbo enhances world knowledge, with data updated to April 2023, and introduces new modalities including DALL-E 3 for image generation and a text-to-speech model.
• 🔧 Custom Models program allows companies to work closely with OpenAI researchers to create a tailor-made model for their specific needs and use cases.
• 🚀 OpenAI has doubled the rate limits for GPT-4 customers and introduced a Copyright Shield to protect customers from legal claims related to copyright infringement.
• 💰 Pricing for GPT-4 Turbo is set at a significantly lower rate than GPT-4, with a reduction by a factor of 3x for prompt tokens and 2x for completion tokens.
• 🤖 The introduction of GPTs (Guided Prompts) allows users to create tailored versions of ChatGPT for specific purposes, which can be shared publicly or kept private.
• 🤝 Microsoft's CEO, Satya Nadella, discussed the strategic partnership with OpenAI, emphasizing the mutual goal of empowering every person and organization through AI.
• 📱 The Assistants API simplifies the creation of custom assistant experiences within apps, providing persistent threads, built-in retrieval, and a code interpreter.
• ✈️ A live demo showcased the ability of the new voice assistant to interact with users in real-time, using Whisper for speech recognition, GPT-4 for understanding, and TTS for responses.

Q & A

What is the significance of the first-ever OpenAI DevDay?

The first-ever OpenAI DevDay is significant as it marks a milestone for the company, showcasing its growth, technological advancements, and commitment to the developer community. It is an opportunity for OpenAI to announce new developments, share insights, and engage with developers who are building on their API.

When was ChatGPT first shipped as a 'low-key research preview'?

ChatGPT was first shipped as a 'low-key research preview' on November 30th of the previous year mentioned in the transcript.

What are the new capabilities introduced by GPT-4 Turbo?

GPT-4 Turbo introduces several new capabilities including an extended context length of up to 128,000 tokens, more control over the model's responses through features like JSON Mode and reproducible outputs, better world knowledge with an updated knowledge cutoff in April 2023, new modalities such as DALL-E 3 integration, text-to-speech models, and the next version of the Whisper speech recognition model, customization options with fine-tuning and Custom Models, and higher rate limits for customers.

How does the new pricing for GPT-4 Turbo compare to GPT-4?

GPT-4 Turbo is considerably cheaper than GPT-4, with a reduction by a factor of 3x for prompt tokens and 2x for completion tokens. The new pricing is 1¢ per 1,000 prompt tokens and 3¢ per 1,000 completion tokens, making it more than 2.75 times cheaper to use than GPT-4 for most customers.

What is the role of Microsoft in the partnership with OpenAI?

Microsoft, led by CEO Satya Nadella, is a key partner for OpenAI, providing Azure credits and infrastructure support. They are committed to building the best system for training and inference of AI models and making it available to developers. Microsoft also uses OpenAI's technology to build their own products, such as GitHub Copilot.

What is the purpose of the GPT store that OpenAI plans to launch?

The GPT store is intended to be a platform where developers can list, share, and discover GPTs (tailored versions of ChatGPT for specific purposes). It will feature the best and most popular GPTs, fostering a vibrant ecosystem and allowing creators to monetize their GPTs through revenue sharing.

How does the new Assistants API simplify the process of building custom assistant experiences?

The Assistants API simplifies the process by including persistent threads for managing long conversation history, built-in retrieval to give assistants more knowledge, a working Python interpreter (Code Interpreter) in a sandbox environment, and improved function calling capabilities. This allows developers to build more sophisticated and integrated AI experiences with less complexity.

What are the benefits of using GPTs for businesses and developers?

GPTs offer tailored assistance for specific purposes, combining instructions, expanded knowledge, and actions. They can be more helpful in various contexts, provide better control, and make it easier to accomplish tasks or enhance user experiences. They can also be customized through natural language, making them accessible to people who may not have coding expertise.

What is the significance of the 'Copyright shield' introduced by OpenAI?

The 'Copyright shield' is a service provided by OpenAI that defends its customers against legal claims related to copyright infringement. If a customer faces such claims, OpenAI will step in to defend them and cover the costs incurred, offering an additional layer of protection and support for those building on their platform.

How does the new text-to-speech model enhance the capabilities of GPT-4 Turbo?

The new text-to-speech model allows GPT-4 Turbo to generate natural-sounding audio from text, offering six preset voices to choose from. This enhances the model's capabilities by making applications more natural to interact with, more accessible, and unlocking new use cases such as language learning and voice assistance.

What is the vision behind the gradual iterative deployment of AI agents by OpenAI?

OpenAI's vision is to empower individuals and elevate humanity through AI technology. They believe in a gradual and iterative approach to deploying AI agents to ensure safety and allow society to adapt. This approach is intended to give developers and users the opportunity to start building with and using these agents now, preparing for a future where they are more capable and integral to daily life.

Outlines

00:00

🎉 Introduction and OpenAI's Progress

Sam Altman opens the first-ever OpenAI DevDay in San Francisco, expressing excitement about the audience's presence and the city's significance to OpenAI and the tech industry. He reflects on the company's milestones, including the release of ChatGPT, GPT-4, and the addition of voice and vision capabilities. DALL-E 3 is highlighted as a significant advancement, and the enterprise version of ChatGPT is praised for its enhanced security and privacy. The rapid growth supported by word-of-mouth is also a point of pride. The audience hears about various use cases of AI, emphasizing the technology's profound impact on people's lives.

05:01

🚀 GPT-4 Turbo and New Features

The presentation introduces GPT-4 Turbo, a new model that addresses developer feedback with six major improvements. These include extended context length, more control over responses, better world knowledge, new modalities like DALL-E 3 and text-to-speech, customization options, and higher rate limits. The update to GPT-4 Turbo's knowledge base up to April 2023 is a significant change, and the introduction of the Whisper V3 speech recognition model is also mentioned. The pricing of GPT-4 Turbo is highlighted as being significantly cheaper than its predecessor, making it more accessible to developers.

10:02

🤝 Microsoft Partnership and Infrastructure

Sam Altman invites Satya Nadella, CEO of Microsoft, to discuss their partnership. Nadella emphasizes the unique workload demands of AI models and the system overhaul in Azure to support these models. He also mentions Microsoft's commitment to building products like GitHub Copilot using OpenAI's APIs. The discussion underscores the shared mission of empowering people through AI and the importance of safety and ethical considerations in AI development.

15:03

💡 Enhancements to ChatGPT and Future Directions

The conversation shifts to improvements in ChatGPT, which now utilizes GPT-4 Turbo and can perform a variety of tasks like browsing the web and generating images. The removal of the model picker is announced, aiming to streamline the user experience. The discussion then转向未来的方向, focusing on the concept of AI 'agents' and the gradual deployment of these technologies for safety and societal adaptation. The introduction of GPTs, or tailored versions of ChatGPT for specific purposes, is a key highlight, showcasing their potential for personalization and task automation.

20:04

🛠️ Building and Customizing GPTs

The process of building a GPT is demonstrated live, starting with a conversational interface that allows users to program a GPT with natural language. The GPT builder is shown creating a 'Startup Mentor' GPT that provides advice to founders based on uploaded lectures and predefined instructions. The customization options, including style and additional actions, are explored, emphasizing the ease of creating tailored AI experiences without coding expertise.

25:04

📈 GPT Store and Assistants API

The announcement of the GPT store, launching later in the month, is made, where developers can list their GPTs for others to use. The store will feature and promote the most popular and useful GPTs, with a revenue-sharing model for creators. The Assistants API is introduced to simplify the creation of agent-like experiences within apps, with features like persistent threads, built-in retrieval, and a Python code interpreter. The API's capabilities are demonstrated through a travel app example that uses GPT-4 for destination suggestions and integrates with DALL-E 3 for illustrations.

30:08

🔊 New Modalities and Assistants API Features

The Assistants API is further explored with a focus on new modalities, including voice interaction and real-time actions. The API's function calling capability is emphasized, allowing for JSON output and simultaneous invocation of multiple functions. The retrieval feature is shown parsing documents, and the stateful API is highlighted for its simplicity and reduced complexity. Code Interpreter's ability to write and execute code is demonstrated, and the integration of voice recognition and text-to-speech APIs is showcased. The assistant's capability to interact with the internet and perform actions, such as selecting attendees for rewards, is also illustrated.

35:10

🌟 Closing Remarks and Future Outlook

Sam Altman concludes the event by expressing gratitude to the OpenAI team and reiterating the belief in AI as a revolutionary technology. He emphasizes the importance of gradual deployment and the collective effort to shape the future with AI. The potential for AI to empower individuals and elevate humanity is discussed, with a vision of AI as a tool that grants superpowers on demand. The audience is thanked for their participation, and an invitation to return next year is extended, with a teaser for the advancements yet to come.

Keywords

OpenAI DevDay

OpenAI DevDay is an event organized by OpenAI, a company at the forefront of artificial intelligence research and deployment. The event serves as a platform for developers, researchers, and industry professionals to come together and discuss the latest advancements in AI technology. In the script, it is the setting for various announcements and discussions about AI models and capabilities.

GPT-4 Turbo

GPT-4 Turbo is a new AI model introduced by OpenAI during the DevDay event. It represents a significant upgrade from the previous models, offering enhanced capabilities such as increased context length, improved accuracy, and more control over the model's responses. The model is designed to be more efficient and cost-effective, allowing developers to integrate advanced AI functionalities into their applications more seamlessly.

DALL-E 3

DALL-E 3 is an advanced image model developed by OpenAI, capable of generating high-quality images from textual descriptions. It represents a leap in AI's ability to understand and create visual content. In the script, DALL-E 3 is mentioned as part of the new capabilities being integrated into the API, allowing users to programmatically generate images and designs.

API

API, or Application Programming Interface, is a set of protocols and tools that allow different software applications to communicate with each other. In the context of the video, OpenAI's API enables developers to access and utilize the functionalities of AI models like GPT-4 Turbo and DALL-E 3 within their own applications, thereby expanding the reach and application of these advanced AI technologies.

JSON Mode

JSON Mode is a new feature introduced in the GPT-4 Turbo model. It ensures that the model's responses adhere to the JSON (JavaScript Object Notation) format, which is a widely used data interchange format. This feature is significant for developers as it facilitates easier integration with systems that rely on JSON for data communication, thereby streamlining the process of building applications that interact with the AI model.

Reproducible Outputs

Reproducible Outputs is a feature that allows the AI model to return consistent results when given the same input. This is achieved by passing a seed parameter to the model. In the context of the video, this feature is important for developers who require deterministic behavior from the AI model, which can be crucial for testing and debugging applications that rely on AI model outputs.

Custom Models

Custom Models refer to a new program launched by OpenAI that allows companies to work closely with OpenAI researchers to create a tailored AI model specific to their needs and use cases. This involves modifying various steps of the model training process, including domain-specific pre-training and a custom reinforcement learning post-training process. The concept is introduced to cater to the needs of companies that require a higher level of customization and control over the AI models they use.

Rate Limits

Rate limits in the context of the API refer to the maximum number of requests or tokens that can be processed by the system within a given time frame. In the script, it is mentioned that OpenAI is doubling the tokens per minute for all established GPT-4 customers, effectively allowing for more requests to be made in the same amount of time, which can enhance the performance and capabilities of applications using the API.

Copyright Shield

Copyright Shield is a service introduced by OpenAI to protect its customers from legal claims related to copyright infringement. If a customer faces such claims, OpenAI will defend them and cover the costs incurred. This service is particularly important for enterprise customers using the ChatGPT Enterprise and the API, as it provides an additional layer of security and assurance when utilizing AI-generated content.

GPTs

GPTs, or Generative Pre-trained Transformers, are tailored versions of the ChatGPT model created for specific purposes. They are designed to be more helpful and contextually aware by combining instructions, expanded knowledge, and actions. In the script, GPTs are presented as a way for users to create custom AI agents that can perform tasks, provide advice, or enhance user experiences within various applications.

Assistants API

The Assistants API is a new tool introduced by OpenAI that simplifies the process of building custom assistant experiences within applications. It includes features like persistent threads for managing conversation history, built-in retrieval for accessing external knowledge, and a code interpreter for executing code. The API is designed to make it easier for developers to create AI-driven assistants that can perform complex tasks and interact with users in a more natural and integrated manner.

Highlights

OpenAI DevDay's opening keynote featured Sam Altman, CEO of OpenAI, welcoming attendees to the first-ever event.

A year ago, OpenAI shipped ChatGPT as a 'low-key research preview', which was well-received.

In March, GPT-4 was launched, touted as the most capable model in the world at the time.

Voice and vision capabilities were added to ChatGPT, enabling it to see, hear, and speak.

DALL-E 3, the world's most advanced image model, was launched and integrated into ChatGPT.

ChatGPT Enterprise was introduced, offering enterprise-grade security, privacy, and higher speed GPT-4 access.

2 million developers are building on the OpenAI API, and over 92% of Fortune 500 companies are using OpenAI products.

OpenAI has reached 100 million weekly active users on ChatGPT, growing through word of mouth.

GPT-4 Turbo, a new model, was announced with six major improvements including context length, control, world knowledge, modalities, customization, and rate limits.

GPT-4 Turbo supports up to 128,000 tokens of context, which is 16 times longer than the previous 8k context.

JSON Mode and reproducible outputs were introduced for developers to have more control over model responses.

OpenAI updated the knowledge cutoff for GPT-4 Turbo to April 2023 and committed to keeping it up to date.

DALL-E 3 and a new text-to-speech model were integrated into the API, allowing for image and voice interactions.

Custom Models program was launched for companies to create a custom model tailored to their specific needs.

Rate limits for GPT-4 customers were doubled, and copyright shield was introduced to defend customers against legal claims on copyright infringement.

Pricing for GPT-4 Turbo was announced to be significantly cheaper than GPT-4, by a factor of 3x for prompt tokens and 2x for completion tokens.

The introduction of GPTs, tailored versions of ChatGPT for specific purposes, allowing for customization and publishing for others to use.

The GPT store will be launched later this month for sharing and discovering GPTs, with a revenue-sharing model for creators.

Assistants API was announced to simplify the creation of assistive experiences within apps, including persistent threads, built-in retrieval, and code interpreter.

A live demonstration showcased the capabilities of the new Assistants API, including function calling, retrieval, and code execution.

The event concluded with a giveaway of $500 in OpenAI credits to five random attendees, and a promise of future advancements to be showcased at next year's DevDay.