AI News: The AI Arms Race is Getting Insane!

Summary

This week in AI saw major announcements from Google and OpenAI, with Google's Gemini 1.5 becoming available in 180 countries and OpenAI's GPT-4 Turbo model improving at coding and math. New large language models were released, including Stability AI's non-commercial Stable LM2 and ML's Mixr 8X 22b. Meta is also on the verge of releasing Llama 3, an open-source model. Additionally, companies are developing AI chips to reduce reliance on Nvidia GPUs, and there's a push for AI companies to disclose their training data. In the world of AI music, Udio is gaining support from musicians, and Spotify is testing AI-generated playlists.

Takeaways

• 📢 Google's Cloud Next event in Las Vegas featured numerous AI-related announcements, with a focus on enterprise and developer tools.
• 🌐 Google made Gemini 1.5 available in over 180 countries, offering a 1 million token context window for advanced language understanding and audio processing.
• 🎥 An example of Gemini 1.5's capabilities includes analyzing an hour-long audio file to provide key takeaways and generate YouTube video titles and thumbnails.
• 🤖 OpenAI announced a significantly improved GPT-4 Turbo model, which is now available through the API and has shown better performance in coding and math tasks.
• 🚀 Stability AI released Stable LM2, a 12 billion parameter model that can be used both non-commercially and commercially with a membership.
• 🌟 ML released a new large language model using a mixture of experts architecture, featuring 176 billion parameters and a 65,000 token context window.
• 🔥 Google introduced new versions of their open-source large language model, Gemma, tailored for coding and efficient research purposes.
• 🐫 Meta is close to releasing Llama 3, an open-source model expected to be as capable as GPT-4, with multiple versions for different use cases.
• 💰 Tech companies like Google, Intel, and Meta are developing their own AI chips to reduce reliance on Nvidia's GPUs, which currently dominate the AI training market.
• 🎶 AI music generators like Udio are gaining popularity and support from musicians, offering a platform for creating music with AI assistance.

Q & A

What is the main focus of the AI news in the spring of last year?

The main focus of the AI news in the spring of last year was the ramping up of announcements related to new large language models becoming available, as well as the developments in AI technology by major companies like Google and OpenAI.

What significant announcement did Google make at their Google Cloud Next event in Las Vegas?

At the Google Cloud Next event, Google announced the availability of Gemini 1.5 in over 180 countries with native audio understanding system instructions and JSON mode, among other features.

What is the context window of Gemini 1.5 and how does it compare to other models?

Gemini 1.5 has a context window of 1 million tokens, which is significant because it allows for a much larger amount of input and output for the model to work with, providing a combined 750,000 words for interaction.

How did Bill use Gemini 1.5 to enhance his YouTube content creation?

Bill used Gemini 1.5 to analyze an hour-long audio file from a video interview, generate key takeaways, suggest high click-through rate YouTube titles based on principles of Daryl EES and top YouTube creators, and even provide feedback on which thumbnail to use for the video.

What is the difference between GPT-4 Turbo and the previous model in terms of capabilities?

GPT-4 Turbo is an improvement over the previous model with enhanced capabilities in coding and math, and it is updated through December 2023. It is also considered the strongest and most powerful model according to the chatbot Arena.

What is the open-source model released by Stability AI and how does it compare to Mixl 8X 7B model?

Stability AI released Stable LM2, a 12 billion parameter model that slightly underperforms the Mixl 8X 7B model. It can be used both non-commercially and commercially, but commercial use requires a Stability AI membership.

How did Mistol release their new large language model and what are its specifications?

Mistol released their new model, Mixr 8X 22b, through a torrent link. The model features a 65,000 token context window and a total of 176 billion parameters, with eight experts each having 22 billion parameters.

What is the significance of the new large language models released by Google and Meta?

Google released new versions of Gemma, their open-source large language models, focused on coding and efficient research. Meta is close to releasing Llama 3, an open-source model expected to be as good as GPT 4, available for anyone to use and build upon.

What are the implications of the new AI chips introduced by Google, Intel, and Meta in relation to Nvidia's dominance in the GPU market?

Google, Intel, and Meta are all developing their own AI chips to reduce reliance on Nvidia's GPUs. While Nvidia currently leads the market, these companies are attempting to catch up and provide alternative options for AI model training and development.

What is the controversy surrounding AI companies and their use of copyrighted material for training?

There is a debate over the use of copyrighted material for training AI models. A new bill has been introduced to Congress that would force AI companies to reveal the copyrighted material used in training their generative AI models. This is due to concerns over data privacy and the ethical use of content.

How is Adobe approaching the acquisition of training data for their AI models?

Adobe is taking a different approach by offering to purchase video content from creators for their AI training data. They are willing to pay between $3 to $7 per minute for everyday video footage, which is a shift from the traditional method of data acquisition.