Free AI Audio Tools You Won't Believe Exist

This video introduces four free AI audio tools that run locally on your computer without an internet connection. The presenter highlights Adobe Audition and Premiere Pro's speech enhancement feature, DaVinci Resolve's vocal isolation, and Audacity's AI plugins, which are easy to install and offer transcription, noise suppression, and music generation capabilities. The AI transcription tool uses the Whisper model to transcribe audio locally, while the noise suppression tool effectively removes background noise. Additionally, the video demonstrates low-cost stem separation to isolate vocals or music, and music generation from text prompts or remixing existing tracks. The presenter also discusses the potential for future AI tools in audio editing and creation.

Takeaways

• 🎙️ The video introduces four free AI audio tools that can run locally on a computer without an internet connection.
• 🚀 Adobe Audition and Premiere Pro have integrated speech enhancement features for improved audio quality.
• 🎶 DaVinci Resolve offers vocal isolation and other AI-powered audio tools in partnership with Intel.
• 🔧 Audacity, a free and open-source tool, can be enhanced with AI plugins for various audio processing tasks.
• 📚 Audacity's latest version (3.4.2 at the time of recording) is required to install AI plugins.
• 💻 Users can download and install AI plugins from a provided web link and enable them in Audacity's preferences.
• 📝 The transcription plugin allows local transcription of audio without relying on cloud services or APIs.
• ⏱️ The Whisper model is used for transcription, offering high-quality results similar to paid services.
• 🔊 Noise suppression can be achieved using AI, providing a cleaner audio track in seconds.
• 🎼 AI-powered music track separation allows users to isolate vocals, drums, bass, and other instruments from a mix.
• 🎉 Music generation is possible within Audacity, enabling users to create new tracks or remix existing ones using text prompts.
• 🔗 The video provides a link in the description to download necessary files for the AI plugins.
• 📈 The product manager of Audacity hints at future developments and collaborations with Intel for more AI tools.

Q & A

What are the four AI audio tools mentioned in the video?

The video does not explicitly list four separate tools but focuses on the AI capabilities that can be added to Audacity, including transcription, noise suppression, music separation, and music generation.

How can I enhance speech using Adobe Premiere Pro?

The video mentions that Adobe Premiere Pro has integrated speech enhancement. You can use this feature to potentially make your speech sound as if it was recorded in a professional studio without background noise.

What is the process of installing AI plugins in Audacity?

To install AI plugins in Audacity, ensure you are running the latest version (at the time of the video, it's Audacity 3.4.2). Then, download the necessary files from the provided web link, extract them, and drag them into the Audacity installation folder. After that, open Audacity, go to Edit > Preferences, navigate to Modules, and enable the mod-dash-openvino module. Restart Audacity to access the plugins under the Effect, Generate, and Analyze menus.

How does the transcription feature in Audacity work?

The transcription feature uses the Whisper model, one of the best transcription models available. After enabling the AI plugin, you can select a portion of audio in Audacity, go to Analyze > Open Vino > Whisper Transcription, and choose to transcribe or translate the audio. The transcribed text can then be exported with timestamps via File > Export > Export Labels.

What is the AI-powered noise suppression tool in Audacity?

The AI-powered noise suppression tool in Audacity allows you to remove background noise from audio tracks using either a CPU or GPU for processing. It provides a cleaner audio track in a matter of seconds.

How does the music separation feature in Audacity work?

The music separation feature uses AI to separate a music track into different components, such as drums, bass, vocals, and other instruments. This allows users to isolate specific elements of a track for remixing or other audio editing purposes.

What is the music generation feature in Audacity?

The music generation feature in Audacity enables users to create new music tracks either by remixing existing music or by generating something completely new using a text prompt. The feature allows for various settings adjustments and can utilize either a CPU or GPU for processing.

Why is it significant that these AI tools run locally on your computer?

Running these AI tools locally on your computer is significant because it allows for greater privacy and security as you do not need to upload your audio to the cloud or share it with third-party companies. It also means you can use these tools without an internet connection.

How does the AI music generation compare to traditional music creation?

AI music generation in Audacity automates the process of creating music based on a given prompt or style, which can save time and offer new creative possibilities. However, it may require fine-tuning and may not yet reach the expressiveness and nuance of traditionally composed music.

What are the potential use cases for the AI audio tools in Audacity?

Potential use cases include transcription of podcasts or interviews without cloud services, noise reduction for clearer audio, music separation for remixing or isolating vocals or instruments, and music generation for creating new tracks or remixing existing ones.

What are the system requirements for using these AI plugins in Audacity?

The system requirements include running the latest version of Audacity (3.4.2 at the time of the video) and having a CPU or GPU capable of processing the AI models. Internet access is needed initially to download the plugins but not for their operation.

How can I stay updated with new features and AI tools introduced to Audacity?

To stay updated with new features and AI tools in Audacity, you can follow their official channels, subscribe to their newsletter, or regularly check their website and community forums for announcements and updates.

Outlines

00:00

🎙️ Introduction to Free AI Audio Tools

The video introduces four free AI audio tools that can run locally on your computer without an internet connection. The presenter expresses excitement about AI music generators and highlights the significance of these tools, which are considered groundbreaking. Adobe Audition and Premiere Pro's speech enhancement feature is mentioned, along with DaVinci Resolve's vocal isolation tool. The primary focus is on Audacity, which is easy to install with AI plugins, and the latest version required is specified as 3.4.2. The process for downloading and enabling these plugins is outlined, and the video promises to demonstrate the transcription plugin's capabilities using a sample audio clip.

05:00

🔊 AI-Powered Transcription and Noise Suppression

The video demonstrates the transcription feature of Audacity's AI plugin, which traditionally required cloud services. The presenter shows how to transcribe an audio sample using the Whisper model locally on a computer, a feature that was previously only available through paid cloud services. The process of exporting the transcription with timestamps is also shown. Additionally, the video compares the AI noise suppression tool with Audacity's original noise reduction feature, noting the AI tool's faster processing time and the original tool's more aggressive settings that may introduce artifacts into the audio.

10:03

🎼 AI Music Track Separation and Remixing

The presenter discusses AI's capability to separate music tracks into components, such as music backing or vocals, using Audacity. This feature is particularly useful for remixing or isolating specific elements of a track. The video shows how to use the music separation tool to isolate drums, bass, other instruments, and vocals from a jingle. The presenter is impressed by the quality of the separation and the potential use cases for such a feature. The ability to remix existing music or generate new music using text prompts is also explored, with the presenter noting the need for further refinement of prompts and settings for better results.

15:05

🚀 Future of AI in Audacity and Music Generation

The video concludes with a discussion on the potential future developments of AI tools within Audacity, as mentioned by the product manager, Martin Keery. The presenter expresses enthusiasm for the ongoing partnership between Audacity and Intel to develop new AI tools. The video also showcases the music generation feature, which allows users to create new music tracks based on text prompts. The presenter experiments with different prompts and settings to generate various music styles, noting the need for quality prompts and the impact of using a GPU on generation speed. The video ends with an invitation for viewers to like, subscribe, and comment on how they might use these tools in their work.

Keywords

AI audio tools

AI audio tools refer to software applications that utilize artificial intelligence to perform various audio-related tasks such as transcription, noise suppression, and music generation. In the video, the host introduces several AI audio tools that are free to use and can run locally on a computer without an internet connection, which is a significant advantage for privacy and convenience.

Adobe Audition

Adobe Audition is a professional digital audio workstation used for recording and editing audio. The script mentions that Adobe Audition, along with Adobe Premiere Pro, has integrated speech enhancement features. This implies that these Adobe products have the capability to improve the quality of speech within audio files, which is a valuable feature for professionals working with voiceovers or podcasts.

DaVinci Resolve

DaVinci Resolve is a advanced video editing software that also offers audio editing capabilities. The script highlights its vocal isolation feature, which allows users to separate vocals from the instrumental track in a song. This is particularly useful for those who need to isolate or adjust specific elements within a music track for remixing or other audio editing purposes.

Audacity

Audacity is a free, open-source digital audio editor and recording application. The video focuses on Audacity's compatibility with AI plugins that enable advanced features like transcription, noise suppression, and music generation. The ease of installing these plugins and using them within Audacity is emphasized, showcasing its user-friendly nature and powerful capabilities.

Transcription

Transcription is the process of converting spoken language into written text. The video demonstrates how one of the AI plugins in Audacity can transcribe audio files locally using the Whisper model, which is significant because it offers a high-quality transcription alternative to cloud-based services. This feature is beneficial for creating subtitles, closed captions, or transcripts for podcasts and other audio content.

Noise Suppression

Noise suppression is the reduction or removal of unwanted background noise from an audio recording. The script discusses an AI-powered noise suppression tool within Audacity that can clean up audio tracks quickly and efficiently. This is particularly useful for improving the clarity of audio recordings made in noisy environments.

Music Separation

Music separation is the process of isolating different components of a music track, such as vocals, drums, bass, and other instruments. The video showcases an AI tool that can perform this task within Audacity, allowing users to separate and manipulate individual elements of a song. This can be valuable for remixing or creating a cappella versions of songs.

Music Generation

Music generation refers to the creation of new music using AI algorithms. The video introduces a feature within Audacity that can generate new music based on text prompts or remix existing music. This is an innovative application of AI that opens up possibilities for musicians, producers, and hobbyists to create unique music tracks without traditional composition skills.

Local Processing

Local processing means performing tasks directly on the user's computer rather than relying on cloud-based services. The video emphasizes the benefits of running AI audio tools locally, which include privacy, not needing an internet connection, and potentially faster processing times. This is particularly appealing for users who work with sensitive or proprietary audio content.

OpenVino

OpenVINO (Open Visual Inference and Neural Network Optimization) is a toolkit developed by Intel that optimizes deep learning models for computer vision and video analytics applications. In the context of the video, OpenVINO is used to enable AI functionalities within Audacity, highlighting a partnership between Intel and the development of AI tools for audio processing.

Plugin

A plugin, in the context of software, is an additional component that can be added to a program to extend its functionality. The video discusses the installation and use of AI plugins in Audacity, which provide advanced features powered by AI. These plugins allow users to perform complex audio tasks that would otherwise require more specialized software or services.

Highlights

The video introduces four free AI audio tools that are surprisingly effective.

AI music generators can run locally on your computer without an internet connection.

Adobe Audition and Premiere Pro have integrated speech enhancement features.

DaVinci Resolve offers vocal isolation and other AI-powered audio tools.

Audacity is highlighted as an easy-to-use tool for installing AI plugins.

The latest version of Audacity required for the plugins is version 3.4.2.

Transcription can be done locally on your computer using Audacity and the Whisper model.

The Whisper model is one of the best transcription models available today.

Audacity's AI plugins enable noise suppression using either CPU or GPU.

A comparison is made between AI-powered noise reduction and traditional Audacity noise reduction.

AI tools allow for low-cost stem separation in music tracks.

Audacity's music separation feature can isolate vocals, drums, bass, and other instruments.

Music generation within Audacity allows for creating new tracks from existing music or text prompts.

The music generation feature is in its early stages but shows promise for the future.

Product manager Martin Keery discusses the future of AI tools in Audacity.

The video provides a comprehensive guide on how to install and use the AI plugins with Audacity.

The AI audio tools presented have the potential to greatly enhance audio production workflows.

The video concludes by encouraging viewers to explore these free tools for their audio projects.