Welcome to the World of Audio Computers | Jason Rugolo | TED

Summary

In this TED talk, the speaker explores the evolution of technology and its impact on our relationship with screens. After reflecting on the growing dependence on smartphones, they introduce a new concept of 'audio computing.' This technology enables natural, engaging conversations with computers, replacing the need for screens. Through a prototype audio-based computer, the speaker demonstrates how advancements in auditory interfaces can enhance everyday experiences like communication, learning, and entertainment. The goal is to create a more intuitive, hands-free way of interacting with technology, moving away from visual interfaces toward a more natural, auditory-driven experience.

Takeaways

• 😀 Dreaming of the future of technology, the speaker reflects on the reality of modern life, where people are often glued to their phones, even while judging others for the same behavior.
• 😀 The speaker suggests that technology should foster healthier relationships, and emphasizes the need for a new type of computer that speaks our language naturally.
• 😀 The speaker has spent years funding deep tech and working at companies like ARPA-E and Google X, focusing on what comes next in the field of computing.
• 😀 The vision is to create a new type of computer: an audio-based system where users interact through natural language, rather than swipes, clicks, or voice commands.
• 😀 A prototype 'audio computer' is introduced, which doesn’t have a screen and aims to replace some of the functions typically done on visual computers.
• 😀 This 'audio computer' relies on natural language input and 'auditory space' output, offering a more intuitive and natural interaction compared to traditional tech interfaces.
• 😀 The speaker demonstrates how a conversation with the device (called 'Q') provides a more engaging and human-like interaction, contrasting it with robotic voice command systems.
• 😀 Natural conversation, the speaker argues, is more efficient and emotionally robust than text-based interactions, and technology should enable this type of communication with computers.
• 😀 The speaker introduces the concept of 'second-person neuroscience,' which explores how our brains function in social contexts, with conversation being a key part of thinking together.
• 😀 A key technological breakthrough is revealed: creating a computer that engages with us as a person would—understanding intention, accessing vast information, and using natural language processing.
• 😀 The new audio computer allows for an improved search experience, email management, and personalized app interactions through voice, reducing screen time and promoting a hands-free, heads-up lifestyle.
• 😀 In order to create a mixed-reality audio experience, the speaker discusses advancements in psychoacoustics and auditory technology, allowing for virtual soundscapes with unprecedented control over ambient acoustics.
• 😀 The audio computer uses beamforming, machine learning, and AI-driven applications to enhance real-world audio experiences, like isolating specific voices or translating languages in real time.
• 😀 The potential applications of this audio computing technology are vast, ranging from personalized education apps to fitness coaches and relaxation soundscapes, with imagination being the only limit.
• 😀 The speaker stresses that the goal is not just to build the first audio computer but to create a truly intuitive computing experience that doesn’t monetize attention or create dependency on new devices.

Q & A

What inspired the speaker to develop the concept of an audio computer?

The speaker was inspired by the realization that people are often immersed in their phones, and how the technology today, despite being advanced, has created a disconnect. They wanted to explore a new way to interact with technology that feels more natural, through conversation, rather than through swipes and clicks.

What is the fundamental difference between the audio computer and current devices like smartphones?

The key difference is that the audio computer does not have a screen. Instead, it relies on natural language input and auditory output, making the interaction more intuitive and engaging. It aims to reduce the time spent looking at screens and offers a more natural, conversational way of engaging with technology.

How does the audio computer interact with users?

The audio computer allows users to engage in natural, human-like conversations, using voice as the primary interface. It uses a natural language interface, so users can converse with it the same way they would with another person, without the need for rigid voice commands.

What is the role of 'auditory space' in the audio computer’s design?

'Auditory space' refers to the way the audio computer creates an immersive, spatial sound environment. It uses advanced psychoacoustic techniques to modify and control how sound is perceived, enabling the user to experience virtual soundscapes in high fidelity.

What is the significance of 'second-person neuroscience' mentioned in the talk?

Second-person neuroscience suggests that human thinking is not isolated but is a collective, social activity that happens out loud. It emphasizes that true communication and understanding occur in conversation, with subtle cues like tone, pitch, and intensity being integral to how we think and process information.

How does the audio computer improve on traditional voice assistants?

Unlike traditional voice assistants that rely on predefined, structured dialogue models, the audio computer enables free-flowing, natural conversation. It understands user intent, builds context over time, and provides a more intuitive and engaging experience.

What are some potential applications for the audio computer?

Potential applications include more intuitive email and search experiences, personalized education apps, fitness coaches, and even virtual soundscapes for relaxation or focus. It could also revolutionize how we interact with many everyday tasks, making them more conversational and seamless.

What is the purpose of the psychoacoustic research mentioned in the presentation?

The psychoacoustic research is aimed at understanding how the human brain perceives sound in space. This knowledge allows the creation of virtual auditory spaces that make sound appear as if it’s coming from all directions, enhancing the immersive experience of the audio computer.

Why does the audio computer not have a screen?

The absence of a screen is intentional. The speaker argues that we already have sufficient screens in our lives, and the goal is to create a more hands-free and heads-up experience. By eliminating the need to look at a screen, the audio computer promotes a more natural, conversational interaction.

How does the audio computer handle noisy environments, like a crowded restaurant?

The audio computer features beamforming and computational auditory scene analysis, allowing it to enhance specific sounds, isolate individual voices, and reduce background noise. It even has machine-learning capabilities for real-time transcription and translation, making it easier to hear and understand conversations in noisy environments.