Sensory Substitution: How to See With Your Tongue

Summary

The video highlights the incredible adaptability of the human brain through sensory substitution technology. Devices like BrainPort allow the blind to 'see' using their tongue, while other innovations like vibrating wristbands help the deaf perceive sound. These technologies tap into the brain’s neuroplasticity, enabling it to process sensory data from alternative sources. Beyond compensating for lost senses, sensory substitution holds the potential to expand human perception, integrating data like ultrasounds or magnetic fields. While promising, accessibility and affordability remain key challenges in realizing its full potential to improve lives.

Takeaways

• 👁️ The human senses are impressive, with the eyes, ears, and skin providing vast sensory information, but the brain is the most powerful part of the sensory system.
• 🧠 The brain decodes and combines electrical signals from various senses to create our perception of reality.
• ⚡ Sometimes, sensory connections get damaged, leading to loss of a sense, but technology is offering new ways to substitute one sense for another.
• 👅 The BrainPort device allows blind or visually impaired individuals to see through their tongue by translating visual data into electrical pulses.
• 🔄 The brain's neuroplasticity enables it to rewire and adapt, interpreting new signals regardless of their origin, like the BrainPort's use of tongue stimulation.
• 🦸 Devices like NeoSensory's Buzz wristband and Wearwork's Wayband provide sensory substitution for hearing and vision impairments.
• 🎧 The vOICe device translates images into sound, allowing users to 'see through sound' by using smart glasses equipped with cameras and speakers.
• 🌍 Technology could extend human senses beyond their natural capabilities, allowing us to perceive UV light, ultrasounds, and even the Earth's magnetic field.
• 📊 Sensory substitution opens up possibilities to process large amounts of digital data in ways our brains can understand, such as astronauts feeling space station metrics or surgeons monitoring vital signs through tactile feedback.
• 💡 Although these devices have transformative potential, they remain expensive, and efforts are needed to lower costs and improve accessibility for widespread use.

Q & A

What is the primary role of the brain in relation to human senses?

The brain's primary role is to analyze electrical impulses from all over the body, decode their meanings, and combine them to create the rich, multi-modal experience we call reality.

What is neuroplasticity, and why is it important for sensory substitution?

Neuroplasticity is the brain's ability to rewire itself and adapt to new patterns of signals. It is essential for sensory substitution because it allows the brain to process information from different sensory inputs, such as a camera connected to the tongue, and interpret them in a way that compensates for lost or diminished senses.

What is the BrainPort, and how does it help blind or visually impaired individuals?

The BrainPort is a device that connects a camera to a small plastic patch placed on the user's tongue. The patch has electrodes that send electrical pulses based on the visual input from the camera. These pulses allow the user to 'see' through their tongue by translating visual information into tactile sensations.

How does sensory substitution work in the case of balance restoration for people with inner-ear damage?

In people with inner-ear damage, the BrainPort can be connected to an accelerometer (a device that detects orientation) to send signals to the brain. The brain then reinterprets these signals to help the individual regain their sense of balance, even though the original sense organ (inner ear) is damaged.

What is the potential benefit of sensory substitution technologies like NeoSensory’s Buzz or Wearwork’s Wayband?

Devices like NeoSensory’s Buzz and Wearwork’s Wayband can assist people with hearing impairments by translating sounds into vibrations. They can also help the visually impaired by providing feedback through touch, helping users navigate their surroundings or interpret sound data in a new way.

How could sensory substitution extend human perception beyond natural senses?

Sensory substitution could extend human perception by allowing us to sense data that we can't naturally detect, such as UV light, ultrasounds, or the Earth’s magnetic field. Technology could translate these inputs into signals that the brain can interpret, effectively giving humans enhanced or 'superhuman' senses.

What does David Eagleman propose as a future use of sensory substitution?

David Eagleman proposes that sensory substitution could be used in various fields such as space exploration, aviation, and surgery. For example, astronauts could use vibrotactile vests to monitor space stations, or pilots could simplify their dashboard readouts into sensory feedback they can feel.

Why is the cost of sensory substitution technology a concern?

The cost of sensory substitution technology is a concern because, while devices like vibrotactile wristbands are innovative, they remain expensive and are considered luxury items. For these technologies to benefit the greatest number of people, their price must become more affordable.

How has sensory substitution been successfully demonstrated in real-life scenarios?

Sensory substitution has been successfully demonstrated by blind mountaineer Erik Weihenmayer, who used the BrainPort during climbing expeditions. This shows that the technology can function in challenging environments, providing practical assistance to individuals in real-life situations.

What are the broader implications of sensory substitution technology in the Information Age?

In the Information Age, sensory substitution could allow humans to process and understand vast amounts of digital data by translating it into sensory feedback. This could revolutionize the way we interact with data, enabling us to perceive and interpret information in entirely new ways.