Be My Eyes: How ChatGPT4 is helping visually impaired people picture what they can't see | ITV News

Summary

An innovative AI-powered mobile app is transforming the lives of blind and partially sighted individuals by offering greater autonomy and independence. Lucy Edwards, one of the first users, demonstrates how the app helps her navigate her world, identify objects, and make decisions, such as what to cook with available ingredients. The app, which interprets images and contextualizes information, empowers users to function independently without relying on sighted assistance. While still learning, the app is set to be released globally for free, promising greater access to 253 million visually impaired people around the world.

Takeaways

• 😀 Artificial intelligence is enhancing a mobile app designed for blind and partially sighted people, improving everyday decision-making processes.
• 😀 Lucy Edwards, who lost her sight at 17, is one of the first users of an AI-powered app that helps her visualize her surroundings.
• 😀 The app uses AI to not only describe objects but also contextualize them, like suggesting recipes based on ingredients in the fridge.
• 😀 The app's AI can interpret both images and text, making it more versatile in providing assistance to users.
• 😀 One of the app's key features is identifying expiration dates on food items, offering a safety feature to help prevent foodborne illness.
• 😀 The app is highly accurate, with a 95% success rate in interpreting and identifying objects, although it is still evolving.
• 😀 The app can provide information on fashion, as seen in its ability to describe models wearing different outfits, showcasing its broad applicability.
• 😀 Lucy Edwards shared a deeply emotional experience where the app helped her navigate the London Underground, giving her newfound confidence in public transportation.
• 😀 Previously, the app relied on human volunteers for assistance, but now it gives blind users greater autonomy and independence.
• 😀 Despite its advancements, the app is not perfect—some limitations include difficulty in distinguishing closely related dog breeds, but its developers are working to improve it.
• 😀 The app, which has been in development for eight years, is learning continuously and will soon be available for free worldwide, offering improved accessibility to millions of people with visual impairments.

Q & A

What is the main focus of the AI-powered mobile phone app mentioned in the transcript?

The main focus of the AI-powered mobile phone app is to assist blind and partially sighted people by helping them make everyday decisions, such as identifying objects, interpreting images, and contextualizing the world around them.

How did Lucy Edwards lose her sight?

Lucy Edwards lost her sight at the age of 17.

What feature of the app does Lucy appreciate the most?

Lucy appreciates the app's ability to give her autonomy and independence, allowing her to navigate and make decisions without needing human assistance.

What recent update was made to the app?

The app was updated to interpret both pictures and words, improving its ability to assist users with interpreting images and contextualizing their surroundings.

How accurate is the app in identifying food expiration dates?

The app is about 95% accurate in identifying food expiration dates, helping users avoid consuming expired products.

What emotional reaction does Lucy express about the app?

Lucy expresses an emotional reaction, saying the app makes her cry because it helps her navigate situations like taking the tube, which she had not been confident doing for 10 years.

How does the app assist Lucy with taking the tube?

The app helped Lucy by interpreting a photo of a tube map and guiding her on where to go, which gave her the confidence to travel independently.

What was the role of human volunteers in the app's previous version?

In its previous version, the app relied on human volunteers to assist users, providing advice and guidance for tasks that the AI could not handle.

What challenge does the app still face in its functionality?

One challenge the app faces is accurately distinguishing closely related dog breeds, though it continues to improve and learn.

What is the developers' vision for the app in the future?

The developers aim to release the app for free worldwide, making it accessible to millions of blind and partially sighted individuals, with the potential to transform their ability to navigate and interact with the world.