The ethical dilemma we face on AI and autonomous tech | Christine Fox | TEDxMidAtlantic

TEDx Talks

11 May 201718:47

Summary

TLDRThe video discusses the evolving relationship between technology and policy, emphasizing how rapid advancements in technology are outpacing government regulation. It explores military technology, autonomous systems, the Internet, and the Internet of Things, highlighting both the benefits and unforeseen risks. The speaker raises concerns about vulnerabilities, especially in cybersecurity and autonomous machines, urging a shift in responsibility to companies and consumers. They advocate for proactive measures like corporate social responsibility and 'red teaming' to address potential risks before technologies are released to the public, stressing that we all share the responsibility in shaping our technological future.

Takeaways

🤖 Advanced technology, particularly in robotics, can elicit mixed reactions, from excitement to concern about its potential risks.
⚔️ The military must comply with the laws of armed conflict, focusing on targeting combatants while protecting civilians, and it strives to improve with the help of technology.
🛠️ Precision weapons and drones are remotely piloted and not autonomous, contrary to public perception, and DoD policy mandates human oversight for any lethal actions.
🚫 Current policy prohibits fully autonomous lethal weapons, as they cannot yet reliably differentiate between combatants and civilians.
📉 The private sector is leading in advanced technology development, surpassing government agencies in research and development spending, creating a regulatory gap.
🌐 The internet, while transformative and beneficial, has also introduced vulnerabilities like cyber warfare, hacking, and threats to personal data and national security.
📱 The Internet of Things (IoT) brings convenience but also risks, as devices like household robots may not be secure against cyber threats, with little regulation on safety standards.
🚗 Autonomous vehicles are already in operation, but they too raise ethical and safety concerns, such as decision-making in dangerous situations and potential hackability.
🏢 Companies must embrace a form of corporate social responsibility, ensuring their technologies are secure by applying tactics like red teaming to anticipate risks.
🧠 Consumers need to become more informed and proactive, demanding safer, more secure technology as part of their buying decisions, shifting some responsibility onto the public.

Q & A

What are the three phases of reactions people typically have when watching the video mentioned at the beginning?
-The three phases are: 1) Initial amazement and admiration for the technology, 2) Discomfort when the robots are kicked, and 3) Growing unease, feeling that the robots are 'creepy' and questioning whether such technology should be developed.
Who currently decides on the use of military technology, particularly in relation to the laws of armed conflict?
-The government and defense department leadership make decisions regarding military technology, guided by policies ensuring compliance with the laws of armed conflict, which require the military to target combatants and protect civilians.
Why is the use of lethal autonomous systems not currently allowed on the battlefield?
-Lethal autonomous systems are not allowed because current technology cannot reliably discriminate between combatants and civilians, which would violate the laws of armed conflict.
What is one reason the speaker believes the policy on autonomous systems is appropriate for now?
-The speaker argues that if current technology cannot correctly interpret simple text (e.g., spell check errors), it cannot be trusted to distinguish between combatants and civilians in complex warfare environments.
What concerns does the speaker raise about the rapid development of technology in the commercial world?
-The speaker is concerned that commercial technology is advancing so quickly that policymakers have fallen behind and may not be able to catch up, creating risks for society due to the lack of regulation and oversight.
How has the role of the internet evolved from its original conception?
-The internet, initially developed by DARPA for communication and information access, has evolved into a space that includes cyber warfare and vulnerabilities like hacking, which were unanticipated at its inception.
What example does the speaker use to illustrate the unforeseen vulnerabilities introduced by the internet?
-The speaker references several examples, including the 2014 Sony hack linked to North Korea, the theft of personal data from the Office of Personnel Management, and the hacking of the U.S. political process.
What is the 'Internet of Things' and what are its potential risks?
-The 'Internet of Things' refers to interconnected devices like smart homes and autonomous systems, which aim to improve daily life but also present risks such as inadequate cybersecurity and vulnerability to hacking.
Why does the speaker believe that corporate social responsibility is necessary in the context of emerging technology?
-The speaker argues that since policymakers may not keep up with rapid technological advancements, companies should take responsibility by adopting measures like red-teaming to identify and mitigate potential risks before releasing new products.
What role do consumers play in shaping the future of technology, according to the speaker?
-Consumers need to be educated and ask hard questions about the security and safety of technology before purchasing, as their choices influence companies to prioritize protection and ethical practices.

Outlines

00:00

🤖 The Complexity of Technology and Human Reactions

The speaker introduces the theme of technology’s complexity using a video as an example. Reactions to the video occur in three phases: amazement, discomfort, and concern. The speaker questions who should decide on the development and control of such technologies, specifically referencing military applications. Military policy is clear on protecting civilians and following laws of armed conflict, with precision weapons improving over time. However, concerns persist about the use of autonomous systems and whether they can be trusted to make life-and-death decisions.

05:02

📱 The Spellchecker Dilemma and Technology-Policy Evolution

The speaker shifts to a lighter example, discussing how technology like spellcheck can misinterpret intent, drawing a parallel to more serious military contexts where autonomous systems might fail to distinguish between combatants and civilians. The argument is made that technology and policy must evolve together. The speaker points out that commercial tech, not government, now drives innovation. With commercial R&D vastly outpacing defense budgets, the gap between technology's rapid development and policy regulation is growing, which poses significant challenges.

10:02

💻 The Internet’s Promise and Unintended Vulnerabilities

The speaker highlights the dual nature of the internet—its great promise of global connectivity and its unforeseen vulnerabilities, such as cyberattacks. The Sony hack is discussed as a key example of how nations and individuals can exploit these weaknesses, resulting in personal and institutional harm. Additionally, the speaker mentions incidents like the breach of personal information from government databases, emphasizing the risks involved in our increasing dependence on technology.

15:03

🏠 The Internet of Things: Friend or Foe?

This section focuses on the Internet of Things (IoT) and how it’s designed to make life easier through interconnected devices. The speaker introduces the concept of a household robot and raises concerns about who decides the level of cybersecurity embedded in such devices. They argue that there is no clear policy regulating the security of these commercial technologies, placing the responsibility on consumers and companies. The speaker urges for corporate responsibility in safeguarding against the potential misuse of these advancements.

🚗 Autonomous Vehicles and Ethical Dilemmas

The speaker discusses the ethical challenges of autonomous vehicles, particularly in life-or-death situations where they may have to choose between the safety of passengers and pedestrians. This dilemma mirrors decisions made in combat scenarios involving distinguishing civilians from combatants. Additionally, the issue of vehicle hackability is raised, with real-world examples like the Jeep hack illustrating the risks of new technologies. The speaker calls for urgent attention to these problems, expressing doubt that policymakers alone can keep up with the pace of innovation.

🏭 Corporate Responsibility in the Age of Technology

The speaker argues for a new form of corporate social responsibility, where companies take proactive steps to secure their technologies against potential threats. This might include adopting practices like 'red teaming,' where experts simulate how new technologies could be exploited by adversaries. By thinking ahead and addressing vulnerabilities, companies can create safer products. The speaker emphasizes that consumers also have a role in this process by demanding secure technologies and making informed decisions.

🌍 A Call for Collective Action in Shaping the Future of Technology

In the concluding remarks, the speaker expresses their love for technology but stresses the importance of guiding its development responsibly. They encourage collective action among corporations, consumers, and policymakers to ensure that technological advancements lead to positive outcomes for society. The speaker remains optimistic that by asking the right questions and addressing challenges head-on, the future of technology can be shaped in a way that benefits everyone, both today and for future generations.

Mindmap

Keywords

💡Technology

Technology is the central theme of the video, referring to the development and application of advanced tools, systems, and machinery. In the script, technology is portrayed as a double-edged sword—capable of both enhancing human lives (e.g., precision weapons and drones) and creating new ethical, security, and policy challenges (e.g., autonomous systems and the Internet of Things).

💡Autonomous Systems

Autonomous systems are machines that can perform tasks without human intervention. In the video, the speaker explores the ethical concerns surrounding autonomous systems, particularly in military contexts. The issue is whether these systems can make moral judgments, such as distinguishing between combatants and civilians, which is why lethal autonomous weapons are not allowed in current warfare.

💡Laws of Armed Conflict

The Laws of Armed Conflict are international rules meant to regulate the conduct of war, particularly the protection of civilians and the targeted engagement of combatants. The speaker emphasizes how military technology, like precision weapons, must comply with these laws, and expresses concern over autonomous systems' ability to uphold these standards in conflict.

💡Cybersecurity

Cybersecurity refers to the protection of systems, networks, and data from digital attacks. The video highlights cybersecurity as a growing concern with the advent of new technologies like autonomous cars and connected devices. The example of Sony’s hack by North Korea illustrates how cyber vulnerabilities can be exploited, leading to serious consequences.

💡Corporate Social Responsibility

Corporate social responsibility (CSR) in this context refers to the ethical obligation of companies to consider the societal impact of their technologies. The speaker suggests that corporations should 'red team' their technologies—actively seeking to identify potential misuse or vulnerabilities before releasing products to the public. This responsibility is seen as crucial in a rapidly advancing technological landscape where regulations lag behind.

💡Remote Piloted Vehicles (Drones)

Drones are unmanned aircraft controlled remotely by a human pilot. While they are often controversial, the speaker clarifies that current military drones are not autonomous but are controlled by humans for precision targeting. This underscores a key distinction between remotely piloted systems and fully autonomous technologies, which are not yet deployed in combat due to ethical and legal constraints.

💡Internet of Things (IoT)

The Internet of Things refers to the growing network of physical devices connected to the internet, such as smart homes or autonomous cars. The speaker expresses concern over the potential vulnerabilities of these interconnected devices, questioning who decides the level of cybersecurity built into them and stressing the lack of government policy regulating such technologies.

💡Hackability

Hackability refers to the ease with which a device or system can be exploited by hackers. The speaker uses examples like the 'Jeep hack' and the Sony hack to demonstrate how even everyday technologies, such as vehicles and corporate networks, can be vulnerable to cyberattacks, posing serious risks to security and privacy in an increasingly connected world.

💡Human in the Loop

The phrase 'human in the loop' describes the requirement that a human must be involved in decision-making processes when lethal force is used in military technology. The speaker emphasizes that current Department of Defense policy mandates this control to ensure ethical decision-making in combat, contrasting it with the dangers posed by fully autonomous lethal systems.

💡Unanticipated Consequences

Unanticipated consequences refer to the unforeseen negative outcomes that arise from new technologies. The video discusses how innovations like the internet brought great benefits but also introduced risks like cyber warfare, data theft, and threats to democratic institutions. This concept highlights the need for foresight and caution as technology evolves faster than policy frameworks.

Highlights

The speaker introduces a video that showcases the complexity surrounding technology today, noting how people's reactions follow three distinct phases.

In military operations, the government, policy makers, and defense department leadership decide on the use of technology, with a focus on protecting civilians while targeting combatants.

Drones, though controversial, are still piloted by humans, with Department of Defense (DoD) policy mandating a human be in the loop for any lethal actions.

Lethal autonomous systems are currently not allowed on the battlefield due to concerns about the technology's ability to distinguish between combatants and civilians.

Precision weapons have significantly improved military capabilities in targeting combatants while protecting civilians.

Commercial entities, not governments, are leading the development of advanced technologies, and policymakers are struggling to keep up with the pace of technological advancement.

The research and development budgets of top defense contractors are dwarfed by those of tech giants like Microsoft, Apple, and Google.

The speaker emphasizes that the policy surrounding military technology and lethal systems is currently appropriate, but acknowledges that it will likely evolve as technology advances.

An app that connects people trained in CPR with individuals experiencing cardiac arrest is an example of how technology is saving lives in simple but impactful ways.

The internet, initially developed by DARPA, has fulfilled its promise of instant global communication but has also introduced unforeseen vulnerabilities, like cyber warfare.

The Sony hack serves as an example of the unanticipated risks associated with technology, demonstrating how vulnerabilities can impact large organizations and governments alike.

Hackers breaching the Office of Personnel Management database and stealing the personal data of millions of Americans showcases the unnerving reality of cyber threats.

As autonomous technologies like self-driving cars and home robots become more prevalent, the speaker raises concerns about their safety, including their susceptibility to hacking.

Companies need to adopt a new form of corporate social responsibility, focusing on the vulnerabilities their technologies introduce, including security measures before release.

The speaker advocates for the use of red teaming, a defense department strategy to imagine how adversaries might exploit new technologies, as a method for addressing vulnerabilities before they arise.