18:48
The ethical dilemma we face on AI and autonomous tech | Christine Fox | TEDxMidAtlantic
TEDx Talks
Overview
This video explores the ethical dilemmas posed by rapidly advancing autonomous technology, contrasting government-controlled military applications with commercially developed innovations. The speaker highlights the challenge of regulating fast-paced technological development, particularly in the commercial sector, where policy often lags behind. Examples like spell checkers, drones, the internet, and the Internet of Things illustrate the gap between technological promise and potential unintended consequences, such as cyber warfare and data breaches. The talk advocates for a new form of corporate social responsibility, inspired by military 'red teaming,' and emphasizes that consumers, alongside corporations and policymakers, must actively participate in deciding the ethical deployment of future technologies.
How was this?
Save this permanently with flashcards, quizzes, and AI chat
Chapters
- Initial reactions to advanced technology often move from awe to concern about its potential misuse or creepiness.
- This emotional progression reflects a deeper societal unease about who controls and decides the development of new technologies.
- The question of 'who decides should' is central to navigating the ethical landscape of technological advancement.
Understanding these common emotional phases helps us recognize that our initial excitement about new tech can quickly turn into ethical questions, prompting a need for careful consideration.
The video opens with a clip of robots, eliciting reactions of 'wow, that's cool,' followed by 'that's kind of mean,' and finally 'that's creepy, I don't know if we should be building those.'
- In military operations, the government, through policy and leadership, dictates the development and use of technology.
- A core principle is adherence to the laws of armed conflict, requiring efforts to target combatants while protecting civilians.
- Improvements in precision weapons and remote-piloted vehicles (drones) have aided military compliance, though mistakes still occur.
- Current Department of Defense policy explicitly prohibits lethal autonomous capability on the battlefield due to concerns about distinguishing combatants from civilians.
This chapter establishes a baseline for how technology *can* be governed when there is clear authority and established ethical frameworks, providing a contrast to commercial development.
The policy that requires a human in the loop for any employment of lethal capability on drones, and the directive against lethal autonomous weapons, illustrate government control.
- Unlike military tech, advanced technology today is predominantly developed in the commercial sector, not by governments.
- The R&D budgets of major tech companies far exceed those of top defense contractors, indicating a shift in innovation power.
- This commercial dominance means policymakers are struggling to keep pace with and govern rapidly evolving technologies.
- The result is a 'toxic brew' of powerful technologies available with few constraints on their development or accessibility.
This shift explains why current regulatory frameworks are insufficient, as the entities driving innovation are not the ones traditionally responsible for ethical oversight.
The speaker contrasts the combined R&D budgets of the top five defense contractors with less than half of Microsoft's R&D budget, highlighting the scale difference.
- The internet, initially envisioned for communication and information access, has had profound, unanticipated consequences.
- It has created new domains like cyberspace, necessitating specialized military commands for defense.
- Vulnerabilities introduced by the internet have led to significant security breaches and cyber warfare.
- These issues demonstrate how even beneficial technologies can introduce risks that were not foreseen at their inception.
The internet's evolution serves as a critical case study showing how even well-intentioned technologies can spawn complex problems that require new forms of governance and security.
The Sony hack, where a movie release led to a massive data breach and threats, and the compromise of the Office of Personnel Management's database, illustrate the internet's vulnerabilities.
- The Internet of Things (IoT) promises convenience through interconnected devices, like smart home appliances.
- Future IoT devices, such as household robots, are poised to become even more integrated into daily life.
- However, there is currently no policy governing the cyber protection or market readiness of these devices.
- Autonomous vehicles present similar ethical dilemmas, forcing choices between protecting occupants and pedestrians, and are susceptible to hacking.
This section highlights the immediate future, where the lack of governance in IoT and autonomous systems poses direct ethical and safety risks that consumers and manufacturers are already facing.
The example of an autonomous car facing a choice between hitting pedestrians or a brick wall, and the 'Jeep hack' demonstrating a non-autonomous car's vulnerability, illustrate these dilemmas.
- The pace of technological change outstrips policymakers' ability to regulate effectively.
- A new model of corporate social responsibility is needed, where companies proactively consider technology's vulnerabilities, not just its benefits.
- Inspired by military 'red teaming,' companies should imagine how their technologies could be used maliciously and build in safeguards.
- Consumers must be educated and empowered to demand secure products, creating a market incentive for responsible innovation.
This chapter proposes actionable solutions, shifting the responsibility beyond government to include proactive corporate design and informed consumer choice.
The concept of 'red teaming,' where experts try to break a new technology or plan to identify weaknesses before deployment, is suggested as a model for commercial tech development.
Key takeaways
- Technological advancement often outpaces our ethical and regulatory frameworks, creating potential risks.
- The commercial sector now drives most technological innovation, shifting the locus of control away from traditional government oversight.
- Unforeseen consequences, like cyber vulnerabilities and ethical dilemmas in autonomous systems, are inherent risks of powerful new technologies.
- Lethal autonomous weapons are currently prohibited in the US military due to the inability to reliably distinguish combatants from civilians.
- The Internet of Things and autonomous vehicles present immediate ethical and security challenges that require proactive solutions.
- A new paradigm of corporate social responsibility, incorporating 'red teaming' principles, is necessary to address technological risks.
- Consumer education and demand for secure products are crucial drivers for responsible technological development.
Key terms
Autonomous technologyLaws of armed conflictPrecision weaponsRemote piloted vehicles (drones)Human in the loopLethal autonomous capabilityCommercial sectorInternet of Things (IoT)Cyber warfareRed teamingCorporate social responsibility
Test your understanding
- Why is the shift of advanced technology development from government to the commercial sector a significant ethical challenge?
- How does the US military's policy on lethal autonomous weapons reflect the laws of armed conflict?
- What are some of the unanticipated consequences of the internet that the speaker highlights?
- How can the concept of 'red teaming' be applied to commercial technology development to mitigate risks?
- What role do consumers play in ensuring the ethical development and deployment of new technologies?