《人类监控自动化系统》英文版 Social implications

16.422 Human Supervisory Control Social implications Massachusetts Institute of Technology

Social Implications 16.422 Human Supervisory Control

Advantages of automation 16.422 · Improve efficiency productivity Task performance reliability Human safety both operators public Remote operations Reduction of human labor Technological advancements Improved quality of lif He ealth care Leisure But there are some problems Massachusetts Institute of Technology

• Improve: – Efficiency & productivity – Task performance & reliability • Human safety, both operators & public – Remote operations • Reduction of human labor • Technological advancements • Improved quality of life – Health care – Leisure • But there are some problems…. 16.422 Advantages of Automation

Automation issues for the individual 16.422 Employment Centralization of management Identity resocialization Work dissatisfaction Supervising as opposed to interactive control Technological (il)literacy Deskilling Responsibility accountability Trust and biases It will always be far easier to make a robot of a man rather that to make a robot like a man (Engelberger 1981) Massachusetts Institute of Technology

Automation Issues for the Individual • Employment – Centralization of management – Identity & desocialization • Work dissatisfaction – Supervising as opposed to interactive control • Technological (il)literacy • Deskilling • Responsibility & accountability – Trust and biases • “It will always be far easier to make a robot of a man rather that to make a robot like a man.” (Engelberger 1981) 16.422

Problems with automation for society 16.422 “ Technological imperative” Technological determinism as opposed to social construction Productivity VS. meaningfulness °Iele- governance Feed forward versus feedback Privacy Cell phones, automobiles, employee monitoring Reduced social contact Massachusetts Institute of Technology

Problems with Automation for Society • “Technological imperative” – Technological determinism as opposed to social construction • Productivity vs. meaningfulness • Tele-governance – Feed forward versus feedback – Privacy • Cell phones, automobiles, employee monitoring • Reduced social contact 16.422

More problems with automation 16.422 System complexity cost Affects both the individual and groups Group diffusion of accountability Impact on natural resources Tele-robotic spIt les Over-trusting technology Smart weapons Massachusetts Institute of Technology

More Problems with Automation… • System complexity & cost – Affects both the individual and groups • Group diffusion of accountability • Impact on natural resources • Tele-robotic spies • Over-trusting technology • Smart weapons 16.422

A Comparison of Nuclear vs Command control domains 16.422 Factor山 Domain Nuclear power plant Command control Start-up Only when conditions are normal a response to an unexpected problem Shutdown Automatic on abnormality Hard to stop once started Experience Hundreds of plant years Very little personne Semi-permanent High turnover Error records Public Simulation Accidents can be simulated Difficult to do in realistic settings Goal state Control nature Control intelligent opponent Scientific analysis Open Secret

A Comparison of Nuclear vs. Command & Control Domains Factor\Domain Nuclear Power Plant Command & Control Start-up Only when conditions are normal A response to an unexpected problem Shutdown Automatic on abnormality Hard to stop once started Experience Hundreds of plant years Very little Personnel Semi-permanent High turnover Error records Public Secret Simulation Accidents can be simulated Difficult to do in realistic settings Goal state Control nature Control intelligent opponent Scientific analysis Open Secret 16.422

Automation weapons in the Future

Automation & Weapons in the Future

Proposed Tactical Tomahawk Missions Default Mission Flex mission PHp Emergent Mission Time-critical P (emergent) Target DT

Proposed Tactical Tomahawk Missions L P H Emergent Mission p Default Mission P T Flex Mission G W A T B P D T L Time-critical (emergent) Target

Controlling Multiple autonomous Vehicles/Weapons In-Flight rk erH franta Cre DIslceasefud Denot NOtar Iwiltfectar 34且26 2442 315:231 tal Requeed w:M Aaa weisses V whitee Ness回mm lAst FaF bf lager A用围知畔B a Drte Mowm voay NSD) Re12-w. lowet p. tm rate C回 Shea Mas Carvel Retargeting Display Monitor Map Massachusetts Institute of Technology

Controlling Multiple Autonomous Vehicles/Weapons In-Flight Retargeting Display Monitor Map

Resistance to Killing as a Function of Distance HIGHA SEXUAL RANGE HAND- TO-HAND-COMBAT RANGE KNIFE RANGE BAYONET RANGE CLOSE RANGE (PISTOL/RIFLE) HANDGRENADE RANGE MID-RANGE (RIFLE) LONG RANGE (SNIPER, ANTI-ARMOR MISSILES, ETC. MAX RANGE ( BOMBER CLOSE PHYSICAL DISTANCE FROM TARGET FAR Massachusetts Institute of Technology

Resistance to Killing as a Function of Distance