Moral and technical consequences of automation

Norbert Wiener

Cybernetics, feedback, automation ethics · MIT

1960 warning about literal goal pursuit and social consequences of automation

Why it still matters. Framed AI risk as a control and responsibility problem before modern AI existed.

Representative source for this researcher — not necessarily the source of this milestone: https://doi.org/10.1126/science.131.3410.1355 (opens in a new tab)

Cybernetics and control

Matched on representative researcher.

Intelligence is regulation: maintain viable behavior by estimating state, predicting consequences, and using feedback.

Critique. Often assumes known objectives and tractable dynamics; semantics and open-ended learning are secondary.

Modern descendants. World models, model-predictive control, active inference, robotics, and feedback-based agent governance.

Safety, security, and machine ethics

Matched on representative researcher.

Intelligent systems must be treated as potentially fallible or adversarial components embedded in technical and social control structures.

Critique. Hard guarantees rarely cover adaptive learned systems and open environments; governance can lag capability.

Modern descendants. Alignment, prompt-injection defense, agent permissions, red teaming, incident response, and AI assurance.