Is AI morality asleep at the wheel?

In an age where you could soon be legally (and safely) asleep at the wheel thanks to driverless cars, will morality in AI go the same way — is the principle of ethics in AI asleep at the wheel?

The Institute of Electrical and Electronics Engineers (IEEE) recently published the first draft of a framework report exploring the ethical challenges posed by AI. In particular this statement from the report caught my attention:

“We need to make sure that these technologies are aligned to humans in terms of our moral values and ethical principles. AI/AS have to behave in a way that is beneficial to people beyond reaching functional goals and addressing technical problems… …By aligning the creation of AI/AS with the values of its users and society we can prioritize the increase of human wellbeing as our metric for progress in the algorithmic age.”[1]

Ethics and morality have dominated much of what has been written about AI in 2016, often negatively given some recent exposures of AI generated bigotry and bias. What makes this 136-page report interesting, is that it marks the beginning of large ‘collective’[2] thinking on how to build benevolent and societally beneficial artificial intelligence — the principle we founded BenevolentAI on when we established the Company in 2013.

So two immediate thoughts crossed my mind when I read the report and the quote above. 1. Yes, I couldn’t agree more! 2. More importantly… …but how? How do you ‘build morality’ and altruism into AI? How do you qualify, benchmark or even define what morality in AI is? Is AI morally programmable with, as the IEEE describes, “the values of its users and society”?

It is incredibly complex to build ethics and morality into AI. Here’s how we as a Company have begun to answer some of the questions posed above and approached building ‘benevolent AI’ at BenevolentAI — it rests on two ideas:


The information used, its source and how you teach the algorithms is vital. What you feed the AI and the level of its morally nutritional content, dictates the morality of the technology and the knowledge you create.


We are feeding our self learning system with information that benefits humanity — scientific data that focusses on curing disease, improving energy efficiency, better food development etc. The result is that as the technology’s intelligence expands it is denied access to the types of information that instructs it to behave immorally.

We are not trying to create a super human intelligence or “solve intelligence” which is DeepMind’s ambition. This is an important distinction. BenevolentAI is trying to save human lives by enhancing human intelligence using machine intelligence. We are not trying to supplant human intelligence altogether by creating a sentient machine.

Our AI mission is creating the process of finding that seminal inventive step (the Eureka moment) in the scientific discovery process. Looking at how a particular scientist made a discovery based on information that wasn’t known before and then creating a replicable process for this.

So we are trying to teach our AI to track inventive steps such as; what the information environment was for that inventive step; what information and data allowed the scientist to put two-and-two together; the hypotheses that derives from that; how those hypotheses were broken down, tested and a new discovery made.

Understanding this process, creating technology for it, and then applying it in tandem with humans and humanity means it is possible to advance the scientific method and bring it into the 21st Century. By doing so we can transition from a chaotic highly variable process of scientific discovery to one with greater predictability and greater scale by allowing humanity to see things we may not otherwise have been looking at.

Let’s finish where we started, with the IEEE report, and where I hope the AI industry is going next. Konstantinos Karachalios, IEES managing director commented that by building ethical AI…

“…we can move beyond the fears associated with these technologies and bring valued benefits to humanity today and for the future”.



Originally published at on January 11, 2018.




Uniting human and machine intelligence to discover new ways to treat disease | #Becauseitmatters #AI #DrugDiscovery #Innovation

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Could the Government Be In Your Pocket?

Artificial Intelligence at the Forefront of the Wave of Technological Progress

3 Ways Artificial Intelligence Can Complement Qualitative Research

Anti Human: The Future Construction Site

Using AI in the journey to advance a cure for blindness

BenevolentAI- View under a microscope

Daily Newsletter — 9th January 2021

The Greatest Human Invention

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store


Uniting human and machine intelligence to discover new ways to treat disease | #Becauseitmatters #AI #DrugDiscovery #Innovation

More from Medium

JEFF Introduction: Metaverse (1)

Introducing The Dark Galaxies, an Entire Universe Built in the Metaverse and the Real World

WealthTrust: 30% Cash, Tech Will Underperform

Mendor: Your Mending Vendor