• Written by Lewis Mitchell, Senior Lecturer in Applied Mathematics, University of Adelaide
Bias in, bias out: many algorithms have inherent design problems. Vintage Tone/Shutterstock

I swear by Hypatia, by Lovelace, by Turing, by Fisher (and/or Bayes), and by all the statisticians and data scientists, making them my witnesses, that I will carry out, according to my ability and judgement, this oath and this indenture.

Could this be the first line of a “Hippocratic Oath” for mathematicians and data scientists? Hannah Fry, Associate Professor in the mathematics of cities at University College London, argues that mathematicians and data scientists need such an oath, just like medical doctors who swear to act only in their patients’ best interests.

“In medicine, you learn about ethics from day one. In mathematics, it’s a bolt-on at best. It has to be there from day one and at the forefront of your mind in every step you take,” Fry argued.

But is a tech version of the Hippocratic Oath really required? In medicine, these oaths vary between institutions, and have evolved greatly in the nearly 2,500 years of their history. Indeed, there is some debate around whether the oath remains relevant to practising doctors, particularly as it is the law, rather than a set of ancient Greek principles, by which they must ultimately abide.

Read more: A code of ethics in IT: just lip service or something with bite?

How has data science reached the point at which an ethical pledge is deemed necessary? There are certainly numerous examples of algorithms doing harm – criminal sentencing algorithms, for instance, have been shown to disproportionately recommend that low-income and minority people are sent to jail.

Similar crises have led to proposals for ethical pledges before. In the aftermath of the 2008 global financial crisis, a manifesto by financial engineers Emanuel Derman and Paul Wilmott beseeched economic modellers to swear not to “give the people who use my model false comfort about its accuracy. Instead, I will make explicit its assumptions and oversights.”

Just as prejudices can be learned as a child, the biases of these algorithms are a result of their training. A common feature of these algorithms is the use of black-box (often proprietary) algorithms, many of which are trained using statistically biased data.

In the case of criminal justice, the algorithm’s unjust outcome stems from the fact that historically, minorities are overrepresented in prison populations (most likely as a result of long-held human biases). This bias is therefore replicated and likely exacerbated by the algorithm.

Machine learning algorithms are trained on data, and can only be expected to produce predictions that are limited to those data. Bias in, bias out.

Promises, promises

Would taking an ethical pledge have helped the designers of these algorithms? Perhaps, but greater awareness of statistical biases might have been enough. Issues of unbiased representation in sampling have long been a cornerstone of statistics, and training in these topics may have led the designers to step back and question the validity of their predictions.

Fry herself has commented on this issue in the past, saying it’s necessary for people to be “paying attention to how biases you have in data can end up feeding through to the analyses you’re doing”.

But while issues of unbiased representation are not new in statistics, the growing use of high-powered algorithms in contentious areas make “data literacy” more relevant than ever.

Part of the issue is the ease with which machine learning algorithms can be applied, making data literacy no longer particular to mathematical and computer scientists, but to the public at large. Widespread basic statistical and data literacy would aid awareness of the issues with statistical biases, and are a first step towards guarding against inappropriate use of algorithms.

Read more: Algorithms are everywhere but what will it take for us to trust them?

Nobody is perfect, and while improved data literacy will help, unintended biases can still be overlooked. Algorithms might also have errors. One easy (to describe) way to guard against such issues is to make them publicly available. Such open source code can allow joint responsibility for bias and error checking.

Efforts of this sort are beginning to emerge, for example the Web Transparency and Accountability Project at Princeton University. Of course, many proprietary algorithms are commercial in confidence, which makes transparency difficult. Regulatory frameworks are hence likely to become important and necessary in this area. But a precondition is for practitioners, politicians, lawyers, and others to understand the issues around the widespread applicability of models, and their inherent statistical biases.

Ethics is undoubtedly important, and in a perfect world would form part of any education. But university degrees are finite. We argue that data and statistical literacy is an even more pressing concern, and could help guard against the appearance of more “unethical algorithms” in the future.

Lewis Mitchell works for the University of Adelaide, and is an Associate Investigator in the ARC Centre of Excellence for Mathematical and Statistical Frontiers (ACEMS). He receives funding from the Centre for Invasive Species Solutions, and has previously received funding from Data to Decisions CRC.

Joshua Ross works for the University of Adelaide and is an Associate Investigator in the ARC Centre of Excellence for Mathematical and Statistical Frontiers (ACEMS). He receives funding from ARC, NHMRC, Centre for Invasive Species Solutions, DST Group and US-DoD.

Authors: Lewis Mitchell, Senior Lecturer in Applied Mathematics, University of Adelaide

Read more http://theconversation.com/a-hippocratic-oath-for-data-science-well-settle-for-a-little-more-data-literacy-122200

A Guide to Florida Tourism

Everybody loves Florida, and why shouldn’t they? The weather is better than any other state in the country. The beaches are up for countless awards every year. The ocean is calm and salty on the W...



Since the year 2020 has already started, you are now thinking about building or renovating your home or workplace. With the start of the new year, most homeowners or business owners want to tackle b...

News Company - avatar News Company


Are you staring at your wardrobe for a beautiful cocktail dress for hours? Here is the deal, since we all know that a perfect cocktail dress is supposed to enhance the beauty of your body, thus, it...

News Company - avatar News Company


Who said only skinny girls can rock lingerie? Beauty is not confined to hour-glass figures only. It was unfortunate that the fashion industry had limited their designed outfits for skinny women only...

News Company - avatar News Company


As we go into the new year, we also are taking strides into a brand new decade. 2020 is not just a new year full of accessories, clothing, and trends, but it is also the introduction of how the next...

News Company - avatar News Company

Seven trends for women wear in 2020

Women and fashion is a pair that cannot be separated by anyway and by any means. If you are trying to make your woman angry, make them follow the latest fashion trends going on, and not allow them t...

News Company - avatar News Company

How a seasonal snarl-up in the mid-1500s gave us our strange rules for leap years

shutterstock Happy February 29! It doesn’t come round very often, so make sure you enjoy it. But why do we have these extra days? Well, if we didn’t, the seasons would gradually move aro...

Jonti Horner, Professor (Astrophysics), University of Southern Queensland - avatar Jonti Horner, Professor (Astrophysics), University of Southern Queensland

Leviathan review: Circa's new production explores the ordinary, extraordinary mass of humanity

Sergio Lordao/Perth FestivalReview: Leviathan, directed by Yaron Lifschitz. Circa in collaboration with Co:3 Australia, MAXIMA Circus and CircusWA for Perth Festival. As the audience takes their sea...

Leah Mercer, Associate Professor of Theatre Arts, Curtin University - avatar Leah Mercer, Associate Professor of Theatre Arts, Curtin University

Why do I sweat so much?

ShutterstockIf you’re hot and sticky even before your daily commute, you might ask why you sweat so much. Sweating is usually the body’s way of stopping you overheating. But for some peo...

Tom Bailey, Research Fellow, The University of Queensland - avatar Tom Bailey, Research Fellow, The University of Queensland

Sick and Tired of Your Dead End Job? Try Teaching!

Tired of the same old grind at the office? Want an opportunity to impact lives both in your community and around the world? Do you love to travel and have new experiences? Teaching English is the perfect job for you! All you need is a willingness to ...

News Company - avatar News Company

The Impact of an Aging Population in Australia

There’s an issue on the horizon that Australia needs to prepare for. The portion of elderly citizens that make up the country’s overall population is increasing, and we might not have the infrastructure in place to support this. Australians h...

News Company - avatar News Company