.

  • Written by Lewis Mitchell, Senior Lecturer in Applied Mathematics, University of Adelaide
Bias in, bias out: many algorithms have inherent design problems. Vintage Tone/Shutterstock

I swear by Hypatia, by Lovelace, by Turing, by Fisher (and/or Bayes), and by all the statisticians and data scientists, making them my witnesses, that I will carry out, according to my ability and judgement, this oath and this indenture.

Could this be the first line of a “Hippocratic Oath” for mathematicians and data scientists? Hannah Fry, Associate Professor in the mathematics of cities at University College London, argues that mathematicians and data scientists need such an oath, just like medical doctors who swear to act only in their patients’ best interests.

“In medicine, you learn about ethics from day one. In mathematics, it’s a bolt-on at best. It has to be there from day one and at the forefront of your mind in every step you take,” Fry argued.

But is a tech version of the Hippocratic Oath really required? In medicine, these oaths vary between institutions, and have evolved greatly in the nearly 2,500 years of their history. Indeed, there is some debate around whether the oath remains relevant to practising doctors, particularly as it is the law, rather than a set of ancient Greek principles, by which they must ultimately abide.


Read more: A code of ethics in IT: just lip service or something with bite?


How has data science reached the point at which an ethical pledge is deemed necessary? There are certainly numerous examples of algorithms doing harm – criminal sentencing algorithms, for instance, have been shown to disproportionately recommend that low-income and minority people are sent to jail.

Similar crises have led to proposals for ethical pledges before. In the aftermath of the 2008 global financial crisis, a manifesto by financial engineers Emanuel Derman and Paul Wilmott beseeched economic modellers to swear not to “give the people who use my model false comfort about its accuracy. Instead, I will make explicit its assumptions and oversights.”

Just as prejudices can be learned as a child, the biases of these algorithms are a result of their training. A common feature of these algorithms is the use of black-box (often proprietary) algorithms, many of which are trained using statistically biased data.

In the case of criminal justice, the algorithm’s unjust outcome stems from the fact that historically, minorities are overrepresented in prison populations (most likely as a result of long-held human biases). This bias is therefore replicated and likely exacerbated by the algorithm.

Machine learning algorithms are trained on data, and can only be expected to produce predictions that are limited to those data. Bias in, bias out.

Promises, promises

Would taking an ethical pledge have helped the designers of these algorithms? Perhaps, but greater awareness of statistical biases might have been enough. Issues of unbiased representation in sampling have long been a cornerstone of statistics, and training in these topics may have led the designers to step back and question the validity of their predictions.

Fry herself has commented on this issue in the past, saying it’s necessary for people to be “paying attention to how biases you have in data can end up feeding through to the analyses you’re doing”.

But while issues of unbiased representation are not new in statistics, the growing use of high-powered algorithms in contentious areas make “data literacy” more relevant than ever.

Part of the issue is the ease with which machine learning algorithms can be applied, making data literacy no longer particular to mathematical and computer scientists, but to the public at large. Widespread basic statistical and data literacy would aid awareness of the issues with statistical biases, and are a first step towards guarding against inappropriate use of algorithms.


Read more: Algorithms are everywhere but what will it take for us to trust them?


Nobody is perfect, and while improved data literacy will help, unintended biases can still be overlooked. Algorithms might also have errors. One easy (to describe) way to guard against such issues is to make them publicly available. Such open source code can allow joint responsibility for bias and error checking.

Efforts of this sort are beginning to emerge, for example the Web Transparency and Accountability Project at Princeton University. Of course, many proprietary algorithms are commercial in confidence, which makes transparency difficult. Regulatory frameworks are hence likely to become important and necessary in this area. But a precondition is for practitioners, politicians, lawyers, and others to understand the issues around the widespread applicability of models, and their inherent statistical biases.

Ethics is undoubtedly important, and in a perfect world would form part of any education. But university degrees are finite. We argue that data and statistical literacy is an even more pressing concern, and could help guard against the appearance of more “unethical algorithms” in the future.

Lewis Mitchell works for the University of Adelaide, and is an Associate Investigator in the ARC Centre of Excellence for Mathematical and Statistical Frontiers (ACEMS). He receives funding from the Centre for Invasive Species Solutions, and has previously received funding from Data to Decisions CRC.

Joshua Ross works for the University of Adelaide and is an Associate Investigator in the ARC Centre of Excellence for Mathematical and Statistical Frontiers (ACEMS). He receives funding from ARC, NHMRC, Centre for Invasive Species Solutions, DST Group and US-DoD.

Authors: Lewis Mitchell, Senior Lecturer in Applied Mathematics, University of Adelaide

Read more http://theconversation.com/a-hippocratic-oath-for-data-science-well-settle-for-a-little-more-data-literacy-122200

Primary Questions to Ask Yourself Before Choosing an Office Space in Philadelphia

Choosing your first office space is thrilling. The excitement of finally setting up your own office is so satisfying. When you start scouting around to select your office space, there are so many fa...

Sarah Williams - avatar Sarah Williams

Freedom And Flexibility - How A Virtual Office Allows For Greater Adaptability

Being able to adapt to changing circumstances and economic conditions is essential in business. For entrepreneurs and startups who want to maximise their chances of success regardless of outside cir...

News Company - avatar News Company

Eat your heart out: native water rats have worked out how to safely eat cane toads

Water rats in Western Australia are safely hunting cane toads. Author providedAustralia’s water rats, or Rakali, are one of Australia’s beautiful but lesser-known native rodents. And these...

Marissa Parrott, Reproductive Biologist, Wildlife Conservation & Science, Zoos Victoria, and Honorary Research Associate, BioSciences, University of Melbourne - avatar Marissa Parrott, Reproductive Biologist, Wildlife Conservation & Science, Zoos Victoria, and Honorary Research Associate, BioSciences, University of Melbourne

Curious Kids: where do phobias come from?

Phobias are an intense fear of very specific things like objects, places, situations or animals. ShutterstockIf you have a question you’d like an expert to answer, send it to curiouskids@theconv...

Lara Farrell, Associate Professor and Clinical Psychologist, Griffith University - avatar Lara Farrell, Associate Professor and Clinical Psychologist, Griffith University

Best Family-Friendly Zoos In America

Zoos have always been part of family travel destinations. This is where your kids get to see the animals that they only often see on their books. Visiting one also provides a learning experience for...

News Company - avatar News Company

Activists are using the climate emergency as a new legal defence to justify law-breaking

The phrase “climate emergency” became part of the political lexicon this year. Governments at all levels made declarations of a climate emergency, as did various organisations such as the ...

Nicole Rogers, Senior lecturer, School of Law and Justice, Southern Cross University - avatar Nicole Rogers, Senior lecturer, School of Law and Justice, Southern Cross University

Don't tear it down: the idea behind Labor's National Rental Affordability Scheme is worth saving

The Grattan Institute has condemned the National Rental Affordability Scheme as a $1 billion windfall to developers. www.shutterstock.comLabor’s Rudd-era National Rental Affordability Scheme (NR...

Marcus Luigi Spiller, Associate Professor (Urban Planning) - honorary  , University of Melbourne - avatar Marcus Luigi Spiller, Associate Professor (Urban Planning) - honorary , University of Melbourne

City share-house rents eat up most of Newstart, leaving less than $100 a week to live on

Even when sharing a house, the average cost of rent means very little is left over from the Newstart allowance for food and living costs. shutterstock.comIn all Australia’s capital cities, avera...

Simone Casey, Research Associate, Future Social Service Institute, RMIT University - avatar Simone Casey, Research Associate, Future Social Service Institute, RMIT University

Users (and their bias) are key to fighting fake news on Facebook – AI isn't smart enough yet

On its own, human judgement can be subjective and skewed towards personal biases. The information we encounter online everyday can be misleading, incomplete or fabricated. Being exposed to “fa...

Gianluca Demartini, Associate professor, The University of Queensland - avatar Gianluca Demartini, Associate professor, The University of Queensland

Fairest and best? Status counts in the Brownlow Medal

Tonight is the AFL’s annual night of nights, the red-carpet spectacular known as the Brownlow Medal vote count. The Brownlow is awarded to the season’s “fairest and best” play...

Liam Lenten, Senior Lecturer, Department of Economics and Finance, La Trobe University - avatar Liam Lenten, Senior Lecturer, Department of Economics and Finance, La Trobe University

How Australians talk about tucker is a story that'll make you want to eat the bum out of an elephant

Wes Mountain/The Conversation, CC BY-NDNot to put a damper on things, but Australian food hasn’t always made us happy little Vegemites. One needn’t look further than the humble meat pie ...

Howard Manns, Lecturer in Linguistics, Monash University - avatar Howard Manns, Lecturer in Linguistics, Monash University

In a chatty world, losing your speech can be alienating. But there's help

People who have trouble with their speech, say after a stroke, can find it challenging. But a speech pathologist can help. from www.shutterstock.comSam is a high school drama teacher — articulat...

Kirrie J Ballard, Professor, Speech Pathology, University of Sydney - avatar Kirrie J Ballard, Professor, Speech Pathology, University of Sydney

From crime fighters to crime writers - a new batch of female authors brings stories that are closer to home

In Dervla McTiernan’s book, The Scholar, published earlier this year, women are consistently used as the “fall guys” for men with high aspirations. Two young women are killed when th...

Lili Pâquet, Lecturer in Writing, University of New England - avatar Lili Pâquet, Lecturer in Writing, University of New England

10 ways to get the most out of silent reading in schools

Children need time and space to enjoy the books they choose to read in schools. Shutterstock/wavebreakmediaReading aloud can help young children learn about new words and how to sound them. There&rsqu...

Margaret Kristin Merga, Senior Lecturer in Education, Edith Cowan University - avatar Margaret Kristin Merga, Senior Lecturer in Education, Edith Cowan University

'Edible forests' can fight land clearing and world hunger at the same time

A Nepalese woman collects mushroom in a forest. Jagannath Adhikari, Author providedReducing emissions from deforestation and farming is an urgent global priority if we want to control climate change. ...

Jagannath Adhikari, Sessional Lecturer, UNSW - avatar Jagannath Adhikari, Sessional Lecturer, UNSW

Comic explainer: young disabled New Zealanders on the barriers to a better life

Our research project explored the everyday lives of disabled young people, aged from 12 to 25 years, with mobility, vision and hearing impairments. We measured and asked them about factors that enable...

Penelope Carroll, Researcher in Public Health, Massey University - avatar Penelope Carroll, Researcher in Public Health, Massey University

View from The Hill: To go to China you have to be invited: Morrison

Scott Morrison was frank, when quizzed at a news conference during his visit to Washington, on whether he would be seeking to travel to China in the next year. “Well, you have to be invited to ...

Michelle Grattan, Professorial Fellow, University of Canberra - avatar Michelle Grattan, Professorial Fellow, University of Canberra

VIDEO: Michelle Grattan on the family law inquiry - and the UN climate change summit

University of Canberra Deputy Vice-Chancellor Leigh Sullivan discusses Scott Morrison’s new family law inquiry with Michelle Grattan. They also speak of the developments in the Tamil family from...

Michelle Grattan, Professorial Fellow, University of Canberra - avatar Michelle Grattan, Professorial Fellow, University of Canberra

Climate explained: why don't we have electric aircraft?

CC BY-ND Climate Explained is a collaboration between The Conversation, Stuff and the New Zealand Science Media Centre to answer your questions about climate change. If yo...

Dries Verstraete, Senior Lecturer in Aerospace Design and Propulsion, University of Sydney - avatar Dries Verstraete, Senior Lecturer in Aerospace Design and Propulsion, University of Sydney

Sick and Tired of Your Dead End Job? Try Teaching!

Tired of the same old grind at the office? Want an opportunity to impact lives both in your community and around the world? Do you love to travel and have new experiences? Teaching English is the perfect job for you! All you need is a willingness to ...

News Company - avatar News Company

The Impact of an Aging Population in Australia

There’s an issue on the horizon that Australia needs to prepare for. The portion of elderly citizens that make up the country’s overall population is increasing, and we might not have the infrastructure in place to support this. Australians h...

News Company - avatar News Company

LifeStyle

Yvonne Allen: Eight ways to super impress someone on a first date

According to Yvonne Allen well known relationship mentor, psychologist and matchmaker, a first dat...

Picking The Right Crystal Yoni Egg: Tips And Instructions

When you are ready to pick your own crystal yoni egg, you need to decide what you will use it for...

Top 5 Tips for Paddleboarding In Whitewater

Paddleboarding can be relaxing as well as intense. If you occasionally want to do something differen...

3 Most Promising Career Occupations for Graduates in 2019

Studying in college is a great adventure which opens up lots of career opportunities. Yet, at times...