Viw Magazine

Men's Weekly

.

  • Written by Lewis Mitchell, Senior Lecturer in Applied Mathematics, University of Adelaide
Bias in, bias out: many algorithms have inherent design problems. Vintage Tone/Shutterstock

I swear by Hypatia, by Lovelace, by Turing, by Fisher (and/or Bayes), and by all the statisticians and data scientists, making them my witnesses, that I will carry out, according to my ability and judgement, this oath and this indenture.

Could this be the first line of a “Hippocratic Oath” for mathematicians and data scientists? Hannah Fry, Associate Professor in the mathematics of cities at University College London, argues that mathematicians and data scientists need such an oath, just like medical doctors who swear to act only in their patients’ best interests.

“In medicine, you learn about ethics from day one. In mathematics, it’s a bolt-on at best. It has to be there from day one and at the forefront of your mind in every step you take,” Fry argued.

But is a tech version of the Hippocratic Oath really required? In medicine, these oaths vary between institutions, and have evolved greatly in the nearly 2,500 years of their history. Indeed, there is some debate around whether the oath remains relevant to practising doctors, particularly as it is the law, rather than a set of ancient Greek principles, by which they must ultimately abide.


Read more: A code of ethics in IT: just lip service or something with bite?


How has data science reached the point at which an ethical pledge is deemed necessary? There are certainly numerous examples of algorithms doing harm – criminal sentencing algorithms, for instance, have been shown to disproportionately recommend that low-income and minority people are sent to jail.

Similar crises have led to proposals for ethical pledges before. In the aftermath of the 2008 global financial crisis, a manifesto by financial engineers Emanuel Derman and Paul Wilmott beseeched economic modellers to swear not to “give the people who use my model false comfort about its accuracy. Instead, I will make explicit its assumptions and oversights.”

Just as prejudices can be learned as a child, the biases of these algorithms are a result of their training. A common feature of these algorithms is the use of black-box (often proprietary) algorithms, many of which are trained using statistically biased data.

In the case of criminal justice, the algorithm’s unjust outcome stems from the fact that historically, minorities are overrepresented in prison populations (most likely as a result of long-held human biases). This bias is therefore replicated and likely exacerbated by the algorithm.

Machine learning algorithms are trained on data, and can only be expected to produce predictions that are limited to those data. Bias in, bias out.

Promises, promises

Would taking an ethical pledge have helped the designers of these algorithms? Perhaps, but greater awareness of statistical biases might have been enough. Issues of unbiased representation in sampling have long been a cornerstone of statistics, and training in these topics may have led the designers to step back and question the validity of their predictions.

Fry herself has commented on this issue in the past, saying it’s necessary for people to be “paying attention to how biases you have in data can end up feeding through to the analyses you’re doing”.

But while issues of unbiased representation are not new in statistics, the growing use of high-powered algorithms in contentious areas make “data literacy” more relevant than ever.

Part of the issue is the ease with which machine learning algorithms can be applied, making data literacy no longer particular to mathematical and computer scientists, but to the public at large. Widespread basic statistical and data literacy would aid awareness of the issues with statistical biases, and are a first step towards guarding against inappropriate use of algorithms.


Read more: Algorithms are everywhere but what will it take for us to trust them?


Nobody is perfect, and while improved data literacy will help, unintended biases can still be overlooked. Algorithms might also have errors. One easy (to describe) way to guard against such issues is to make them publicly available. Such open source code can allow joint responsibility for bias and error checking.

Efforts of this sort are beginning to emerge, for example the Web Transparency and Accountability Project at Princeton University. Of course, many proprietary algorithms are commercial in confidence, which makes transparency difficult. Regulatory frameworks are hence likely to become important and necessary in this area. But a precondition is for practitioners, politicians, lawyers, and others to understand the issues around the widespread applicability of models, and their inherent statistical biases.

Ethics is undoubtedly important, and in a perfect world would form part of any education. But university degrees are finite. We argue that data and statistical literacy is an even more pressing concern, and could help guard against the appearance of more “unethical algorithms” in the future.

Lewis Mitchell works for the University of Adelaide, and is an Associate Investigator in the ARC Centre of Excellence for Mathematical and Statistical Frontiers (ACEMS). He receives funding from the Centre for Invasive Species Solutions, and has previously received funding from Data to Decisions CRC.

Joshua Ross works for the University of Adelaide and is an Associate Investigator in the ARC Centre of Excellence for Mathematical and Statistical Frontiers (ACEMS). He receives funding from ARC, NHMRC, Centre for Invasive Species Solutions, DST Group and US-DoD.

Authors: Lewis Mitchell, Senior Lecturer in Applied Mathematics, University of Adelaide

Read more http://theconversation.com/a-hippocratic-oath-for-data-science-well-settle-for-a-little-more-data-literacy-122200

Designing the Ideal Healthcare Environment with a Professional Medical Centre Fitout

When it comes to healthcare spaces, functionality, hygiene, and patient comfort take top priority. An intelligently designed medical centr...

Stay Comfortable Year-Round with Ducted Cooling Melbourne

When the temperature starts to rise, having a reliable and efficient cooling system becomes a priority. With unpredictable weather and sud...

Best Practices for Content Ownership and Tagging Across Departments

Image by kaboompics on Freepik The bigger and more complex content ecosystems grow, the more valuable ownership and tagging become. In ent...

Understanding Public Liability Insurance Australia: What You Need to Know

Image by rawpixel.com on Freepik The necessity of public liability insurance in Australia is that it acts as a financial safeguard for busi...

How HID Proximity Cards Improve Workplace Security Without Slowing Down Access

In today’s workplaces, security is non-negotiable, but so is speed. Companies are under pressure to protect their people, property, and ...

Unlock Business Insights Faster with Power BI Tools

In this digital age where data drives the consumer landscape, businesses are shipping huge amounts of data every day. To remain competit...

Why Split System Installation Is a Smart Choice for Home Climate Control

Temperature control is essential for comfort, and when it comes to efficient, versatile cooling and heating, a split system is one of the ...

The Ultimate Guide to Door Replacement: Everything You Need to Know

Image by freepik Sure, swapping out a door is a fairly easy task, but it requires careful consideration of options for materials, designs...

Common Web Development Issues Perth Businesses Face (and How Agencies Fix Them)

Image by freepik Let's be honest, in the bustling heart of Perth's business scene, a website that's not up to scratch is like trying to he...

Life With Clear Aligners: 10 Small Changes That Make a Big Difference

Image by tonodiaz on Freepik Clear aligners have transformed orthodontics, offering a nearly invisible way to straighten teeth without the...

Choosing the Right Hair Loss Treatment for Your Needs

Millions of people experience hair loss globally, and it can be a major cause of emotional discomfort and self-consciousness. Hair loss ca...

Cardboard Display Boxes: An Effective Solution for Retail Presentation

In the competitive world of retail, how products are presented can be just as important as the products themselves. Cardboard display boxe...

Why Hiring a Skilled Shopify Web Developer Can Transform Your Online Store

Shopify has become one of the most popular e-commerce platforms due to its ease of use, powerful features, and scalability. However, creat...

Selling a Home Left 1 in 3 Aussies in Tears, Survey Finds

New research on selling property found that more than 1 in 3 people who sold a property in the past two years admitted to crying at some poi...

Brisbane Motor Vehicle Accident Lawyers & Motorbike Accident Claims

Motorbike accidents in Brisbane can lead to severe injuries and complex legal challenges, given the vulnerability of riders on the road. F...

Jesse Martin, OAM Sets Sail Again with Portland Roads - Sailing the Whitsundays

Jesse Martin OAM shot to fame in 1999 as the world’s youngest sailor to circumnavigate the globe – solo, unassisted and non-stop. No...

Why Modern Roller Shutters Are the Perfect Solution for Your Home or Business

Whether you're looking to secure your home or make your business more energy-efficient, modern roller shutters are a smart choice. In this...

Everything You Need to Know About the EWPA Yellow Card

The EWPA Yellow Card is an important certification in the construction and workplace safety sectors. It plays a key role in ensuring worke...

From Residential to NDIS to Commercial: How Mr Window Cleaning Covers Every Window

Not all window cleaning jobs are created equal. A quiet suburban home, a bustling retail store, and a property under an NDIS plan each com...

How Timely Duct Inspections and Repairs Improve HVAC Efficiency

You have cranked up the air conditioning, but your home still feels unevenly cooled or stuffy. Sound familiar? Many homeowners jump straig...