Skip to main content

How to Ethically Use Machine Learning to Drive Decisions

Having good quality data requires strong data foundations, along with a commitment to monitoring models and removing bias.
Aug 2020  · 3 min read

Focus on solid data foundations and tooling

Having good quality data is a huge challenge in itself. We recommend companies that want to leverage machine learning, artificial intelligence, and data science to consider Monica Rogati’s AI Hierarchy of Needs, which has machine learning close to the top as one of the final pieces of the puzzle.

Source: Hackernoon

This hierarchy illustrates that before machine learning can happen, you need solid data foundations and tools for extracting, loading, and transforming data (ETL), as well as tools for cleaning and aggregating data from disparate sources.

This requires strong data engineering practices—you’ll need to leverage databases, understand how to process data correctly, schedule your workflows, and make use of cloud computing.

So before you hire your first machine learning engineer, you should first set up your data engineering, data science, and data analysis functions.

Beware of bias in your data and algorithms

Machine learning can only be as good as the data you feed it. If your data is biased, your model will be too. For example, Amazon built a ML recruiting tool to predict the success of applicants based on resumes with ten years’ worth of training data that favored males due to historic male dominance across the tech industry—which caused the ML tool to also be biased against women.

This is why data ethics has emerged as such an important topic in recent years. As more and more data is generated, the impact of how that data is used also scales dramatically. This requires principled consideration and monitoring. As Cassie Kozyrkov, Google's Chief Decision Scientist, has analogized, a teacher is only as good as the books they’re using to teach the students. If the books are biased, their lessons will be too.

Keep tabs on your model and improve it

Remember that the job of machine learning doesn’t end when your model is in production, making predictions, or performing classifications. Models that are deployed and doing work still need to be monitored and maintained.

If you have a model predicting credit card fraud based on transaction data, you get useful information every time your model makes a prediction and you act on it. On top of this, the activity you’re trying to monitor and predict—in this case, credit card fraud—may be dynamic and change over time. This process, where data that’s generated is constantly in flux, is called data drift—and it proves how essential it is to regularly update your model.

Source: DataBricks

Related

Top Machine Learning Use-Cases and Algorithms

Machine learning is arguably responsible for data science and artificial intelligence’s most prominent and visible use cases. In this article, learn about machine learning, some of its prominent use cases and algorithms, and how you can get started.
Vidhi Chugh's photo

Vidhi Chugh

15 min

Top MLOps Tools

17 Top MLOps Tools You Need to Know

Discover top MLOps tools for experiment tracking, model metadata management, workflow orchestration, data and pipeline versioning, model deployment and serving, and model monitoring in production.
Abid Ali Awan's photo

Abid Ali Awan

13 min

Supervised Machine Learning Cheat Sheet

In this cheat sheet, you'll have a guide around the top supervised machine learning algorithms, their advantages and disadvantages, and use-cases.
DataCamp Team's photo

DataCamp Team

5 min

Unsupervised Machine Learning Cheat Sheet

In this cheat sheet, you'll have a guide around the top unsupervised machine learning algorithms, their advantages and disadvantages and use cases.
DataCamp Team's photo

DataCamp Team

9 min

A Complete Guide to Data Augmentation

Learn about data augmentation techniques, applications, and tools with a TensorFlow and Keras tutorial.
Abid Ali Awan's photo

Abid Ali Awan

15 min

Understanding Data Drift and Model Drift: Drift Detection in Python

Navigate the perils of model drift and explore our practical guide to data drift monitoring.
Moez Ali 's photo

Moez Ali

9 min

See MoreSee More