types of missing data mcar mar mnar

Types of Missing Data: Understanding MCAR, MAR & MNAR

By James Brown
AD

Missing data, a common challenge in data analysis, can significantly impact the reliability and validity of study results. It occurs when data is absent or unavailable, and different types necessitate different handling strategies. This article delves into three primary types of missing data: Missing Completely at Random (MCAR), Missing at Random (MAR), and Not Missing at Random (NMAR).

Understanding these types is crucial for making informed decisions about the appropriate method to handle missing data, which can save time, reduce biases, and enhance results' accuracy. Let's explore each type, their definitions, and examples.

Missing Completely at Random (MCAR)

MCAR is the most benign type of missing data, assuming that the probability of data being missing is independent of both observed and unobserved data. In other words, once a value is missing, it provides no further information about the other variables in the dataset.

AD
Different types of missing data.
Different types of missing data.
All About Missing Data Handling | Towards Data Science
All About Missing Data Handling | Towards Data Science
Missing Data Overview: Types, Implications & Handling
Missing Data Overview: Types, Implications & Handling

MCAR is ideal for data imputation techniques like mean/mode/median imputation, but in practice, it's often hard to verify its assumption. Here's an example:

Example of MCAR

Consider a survey where participants are asked about their income, education level, and employment status. If respondents leave the income field empty simply because they find income questions sensitive, the income data is MCAR. The reason for non-response is not related to their education level or employment status.

Missing Data in Time-Series: Machine Learning Techniques | Towards Data Science
Missing Data in Time-Series: Machine Learning Techniques | Towards Data Science
a flow diagram with the words handling missing data in different colors and shapes, including arrows
a flow diagram with the words handling missing data in different colors and shapes, including arrows
Aasif • Data Science & AI on Instagram: "Dealing with Missing Data in Data Analysis 👨‍💻 Handling missing data is crucial for accurate analysis and reliable results. Here’s a quick guide on why it’s important, the types of missing data, and strategies to handle it. Why It Matters Missing data can distort the results of your analysis, leading to wrong conclusions. Proper handling ensures the integrity of your models and insights. Types of Missing Data 1. MCAR (Missing Completely at Random): Data missing independently of other variables. 2. MAR (Missing at Random): Missingness related to other observed data. 3. MNAR (Missing Not at Random): Missingness is related to the unobserved data itself. Strategies to Handle Missing Data • Deletion Methods: Removing rows/columns with missing Missing Rows In Data Analysis, Shared Data Problems Analysis, How To Solve Data Analysis Problems, How To Handle Missing Data In Statistics, Missing Data In Statistics, How To Interpret Data In Science, How To Handle Missing Data, Methods For Handling Missing Data, Understanding Data Science Roles
Aasif • Data Science & AI on Instagram: "Dealing with Missing Data in Data Analysis 👨‍💻 Handling missing data is crucial for accurate analysis and reliable results. Here’s a quick guide on why it’s important, the types of missing data, and strategies to handle it. Why It Matters Missing data can distort the results of your analysis, leading to wrong conclusions. Proper handling ensures the integrity of your models and insights. Types of Missing Data 1. MCAR (Missing Completely at Random): Data missing independently of other variables. 2. MAR (Missing at Random): Missingness related to other observed data. 3. MNAR (Missing Not at Random): Missingness is related to the unobserved data itself. Strategies to Handle Missing Data • Deletion Methods: Removing rows/columns with missing Missing Rows In Data Analysis, Shared Data Problems Analysis, How To Solve Data Analysis Problems, How To Handle Missing Data In Statistics, Missing Data In Statistics, How To Interpret Data In Science, How To Handle Missing Data, Methods For Handling Missing Data, Understanding Data Science Roles

Imputation Methods for MCAR

Methods like mean/mode/median imputation, regression imputation, and k-nearest neighbors (KNN) imputation are suitable for handling MCAR data. However, they should be used with caution, as they may not preserve data variance and can introduce biases.

Missing at Random (MAR)

MAR is a broader scenario where, although data is missing, the probability of missingness depends only on observed data. In other words, once you've controlled for certain observed variables, the missing data is MCAR. MAR is the most common type of missing data in practice.

AD

For MAR data, multiple imputation (MI) techniques are recommended. MI creates multiple datasets, each with imputed values for the missing data, thereby accounting for the uncertainty in the imputation process. Here's an example:

Mean Worksheets
Mean Worksheets
Don’t impute all missing data: Missing Data Patterns
Don’t impute all missing data: Missing Data Patterns
5 Causes of Missing Data in Enterprise Systems
5 Causes of Missing Data in Enterprise Systems
a diagram showing different types of data storage
a diagram showing different types of data storage
The Three Types of Missing Data Every Data Professional Should Know | Towards Data Science
The Three Types of Missing Data Every Data Professional Should Know | Towards Data Science
the memory taken by different data types
the memory taken by different data types

Example of MAR

A medical study tracks patients' height, weight, and cholesterol levels. Some patients might skip the weight measurement due to feeling embarrassed about their weight (observed data). However, their cholesterol levels (missing data) might still be(recorded. In this case, missingness is related to observed data (embarrassment about weight) but not the unobserved data (cholesterol levels), making it MAR.

Multiple Imputation for MAR

Software like R's 'mice' package and SPSS's multiple imputation feature can perform multiple imputation, filling in multiple plausible values for missing data under MAR assumption.

AD

Missing Not at Random (NMAR)

NMAR, also known as informative or non-ignorable missingness, is the most challenging type. Here, the probability of missingness depends on unobserved data, creating a strong relationship between the data and the process that caused it to be missing. NMAR violates the ignorability assumption, making traditional imputation techniques inappropriate.

Maximizing the likelihood of the observed data (e.g., expectation maximization algorithm) and Bayesian approaches are common methods to handle NMAR data. Let's explore an example:

Example of NMAR

Aitudinal survey asks participants about their views on climate change and political affiliation. If people with stronger political beliefs tend to skip the climate change question, the missing data is NMAR because the probability of missingness depends on unobserved data (opinions on climate change).

AD

HandlingNMAR Data

While there's no universally agreed-upon approach to handle NMAR data, methods like pattern-mixture models, selection models, and multiple imputation with informative dropout (MID) can handle NMAR under specific assumptions.

Wrapping up, understanding and categorizing missing data are essential for producing reliable and valid results. By recognizing MCAR, MAR, and NMAR, data analysts can make informed decisions about handling strategies, ensuring optimal outcomes in data analysis.

AD