examples of data missing at random

Data Missing at Random: Real-World Examples & Solutions

By Richard Wilson
AD

Data missing at random (MAR) is a type of data missingness that occurs when the likelihood of data being missing is related to other observed variables in the dataset, but not to the variable of interest itself. Understanding and handling MAR is crucial in statistical analysis to avoid biased results and increased error rates. Let's delve into the concept of MAR and explore various examples to illustrate different scenarios.

To understand data missing at random, it's essential to contrast it with other types of missing data. Missing completely at random (MCAR) occurs when the probability of missing data is the same regardless of observed or unobserved data. In contrast, missing not at random (MNAR) implies that the probability of missing data is related to unobserved variables.

Categorical Data Missing at Random

In categorical data, MAR can occur when the missingness depends on the values of other categorical variables. Here are two examples that illustrate this:

AD
Missing and Modified Data in Nonparametric Estimation: With R Examples | Indigo Chapters
Missing and Modified Data in Nonparametric Estimation: With R Examples | Indigo Chapters
Missing Data Overview: Types, Implications & Handling
Missing Data Overview: Types, Implications & Handling
Missing Data in Time-Series: Machine Learning Techniques | Towards Data Science
Missing Data in Time-Series: Machine Learning Techniques | Towards Data Science

Example 1: Consider a survey on voting patterns, where respondents are asked about their gender, age group, and political affiliation. If political affiliation data is missing at random, it means that the likelihood of missing data is related to the respondents' age group or gender. For instance, older respondents might be more likely to refuse answering the political affiliation question due to privacy concerns, but this likelihood is not tied directly to their political views.

Age-Group Bias

Respondents in the age group of 55-64 years are particularly reluctant to share their political affiliation,irrespective of their actual political beliefs. This missingness is related to the respondents' age group (observed variable), hence MAR.

a flow diagram with the words handling missing data in different colors and shapes, including arrows
a flow diagram with the words handling missing data in different colors and shapes, including arrows
Don’t impute all missing data: Missing Data Patterns
Don’t impute all missing data: Missing Data Patterns
Dealing with Leaky, Missing Data in a Production Environment | Towards Data Science
Dealing with Leaky, Missing Data in a Production Environment | Towards Data Science

Here's a simple representation of this data:

Age GroupPolitical Affiliation (Available)Political Affiliation (Missing)
18-24650150
25-34700100
35-4485075
55-64600200
65+45050

Gender-Targeted Bias

Respondents identifying as male have a higher propensity to leave the political affiliation question unanswered if it's towards the end of the survey. Again, this is related to an observed variable (gender), meeting the criteria for MAR.

AD

Numerical Data Missing at Random

For numerical data, MAR usually involves the relationship between the mean of the variable with missing data and the mean of other observed variables. Here's an example:

Different types of missing data.
Different types of missing data.
Imputing missing data with R; MICE package | R-bloggers
Imputing missing data with R; MICE package | R-bloggers
Missing Data Demystified: The Absolute Primer for Data Scientists | Towards Data Science
Missing Data Demystified: The Absolute Primer for Data Scientists | Towards Data Science
Missing Value Imputation, Explained: A Visual Guide with Code Examples for Beginners | Towards Data Science
Missing Value Imputation, Explained: A Visual Guide with Code Examples for Beginners | Towards Data Science
Predict Missing Values in the Dataset
Predict Missing Values in the Dataset
Computer Coding, Study Notes, Data Science, Computer Science, Machine Learning, Helping People, Science, Engineering, Coding
Computer Coding, Study Notes, Data Science, Computer Science, Machine Learning, Helping People, Science, Engineering, Coding

Salary Relationship

In a company's employee database, salary data is missing at random for certain employees. The likelihood of missing salary data is directly related to the employee's job title (an observed variable). For instance, employees with the job title "Senior Software Engineer" have a higher probability of having missing salary data because they might be more reluctant to share their compensation due to competitive dynamics within the team.

This data can be represented as follows:

AD
Job TitleSalary (Available)Salary (Missing)
Junior Software Engineer50,0005,000
Mid-Level Software Engineer65,0008,000
Senior Software Engineer80,00015,000
Principal Software Engineer100,0005,000

When dealing with data missing at random, it's essential to employ appropriate statistical techniques, such as multiple imputation or fully conditional specification, to handle the missing data and mitigate potential biases in the results.

What Makes Histograms a Misleading Choice for Data Visualisation?
What Makes Histograms a Misleading Choice for Data Visualisation?

In conclusion, understanding and effectively handling data missing at random is vital for robust data analysis. By exploring various examples across different data types, we've demonstrated how MAR can occur and how it should be addressed in both categorical and numerical data.

AD