Could someone please explain why I get different answers using the aggregate function to count missing values by group? Also, is there a better way to count missing values
library(dplyr)
library(tidyr)
#say you want to get missing values from group 1
dataframe %>% filter(group = 1 & is.na(another_column))
#missing values from group 2
dataframe %>% filter(group = 2 & is.na(another_column))
The help page at ?aggregate points out that the formula method has an argument na.action which is set by default to na.omit.
na.action: a function which indicates what should happen when the data containNAvalues. The default is to ignore missing values in the given variables.
Change that argument to NULL or na.pass instead to get the results you are probably expecting:
# aggregate(X ~ YEAR, data=DF, function(x) {sum(is.na(x))}, na.action = na.pass)
aggregate(X ~ YEAR, data=DF, function(x) {sum(is.na(x))}, na.action = NULL)
# YEAR X
# 1 2000 1
# 2 2001 3
# 3 2002 0