Braindr-based quality control has a substantial impact on effect size estimates 

The secondary goal of this study was to demonstrate how the result of scaling expertise through citizen science amplification affects scientific results. For this proof of concept, we studied brain development. In \cite{lebel2011longitudinal}, the authors found white matter increases and gray matter decreases equal in magnitude, resulting in no overall brain volume change. From the second figure in their manuscript, we estimate an effect of  -4.3 cmper year ((710-580)/(5-35)) of gray matter volume change during development. In Figure \ref{182176}, we present an interactive plot, where readers can threshold data points based on QC scores from the predicted labels of the CNN (called "Braindr ratings"), or on MRIQC XGBoost probabilities (called "MRIQC ratings"). Depending on the threshold chosen, the effect of gray matter volume over age varies from -2.6 cm3/year (with no threshold) to -5.3 cm3/year (with Braindr rating > 0.9). A threshold of 0.7 of either Braindr or MRIQC results in an effect size around -4.3 cm3 per year, replicating the results of \cite{Lebel2011}