gms | German Medical Science

Background: With the rise of technology in educational design, massive open online courses (MOOCs) are becoming more popular to facilitate teaching and learning, emphasizing open-access, interactive, and self-paced instruction. Such platforms have been invoked to improve statistical education among students and researchers. While the current work assesses individual learners, it speaks to a larger concern within psychology, namely the replicability crisis (OSC, 2015), raising doubts about methodological & statistical rigour among psychologists and social scientists. In light of overwhelming prevalence rates of p-value misinterpretations [1], [2], [3], research is warranted in pinpointing statistical misconceptions, and developing means to improve statistical literacy – goals that should be tackled in unison.

Methods: Pre-/posttest design is implemented within Daniёl Lakens’ 8-week MOOC “Improving your statistical inferences”, which fosters practical understanding of statistical concepts through use of mixed instructional methods, including video lectures and hands-on assignments (e.g., R simulations). The current research evaluates the effectiveness of this applied approach when teaching correct interpretations of p-values, confidence intervals (CIs), and Bayes Factors (BFs). 3 measurement timepoints (14 True/False questions), serve as proxies of prior knowledge (in week 1), immediate improvement (across weeks 1-4), and retention (in week 8). Repeated-measures ANCOVA and regression analyses are used to evaluate effects of course participation on learning, with additional separate analyses for each concept (p-values, CIs, BFs). Demographics and confidence ratings are measured.

Results & Discussion: Study is currently in the online data collection phase. Based on our pilot findings, we expect accuracy rates to correlate with confidence levels and self-rated statistical expertise. Results will be discussed in relation to conceptual knowledge gain vs. applied learning, and how each form of inferential reasoning might inform the other. The presented research aims to instill a more positive outlook on the matter of improving statistical literacy, using practical hands-on learning platforms that may cultivate inquiry-based learning processes.