New large scale registered replication project probing Construal-Level Theory.
It shows the typical pattern: Hundreds of published studies (with positive effects), but virtually no replication attempts. Metaanalytic bias correction suggests true effect close to zero.
The preregistered replication:
* N = 11,775 from 27 countries and regions; 99.995% power for g = 0.23
* direct and paradigmatic replications
Results (positive effects are consistent with hypotheses):
* temporal, d = 0.08, 95% confidence interval [CI] = [0.003, 0.16] (effect in original study: d = 0.92);
* spatial, d = 0.04, 95% CI = [−0.03, 0.11] (effect in original study: d = 0.55);
* social, d = −0.27, 95% CI = [−0.34, −0.19]; and
* likelihood, d = 0.03, 95% CI = [−0.05, 0.11].
"These findings provide limited evidence for the predictions of the theory and present a critical challenge for CLT.“
OA paper: Calderon et al:: journals.sagepub.com/doi/full/…