Shows / Replicability-Index
Episodes
- Replicability-Index
Getting Results in Structural Equation Modeling
I first learned structural equation modeling with Ralf Schwarzer at the Free University Berlin. Alexander Grob taught me how to achieve good model fit when I…
- Replicability-Index
The HEXACO Paradigm: Confusing the Map With the Territory
In The Structure of Scientific Revolutions, Thomas Kuhn (1962) described how scientific communities develop around a paradigm. A paradigm involves more than a…
- Replicability-Index
Lost in Factor Space: The Search for Personality Meta-Traits
Shaky Scientific (Epistemiological) Foundations of Personality Psychology Personality psychology lacks solid scientific foundations. Behaviorism was…
- Replicability-Index
Narcissism Is Not a Trait: Entitlement and Grandiosity Are
Ulrich Schimmack | University of Toronto Mississauga | Replication Index | October 2026 Is your boss a narcissist? Your ex? A politician? People ask these…
- Replicability-Index
Towards a Consensual Taxonomy of Personality Traits: One Dataset, Many Analysts
An open invitation to personality researchers Personality psychology has produced numerous taxonomies of personality traits, but we still lack a widely…
- Replicability-Index
Personality and GPA: A Multi-Rater Study
Dozens of studies have correlated students’ personality with their GPA (Grade Point Average). The reason is simple. Students are easily accessible, and…
- Replicability-Index
Peer Review Uncovers Errors in Human Information Processing: But Who Is Making Them?
Peer review is supposed to uncover errors in manuscripts. Sometimes it does. Sometimes it provides a rather nice demonstration of the errors humans make while…
- Replicability-Index
IAT Does Not Predict Discrimination Against Immigrant Students in Italy
Alesina, A., Carlana, M., La Ferrara, E., & Pinotti, P. (2018). Revealing stereotypes: Evidence from immigrants in schools (NBER Working Paper No. 25333)…
- Replicability-Index
A Second Look at the Credibility of Clinical Trials Using zcurve3
van Zwet, E., Gelman, A., Greenland, S., Imbens, G., Schwab, S., & Goodman, S. N. (2024). A New Look at P Values for Randomized Clinical Trials. NEJM evidence…
- Replicability-Index
Post-Publication Review of Faridani, Testing for Underpowered Literatures
Faridani, S. (2026). Testing for underpowered literatures. Journal of Econometrics, 257, 106312. https://doi.org/10.1016/j.jeconom.2026.106312 Abstract…
- Replicability-Index
How Robust is RoBMA?
Robust Bayesian Meta-Analysis, or RoBMA, was developed in E. J. Wagenmakers’ research group as a method for evaluating meta-analytic evidence while allowing…
- Replicability-Index
Assessing Nudge Impact: A Comprehensive Second- Order Monster- Analysis
Hu, B., Z. Xia, Q. Guo, C. Lu, S. Constantino, and X. Ju. 2025. “ Assessing Nudge Impact: A Comprehensive Second-Order Meta-Analysis.” Journal of Behavioral…
- Replicability-Index
What is the Effect of Nudging? 43
Mertens, S., Herberz, M., Hahnel, U. J. J., & Brosch, T. (2022). The effectiveness of nudging: A meta-analysis of choice architecture interventions across…
- Replicability-Index
Closer to Zero Does Not Mean Closer to the Truth — How RoBMA Overcorrects Real Effects
Maier, M., Bartoš, F., & Wagenmakers, E.-J. (2023). Robust Bayesian meta-analysis: Addressing publication bias with model-averaging. Psychological Methods…
- Replicability-Index
How Effective is Psychotherapy for the Treatment of Depression?
Conclusion: A meta-analysis of clinical trials in Western nations that compare psychotherapy to treatment as usual shows an average effect size of half a…
- Replicability-Index
It is OK to be a WEIRD science
It Is Fine to Be WEIRD Americans love acronyms, and none has traveled further in social psychology than WEIRD — Western, Educated, Industrialized, Rich, and…
- Replicability-Index
Credibility in Economics: A Reanalysis of Large-Scale Meta-Research
Askarov, Z., Doucouliagos, A., Doucouliagos, H., & Stanley, T. D. (2024). Selective and (mis)leading economics journals: Meta-research evidence. Journal of…
- Replicability-Index
Primed for Equivocation
“Priming exercise” and psychological priming share a label, not necessarily a mechanism. Deliberate preparation for a known future competition provides no…
- Replicability-Index
Methodological Problems in Claims About “Conscious” and “Preconscious” Influencer Effects
Mir, I. A. (2026). Influencer’s physical attractiveness and content aesthetics: Conscious and preconscious determinants of fashion-branded content engagement…
- Replicability-Index
Auditing a Poor Audit of Elderly Priming
Costa, T. (2026). The Bayesian audit: Evaluating the proportionality of scientific claims to evidence—a case study on social priming and walking speed…
- Replicability-Index
Old Evidence for a Fragile Priming Theory
Przybylinski, E. (2026). Whatever you say: Changing transference-based problem behavior with if–then plans. Self and Identity. Advance online publication…
- Replicability-Index
A Speculative Theory of Replication Failures in Social Psychology: The Empty-Self Metaphor
Klein, J. W., & Swann, W. B., Jr. (2026). Social psychology’s empty-self metaphor and the replication crisis. Perspectives on Psychological Science, 21(2)…
- Replicability-Index
A Mostly Speculative Social Identity Theory of Digital Identity
“Theories are a dime a dozen” (Ed Diener, personal communication) Bingley, W. J., Worthy, P., Wiles, J., & Haslam, S. A. (2026). A social…
- Replicability-Index
Individual Differences Do Not Salvage The Priming Train Wreck
Aytürk, E., & Saribay, S. A. (2026). Neglect of the individual as a neglected problem: The relevance of combined idiographic-nomothetic approaches for…
- Replicability-Index
Is Subliminal Manipulation Really the Threat?
Smolinski, J., Smolinski, R., Kesting, P., & Kröcher, F. (2026). Ethical guidelines for designing, developing, and deploying AI negotiation agents. Group…
- Replicability-Index
Speculative versus Explanatory Theory: A Review of “Narrative Embodiment”
Shimada, S., Tanaka, S., Morioka, S., Rode, G., Roy, J.-M., & Rossetti, Y. (2026). Narrative embodiment: A conceptual framework linking the narrative self…
- Replicability-Index
Elderly Priming: Did It Ever Work?
The Short Version Bargh, Chen, and Burrows (1996) reported that priming students with words related to old age made them walk more slowly, with effect sizes…
- Replicability-Index
Priming Automatic Behaviors
Question:Is there credible evidence that automatic priming of behavior without people’s awareness works? Current Scientific Answer: There is no strong…
- Replicability-Index
Priming: A Pathological Paradigm
Priming behavior: A meta-analysis of the effects of behavioral and nonbehavioral primes on overt behavioral outcomes. Brief Introduction The replication crisis…
- Replicability-Index
Gary Latham: Primed for Achievement
Gary P. Latham is a professor at the business school of the University of Toronto, where he has spent his career studying goal pursuit — how people…
- Replicability-Index
Why Most Meta-Analyses (in Psychology) Could Be False: Mismodeling Heterogeneity
This blog post follows up on an introduction to meta-analyses with heterogeneous data. Modeling Heterogeneity in Meta-Analyses – Replicability-Index We…
- Replicability-Index
Modeling Heterogeneity in Meta-Analyses
Correction (2026-07-14)The original post claimed that violations of the normality assumption biases standard random effects estimates. That finding was based…
- Replicability-Index
Managing the Terror of Meta-Analyses
Summary For method folks, the picture tells the full story: z-curve can estimate the true mean of a set of heterogeneous studies better than the…
- Replicability-Index
To Model or Not to Model Nonsignificant Results in Meta-Analyses?
To make sense of empirical data, researchers need statistical models, and the choice of model can influence conclusions. It is therefore important to be aware…
- Replicability-Index
The Irony of Testing for Bias with the Same Tools That Created It
Meta-psychology was born from a simple observation: the way psychologists used significance testing created a distorted literature. Researchers treated p <…
- Replicability-Index
Simulations as Rhetorical Devices
The past decade has not been kind to experimental social psychology. Study after study failed to replicate and entire literatures have turned out to be built…
- Replicability-Index
Hypothesis Testing and Estimation with Standardized Standard Errors
Inferential statistics in psychology lacks a unified practice. Debates about statistical inference tend to organize around a 2 × 2 structure: one dimension…
- Replicability-Index
Project Implicit: Insider and Outsider Perspectives
Here is an open access version of “Lessons from two decades of project implicit” by Kate A. Ratliff and Colin Tucker Smith. Microsoft Word –…
- Replicability-Index
Who is who in social psychology? Project Implicit
Project Implicit is a nonprofit company founded in 1998 by three social psychologists: Tony Greenwald (University of Washington)Mahzarin Banaji (Harvard…
- Replicability-Index
The Abuse of Effect Sizes: The Pervasive Fallacy of Effect Size Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001). The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis. The American Statistician, 55(1)…