Background and hypothesis: Identifying generalizable brain imaging markers from large multi-center datasets remains challenging due to varying statistical aggregation approaches and p-hacking with increasing big data. We hypothesized that effect size (ES) inference surpasses P-value-based inference in reliably identifying core brain damage of schizophrenia, regardless of whether Mega- or Meta-analyses are used.
Study design: We examined voxel-wise inter-group differences in gray matter volume (GMV) based on individual data from 976 schizophrenia patients and 801 healthy controls across 16 datasets, along with published coordinates data from 103 studies involving 5151 patients and 5438 controls, using Mega-analysis (Mega), Image-Based Meta-analysis (IBMA), and Coordinate-Based Meta-analysis (CBMA) under P-value and ES inference frameworks, respectively. We then compared the performances of different statistical aggregation (Mega, IBMA, and CBMA) and statistical inference (P-value and ES) strategies in revealing brain abnormalities in schizophrenia.
Study results: P-value Mega identified significant GMV abnormalities in nearly all gray matter voxels (94.85%) with high sensitivity to sample size; in contrast, ES Mega detected core abnormalities in only 24.63% of voxels that had large ES and manifested higher resistance to sample size. ES IBMA and CBMA also demonstrated superior detection performance and were less affected by sample size than P-value ones. Finally, IBMA exhibited comparable performance with the Mega-analysis and superior performance than all types of CBMAs.
Conclusions: These results underscore the advantages of using ES inference in multi-center statistical aggregation and highlight the potential of IBMA for enhanced detection of brain structural abnormalities in schizophrenia.
Keywords: P-value; big data; effect size; image-based meta-analysis; mega-analysis; schizophrenia.
© The Author(s) 2025. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For commercial re-use, please contact reprints@oup.com for reprints and translation rights for reprints. All other permissions can be obtained through our RightsLink service via the Permissions link on the article page on our site—for further information please contact journals.permissions@oup.com.