Directional replicability addresses the question of whether an effect studied across n independent studies is present with the same direction in at least r of them, for r≥2. When the expected direction of the effect is not specified in advance, the state of the art recommends assessing replicability separately by combining one-sided p-values for both directions (left and right), and then doubling the smaller of the two resulting combined p-values to account for multiple testing. In this work, we show that this multiplicative correction is not always necessary, and give a sufficient and necessary condition under which it can be safely omitted.

Directional replicability: When can the factor of two be omitted

Djordjilovic, Vera
;
2026

Abstract

Directional replicability addresses the question of whether an effect studied across n independent studies is present with the same direction in at least r of them, for r≥2. When the expected direction of the effect is not specified in advance, the state of the art recommends assessing replicability separately by combining one-sided p-values for both directions (left and right), and then doubling the smaller of the two resulting combined p-values to account for multiple testing. In this work, we show that this multiplicative correction is not always necessary, and give a sufficient and necessary condition under which it can be safely omitted.
File in questo prodotto:
File Dimensione Formato  
Directional_Replicability_VoR.pdf

accesso aperto

Tipologia: Versione dell'editore
Licenza: Creative commons
Dimensione 614.26 kB
Formato Adobe PDF
614.26 kB Adobe PDF Visualizza/Apri

I documenti in ARCA sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10278/5112868
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact