Access the full text.
Sign up today, get DeepDyve free for 14 days.
Bai Y. (2021)
1Journal of the American Statistical Association, 2021
Bai, Joseph Romano, A. Shaikh (2019)
Inference in Experiments With Matched PairsJournal of the American Statistical Association, 117
G. Casella, I. Olkin, S. Fienberg (2021)
Testing Statistical HypothesesProbability and Statistical Inference, Third Edition
there is a single treatment, a single outcome, and multiple subpopulations defined according to the joint values of two binary variables z 1 and z 2
J. Heckman, Rodrigo Pinto, A. Shaikh, Adam Yavitz (2011)
Inference with Imperfect Randomization: The Case of the Perry Preschool ProgramEconometrics: Applied Econometrics & Modeling eJournal
T. Ye, J. Shao, Yanyao Yi, Qingyuan Zhao (2020)
Toward Better Practice of Covariate Adjustment in Analyzing Randomized Clinical TrialsJournal of the American Statistical Association
Cecilia Machado, A. Shaikh, E. Vytlacil (2018)
Instrumental Variables and the Sign of the Average Treatment EffectBecker Friedman Institute for Economics Working Paper Series
S. Holm (1979)
A Simple Sequentially Rejective Multiple Test ProcedureScandinavian Journal of Statistics, 6
Federico Bugni, Ivan Canay, A. Shaikh (2015)
Inference Under Covariate-Adaptive RandomizationJournal of the American Statistical Association, 113
R. Beran (1990)
Refining Bootstrap Simultaneous Confidence SetsJournal of the American Statistical Association, 85
Davide Viviano, K. Wuthrich, Paul Niehaus (2021)
(When) should you adjust inferences for multiple hypothesis testing?
T. Ye, J. Shao, Qingyuan Zhao (2020)
Principles for Covariate Adjustment in Analyzing Randomized Clinical TrialsarXiv: Methodology
Federico Bugni, Ivan Canay, A. Shaikh (2018)
Inference under Covariate-Adaptive Randomization with Multiple TreatmentsBecker Friedman Institute for Economics Working Paper Series
Joseph Romano, A. Shaikh (2006)
Stepup procedures for control of generalizations of the familywise error rate
Joseph Romano, A. Shaikh, D. Wilhelm (2020)
Inference for Ranks with Applications to Mobility Across Neighborhoods and Academic Achievement Across CountriesPolitical Economy - Development: Public Service Delivery eJournal
Anna Dreber, T. Pfeiffer, Johan Almenberg, Siri Isaksson, Brad Wilson, Yiling Chen, Brian Nosek, M. Johannesson (2015)
Using prediction markets to estimate the reproducibility of scientific researchProceedings of the National Academy of Sciences, 112
A. Tsiatis, M. Davidian, Min Zhang, Xiaomin Lu (2008)
Covariate adjustment for two‐sample treatment comparisons in randomized clinical trials: A principled yet flexible approachStatistics in Medicine, 27
Li Yang, A. Tsiatis (2001)
Efficiency Study of Estimators for a Treatment Effect in a Pretest–Posttest TrialThe American Statistician, 55
Zacharias Maniadis, Fabio Tufano, J. List (2014)
One swallow doesn’t make a summer: new evidence on anchoring effectsThe American Economic Review, 104
Joseph Romano, A. Shaikh, Michael Wolf (2009)
Hypothesis Testing in EconometricsEconometrics: Econometric & Statistical Methods - General eJournal
C. Bonferroni, C. Bonferroni (1935)
Il calcolo delle assicurazioni su gruppi di teste
Suppose there is a single treatment, multiple outcomes and a single subpopulation. It is now less clear whether the null hypotheses corresponding to all such outcomes should be included in the family
Sergei Bazylik, M. Mogstad, Joseph Romano, A. Shaikh, D. Wilhelm (2021)
Finite- and large-sample inference for ranks using multinomial data with an application to ranking political partiesSSRN Electronic Journal
M. Mogstad, J. Romano, A. Shaikh, D. Wilhelm (2022)
Statistical uncertainty in the ranking of journals and universitiesSSRN Electronic Journal
Laurie Anderson, Carolynne Shinn, M. Fullilove, S. Scrimshaw, J. Fielding, J. Normand, Vilma Carande-Kulis (2003)
The effectiveness of early childhood development programs. A systematic review.American journal of preventive medicine, 24 3 Suppl
J. Heckman, S. Moon, Rodrigo Pinto, P. Savelyev, Adam Yavitz (2010)
Analyzing Social Experiments as Implemented: A Reexamination of the Evidence from the Highscope Perry Preschool ProgramERN: Econometric Modeling in Microeconomics (Topic)
Joseph Romano, Michael Wolf
Centre De Referència En Economia Analítica Barcelona Economics Working Paper Series Working Paper Nº 17 Stewise Multiple Testing as Formalized Data Snooping Stepwise Multiple Testing as Formalized Data Snooping
Joseph Romano, Michael Wolf (2008)
Balanced Control of Generalized Error RatesEconometrics: Econometric & Statistical Methods - General eJournal
Dean Karlan, J. List (2006)
Does Price Matter in Charitable Giving? Evidence from a Large-Scale Natural Field ExperimentERN: Other Primary Taxonomy (Sub-Topic)
Butera Luigi, J. GrossmanPhilip, Houser Daniel, A. ListJohn, Villeval Marie-Claire, A. Greg, B. Russell, Eckel Catherine, F. Robert, Haruvy Ernan, Ma Yu, Popkowski Peter, Yu Wang, Xin Sherry, G. JamesAlexander, J. MurphyJames, K. PriceMichael, C. Bharat, Hortacsu Ali, Muir Ian, M. WooldridgeJeffrey, Gneezy Uri, Al-Ubaydli Omar, Mackevicius Claire, Sok Min, L. SuskindDana, C. Shubha, Lundberg Mattias, Nikolov Plamen, Zenker Juliane, Hedblom Daniel, R. HickmanBrent, Bulte Erwin, van Daan (2020)
A New Mechanism to Alleviate the Crises of Confidence in Science-With an Application to the Public Goods GamePublic Choice: Public Goods eJournal
Joseph Romano, A. Shaikh, Michael Wolf (2007)
FORMALIZED DATA SNOOPING BASED ON GENERALIZED ERROR RATESEconometric Theory, 24
Akanksha Negi, J. Wooldridge (2020)
Revisiting regression adjustment in experiments with heterogeneous treatment effectsEconometric Reviews, 40
Soohyung Lee, A. Shaikh (2014)
MULTIPLE TESTING AND HETEROGENEOUS TREATMENT EFFECTS: RE-EVALUATING THE EFFECT OF PROGRESA ON SCHOOL ENROLLMENT: HETEROGENEOUS TREATMENT EFFECTSJournal of Applied Econometrics, 29
J. Bhattacharya, A. Shaikh, E. Vytlacil (2005)
Treatment Effect Bounds: An Application to Swan-Ganz CatheterizationHealth Economics eJournal
J. List, A. Shaikh, Yang Xu (2016)
Multiple hypothesis testing in experimental economicsExperimental Economics
Joseph Romano, A. Shaikh, Michael Wolf (2008)
Control of the false discovery rate under dependence using the bootstrap and subsamplingTEST, 17
Joseph Romano, A. Shaikh (2012)
On the uniform asymptotic validity of subsampling and the bootstrapAnnals of Statistics, 40
W. Lin (2012)
Agnostic notes on regression adjustments to experimental data: Reexamining Freedman's critiquearXiv: Applications
James Heckman, Rodrigo Pinto, P. Savelyev (2012)
NBER WORKING PAPER SERIES UNDERSTANDING THE MECHANISMS THROUGH WHICH AN INFLUENTIAL EARLY CHILDHOOD PROGRAM BOOSTED ADULT OUTCOMES
R. Berk, E. Pitkin, L. Brown, A. Buja, E. George, Linda Zhao (2013)
Covariance Adjustments for the Analysis of Randomized Field ExperimentsEvaluation Review, 37
Joseph Romano, A. Shaikh, Michael Wolf (2009)
Financial Valuation and Risk Management Working Paper No . 585 Consonance and the Closure Method in Multiple Testing
Soohyung Lee, A. Shaikh (2013)
Multiple Testing and Heterogeneous Treatment Effects: Re-Evaluating the Effect of PROGRESA on School EnrollmentSIRN: Low Income Families with Children (Topic)
This paper provides a framework for testing multiple null hypotheses simultaneously using experimental data in which simple random sampling is used to assign treatment status to units. Using general results from the multiple testing literature, we develop under weak assumptions a procedure that (i) asymptotically controls the familywise error rate—the probability of one or more false rejections—and (ii) is asymptotically balanced in that the marginal probability of rejecting any true null hypothesis is approximately equal in large samples. Our procedure improves upon classical methods by incorporating information about the joint dependence structure of the test statistics when determining which null hypotheses to reject, leading to gains in power. An important point of departure from prior work is that we exploit observed, baseline covariates to obtain further gains in power. The precise way in which we incorporate these covariates is based on recent results from the statistics literature in order to ensure that inferences are typically more powerful in large samples.
Journal of Applied Econometrics – Wiley
Published: Sep 1, 2023
Keywords: experiments; familywise error rate; multiple testing; treatment effects
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.