Title: Confidence intervals for single-case effect size measures based on randomization test inversion
Authors: Michiels, Bart ×
Heyvaert, Mieke
Meulders, Ann
Onghena, Patrick #
Issue Date: 2016
Publisher: Psychonomic Society
Series Title: Behavior Research Methods
Abstract: In the current paper, we present a method to construct nonparametric confidence intervals for single-case effect size measures in the context of various single-case designs. We use the relationship between a two-sided statistical hypothesis test at significance level α and a 100(1 – α)% two-sided confidence interval to construct confidence intervals for any effect size measure θ that contain all point null hypothesis θ values that cannot be rejected by the hypothesis test at significance level α. This method of hypothesis test inversion (HTI) can be employed using a randomization test as the statistical hypothesis test in order to construct a nonparametric confidence interval for θ. We will refer to this procedure as randomization test inversion (RTI). We illustrate RTI in a situation in which θ is the unstandardized and the standardized difference in means between two treatments in a completely randomized single-case design. Additionally, we demonstrate how RTI can be extended to other types of single-case designs. Finally, we discuss a few challenges for RTI as well as possibilities when using the method with other effect size measures, such as rank-based nonoverlap indices. Supplementary to this paper, we provide easy-to-use R code, which allows the user to construct nonparametric confidence intervals according to the proposed method.
ISSN: 1554-351X
Publication status: accepted
KU Leuven publication type: IT
Appears in Collections:Methodology of Educational Sciences
Health Psychology
× corresponding author
# (joint) last author

Files in This Item:

There are no files associated with this item.

Request a copy


All items in Lirias are protected by copyright, with all rights reserved.