Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.
Research Guides
Multiple Case Studies
Nadia Alqahtani and Pengtong Qu
Description
The case study approach is popular across disciplines in education, anthropology, sociology, psychology, medicine, law, and political science (Creswell, 2013). It is both a research method and a strategy (Creswell, 2013; Yin, 2017). In this type of research design, a case can be an individual, an event, or an entity, as determined by the research questions. There are two variants of the case study: the single-case study and the multiple-case study. The former design can be used to study and understand an unusual case, a critical case, a longitudinal case, or a revelatory case. On the other hand, a multiple-case study includes two or more cases or replications across the cases to investigate the same phenomena (Lewis-Beck, Bryman & Liao, 2003; Yin, 2017). …a multiple-case study includes two or more cases or replications across the cases to investigate the same phenomena
The difference between the single- and multiple-case study is the research design; however, they are within the same methodological framework (Yin, 2017). Multiple cases are selected so that “individual case studies either (a) predict similar results (a literal replication) or (b) predict contrasting results but for anticipatable reasons (a theoretical replication)” (p. 55). When the purpose of the study is to compare and replicate the findings, the multiple-case study produces more compelling evidence so that the study is considered more robust than the single-case study (Yin, 2017).
To write a multiple-case study, a summary of individual cases should be reported, and researchers need to draw cross-case conclusions and form a cross-case report (Yin, 2017). With evidence from multiple cases, researchers may have generalizable findings and develop theories (Lewis-Beck, Bryman & Liao, 2003).
Creswell, J. W. (2013). Qualitative inquiry and research design: Choosing among five approaches (3rd ed.). Los Angeles, CA: Sage.
Lewis-Beck, M., Bryman, A. E., & Liao, T. F. (2003). The Sage encyclopedia of social science research methods . Los Angeles, CA: Sage.
Yin, R. K. (2017). Case study research and applications: Design and methods . Los Angeles, CA: Sage.
Key Research Books and Articles on Multiple Case Study Methodology
Yin discusses how to decide if a case study should be used in research. Novice researchers can learn about research design, data collection, and data analysis of different types of case studies, as well as writing a case study report.
Chapter 2 introduces four major types of research design in case studies: holistic single-case design, embedded single-case design, holistic multiple-case design, and embedded multiple-case design. Novice researchers will learn about the definitions and characteristics of different designs. This chapter also teaches researchers how to examine and discuss the reliability and validity of the designs.
Creswell, J. W., & Poth, C. N. (2017). Qualitative inquiry and research design: Choosing among five approaches . Los Angeles, CA: Sage.
This book compares five different qualitative research designs: narrative research, phenomenology, grounded theory, ethnography, and case study. It compares the characteristics, data collection, data analysis and representation, validity, and writing-up procedures among five inquiry approaches using texts with tables. For each approach, the author introduced the definition, features, types, and procedures and contextualized these components in a study, which was conducted through the same method. Each chapter ends with a list of relevant readings of each inquiry approach.
This book invites readers to compare these five qualitative methods and see the value of each approach. Readers can consider which approach would serve for their research contexts and questions, as well as how to design their research and conduct the data analysis based on their choice of research method.
Günes, E., & Bahçivan, E. (2016). A multiple case study of preservice science teachers’ TPACK: Embedded in a comprehensive belief system. International Journal of Environmental and Science Education, 11 (15), 8040-8054.
In this article, the researchers showed the importance of using technological opportunities in improving the education process and how they enhanced the students’ learning in science education. The study examined the connection between “Technological Pedagogical Content Knowledge” (TPACK) and belief system in a science teaching context. The researchers used the multiple-case study to explore the effect of TPACK on the preservice science teachers’ (PST) beliefs on their TPACK level. The participants were three teachers with the low, medium, and high level of TPACK confidence. Content analysis was utilized to analyze the data, which were collected by individual semi-structured interviews with the participants about their lesson plans. The study first discussed each case, then compared features and relations across cases. The researchers found that there was a positive relationship between PST’s TPACK confidence and TPACK level; when PST had higher TPACK confidence, the participant had a higher competent TPACK level and vice versa.
Recent Dissertations Using Multiple Case Study Methodology
Milholland, E. S. (2015). A multiple case study of instructors utilizing Classroom Response Systems (CRS) to achieve pedagogical goals . Retrieved from ProQuest Dissertations & Theses Global. (Order Number 3706380)
The researcher of this study critiques the use of Classroom Responses Systems by five instructors who employed this program five years ago in their classrooms. The researcher conducted the multiple-case study methodology and categorized themes. He interviewed each instructor with questions about their initial pedagogical goals, the changes in pedagogy during teaching, and the teaching techniques individuals used while practicing the CRS. The researcher used the multiple-case study with five instructors. He found that all instructors changed their goals during employing CRS; they decided to reduce the time of lecturing and to spend more time engaging students in interactive activities. This study also demonstrated that CRS was useful for the instructors to achieve multiple learning goals; all the instructors provided examples of the positive aspect of implementing CRS in their classrooms.
Li, C. L. (2010). The emergence of fairy tale literacy: A multiple case study on promoting critical literacy of children through a juxtaposed reading of classic fairy tales and their contemporary disruptive variants . Retrieved from ProQuest Dissertations & Theses Global. (Order Number 3572104)
To explore how children’s development of critical literacy can be impacted by their reactions to fairy tales, the author conducted a multiple-case study with 4 cases, in which each child was a unit of analysis. Two Chinese immigrant children (a boy and a girl) and two American children (a boy and a girl) at the second or third grade were recruited in the study. The data were collected through interviews, discussions on fairy tales, and drawing pictures. The analysis was conducted within both individual cases and cross cases. Across four cases, the researcher found that the young children’s’ knowledge of traditional fairy tales was built upon mass-media based adaptations. The children believed that the representations on mass-media were the original stories, even though fairy tales are included in the elementary school curriculum. The author also found that introducing classic versions of fairy tales increased children’s knowledge in the genre’s origin, which would benefit their understanding of the genre. She argued that introducing fairy tales can be the first step to promote children’s development of critical literacy.
Asher, K. C. (2014). Mediating occupational socialization and occupational individuation in teacher education: A multiple case study of five elementary pre-service student teachers . Retrieved from ProQuest Dissertations & Theses Global. (Order Number 3671989)
This study portrayed five pre-service teachers’ teaching experience in their student teaching phase and explored how pre-service teachers mediate their occupational socialization with occupational individuation. The study used the multiple-case study design and recruited five pre-service teachers from a Midwestern university as five cases. Qualitative data were collected through interviews, classroom observations, and field notes. The author implemented the case study analysis and found five strategies that the participants used to mediate occupational socialization with occupational individuation. These strategies were: 1) hindering from practicing their beliefs, 2) mimicking the styles of supervising teachers, 3) teaching in the ways in alignment with school’s existing practice, 4) enacting their own ideas, and 5) integrating and balancing occupational socialization and occupational individuation. The study also provided recommendations and implications to policymakers and educators in teacher education so that pre-service teachers can be better supported.
Multiple Case Studies Copyright © 2019 by Nadia Alqahtani and Pengtong Qu is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License , except where otherwise noted.
Share This Book
SINGLE CASE STUDIES VS. MULTIPLE CASE STUDIES: A COMPARATIVE STUDY - DIVA PORTAL
- Download HTML
- Download PDF
- Health & Fitness
- Style & Fashion
- Food & Drink
- Uncategorized
- Government & Politics
- IT & Technique
- Home & Garden
- Cars & Machinery
- Current Events
- World Around
Multiple Case Research Design
- First Online: 04 January 2024
Cite this chapter
- Stefan Hunziker 3 &
- Michael Blankenagel 3
1254 Accesses
2 Citations
This chapter addresses multiple case research designs’ peculiarities, characteristics, and major fallacies. The significant advantage of multiple-case research lies in cross-case analysis. A multiple-case research design shifts the focus from understanding a single case to the differences and similarities between cases. Thus, it is more than conducting more case studies (second, third, etc.). Instead, it is the next step in developing a theory about factors driving differences and similarities. Also, researchers find relevant information on how to write a multiple case research design paper and learn about typical methodologies used for this research design. The chapter closes by referring to overlapping and adjacent research designs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Subscribe and save.
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime
- Available as PDF
- Read on any device
- Instant download
- Own it forever
- Available as EPUB and PDF
- Compact, lightweight edition
- Dispatched in 3 to 5 business days
- Free shipping worldwide - see info
Tax calculation will be finalised at checkout
Purchases are for personal use only
Institutional subscriptions
Bruns, W. J., & McKinnon, S. M. (1993). Information and managers: A field study. Journal of Management Accounting Research, 5, 84–108.
Google Scholar
Eisenhardt, K. M., & Graebner, M. E. (2007). Theory building from cases: Opportunities and challenges. Academy of Management Journal, 50 (1), 25–32.
Article Google Scholar
Ferreira, L. D., & Merchant, K. A. (1992). Field research in management accounting and control: A review and evaluation . Emerald Group Publishing Limited.
Keating, P. J. (1995). A framework for classifying and evaluating the theoretical contributions of case research in management accounting. Journal of Management Accounting Research, 7, 66–86.
Lillis, A. M., & Mundy, J. (2005). Cross-sectional field studies in management accounting research—closing the gaps between surveys and case studies. Journal of Management Accounting Research, 17 (1), 119–141.
Ragin, C. C. (2009). Reflections on casing and case-oriented research (pp. 522–534). The Sage handbook of case-based method.
Ridder, H.-G. (2017). The theory contribution of case study research designs. Business Research, 10 (2), 281–305.
Stake, R. E. (2005). Qualitative case studies. In N.K. Denzin & Y.S. Lincoln (Eds.), The SAGE handbook of qualitative research (3rd ed., pp. 443–466).
Vaughan, D. (1992). Theory elaboration: The heuristics of case analysis. What is a case?. In C. C. Ragin & H. S. Becker (Eds.), Exploring the foundations of social inquiry (pp. 173–202). Cambridge University Press.
Walsham, G. (2006). Doing interpretive research. European Journal of Information Systems, 15 (3), 320–330.
Yin, R. K. (2014). Case study research. Design and methods (5th ed.). SAGE.
Download references
Author information
Authors and affiliations.
Wirtschaft/IFZ, Campus Zug-Rotkreuz, Hochschule Luzern, Zug-Rotkreuz, Zug, Switzerland
Stefan Hunziker & Michael Blankenagel
You can also search for this author in PubMed Google Scholar
Corresponding author
Correspondence to Stefan Hunziker .
Rights and permissions
Reprints and permissions
Copyright information
© 2024 Springer Fachmedien Wiesbaden GmbH, part of Springer Nature
About this chapter
Hunziker, S., Blankenagel, M. (2024). Multiple Case Research Design. In: Research Design in Business and Management. Springer Gabler, Wiesbaden. https://doi.org/10.1007/978-3-658-42739-9_9
Download citation
DOI : https://doi.org/10.1007/978-3-658-42739-9_9
Published : 04 January 2024
Publisher Name : Springer Gabler, Wiesbaden
Print ISBN : 978-3-658-42738-2
Online ISBN : 978-3-658-42739-9
eBook Packages : Business and Management Business and Management (R0)
Share this chapter
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
- Publish with us
Policies and ethics
- Find a journal
- Track your research
An official website of the United States government
Official websites use .gov A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS A lock ( Lock Locked padlock icon ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.
- Publications
- Account settings
- Advanced Search
- Journal List
Single-Case Design, Analysis, and Quality Assessment for Intervention Research
Michele a lobo , pt, phd, mariola moeyaert , phd, andrea baraldi cunha , pt, phd, iryna babik , phd.
- Author information
- Copyright and License information
Correspondence regarding this article should be directed to: Michele A. Lobo, [email protected]
Background and Purpose
The purpose of this article is to describe single-case studies, and contrast them with case studies and randomized clinical trials. We will highlight current research designs, analysis techniques, and quality appraisal tools relevant for single-case rehabilitation research.
Summary of Key Points
Single-case studies can provide a viable alternative to large group studies such as randomized clinical trials. Single case studies involve repeated measures, and manipulation of and independent variable. They can be designed to have strong internal validity for assessing causal relationships between interventions and outcomes, and external validity for generalizability of results, particularly when the study designs incorporate replication, randomization, and multiple participants. Single case studies should not be confused with case studies/series (ie, case reports), which are reports of clinical management of one patient or a small series of patients.
Recommendations for Clinical Practice
When rigorously designed, single-case studies can be particularly useful experimental designs in a variety of situations, even when researcher resources are limited, studied conditions have low incidences, or when examining effects of novel or expensive interventions. Readers will be directed to examples from the published literature in which these techniques have been discussed, evaluated for quality, and implemented.
Keywords: n-of-one studies, single-subject research, research design, quality assessment
Introduction
The purpose of this article is to present current tools and techniques relevant for single-case rehabilitation research. Single-case (SC) studies have been identified by a variety of names, including “n of 1 studies” and “single-subject” studies. The term “single-case study” is preferred over the previously mentioned terms because previous terms suggest these studies include only one participant. In fact, as will be discussed below, for purposes of replication and improved generalizability, the strongest SC studies commonly include more than one participant.
A SC study should not be confused with a “case study/series “ (also called “case report”. In a typical case study/series, a single patient or small series of patients is involved, but there is not a purposeful manipulation of an independent variable, nor are there necessarily repeated measures. Most case studies/series are reported in a narrative way while results of SC studies are presented numerically or graphically. 1 , 2 This article defines SC studies, contrasts them with randomized clinical trials, discusses how they can be used to scientifically test hypotheses, and highlights current research designs, analysis techniques, and quality appraisal tools that may be useful for rehabilitation researchers.
In SC studies, measurements of outcome (dependent variables) are recorded repeatedly for individual participants across time and varying levels of an intervention (independent variables). 1 – 5 These varying levels of intervention are referred to as “phases” with one phase serving as a baseline or comparison, so each participant serves as his/her own control. 2 In contrast to case studies and case series in which participants are observed across time without experimental manipulation of the independent variable, SC studies employ systematic manipulation of the independent variable to allow for hypothesis testing. 1 , 6 As a result, SC studies allow for rigorous experimental evaluation of intervention effects and provide a strong basis for establishing causal inferences. Advances in design and analysis techniques for SC studies observed in recent decades have made SC studies increasingly popular in educational and psychological research. Yet, the authors believe SC studies have been undervalued in rehabilitation research, where randomized clinical trials (RCTs) are typically recommended as the optimal research design to answer questions related to interventions. 7 In reality, there are advantages and disadvantages to both SC studies and RCTs that should be carefully considered in order to select the best design to answer individual research questions. While there are a variety of other research designs that could be utilized in rehabilitation research, only SC studies and RCTs are discussed here because SC studies are the focus of this article and RCTs are the most highly recommended design for intervention studies. 7
When designed and conducted properly, RCTs offer strong evidence that changes in outcomes may be related to provision of an intervention. However, RCTs require monetary, time, and personnel resources that many researchers, especially those in clinical settings, may not have available. 8 RCTs also require access to large numbers of consenting participants that meet strict inclusion and exclusion criteria that can limit variability of the sample and generalizability of results. 9 The requirement for large participant numbers may make RCTs difficult to perform in many settings, such as rural and suburban settings, and for many populations, such as those with diagnoses marked by lower prevalence. 8 To rely exclusively on RCTs has the potential to result in bodies of research that are skewed to address the needs of some individuals while neglecting the needs of others. RCTs aim to include a large number of participants and to use random group assignment to create study groups that are similar to one another in terms of all potential confounding variables, but it is challenging to identify all confounding variables. Finally, the results of RCTs are typically presented in terms of group means and standard deviations that may not represent true performance of any one participant. 10 This can present as a challenge for clinicians aiming to translate and implement these group findings at the level of the individual.
SC studies can provide a scientifically rigorous alternative to RCTs for experimentally determining the effectiveness of interventions. 1 , 2 SC studies can assess a variety of research questions, settings, cases, independent variables, and outcomes. 11 There are many benefits to SC studies that make them appealing for intervention research. SC studies may require fewer resources than RCTs and can be performed in settings and with populations that do not allow for large numbers of participants. 1 , 2 In SC studies, each participant serves as his/her own comparison, thus controlling for many confounding variables that can impact outcome in rehabilitation research, such as gender, age, socioeconomic level, cognition, home environment, and concurrent interventions. 2 , 11 Results can be analyzed and presented to determine whether interventions resulted in changes at the level of the individual, the level at which rehabilitation professionals intervene. 2 , 12 When properly designed and executed, SC studies can demonstrate strong internal validity to determine the likelihood of a causal relationship between the intervention and outcomes and external validity to generalize the findings to broader settings and populations. 2 , 12 , 13
Single Case Research Designs for Intervention Research
There are a variety of SC designs that can be used to study the effectiveness of interventions. Here we discuss: 1) AB designs, 2) reversal designs, 3) multiple baseline designs, and 4) alternating treatment designs, as well as ways replication and randomization techniques can be used to improve internal validity of all of these designs. 1 – 3 , 12 – 14
The simplest of these designs is the AB Design 15 ( Figure 1 ). This design involves repeated measurement of outcome variables throughout a baseline control/comparison phase (A ) and then throughout an intervention phase (B). When possible, it is recommended that a stable level and/or rate of change in performance be observed within the baseline phase before transitioning into the intervention phase. 2 As with all SC designs, it is also recommended that there be a minimum of five data points in each phase. 1 , 2 There is no randomization or replication of the baseline or intervention phases in the basic AB design. 2 Therefore, AB designs have problems with internal validity and generalizability of results. 12 They are weak in establishing causality because changes in outcome variables could be related to a variety of other factors, including maturation, experience, learning, and practice effects. 2 , 12 Sample data from a single case AB study performed to assess the impact of Floor Play intervention on social interaction and communication skills for a child with autism 15 are shown in Figure 1 .
An example of results from a single-case AB study conducted on one participant with autism; two weeks of observation (baseline phase A) were followed by seven weeks of Floor Time Play (intervention phase B). The outcome measure Circles of Communications (reciprocal communication with two participants responding to each other verbally or nonverbally) served as a behavioral indicator of the child’s social interaction and communication skills (higher scores indicating better performance). A statistically significant improvement in Circles of Communication was found during the intervention phase as compared to the baseline. Note that although a stable baseline is recommended for SC studies, it is not always possible to satisfy this requirement, as you will see in Figures 1 – 4 . Data were extracted from Dionne and Martini (2011) 15 utilizing Rohatgi’s WebPlotDigitizer software. 78
If an intervention does not have carry-over effects, it is recommended to use a Reversal Design . 2 For example, a reversal A 1 BA 2 design 16 ( Figure 2 ) includes alternation of the baseline and intervention phases, whereas a reversal A 1 B 1 A 2 B 2 design 17 ( Figure 3 ) consists of alternation of two baseline (A 1 , A 2 ) and two intervention (B 1 , B 2 ) phases. Incorporating at least four phases in the reversal design (i.e., A 1 B 1 A 2 B 2 or A 1 B 1 A 2 B 2 A 3 B 3 …) allows for a stronger determination of a causal relationship between the intervention and outcome variables, because the relationship can be demonstrated across at least three different points in time – change in outcome from A 1 to B 1 , from B 1 to A 2 , and from A 2 to B 2 . 18 Before using this design, however, researchers must determine that it is safe and ethical to withdraw the intervention, especially in cases where the intervention is effective and necessary. 12
An example of results from a single-case A 1 BA 2 study conducted on eight participants with stable multiple sclerosis (data on three participants were used for this example). Four weeks of observation (baseline phase A 1 ) were followed by eight weeks of core stability training (intervention phase B), then another four weeks of observation (baseline phase A 2 ). Forward functional reach test (the maximal distance the participant can reach forward or lateral beyond arm’s length, maintaining a fixed base of support in the standing position; higher scores indicating better performance) significantly improved during intervention for Participants 1 and 3 without further improvement observed following withdrawal of the intervention (during baseline phase A 2 ). Data were extracted from Freeman et al. (2010) 16 utilizing Rohatgi’s WebPlotDigitizer software. 78
An example of results from a single-case A 1 B 1 A 2 B 2 study conducted on two participants with severe unilateral neglect after a right-hemisphere stroke. Two weeks of conventional treatment (baseline phases A 1, A 2 ) alternated with two weeks of visuo-spatio-motor cueing (intervention phases B 1 , B 2 ). Performance was assessed in two tests of lateral neglect, the Bells Cancellation Test (Figure A; lower scores indicating better performance) and the Line Bisection Test (Figure B; higher scores indicating better performance). There was a statistically significant intervention-related improvement in participants’ performance on the Line Bisection Test, but not on the Bells Test. Data were extracted from Samuel at al. (2000) 17 utilizing Rohatgi’s WebPlotDigitizer software. 78
A recent study used an ABA reversal SC study to determine the effectiveness of core stability training in 8 participants with multiple sclerosis. 16 During the first four weekly data collections, the researchers ensured a stable baseline, which was followed by eight weekly intervention data points, and concluded with four weekly withdrawal data points. Intervention significantly improved participants’ walking and reaching performance ( Figure 2 ). 16 This A 1 BA 2 design could have been strengthened by the addition of a second intervention phase for replication (A 1 B 1 A 2 B 2 ). For instance, a single-case A 1 B 1 A 2 B 2 withdrawal design aimed to assess the efficacy of rehabilitation using visuo-spatio-motor cueing for two participants with severe unilateral neglect after a severe right-hemisphere stroke. 17 Each phase included 8 data points. Statistically significant intervention-related improvement was observed, suggesting that visuo-spatio-motor cueing might be promising for treating individuals with very severe neglect ( Figure 3 ). 17
The reversal design can also incorporate a cross over design where each participant experiences more than one type of intervention. For instance, a B 1 C 1 B 2 C 2 design could be used to study the effects of two different interventions (B and C) on outcome measures. Challenges with including more than one intervention involve potential carry-over effects from earlier interventions and order effects that may impact the measured effectiveness of the interventions. 2 , 12 Including multiple participants and randomizing the order of intervention phase presentations are tools to help control for these types of effects. 19
When an intervention permanently changes an individual’s ability, a return to baseline performance is not feasible and reversal designs are not appropriate. Multiple Baseline Designs (MBDs) are useful in these situations ( Figure 4 ). 20 MBDs feature staggered introduction of the intervention across time: each participant is randomly assigned to one of at least 3 experimental conditions characterized by the length of the baseline phase. 21 These studies involve more than one participant, thus functioning as SC studies with replication across participants. Staggered introduction of the intervention allows for separation of intervention effects from those of maturation, experience, learning, and practice. For example, a multiple baseline SC study was used to investigate the effect of an anti-spasticity baclofen medication on stiffness in five adult males with spinal cord injury. 20 The subjects were randomly assigned to receive 5–9 baseline data points with a placebo treatment prior to the initiation of the intervention phase with the medication. Both participants and assessors were blind to the experimental condition. The results suggested that baclofen might not be a universal treatment choice for all individuals with spasticity resulting from a traumatic spinal cord injury ( Figure 4 ). 20
An example of results from a single-case multiple baseline study conducted on five participants with spasticity due to traumatic spinal cord injury. Total duration of data collection was nine weeks. The first participant was switched from placebo treatment (baseline) to baclofen treatment (intervention) after five data collection sessions, whereas each consecutive participant was switched to baclofen intervention at the subsequent sessions through the ninth session. There was no statistically significant effect of baclofen on viscous stiffness at the ankle joint. Data were extracted from Hinderer at al. (1990) 20 utilizing Rohatgi’s WebPlotDigitizer software. 78
The impact of two or more interventions can also be assessed via Alternating Treatment Designs (ATDs) . In ATDs, after establishing the baseline, the experimenter exposes subjects to different intervention conditions administered in close proximity for equal intervals ( Figure 5 ). 22 ATDs are prone to “carry-over effects” when the effects of one intervention influence the observed outcomes of another intervention. 1 As a result, such designs introduce unique challenges when attempting to determine the effects of any one intervention and have been less commonly utilized in rehabilitation. An ATD was used to monitor disruptive behaviors in the school setting throughout a baseline followed by an alternating treatment phase with randomized presentation of a control condition or an exercise condition. 23 Results showed that 30 minutes of moderate to intense physical activity decreased behavioral disruptions through 90 minutes after the intervention. 23 An ATD was also used to compare the effects of commercially available and custom-made video prompts on the performance of multi-step cooking tasks in four participants with autism. 22 Results showed that participants independently performed more steps with the custom-made video prompts ( Figure 5 ). 22
An example of results from a single case alternating treatment study conducted on four participants with autism (data on two participants were used for this example). After the observation phase (baseline), effects of commercially available and custom-made video prompts on the performance of multi-step cooking tasks were identified (treatment phase), after which only the best treatment was used (best treatment phase). Custom-made video prompts were most effective for improving participants’ performance of multi-step cooking tasks. Data were extracted from Mechling at al. (2013) 22 utilizing Rohatgi’s WebPlotDigitizer software. 78
Regardless of the SC study design, replication and randomization should be incorporated when possible to improve internal and external validity. 11 The reversal design is an example of replication across study phases. The minimum number of phase replications needed to meet quality standards is three (A 1 B 1 A 2 B 2 ), but having four or more replications is highly recommended (A 1 B 1 A 2 B 2 A 3 …). 11 , 14 In cases when interventions aim to produce lasting changes in participants’ abilities, replication of findings may be demonstrated by replicating intervention effects across multiple participants (as in multiple-participant AB designs), or across multiple settings, tasks, or service providers. When the results of an intervention are replicated across multiple reversals, participants, and/or contexts, there is an increased likelihood a causal relationship exists between the intervention and the outcome. 2 , 12
Randomization should be incorporated in SC studies to improve internal validity and the ability to assess for causal relationships among interventions and outcomes. 11 In contrast to traditional group designs, SC studies often do not have multiple participants or units that can be randomly assigned to different intervention conditions. Instead, in randomized phase-order designs , the sequence of phases is randomized. Simple or block randomization is possible. For example, with simple randomization for an A 1 B 1 A 2 B 2 design, the A and B conditions are treated as separate units and are randomly assigned to be administered for each of the pre-defined data collection points. As a result, any combination of A-B sequences is possible without restrictions on the number of times each condition is administered or regard for repetitions of conditions (e.g., A 1 B 1 B 2 A 2 B 3 B 4 B 5 A 3 B 6 A 4 A 5 A 6 ). With block randomization for an A 1 B 1 A 2 B 2 design, two conditions (e.g., A and B) would be blocked into a single unit (AB or BA), randomization of which to different time periods would ensure that each condition appears in the resulting sequence more than two times (e.g., A 1 B 1 B 2 A 2 A 3 B 3 A 4 B 4 ). Note that AB and reversal designs require that the baseline (A) always precedes the first intervention (B), which should be accounted for in the randomization scheme. 2 , 11
In randomized phase start-point designs , the lengths of the A and B phases can be randomized. 2 , 11 , 24 – 26 For example, for an AB design, researchers could specify the number of time points at which outcome data will be collected, (e.g., 20), define the minimum number of data points desired in each phase (e.g., 4 for A, 3 for B), and then randomize the initiation of the intervention so that it occurs anywhere between the remaining time points (points 5 and 17 in the current example). 27 , 28 For multiple-baseline designs, a dual-randomization, or “regulated randomization” procedure has been recommended. 29 If multiple-baseline randomization depends solely on chance, it could be the case that all units are assigned to begin intervention at points not really separated in time. 30 Such randomly selected initiation of the intervention would result in the drastic reduction of the discriminant and internal validity of the study. 29 To eliminate this issue, investigators should first specify appropriate intervals between the start points for different units, then randomly select from those intervals, and finally randomly assign each unit to a start point. 29
Single Case Analysis Techniques for Intervention Research
The What Works Clearinghouse (WWC) single-case design technical documentation provides an excellent overview of appropriate SC study analysis techniques to evaluate the effectiveness of intervention effects. 1 , 18 First, visual analyses are recommended to determine whether there is a functional relation between the intervention and the outcome. Second, if evidence for a functional effect is present, the visual analysis is supplemented with quantitative analysis methods evaluating the magnitude of the intervention effect. Third, effect sizes are combined across cases to estimate overall average intervention effects which contributes to evidence-based practice, theory, and future applications. 2 , 18
Visual Analysis
Traditionally, SC study data are presented graphically. When more than one participant engages in a study, a spaghetti plot showing all of their data in the same figure can be helpful for visualization. Visual analysis of graphed data has been the traditional method for evaluating treatment effects in SC research. 1 , 12 , 31 , 32 The visual analysis involves evaluating level, trend, and stability of the data within each phase (i.e., within-phase data examination) followed by examination of the immediacy of effect, consistency of data patterns, and overlap of data between baseline and intervention phases (i.e., between-phase comparisons). When the changes (and/or variability) in level are in the desired direction, are immediate, readily discernible, and maintained over time, it is concluded that the changes in behavior across phases result from the implemented treatment and are indicative of improvement. 33 Three demonstrations of an intervention effect are necessary for establishing a functional relation. 1
Within-phase examination
Level, trend, and stability of the data within each phase are evaluated. Mean and/or median can be used to report the level, and trend can be evaluated by determining whether the data points are monotonically increasing or decreasing. Within-phase stability can be evaluated by calculating the percentage of data points within 15% of the phase median (or mean). The stability criterion is satisfied if about 85% (80% – 90%) of the data in a phase fall within a 15% range of the median (or average) of all data points for that phase. 34
Between-phase examination
Immediacy of effect, consistency of data patterns, and overlap of data between baseline and intervention phases are evaluated next. For this, several nonoverlap indices have been proposed that all quantify the proportion of measurements in the intervention phase not overlapping with the baseline measurements. 35 Nonoverlap statistics are typically scaled as percent from 0 to 100, or as a proportion from 0 to 1. Here, we briefly discuss the Nonoverlap of All Pairs ( NAP ), 36 the Extended Celeration Line ( ECL ), the Improvement Rate Difference ( IRD) , 37 and the TauU and the TauU-adjusted, TauU adj , 35 as these are the most recent and complete techniques. We also examine the Percentage of Nonoverlapping Data ( PND ) 38 and the Two Standard Deviations Band Method, as these are frequently used techniques. In addition, we include the Percentage of Nonoverlapping Corrected Data ( PNCD ) – an index applying to the PND after controlling for baseline trend. 39
Nonoverlap of all pairs (NAP)
Each baseline observation can be paired with each intervention phase observation to make n pairs (i.e., N = n A * n B ). Count the number of overlapping pairs, n o , counting all ties as 0.5. Then define the percent of the pairs that show no overlap. Alternatively, one can count the number of positive (P), negative (N), and tied (T) pairs 2 , 36 :
Extended Celeration Line (ECL)
ECL or split middle line allows control for a positive Phase A trend. Nonoverlap is defined as the proportion of Phase B ( n b ) data that are above the median trend plotted from Phase A data ( n B< sub > Above Median trend A </ sub > ), but then extended into Phase B: ECL = n B Above Median trend A n b ∗ 100
As a consequence, this method depends on a straight line and makes an assumption of linearity in the baseline. 2 , 12
Improvement rate difference (IRD)
This analysis is conceptualized as the difference in improvement rates (IR) between baseline ( IR B ) and intervention phases ( IR T ). 38 The IR for each phase is defined as the number of “improved data points” divided by the total data points in that phase. IRD, commonly employed in medical group research under the name of “risk reduction” or “risk difference” attempts to provide an intuitive interpretation for nonoverlap and to make use of an established, respected effect size, IR B - IR B , or the difference between two proportions. 37
TauU and TauU adj
Each baseline observation can be paired with each intervention phase observation to make n pairs (i.e., n = n A * n B ). Count the number of positive (P), negative (N), and tied (T) pairs, and use the following formula: TauU = P - N P + N + τ
The TauU adj is an adjustment of TauU for monotonic trend in baseline. Each baseline observation can be paired with each intervention phase observation to make n pairs (i.e., n = n A * n B ). Each baseline observation can be paired with all later baseline observations (n A *(n A -1)/2). 2 , 35 Then the baseline trend can be computed: TauU adf = P - N - S trend P + N + τ ; S trend = P A – NA
Online calculators might assist researchers in obtaining the TauU and TauU adjusted coefficients ( http://www.singlecaseresearch.org/calculators/tau-u ).
Percentage of nonoverlapping data (PND)
If anticipating an increase in the outcome, locate the highest data point in the baseline phase and then calculate the percent of the intervention phase data points that exceed it. If anticipating a decrease in the outcome, find the lowest data point in the baseline phase and then calculate the percent of the treatment phase data points that are below it: PND = n B Overlap A n b ∗ 100 . A PND < 50 would mark no observed effect, PND = 50–70 signifies a questionable effect, and PND > 70 suggests the intervention was effective. 40 The percentage of nonoverlapping (PNDC) corrected was proposed in 2009 as an extension of the PND. 39 Prior to applying the PND, a data correction procedure is applied eliminating pre-existing baseline trend. 38
Two Standard Deviation Band Method
When the stability criterion described above is met within phases, it is possible to apply the two standard deviation band method. 12 , 41 First, the mean of the data for a specific condition is calculated and represented with a solid line. In the next step, the standard deviation of the same data is computed and two dashed lines are represented: one located two standard deviations above the mean and the other – two standard deviations below. For normally distributed data, few points (less than 5%) are expected to be outside the two standard deviation bands if there is no change in the outcome score due to the intervention. However, this method is not considered a formal statistical procedure, as the data cannot typically be assumed to be normal, continuous, or independent. 41
Statistical Analysis
If the visual analysis indicates a functional relationship (i.e., three demonstrations of the effectiveness of the intervention effect), it is recommended to proceed with the quantitative analyses, reflecting the magnitude of the intervention effect. First, effect sizes are calculated for each participant (individual-level analysis). Moreover, if the research interest lies in the generalizability of the effect size across participants, effect sizes can be combined across cases to achieve an overall average effect size estimate (across-case effect size).
Note that quantitative analysis methods are still being developed in the domain of SC research 1 and statistical challenges of producing an acceptable measure of treatment effect remain. 14 , 42 , 43 Therefore, the WWC standards strongly recommend conducting sensitivity analysis and reporting multiple effect size estimators. If consistency across different effect size estimators is identified, there is stronger evidence for the effectiveness of the treatment. 1 , 18
Individual-level effect size analysis
The most common effect sizes recommended for SC analysis are: 1) standardized mean difference Cohen’s d ; 2) standardized mean difference with correction for small sample sizes Hedges’ g ; and 3) the regression-based approach which has the most potential and is strongly recommended by the WWC standards. 1 , 44 , 45 Cohen’s d can be calculated using following formula: d = X A ¯ - X B ¯ s p , with X A ¯ being the baseline mean, X B ¯ being the treatment mean, and s p indicating the pooled within-case standard deviation. Hedges’ g is an extension of Cohen’s d , recommended in the context of SC studies as it corrects for small sample sizes. The piecewise regression-based approach does not only reflect the immediate intervention effect, but also the intervention effect across time:
i stands for the measurement occasion ( i = 0, 1,… I ). The dependent variable is regressed on a time indicator, T , which is centered around the first observation of the intervention phase, D , a dummy variable for the intervention phase, and an interaction term of these variables. The equation shows that the expected score, Ŷ i , equals β 0 + β 1 T i in the baseline phase, and ( β 0 + β 2 ) + ( β 1 + β 3 ) T i in the intervention phase. β 0 , therefore, indicates the expected baseline level at the start of the intervention phase (when T = 0), whereas β 1 marks the linear time trend in the baseline scores. The coefficient β 2 can then be interpreted as an immediate effect of the intervention on the outcome, whereas β 3 signifies the effect of the intervention across time. The e i ’s are residuals assumed to be normally distributed around a mean of zero with a variance of σ e 2 . The assumption of independence of errors is usually not met in the context of SC studies because repeated measures are obtained within a person. As a consequence, it can be the case that the residuals are autocorrelated, meaning that errors closer in time are more related to each other compared to errors further away in time. 46 – 48 As a consequence, a lag-1 autocorrelation is appropriate (taking into account the correlation between two consecutive errors: e i and e i –1 ; for more details see Verbeke & Molenberghs, (2000). 49 In Equation 1 , ρ indicates the autocorrelation parameter. If ρ is positive, the errors closer in time are more similar; if ρ is negative, the errors closer in time are more different, and if ρ equals zero, there is no correlation between the errors.
Across-case effect sizes
Two-level modeling to estimate the intervention effects across cases can be used to evaluate across-case effect sizes. 44 , 45 , 50 Multilevel modeling is recommended by the WWC standards because it takes the hierarchical nature of SC studies into account: measurements are nested within cases and cases, in turn, are nested within studies. By conducting a multilevel analysis, important research questions can be addressed (which cannot be answered by single-level analysis of SC study data), such as: 1) What is the magnitude of the average treatment effect across cases? 2) What is the magnitude and direction of the case-specific intervention effect? 3) How much does the treatment effect vary within cases and across cases? 4) Does a case and/or study level predictor influence the treatment’s effect? The two-level model has been validated in previous research using extensive simulation studies. 45 , 46 , 51 The two-level model appears to have sufficient power (> .80) to detect large treatment effects in at least six participants with six measurements. 21
Furthermore, to estimate the across-case effect sizes, the HPS (Hedges, Pustejovsky, and Shadish) , or single-case educational design ( SCEdD)-specific mean difference, index can be calculated. 52 This is a standardized mean difference index specifically designed for SCEdD data, with the aim of making it comparable to Cohen’s d of group-comparison designs. The standard deviation takes into account both within-participant and between-participant variability, and is typically used to get an across-case estimator for a standardized change in level. The advantage of using the HPS across-case effect size estimator is that it is directly comparable with Cohen’s d for group comparison research, thus enabling the use of Cohen’s (1988) benchmarks. 53
Valuable recommendations on SC data analyses have recently been provided. 54 , 55 They suggest that a specific SC study data analytic technique can be chosen based on: (1) the study aims and the desired quantification (e.g., overall quantification, between-phase quantifications, randomization, etc.), (2) the data characteristics as assessed by visual inspection and the assumptions one is willing to make about the data, and (3) the knowledge and computational resources. 54 , 55 Table 1 lists recommended readings and some commonly used resources related to the design and analysis of single-case studies.
Recommend readings and resources related to the design and analysis of single-case studies.
Quality Appraisal Tools for Single-Case Design Research
Quality appraisal tools are important to guide researchers in designing strong experiments and conducting high-quality systematic reviews of the literature. Unfortunately, quality assessment tools for SC studies are relatively novel, ratings across tools demonstrate variability, and there is currently no “gold standard” tool. 56 Table 2 lists important SC study quality appraisal criteria compiled from the most common scales; when planning studies or reviewing the literature, we recommend readers consider these criteria. Table 3 lists some commonly used SC quality assessment and reporting tools and references to resources where the tools can be located.
Summary of important single-case study quality appraisal criteria.
Quality assessment and reporting tools related to single-case studies.
When an established tool is required for systematic review, we recommend use of the What Works Clearinghouse (WWC) Tool because it has well-defined criteria and is developed and supported by leading experts in the SC research field in association with the Institute of Education Sciences. 18 The WWC documentation provides clear standards and procedures to evaluate the quality of SC research; it assesses the internal validity of SC studies, classifying them as “Meeting Standards”, “Meeting Standards with Reservations”, or “Not Meeting Standards”. 1 , 18 Only studies classified in the first two categories are recommended for further visual analysis. Also, WWC evaluates the evidence of effect, classifying studies into “Strong Evidence of a Causal Relation”, “Moderate Evidence of a Causal Relation”, or “No Evidence of a Causal Relation”. Effect size should only be calculated for studies providing strong or moderate evidence of a causal relation.
The Single-Case Reporting Guideline In BEhavioural Interventions (SCRIBE) 2016 is another useful SC research tool developed recently to improve the quality of single-case designs. 57 SCRIBE consists of a 26-item checklist that researchers need to address while reporting the results of SC studies. This practical checklist allows for critical evaluation of SC studies during study planning, manuscript preparation, and review.
Single-case studies can be designed and analyzed in a rigorous manner that allows researchers strength in assessing causal relationships among interventions and outcomes, and in generalizing their results. 2 , 12 These studies can be strengthened via incorporating replication of findings across multiple study phases, participants, settings, or contexts, and by using randomization of conditions or phase lengths. 11 There are a variety of tools that can allow researchers to objectively analyze findings from SC studies. 56 While a variety of quality assessment tools exist for SC studies, they can be difficult to locate and utilize without experience, and different tools can provide variable results. The WWC quality assessment tool is recommended for those aiming to systematically review SC studies. 1 , 18
SC studies, like all types of study designs, have a variety of limitations. First, it can be challenging to collect at least five data points in a given study phase. This may be especially true when traveling for data collection is difficult for participants, or during the baseline phase when delaying intervention may not be safe or ethical. Power in SC studies is related to the number of data points gathered for each participant so it is important to avoid having a limited number of data points. 12 , 58 Second, SC studies are not always designed in a rigorous manner and, thus, may have poor internal validity. This limitation can be overcome by addressing key characteristics that strengthen SC designs ( Table 2 ). 1 , 14 , 18 Third, SC studies may have poor generalizability. This limitation can be overcome by including a greater number of participants, or units. Fourth, SC studies may require consultation from expert methodologists and statisticians to ensure proper study design and data analysis, especially to manage issues like autocorrelation and variability of data. 2 Fifth, while it is recommended to achieve a stable level and rate of performance throughout the baseline, human performance is quite variable and can make this requirement challenging. Finally, the most important validity threat to SC studies is maturation. This challenge must be considered during the design process in order to strengthen SC studies. 1 , 2 , 12 , 58
SC studies can be particularly useful for rehabilitation research. They allow researchers to closely track and report change at the level of the individual. They may require fewer resources and, thus, can allow for high-quality experimental research, even in clinical settings. Furthermore, they provide a tool for assessing causal relationships in populations and settings where large numbers of participants are not accessible. For all of these reasons, SC studies can serve as an effective method for assessing the impact of interventions.
Acknowledgments
This research was supported by the National Institute of Health, Eunice Kennedy Shriver National Institute of Child Health & Human Development (1R21HD076092-01A1, Lobo PI) and the Delaware Economic Development Office (Grant #109).
Some of the information in this manuscript was presented at the IV Step Meeting in Columbus, OH, June 2016.
- 1. Kratochwill TR, Hitchcock J, Horner RH, Levin JR, Odom SL, Rindskopf DM, Shadish WR. Single case designs technical documentation. What Works Clearinghouse: Procedures and standards handbook. 2010 Retrieved from What Works Clearinghouse website: http://files.eric.ed.gov/fulltext/ED510743.pdf .
- 2. Kratochwill TR, Levin JR, editors. Single-case intervention research: Methodological and statistical advances. Washington, DC: American Psychological Association; 2014. [ Google Scholar ]
- 3. Barlow DH, Nock MK, Hersen M. Single case experimental designs: Strategies for studying behavior change. 3. Boston, MA: Allyn & Bacon; 2008. [ Google Scholar ]
- 4. Kazdin AE. Single-case research designs: Methods for clinical and applied settings. 2. New York, NY: Oxford University Press; 2010. [ Google Scholar ]
- 5. Onghena P. Single-case designs. In: Howell BED, editor. Encyclopedia of statistics in behavioral science. Vol. 4. Chichester: Wiley; 2005. pp. 1850–1854. [ Google Scholar ]
- 6. Tate RL, McDonald S, Perdices M, Togher L, Schultz R, Savage S. Rating the methodological quality of single-subject designs and n-of-1 trials: introducing the Single-Case Experimental Design (SCED) Scale. Neuropsychol Rehabil. 2008;18(4):385–401. doi: 10.1080/09602010802009201. [ DOI ] [ PubMed ] [ Google Scholar ]
- 7. Jewell DV. Guide to Evidence-Based PT Practice. 3. Burlington, MA: Jones & Bartlett Learning; 2014. [ Google Scholar ]
- 8. Sanson-Fisher RW, Bonevski B, Green LW, D’Este C. Limitations of the randomized controlled trial in evaluating population-based health interventions. Am J Prev Med. 2007;33(2):155–161. doi: 10.1016/j.amepre.2007.04.007. [ DOI ] [ PubMed ] [ Google Scholar ]
- 9. Cartwright N, Munro E. The limitations of randomized controlled trials in predicting effectiveness. J Eval Clin Pract. 2010;16(2):260–266. doi: 10.1111/j.1365-2753.2010.01382.x. [ DOI ] [ PubMed ] [ Google Scholar ]
- 10. Lefkowitz W, Jefferson TC. Medicine at the limits of evidence: the fundamental limitation of the randomized clinical trial and the end of equipoise. J Perinatol. 2014;34(4):249–251. doi: 10.1038/jp.2013.172. [ DOI ] [ PubMed ] [ Google Scholar ]
- 11. Kratochwill TR, Levin JR. Enhancing the Scientific Credibility of Single-Case Intervention Research: Randomization to the Rescue. Psychol Methods. 2010;15(2):124–144. doi: 10.1037/a0017736. [ DOI ] [ PubMed ] [ Google Scholar ]
- 12. Portney LG, Watkins MP. Foundations of Clinical Research: Applications to Practice. Philadelphia, PA: F. A. Davis Company; 2015. [ Google Scholar ]
- 13. Kratochwill TR, Levin JR. Single-case research design and analysis. Hillsdale, NJ: Lawrence Erlbaum Associates; 1992. [ Google Scholar ]
- 14. Horner RH, Carr EG, Halle J, McGee G, Odom S, Wolery M. The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education. Except Children. 2005;71(2):165–179. [ Google Scholar ]
- 15. Dionne M, Martini R. Floor Time Play with a child with autism: A single subject study. Can J Occup Ther Ther. 2011;78(3):196–203. doi: 10.2182/cjot.2011.78.3.8. [ DOI ] [ PubMed ] [ Google Scholar ]
- 16. Freeman JA, Gear M, Pauli A, Cowan P, Finnigan C, Hunter H, Mobberley C, … Thain J. The effect of core stability training on balance and mobility in ambulant individuals with multiple sclerosis: a multi-centre series of single case studies. Mult Scler. 2010;16(11):1377–1384. doi: 10.1177/1352458510378126. [ DOI ] [ PubMed ] [ Google Scholar ]
- 17. Samuel C, Louis-Dreyfus A, Kaschel R, Makiela E, Troubat M, Anselmi N, Cannizzo V, Azouvi P. Rehabilitation of very severe unilateral neglect by visuo-spatio-motor cueing: Two single case studies. Neuropsychol Rehabil. 2000;10(4):385–399. [ Google Scholar ]
- 18. Clearinghouse WW. What Works Clearinghouse: Procedures and Standards Handbook. Version 3.0:1–91. [ Google Scholar ]
- 19. Wellek S, Blettner M. On the Proper Use of the Crossover Design in Clinical Trials: Part 18 of a Series on Evaluation of Scientific Publications. Dtsch Arztebl Int. 2012;109(15):276–281. doi: 10.3238/arztebl.2012.0276. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 20. Hinderer SR, Lehmann JF, Price R, White O, deLateur BJ, Deitz J. Spasticity in spinal cord injured persons: quantitative effects of baclofen and placebo treatments. Am J Phys Med Rehab. 1990;69(6):311–317. doi: 10.1097/00002060-199012000-00007. [ DOI ] [ PubMed ] [ Google Scholar ]
- 21. Ferron JM, Moeyaert M, Van den Noortgate NW, Beretvas SN. Estimating causal effects from multiple-baseline studies: implications for design and analysis. Psychol Methods. 2014;19(4):493–510. doi: 10.1037/a0037038. [ DOI ] [ PubMed ] [ Google Scholar ]
- 22. Mechling LC, Ayres KM, Foster AL, Bryant KJ. Comparing the Effects of Commercially Available and Custom-Made Video Prompting for Teaching Cooking Skills to High School Students With Autism. Rem Spec Educ. 2013;34(6):371–383. [ Google Scholar ]
- 23. Folino A, Ducharme JM, Greenwald N. Temporal effects of antecedent exercise on students’ disruptive behaviors: An exploratory study. J School Psychol. 2014;52(5):447–462. doi: 10.1016/j.jsp.2014.07.002. [ DOI ] [ PubMed ] [ Google Scholar ]
- 24. Edgington ES, Onghena P. Randomization tests. Boca Raton, FL: Chapman & Hall/CRC; 2007. [ Google Scholar ]
- 25. Onghena P, Edgington ES. Customization of pain treatments: Single-case design and analysis. Clin J Pain. 2005;21:56–68. doi: 10.1097/00002508-200501000-00007. [ DOI ] [ PubMed ] [ Google Scholar ]
- 26. Todman JB, Dugard P. Single-case and small-n experimental designs: A practical guide to randomization tests. Mahwah, NJ: Erlbaum; 2001. [ Google Scholar ]
- 27. Edgington ES. Randomization tests for one-subject operant experiments. J Psychol. 1975;90(1):57–68. [ Google Scholar ]
- 28. Edgington ES. Single-case research design and analysis. Hillsdale, NJ: Erlbaum; 1992. Nonparametric tests for single-case experiments. [ Google Scholar ]
- 29. Koehler MJ, Levin JR. Regulated Randomization: A Potentially Sharper Analytical Tool for the Multiple-Baseline Design. Psychol Methods. 1998;3(2):206–217. [ Google Scholar ]
- 30. Marascuilo LA, Busk PL. Combining statistics for multiple-baseline AB and replicated ABAB designs across subjects. Behav Assess. 1988;10:1–28. [ Google Scholar ]
- 31. Ferron J, Jones PK. Tests for the Visual Analysis of Response-Guided Multiple-Baseline Data. J Exp Educ. 2006;75(1):66–81. [ Google Scholar ]
- 32. Horner RH, Swaminathan H, Sugai G, Smolkowski K. Considerations for the Systematic Analysis and Use of Single-Case Research. Educ Treat Children. 2012;35(2):269–290. [ Google Scholar ]
- 33. Busse RT, Kratochwill TR, Elliott SN. Meta-analysis for single-case consultation outcomes: Applications to research and practice. J School Psychol. 1995;33(4):269–285. [ Google Scholar ]
- 34. Neuman SB, McCormick S. Single-subject experimental research: Applications for literacy. Newark, DE: International Reading Association; 1995. [ Google Scholar ]
- 35. Parker RI, Vannest KJ, Davis JL. Effect size in single-case research: a review of nine nonoverlap techniques. Behav Modif. 2011;35(4):303–322. doi: 10.1177/0145445511399147. [ DOI ] [ PubMed ] [ Google Scholar ]
- 36. Parker RI, Vannest K. An Improved Effect Size for Single-Case Research: Nonoverlap of All Pairs. Behav Ther. 2009;40(4):357–367. doi: 10.1016/j.beth.2008.10.006. [ DOI ] [ PubMed ] [ Google Scholar ]
- 37. Parker RI, Vannest KJ, Brown L. The “Improvement Rate Difference” for Single-Case Research. Except Children. 2009;75(2):135–150. [ Google Scholar ]
- 38. Scruggs TE, Mastropieri MA. PND at 25: Past, present, and future trends in summarizing single subject research. Rem Spec Educ. 2013;34:9–19. [ Google Scholar ]
- 39. Manolo R, Solanas A. Percentage of nonoverlapping corrected data. Behav Res Meth. 2009;41:1262–1271. doi: 10.3758/BRM.41.4.1262. [ DOI ] [ PubMed ] [ Google Scholar ]
- 40. Scruggs TE, Mastropieri MA. Summarizing single-subject research: Issues and applications. Behav Modif. 1998;22:221–242. doi: 10.1177/01454455980223001. [ DOI ] [ PubMed ] [ Google Scholar ]
- 41. Callahan CD, Barisa MT. Statistical process control and rehabilitation outcome: the single-subject design reconsidered. Rehabil Psychol. 2005;50(1):24–33. [ Google Scholar ]
- 42. Beretvas SN, Chung H. A review of meta-analyses of single-subject experimental designs: Methodological issues and practice. Evid Based Commun Assess Interv. 2008;2(3):129–141. [ Google Scholar ]
- 43. Shadish WR, Rindskopf DM. Methods for evidence-based practice: Quantitative synthesis of single-subject designs. New Dir Eval. 2007;113:95–109. [ Google Scholar ]
- 44. Van den Noortgate DNW, Onghena P. Hierarchical linear models for the quantitative integration of effect sizes in single-case research. Behav Res Meth Instrum Comput. 2003;35(1):1–10. doi: 10.3758/bf03195492. [ DOI ] [ PubMed ] [ Google Scholar ]
- 45. Van den Noortgate W, Onghena P. Combining Single-Case Experimental Data Using Hierarchical Linear Models. Sch Psychol Q. 2003;18(3):325–346. [ Google Scholar ]
- 46. Ferron JM, Bell BA, Hess MR, Rendina-Gobioff G, Hibbard ST. Making treatment effect inferences from multiple-baseline data: The utility of multilevel modeling approaches. Behav Res Meth. 2009;41(2):372–384. doi: 10.3758/BRM.41.2.372. [ DOI ] [ PubMed ] [ Google Scholar ]
- 47. Huitema BE, McKean JW. Reduced Bias Autocorrelation Estimation: Three Jackknife Methods. Educ Psychol Meas. 1994;54(3):654–665. [ Google Scholar ]
- 48. McKnight SD, McKean JW, Huitema BE. A double bootstrap method to analyze linear models with autoregressive error terms. Psychol Methods. 2000;5(1):87–101. doi: 10.1037/1082-989x.5.1.87. [ DOI ] [ PubMed ] [ Google Scholar ]
- 49. Verbeke G, Molenberghs G. Linear mixed models for longitudinal data. New York,NY: Springer; 2000. [ Google Scholar ]
- 50. Van den Noortgate W, Onghena P. A multilevel meta-analysis of single-subject experimental design studies. Evid Based Commun Assess Interv. 2008;2(3):142–151. [ Google Scholar ]
- 51. Ferron JM, Farmer JL, Owens CM. Estimating individual treatment effects from multiple-baseline data: A Monte Carlo study of multilevel-modeling approaches. Behav Res Meth. 2010;42(4):930–943. doi: 10.3758/BRM.42.4.930. [ DOI ] [ PubMed ] [ Google Scholar ]
- 52. Hedges LV, Pustejovsky JE, Shadish WR. A standardized mean difference effect size for single case designs. Res Synth Methods. 2012;3(3):224–239. doi: 10.1002/jrsm.1052. [ DOI ] [ PubMed ] [ Google Scholar ]
- 53. Cohen J. Statistical power analysis for the behavioral sciences. United states of America: Lawrence Erlbauw Associates; 1988. [ Google Scholar ]
- 54. Manolov R, Moeyaert M. How Can Single-Case Data Be Analyzed? Software Resources, Tutorial, and Reflections on Analysis. Behav Modif. 2016 doi: 10.1177/0145445516664307. [ DOI ] [ PubMed ] [ Google Scholar ]
- 55. Manolov R, Moeyaert M. Recommendations for Choosing Single-Case Data Analytical Techniques. Behav Ther. 2016 doi: 10.1016/j.beth.2016.04.008. [ DOI ] [ PubMed ] [ Google Scholar ]
- 56. Wendt O, Miller B. Quality Appraisal of Single-Subject Experimental Designs: An Overview and Comparison of Different Appraisal Tools. Educ Treat Children. 2012;35(2):235–286. [ Google Scholar ]
- 57. Tate RL, Perdices M, Rosenkoetter U, McDonald S, Togher L, Shadish W, Horner R, … Vohra S. The Single-Case Reporting guideline In BEhavioural interventions (SCRIBE) 2016 statement. J School Psychol. 2016;56:133–142. doi: 10.1016/j.jsp.2016.04.001. [ DOI ] [ PubMed ] [ Google Scholar ]
- 58. Gast DL, Ledford JR. Single Case Research Methodology: Applications in Special Education and Behavioral Sciences. New York, NY: Routledge; 2014. [ Google Scholar ]
- 59. Feeney TJ, Ylvisaker M. Context-Sensitive Cognitive-Behavioral Supports for Young Children With TBI. J Posit Behav Interv. 2008;10(2):115–128. [ Google Scholar ]
- 60. Lin C-Y, Chang Y-M. Increase in physical activities in kindergarten children with cerebral palsy by employing MaKey–MaKey-based task systems. Res Dev Disabil. 2014;35:1963–1969. doi: 10.1016/j.ridd.2014.04.028. [ DOI ] [ PubMed ] [ Google Scholar ]
- 61. Lane-Brown A, Tate R. Evaluation of an Intervention for Apathy After Traumatic Brain Injury: A Multiple-Baseline, Single-Case Experimental Design. J Head Trauma Rehab. 2010;25(6):459–469. doi: 10.1097/HTR.0b013e3181d98e1d. [ DOI ] [ PubMed ] [ Google Scholar ]
- 62. Lieberman LJ, Dunn JM, van der Mars H, McCubbin J. Peer tutors’ effects on activity levels of deaf students in inclusive elementary physical education. Adapt Phys Act Q. 2000;17(1):20–39. [ Google Scholar ]
- 63. Lundblom EEG, Woods JJ. Working in the Classroom: Improving Idiom Comprehension Through Classwide Peer Tutoring. Commun Disord Q. 2012;33(4):202–219. [ Google Scholar ]
- 64. Banda DR, Hart SL, Liu-Gitz L. Impact of training peers and children with autism on social skills during center time activities in inclusive classrooms. Res Autism Spect Dis. 2010;4(4):619–625. [ Google Scholar ]
- 65. Oddo M, Barnett DW, Hawkins RO, Musti-Rao S. Reciprocal peer tutoring and repeated reading: Increasing practicality using student groups. Psychol Schools. 2010;47(8):842–858. [ Google Scholar ]
- 66. Peterson-Brown S, Karich AC, Symons FJ. Examining estimates of effect using non-overlap of all pairs in multiple baseline studies of academic intervention. J Behav Educ. 2012;21(3):203–216. [ Google Scholar ]
- 67. Chen M, Hyppa-Martin JK, Reichle JE, Symons FJ. Comparing Single Case Design Overlap-Based Effect Size Metrics From Studies Examining Speech Generating Device Interventions. Am J Intellect Dev Disabil. 2016;121(3):169–193. doi: 10.1352/1944-7558-121.3.169. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 68. Derakhshandeh F, Nikmaram M, Hosseinabad HH, et al. Speech characteristics after articulation therapy in children with cleft palate and velopharyngeal dysfunction - A single case experimental design. Int J Pediatr Otorhinolaryngol. 2016;86:104–113. doi: 10.1016/j.ijporl.2016.04.025. [ DOI ] [ PubMed ] [ Google Scholar ]
- 69. Klingbeil D, Moeyaert M, Archerm C, Chimnoza TM, Zwolski SA. Examining the efficacy of peer-mediated incremental rehearsal. School Psychol Rev. in press. [ Google Scholar ]
- 70. Saddler K, Saddler B, Moeyaert M, Ellis-Robinson T. Effects of a summarizing strategy on written summaries of children with emotional and behavioral disorders. Rem Spec Educ. 2016 [ Google Scholar ]
- 71. Ingersoll B, Wainer A. Initial Efficacy of Project ImPACT: A Parent-Mediated Social Communication Intervention for Young Children with ASD. J Autism Dev Disord. 2013;43(12):2943–2952. doi: 10.1007/s10803-013-1840-9. [ DOI ] [ PubMed ] [ Google Scholar ]
- 72. Wade CA, Ortiz C, Gorman BS. Two-session group parent training for bedtime noncompliance in head start preschoolers. Child Fam Behav Ther. 2007;29(3):23–55. [ Google Scholar ]
- 73. Hartman DP, Barrios BA, Wood DD. Principles of behavioral observation. In: Haynes SN, Hieby EM, editors. Comprehensive handbook of psychological assessment. Behavioral assessment. Vol. 3. New York, NY: Wiley; 2004. [ Google Scholar ]
- 74. Reichow B, Volkmar F, Cicchetti D. Development of the evaluative method for evaluating and determining evidence-based practices in autism. J Autism Dev Disord. 2008;38(7):1311–1319. doi: 10.1007/s10803-007-0517-7. [ DOI ] [ PubMed ] [ Google Scholar ]
- 75. Simeonsson R, Bailey D. IDMRB, editor. Early intervention studies for young children with special needs. London, England: Chapman & Hall; 1991. Evaluating programme impact: Levels of certainty; pp. 280–296. [ Google Scholar ]
- 76. Schlosser RW, Sigafoos J, Belfiore P. EVIDAAC comparative single-subject experimental design scale (CSSEDARS) 2009. [Accessed November 20, 2016]. [ Google Scholar ]
- 77. Logan LR, Hickman RR, Harris SR, Heriza CB. Single-subject research design: recommendations for levels of evidence and quality rating. Dev Med Child Neurol. 2008;50:99–103. doi: 10.1111/j.1469-8749.2007.02005.x. [ DOI ] [ PubMed ] [ Google Scholar ]
- 78. Rohatgi A. WebPlotDigitizer user manual version 3.4. 2014. [ Google Scholar ]
- View on publisher site
- PDF (756.1 KB)
- Collections
Similar articles
Cited by other articles, links to ncbi databases.
- Download .nbib .nbib
- Format: AMA APA MLA NLM
IMAGES
VIDEO
COMMENTS
3.1.1 Format of a case study. Except to identify the case and the specific type of a case study that shall be implemented, the researchers have to consider if it's wisely to make a single case study, or if it's better to do a multiple case study, for the understanding of the phenomenon.
This study attempts to answer when to write a single case study and when to write a multiple case study. It will further answer the benefits and disadvantages with the different types. The literature review, which is based on secondary sources, is about case studies. Then the literature review is discussed and analysed to reach a conclusion ...
The difference between the single- and multiple-case study is the research design; however, they are within the same methodological framework (Yin, 2017). Multiple cases are selected so that "individual case studies either (a) predict similar results (a literal replication) or (b) predict contrasting results but for anticipatable reasons (a ...
Single or Multiple Case Study Designs . Single Case . In addition to identifying the "case" and the specific "type" of case study to be . conducted, ...
A second step calls for deciding whether your case study will consist of a single or multiple cases—what then might be labeled as a single-or a multiple-case study. 1 Whether single or multiple, you also can choose to keep your case holistic or to have embedded subcases within an overall holistic case. The resulting two-by-two
The major advantage of multiple case research lies in cross-case analysis. A multiple case research design shifts the focus from understanding a single case to the differences and similarities between cases. Thus, it is not just conducting more (second, third, etc.) case studies. Rather, it is the next step in developing a theory about factors ...
Single case studies vs. multiple case studies: A comparative study. Platt, J. (1992). "Case study" in American methodological thought. Current sociology, 40 (1), 17-48.
J. Gustafsson science, evaluate programs and develop theories and involvements (Baxter & Jack, 2008). 3.1.1 Format of a case study Except to identify the case and the specific type of a case study that shall be implemented, the researchers have to consider if it's wisely to make a single case study, or if it's better to do a multiple case study, for the understanding of the phenomenon.
A multiple-case research design shifts the focus from understanding a single case to the differences and similarities between cases. Thus, it is more than just conducting another (second, third, etc.) case study. Instead, it is the next step in developing a theory about factors driving differences and similarities.
An example of results from a single-case A 1 BA 2 study conducted on eight participants with stable multiple sclerosis (data on three participants were used for this example). Four weeks of observation (baseline phase A 1) were followed by eight weeks of core stability training (intervention phase B), then another four weeks of observation (baseline phase A 2).