An Applied Guide to Research Designs Quantitative, Qualitative, and Mixed Methods Second Edition · W. Alex Edmonds Thomas D. Kennedy Nova Southeastern University . • 1): ISAGE Los Angeles I London I New Delhi Singapore I Washington DC I Melbourne ($)SAGE FORI NFORMATION: Copyright © 2017 by SAGE Publications, Inc. All rights reserved. No part of this book may be reproduced or SAGEP ublicationsIn, c. used in any form or by any means, electronic or mechanical, 2455T ellerR oad including photocopying, recording, or by any information storage ThousandO aks,C alifornia9 1320 and retrieval system, without permission in writing from the E-mailo: [email protected] publisher. SAGEP ublicationLst d. Printed in the United States of America 1 Oliver'sY ard 55CityRoad Library of Congress Cataloging-in-Publication Data LondonE, C1Y1 SP Names: Edmonds, W. Alex, author. I Kennedy, Thomas D., author. UnitedK ingdom Title: An applied guide to research designs : quantitative, SAGEP ublicationIsn diaP vt.L td. qualitative, and mixed methods I W. Alex Edmonds, Nova Southeastern University, Thomas D. Kennedy, Nova Southeastern B 1/11M ohanC ooperativIen dustriaAl rea University. MathuraR oadN, ewD elh1i 100 44 Other titles: Applied reference guide to research designs India Description: Los Angeles: SAGE, [2017] I Earlier edition SAGEP ublicationAss ia-PacifiPc te.L td. published in 2013 as: An applied reference guide to research designs : quantitative, qualitative, and mixed methods. I Includes 3 ChurchS treet bibliographical references and index. #10-04S amsungH ub Identifiers: LCCN 2015045991 I ISBN 9781483317274 (pbk.: alk. Singapor0e4 9483 paper) Subjects: LCSH: Social sciences-Research-Methodology. I Education-Research-Methodology. I Research-Methodology. Classification: LCC H62 .E327 2017 I DOC 001.4/2-dc23 LC record available at http://lccn.loc.gov/2015045991 AcquisitionEs ditor: LeahF argotstein EditoriaAl ssistant: YvonneM cDuffee This book is printed on acid-free paper. eLearningE ditor: KatieA nchetaa nd RobertH ig;iins ProductionE ditor: OliviaW eber-Stenis CopyE ditor: AmyH arris Typesetter:C &MD igitals( P)L td. Proofreader:J eff Bryant Indexer: WilliamR agsdale CoverD esigner: CandiceH arman MarketingM anager: SusannaGh oldes 16 17 18 19 20 10 9 8 7 6 5 4 3 2 1 Brief Contents List of Tables, Figures, and Diagrams xi Foreword xiv Preface xvii Acknowledgments XXV About the Authors xxvi 1. A Primer of the Scientific Method and Relevant Components 1 PART I. QUANTITATIVE METHODS FOR EXPERIMENTAL AND QUASI-EXPERIMENTAL RESEARCH 29 2. Between-Subjects Approach 35 3. Regression-Discontinuity Approach 51 4. Within-Subjects Approach 57 5. Factorial Designs 75 6. Solomon N-Group Designs 93 7. Single-Case Approach 103 PART II. QUANTITATIVE METHODS FOR NONEXPERIME~TAL ¥ESEARCH 117 8. Ex Post Facto and Posttest-Only Designs 120 9. Observational Approach 125 10. Survey Approach 133 PART III. QUALITATIVE METHODS 141 11. Grounded Theory Perspective 145 12. Ethnographic Perspective 152 13. Narrative Perspective 160 14. Phenomenological Perspective 168 PART Iv. MIXED METHODS 177 15. Convergent-Parallel Approach 181 16. Embedded Approach 189 17. Explanatory-Sequential Approach 196 18. Exploratory-Sequential Approach 201 19. Mixed Methods, Case Studies, and Single-Case Approaches 208 20. Action Research Approaches 212 21. Conclusion 218 Appendix A. Less Common Designs for Experimental and Quasi-Experimental Research 222 Appendix B. Types of Case Study Designs 229 Appendix C. Five Types of Mixed Methods Designs 231 Appendix D. Reporting Preliminary Statistical Findings 232 Appendix E. Analysis by Design 251 Appendix F. Qualitative Data Analysis 321 Appendix G. Validity, Control, and Causal Inferences Checklist 332 Appendix H. Consort 2010: Checklist and Guidelines for Reporting Parallel Group Randomised Trials 334 References 338 Author Index 352 Subject Index 357 Detailed Contents List of Tables, Figures, and Diagrams xi Foreword xiv Paul E. Spector Preface xvii Audience xx Features xxi Unique Features xxi New to the Second Edition xxii Companion Website xxiii Acknowledgments XXV About the Authors xx:vi 1. A Primer of the Scientific Method and Relevant Components 1 The Scientific Method 2 Validity and Research Designs 3 Independent and Dependent Variables 5 Internal Validity 7 External Validity 8 Construct Validity 9 Statistical Conclusion Validity 9 Design Logic 13 ... ' Control 13 Design Notations 15 Assignment Techniques 15 Comparison and Control Groups 18 Sampling Strategies 18 Probability Sampling Techniques 20 Nonprobability Sampling Techniques 20 Research Questions 21 Types of Inquiry 21 PART I. QUANTITATIVE METHODS FOR EXPERIMENTAL AND QUASI-EXPERIMENTAL RESEARCH 29 Experimental Research 30 Quasi-Experimental Research 32 2. Between-Subjects Approach 35 Pretest and Posttest Designs 35 k-Factor Designs 36 Posttest Designs 43 3. Regression-Discontinuity Approach 51 4. Within-Subjects Approach 57 Repeated-Measures Approach 58 Switching-Replications Design: A Primer 59 Crossover and Latin-Square Designs 61 5. Factorial Designs 75 6. Solomon N-Group Design 93 7. Single-Case Approach 103 PART II. QUANTITATIVE METHODS FOR NONEXPERIMENTAL RESEARCH 117 8. Ex Post Facto and Posttest-Only Designs 120 9. Observational Approach 125 Explanatory Design 126 Predictive Design 126 Statistical Tools 127 Predicting a Single Variable for the Predictive Design 128 Predicting More Tban One Variable 128 10. Survey Approach 133 Primary Threats to Validity 134 Cross-Sectional Design 135 Longitudinal Design 135 PART III. QUALITATIVE METHODS 141 The Case Study 143 11. Grounded Theory Perspective 145 Systematic Design 146 Emerging Design 146 Constructivist Design 146 12. Ethnographic Perspective 152 Realist Design 152 Critical Design 153 Case Study Design 153 13. Narrative Perspective 160 Descriptive Design 161 Explanatory Design 161 Critical Design 161 14. Phenomenological Perspective 168 Existential Design 168 Transcendental Design 169 Hermeneutic Design 169 Case Study Design 169 PART Iv. MIXED METHODS 177 Mixed Methods Legend 179 15. Convergent-Parallel Approach 181 Parallel-Databases Design 182 Data-Transformation Design 182 Data-Validation Design 182 Multilevel Design 182 16. Embedded Approach 189 Embedded-Experiment Design 190 Embedded-Correlational Design 190 Embedded Case Sn.tdy De~gn 190 17. Explanatory-Sequential Approach 196 Follow-Up Explanations Design 197 Participant-Selection Design 197 18. Exploratory-Sequential Approach 201 Instrument-Development Design 202 Theory-Development Design 202 Treatment-Development Design 202 19. Mixed Methods, Case Studies, and Single-Case Approaches 208 Mixed Method A-B-A Designs 209 Sequential Case Study Single-Case Design 210 20. Action Research Approaches 212 Embedding Research Designs Within the Action Research Approach 214 21. Conclusion 218 Philosophical Tenets 218 Evaluation Approaches 219 Data Analytics 220 Final Remarks 220 Appendix A. Less Common Designs for Experimental and Quasi-Experimental Research 222 Appendix B. Types of Case Study Designs 229 Appendix C. Five Types of Mixed Methods Designs 231 Appendix D. Reporting Preliminary Statistical Findings 232 Appendix E. Analysis by Design 251 Appendix F. Qualitative Data Analysis 321 Appendix G. Validity, Control, and Causal Inferences Checklist 332 Appendix H. Consort 2010: Checklist and Guidelines for Reporting Parallel Group Randomised Trials 334 References 338 Author Index 352 Subject Index 357 List of Tables, Figures, and Diagrams + TABLES Table 1.1. Threats to Internal Validity 7 Table 1.6. Design Notations 15 Table 1.2. Threats to External Validity 9 Table 1.7. Group Assignment Design Notations 15 Table 1.3. Threats to Construct Validity 10 Table 7.1. Design Notations for Table 1.4. Threats to Statistical Conclusion Single-Case Approaches 104 Validity 11 Table 20.1. Design Notations for the Action Table 1.5. Control Techniques for Research Approach 215 Experimental, Quasi Experimental, and Nonexperimental Research 14 + FIGURES Figure 1.1. The Scientific Method 3 Figure 3.1. Sample of a Cutoff Score 52 Figure 1.2. Conceptual and Operational Figure 4.1. Wait-List Continuation Design Definitions 6 (for Random Assignment) 60 Figure 4.2. Switching-Replications Design Figure 1.3. Example of"a Stratlfied Random- (for Nonrandom Assignment) 60 Assignment Technique 17 Figure 11.1. Systematic Design 147 Figure 1.4. Example of a Sample Extracted From a Population 19 Figure 11.2. Emerging Design 148 Figure 11.3. Constructivist Design 150 Figure 1.1. Quantitative Method Flowchart 29 Figure 12.1. Realist Design 155 Figure 1.2. Double Pretest Design for Quasi- Experimental Research 33 Figure 12.2. Critical Design 156 xi