Handbook of Tests and Measurement in Education and the Social Sciences Third Edition Handbook of Tests and Measurement in Education and the Social Sciences Third Edition Paula E. Lester Deborah Inman Lloyd Bishop ROWMAN & LITTLEFIELD Lanham • Boulder • New York • London Published by Rowman & Littlefield A wholly owned subsidiary of The Rowman & Littlefield Publishing Group, Inc. 4501 Forbes Boulevard, Suite 200, Lanham, Maryland 20706 www.rowman.com Unit A, Whitacre Mews, 26-34 Stannery Street, London SE11 4AB Copyright © 2014 by Paula E. Lester, Deborah Inman, and Lloyd K. Bishop All rights reserved. No part of this book may be reproduced in any form or by any electronic or mechanical means, including information storage and retrieval systems, without written permission from the publisher, except by a reviewer who may quote passages in a review. British Library Cataloguing in Publication Information Available Library of Congress Cataloging-in-Publication Data Lester, Paula E. Handbook of tests and measurement in education and the social sciences / Paula E. Lester, Deborah Inman, and Lloyd K. Bishop. -- Third edition. pages cm Includes bibliographical references and index. ISBN 978-1-61048-429-9 (cloth : alk. paper) — ISBN 978-1-61048-430-5 (pbk. : alk. paper) — ISBN 978-1-61048-431-2 (electronic) 1. Educational tests and measurements—Handbooks, manuals, etc. 2. Social sciences—Methodology— Handbooks, manuals, etc. I. Bishop, Lloyd K. II. Title. LB3051.L4543 2014 371.26—dc23 2014036286 ™ The paper used in this publication meets the minimum requirements of American National Standard for Information Sciences—Permanence of Paper for Printed Library Materials, ANSI/NISO Z39.48-1992. Printed in the United States of America Dedicated to Rose DeMarino Bishop In Loving Memory The wind beneath our wings Contents Introduction ix PART I: QUANTITATIVE RESEARCH AND MEASUREMENT, QUALITATIVE RESEARCH METHODS 1 Basic Quantitative Research and Statistical Procedures 3 2 Multiple Regression Analysis 11 3 Inferential Research Methods 29 t-test 29 ANOVA 35 4 Measurement in Quantitative Research 45 5 Examples of Measurement Procedures 59 Reliability/Validity 59 Item Analysis 60 Factor Analysis 61 6 Qualitative and Mixed Methods Research 75 PART II: INSTRUMENT SECTION Introduction to Instrument Section 91 Instruments Included and Reviewed 91 Alienation 94 Anxiety/Frustration 98 Change/Innovation 102 Climate 106 Communication 114 Conflict 119 Culture 124 Decision Making 127 Dogmatism 132 Ethics 135 Honesty/Trust 139 Interpersonal Relations 143 Job Commitment 152 Job Involvement 154 Job Satisfaction 155 vii viii Contents Leadership 166 Locus of Control 169 Mentoring 178 Morale 182 Motivation/Money 186 Needs 196 Organizational Assessment/Effectiveness 200 Organizational Structure 216 Parental Involvement 218 Politics 224 Power 225 Principal Evaluation 230 Professional Performance 231 Role 244 School Boards 248 Self-Actualization 253 Self-Concept 256 Self-Efficacy 259 Self-Esteem 265 Sex Roles (Gender Identification) 267 Stress/Burnout 270 Supervisory/Managerial Behavior 281 Teacher Attitudes/Beliefs 297 Teacher Evaluation 316 Total Quality Management 322 Instruments Available through Commercial Organizations 325 References 333 Author Index 337 Instrument Index 339 About the Authors 343 Introduction The first two editions of this book focused on the quantitative approaches to measurement and research methods. This edition has been expanded to include the increasing interest and need for qualitative and mixed methods research de- signs. This third edition is expanded to serve as a broader research handbook with two parts. Part 1 includes an overview of research methods including chapters on quantitative methods, qualitative methods, and mixed methods. Part 2 in- cludes the anthology and instruments, with a review of each measure, that have been updated from the previous editions. Twenty years ago, Bishop and Lester compiled an anthology of instruments in education and the social sciences. Bibliographic references were provided for more than seven hundred instruments developed over the last forty years in more than thirty related areas. This anthology was based on more than a dozen major reference books that were written in the 1960s and 1970s. Many of these books are no longer in print and not available. These reference books varied in the amount of information provided. Some sources included the actual instrument, while others provided only a summary of the psychometric characteristics. Still other sources presented critiques of instruments and general bibliographic infor- mation. Consequently, there was a need to include in one book not only the specific psychometric information about the instruments and bibliographic references related to the instrument, but the actual instrument (published or unpublished). This edition of the handbook was originally published in 1997 for that purpose. This second edition of the handbook, published in 2000, expanded upon and updated the original handbook. Since 2000, additional areas of interest have emerged and have been included in this third edition. For example, the issue of teacher and principal evaluation has come to the forefront with federal and state legislation. Teachers and principals across the states are now given grades at the end of every year that represent their effectiveness rating. The Annual Pro- fessional Performance Review (APPR) is a state-governed process that determines the standards for these ratings and the process for assessing teachers’ and leaders’ effectiveness. The details of the evaluation process are determined locally by school districts. Therefore, the indexes contain a section on Instruments Available through Commercial Organizations, which include the latest sources for teacher and principal evaluation instruments. For many years, quantitative methods (sometimes referred to as verificational research) were considered the best ap- proach for conducting quality research especially in the “hard” sciences. In fact in the early days of research, quantitative methods were considered superior to qualitative methods. However, as methods from other fields were better understood in the context of strengthening research designs, the barriers between different disciplines became less evident. The social sciences, for example, are now much more open to methods from the humanities and philosophy than they were even twenty years ago. The need for more in-depth and comprehensive understanding of various research questions has resulted in a greater appreciation and need for what qualitative and mixed methods research designs can provide. Quantitative research incorporates systematic empirical investigations using scientific methods to answer specific questions. Quantitative methods are also used in the social sciences although its origins are from positivism. Quan- titative methods refer to the systematic empirical investigation of social phenomena using statistical, mathematical, or computational techniques. Appropriate mathematical measurement of research variables is central to quantitative research because it provides the fundamental connection between empirical observation and mathematical expression of quantitative relationships. Quantitative data are usually numerical requiring the use of various statistical procedures for data analysis and interpretation. Qualitative research is a method of inquiry used in many different disciplines, although it traditionally emerged in the social sciences with roots from sociology and anthropology (Bogdan and Biklen, 1998), and also referred to ix