Statistics for Biology and Health SeriesEditors M.Gail,K.Krickeberg,J.M.Samet,A.Tsiatis,W.Wong For othertitlespublished inthisseries, go to http://www.springer.com/series/2848 . David G. Kleinbaum Mitchel Klein Logistic Regression ‐ A Self Learning Text Third Edition With Contributions by Erica Rihl Pryor DavidG.Kleinbaum MitchelKlein DepartmentofEpidemiology EmoryUniversity RollinsSchoolofPublicHealth Atlanta,GA30322 USA [email protected] [email protected] SeriesEditors M.Gail K.Krickeberg JonathanM.Samet NationalCancerInstitute LeChatelet DepartmentofPreventive Rockville, F-63270Manglieu Medicine MD20892 France KeckSchoolofMedicine USA UniversityofSouthern California LosAngeles,CA90089 USA A.Tsiatis W.Wong DepartmentofStatistics DepartmentofStatistics NorthCarolinaStateUniversity StanfordUniversity Raleigh,NC27695 Stanford,CA94305-4065 USA USA ISBN:978-1-4419-1741-6 e-ISBN:978-1-4419-1742-3 DOI10.1007/978-1-4419-1742-3 SpringerNewYorkDordrechtHeidelbergLondon LibraryofCongressControlNumber:2009943538 #SpringerScience+BusinessMediaLLC2010 All rights reserved. This work may not be translated or copied in whole or in part without the written permissionofthepublisher(SpringerScience+BusinessMedia,LLC,233SpringStreet,NewYork,NY 10013,USA),exceptforbriefexcerptsinconnectionwithreviewsorscholarlyanalysis.Useinconnection withanyformofinformationstorageandretrieval,electronicadaptation,computersoftware,orbysimilar ordissimilarmethodologynowknownorhereafterdevelopedisforbidden. Theuseinthispublicationoftradenames,trademarks,servicemarks,andsimilarterms,eveniftheyare notidentifiedassuch,isnottobetakenasanexpressionofopinionastowhetherornottheyaresubjectto proprietaryrights. Printedonacid-freepaper SpringerispartofSpringerScience+BusinessMedia(www.springer.com) To EdnaKleinbaum and RebeccaKlein . Contents Preface xiii Acknowledgements xvii Chapter 1 Introduction to Logistic Regression 1 Introduction 2 AbbreviatedOutline 2 Objectives 3 Presentation 4 DetailedOutline 29 KeyFormulae 32 PracticeExercises 32 Test 34 AnswerstoPracticeExercises 37 Chapter 2 Important Special Cases of the Logistic Model 41 Introduction 42 AbbreviatedOutline 42 Objectives 43 Presentation 45 DetailedOutline 65 PracticeExercises 67 Test 69 AnswerstoPracticeExercises 71 Chapter 3 Computing the Odds Ratio in Logistic Regression 73 Introduction 74 AbbreviatedOutline 74 Objectives 75 Presentation 76 DetailedOutline 92 PracticeExercises 96 Test 98 AnswerstoPracticeExercises 101 Chapter 4 Maximum Likelihood Techniques: An Overview 103 Introduction 104 AbbreviatedOutline 104 vii viii Contents Objectives 105 Presentation 106 DetailedOutline 122 PracticeExercises 124 Test 124 AnswerstoPracticeExercises 127 Chapter 5 Statistical Inferences Using Maximum Likelihood Techniques 129 Introduction 130 AbbreviatedOutline 130 Objectives 131 Presentation 132 DetailedOutline 154 PracticeExercises 156 Test 159 AnswerstoPracticeExercises 162 Chapter 6 Modeling Strategy Guidelines 165 Introduction 166 AbbreviatedOutline 166 Objectives 167 Presentation 168 DetailedOutline 194 PracticeExercises 197 Test 198 AnswerstoPracticeExercises 201 Chapter 7 Modeling Strategy for Assessing Interaction and Confounding 203 Introduction 204 AbbreviatedOutline 204 Objectives 205 Presentation 206 DetailedOutline 233 PracticeExercises 234 Test 236 AnswerstoPracticeExercises 237 Chapter 8 Additional Modeling Strategy Issues 241 Introduction 242 AbbreviatedOutline 242 Objectives 243 Contents ix Presentation 244 DetailedOutline 286 PracticeExercises 289 Test 293 AnswerstoPracticeExercises 298 Chapter 9 Assessing Goodness of Fit for Logistic Regression 301 Introduction 302 AbbreviatedOutline 302 Objectives 303 Presentation 304 DetailedOutline 329 PracticeExercises 334 Test 338 AnswerstoPracticeExercises 342 Chapter 10 Assessing Discriminatory Performance of a Binary Logistic Model: ROC Curves 345 Introduction 346 AbbreviatedOutline 346 Objectives 347 Presentation 348 DetailedOutline 373 PracticeExercises 377 Test 380 AnswerstoPracticeExercises 386 Chapter 11 Analysis of Matched Data Using Logistic Regression 389 Introduction 390 AbbreviatedOutline 390 Objectives 391 Presentation 392 DetailedOutline 415 PracticeExercises 420 Test 424 AnswerstoPracticeExercises 426 Chapter 12 Polytomous Logistic Regression 429 Introduction 430 AbbreviatedOutline 430 Objectives 431 x Contents Presentation 432 DetailedOutline 455 PracticeExercises 458 Test 460 AnswerstoPracticeExercises 461 Chapter 13 Ordinal Logistic Regression 463 Introduction 464 AbbreviatedOutline 464 Objectives 465 Presentation 466 DetailedOutline 482 PracticeExercises 485 Test 487 AnswerstoPracticeExercises 488 Chapter 14 Logistic Regression for Correlated Data: GEE 489 Introduction 490 AbbreviatedOutline 490 Objectives 491 Presentation 492 DetailedOutline 529 PracticeExercises 536 Test 537 AnswerstoPracticeExercises 538 Chapter 15 GEE Examples 539 Introduction 540 AbbreviatedOutline 540 Objectives 541 Presentation 542 DetailedOutline 558 PracticeExercises 559 Test 562 AnswerstoPracticeExercises 564 Chapter 16 Other Approaches for Analysis of Correlated Data 567 Introduction 568 AbbreviatedOutline 568 Objectives 569 Presentation 570