About This eBook ePUB is an open, industry-standard format for eBooks. However, support of ePUB and its many features varies across reading devices and applications. Use your device or app settings to customize the presentation to your liking. Settings that you can customize often include font, font size, single or double column, landscape or portrait mode, and figures that you can click or tap to enlarge. For additional information about the settings and features on your reading device or app, visit the device manufacturer’s Web site. Many titles include programming code or configuration examples. To optimize the presentation of these elements, view the eBook in single-column, landscape mode and adjust the font size to the smallest setting. In addition to presenting code and configurations in the reflowable text format, we have included images of the code that mimic the presentation found in the print book; therefore, where the reflowable format may compromise the presentation of the code listing, you will see a “Click here to view code image” link. Click the link to view the print-fidelity code image. To return to the previous page viewed, click the Back button on your device or app. Hands-On Mobile App Testing A Guide for Mobile Testers and Anyone Involved in the Mobile App Business Daniel Knott New York • Boston • Indianapolis • San Francisco Toronto • Montreal • London • Munich • Paris • Madrid Capetown • Sydney • Tokyo • Singapore • Mexico City Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in this book, and the publisher was aware of a trademark claim, the designations have been printed with initial capital letters or in all capitals. The author and publisher have taken care in the preparation of this book, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein. For information about buying this title in bulk quantities, or for special sales opportunities (which may include electronic versions; custom cover designs; and content particular to your business, training goals, marketing focus, or branding interests), please contact our corporate sales department at prior to any prohibited reproduction, storage in a retrieval system, or transmission in any form or by any means, electronic, mechanical, photocopying, recording, or likewise. To obtain permission to use material from this work, please submit a written request to Pearson Education, Inc., Permissions Department, 200 Old Tappan Road, Old Tappan, New Jersey 07675, or you may fax your request to (201) 236-3290. ISBN-13: 978-0-13-419171-3 ISBN-10: 0-13-419171-4 Text printed in the United States on recycled paper at RR Donnelley in Crawfordsville, Indiana. First printing, May 2015 For my wife, Sarah. Thank you very much for your support and encouragement while I wrote this book. Contents Preface Acknowledgments About the Author Chapter 1: What’s Special about Mobile Testing? User Expectations Mobility and Data Networks Mobile Devices Mobile Release Cycles Mobile Testing Is Software Testing Summary Chapter 2: Introduction to Mobile Devices and Apps Overview of Mobile Networks Mobile Devices and the Year 2007 The Big Two What Types of Apps Exist? Native Apps Hybrid Apps Web Apps Business Models of Mobile Apps Freemium Paid Transaction Choosing a Business Model App Stores Summary Chapter 3: Challenges in Mobile Testing The Customer Customer Summary Mobile Platforms and Fragmentation Mobile Device Groups Mobile Device Labs Sensors and Interfaces Ambient Light Sensor Proximity Sensor Acceleration Sensor Gyroscope Sensor Magnetic Sensor Pressure, Temperature, and Humidity Sensors Location Sensor Touchless Sensor Sensors Summary Touchscreen Microphones Camera System Apps Internationalization (I18n) and Localization (L10n) Mobile Browsers Summary Chapter 4: How to Test Mobile Apps Emulator, Simulator, or Real Device? Manual Testing versus Automated Testing “Traditional” Testing Mobile-Specific Testing Mobile Functional Testing Mobile Usability Testing Accessibility Testing Battery Usage Testing Stress and Interrupt Testing Performance Testing Standby Testing Installation Testing Update Testing Database Testing Local Storage Testing Security Testing Platform Guideline Testing Conformance Testing Checking the Log Files Be Creative! Checklists, Mnemonics, and Mind Maps Checklists Mnemonics Mind Maps How to File Mobile Bugs Bug ID Description Steps to Reproduce Expected Result Actual Result Work-around Reproducible Operating System, Mobile Platform, and Mobile Device Mobile-Device-Specific Information Browser Version Software Build Version Network Condition and Environment Language Test Data Severity Bug Category Screenshot or Video Log Files Tester Who Found the Bug Three More Points App Quality Alliance Summary Chapter 5: Mobile Test Automation and Tools The Flipped Testing Pyramid The Mobile Test Pyramid Different Types of Test Automation Tools Image Recognition Coordinate-Based Recognition OCR/Text Recognition Native Object Recognition Capture and Replay Tool Type Recommendation What Should Be Automated? Emulator, Simulator, or Real Device? Emulator/Simulator Pros Emulator/Simulator Cons Real Device Pros Real Device Cons Where to Automate? How to Select the Right Mobile Test Automation Tool Selection Criteria for a Test Automation Tool Current State of Tools Android Tools iOS Tools Mobile Test Automation Tools Summary Continuous Integration System