Hands-On Intelligent Agents with OpenAI Gym A step-by-step guide to develop AI agents using deep reinforcement learning Praveen Palanisamy BIRMINGHAM - MUMBAI Hands-On Intelligent Agents with OpenAI Gym Copyright © 2018 Packt Publishing All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews. Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author(s), nor Packt Publishing or its dealers and distributors, will be held liable for any damages caused or alleged to have been caused directly or indirectly by this book. Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information. Commissioning Editor: Sunith Shetty Acquisition Editor: Divya Poojari Content Development Editor: Eisha Dsouza Technical Editor: Ishita Vora Copy Editor: Safis Editing Project Coordinator: Namrata Swetta Proofreader: Safis Editing Indexer: Mariammal Chettiyar Graphics: Jisha Chirayil Production Coordinator: Deepika Naik First published: July 2018 Production reference: 1300718 Published by Packt Publishing Ltd. Livery Place 35 Livery Street Birmingham B3 2PB, UK. ISBN 978-1-78883-657-9 www.packtpub.com To Sulo, my loving mom, for all the sacrifices she has made and for doing the best she could. To my Dad, for his support during my early growth period. To the living entity that bears the sun and the moon. – Praveen Palanisamy mapt.io Mapt is an online digital library that gives you full access to over 5,000 books and videos, as well as industry leading tools to help you plan your personal development and advance your career. For more information, please visit our website. Why subscribe? Spend less time learning and more time coding with practical eBooks and Videos from over 4,000 industry professionals Improve your learning with Skill Plans built especially for you Get a free eBook or video every month Mapt is fully searchable Copy and paste, print, and bookmark content PacktPub.com Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at www.PacktP and as a print book customer, you are entitled to a discount on the eBook ub.com copy. Get in touch with us at for more details. [email protected] At , you can also read a collection of free technical articles, sign www.PacktPub.com up for a range of free newsletters, and receive exclusive discounts and offers on Packt books and eBooks. Contributors About the author Praveen Palanisamy works on developing autonomous intelligent systems. He is currently an AI researcher at General Motors R&D. He develops planning and decision-making algorithms and systems that use deep reinforcement learning for autonomous driving. Previously, he was at the Robotics Institute, Carnegie Mellon University, where he worked on autonomous navigation, including perception and AI for mobile robots. He has experience developing complete, autonomous, robotic systems from scratch. I want to thank the people who contribute to the open source development of OpenAI Gym and PyTorch. I also would like to thank the Packt team, specifically Rushi, Eisha, and Ishita, for helping me throughout the authoring process.