Applied Machine L earning and AI for Engineers Solve Business Problems That Can't Be Solved Algorithmically P r o s is e Jeff Prosise Foreword by Adam Prosise Applied Machine Learning and AI for Engineers While many introductory guides to AI are calculus books in disguise, this one mostly eschews the math. Instead, author “If you want to Jeff Prosise helps engineers and software developers build understand how AI and an intuitive understanding of AI to solve business problems. ML really work under the Need to create a system to detect the sounds of illegal hood, and how these logging in the rainforest, analyze text for sentiment, or technologies have predict early failures in rotating machinery? This practical evolved and come to be, book teaches you the skills necessary to put AI and machine learning to work at your company. READ THIS BOOK.” Applied Machine Learning and AI for Engineers provides —Todd Fine Chief Strategy Officer, Atmosera examples and illustrations from the AI and ML course Prosise teaches at companies and research institutions worldwide. “Reading this book will There’s no fluff and no scary equations—just a fast start for make you want to go engineers and software developers, complete with hands-on build something.” examples. —Doug Turnure This book helps you: Azure Specialist, Microsoft • Learn what machine learning and deep learning are and what they can accomplish Jeff Prosise is an engineer whose • Understand how popular learning algorithms work and passion is to introduce engineers and software developers to the wonders of when to apply them AI and machine learning. Cofounder of • Build machine learning models in Python with Scikit- Wintellect, he has trained thousands Learn, and neural networks with Keras and TensorFlow of developers at Microsoft and spoken at some of the world’s largest • Train and score regression models and binary and software conferences. In another life, multiclass classification models Jeff worked on high-powered laser • Build facial recognition models and object detection models systems and fusion energy research at Oak Ridge National Laboratory • Build language models that respond to natural-language and Lawrence Livermore National queries and translate text to other languages Laboratory. He currently serves as • Use Cognitive Services to infuse AI into the apps that Chief Learning Officer at Atmosera, where he helps customers infuse AI you write into their products. MACHINE LEARNING Twitter: @oreillymedia linkedin.com/company/oreilly-media US $69.99 CAN $87.99 youtube.com/oreillymedia ISBN: 978-1-492-09805-8 Praise for Applied Machine Learning and AI for Engineers This book is a fantastic guide to machine learning and AI algorithms. It’s succinct while being comprehensive, and the concrete examples with working code show how to take the theory into practice. —Mark Russinovich, Azure CTO and Technical Fellow, Microsoft When Jeff Prosise is passionate about something (whether it be technology, his pet yellow-nape Amazon “Hawkeye,” or his hobby of building and flying radio-controlled jets), you definitely want to listen in. He combines that passion with a clarity of explanation that enables him to communicate and teach complex topics better than anyone I’ve ever known. He brings you along on a personal journey of learning and understanding. Now Jeff brings these skills to the current and ongoing “technological tsunami” (as he puts it) of machine learning and AI. In this new book, he builds your understanding from the foundations up, always emphasizing an intuitive approach and connecting concepts and solutions to the real world. If you want to understand how AI and ML really work under the hood, and how these technologies have evolved and come to be, READ THIS BOOK. —Todd Fine, Chief Strategy Officer, Atmosera Jeff distills years of working AI/ML knowledge into a practical and understandable guide for practitioners of all levels. —Ken Muse, 4x Azure MVP and Senior DevOps Architect, GitHub Applied Machine Learning and AI for Engineers is the book I wish I had when first introduced to machine learning. It’s a fantastic introduction for novice ML engineers and a great reference for those more experienced. It is now my go-to source when refreshing and enhancing my understanding of various ML techniques and their applicability. I love that Jeff uses real-world examples and datasets to demonstrate each tool set and approach. Just like a neural net, I have no idea how Jeff came up with this material, but it’s tremendously useful all the same. —Brent Rector, Principal Technical Program Manager, Amazon; Founder, Wise Owl Consulting, LLC, Wise Owl Aviation Services, LLC, and Rector Aviation Law PC I’ve known Jeff for decades and he has always possessed the ability to plainly explain complicated concepts. He has done it again with Applied Machine Learning and AI for Engineers. The examples, analogies, and color figures make the material truly understandable for the beginner to the more advanced reader. —Jeffrey Richter, Software Architect, Microsoft This book fills an extremely important gap for engineers and scientists that want to bring the power of AI to bear on their most challenging data analysis problems. It strikes just the right balance between technical depth and practical application, with tools and many hands-on examples, to empower the reader to become an effective AI practitioner in their own application domain (including business, science, and other data-rich fields). —Shaun S. Gleason, PhD, Director, Cyber Resilience and Intelligence, Oak Ridge National Laboratory Applied Machine Learning and AI for Engineers has the potential to become the go-to for ML and AI enthusiasts. What sets this book apart is how relevant the problem statements are in today’s fast-paced adoption of machine learning in the tech world. A must-read for newbies and professionals alike! —Lipi Deepaakshi Patnaik, Software Development Engineer, Zeta Suite Jeff has always been able to wrap great stories around deep technical concepts that make learning markedly easier. This might be his best book yet, and perhaps his most relevant subject matter as well. Reading this book will make you want to go build something. —Doug Turnure, Azure Specialist, Microsoft Applied Machine Learning and AI for Engineers is a practical handbook for building useful machine learning systems. It provides accessible guidance on how to apply cutting-edge AI algorithms to solve contemporary business problems. —Brian Spiering, Data Science Instructor, Metis This book is a perfect start for engineers and software developers who want to get into machine learning. It covers good ground in ML and quickly gets you started for a wide variety of problems that are driven by data rather than algorithms. —Dr. Manjeet Dahiya, VP and Head, AI and Machine Learning, Ecom Express Whether you’re new to applied ML or a seasoned developer looking for a reference, this book is a must-have, up-to-date, comprehensive guide to all major classes of machine learning algorithms (with clean code implementations to really solidify your understanding). —Goku Mohandas, Founder, Made With ML Applied Machine Learning and AI for Engineers is a brilliant primer for beginner to intermediate readers in AI/ML. The book builds a comfortable flow from conventional ML to deep learning with the desirable bonus of AI implementation on the cloud, making it a complete end-to-end guide for any enthusiastic reader or professional practitioner. —Satyarth Praveen, Computing Science Engineer, Lawrence Berkeley National Lab Jeff Prosise is one of the best teachers I have ever encountered, and regardless of the platform (classroom, blog, magazine article, webinar, book, etc.), he has a special talent of taking complex topics and making them accessible for the rest of us. In this book, Jeff goes beyond simply providing a very clear understanding of the basic concepts that undergird machine learning to provide easy-to-follow examples that demonstrate those concepts within the current environment. He delivers a great introduction/overview of a wide variety of topics within machine learning and gives clear guidance on how each can (and should) be used. Jeff is one of the very few that could have taken this complex topic and put it into a form that could be easily absorbed and applied. This book is a MUST READ for engineers and other problem solvers who are looking to use machine learning to augment their skill set. —Larry Clement, Assistant Professor, Computing, Software, and Data Sciences, and former Department Chair, California Baptist University. Formerly a senior engineer-scientist with the Boeing Corporation on the C-17 program. Infused with author Jeff Prosise’s iconic teaching style that has helped thousands of developers over the years, Applied Machine Learning and AI for Engineers layers context around complex topics and provides easy-to-understand examples and tutorials. Highly recommended for engineers who want to incorporate machine learning concepts and skills in their repertoire. —Vani Mandava, Head of Engineering, Scientific Software Engineering Center at University of Washington eScience Institute Applied Machine Learning and AI for Engineers Solve Business Problems That Can’t Be Solved Algorithmically Jeff Prosise Foreword by Adam Prosise BBeeiijjiinngg BBoossttoonn FFaarrnnhhaamm SSeebbaassttooppooll TTookkyyoo Applied Machine Learning and AI for Engineers by Jeff Prosise Copyright © 2023 Jeff Prosise. All rights reserved. Printed in the United States of America. Published by O’Reilly Media, Inc., 1005 Gravenstein Highway North, Sebastopol, CA 95472. O’Reilly books may be purchased for educational, business, or sales promotional use. Online editions are also available for most titles (http://oreilly.com). For more information, contact our corporate/institutional sales department: 800-998-9938 or [email protected]. Acquisitions Editor: Nicole Butterfield Indexer: Potomac Indexing, LLC Development Editor: Jill Leonard Interior Designer: David Futato Production Editor: Gregory Hyman Cover Designer: Karen Montgomery Copyeditor: Audrey Doyle Illustrator: Kate Dullea Proofreader: Piper Editorial Consulting, LLC November 2022: First Edition Revision History for the First Edition 2022-11-10: First Release See http://oreilly.com/catalog/errata.csp?isbn=9781492098058 for release details. The O’Reilly logo is a registered trademark of O’Reilly Media, Inc. Applied Machine Learning and AI for Engineers, the cover image, and related trade dress are trademarks of O’Reilly Media, Inc. The views expressed in this work are those of the author and do not represent the publisher’s views. While the publisher and the author have used good faith efforts to ensure that the information and instructions contained in this work are accurate, the publisher and the author disclaim all responsibility for errors or omissions, including without limitation responsibility for damages resulting from the use of or reliance on this work. Use of the information and instructions contained in this work is at your own risk. If any code samples or other technology this work contains or describes is subject to open source licenses or the intellectual property rights of others, it is your responsibility to ensure that your use thereof complies with such licenses and/or rights. 978-1-492-09805-8 [LSI] For my Wintellect family past and present