Content Production of Digital Audio/Video, Illustration and 3D Animation Android Studio New Media Fundamentals Wallace Jackson www.it-ebooks.info Android Studio New Media Fundamentals Content Production of Digital Audio/Video, Illustration and 3D Animation Wallace Jackson www.it-ebooks.info Android Studio New Media Fundamentals Wallace Jackson Lompoc, California, USA ISBN-13 (pbk): 978-1-4842-1640-8 ISBN-13 (electronic): 978-1-4842-9867-1 DOI 10.1007/978-1-4842-9867-1 Library of Congress Control Number: 2015955164 Copyright © 2015 by Wallace Jackson This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. Exempted from this legal reservation are brief excerpts in connection with reviews or scholarly analysis or material supplied specifically for the purpose of being entered and executed on a computer system, for exclusive use by the purchaser of the work. Duplication of this publication or parts thereof is permitted only under the provisions of the Copyright Law of the Publisher’s location, in its current version, and permission for use must always be obtained from Springer. Permissions for use may be obtained through RightsLink at the Copyright Clearance Center. Violations are liable to prosecution under the respective Copyright Law. Trademarked names, logos, and images may appear in this book. Rather than use a trademark symbol with every occurrence of a trademarked name, logo, or image we use the names, logos, and images only in an editorial fashion and to the benefit of the trademark owner, with no intention of infringement of the trademark. The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights. While the advice and information in this book are believed to be true and accurate at the date of publication, neither the authors nor the editors nor the publisher can accept any legal responsibility for any errors or omissions that may be made. The publisher makes no warranty, express or implied, with respect to the material contained herein. Managing Director: Welmoed Spahr Lead Editor: Steve Anglin Technical Reviewer: Chad Darby Editorial Board: Steve Anglin, Louise Corrigan, Jonathan Gennick, Robert Hutchinson, Michelle Lowman, James Markham, Susan McDermott, Matthew Moodie, Jeffrey Pepper, Douglas Pundick, Ben Renow-Clarke, Gwenan Spearing, Steve Weiss Coordinating Editor: Mark Powers Copy Editor: Jana Weinstein and Kim Burton-Weisman Compositor: SPi Global Indexer: SPi Global Artist: SPi Global Distributed to the book trade worldwide by Springer Science+Business Media New York, 233 Spring Street, 6th Floor, New York, NY 10013. Phone 1-800-SPRINGER, fax (201) 348-4505, e-mail [email protected], or visit www.springeronline.com. Apress Media, LLC is a California LLC and the sole member (owner) is Springer Science + Business Media Finance Inc (SSBM Finance Inc). SSBM Finance Inc is a Delaware corporation. For information on translations, please e-mail [email protected], or visit www.apress.com. Apress and friends of ED books may be purchased in bulk for academic, corporate, or promotional use. eBook versions and licenses are also available for most titles. For more information, reference our Special Bulk Sales–eBook Licensing web page at www.apress.com/bulk-sales. Any source code or other supplementary materials referenced by the author in this text are available to readers at www.apress.com. For detailed information about how to locate your book’s source code, go to www.apress.com/source-code/. Readers can also access source code at SpringerLink in the Supplementary Material section for each chapter. Printed on acid-free paper www.it-ebooks.info Contents at a Glance About the Author ..............................................................................xi About the Technical Reviewer ........................................................xiii ■ Chapter 1: Enhancing Android Apps: Using New Media Assets ......1 ■ Chapter 2: Digital Images: Concepts and Terminology .................11 ■ Chapter 3: Digital Image Assets: Data Footprint Optimization .....27 ■ Chapter 4: Digital Audio: Concepts and Terminology ...................33 ■ Chapter 5: Digital Audio Assets: Data Footprint Optimization ......43 ■ Chapter 6: Digital Video: Concepts and Terminology ....................57 ■ Chapter 7: Digital Video Assets: Data Footprint Optimization ......65 ■ Chapter 8: Digital Illustration: Concepts and Terminology ...........77 ■ Chapter 9: Digital Illustration: Data Footprint Optimization .........87 ■ Chapter 10: 3D New Media: Concepts and Terminology .............101 ■ Chapter 11: 3D New Media: Data Formats and Platforms ..........117 ■ Chapter 12: Referencing New Media Assets in Android Studio ............................................................................129 Index ..............................................................................................137 iii www.it-ebooks.info ThiSisaFMBlankPage www.it-ebooks.info Contents About the Author ..............................................................................xi About the Technical Reviewer ........................................................xiii ■ Chapter 1: Enhancing Android Apps: Using New Media Assets ......1 New Media Genres: Multimedia Pie Slices ..............................................2 Separate Your App from the Crowd: New Media .......................................................2 Android Studio New Media Support: File Formats ....................................................2 Downloading and Installing Your Software ..............................................4 Digital Image Editing and Compositing: GIMP...........................................................4 Digital Audio Editing and Effects: Audacity ...............................................................5 Digital Video Editing and Effects: Lightworks ...........................................................6 Digital Illustration and 2D Modeling: Inkscape .........................................................7 3D Modeling, Rendering, and Animation: Blender.....................................................8 Summary .................................................................................................9 ■ Chapter 2: Digital Images: Concepts and Terminology .................11 Pixels: Your Digital Image Building Blocks ............................................11 Raster vs. Vector: Imagery vs. Illustration ..............................................................12 Rendering: Convert Vector Shape to Raster Image .................................................12 Resolution: The Number of Image Pixels ...............................................12 Doing the Math: Calculate Your Total Image Pixels .................................................13 Matching Image Resolution to Android Devices .....................................................13 v www.it-ebooks.info ■ CONTENTS Aspect Ratio: The 2D Ratio of W:H Pixels ..............................................14 Screen Shapes: Common Display Aspect Ratios ....................................................15 Doing the Math: How to Arrive at the Aspect Ratio .................................................15 Color Theory: Using Pixel Color Channels ..............................................15 The Mathematics of RGB Color: Multiplying Your Intensities ..................................16 Representing RGB Color Values: Using Hexadecimal Data Values ..........................17 Color Depth: Bit-Levels That Defi ne Color .............................................18 Indexed Color: Using Palettes to Hold 256 Colors ...................................................18 True Color: Using 24-Bit Color Imagery ...................................................................19 True Color plus Alpha: Using 32-Bit Digital Images ................................................19 Alpha Channels: Defi ning Transparency ................................................21 PorterDuff: Algorithmic Blending Modes ...............................................21 Smoothing Edges: Anti-Aliasing ............................................................22 NinePatch Assets: 9-patch Digital Images.............................................23 NinePatch Class: Creating NinePatch in Android ....................................................24 Draw 9-patch: Create a NinePatchDrawable Image ...............................................24 Summary ...............................................................................................26 ■ Chapter 3: Digital Image Assets: Data Footprint Optimization .....27 Optimizing Digital Imagery: Key Factors ...............................................27 Image Resolution: Number of Pixels in the Array ...................................................28 Image Color Depth: Color Channels for Each Pixel .................................................28 Image Alpha Channel: Pixel Transparency Channel ................................................32 Summary ...............................................................................................32 ■ Chapter 4: Digital Audio: Concepts and Terminology ...................33 Audio Concepts and Terminology ..........................................................33 Foundation of Analog Audio: Sound Waves of Air ...................................................33 Digital Audio: Samples, Resolution, and Frequency ................................................34 Digital Audio Data: Transmission and Digitization ...................................................36 vi www.it-ebooks.info ■ CONTENTS Digital Audio in Android: File Formats .....................................................................37 MIDI: Musical Instrument Data Interface ................................................................38 MPEG-3 Audio: The Popular MP3 Data Format .......................................................38 FLAC: The 24-Bit Free Lossless Audio Codec..........................................................39 OGG Vorbis: A Lossy Open Source Audio Codec ......................................................39 MPEG-4 Audio: Advanced Audio Coding (AAC) ........................................................40 MPEG-4 AMR: Adaptive Multi-Rate Audio Codecs ...................................................40 PCM Audio: Pulse-Code Modulation Codec .............................................................40 Summary ...............................................................................................41 ■ Chapter 5: Digital Audio Assets: Data Footprint Optimization ......43 Audio Optimization: Device Compatibility ..............................................43 Digital Audio Optimization: Work Process ..............................................44 Trim an Audio Sample: Removing Unused Audio ....................................................45 Noise Reduction: Removing Background Noise ......................................................47 Establishing a Baseline: Exporting PCM Format .....................................................48 Exporting Lossless FLAC: FLAC Audio Files ............................................................50 Exporting Lossy Ogg Vorbis: OGG Audio Files .........................................................51 Exporting Lossy MPEG-3 Format: MP3 Audio Files .................................................52 Exporting Lossy MPEG-4 Format: M4A Audio Files .................................................53 Exporting Narrow Band Format: AMR Audio Files ...................................................54 Summary ...............................................................................................55 ■ Chapter 6: Digital Video: Concepts and Terminology ....................57 Digital Video Concepts and Terminology ...............................................57 Digital Video Concepts: Frames and Frame Rates ..................................................57 Digital Video Mathematics: Doing the Multiplication ..............................................58 Digital Video Algorithms: Digital Video Codecs .......................................................59 Video in Android: MPEG-4 H.264 AVC and WebM ....................................................59 Digital Video Resolutions: Industry Standards ........................................................60 vii www.it-ebooks.info ■ CONTENTS Digital Video Storage: Captive vs. Streaming ..........................................................61 Digital Video Compression: Bit Rates and Playback ...............................................61 Digital Video Optimization: Encoding Software .......................................................62 Digital Video Optimization: Encoder Settings ..........................................................62 Summary ...............................................................................................64 ■ Chapter 7: Digital Video Assets: Data Footprint Optimization ......65 Creating Digital Video Content: Terragen ...............................................65 Creating Uncompressed AVIs: VirtualDub ..............................................68 Applying Video Compression: Squeeze .................................................71 Summary ...............................................................................................76 ■ Chapter 8: Digital Illustration: Concepts and Terminology ...........77 Digital Illustration Is Rendered, Not Stored ...........................................77 Vector Components: Vertices and Curves ..............................................78 The Vertex: The Foundation for Your 2D Shapes .....................................................78 The Path: Connecting Vertices to Create a Shape ...................................................78 The Fill: Filling Your Closed Shapes with Colors .....................................................82 The Stroke: Controlling How Lines and Curves Look ..............................................84 SVG Format: Coding Vector Shape Data ................................................85 Summary ...............................................................................................85 ■ Chapter 9: Digital Illustration: Data Footprint Optimization .........87 Inkscape: Vector Illustration Shape Data ...............................................87 The Layout: Overview of Key Areas in Inkscape .....................................................87 Polygon Shapes: Creating Basic Closed Shapes .....................................................88 SVG Data Export: Using Inkscape File ➤ Save As ..................................................89 Spline Shapes: Creating Complex Shapes ..............................................................91 Data Footprint Optimization: Use Integers .............................................99 Summary .............................................................................................100 viii www.it-ebooks.info ■ CONTENTS ■ Chapter 10: 3D New Media: Concepts and Terminology .............101 Interactive 3D Assets: 3D Vector Content ............................................101 The Foundation of 3D: The Geometry of the Mesh ................................................102 Skinning a 3D Model: Texture Mapping Concepts ................................................108 3D Animation: Keyframes, Motion Curves, and IK .................................................113 Summary .............................................................................................116 ■ Chapter 11: 3D New Media: Data Formats and Platforms ..........117 3D Model Data: Open Source File Formats ..........................................117 Autodesk: 3D Studio for DOS 3DS .........................................................................118 Wavefront Technologies: Advanced Visualizer OBJ ...............................................118 Collada: ISO Collaborative Design Activity DAE .....................................................119 Stereolithography or STL: 3D Systems CAD ..........................................................119 X3D: The ISO Successor to VRML ..........................................................................119 FXML: The JavaFX Markup Language Data Format ..............................................120 Java 3D Support: JavaFX Scene Graph ...............................................120 3D Modeling: Points, Polygons, Mesh, and Shading .............................................121 3D Animation: Timeline, KeyFrame, and Interpolator ............................................122 Third-Party Java Scene Graph 3D Engines ..........................................123 jMonkeyEngine: The JME i3D Game Engine .........................................................123 LWJGL: Lightweight Java Game Library V3 ...........................................................124 JOGL: Java OpenGL, OpenAL, and OpenCL............................................................124 libGDX: Cross-Platform Desktop and Android 3D ..................................................125 Android OpenGL Package: Android i3D ................................................126 Summary .............................................................................................127 ix www.it-ebooks.info