Hadoop 2 Quick-Start Guide Learn the Essentials of Big Data Computing in the Apache Hadoop 2 Ecosystem

by Eadline, Douglas

• ISBN13: 9780134049946
• ISBN10: 0134049942
• Edition: 1st
• Format: Paperback
• Copyright: 2015-10-26
• Publisher: Addison-Wesley Professional
• More Book Details

Summary

Get Started Fast with Apache Hadoop^® 2, YARN, and Today’s Hadoop Ecosystem

 

With Hadoop 2.x and YARN, Hadoop moves beyond MapReduce to become practical for virtually any type of data processing. Hadoop 2.x and the Data Lake concept represent a radical shift away from conventional approaches to data usage and storage. Hadoop 2.x installations offer unmatched scalability and breakthrough extensibility that supports new and existing Big Data analytics processing methods and models.

 

Hadoop^® 2 Quick-Start Guide is the first easy, accessible guide to Apache Hadoop 2.x, YARN, and the modern Hadoop ecosystem. Building on his unsurpassed experience teaching Hadoop and Big Data, author Douglas Eadline covers all the basics you need to know to install and use Hadoop 2 on personal computers or servers, and to navigate the powerful technologies that complement it.

 

Eadline concisely introduces and explains every key Hadoop 2 concept, tool, and service, illustrating each with a simple “beginning-to-end” example and identifying trustworthy, up-to-date resources for learning more.

 

This guide is ideal if you want to learn about Hadoop 2 without getting mired in technical details. Douglas Eadline will bring you up to speed quickly, whether you’re a user, admin, devops specialist, programmer, architect, analyst, or data scientist.

 

Coverage Includes

• Understanding what Hadoop 2 and YARN do, and how they improve on Hadoop 1 with MapReduce
• Understanding Hadoop-based Data Lakes versus RDBMS Data Warehouses
• Installing Hadoop 2 and core services on Linux machines, virtualized sandboxes, or clusters
• Exploring the Hadoop Distributed File System (HDFS)
• Understanding the essentials of MapReduce and YARN application programming
• Simplifying programming and data movement with Apache Pig, Hive, Sqoop, Flume, Oozie, and HBase
• Observing application progress, controlling jobs, and managing workflows
• Managing Hadoop efficiently with Apache Ambari–including recipes for HDFS to NFSv3 gateway, HDFS snapshots, and YARN configuration
• Learning basic Hadoop 2 troubleshooting, and installing Apache Hue and Apache Spark

 

Author Biography

Doug Eadline, Ph.D., began his career as a practitioner and a chronicler of the Linux Cluster HPC revolution and now documents big data analytics. Starting with the first Beowulf How To document, Dr. Eadline has written hundreds of articles, white papers, and instructional documents covering virtually all aspects of HPC computing. Prior to starting and editing the popular ClusterMonkey.net web site in 2005, he served as editor-in-chief for ClusterWorld Magazine, and was Senior HPC Editor for Linux Magazine. Currently, he is a consultant to the HPC industry and writes a monthly column in HPC Admin Magazine. He has practical hands on experience in many aspects of HPC including, hardware and software design, benchmarking, storage, GPU, cloud, and parallel computing. He is the coauthor of Apache Hadoop™ YARN book, Hadoop Fundamentals LiveLessons,and Apache Hadoop YARN LiveLessons.

Table of Contents

Introduction: A Roadmap for Apache Hadoop
1. Background and Concepts
2. Installing Apache Hadoop
3. Using the Hadoop Distributed File System
4. Running Example Programs and Benchmarking
5. Hadoop MapReduce Framework
6. MapReduce Programming Examples
7. Higher Level Tools
8. Introduction to Apache Hadoop YARN Frameworks
9. Administration Procedures
Summary and Additional Resources
Appendix A. Getting Started Check List/Flow Chart
Appendix B. Roadmap of Additional Apache Hadoop Resources By Topic
Appendix C. Book Web Page and Reference Scripts