If you store and process massive application datasets, from gigabytes to petabytes, Apache Hadoop is the perfect solution -- and Hadoop: The Definitive Guide is the most thorough resource you'll find on this remarkable framework. With this book, experienced programmers will find methods for analyzing large datasets, and administrators will learn how to set up and run Hadoop clusters. This second edition covers recent changes to Hadoop in depth, including new features such as Hive, Sqoop, and Avro. You'll benefit from case studies that illustrate how Hadoop solves specific problems. * Use the Hadoop Distributed File System (HDFS) for storing large datasets, and use MapReduce to run distributed computations over those datasets * Become familiar with Hadoop's data and I/O building blocks for compression, data integrity, serialization, and persistence * Discover common pitfalls and advanced features for writing real-world MapReduce programs * Design, build, and administer a dedicated Hadoop cluster, or run Hadoop in the cloud * Analyze datasets with Hive, Hadoop's data warehousing system * Use Pig, a high-level query language for large-scale data processing * Take advantage of HBase, Hadoop's database for structured and semi-structured data * Learn ZooKeeper, a toolkit of coordination primitives for building distributed systems "Now you have the opportunity to learn about Hadoop from a master -- not only of the technology, but also of common sense and plain talk." --Doug Cutting, Cloudera

About the Author

Tom White has been an Apache Hadoop committer since February 2007, and is a member of the Apache Software Foundation. He works for Cloudera, a company set up to offer Hadoop support and training. Previously he was as an independent Hadoop consultant, working with companies to set up, use, and extend Hadoop. He has written numerous articles for O'Reilly, java.net and IBM's developerWorks, and has spoken at several conferences, including at ApacheCon 2008 on Hadoop. Tom has a Bachelor's degree in Mathematics from the University of Cambridge and a Master's in Philosophy of Science from the University of Leeds, UK.