大數據平臺搭建與運維（簡體書）

本書以任務為載體，以實施過程為主線，將知識點穿插到任務實施過程中，知識體系的構建循序漸進、由易到難、由淺入深，符合普遍認知規律。本書以Hadoop大數據平臺為重點，主要內容包括預備知識、準備Hadoop環境、搭建Hadoop大數據平臺、使用Java語言編寫MapReduce程序、使用Python語言編寫MapReduce程序、Hadoop系統的常見故障及應對和Hadoop系統運維。

項目1　預備知識................................................1
任務1　VirtualBox虛擬機安裝與配置........................................................2
任務2　在VirtualBox中安裝Ubuntu虛擬機...............................................7
任務3　安裝和配置遠程連接工具Xshell...................................................15
任務4　安裝和配置遠程連接工具Xftp......................................................21
任務5　Linux基礎知識............................................................................25
項目2　準備Hadoop環境..................................31
任務1　配置JDK....................................................................................32
任務2　配置SSH免密碼登錄...................................................................35
任務3　Hadoop文件和目錄結構.............................................................39
項目3　搭建Hadoop大數據平臺.........................45
任務1　配置單機模式Hadoop................................................................46
任務2　配置偽分佈模式Hadoop.............................................................50
任務3　配置集群模式Hadoop.................................................................62
任務4　安裝ZooKeeper組件..................................................................75
任務5　配置高可用模式Hadoop.............................................................82
任務6　HDFS........................................................................................92
任務7　Hadoop調優..............................................................................97
任務8　安裝Hive數據倉庫....................................................................102
任務9　搭建Spark計算平臺..................................................................109
項目4　使用Java語言編寫MapReduce程序.........123
任務1　安裝與配置Maven本地倉庫......................................................124
任務2　配置IDEA編程環境...................................................................130
任務3　編寫第一個Java應用程序.........................................................137
任務4　編寫Hadoop經典程序WordCount............................................146
任務5　分析通信基站數據.....................................................................154
項目5　使用Python語言編寫MapReduce程序....159
任務1　WordCount案例......................................................................160
任務2　母嬰產品銷售數據分析..............................................................169
任務3　通信基站數據分析.....................................................................176
項目6　Hadoop系統的常見故障及應對...............185
任務1　Hadoop系統日誌結構及分析....................................................186
任務2　NameNode單節點故障的風險預防...........................................189
任務3　硬件故障及應對........................................................................197
任務4　Hadoop系統的隱私安全...........................................................198
任務5　Hadoop系統的未來..................................................................199
項目7　Hadoop系統運維................................201
任務1　用Ambari搭建Hadoop及生態組件............................................202
任務2　動態增加和刪除Hadoop節點....................................................221
任務3　從SecondaryNameNode恢復NameNode..............................226
任務4　Zabbix安裝與配置....................................................................231
任務5　Ansible基礎.............................................................................241
任務6　使用Ansible部署Hadoop集群..................................................249
任務7　Docker安裝與應用...................................................................252
任務8　使用Docker部署Hadoop集群...................................................257
參考文獻......................................................263