From cf17652c3536599ba891e30cbb7c456818a5ed1d Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?=E7=BD=97=E7=A5=A5?= <1366971433@qq.com> Date: Thu, 14 Mar 2019 14:05:25 +0800 Subject: [PATCH] add hadoop mapreduce --- README.md | 8 +- notes/Hadoop-HDFS.md | 285 +++++++++++------- notes/Hadoop-MapReduce.md | 113 +++++++ notes/Hadoop-YARN.md | 2 +- ...Detailed-Hadoop-MapReduce-Data-Flow-14.png | Bin 0 -> 230931 bytes pictures/hdfs-read-1.jpg | Bin 0 -> 298095 bytes pictures/hdfs-tolerance-1.jpg | Bin 0 -> 317279 bytes pictures/hdfs-tolerance-2.jpg | Bin 0 -> 335033 bytes pictures/hdfs-tolerance-3.jpg | Bin 0 -> 354799 bytes pictures/hdfs-tolerance-4.jpg | Bin 0 -> 348158 bytes pictures/hdfs-tolerance-5.jpg | Bin 0 -> 321197 bytes pictures/hdfs-write-1.jpg | Bin 0 -> 314690 bytes pictures/hdfs-write-2.jpg | Bin 0 -> 304124 bytes pictures/hdfs-write-3.jpg | Bin 0 -> 315100 bytes pictures/mapreduce-combiner.png | Bin 0 -> 14076 bytes pictures/mapreduce-sort.png | Bin 0 -> 153063 bytes pictures/mapreduceProcess.png | Bin 0 -> 275345 bytes 17 files changed, 289 insertions(+), 119 deletions(-) create mode 100644 notes/Hadoop-MapReduce.md create mode 100644 pictures/Detailed-Hadoop-MapReduce-Data-Flow-14.png create mode 100644 pictures/hdfs-read-1.jpg create mode 100644 pictures/hdfs-tolerance-1.jpg create mode 100644 pictures/hdfs-tolerance-2.jpg create mode 100644 pictures/hdfs-tolerance-3.jpg create mode 100644 pictures/hdfs-tolerance-4.jpg create mode 100644 pictures/hdfs-tolerance-5.jpg create mode 100644 pictures/hdfs-write-1.jpg create mode 100644 pictures/hdfs-write-2.jpg create mode 100644 pictures/hdfs-write-3.jpg create mode 100644 pictures/mapreduce-combiner.png create mode 100644 pictures/mapreduce-sort.png create mode 100644 pictures/mapreduceProcess.png diff --git a/README.md b/README.md index cbab82b..b831bd0 100644 --- a/README.md +++ b/README.md @@ -6,7 +6,7 @@ -> 2019大数据常用技术栈学习之路 — — 持续更新中 +> 大数据常用技术栈学习之路 — — 持续更新中 @@ -40,8 +40,12 @@ - ## 一、Hadoop + +1. [分布式文件存储系统——HDFS](https://github.com/heibaiying/BigData-Notes/blob/master/notes/Hadoop-HDFS.md) +2. [分布式计算框架——MapReduce](https://github.com/heibaiying/BigData-Notes/blob/master/notes/Hadoop-MapReduce.md) +3. [集群资源管理器——YARN](https://github.com/heibaiying/BigData-Notes/blob/master/notes/Hadoop-YARN.md) + ## 二、Hive ## 三、Spark ## 四、Flume diff --git a/notes/Hadoop-HDFS.md b/notes/Hadoop-HDFS.md index bfe69a9..bdb1d1d 100644 --- a/notes/Hadoop-HDFS.md +++ b/notes/Hadoop-HDFS.md @@ -1,5 +1,6 @@ -# Hadoop-HDFS -