92 lines
4.2 KiB
Markdown
92 lines
4.2 KiB
Markdown
# BigData-Notes
|
||
|
||
|
||
|
||
<div align="center"> <img width="470px" src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/bigdata-notes-icon.png"/> </div>
|
||
|
||
|
||
|
||
> Java 程序员的大数据学习之路 — — 持续更新中
|
||
|
||
|
||
|
||
<table>
|
||
<tr>
|
||
<th><img width="50px" src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/hadoop.jpg"></th>
|
||
<th><img width="50px" src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/hive.jpg"></th>
|
||
<th><img width="50px" src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/spark.jpg"></th>
|
||
<th><img width="50px" src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/flink.png"></th>
|
||
<th><img width="50px" src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/storm.png"></th>
|
||
<th><img width="50px" src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/flume.png"></th>
|
||
<th><img width="50px" src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/oozie.jpg"></th>
|
||
<th><img width="50px" src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/sqoop.png"></th>
|
||
<th><img width="50px" src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/azkaban.png"></th>
|
||
<th><img width="50px" src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/hbase.png"></th>
|
||
<th><img width="50px" src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/kafka.png"></th>
|
||
<th><img width="50px" src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/zookeeper.jpg"></th>
|
||
<th><img width="50px" src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/scala.jpg"></th>
|
||
</tr>
|
||
<tr>
|
||
<td align="center"><a href="#一hadoop">Hadoop</a></td>
|
||
<td align="center"><a href="#二hive">Hive</a></td>
|
||
<td align="center"><a href="#三spark">Spark</a></td>
|
||
<td align="center"><a href="#四flink">Flink</a></td>
|
||
<td align="center"><a href="#五storm">Storm</a></td>
|
||
<td align="center"><a href="#六flume">Flume</a></td>
|
||
<td align="center"><a href="#七oozie">Oozie</a></td>
|
||
<td align="center"><a href="#八sqoop">Sqoop</a></td>
|
||
<td align="center"><a href="#九azkaban">Azkaban</a></td>
|
||
<td align="center"><a href="#十hbase">Hbase</a></td>
|
||
<td align="center"><a href="#十一kafka">Kafka</a></td>
|
||
<td align="center"><a href="#十二zookeeper">Zookeeper</a></td>
|
||
<td align="center"><a href="#十三scala">Scala</a></td>
|
||
</tr>
|
||
</table>
|
||
|
||
|
||
|
||
|
||
> 本仓库涉及的所有软件的详细搭建步骤整理至：[Linux下大数据常用软件安装指南](https://github.com/heibaiying/BigData-Notes/blob/master/notes/Linux中大数据常用软件安装指南.md)
|
||
|
||
|
||
|
||
## 一、Hadoop
|
||
|
||
1. [分布式文件存储系统——HDFS](https://github.com/heibaiying/BigData-Notes/blob/master/notes/Hadoop-HDFS.md)
|
||
2. [分布式计算框架——MapReduce](https://github.com/heibaiying/BigData-Notes/blob/master/notes/Hadoop-MapReduce.md)
|
||
3. [集群资源管理器——YARN](https://github.com/heibaiying/BigData-Notes/blob/master/notes/Hadoop-YARN.md)
|
||
|
||
## 二、Hive
|
||
|
||
1. [数据仓库Hive](https://github.com/heibaiying/BigData-Notes/blob/master/notes/Hive.md)
|
||
|
||
## 三、Spark
|
||
|
||
1. RDD详解
|
||
2. Spark Transformation 和 Action
|
||
|
||
## 四、Flink
|
||
|
||
## 五、Storm
|
||
|
||
1. [Storm核心概念详解](https://github.com/heibaiying/BigData-Notes/blob/master/notes/Storm核心概念详解.md)
|
||
|
||
## 六、Flume
|
||
## 七、Oozie
|
||
## 八、Sqoop
|
||
## 九、Azkaban
|
||
## 十、Hbase
|
||
|
||
1. [Hbase基本环境搭建（Standalone /pseudo-distributed mode）](https://github.com/heibaiying/BigData-Notes/blob/master/notes/installation/Hbase%E5%9F%BA%E6%9C%AC%E7%8E%AF%E5%A2%83%E6%90%AD%E5%BB%BA.md)
|
||
|
||
2. [Hbase系统架构及数据结构](https://github.com/heibaiying/BigData-Notes/blob/master/notes/Hbase%E7%B3%BB%E7%BB%9F%E6%9E%B6%E6%9E%84%E5%8F%8A%E6%95%B0%E6%8D%AE%E7%BB%93%E6%9E%84.md)
|
||
3. [Hbase 常用Shell命令](https://github.com/heibaiying/BigData-Notes/blob/master/notes/Hbase%20Shell.md)
|
||
4. Hbase Java API
|
||
5. Hbase 协处理器
|
||
6. Hbase 备份与恢复
|
||
7. Hbase上的sql层——phoenix
|
||
|
||
## 十一、Kafka
|
||
## 十二、Zookeeper
|
||
## 十三、Scala
|