blog/BigData-Notes
2
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update Spark单机版本环境搭建.md

Browse Source
This commit is contained in:
heibaiying 2019-03-22 13:46:57 +08:00 committed by GitHub
parent 2253985fee
commit fe561d883c
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
notes/installation/Spark单机版本环境搭建.md
View File

@ -107,7 +107,7 @@ hadoop,hadoop
#### 3. 在scala交互式命令行中执行如下命名 #### 3. 在scala交互式命令行中执行如下命名
```scala ```scala
val file = spark.sparkContext.textFile("file:///usr/app//wc.txt") val file = spark.sparkContext.textFile("file:///usr/app/wc.txt")
val wordCounts = file.flatMap(line => line.split(",")).map((word => (word, 1))).reduceByKey(_ + _) val wordCounts = file.flatMap(line => line.split(",")).map((word => (word, 1))).reduceByKey(_ + _)
wordCounts.collect wordCounts.collect
``` ```
@ -118,4 +118,4 @@ wordCounts.collect
通过spark shell web-ui可以查看作业的执行情况，访问端口为4040 通过spark shell web-ui可以查看作业的执行情况，访问端口为4040
<div align="center"> <img src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/spark-shell-web-ui.png"/> </div> <div align="center"> <img src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/spark-shell-web-ui.png"/> </div>