blog/BigData-Notes
2
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update Spark部署模式与作业提交.md

Browse Source
This commit is contained in:
heibaiying 2019-05-19 21:38:32 +08:00 committed by GitHub
parent f1c74d38a2
commit 86499fd885
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
notes/Spark部署模式与作业提交.md
View File

@ -172,10 +172,9 @@ check your cluster UI to ensure that workers are registered and have sufficient
这时候可以查看Web UI，我这里是内存空间不足：提交命令中要求作业的`executor-memory`是2G，但是实际的工作节点的`Memory`只有1G，这时候你可以修改`--executor-memory`，也可以修改 Woker 的`Memory`，其默认值为主机所有可用内存值减去1G。
<div align="center"> <img src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/spark-内存不足.png"/> </div>
<div align="center"> <img src="https://github.com/heibaiying/BigData-Notes/blob/master/pictures/spark-内存不足.png"/> </div>
<br/>
关于Master和Woker节点的所有可选配置如下，可以在`spark-env.sh`进行对应的配置：
关于Master和Woker节点的所有可选配置如下，可以在`spark-env.sh`中进行对应的配置：
| Environment Variable（环境变量） | Meaning（含义） |
| -------------------------------- | ------------------------------------------------------------ |