版权声明:本文为博主原创文章,转载请注明出处。 https://blog.csdn.net/struggling_rong/article/details/81269635
提交一个spark应用时报如下警告:
18/07/29 11:42:37 WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
查看spark UI可以看到有其它的Application 正在运行,
Running Applications
Application ID ▾ Name Cores Memory per Executor Submitted Time
app-20180729114216-0009 (kill) UserClickTrackETL 0 500.0 MB 2018/07/29 11:42:16
app-20180729112305-0006 (kill) Spark shell 4 1024.0 MB 2018/07/29 11:23:05
导致资源不足,因此可以先停止不需要的application