Spark日志显示
ERROR executor.CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM

原因
Spark开启了资源动态分配,当executors空闲达到设定时间后会被移除。
spark.dynamicAllocation.enabled=true spark.dynamicAllocation.executorIdleTimeout=60s
解决
CDH平台,搜索 dynamicAllocation,取消动态分配,或者加长时间。

发布者:全栈程序员-站长,转载请注明出处:https://javaforall.net/228469.html原文链接:https://javaforall.net
