Spark Yarn Client模式spark.driver.host导致 Cannot assign requested address: Service 'sparkDriver' failed

1.背景

[deploy@fideploy cheetah-node]$  /opt/cloudera/parcels/SPARK2/bin/spark2-submit  --keytab /etc/security/keytabs/cluster_user.keytab --principal [email protected] --class com.dtwave.cheetah.node.spark.structured.streaming.StructureStreamingExecutor --name test --master yarn --deploy-mode client --queue root.default /opt/workspace/cheetah-node/libs/spark-structured-streaming.jar  deploy-mode=client  task-protocol=/data/cheetah-node/codes/T_6167372758075432_20190829211641_2_1/stream_info   yarn-address=xxx:8032


WARNING: User-defined SPARK_HOME (/opt/cloudera/parcels/SPARK2-2.2.0.cloudera4-1.cdh5.13.3.p0.603055/lib/spark2) overrides detected (/opt/cloudera/parcels/SPARK2/lib/spark2).
WARNING: Running spark-class from us

你可能感兴趣的:(大数据-spark)