Spark-submit诡异问题之:ERROR XJ040: Failed to start database 'metastore_db'

背景


今天写了一个spark jar包任务,在CDH集群上命令提交

 export HADOOP_USER_NAME=lcc;spark2-submit --class com.dtwave.spark.SparkMain --name structured-stream-test --master yarn --deploy-mode client --queue default ./SparkStructuredPlatform-1.0-SNAPSHOT-jar-with-dependencies.jar  log-level=INFO app-name=lcc master-name=yarn  enable-hive=false input-bootstrap-server=kylin1.dev.local:9092,kylin2.dev.local:9093,kylin3.dev.local:9094 input-topic=topic_lcc input-schema=id,IntegerType#name,StringType#eventTime,StringType sql="select * from record" sink-model=append format=console trigger-mill=10

这样提交不报错,但是因为是程序启动的,app中也是调用上述命令提交,但是报错,错误如下

19/07/22 15:05:18 INFO spark.SparkContext: Registered listener com.cloudera.spark.l

你可能感兴趣的:(大数据-spark)