pyspark config设置、增加配置、限制_success文件生成;spark-submit 集群提交参数
1、pyspark增加config设置javaheap错误增加内存spark=(SparkSession.builder.config("spark.hadoop.hive.exec.dynamic.partition","true").config("spark.hadoop.hive.exec.dynamic.partition.mode","nonstrict").config("spark