SparkSQL执行错误run at ThreadPoolExecutor.java:1149

为了窥视SparkSQL执行SQL时的内在机制,新建一个测试表test
create table test(key string,value string)
基于这个测试表,执行下面的sql语句,关键字explain extended可以在console里打印详细日志。
explain extended select a.key*(2+3),b.value from test a join test b on a.key = b.key and a.key >3;

  • console详细日志:


    SparkSQL执行错误run at ThreadPoolExecutor.java:1149_第1张图片
    console详细日志.png

    即:


    SparkSQL执行错误run at ThreadPoolExecutor.java:1149_第2张图片
    Spark SQL架构.png
  • Spark UI http://hadoop000:4040/jobs/页面中看到错误:
    run at ThreadPoolExecutor.java:1149

SparkSQL执行错误run at ThreadPoolExecutor.java:1149_第3张图片
image.png

https://stackoverflow.com/questions/40852622/what-are-threadpoolexecutors-jobs-in-web-ui

你可能感兴趣的:(SparkSQL执行错误run at ThreadPoolExecutor.java:1149)