Spark连接HBase操作异常处理ERROR spark.SparkContext: Error initializing SparkContext. java.lang.SecurityExcep

异常报错信息:

 ERROR spark.SparkContext: Error initializing SparkContext.
java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s signer information does not match signer information of other classes in the same package
at java.lang.ClassLoader.checkCerts(ClassLoader.java:898)
at java.lang.ClassLoader.preDefineClass(ClassLoader.java:668)
at java.lang.ClassLoader.defineClass(ClassLoader.java:761)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.spark-project.jetty.servlet.ServletContextHandler.(ServletContextHandler.java:136)
at org.spark-project.jetty.servlet.ServletContextHandler.(ServletContextHandler.java:129)
at org.spark-project.jetty.servlet.ServletContextHandler.(ServletContextHandler.java:98)
at org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:129)
at org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:116)
at org.apache.spark.ui.WebUI.attachPage(WebUI.scala:79)
at org.apache.spark.ui.WebUI$$anonfun$attachTab$1.apply(WebUI.scala:63)
at org.apache.spark.ui.WebUI$$anonfun$attachTab$1.apply(WebUI.scala:63)
at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)
at org.apache.spark.ui.WebUI.attachTab(WebUI.scala:63)
at org.apache.spark.ui.SparkUI.initialize(SparkUI.scala:67)
at org.apache.spark.ui.SparkUI.(SparkUI.scala:80)
at org.apache.spark.ui.SparkUI$.create(SparkUI.scala:208)
at org.apache.spark.ui.SparkUI$.createLiveUI(SparkUI.scala:150)
at org.apache.spark.SparkContext.(SparkContext.scala:484)
at org.apache.spark.api.java.JavaSparkContext.(JavaSparkContext.scala:59)


原因:SparkCore读取写入HBase数据操作,引入的spark-core和hbase的servlet-api相关依赖版本不一致导致


解决办法:去掉HBase相关的servlet-api的全部的依赖,如下


    org.apache.hbase
    hbase-annotations
    ${hbase.version}


    org.apache.hbase
    hbase-common
    ${hbase.version}
    
        <exclusion>
            javax.servlet
            servlet-api
        exclusion>
        <exclusion>
            org.mortbay.jetty
            servlet-api
        exclusion>
        <exclusion>
            javax.servlet.jsp
            jsp-api
        exclusion>
        <exclusion>
            org.mortbay.jetty
            servlet-api-2.5
        exclusion>
    

    org.apache.hbase
    hbase-server
    ${hbase.version}
    
        
            org.mortbay.jetty
            servlet-api
        
        
            org.mortbay.jetty
            jsp-api-2.1
        
        
            org.mortbay.jetty
            servlet-api-2.5
        
    

    org.apache.hbase
    hbase-rest
    ${hbase.version}
    
        
            javax.servlet
            *
        
        
            org.mortbay.jetty
            servlet-api
        
        
            org.mortbay.jetty
            servlet-api-2.5
        
    

    org.apache.hbase
    hbase-thrift
    ${hbase.version}
    
        
            javax.servlet
            *
        
        
            org.mortbay.jetty
            servlet-api
        
        
            org.mortbay.jetty
            servlet-api-2.5
        
    



你可能感兴趣的:(spark,spark-异常)