flink在Linux的运行方式

普通的jar:主类入口是普通的类,监控kafka,但是里面又创建了flink批环境

nohup java -jar -Xmx8192m -Xms2048m  k4.jar &

flink jar:主类就是flink的入库监控

bin/flink run -m yarn-cluster -p 3 -c flinkonkafka -yjm 2048m -ytm 8192m /test/flink_test.jar

 

报错:Flink Could not resolve substitution to a value: ${akka.stream.materializer}

报错现象:

Exception in thread "main" com.typesafe.config.ConfigException$UnresolvedSubstitution: reference.conf @ jar:file:/bigdata/app/flink-1.0-SNAPSHOT-jar-with-dependencies.jar!/reference.conf: 804: Could not resolve substitution to a value: ${akka.stream.materializer}

flink在Linux的运行方式_第1张图片

pom文件里面添加:


     reference.conf

  4.0.0
  com.yss.datamiddle
  test-scala
  1.0-SNAPSHOT
  2008

  
    2.12.6
    2.12
    UTF-8
    2.7.0
    2.1.0
    1.10.0
    2.2.1
    1.8.0
    3.0.0
    1.10.0
    1.0
    2.2
    12.1.0.2
    2.12
    1.1.22
    2.2.1
    3.5.0
    1.2.3
    2.8.6
      2.4.1


  

  
    
    
      com.alibaba
      druid
      ${druid.version}
    
    
      org.apache.flink
      flink-table-api-scala-bridge_2.12
      ${flink.version}
    
    
      org.apache.flink
      flink-table-api-java-bridge_2.12
      ${flink.version}
    
    
      org.apache.flink
      flink-table-planner-blink_${scala.binary.version}
      ${flink.version}
      
    
    
    
      org.apache.flink
      flink-table-planner_${scala.binary.version}
      ${flink.version}
    
    
      org.apache.flink
      flink-table-common
      ${flink.version}
    
    
      org.apache.flink
      flink-connector-hive_2.12
      ${flink.version}
      ${scope}
    
    
      com.google.code.gson
      gson
      ${gson.version}
    





    
    
      org.apache.flink
      flink-connector-kafka-0.11_2.12
      ${flink.version}
    

    
    
      net.minidev
      json-smart
      ${json.smart.version}
    
    
    
      com.typesafe.scala-logging
      scala-logging_2.12
      ${scala.logging.version}
    
    
      ch.qos.logback
      logback-classic
      ${logback.classic.version}
    

    


    
      org.apache.flink
      flink-scala_2.12
      ${flink.version}
    

    
      org.apache.flink
      flink-hbase_2.12
      ${flink.version}
    

    
      org.apache.flink
      flink-clients_2.12
      ${flink.version}
    

    
      org.apache.flink
      flink-java
      ${flink.version}
    

    
      org.apache.hbase
      hbase-client
      ${hbase.version}
    

    
    
      
      
      
      
      
    
    
      org.apache.hbase
      hbase-server
      ${hbase.version}
    
    
      org.apache.hbase
      hbase-common
      ${hbase.version}
      
        
          jdk.tools
          jdk.tools
          
        
      
    

    
      org.apache.flink
      flink-jdbc_2.12
      ${flink.jdbc.version}
    
    
    
      org.apache.flink
      flink-streaming-scala_2.12
      ${flink.streaming.scala.version}
    

    
      org.scalanlp
      breeze_2.12
      ${breeze.version}
    

    
      org.apache.commons
      commons-math
      ${commons.math.version}
    

    
      com.github.noraui
      ojdbc7
      ${oracle.version}
    
    
      org.scalaj
      scalaj-http_2.12
      ${http.scala.version}
    
  


  
    
    src/main/scala
    

      
        net.alchim31.maven
        scala-maven-plugin
        4.4.0
        
          
            
              compile
              testCompile
            
          
        
      

      
        maven-compiler-plugin
        3.6.0
        
          1.8
          1.8
        
      
      






































      
      
        org.apache.maven.plugins
        maven-shade-plugin
        2.4.3
        
          
            package
            
              shade
            
            
              
                
                  *:*
                  
                    META-INF/*.SF
                    META-INF/*.DSA
                    META-INF/*.RSA
                  
                
              
              
              
                
                  flinkonkafka.KafkaConsumer
                
                -->
                              reference.conf
                            
              
            
          
        
      
    

    
      
        src/main/resources
        
          **/*.xml
          **/*.yml
        
        false
      
    
  


 

你可能感兴趣的:(Flink)