Flink1.11中Application模式java代码启动遇到的一些问题以及解决方案

Flink1.11通过java代码方式运行Application模式遇到的问题及解决方案:

1.flink-yarn_2.11-1.11.0.jar与maven导入jar包冲突

pom找到对应的dependency进行exclusion即可


    org.apache.flink
    flink-yarn_${scala.binary.version}
    ${flink.version}
    
        
            org.apache.hadoop
            hadoop-yarn-common
        
    

2.Flink1.11无法找到本地导入的core-site

org.apache.hadoop.conf.Configuration conf = new org.apache.hadoop.conf.Configuration();
conf.addResource(new Path("core-site.xml"));
FileSystem fs = FileSystem.get(conf);

3.flink启动报错:

Exception in thread "main" java.net.ConnectException: Call From caiyong/127.0.1.1 to localhost:8020 failed on connection exception: java.net.ConnectException: 拒绝连接; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused

修改core-site.xml中fs.defaultFS的value为HDFS namenode的路径:端口号即可


    
        fs.defaultFS
        hdfs://ip:port
    

你可能感兴趣的:(大数据)