Java实现读取HDFS目录

LOG.info("检查是否有当前日期的目录");
        fsUtil.checkDirExists(new File(configUtil.readConfig("download.file.path") + currentDay));
        FSDataInputStream in = null;
        LOG.info("生成以JobID命名的目录");
        String fileName = configUtil.readConfig("download.file.path") + currentDay + "/" + jobID + ".csv";
        File file = new File(fileName);
        List> dataList = new ArrayList<>();
        InputStreamReader inputStreamReader = null;
        try {
            String dataPath = configUtil.readConfig("offLine.data.path") + currentDay + "/" + jobID + ".csv/";
            LOG.info(dataPath);
            Path path = new Path(dataPath);
            Configuration configuration = dfsUtil.getHadoopConf();
            FileSystem hdfs = FileSystem.get(configuration);
            BufferedReader br = null;
            if (hdfs.exists(path) && hdfs.isDirectory(path)) {
                FileStatus[] srcFileStatus = 

你可能感兴趣的:(Java,大数据挖掘与大数据应用案例,Java,HDFS,Hadoop)