kettle 7.1 集成 HDP2.6 写入HDFS 报错问题

不仅HDP2.6存在问题， 在与Apache Hadoop 2.6.4集成过程中也出现同样的问题。

2017/06/30 12:18:18 - 生成随机数.1 - 完成处理 (I=0, O=0, R=1, W=1, U=0, E=0)
2017/06/30 12:18:18 - 生成随机数.2 - 完成处理 (I=0, O=0, R=1, W=1, U=0, E=0)
2017/06/30 12:18:18 - Hadoop File Output.0 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Unexpected error
2017/06/30 12:18:18 - Hadoop File Output.0 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : java.lang.NullPointerException
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.pentaho.big.data.impl.vfs.hdfs.HDFSFileSystem.addCapabilities(HDFSFileSystem.java:51)
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.apache.commons.vfs2.provider.AbstractFileSystem.init(AbstractFileSystem.java:123)
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.apache.commons.vfs2.provider.AbstractVfsContainer.addComponent(AbstractVfsContainer.java:53)
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.apache.commons.vfs2.provider.AbstractFileProvider.addFileSystem(AbstractFileProvider.java:103)
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.apache.commons.vfs2.provider.AbstractOriginatingFileProvider.getFileSystem(AbstractOriginatingFileProvider.java:103)
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.apache.commons.vfs2.provider.AbstractOriginatingFileProvider.findFile(AbstractOriginatingFileProvider.java:80)
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.apache.commons.vfs2.provider.AbstractOriginatingFileProvider.findFile(AbstractOriginatingFileProvider.java:64)
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.apache.commons.vfs2.impl.DefaultFileSystemManager.resolveFile(DefaultFileSystemManager.java:790)
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.apache.commons.vfs2.impl.DefaultFileSystemManager.resolveFile(DefaultFileSystemManager.java:712)
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.pentaho.di.core.vfs.KettleVFS.getFileObject(KettleVFS.java:152)
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.pentaho.di.core.vfs.KettleVFS.getFileObject(KettleVFS.java:107)
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.pentaho.di.trans.steps.textfileoutput.TextFileOutput.getFileObject(TextFileOutput.java:1032)
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.pentaho.di.trans.steps.textfileoutput.TextFileOutput.isFileExist(TextFileOutput.java:215)
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.pentaho.di.trans.steps.textfileoutput.TextFileOutput.processRow(TextFileOutput.java:127)
2017/06/30 12:18:18 - Hadoop File Output.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2017/06/30 12:18:18 - Hadoop File Output.0 - at java.lang.Thread.run(Thread.java:745)
2017/06/30 12:18:18 - Hadoop File Output.0 - 完成处理 (I=0, O=0, R=1, W=0, U=0, E=1)
2017/06/30 12:18:18 - test3 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : 错误被检测到!
2017/06/30 12:18:18 - Spoon - 转换完成!!
2017/06/30 12:18:18 - test3 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : 错误被检测到!
2017/06/30 12:18:18 - test3 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : 错误被检测到!

开始问题分析

先到官网看一下 Hadoop File Output 的相关介绍

http://wiki.pentaho.com/display/EAI/Hadoop+File+Output

看下7.1 的文档

https://help.pentaho.com/Documentation/7.1

https://help.pentaho.com/Documentation/7.1/0H0/Set_Up_Pentaho_to_Connect_to_a_Hortonworks_Cluster#Step_3:_Copy_the_Configuration_Files_from_Cluster_to_Shim

设置Pentaho连接到Hortonworks集群

https://help.pentaho.com/Documentation/7.1/0H0/Set_Up_Pentaho_to_Connect_to_a_Hortonworks_Cluster