Failing Oozie Launcher, Output data size [2,070] exceeds maximum [2,048]
在读取了属性信息放到oozie节点中的时候因为数据太大了。
File file = new File(System.getProperty("oozie.action.output.properties"));
Properties props = new Properties();
for (String key : prop.keySet()) {
//....
props.setProperty(key, value);
}
OutputStream os = new FileOutputStream(file);
props.store(os, "");
把数据分小点放到其他节点就ok 了 ,或者修改oozie-site.xml文件增加参数
<property>
<name>oozie.servlet.CallbackServlet.max.data.len</name>
<value>4096</value>
</property>
这个参数在最后取出来要赋值给oozie.action.max.output.data这个参数, 默认如果取不到这个参数就是2M
xml 解析错误
Nested exception:
org.xml.sax.SAXParseException: The string "--" is not permitted within comments.
at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.createSAXParseException(ErrorHandlerWrapper.java:195)
at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.fatalError(ErrorHandlerWrapper.java:174)
at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:388)
at com.sun.org.apache.xerces.internal.impl.XMLScanner.reportFatalError(XMLScanner.java:1414)
at com.sun.org.apache.xerces.internal.impl.XMLScanner.scanComment(XMLScanner.java:774)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanComment(XMLDocumentFragmentScannerImpl.java:1040)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2954)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:648)
at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:140)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:511)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:808)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:119)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
at org.dom4j.io.SAXReader.read(SAXReader.java:465)
at org.dom4j.io.SAXReader.read(SAXReader.java:343)
因为在注释中有个多余的 -- 字符,是不能被使用的。
<?xml version="1.0" encoding="UTF-8"?>
<ds xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://xxxx.com/datasourceSchema"
xsi:schemaLocation="http://xxxx.com/outputSchema datasource.xsd">
<queries>
<!-- -- 付款 -->
<query name="unifiedPay" splitBy="id">
<![CDATA[......]]>
</query>
<!-- -- 收款 -->
<query name="unifiedReceived" splitBy="id">
<![CDATA[......]]>
</query>
</queries>
</ds>
所以去掉就ok 了
------------------------------
oozie启动错误。
严重: Context [/oozie] startup failed due to previous errors
2013-11-28 10:51:48 org.apache.catalina.loader.WebappClassLoader clearReferencesJdbc
严重: The web application [/oozie] registered the JDBC driver [com.mysql.jdbc.Driver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered.
2013-11-28 10:51:48 org.apache.catalina.loader.WebappClassLoader clearReferencesJdbc
严重: The web application [/oozie] registered the JDBC driver [org.apache.derby.jdbc.AutoloadedDriver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered.
2013-11-28 10:51:48 org.apache.catalina.loader.WebappClassLoader clearReferencesJdbc
严重: The web application [/oozie] registered the JDBC driver [org.postgresql.Driver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered.
2013-11-28 10:51:48 org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
严重: The web application [/oozie] appears to have started a thread named [Thread-2] but has failed to stop it. This is very likely to create a memory leak.
2013-11-28 10:51:48 org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
严重: The web application [/oozie] appears to have started a thread named [Timer-0] but has failed to stop it. This is very likely to create a memory leak.
2013-11-28 10:51:48 org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
严重: The web application [/oozie] created a ThreadLocal with key of type [org.apache.oozie.util.XLog$Info$1] (value [org.apache.oozie.util.XLog$Info$1@4b51ac10]) and a value of type [org.apache.oozie.util.XLog.Info] (value [org.apache.oozie.util.XLog$Info@5ef77511]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
今天oozie一直起不来,发现mysql服务器磁盘满了,mysql去连接的时候注册不上驱动。把mysql服务器磁盘清理后重启oozie就ok 了。