磨刀人

【成功】maven编译 apache falcon0.9源码_RedHat6.4

背景

最近一直在调查数据分析以及集群的软件，接下来，又开始了BI的调查了，今天就收到邮件，让调查apache falcon。各种环境折腾又开始了。

先理解一下Falcon的架构：

事前准备

apache falcon源码（本次使用的是最新的apache-falcon-0.9-sources.tar.gz）
jdk(1.7/1.8)
maven(3.X) apache-maven-3.0.3-bin.tar.gz 【后续提示出错，换成maven3.1.0】

安装

JDK

JDK的安装，此处就不再说明了，很简单，装完后记得配置/etc/profile里JAVA_HOME，完后source一下就OK了，确认如下：

[root@sv004 project]# java -version
java version "1.7.0_67"
Java(TM) SE Runtime Environment (build 1.7.0_67-b01)
Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)

maven

maven的安装，本人第一次，也很简单，解压，配置MAVEN_BIN，然后使用mvn -v确认是否安装。效果如下所示：

[root@sv004 apache-maven-3.0.3]# ./bin/mvn -v
Apache Maven 3.0.3 (r1075438; 2011-03-01 02:31:09+0900)
Maven home: /home/project/apache-maven-3.0.3
Java version: 1.7.0_67, vendor: Oracle Corporation
Java home: /usr/java/jdk1.7.0_67/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "2.6.32-431.el6.x86_64", arch: "amd64", family: "unix"

本次的重点来了

使用maven编译falcon源码

1.解压falcon源码

tar -xzvf apache-falcon-${project.version}-source.tar.gz
cd falcon-sources-${project.version}

2.编译falcon

export MAVEN_OPTS="-Xmx1024m -XX:MaxPermSize=256m -noverify" && mvn clean install

但此时报错了

[INFO] Scanning for projects...
Downloading: http://repo1.maven.org/maven2/org/apache/apache/17/apache-17.pom
Downloading: https://raw.github.com/InMobi/mvn-repo/master/releases/org/apache/apache/17/apache-17.pom
Downloading: http://repo.hortonworks.com/content/repositories/releases/org/apache/apache/17/apache-17.pom
Downloading: https://repository.apache.org/content/groups/snapshots/org/apache/apache/17/apache-17.pom
Downloading: https://repository.apache.org/content/groups/public/org/apache/apache/17/apache-17.pom
Downloading: https://maven.java.net/content/groups/public/org/apache/apache/17/apache-17.pom
Downloading: https://repository.jboss.org/nexus/content/groups/public/org/apache/apache/17/apache-17.pom
Downloading: https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/apache/17/apache-17.pom
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]   
[ERROR]   The project org.apache.falcon:falcon-main:0.9 (/home/project/apache-maven-3.0.3/falcon-sources-0.9/pom.xml) has 1 error
[ERROR]     Non-resolvable parent POM: Could not transfer artifact org.apache:apache:pom:17 from/to central (http://repo1.maven.org/maven2): Error transferring file: repo1.maven.org and 'parent.relativePath' points at wrong local POM @ line 21, column 13: Unknown host repo1.maven.org -> [Help 2]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException

原因

根据Unkown host信息调查了一下，应该是代理设置的有问题，我的maven使用的是默认的，没有设置，坑就被我踩到了。

参考URL:http://stackoverflow.com/questions/15334394/could-not-transfer-artifact-org-apache-maven-pluginsmaven-surefire-pluginpom2/15334627#15334627

解决策

修改我的maven/conf/setting.xml，如下所示：

  
     
      true
      http
      ***.***.***.***  ⇒代理的IP地址
      8080
      maven

完后重新执行

export MAVEN_OPTS="-Xmx1024m -XX:MaxPermSize=256m -noverify" && mvn clean install

第一次时间比较长，取决你的网速，因为要下载好多依赖包文件。

好事多磨呀.....

Exception while executing SCM command.
[INFO] Storing buildScmBranch: UNKNOWN_BRANCH
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ falcon-ui ---
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Falcon ..................................... SUCCESS [18:56.122s]
[INFO] Apache Falcon UI .................................. FAILURE [3.810s]
[INFO] Checkstyle ........................................ SKIPPED
[INFO] Build Tools ....................................... SKIPPED
[INFO] Apache Falcon Java client ......................... SKIPPED
[INFO] Apache Falcon CLI client .......................... SKIPPED
[INFO] Apache Falcon Metrics ............................. SKIPPED
[INFO] Apache Falcon Hadoop Dependencies ................. SKIPPED
[INFO] Apache Falcon Test Utility ........................ SKIPPED
[INFO] Apache Falcon Commons ............................. SKIPPED
[INFO] Apache Falcon Oozie EL Extension .................. SKIPPED
[INFO] Apache Falcon Embedded Hadoop - Test Cluster ...... SKIPPED
[INFO] Apache Falcon Sharelib Hive - Test Cluster ........ SKIPPED
[INFO] Apache Falcon Sharelib Pig - Test Cluster ......... SKIPPED
[INFO] Apache Falcon Sharelib Hcatalog - Test Cluster .... SKIPPED
[INFO] Apache Falcon Sharelib Oozie - Test Cluster ....... SKIPPED
[INFO] Apache Falcon Test Tools - Test Cluster ........... SKIPPED
[INFO] Apache Falcon Messaging ........................... SKIPPED
[INFO] Apache Falcon LIfecycle Module .................... SKIPPED
[INFO] Apache Falcon Oozie Adaptor ....................... SKIPPED
[INFO] Apache Falcon Scheduler ........................... SKIPPED
[INFO] Apache Falcon Acquisition ......................... SKIPPED
[INFO] Apache Falcon Distcp Replication .................. SKIPPED
[INFO] Apache Falcon Retention ........................... SKIPPED
[INFO] Apache Falcon Archival ............................ SKIPPED
[INFO] Apache Falcon Rerun ............................... SKIPPED
[INFO] Apache Falcon Prism ............................... SKIPPED
[INFO] falcon-unit ....................................... SKIPPED
[INFO] Apache Falcon Web Application ..................... SKIPPED
[INFO] Apache Falcon Documentation ....................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 19:04.642s
[INFO] Finished at: Thu Apr 14 02:38:36 JST 2016
[INFO] Final Memory: 18M/237M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.github.eirslett:frontend-maven-plugin:0.0.23:install-node-and-npm (install node and npm) on project falcon-ui: The plugin com.github.eirslett:frontend-maven-plugin:0.0.23 requires Maven version 3.1.0 -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginIncompatibleException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :falcon-ui

根据报错信息来看，maven的版本与下载的插件的版本不一致导致的，根据提示信息，遂决定使用maven3.1.0。

构建好Maven3.1.0的环境后，重新再次编译falcon源码，结果悲剧了，install-node-and-npm无法下载.......

[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Falcon ..................................... SUCCESS [2.380s]
[INFO] Apache Falcon UI .................................. FAILURE [1:02.489s]
[INFO] Checkstyle ........................................ SKIPPED
[INFO] Build Tools ....................................... SKIPPED
[INFO] Apache Falcon Java client ......................... SKIPPED
[INFO] Apache Falcon CLI client .......................... SKIPPED
[INFO] Apache Falcon Metrics ............................. SKIPPED
[INFO] Apache Falcon Hadoop Dependencies ................. SKIPPED
[INFO] Apache Falcon Test Utility ........................ SKIPPED
[INFO] Apache Falcon Commons ............................. SKIPPED
[INFO] Apache Falcon Oozie EL Extension .................. SKIPPED
[INFO] Apache Falcon Embedded Hadoop - Test Cluster ...... SKIPPED
[INFO] Apache Falcon Sharelib Hive - Test Cluster ........ SKIPPED
[INFO] Apache Falcon Sharelib Pig - Test Cluster ......... SKIPPED
[INFO] Apache Falcon Sharelib Hcatalog - Test Cluster .... SKIPPED
[INFO] Apache Falcon Sharelib Oozie - Test Cluster ....... SKIPPED
[INFO] Apache Falcon Test Tools - Test Cluster ........... SKIPPED
[INFO] Apache Falcon Messaging ........................... SKIPPED
[INFO] Apache Falcon LIfecycle Module .................... SKIPPED
[INFO] Apache Falcon Oozie Adaptor ....................... SKIPPED
[INFO] Apache Falcon Scheduler ........................... SKIPPED
[INFO] Apache Falcon Acquisition ......................... SKIPPED
[INFO] Apache Falcon Distcp Replication .................. SKIPPED
[INFO] Apache Falcon Retention ........................... SKIPPED
[INFO] Apache Falcon Archival ............................ SKIPPED
[INFO] Apache Falcon Rerun ............................... SKIPPED
[INFO] Apache Falcon Prism ............................... SKIPPED
[INFO] falcon-unit ....................................... SKIPPED
[INFO] Apache Falcon Web Application ..................... SKIPPED
[INFO] Apache Falcon Documentation ....................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:05.883s
[INFO] Finished at: Thu Apr 14 20:57:47 JST 2016
[INFO] Final Memory: 30M/303M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.github.eirslett:frontend-maven-plugin:0.0.23:install-node-and-npm (install node and npm) on project falcon-ui: Could not extract the Node archive: Could not extract archive: '/home/project/apache-maven-3.1.0/falcon-sources-0.9/falcon-ui/node_tmp/node.tar.gz': EOFException -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :falcon-ui

调查了好久，最终来发现，原来是磁盘没有空间了，刚开始还以为是公司的网速的问题【PS:我们公司的网太烂了，刷个页面要好久】

清空一部分空间出来后，又出幺蛾子了.....

[ERROR] npm WARN package.json [email protected] No repository field.
[ERROR] npm http GET https://registry.npmjs.org/phantomjs
[ERROR] npm http GET https://registry.npmjs.org/protractor
[ERROR] npm http 304 https://registry.npmjs.org/protractor
[ERROR] npm http 304 https://registry.npmjs.org/phantomjs
[ERROR] npm http GET https://registry.npmjs.org/hasha
[ERROR] npm http GET https://registry.npmjs.org/kew
[ERROR] npm http GET https://registry.npmjs.org/progress
[ERROR] npm http GET https://registry.npmjs.org/request
[ERROR] npm http GET https://registry.npmjs.org/request-progress
[ERROR] npm http GET https://registry.npmjs.org/which
[ERROR] npm http GET https://registry.npmjs.org/extract-zip
[ERROR] npm http GET https://registry.npmjs.org/fs-extra
[ERROR] npm http GET https://registry.npmjs.org/request
[ERROR] npm http GET https://registry.npmjs.org/selenium-webdriver/2.44.0
[ERROR] npm http GET https://registry.npmjs.org/minijasminenode/1.1.1
[ERROR] npm http GET https://registry.npmjs.org/jasminewd/1.1.0
[ERROR] npm http GET https://registry.npmjs.org/jasminewd2/0.0.2
[ERROR] npm http GET https://registry.npmjs.org/jasmine/2.1.1
[ERROR] npm http GET https://registry.npmjs.org/saucelabs
[ERROR] npm http GET https://registry.npmjs.org/glob
[ERROR] npm http GET https://registry.npmjs.org/adm-zip/0.4.4
[ERROR] npm http GET https://registry.npmjs.org/optimist
[ERROR] npm http GET https://registry.npmjs.org/q/1.0.0
[ERROR] npm http GET https://registry.npmjs.org/lodash
[ERROR] npm http GET https://registry.npmjs.org/source-map-support
[ERROR] npm http GET https://registry.npmjs.org/html-entities
[ERROR] npm http GET https://registry.npmjs.org/accessibility-developer-tools
[ERROR] npm http 304 https://registry.npmjs.org/request-progress
[ERROR] npm http 304 https://registry.npmjs.org/request
[ERROR] npm http 304 https://registry.npmjs.org/hasha
[ERROR] npm http 304 https://registry.npmjs.org/fs-extra
[ERROR] npm http 304 https://registry.npmjs.org/html-entities
[ERROR] npm http 304 https://registry.npmjs.org/adm-zip/0.4.4
[ERROR] npm http 304 https://registry.npmjs.org/q/1.0.0
[ERROR] npm http 304 https://registry.npmjs.org/selenium-webdriver/2.44.0
[ERROR] npm http GET https://registry.npmjs.org/selenium-webdriver/-/selenium-webdriver-2.44.0.tgz
[ERROR] npm http 304 https://registry.npmjs.org/accessibility-developer-tools
[ERROR] npm http 304 https://registry.npmjs.org/progress
[ERROR] npm http 304 https://registry.npmjs.org/jasminewd/1.1.0
[ERROR] npm http 304 https://registry.npmjs.org/request
[ERROR] npm http 304 https://registry.npmjs.org/jasmine/2.1.1
[ERROR] npm http 304 https://registry.npmjs.org/extract-zip
[ERROR] npm http 304 https://registry.npmjs.org/which
[ERROR] npm http 304 https://registry.npmjs.org/source-map-support
[ERROR] npm http 304 https://registry.npmjs.org/jasminewd2/0.0.2
[ERROR] npm http 200 https://registry.npmjs.org/selenium-webdriver/-/selenium-webdriver-2.44.0.tgz
[ERROR] npm http 304 https://registry.npmjs.org/kew
[ERROR] npm http GET https://registry.npmjs.org/is-stream
[ERROR] npm http GET https://registry.npmjs.org/pinkie-promise
[ERROR] npm http GET https://registry.npmjs.org/mkdirp/0.5.0
[ERROR] npm http GET https://registry.npmjs.org/yauzl/2.4.1
[ERROR] npm http GET https://registry.npmjs.org/concat-stream/1.5.0
[ERROR] npm http GET https://registry.npmjs.org/debug/0.7.4
[ERROR] npm http GET https://registry.npmjs.org/is-absolute
[ERROR] npm http GET https://registry.npmjs.org/isexe
[ERROR] npm http GET https://registry.npmjs.org/throttleit
[ERROR] npm http GET https://registry.npmjs.org/graceful-fs
[ERROR] npm http GET https://registry.npmjs.org/jsonfile
[ERROR] npm http GET https://registry.npmjs.org/klaw
[ERROR] npm http GET https://registry.npmjs.org/path-is-absolute
[ERROR] npm http GET https://registry.npmjs.org/rimraf
[ERROR] npm http GET https://registry.npmjs.org/bl
[ERROR] npm http GET https://registry.npmjs.org/caseless
[ERROR] npm http GET https://registry.npmjs.org/extend
[ERROR] npm http GET https://registry.npmjs.org/forever-agent
[ERROR] npm http GET https://registry.npmjs.org/form-data
[ERROR] npm http GET https://registry.npmjs.org/json-stringify-safe
[ERROR] npm http GET https://registry.npmjs.org/mime-types
[ERROR] npm http GET https://registry.npmjs.org/node-uuid
[ERROR] npm http GET https://registry.npmjs.org/qs
[ERROR] npm http GET https://registry.npmjs.org/tunnel-agent
[ERROR] npm http GET https://registry.npmjs.org/tough-cookie
[ERROR] npm http GET https://registry.npmjs.org/http-signature
[ERROR] npm http GET https://registry.npmjs.org/oauth-sign
[ERROR] npm http GET https://registry.npmjs.org/aws-sign2
[ERROR] npm http GET https://registry.npmjs.org/hawk
[ERROR] npm http GET https://registry.npmjs.org/stringstream
[ERROR] npm http GET https://registry.npmjs.org/combined-stream
[ERROR] npm http GET https://registry.npmjs.org/isstream
[ERROR] npm http GET https://registry.npmjs.org/is-typedarray
[ERROR] npm http GET https://registry.npmjs.org/har-validator
[ERROR] npm http 304 https://registry.npmjs.org/saucelabs
[ERROR] npm http 304 https://registry.npmjs.org/mkdirp/0.5.0
[ERROR] npm http 304 https://registry.npmjs.org/pinkie-promise
[ERROR] npm http 304 https://registry.npmjs.org/is-stream
[ERROR] npm http 304 https://registry.npmjs.org/path-is-absolute
[ERROR] npm http GET https://registry.npmjs.org/pinkie
[ERROR] npm http 304 https://registry.npmjs.org/rimraf
[ERROR] npm http 304 https://registry.npmjs.org/concat-stream/1.5.0
[ERROR] npm http 304 https://registry.npmjs.org/isexe
[ERROR] npm http 304 https://registry.npmjs.org/graceful-fs
[ERROR] npm http 304 https://registry.npmjs.org/klaw
[ERROR] npm http 304 https://registry.npmjs.org/json-stringify-safe
[ERROR] npm http 304 https://registry.npmjs.org/qs
[ERROR] npm http 304 https://registry.npmjs.org/tough-cookie
[ERROR] npm http 304 https://registry.npmjs.org/http-signature
[ERROR] npm http 304 https://registry.npmjs.org/stringstream
[ERROR] npm http 304 https://registry.npmjs.org/isstream
[ERROR] npm http 304 https://registry.npmjs.org/har-validator
[ERROR] npm http 304 https://registry.npmjs.org/yauzl/2.4.1
[ERROR] npm http 304 https://registry.npmjs.org/tunnel-agent
[ERROR] npm http 304 https://registry.npmjs.org/form-data
[ERROR] npm http 304 https://registry.npmjs.org/combined-stream
[ERROR] npm http 304 https://registry.npmjs.org/mime-types
[ERROR] npm http 304 https://registry.npmjs.org/optimist
[ERROR] npm http 304 https://registry.npmjs.org/lodash
[ERROR] npm http 304 https://registry.npmjs.org/is-absolute
[ERROR] npm http GET https://registry.npmjs.org/is-relative
[ERROR] npm http 304 https://registry.npmjs.org/extend
[ERROR] npm http 304 https://registry.npmjs.org/caseless
[ERROR] npm http 304 https://registry.npmjs.org/is-typedarray
[ERROR] npm http 304 https://registry.npmjs.org/node-uuid
[ERROR] npm http 304 https://registry.npmjs.org/debug/0.7.4
[ERROR] npm http GET https://registry.npmjs.org/inherits
[ERROR] npm http GET https://registry.npmjs.org/typedarray
[ERROR] npm http GET https://registry.npmjs.org/readable-stream
[ERROR] npm http GET https://registry.npmjs.org/fd-slicer
[ERROR] npm http GET https://registry.npmjs.org/minimist/0.0.8
[ERROR] npm http 304 https://registry.npmjs.org/forever-agent
[ERROR] npm http 304 https://registry.npmjs.org/oauth-sign
[ERROR] npm http 304 https://registry.npmjs.org/is-relative
[ERROR] npm http 304 https://registry.npmjs.org/inherits
[ERROR] npm http 304 https://registry.npmjs.org/readable-stream
[ERROR] npm http 304 https://registry.npmjs.org/pinkie
[ERROR] npm http 304 https://registry.npmjs.org/glob
[ERROR] npm http 304 https://registry.npmjs.org/bl
[ERROR] npm http 304 https://registry.npmjs.org/hawk
[ERROR] npm http 304 https://registry.npmjs.org/minimist/0.0.8
[ERROR] npm http 304 https://registry.npmjs.org/throttleit
[ERROR] npm http 304 https://registry.npmjs.org/fd-slicer
[ERROR] npm http GET https://registry.npmjs.org/pend
[ERROR] npm http 304 https://registry.npmjs.org/pend
[ERROR] npm http 304 https://registry.npmjs.org/aws-sign2
[ERROR] npm WARN engine [email protected]: wanted: {"node":">=0.10.32"} (current: {"node":"v0.10.30","npm":"1.4.3"})
[ERROR] npm http GET https://registry.npmjs.org/delayed-stream
[ERROR] npm http GET https://registry.npmjs.org/mime-db
[ERROR] npm http GET https://registry.npmjs.org/async
[ERROR] npm http GET https://registry.npmjs.org/assert-plus
[ERROR] npm http GET https://registry.npmjs.org/jsprim
[ERROR] npm http GET https://registry.npmjs.org/sshpk
[ERROR] npm http GET https://registry.npmjs.org/chalk
[ERROR] npm http GET https://registry.npmjs.org/commander
[ERROR] npm http GET https://registry.npmjs.org/is-my-json-valid
[ERROR] npm http GET https://registry.npmjs.org/core-util-is
[ERROR] npm http GET https://registry.npmjs.org/isarray
[ERROR] npm http GET https://registry.npmjs.org/process-nextick-args
[ERROR] npm http GET https://registry.npmjs.org/string_decoder
[ERROR] npm http GET https://registry.npmjs.org/util-deprecate
[ERROR] npm http GET https://registry.npmjs.org/hoek
[ERROR] npm http GET https://registry.npmjs.org/boom
[ERROR] npm http GET https://registry.npmjs.org/cryptiles
[ERROR] npm http GET https://registry.npmjs.org/sntp
[ERROR] npm http 304 https://registry.npmjs.org/mime-db
[ERROR] npm http 304 https://registry.npmjs.org/delayed-stream
[ERROR] npm http 304 https://registry.npmjs.org/process-nextick-args
[ERROR] npm http 304 https://registry.npmjs.org/util-deprecate
[ERROR] npm http 304 https://registry.npmjs.org/assert-plus
[ERROR] npm http 304 https://registry.npmjs.org/hoek
[ERROR] npm http 304 https://registry.npmjs.org/is-my-json-valid
[ERROR] npm http 304 https://registry.npmjs.org/sshpk
[ERROR] npm http 304 https://registry.npmjs.org/core-util-is
[ERROR] npm http 200 https://registry.npmjs.org/isarray
[ERROR] npm http 304 https://registry.npmjs.org/chalk
[ERROR] npm http 304 https://registry.npmjs.org/cryptiles
[ERROR] npm http 304 https://registry.npmjs.org/boom
[ERROR] npm http 304 https://registry.npmjs.org/typedarray
[ERROR] npm http 304 https://registry.npmjs.org/sntp
[ERROR] npm WARN engine [email protected]: wanted: {"node":">=0.10.40"} (current: {"node":"v0.10.30","npm":"1.4.3"})
[ERROR] npm WARN engine [email protected]: wanted: {"node":">=0.10.40"} (current: {"node":"v0.10.30","npm":"1.4.3"})
[ERROR] npm WARN engine [email protected]: wanted: {"node":">=0.10.40"} (current: {"node":"v0.10.30","npm":"1.4.3"})
[ERROR] npm http 304 https://registry.npmjs.org/jsprim
[ERROR] npm http GET https://registry.npmjs.org/extsprintf/1.0.2
[ERROR] npm http GET https://registry.npmjs.org/json-schema/0.2.2
[ERROR] npm http GET https://registry.npmjs.org/verror/1.3.6
[ERROR] npm http 200 https://registry.npmjs.org/commander
[ERROR] npm http 200 https://registry.npmjs.org/async
[ERROR] npm http GET https://registry.npmjs.org/ansi-styles
[ERROR] npm http GET https://registry.npmjs.org/escape-string-regexp
[ERROR] npm http GET https://registry.npmjs.org/has-ansi
[ERROR] npm http GET https://registry.npmjs.org/strip-ansi
[ERROR] npm http GET https://registry.npmjs.org/supports-color
[ERROR] npm http GET https://registry.npmjs.org/graceful-readlink
[ERROR] npm http GET https://registry.npmjs.org/asn1
[ERROR] npm http GET https://registry.npmjs.org/dashdash
[ERROR] npm http GET https://registry.npmjs.org/jsbn
[ERROR] npm http GET https://registry.npmjs.org/tweetnacl
[ERROR] npm http GET https://registry.npmjs.org/jodid25519
[ERROR] npm http GET https://registry.npmjs.org/ecc-jsbn
[ERROR] npm http GET https://registry.npmjs.org/generate-function
[ERROR] npm http GET https://registry.npmjs.org/generate-object-property
[ERROR] npm http GET https://registry.npmjs.org/jsonpointer/2.0.0
[ERROR] npm http GET https://registry.npmjs.org/xtend
[ERROR] npm http 200 https://registry.npmjs.org/string_decoder
[ERROR] npm http 304 https://registry.npmjs.org/jsonfile
[ERROR] npm http GET https://registry.npmjs.org/glob
[ERROR] npm http 304 https://registry.npmjs.org/json-schema/0.2.2
[ERROR] npm http 304 https://registry.npmjs.org/supports-color
[ERROR] npm http 304 https://registry.npmjs.org/jodid25519
[ERROR] npm http 304 https://registry.npmjs.org/tweetnacl
[ERROR] npm http 304 https://registry.npmjs.org/jsbn
[ERROR] npm http 304 https://registry.npmjs.org/ansi-styles
[ERROR] npm http 304 https://registry.npmjs.org/asn1
[ERROR] npm http 304 https://registry.npmjs.org/dashdash
[ERROR] npm http 304 https://registry.npmjs.org/generate-object-property
[ERROR] npm http 304 https://registry.npmjs.org/strip-ansi
[ERROR] npm http 304 https://registry.npmjs.org/verror/1.3.6
[ERROR] npm http 304 https://registry.npmjs.org/ecc-jsbn
[ERROR] npm http 304 https://registry.npmjs.org/jsonpointer/2.0.0
[ERROR] npm http 304 https://registry.npmjs.org/graceful-readlink
[ERROR] npm http 304 https://registry.npmjs.org/generate-function
[ERROR] npm http 304 https://registry.npmjs.org/glob
[ERROR] npm http GET https://registry.npmjs.org/inflight
[ERROR] npm http GET https://registry.npmjs.org/inherits
[ERROR] npm http GET https://registry.npmjs.org/minimatch
[ERROR] npm http GET https://registry.npmjs.org/once
[ERROR] npm http 304 https://registry.npmjs.org/once
[ERROR] npm http 304 https://registry.npmjs.org/inherits
[ERROR] npm http 304 https://registry.npmjs.org/minimatch
[ERROR] npm http 304 https://registry.npmjs.org/has-ansi
[ERROR] npm http 304 https://registry.npmjs.org/xtend
[ERROR] npm http GET https://registry.npmjs.org/is-property
[ERROR] npm http 200 https://registry.npmjs.org/inflight
[ERROR] npm http GET https://registry.npmjs.org/wrappy
[ERROR] npm http GET https://registry.npmjs.org/brace-expansion
[ERROR] npm http 304 https://registry.npmjs.org/escape-string-regexp
[ERROR] npm http GET https://registry.npmjs.org/ansi-regex
[ERROR] npm http 304 https://registry.npmjs.org/ansi-regex
[ERROR] npm http 304 https://registry.npmjs.org/brace-expansion
[ERROR] npm http GET https://registry.npmjs.org/balanced-match
[ERROR] npm http GET https://registry.npmjs.org/concat-map/0.0.1
[ERROR] npm http 304 https://registry.npmjs.org/is-property
[ERROR] npm http 200 https://registry.npmjs.org/balanced-match
[ERROR] npm http 304 https://registry.npmjs.org/concat-map/0.0.1
[ERROR] npm http 200 https://registry.npmjs.org/wrappy
[ERROR] npm http GET https://registry.npmjs.org/minijasminenode/1.1.1
[ERROR] npm http 304 https://registry.npmjs.org/minijasminenode/1.1.1
[ERROR] npm http GET https://registry.npmjs.org/extsprintf/1.0.2
[ERROR] npm http 304 https://registry.npmjs.org/extsprintf/1.0.2

还有一个额外的信息：Exception while executing SCM command.

最后在英文网站上找到了一个解决策，但原因是什么，没有明白：https://github.com/Mach5/supersonic/issues/85

Find the lines that read:

org.codehaus.mojo
buildnumber-maven-plugin
1.0

and remove them.

但，新的问题又出现了，打出的堆栈信息如下所示....

[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (BUILD-OOZIE) on project build-tools: Command execution failed. Process exited with an error: 6 (Exit value: 6) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (BUILD-OOZIE) on project build-tools: Command execution failed.
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
        at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
        at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
        at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
        at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
        at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:318)
        at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:153)
        at org.apache.maven.cli.MavenCli.execute(MavenCli.java:555)
        at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
        at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
        at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
        at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:414)
        at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:357)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
        at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:362)
        at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:106)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
        ... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 6 (Exit value: 6)
        at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:377)
        at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:160)
        at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:610)
        at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:352)
        ... 21 more
[ERROR] 
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :build-tools

根据上面的提示信息，找到一个对应的帖子：

http://mail-archives.apache.org/mod_mbox/falcon-dev/201402.mbox/%[email protected]%3E

https://issues.apache.org/jira/browse/FALCON-291

看着是Falcon的一个降级BUG，发邮件询问Falcon社区的负责人，一天过去了，没有回信。

自己动手去琢磨，falcon0.4作入的BUG，0.9的话，应该是已经被修正了，估计是自己这边的环境有问题，再继续折腾吧，找到解决策后再继续追加。

@2016-4-15 15:32

全局使用maven编译的时候，一直报错

Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (BUILD-OOZIE)

但具体是哪有问题，即使使用mvn clean install -X打印出详细的堆栈信息，对于不清楚源码的人来说，还是没有什么实质性的帮助。遂决定单独去编译build-tool模块。

单独编译build-tool时，出错信息就详细多了，且很有价值的信息。具体如下所示：

[INFO] --- exec-maven-plugin:1.2.1:exec (BUILD-OOZIE) @ build-tools ---
oozie version 
Using maven from  /home/project/apache-maven-3.1.0/bin/mvn
+ VERSION=4.1.0
+ BUILD_VERSION=4.1.0-falcon
+ FORCE_BUILD=false
+ echo 'oozie version '
+ '[' -z /home/project/apache-maven-3.1.0 ']'
+ export MVN_CMD=/home/project/apache-maven-3.1.0/bin/mvn
+ MVN_CMD=/home/project/apache-maven-3.1.0/bin/mvn
+ echo 'Using maven from ' /home/project/apache-maven-3.1.0/bin/mvn
+ [[ false == \f\a\l\s\e ]]
++ cut '-d>' -f2
++ cut '-d<' -f1
++ grep localRepository
++ /home/project/apache-maven-3.1.0/bin/mvn help:effective-settings
+ [[ -f /root/.m2/repository/org/apache/oozie/oozie-webapp/4.1.0-falcon/oozie-webapp-4.1.0-falcon.war ]]
+ PKG_URL=http://archive.apache.org/dist/oozie/4.1.0/oozie-4.1.0.tar.gz
+ PKG=oozie-4.1.0
+ mkdir -p ../target
+ pushd ../target
/home/project/apache-maven-3.1.0/falcon-sources-0.9/target /home/project/apache-maven-3.1.0/falcon-sources-0.9/build-tools
+ rm -rf 'oozie-*'
+ curl -v http://archive.apache.org/dist/oozie/4.1.0/oozie-4.1.0.tar.gz -o oozie-4.1.0.tgz
* getaddrinfo(3) failed for archive.apache.org:80
* Couldn't resolve host 'archive.apache.org'
* Closing connection #0

curl: (6) Couldn't resolve host 'archive.apache.org'
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 5.362s
[INFO] Finished at: Sat Apr 16 00:51:40 JST 2016
[INFO] Final Memory: 10M/239M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (BUILD-OOZIE) on project build-tools: Command execution failed. Process exited with an error: 6 (Exit value: 6) -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

看到上面黑体加错的那三行，就知道是什么原因造成build-tool一直无法编译了。

getaddrinfo(3)出错导致的。

继续解析，发现是自己的虚拟机没有配DNS，或者说，没有在虚拟机中设置代理。可悲的是，下班后坐在车上才想通了，原来只需要在UI界面设置一下代理，就可以下载这个http://archive.apache.org/dist/oozie/4.1.0/oozie-4.1.0.tar.gz文件了。可惜，下班之前没有搞定，只能下周一接着去确认了。

@2016/04/18

今天到公司后，配好虚拟机的代理。能上网，但就是ping不通www.baidu.com。主机这边也是ping不通www.baidu.com。猜测应该是整个公司将DNS的解析给屏蔽掉了。再次执行mvn clean install，还是出问题，但在vmware下执行的时候，之前的错误就没发生，这会一直处于关联文件下载中，对公司的网速表示呵呵了。但没报错就是好事了....

新的问题又出现了，在build testcase的时候出错了。。。

Tests run: 41, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.763 sec - in org.apache.falcon.workflow.WorkflowExecutionContextTest
Running org.apache.falcon.update.UpdateHelperTest
Tests run: 5, Failures: 4, Errors: 0, Skipped: 0, Time elapsed: 3.421 sec <<< FAILURE! - in org.apache.falcon.update.UpdateHelperTest
testIsEntityACLUpdated(org.apache.falcon.update.UpdateHelperTest)  Time elapsed: 0.397 sec  <<< FAILURE!
org.apache.hadoop.fs.ParentNotDirectoryException: Parent path is not a directory: /home/project/apache-maven-3.3.9/falcon-sources-0.9/common/target/falcon/tmp-hadoop-root/jail-fs/testCluster/projects/falcon/staging/falcon/workflows/process/sample
        at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:418)
        at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:432)
        at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:281)
        at org.apache.falcon.hadoop.JailedFileSystem.mkdirs(JailedFileSystem.java:152)
        at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1815)
        at org.apache.falcon.update.UpdateHelperTest.prepare(UpdateHelperTest.java:90)
        at org.apache.falcon.update.UpdateHelperTest.testIsEntityACLUpdated(UpdateHelperTest.java:262)

testIsEntityLateProcessUpdated(org.apache.falcon.update.UpdateHelperTest)  Time elapsed: 0.068 sec  <<< FAILURE!
org.apache.hadoop.fs.ParentNotDirectoryException: Parent path is not a directory: /home/project/apache-maven-3.3.9/falcon-sources-0.9/common/target/falcon/tmp-hadoop-root/jail-fs/testCluster/projects/falcon/staging/falcon/workflows/process/sample
        at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:418)
        at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:432)
        at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:281)
        at org.apache.falcon.hadoop.JailedFileSystem.mkdirs(JailedFileSystem.java:152)
        at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1815)
        at org.apache.falcon.update.UpdateHelperTest.prepare(UpdateHelperTest.java:90)
        at org.apache.falcon.update.UpdateHelperTest.testIsEntityLateProcessUpdated(UpdateHelperTest.java:280)

testIsEntityUpdated(org.apache.falcon.update.UpdateHelperTest)  Time elapsed: 0.209 sec  <<< FAILURE!
org.apache.hadoop.fs.ParentNotDirectoryException: Parent path is not a directory: /home/project/apache-maven-3.3.9/falcon-sources-0.9/common/target/falcon/tmp-hadoop-root/jail-fs/testCluster/projects/falcon/staging/falcon/workflows/process/sample
        at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:418)
        at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:432)
        at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:281)
        at org.apache.falcon.hadoop.JailedFileSystem.mkdirs(JailedFileSystem.java:152)
        at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1815)
        at org.apache.falcon.update.UpdateHelperTest.prepare(UpdateHelperTest.java:90)
        at org.apache.falcon.update.UpdateHelperTest.testIsEntityUpdated(UpdateHelperTest.java:117)

testShouldUpdateAffectedEntities(org.apache.falcon.update.UpdateHelperTest)  Time elapsed: 0.052 sec  <<< FAILURE!
org.apache.hadoop.fs.ParentNotDirectoryException: Parent path is not a directory: /home/project/apache-maven-3.3.9/falcon-sources-0.9/common/target/falcon/tmp-hadoop-root/jail-fs/testCluster/projects/falcon/staging/falcon/workflows/process/sample
        at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:418)
        at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:432)
        at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:281)
        at org.apache.falcon.hadoop.JailedFileSystem.mkdirs(JailedFileSystem.java:152)
        at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1815)
        at org.apache.falcon.update.UpdateHelperTest.prepare(UpdateHelperTest.java:90)
        at org.apache.falcon.update.UpdateHelperTest.testShouldUpdateAffectedEntities(UpdateHelperTest.java:157)

Running org.apache.falcon.metadata.MetadataMappingServiceTest
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.512 sec - in org.apache.falcon.metadata.MetadataMappingServiceTest
Running org.apache.falcon.security.AuthenticationInitializationServiceTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.027 sec - in org.apache.falcon.security.AuthenticationInitializationServiceTest
Running org.apache.falcon.security.DefaultAuthorizationProviderTest
Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.884 sec - in org.apache.falcon.security.DefaultAuthorizationProviderTest
Running org.apache.falcon.security.CurrentUserTest
Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.062 sec - in org.apache.falcon.security.CurrentUserTest
Running org.apache.falcon.security.SecurityUtilTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.202 sec - in org.apache.falcon.security.SecurityUtilTest
Running org.apache.falcon.cleanup.LogCleanupServiceTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.601 sec - in org.apache.falcon.cleanup.LogCleanupServiceTest
Running org.apache.falcon.util.RadixTreeTest
Tests run: 26, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.894 sec - in org.apache.falcon.util.RadixTreeTest
Running org.apache.falcon.util.ApplicationPropertiesTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.514 sec - in org.apache.falcon.util.ApplicationPropertiesTest
Running org.apache.falcon.util.RadixNodeTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.432 sec - in org.apache.falcon.util.RadixNodeTest
Running org.apache.falcon.util.ReflectionUtilsTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.133 sec - in org.apache.falcon.util.ReflectionUtilsTest
Running org.apache.falcon.expression.ExpressionHelperTest
Tests run: 23, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.458 sec - in org.apache.falcon.expression.ExpressionHelperTest
Running org.apache.falcon.group.FeedGroupMapTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.25 sec - in org.apache.falcon.group.FeedGroupMapTest

Results :

Failed tests: 
  UpdateHelperTest.testIsEntityACLUpdated:262->prepare:90 » ParentNotDirectory P...
  UpdateHelperTest.testIsEntityLateProcessUpdated:280->prepare:90 » ParentNotDirectory
  UpdateHelperTest.testIsEntityUpdated:117->prepare:90 » ParentNotDirectory Pare...
  UpdateHelperTest.testShouldUpdateAffectedEntities:157->prepare:90 » ParentNotDirectory

Tests run: 575, Failures: 4, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Falcon ...................................... SUCCESS [  2.882 s]
[INFO] Apache Falcon UI ................................... SUCCESS [  7.223 s]
[INFO] Checkstyle ......................................... SUCCESS [  0.470 s]
[INFO] Build Tools ........................................ SUCCESS [  4.177 s]
[INFO] Apache Falcon Java client .......................... SUCCESS [ 12.203 s]
[INFO] Apache Falcon CLI client ........................... SUCCESS [  3.790 s]
[INFO] Apache Falcon Metrics .............................. SUCCESS [  4.277 s]
[INFO] Apache Falcon Hadoop Dependencies .................. SUCCESS [  1.939 s]
[INFO] Apache Falcon Test Utility ......................... SUCCESS [  3.077 s]
[INFO] Apache Falcon Commons .............................. FAILURE [01:44 min]
[INFO] Apache Falcon Oozie EL Extension ................... SKIPPED
[INFO] Apache Falcon Embedded Hadoop - Test Cluster ....... SKIPPED
[INFO] Apache Falcon Sharelib Hive - Test Cluster ......... SKIPPED
[INFO] Apache Falcon Sharelib Pig - Test Cluster .......... SKIPPED
[INFO] Apache Falcon Sharelib Hcatalog - Test Cluster ..... SKIPPED
[INFO] Apache Falcon Sharelib Oozie - Test Cluster ........ SKIPPED
[INFO] Apache Falcon Test Tools - Test Cluster ............ SKIPPED
[INFO] Apache Falcon Messaging ............................ SKIPPED
[INFO] Apache Falcon LIfecycle Module ..................... SKIPPED
[INFO] Apache Falcon Oozie Adaptor ........................ SKIPPED
[INFO] Apache Falcon Scheduler ............................ SKIPPED
[INFO] Apache Falcon Acquisition .......................... SKIPPED
[INFO] Apache Falcon Distcp Replication ................... SKIPPED
[INFO] Apache Falcon Retention ............................ SKIPPED
[INFO] Apache Falcon Archival ............................. SKIPPED
[INFO] Apache Falcon Rerun ................................ SKIPPED
[INFO] Apache Falcon Prism ................................ SKIPPED
[INFO] falcon-unit ........................................ SKIPPED
[INFO] Apache Falcon Web Application ...................... SKIPPED
[INFO] Apache Falcon Documentation ........................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:25 min
[INFO] Finished at: 2016-04-18T22:29:01+09:00
[INFO] Final Memory: 154M/567M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on project falcon-common: There are test failures.
[ERROR] 
[ERROR] Please refer to /home/project/apache-maven-3.3.9/falcon-sources-0.9/common/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :falcon-common

因为本次编译的重点是falcon源码，至于自带的测试项，对后续的使用是没有用处的，换句话说，编译测试项，只是进一步证明了而已，为了，解决方案是跳过它。

解决命令：

export MAVEN_OPTS="-Xmx1024m -XX:MaxPermSize=256m -noverify" && mvn clean install -Dhadoop.version=2.5.2 -DskipTests

再次执行，编译又可以继续了，又是不停的下载关联的文件的模式了......

但，还是看到了希望

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Falcon ...................................... SUCCESS [  3.030 s]
[INFO] Apache Falcon UI ................................... SUCCESS [  7.757 s]
[INFO] Checkstyle ......................................... SUCCESS [  0.504 s]
[INFO] Build Tools ........................................ SUCCESS [  4.186 s]
[INFO] Apache Falcon Java client .......................... SUCCESS [ 10.193 s]
[INFO] Apache Falcon CLI client ........................... SUCCESS [  3.747 s]
[INFO] Apache Falcon Metrics .............................. SUCCESS [  3.663 s]
[INFO] Apache Falcon Hadoop Dependencies .................. SUCCESS [  1.945 s]
[INFO] Apache Falcon Test Utility ......................... SUCCESS [  2.465 s]
[INFO] Apache Falcon Commons .............................. SUCCESS [  9.517 s]
[INFO] Apache Falcon Oozie EL Extension ................... SUCCESS [  5.234 s]
[INFO] Apache Falcon Embedded Hadoop - Test Cluster ....... SUCCESS [07:07 min]
[INFO] Apache Falcon Sharelib Hive - Test Cluster ......... SUCCESS [  8.564 s]
[INFO] Apache Falcon Sharelib Pig - Test Cluster .......... SUCCESS [01:01 min]
[INFO] Apache Falcon Sharelib Hcatalog - Test Cluster ..... SUCCESS [  0.826 s]
[INFO] Apache Falcon Sharelib Oozie - Test Cluster ........ SUCCESS [  0.093 s]
[INFO] Apache Falcon Test Tools - Test Cluster ............ SUCCESS [  0.049 s]
[INFO] Apache Falcon Messaging ............................ SUCCESS [  2.779 s]
[INFO] Apache Falcon LIfecycle Module ..................... SUCCESS [01:25 min]
[INFO] Apache Falcon Oozie Adaptor ........................ SUCCESS [  7.485 s]
[INFO] Apache Falcon Scheduler ............................ SUCCESS [02:04 min]
[INFO] Apache Falcon Acquisition .......................... SUCCESS [  0.251 s]
[INFO] Apache Falcon Distcp Replication ................... SUCCESS [  1.719 s]
[INFO] Apache Falcon Retention ............................ SUCCESS [  1.805 s]
[INFO] Apache Falcon Archival ............................. SUCCESS [  0.243 s]
[INFO] Apache Falcon Rerun ................................ SUCCESS [  3.625 s]
[INFO] Apache Falcon Prism ................................ SUCCESS [09:49 min]
[INFO] falcon-unit ........................................ SUCCESS [  5.552 s]
[INFO] Apache Falcon Web Application ...................... SUCCESS [02:45 min]
[INFO] Apache Falcon Documentation ........................ FAILURE [ 11.370 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 25:50 min
[INFO] Finished at: 2016-04-18T22:56:18+09:00
[INFO] Final Memory: 252M/868M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-site-plugin:3.4:site (default) on project falcon-docs: SiteToolException: The site descriptor cannot be resolved from the repository: ArtifactResolutionException: Unable to locate site descriptor: Could not transfer artifact org.apache:apache:xml:site_en:17 from/to java.net-Public (https://maven.java.net/content/groups/public/): Failed to transfer file: https://maven.java.net/content/groups/public/org/apache/apache/17/apache-17-site_en.xml. Return code is: 503 , ReasonPhrase:Service Unavailable.
[ERROR] org.apache:apache:xml:17
[ERROR] 
[ERROR] from the specified remote repositories:
[ERROR] central (http://repo1.maven.org/maven2, releases=true, snapshots=false),
[ERROR] im (https://raw.github.com/InMobi/mvn-repo/master/releases, releases=true, snapshots=false),
[ERROR] hortonworks.repo (http://repo.hortonworks.com/content/repositories/releases, releases=true, snapshots=false),
[ERROR] apache.snapshots.repo (https://repository.apache.org/content/groups/snapshots, releases=true, snapshots=true),
[ERROR] default (https://repository.apache.org/content/groups/public/, releases=true, snapshots=true),
[ERROR] java.net-Public (https://maven.java.net/content/groups/public/, releases=true, snapshots=true),
[ERROR] repository.jboss.org-public (https://repository.jboss.org/nexus/content/groups/public, releases=true, snapshots=true),
[ERROR] cdh.repo (https://repository.cloudera.com/artifactory/cloudera-repos/, releases=true, snapshots=false),
[ERROR] apache.snapshots (http://repository.apache.org/snapshots, releases=false, snapshots=true)
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :falcon-docs
[INFO] Shutdown hook executing
[INFO] Shutdown hook complete
Shutting down hive metastore.

根据这报错信息，以及这么久折腾falcon的经验来看，应该还是网速的原因，在timeout时间内没有找到对应的服务器导致了，果断的重新来过一次，果然，这次编译过了，效果如下所示：

[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Falcon ...................................... SUCCESS [  2.613 s]
[INFO] Apache Falcon UI ................................... SUCCESS [  7.466 s]
[INFO] Checkstyle ......................................... SUCCESS [  0.414 s]
[INFO] Build Tools ........................................ SUCCESS [  4.255 s]
[INFO] Apache Falcon Java client .......................... SUCCESS [ 10.174 s]
[INFO] Apache Falcon CLI client ........................... SUCCESS [  3.492 s]
[INFO] Apache Falcon Metrics .............................. SUCCESS [  3.342 s]
[INFO] Apache Falcon Hadoop Dependencies .................. SUCCESS [  1.973 s]
[INFO] Apache Falcon Test Utility ......................... SUCCESS [  2.497 s]
[INFO] Apache Falcon Commons .............................. SUCCESS [  8.428 s]
[INFO] Apache Falcon Oozie EL Extension ................... SUCCESS [  2.378 s]
[INFO] Apache Falcon Embedded Hadoop - Test Cluster ....... SUCCESS [ 26.021 s]
[INFO] Apache Falcon Sharelib Hive - Test Cluster ......... SUCCESS [  3.103 s]
[INFO] Apache Falcon Sharelib Pig - Test Cluster .......... SUCCESS [  0.378 s]
[INFO] Apache Falcon Sharelib Hcatalog - Test Cluster ..... SUCCESS [  0.677 s]
[INFO] Apache Falcon Sharelib Oozie - Test Cluster ........ SUCCESS [  0.097 s]
[INFO] Apache Falcon Test Tools - Test Cluster ............ SUCCESS [  0.042 s]
[INFO] Apache Falcon Messaging ............................ SUCCESS [  2.377 s]
[INFO] Apache Falcon LIfecycle Module ..................... SUCCESS [ 11.402 s]
[INFO] Apache Falcon Oozie Adaptor ........................ SUCCESS [  6.631 s]
[INFO] Apache Falcon Scheduler ............................ SUCCESS [  6.307 s]
[INFO] Apache Falcon Acquisition .......................... SUCCESS [  0.280 s]
[INFO] Apache Falcon Distcp Replication ................... SUCCESS [  1.735 s]
[INFO] Apache Falcon Retention ............................ SUCCESS [  1.936 s]
[INFO] Apache Falcon Archival ............................. SUCCESS [  0.277 s]
[INFO] Apache Falcon Rerun ................................ SUCCESS [  4.892 s]
[INFO] Apache Falcon Prism ................................ SUCCESS [ 37.770 s]
[INFO] falcon-unit ........................................ SUCCESS [  6.706 s]
[INFO] Apache Falcon Web Application ...................... SUCCESS [01:09 min]
[INFO] Apache Falcon Documentation ........................ SUCCESS [ 25.824 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 04:14 min
[INFO] Finished at: 2016-04-18T23:03:24+09:00
[INFO] Final Memory: 141M/739M
[INFO] ------------------------------------------------------------------------
[INFO] Shutdown hook executing
[INFO] Shutdown hook complete
Shutting down hive metastore.

至此，apache falcon的源码终于编译成功了。

部署嵌入式模式：

命令：

mvn clean assembly:assembly -DskipTests -DskipITs

效果：

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Falcon ...................................... SUCCESS [03:40 min]
[INFO] Apache Falcon UI ................................... SUCCESS [  0.008 s]
[INFO] Checkstyle ......................................... SUCCESS [  0.002 s]
[INFO] Build Tools ........................................ SUCCESS [  0.004 s]
[INFO] Apache Falcon Java client .......................... SUCCESS [  0.033 s]
[INFO] Apache Falcon CLI client ........................... SUCCESS [  0.007 s]
[INFO] Apache Falcon Metrics .............................. SUCCESS [  0.007 s]
[INFO] Apache Falcon Hadoop Dependencies .................. SUCCESS [  0.017 s]
[INFO] Apache Falcon Test Utility ......................... SUCCESS [  0.004 s]
[INFO] Apache Falcon Commons .............................. SUCCESS [  0.024 s]
[INFO] Apache Falcon Oozie EL Extension ................... SUCCESS [  0.006 s]
[INFO] Apache Falcon Embedded Hadoop - Test Cluster ....... SUCCESS [  0.092 s]
[INFO] Apache Falcon Sharelib Hive - Test Cluster ......... SUCCESS [  0.004 s]
[INFO] Apache Falcon Sharelib Pig - Test Cluster .......... SUCCESS [  0.004 s]
[INFO] Apache Falcon Sharelib Hcatalog - Test Cluster ..... SUCCESS [  0.004 s]
[INFO] Apache Falcon Sharelib Oozie - Test Cluster ........ SUCCESS [  0.003 s]
[INFO] Apache Falcon Test Tools - Test Cluster ............ SUCCESS [  0.003 s]
[INFO] Apache Falcon Messaging ............................ SUCCESS [  0.006 s]
[INFO] Apache Falcon LIfecycle Module ..................... SUCCESS [  0.020 s]
[INFO] Apache Falcon Oozie Adaptor ........................ SUCCESS [  0.020 s]
[INFO] Apache Falcon Scheduler ............................ SUCCESS [  0.049 s]
[INFO] Apache Falcon Acquisition .......................... SUCCESS [  0.004 s]
[INFO] Apache Falcon Distcp Replication ................... SUCCESS [  0.005 s]
[INFO] Apache Falcon Retention ............................ SUCCESS [  0.004 s]
[INFO] Apache Falcon Archival ............................. SUCCESS [  0.004 s]
[INFO] Apache Falcon Rerun ................................ SUCCESS [  0.006 s]
[INFO] Apache Falcon Prism ................................ SUCCESS [  0.118 s]
[INFO] falcon-unit ........................................ SUCCESS [  0.007 s]
[INFO] Apache Falcon Web Application ...................... SUCCESS [  0.245 s]
[INFO] Apache Falcon Documentation ........................ SUCCESS [  0.008 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 03:43 min
[INFO] Finished at: 2016-04-18T23:13:40+09:00
[INFO] Final Memory: 603M/882M
[INFO] ------------------------------------------------------------------------

解压apache-falcon-${project.version}-bin.tar.gz

文件tree:

|- bin
   |- falcon
   |- falcon-start
   |- falcon-stop
   |- falcon-config.sh
   |- service-start.sh
   |- service-stop.sh
|- conf
   |- startup.properties
   |- runtime.properties
   |- client.properties
   |- log4j.xml
   |- falcon-env.sh
|- docs
|- client
   |- lib (client support libs)
|- server
   |- webapp
      |- falcon.war
|- hadooplibs
|- README
|- NOTICE.txt
|- LICENSE.txt
|- DISCLAIMER.txt
|- CHANGES.txt

位置：{project dir}/target/apache-falcon-${project.version}-bin.tar.gz

* tar -xzvf apache-falcon-${project.version}-bin.tar.gz
* cd falcon-${project.version}

启动falcon：

bin/falcon-start

Hadoop home is set, adding libraries from '/home/project/hadoop-2.5.2/bin/hadoop classpath' into falcon classpath
/home/project/apache-maven-3.3.9/falcon-sources-0.9/target/falcon-0.9
falcon started using hadoop version:  Hadoop 2.5.2

注意点：

falcon.url=https://localhost:15443/

但要使用web界面来访问的话，需要稍加修改一下：https://localhost:15443/public

firfox或者chorme或者IE9以上登录，追加认证后就可以显示falcon的画面了。

感触：

1.本次的搭建环境从头到尾，制约因素最大的就是网速了

2.虚拟机的DNS和代理没有配置，导致开始building时没有准确的定位到。以为设置了maven的代理，应该就没事了。

3.没有善用-x参数，在解析maven.apche.org的时候，不知所措。

------ over -------

你可能感兴趣的:(apache,falcon)

Java：爬虫框架 dingcho Java java 爬虫
一、ApacheNutch2【参考地址】Nutch是一个开源Java实现的搜索引擎。它提供了我们运行自己的搜索引擎所需的全部工具。包括全文搜索和Web爬虫。Nutch致力于让每个人能很容易,同时花费很少就可以配置世界一流的Web搜索引擎.为了完成这一宏伟的目标,Nutch必须能够做到:每个月取几十亿网页为这些网页维护一个索引对索引文件进行每秒上千次的搜索提供高质量的搜索结果简单来说Nutch支持分
最简单将静态网页挂载到服务器上(不用nginx) 全能全知者服务器 nginx 运维前端 html 笔记
最简单将静态网页挂载到服务器上(不用nginx)如果随便弄个静态网页挂在服务器都要用nignx就太麻烦了，所以直接使用Apache来搭建一些简单前端静态网页会相对方便很多检查Web服务器服务状态：sudosystemctlstatushttpd#ApacheWeb服务器如果发现没有安装web服务器：安装Apache：sudoyuminstallhttpd启动Apache：sudosystemctl
浅谈MapReduce Android路上的人 Hadoop 分布式计算 mapreduce 分布式框架 hadoop
从今天开始，本人将会开始对另一项技术的学习，就是当下炙手可热的Hadoop分布式就算技术。目前国内外的诸多公司因为业务发展的需要，都纷纷用了此平台。国内的比如BAT啦，国外的在这方面走的更加的前面，就不一一列举了。但是Hadoop作为Apache的一个开源项目，在下面有非常多的子项目，比如HDFS，HBase,Hive，Pig,等等，要先彻底学习整个Hadoop，仅仅凭借一个的力量，是远远不够的。
Hadoop 傲雪凌霜，松柏长青后端大数据 hadoop 大数据分布式
ApacheHadoop是一个开源的分布式计算框架，主要用于处理海量数据集。它具有高度的可扩展性、容错性和高效的分布式存储与计算能力。Hadoop核心由四个主要模块组成，分别是HDFS（分布式文件系统）、MapReduce（分布式计算框架）、YARN（资源管理）和HadoopCommon（公共工具和库）。1.HDFS（HadoopDistributedFileSystem）HDFS是Hadoop生
maven-assembly-plugin 打包实例带着二娃去遛弯
1.先在pom.xml文件中添加assembly打包插件org.apache.maven.pluginsmaven-assembly-plugin2.6assembly/assembly.xmlmake-assemblypackagesingle说明:1.需要修改的可能就是descriptors标签下面的打包配置文件目录,指定assembly.xml的路径.2.可以添加多个打包配置文件,进行多种形
Kafka详细解析与应用分析芊言芊语 kafka 分布式
Kafka是一个开源的分布式事件流平台（EventStreamingPlatform），由LinkedIn公司最初采用Scala语言开发，并基于ZooKeeper协调管理。如今，Kafka已经被Apache基金会纳入其项目体系，广泛应用于大数据实时处理领域。Kafka凭借其高吞吐量、持久化、分布式和可靠性的特点，成为构建实时流数据管道和流处理应用程序的重要工具。Kafka架构Kafka的架构主要由
java 技术架构相关文档圣心 java 架构开发语言
在Java中，有许多不同的技术和架构，这里我将列举一些常见的Java技术和架构，并提供一些相关的文档资源。SpringFrameworkSpring是一个开源的Java/JavaEE全功能框架，以Apache许可证形式发布，提供了一种实现企业级应用的方法。官方文档：SpringFrameworkSpringBootSpringBoot是Spring的一个子项目，旨在简化创建生产级的Spring应用
Apache Shiro安全框架(2)-用户认证 heyrian Java shiro
身份认证在shiro中用户需要提供用户的principals（身份）和credentials（证明）来证明该用户属于当前系统用户。常见的认证方式即用户名/密码。在解释身份认证之前，我们先来看看shiro中的Subject和Realm,这是身份认证的两个关键的概念。Subjectsubject代表当前用户，内部主要维护当前用户信息。shiro中所有的subject都交给SecurityManager
Apache HBase基础（基本概述，物理架构，逻辑架构，数据管理，架构特点，HBase Shell） May--J--Oldhu HBase HBase shell hbase物理架构 hbase逻辑架构 hbase
NoSQL综述及ApacheHBase基础一.HBase1.HBase概述2.HBase发展历史3.HBase应用场景3.1增量数据-时间序列数据3.2信息交换-消息传递3.3内容服务-Web后端应用程序3.4HBase应用场景示例4.ApacheHBase生态圈5.HBase物理架构5.1HMaster5.2RegionServer5.3Region和Table6.HBase逻辑架构-Row7.
Flume：大规模日志收集与数据传输的利器傲雪凌霜，松柏长青后端大数据 flume 大数据
Flume：大规模日志收集与数据传输的利器在大数据时代，随着各类应用的不断增长，产生了海量的日志和数据。这些数据不仅对业务的健康监控至关重要，还可以通过深入分析，帮助企业做出更好的决策。那么，如何高效地收集、传输和存储这些海量数据，成为了一项重要的挑战。今天我们将深入探讨ApacheFlume，它是如何帮助我们应对这些挑战的。一、Flume概述ApacheFlume是一个分布式、可靠、可扩展的日志
Superset二次开发之源码DependencyList.tsx 分析 aimmon Superset二次开发 Superset BI 二次开发 typescript 前端
功能点路径superset-frontend\src\dashboard\components\nativeFilters\FiltersConfigModal\FiltersConfigForm\DependencyList.tsx/***LicensedtotheApacheSoftwareFoundation(ASF)underone*ormorecontributorlicenseagre
史上最全的maven的pom.xml文件详解 Meta999 Maven
注：详解文件中，用红色进行标注的是平常项目中常用的配置节点。要详细学习！转载的，太经典了、、、、欢迎收藏xxxxxxxxxxxx4.0.0xxxxxxjar1.0-SNAPSHOTxxx-mavenhttp://maven.apache.orgAmavenprojecttostudymaven.jirahttp://jira.baidu.com/[email protected]
利用apache-pdfbox库修改pdf文件模板，进行信息替换区块链攻城狮 pdf 合同模板 pdf生成合同生成
publicStringcreateSignFile(Longid)throwsIOException{//1.验证企业信息CompanyDOcompany=validateCompanyExists(id);//2.验证签约状态if(company.getSignStatus()!=0){throwexception(COMPANY_SIGN_STATUS_NOT_ZERO);}//3.获取合同
Apache DataFusion Python 绑定教程柏赢安Simona
ApacheDataFusionPython绑定教程datafusion-pythonApacheDataFusionPythonBindings项目地址:https://gitcode.com/gh_mirrors/data/datafusion-python项目介绍ApacheDataFusion是一个基于ApacheArrow的内存查询引擎，提供了高性能的查询处理能力。DataFusion的
压测服务器并使用 Grafana 进行可视化豆瑞瑞 grafana
简介仓库代码GitCode-全球开发者的开源社区,开源代码托管平台参考Welcome!-TheApacheHTTPServerProjectGrafana|查询、可视化、警报观测平台https://prometheus.io/docs/introduction/overview/
2.Jmeter安装配置，核心目录详情，组件和作用域 XXX-17 Jmeter jmeter 软件测试接口测试
一、Jmeter安装配置以及核心目录详情Jmeter基于java语言来开发，java需要jdk环境。1.安装jdk并且配置jdk的环境变量。2.jmeter只需要解压就可以使用了。3.在D:\apache-jmeter-5.5\bin目录下双击jmeter.bat文件就可以启动使用了backups：自动备份的目录bin：启动文件、配置文件（jmeter.bat是启动问题，jmeter.propti
BindingException: Invalid bound statement (not found) 小卡车555 MyBatis mybatis java mysql
Mybatis出现绑定异常问题的解决org.apache.ibatis.binding.BindingException:Invalidboundstatement(notfound)一般的原因是Mapperinterface和xml文件的定义对应不上，需要检查包名，namespace，函数名称等能否对应上，需要比较细致的对比，我经常就是写错了一两个字母搞的很长时间找不到错误按以下步骤一一执行：1
Java中的大数据处理框架对比分析省赚客app开发者 java 开发语言
Java中的大数据处理框架对比分析大家好，我是微赚淘客系统3.0的小编，是个冬天不穿秋裤，天冷也要风度的程序猿！今天，我们将深入探讨Java中常用的大数据处理框架，并对它们进行对比分析。大数据处理框架是现代数据驱动应用的核心，它们帮助企业处理和分析海量数据，以提取有价值的信息。本文将重点介绍ApacheHadoop、ApacheSpark、ApacheFlink和ApacheStorm这四种流行的
NoClassDefFoundError: org.apache.poi.POIXMLDocument问题排查解决 qinmingjun718 apache
java.lang.NoClassDefFoundError:org/apache/poi/POIXMLDocumentPart这错很明显就是没找到这个类POIXMLDocumentPart就是找不到类问题原因是大概是因为poi从3.1.X低版本版本升级到pio4.1.2高版本的后与org.apache.poi.xwpf.converter.core-1.0.6.jar不兼容问题，导致这个情况的主
使用poi替换XWPFTableCell内容，并设置行间距 RR369_yyh javaUtil java poi
使用poi读取word文档（docx类型），进行数据替换。另外，为了记录poi设置行间距的api，真是找了好几十分钟才找到啊啊啊啊！！！importorg.apache.poi.xwpf.usermodel.*;importorg.springframework.util.StringUtils;importjava.io.File;importjava.io.FileInputStream;im
揭秘OozieBundle：架构组件与核心概念光剑书架上的书计算大数据AI人工智能计算科学神经计算深度学习神经网络大数据人工智能大型语言模型 AI AGI LLM Java Python 架构设计 Agent RPA
揭秘OozieBundle：架构、组件与核心概念1.背景介绍在大数据领域，数据处理工作流程通常由多个复杂的作业组成,这些作业之间存在着依赖关系。ApacheOozie作为一个工作流调度系统,可以有效管理这些复杂的工作流程。OozieBundle是Oozie提供的一种特殊的工作流程,用于协调和控制多个相关的工作流程。OozieBundle的主要目的是将多个相关的工作流程组织在一起,并根据它们之间的依
Apache POI用法 JH3073 apache
一、ApachePOI是什么ApachePOI是用Java编写的免费开源的跨平台的JavaAPI，ApachePOI提供API给Java程序对MicrosoftOffice格式档案读和写的功能，其中使用最多的就是使用POI操作Excel文件。二、POI结构HSSF－提供读写MicrosoftExcelXLS格式档案的功能XSSF－提供读写MicrosoftExcelOOXMLXLSX格式档案的功能
【LINUX】在ubuntu中安装tomcat 缘起性本空 linux 运维服务器
#instaljdkaptinstallopenjdk-8-jdk-y#enterinstallpathcd/home/a/#copytomcatpackagecp/mnt/hgfs/Share/apache-tomcat-9.0.93.tar.gz.#unpresstomcatpackagetar-xfapache-tomcat-9.0.93.tar.gz#enterbinpathcdapach
最好用的e2e框架，使用 Cypress 让产品持续稳定交付 Node全栈 java python 编程语言软件测试 html
以前我们经常使用nightwatch，现在都已经切换到cypress了，可以说cypress目前最好用的e2e框架。具体原因和对比，就是本文要讲的内容。背景ApacheAPISIXDashboard的设计是为了让用户通过前端界面尽可能方便地操作ApacheAPISIX。从项目初始化到现在，已经有552commits、发布了10个版本。在如此之快的产品迭代过程中，确保开源产品质量显的尤为重要。为此，
Linux下apache的安装轴儿
1.获取软件：http://httpd.apache.org/httpd-2.4.25.tar.gz并上传至服务器。运行以上命令时，可能会出现“APRnotfound.”的错误。此时需要下载依赖包。2.下载安装依赖包：创建文件夹：mkdir/usr/httpd-refercd/usr/httpd-refer/下载依赖包：wgethttp://p5osdejt4.bkt.clouddn.com/ap
使用 Apache Cassandra 实现 LLM 缓存：提升 AI 应用性能的实用指南 afTFODguAKBF apache 缓存人工智能 python
使用ApacheCassandra实现LLM缓存：提升AI应用性能的实用指南引言在当今的AI驱动的应用程序中，大语言模型（LLM）扮演着越来越重要的角色。然而，频繁调用LLMAPI不仅会增加延迟，还会导致高昂的成本。为了解决这个问题，实现有效的缓存策略变得至关重要。本文将介绍如何使用ApacheCassandra®或AstraDB来实现LLM缓存，从而显著提升您的AI应用性能和成本效率。为什么选择
CentOS下php安装mcrypt扩展天咋哭了
（以下步骤均为本人实际操作，可能与你的安装方法有所区别，但我会尽量排除疑惑）大致步骤（1）安装mcrypt，（2）安装php对mcrypt的扩展，（3）重启apache（1）、确认你的linux没有安装mcrypt库，如果已安装，跳过安装步骤[root@test-206~]#yumlistinstalled|grepmcryptlibmcrypt.x86_642.5.8-4.el5.centosi
javaweb基于ssm框架学生信息管理(成绩)系统设计与实现 ancen_73bd
开发平台、开发工具、应用服务器的介绍开发平台：Windows开发工具：idea+mySql应用服务器：ApacheTomcat8.0学生成绩管理系统主要用于学校学生成绩信息管理，能实现学生、老师、院系、班级、课程的增删改查操作，同时学生能进行选课和退课操作，老师能对学生的成绩录入和修改操作。系统流程图功能结构图部分截图免费源码获得：扫码关注微信公众号：ancenok，然后回复：013
ASP.NET Core 入门教学二十八 linux打包部署充值内卷 asp.net linux 后端
在Linux上打包和部署ASP.NETCore应用程序涉及几个步骤。以下是一个详细的指南，帮助你在Linux系统上完成这一过程。1.准备工作确保你的Linux系统已经安装了以下软件：.NETSDK（用于构建应用程序）.NETRuntime（用于运行应用程序）Apache或Nginx（作为反向代理服务器）你可以使用以下命令安装.NETSDK和Runtime：sudoaptupdatesudoapti
Hadoop学习第三课（HDFS架构--读、写流程）小小程序员呀~ 数据库 hadoop 架构 big data
1.块概念举例1：一桶水1000ml，瓶子的规格100ml=>需要10个瓶子装完一桶水1010ml，瓶子的规格100ml=>需要11个瓶子装完一桶水1010ml，瓶子的规格200ml=>需要6个瓶子装完块的大小规格，只要是需要存储，哪怕一点点，也是要占用一个块的块大小的参数：dfs.blocksize官方默认的大小为128M官网：https://hadoop.apache.org/docs/r3.
C/C++Win32编程基础详解视频下载择善Zach 编程 C++Win32
课题视频：C/C++Win32编程基础详解视频知识：win32窗口的创建 windows事件机制主讲：择善Uncle老师学习交流群：386620625 验证码：625 --
Guava Cache使用笔记 bylijinnan java guava cache
1.Guava Cache的get/getIfPresent方法当参数为null时会抛空指针异常我刚开始使用时还以为Guava Cache跟HashMap一样，get(null)返回null。实际上Guava整体设计思想就是拒绝null的，很多地方都会执行com.google.common.base.Preconditions.checkNotNull的检查。 2.Guava
解决ora-01652无法通过128（在temp表空间中） 0624chenhong oracle
解决ora-01652无法通过128（在temp表空间中）扩展temp段的过程一个sql语句后，大约花了10分钟，好不容易有一个结果，但是报了一个ora-01652错误，查阅了oracle的错误代码说明：意思是指temp表空间无法自动扩展temp段。这种问题一般有两种原因：一是临时表空间空间太小，二是不能自动扩展。分析过程：既然是temp表空间有问题，那当
Struct在jsp标签不懂事的小屁孩 struct
非UI标签介绍：控制类标签： 1：程序流程控制标签 if elseif else <s:if test="isUsed"> <span class="label label-success">True</span> </
按对象属性排序换个号韩国红果果 JavaScript 对象排序
利用JavaScript进行对象排序，根据用户的年龄排序展示 <script> var bob={ name;bob, age:30 } var peter={ name;peter, age:30 } var amy={ name;amy, age:24 } var mike={ name;mike, age:29 } var john={
大数据分析让个性化的客户体验不再遥远蓝儿唯美数据分析
顾客通过多种渠道制造大量数据，企业则热衷于利用这些信息来实现更为个性化的体验。分析公司Gartner表示，高级分析会成为客户服务的关键，但是大数据分析的采用目前仅局限于不到一成的企业。挑战在于企业还在努力适应结构化数据，疲于根据自身的客户关系管理（CRM）系统部署有效的分析框架，以及集成不同的内外部信息源。然而，面对顾客通过数字技术参与而产生的快速变化的信息，企业需要及时作出反应。要想实
java笔记4 a-john java
操作符 1，使用java操作符操作符接受一个或多个参数，并生成一个新值。参数的形式与普通的方法调用不用，但是效果是相同的。加号和一元的正号（+）、减号和一元的负号（-）、乘号（*）、除号（/）以及赋值号（=）的用法与其他编程语言类似。操作符作用于操作数，生成一个新值。另外，有些操作符可能会改变操作数自身的
从裸机编程到嵌入式Linux编程思想的转变------分而治之：驱动和应用程序 aijuans 嵌入式学习
笔者学习嵌入式Linux也有一段时间了，很奇怪的是很多书讲驱动编程方面的知识，也有很多书将ARM9方面的知识，但是从以前51形式的（对寄存器直接操作，初始化芯片的功能模块）编程方法，和思维模式，变换为基于Linux操作系统编程，讲这个思想转变的书几乎没有，让初学者走了很多弯路，撞了很多难墙。笔者因此写上自己的学习心得，希望能给和我一样转变
在springmvc中解决FastJson循环引用的问题 asialee 循环引用 fastjson
我们先来看一个例子： package com.elong.bms; import java.io.OutputStream; import java.util.HashMap; import java.util.Map; import co
ArrayAdapter和SimpleAdapter技术总结百合不是茶 android SimpleAdapter ArrayAdapter 高级组件基础
ArrayAdapter比较简单，但它只能用于显示文字。而SimpleAdapter则有很强的扩展性，可以自定义出各种效果 ArrayAdapter;的数据可以是数组或者是队列 // 获得下拉框对象 AutoCompleteTextView textview = (AutoCompleteTextView) this
九封信 bijian1013 人生励志
有时候，莫名的心情不好，不想和任何人说话，只想一个人静静的发呆。有时候，想一个人躲起来脆弱，不愿别人看到自己的伤口。有时候，走过熟悉的街角，看到熟悉的背影，突然想起一个人的脸。有时候，发现自己一夜之间就长大了。 2014，写给人
Linux下安装MySQL Web 管理工具phpMyAdmin sunjing PHP Install phpMyAdmin
PHP http://php.net/ phpMyAdmin http://www.phpmyadmin.net Error compiling PHP on CentOS x64 一、安装Apache 请参阅http://billben.iteye.com/admin/blogs/1985244 二、安装依赖包 sudo yum install gd
分布式系统理论 bit1129 分布式
FLP One famous theory in distributed computing, known as FLP after the authors Fischer, Lynch, and Patterson, proved that in a distributed system with asynchronous communication and process crashes,
ssh2整合(spring+struts2+hibernate)-附源码白糖_ eclipse spring Hibernate mysql 项目管理
最近抽空又整理了一套ssh2框架，主要使用的技术如下： spring做容器，管理了三层(dao,service,actioin)的对象 struts2实现与页面交互(MVC)，自己做了一个异常拦截器，能拦截Action层抛出的异常 hibernate与数据库交互 BoneCp数据库连接池，据说比其它数据库连接池快20倍，仅仅是据说 MySql数据库项目用eclipse
treetable bug记录 braveCS table
// 插入子节点删除再插入时不能正常显示。修改： //不知改后有没有错，先做个备忘 Tree.prototype.removeNode = function(node) { // Recursively remove all descendants of +node+ this.unloadBranch(node); // Remove
编程之美-电话号码对应英语单词 bylijinnan java 算法编程之美
import java.util.Arrays; public class NumberToWord { /** * 编程之美电话号码对应英语单词 * 题目： * 手机上的拨号盘，每个数字都对应一些字母，比如2对应ABC，3对应DEF.........，8对应TUV，9对应WXYZ， * 要求对一段数字，输出其代表的所有可能的字母组合
jquery ajax读书笔记 chengxuyuancsdn jQuery ajax
1、jsp页面 <%@ page language="java" import="java.util.*" pageEncoding="GBK"%> <% String path = request.getContextPath(); String basePath = request.getScheme()
JWFD工作流拓扑结构解析伪码描述算法 comsci 数据结构算法工作活动 J#
对工作流拓扑结构解析感兴趣的朋友可以下载附件，或者下载JWFD的全部代码进行分析 /* 流程图拓扑结构解析伪码描述算法 public java.util.ArrayList DFS(String graphid, String stepid, int j)
oracle I/O 从属进程 daizj oracle
I/O 从属进程　　I/O从属进程用于为不支持异步I/O的系统或设备模拟异步I/O.例如，磁带设备(相当慢)就不支持异步I/O.通过使用I/O 从属进程，可以让磁带机模仿通常只为磁盘驱动器提供的功能。就好像支持真正的异步I/O 一样，写设备的进程(调用者)会收集大量数据，并交由写入器写出。数据成功地写出时，写入器(此时写入器是I/O 从属进程，而不是操作系统)会通知原来的调用者，调用者则会
高级排序:希尔排序 dieslrae 希尔排序
public void shellSort(int[] array){ int limit = 1; int temp; int index; while(limit <= array.length/3){ limit = limit * 3 + 1;
初二下学期难记忆单词 dcj3sjt126com english word
kitchen 厨房 cupboard 厨柜 salt 盐 sugar 糖 oil 油 fork 叉；餐叉 spoon 匙；调羹 chopsticks 筷子 cabbage 卷心菜；洋白菜 soup 汤 Italian 意大利的 Indian 印度的 workplace 工作场所 even 甚至；更 Italy 意大利 laugh 笑 m
Go语言使用MySQL数据库进行增删改查 dcj3sjt126com mysql
目前Internet上流行的网站构架方式是LAMP，其中的M即MySQL, 作为数据库，MySQL以免费、开源、使用方便为优势成为了很多Web开发的后端数据库存储引擎。MySQL驱动Go中支持MySQL的驱动目前比较多，有如下几种，有些是支持database/sql标准，而有些是采用了自己的实现接口,常用的有如下几种: http://code.google.c...o-mysql-dri
git命令 shuizhaosi888 git
---------------设置全局用户名： git config --global user.name "HanShuliang" //设置用户名 git config --global user.email "[email protected]" //设置邮箱 ---------------查看环境配置 git config --li
qemu-kvm 网络 nat模式 (四) haoningabc kvm qemu
qemu-ifup-NAT #!/bin/bash BRIDGE=virbr0 NETWORK=192.168.122.0 GATEWAY=192.168.122.1 NETMASK=255.255.255.0 DHCPRANGE=192.168.122.2,192.168.122.254 TFTPROOT= BOOTP= function check_bridge()
不要让未来的你，讨厌现在的自己 jingjing0907 生活奋斗工作梦想
故事one 　23岁，他大学毕业，放弃了父母安排的稳定工作，独闯京城，在家小公司混个小职位，工作还算顺手，月薪三千，混了混，混走了一年的光阴。　　　　24岁，有了女朋友，从二环12人的集体宿舍搬到香山民居，一间平房，二人世界，爱爱爱。偶然约三朋四友，打扑克搓麻将，日子快乐似神仙；　　　　25岁，出了几次差，调了两次岗，薪水涨了不过百，生猛狂飙的物价让现实血淋淋，无力为心爱银儿购件大牌
枚举类型详解一路欢笑一路走 enum 枚举详解 enumset enumMap
枚举类型详解一.Enum详解 1.1枚举类型的介绍 JDK1.5加入了一个全新的类型的”类”—枚举类型，为此JDK1.5引入了一个新的关键字enum,我们可以这样定义一个枚举类型。 Demo:一个最简单的枚举类 public enum ColorType { RED
第11章动画效果（上） onestopweb 动画
index.html <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> <html xmlns="http://www.w3.org/
Eclipse中jsp、js文件编辑时，卡死现象解决汇总 ljf_home eclipse jsp卡死 js卡死
使用Eclipse编辑jsp、js文件时，经常出现卡死现象，在网上百度了N次，经过N次优化调整后，卡死现象逐步好转，具体那个方法起到作用，不太好讲。将所有用过的方法罗列如下： 1、取消验证 windows–>perferences–>validation 把除了manual 下面的全部点掉，build下只留 classpath dependency Valida
MySQL编程中的6个重要的实用技巧 tomcat_oracle mysql
每一行命令都是用分号(;)作为结束对于MySQL，第一件你必须牢记的是它的每一行命令都是用分号(;)作为结束的，但当一行MySQL被插入在PHP代码中时，最好把后面的分号省略掉，例如： mysql_query("INSERT INTO tablename(first_name,last_name)VALUES('$first_name',$last_name')");
zoj 3820 Building Fire Stations(二分+bfs) 阿尔萨斯 Build
题目链接：zoj 3820 Building Fire Stations 题目大意：给定一棵树，选取两个建立加油站，问说所有点距离加油站距离的最大值的最小值是多少，并且任意输出一种建立加油站的方式。解题思路：二分距离判断，判断函数的复杂度是o(n)，这样的复杂度应该是o(nlogn)，即使常数系数偏大，但是居然跑了4.5s，也是醉了。判断函数里面做了3次bfs，但是每次bfs节点最多