Hue Shell工作流Workflows编写以及定时Coordinators调度

1、Shell工作流

image.png

image.png

image.png

image.png

image.png

• 注意：用nodepad++编写shell脚本之后要转换一下，不然linux下不能执行，会报java.io.IOException: Cannot run program,error=2, No such file or directory错误；因为windows的换行符 \r\n（CR LF） ，linux上识别不了 (llinux识别的是 \n (LF))，所以需要把shell脚本格式转换一下，如下图

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], main() threw exception, Cannot run program "sensor_user_data_export_hdfs.sh" (in directory "[/data/yarn/nm/usercache/zhangkai/appcache/application_1571885914821_58055/container_e737_1571885914821_58055_01_000002](http://cdh.weilaijishi.com:8888/filebrowser/view=/data/yarn/nm/usercache/zhangkai/appcache/application_1571885914821_58055/container_e737_1571885914821_58055_01_000002)"): error=2, No such file or directory
java.io.IOException: Cannot run program "sensor_user_data_export_hdfs.sh" (in directory "[/data/yarn/nm/usercache/zhangkai/appcache/application_1571885914821_58055/container_e737_1571885914821_58055_01_000002](http://cdh.weilaijishi.com:8888/filebrowser/view=/data/yarn/nm/usercache/zhangkai/appcache/application_1571885914821_58055/container_e737_1571885914821_58055_01_000002)"): error=2, No such file or directory
    at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
    at org.apache.oozie.action.hadoop.ShellMain.execute(ShellMain.java:102)
    at org.apache.oozie.action.hadoop.ShellMain.run(ShellMain.java:61)
    at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:49)
    at org.apache.oozie.action.hadoop.ShellMain.main(ShellMain.java:53)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:497)
    at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:236)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:4

image.png

image.png

定时调度

• 1、新建调度任务

  
  
  

  image.png

image.png

image.png

image.png

• 2、提交调度任务

image.png

image.png

image.png

image.png