incremental load

• Define Parameter variable:

          Mappings -> Parameters & Variables   

          Lets say ($$mv_PreviousUpdate - Variable - date/time - - - Max - False)   

          Initial Value (Lets say 01/01/1800 01:02:03)

 

• Source Qualifier -> Properties Tab    

         SQL Query - SELECT * FROM EMP WHERE TO_DATE(DOJ, 'MM/DD/YYYY HH24:MI:SS') > TO_DATE('$$mv_PreviousUpdate', 'MM/DD/YYYY HH24:MI:SS')

 

• Add Expression Transformation    

          Define variable Port (Lets say - v_Set_Date)    

          Edit Expression of this variable port as ->SETMAXVARIABLE($$mv_PreviousUpdate, DOJ)

 

• Connect Exp Transformation to Target.
• Create Session and Workflow

 

First time it compares with date 01/01/1800 01:02:03 and load all record having DOJ greater than. On Completion it set the variable $$mv_PreviousUpdate with max value of DOJ. In second run it will compare with MAX(DOJ) of first run and so on...