Category Archives: oozie

Oozie: CRON style scheduling in Oozie

Cron scheduling adds a lot of flexibility while scheduling jobs using the Oozie coordinator. Its bit tricky, but once you familiarize its going to benefit a lot. Here, just focus on the frequency part in your coordinator.xml <coordinator-app name=”oozie-coordinator” frequency=”0/10 … Continue reading

Posted in oozie, Uncategorized | Tagged , , | Leave a comment

Oozie: How to pass current date to Work Flow

Coordinator.xml <coordinator-app name=”oozie-coordinator” frequency=”1440″ start=”2017-10-06T15:00Z” end=”2099-09-19T13:00Z” timezone=”Canada/Eastern” xmlns=”uri:oozie:coordinator:0.1″> <action> <workflow> <app-path>${workflowxml}</app-path> <configuration> <property> <name>currentDate</name> <value>${coord:formatTime(coord:dateOffset(coord:nominalTime(), 0, ‘DAY’), “yyyyMMdd”)} </value> </property> </configuration> </workflow> </action> </coordinator-app> **Change “0” to -1 if you prefer PREVIOUS DATE Access currentDate in your workflow.xml and pass … Continue reading

Posted in oozie, Uncategorized | Tagged , , , , , | Leave a comment

Tips: OOZIE

I would include important commands and other tips related to oozie here.. Trigger Workflow oozie job -oozie http://<host&gt;:11000/oozie -config /users/oozieTest/ooziePigTest/oozie-test/job/job.properties -run Trigger Workflow Through REST API curl -X POST -H “Content-Type: application/xml” -d @oozie-testcurl.xml “http://<host&gt;:11000/oozie/v2/jobs?action=start” Trigger Coordinator oozie job -oozie http://<host&gt;:11000/oozie … Continue reading

Posted in oozie, Rest API, Tips | Tagged , , | Leave a comment

Oozie : Trigger coordinator on data availability

Here is a sample to trigger coordinator on data availability.. Coordinator.xml <coordinator-app name=”oozie-coord-pig-datatrigger” frequency=”3″ start=”2015-06-09T14:25Z” end=”2015-07-05T12:59Z” timezone=”Canada/Eastern” xmlns=”uri:oozie:coordinator:0.1″> <datasets> <dataset name=”input1″ frequency=”05″ initial-instance=”2015-06-09T13:30Z” timezone=”Canada/Eastern”> <!– Below path can be created on HDFS like ${appPath}/feed/2014/03/11/20 –> <uri-template>/user/oozie/trigger</uri-template> </dataset> </datasets> <input-events> <data-in … Continue reading

Posted in oozie | Tagged , , , | Leave a comment

Oozie : Sending emails

Oozie has a feature which allows sending emails in Oozie from a workflow application. For example :- In your workflow.xml, include the following action. <action name=”sendEmail”> <email xmlns=”uri:oozie:email-action:0.1″> <to>xyz@abc.com</to> <subject>WF Success</subject> <body>WF Successfully executed</body> </email> <ok to=”end”/> <error to=”kill”/> </action>   … Continue reading

Posted in oozie | Tagged , , | Leave a comment

Oozie : Trigger Oozie Coordinator Jobs via RestAPI calls

It is also possible to execute the Oozie Coordinator Jobs using Rest API. It helps us to run it from any machine which doesnt have oozie client installed. Create an xml file – oozie-testxml.xml – in the local of your Unix … Continue reading

Posted in oozie | Leave a comment

Oozie : Trigger Oozie workflow via RestAPI calls

It is also possible to execute the Oozie workflow using Rest API. It helps us to run it from any machine which doesnt have oozie client installed. Create an xml file – oozie-testxml.xml – in the local of your Unix machine. $ … Continue reading

Posted in oozie | Leave a comment