Monthly Archives: July 2015

Oozie : Trigger coordinator on data availability

Here is a sample to trigger coordinator on data availability.. Coordinator.xml <coordinator-app name=”oozie-coord-pig-datatrigger” frequency=”3″ start=”2015-06-09T14:25Z” end=”2015-07-05T12:59Z” timezone=”Canada/Eastern” xmlns=”uri:oozie:coordinator:0.1″> <datasets> <dataset name=”input1″ frequency=”05″ initial-instance=”2015-06-09T13:30Z” timezone=”Canada/Eastern”> <!– Below path can be created on HDFS like ${appPath}/feed/2014/03/11/20 –> <uri-template>/user/oozie/trigger</uri-template> </dataset> </datasets> <input-events> <data-in … Continue reading

Posted in oozie | Tagged , , , | Leave a comment

Hortonworks : Ambari Rest API tricks

Rest API allows us to perform operations in a cluster more conveniently.. Edit the following property in ambari.properties api.csrfPrevention.enabled=false Getting details about a service curl -u admin:admin -X GET http://AMBARI_SERVER_HOST:8080/api/v1/clusters/c1/services/SERVICENAME Eg:- curl -u admin:admin -X GET  http://10.xx.xx.xx:8080/api/v1/clusters/CLUSTERNAME/services/FALCON Deleting a service … Continue reading

Posted in Rest API, Uncategorized | Tagged , , , | 1 Comment

Developer’s template: Hive using JDBC

Developer’s template series is intended to ease the life of  Bigdata developers with their application development and leave behind the headache of starting from the scratch. Here is a java program with its pom file which lets you to connect to Hive and … Continue reading

Posted in hive, Java-Maven-Hadoop, Uncategorized | Tagged , , , , | 2 Comments

Java-Hadoop : Create a file in HDFS programmatically and write data into it

Here is a java program with its pom file which lets you to create a file in HDFS, write data into it. The pom file lets you create 2 jar files, one which has all the dependencies included in it. … Continue reading

Posted in Java-Maven-Hadoop | Tagged , , , | Leave a comment

Oozie : Sending emails

Oozie has a feature which allows sending emails in Oozie from a workflow application. For example :- In your workflow.xml, include the following action. <action name=”sendEmail”> <email xmlns=”uri:oozie:email-action:0.1″> <to>xyz@abc.com</to> <subject>WF Success</subject> <body>WF Successfully executed</body> </email> <ok to=”end”/> <error to=”kill”/> </action>   … Continue reading

Posted in oozie | Tagged , , | Leave a comment