running an oozie workflow using java code

Question

I'm new to java and having some trouble running an oozie job using java code. I am unable to figure out the problem in the code. Some help will be really appreciated. Here's my code

import java.util.Properties;

import org.apache.oozie.client.OozieClient;
import org.apache.oozie.client.WorkflowJob;

public class oozie {

public static void main(String[] args) {
    OozieClient wc = new OozieClient("http://host:11000/oozie");

    Properties conf = wc.createConfiguration();

    conf.setProperty(OozieClient.APP_PATH, "hdfs://cluster/user/apps/merge-psp-logs/merge-wf/workflow.xml");
    conf.setProperty("jobTracker", "jobtracker.bigdata.com:8021");
    conf.setProperty("nameNode", "hdfs://namenode.bigdata.com:8020");
    conf.setProperty("queueName", "jobtracker.bigdata.com:8021");
    conf.setProperty("appsRoot", "hdfs://namenode.bigdata.com:8020/user/workspace/apps");
    conf.setProperty("appLibLoc", "hdfs://namenode.bigdata.com:8020/user/workspace/lib");
    conf.setProperty("rawlogsLoc", "hdfs://namenode.bigdata.com:8020/user/workspace/");
    conf.setProperty("mergedlogsLoc", "jobtracker.bigdata.com:8021");
    try {
        String jobId = wc.run(conf);
        System.out.println("Workflow job submitted");

        while (wc.getJobInfo(jobId).getStatus() == WorkflowJob.Status.RUNNING) {
            System.out.println("Workflow job running ...");
            Thread.sleep(10 * 1000);
        }
        System.out.println("Workflow job completed ...");
        System.out.println(wc.getJobInfo(jobId));
    } catch (Exception r) {
        System.out.println("Errors");
    }
}
}

Though i am able to launch the job using command line

Compilation or runtime error?

Giulio Quaresima
– Giulio Quaresima

2012-10-11 09:29:03 +00:00
Commented Oct 11, 2012 at 9:29 — Giulio Quaresima
– Giulio Quaresima, Commented Oct 11, 2012 at 9:29
@GiulioQuaresima gives me runtime errors

Chirag
– Chirag

2012-10-11 09:32:49 +00:00
Commented Oct 11, 2012 at 9:32 — Chirag
– Chirag, Commented Oct 11, 2012 at 9:32

Chris White · Accepted Answer · 2012-10-11 10:31:53Z

2

Without any further information, i would say this is the probably cause of your runtime errors:

conf.setProperty(OozieClient.APP_PATH, 
    "hdfs://cluster/user/apps/merge-psp-logs/merge-wf/workflow.xml");
conf.setProperty("jobTracker", "jobtracker.bigdata.com:8021");
conf.setProperty("nameNode", "hdfs://namenode.bigdata.com:8020");
conf.setProperty("queueName", "jobtracker.bigdata.com:8021");

Unless you have two clusters, my guess is you meant the APP_PATH to point to the same HDFS instance as the one named in your nameNode property, in which case try:

conf.setProperty(OozieClient.APP_PATH, 
    "hdfs://namenode.bigdata.com:8020/user/apps/merge-psp-logs/merge-wf/workflow.xml");

You might also want to change the queueName to a real queue name (probably "default", unless jobtracker.bigdata.com:8021 is the actual name of your queue):

conf.setProperty("queueName", "default");

Aside from those observations, try and post the actual runtime error you're seeing.

answered Oct 11, 2012 at 10:31

Chris White

30.1k4 gold badges75 silver badges96 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Chirag Over a year ago

made the required changes. don't have anymore runtime errors. the console prints "Errors" as per the exception defined. any idea what might be the reason?

Chris White Over a year ago

Seriously, this would be a lot easier if you posted the errors you're seeing

Chirag Over a year ago

got the thing working. it was because of, firstly the changes which you asked to make and lastly, including json-simple jar in the classpath

Collectives™ on Stack Overflow

running an oozie workflow using java code

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related