Profiling a MapReduce program using HProf

You can profile a MapReduce program using Hprof. Some settings are required for this in your driver program as shown below

1 2 3 4

conf.setBoolean("mapred.task.profile", true); conf.set("mapred.task.profile.params", "-agentlib:hprof=cpu=samples," + "heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s"); conf.set("mapred.task.profile.maps", "0-2");