Sunday, November 9, 2014

How to Remote Debug Standalone Hadoop


  When you run your map reduce applications you may have hiccups here and there and may need to have a look inside. If you need to remote debug rather going through logs and figuring out what went wrong following is the procedure.

I am using Intellij Idea as the IDE but for other IDE's process is similar.

1) In Intellij Idea go to Run > Edit Configuration and then click on "+" . And then add Remote for "Remote Debugging"



2) You will have following window after clicking on Remote. You can change the port you are using for remote debugging in this panel.



3) Open your Hadoop Root folder and navigate to etc/hadoop-env.sh in your editor. At the bottom of the file add the following line. (Make sure to have the port you given for IDE configuration as the address)

export HADOOP_OPTS="-agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=5005"


Now you can start hadoop in standalone mode and it will wait until you attach your IDE to debug process to resume.


16 comments:

  1. I am reading your post from the beginning, it was so interesting to read & I feel thanks to you for posting such a good blog, keep updates regularly.
    Regards,
    Python Training in Chennai|Python Taining|Python Training Institutes in Chennai

    ReplyDelete
  2. This is very informative post with lots of amazing applications visit for more info telephone applications

    ReplyDelete
  3. Excellent post!!!. The strategy you have posted on this technology helped me to get into the next level and had lot of information in it.
    Android training in Chennai | Android course in Chennai

    ReplyDelete
  4. First of all thank you sharing this informative post to us.. i got more new and useful information about hadoop which useful to improve my hadoop knowledge ..

    hadoop training institute in chennai | big data training institute in chennai

    ReplyDelete
  5. This comment has been removed by the author.

    ReplyDelete
  6. شركة تنظيف بالرياض الفيلا الجديده ؛ من خلال تنظيف و غسيل الموكيت و السجاد و الكليم و إزالة بقع الطعام منها أو التخلص من الاتربه و الغبار في وقت قياسي جدا ، كما خدمة الغسيل شقق فلل مجالس موكيت كنب مساجد خزانات منازل غسيل شقق
    غسيل فرشات غسيل فلل

    شركة تنظيف مجالس
    شركة تنظيف بالرياض توفير كافه الادوات والمعدات اللازمه في عمليه النظافة لحصول العميل علي منزل نظيف خالي من اي اوساخ بعمالة مدربة باسعار مميزة نظافة شقق موكيت سجاد كنب ستائر فلل منازل مجالس واجهات شقق مجالس كنب سجاد خزانات
    تنظيف فلل
    شركة تنظيف خزانات
    شركة تنظيف فلل ومنازل وشقق
    تنظيف مجالس فرشات ستائر كنب بالرياض

    تقدم خدمات
    تعقيم منازل
    نظافه عامه وخدمات المنزلى
    مكافحة حشرات

    حلى بلاط تلميع زوجتك وتلميع اثاث
    مكيفات فك وتركيب مكيفات
    شركة غسيل خزانات
    تعقيم شامل للمنزل
    شركة تنظيف بحائل
    شركة تنظيف بالرياض

    تهتم بتنظيف شقق فلل خيام استراحات

    تنظيف مكيفات كنب سجاد

    مجالس فرشات مكافحة حشرات

    تنظيف عزل خزانات

    تعقيم فلل مكاتب شركات جلي بلاط سيراميك

    بارخص الاسعار

    ReplyDelete
  7. People working on cyberattacks are more knowledgeable as compared to an average IT professional. Gone are the days where amateur hackers were attacking our systems. Cybersecurity Engineer Career Overview

    ReplyDelete
  8. Great information, thank you for the share. Your blog helps me knowing about Hadoop technology.
    Digital marketing courses in Nashik

    ReplyDelete