I was searching for a complete tutorial on installing Hadoop on Mac and play around with it. There are resources on installing Hadoop with "HomeBrew" which is the missing package manager in Mac ;). But i do not want to offload all the configuration burden to it as i need to learn this from top to bottom. I played with some and here are the configuration steps i followed.
1) You need to download and extract Hadoop Binary. I used Hadoop 2.5.1 which is the latest at the moment.
http://www.apache.org/dyn/closer.cgi/hadoop/common/
2) Extract the binary and lets called the location as HADOOP_HOME
eg: /Users/user1/software/hadoop-2.5.1
3) Add HADOOP_HOME and JAVA_HOME as path variables to your system. You can add them to
bashrc or bash_profile.
You can add them by issuing following commands.
$vim ~/.bash_profile
Add following entries and change paths according to your machine's configurations.
export JAVA_HOME=$(/usr/libexec/java_home)
export HADOOP_HOME=/Users/user1/software/hadoop-2.5.1
export PATH=$PATH:$HADOOP_HOME
and then reload the configurations.
$source ~/.bash_profile
(Follow these steps if you need to run in Pseudo Distributed mode. If you do continue you will have to add input files to the HDFS and then download output files from the HDFS too.)
4) Navigate to HADOOP_HOME and change following files as below.
etc/hadoop/core-site.xml:
<configuration> <property> <name>fs.defaultFS</name> <value>hdfs://localhost:9000</value> </property> </configuration>
etc/hadoop/hdfs-site.xml:
<configuration> <property> <name>dfs.replication</name> <value>1</value> </property> </configuration>
5) Setup passphraseless ssh
Now check that you can ssh to the localhost without a passphrase:
$ ssh localhost
If you cannot ssh to localhost without a passphrase, execute the following commands:
$ ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa
$ cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
(You may need to enable remote-login in system preferences --> sharing if you have not enabled it later to login through ssh.)
6) Starting the Hadoop in Standalone mode.
Navigate to $HADOOP_HOME
Format the filesystem:
$ bin/hdfs namenode -format
Start NameNode daemon and DataNode daemon:
$ sbin/start-dfs.sh
The hadoop daemon log output is written to the $HADOOP_LOG_DIR directory (defaults to $HADOOP_HOME/logs).
Browse the web interface for the NameNode; by default it is available at:
NameNode - http://localhost:50070/
So good luck with all your map reduce jobs. :)
excellent article! really helped me to get started on a mac.
ReplyDeleteGreat Article
DeleteIEEE Projects for CSE in Big Data
Java Training in Chennai
Final Year Project Centers in Chennai
Java Training in Chennai
Thanks a lot! Worked after breaking my head for ages!
ReplyDeleteNice post.. Helped me a lot !!! Thanks Shelan..
ReplyDeleteI am really glad that it was helpful.
ReplyDeleteThanks for giving the installation steps of haddop..Seo training in Chennai
ReplyDeleteHadoop is one of the best tool which is used to handle the big data in the IT industy and it is the fastest growing field in information technology.
ReplyDeletehadoop training in Chennai | hadoop training chennai
Well Said, you have furnished the right information that will be useful to anyone at all time. Thanks for sharing your Ideas.
ReplyDeleteNode JS training in chennai | Node JS training institute in chennai
Nice interesting information on the latest arrived technology which helped me to get update according to the recent trends.
ReplyDeleteSalesforce Training in Chennai | Salesforce Course in Chennai
The blog gave me idea to install hadoop standlone
ReplyDeleteHadoop Training in Chennai
Great blog ... explanation and installation procedure are very clear and step by step so easy to understand.. thanks a lot for sharing this blog to us
ReplyDeletehadoop training | big data training | hadoop training in chennai
After reading this blog i very strong in this topics and this blog really helpful to all... explanation are very clear so very easy to understand... thanks a lot for sharing this blog
ReplyDeletehadoop training in chennai velachery | big data training in chennai velachery
You have provided an nice article, Thank you very much for this one. And i hope this will be useful for many people.. and i am waiting for your next post keep on updating these kinds of knowledgeable things...
ReplyDeleteAndroid App Development Company
شركة كشف تسربات المياه بأبها
ReplyDeleteشركة كشف تسربات المياه بابها
شركة مكافحة حشرات بأبها
شركة مكافحة حشرات بمحايل عسير
شركة كشف تسربات المياه بمحايل عسير
شركة كشف تسربات برجال ألمع
شركة مكافحة حشرات برجال ألمع
ReplyDeleteشركة كشف تسربات المياه بجازان
شركة مكافحة حشرات بجازان
شركة رش دفان بجازان
شركة كشف تسربات بأبها
كشف تسربات المياه بأبها
great and nice blog thanks sharing..I just want to say that all the information you have given here is awesome...Thank you very much for this one.
ReplyDeleteWeb Design Development Company
Web design Company in Chennai
Web development Company in Chennai
it is really amazing...thanks for sharing....provide more useful information...
ReplyDeleteMobile app development company
I wondered upon your blog and wanted to say that I have really enjoyed reading your blog posts. Any way I’ll be subscribing to your feed and I hope you post again soon.
ReplyDeleteFitness SMS
Salon SMS
Investor Relation SMS
I wondered upon your blog and wanted to say that I have really enjoyed reading your blog posts. Any way I’ll be subscribing to your feed and I hope you post again soon.
ReplyDeleteiOS App Development Company
This article is very much helpful and i hope this will be an useful information for the needed one. Keep on updating these kinds of informative things...
ReplyDeletesnapho
I'm puzzled with lots of exercises. I was afraid I could not do the right time despite my hard work. I need a support person.
ReplyDeletehttp://run3play.com
This is a great inspiring article.I am pretty much pleased with your good work.You put really very helpful information. Keep it up. Keep blogging. Looking to reading your next post.
ReplyDeleteInformatica Training in Chennai
Python Training in Chennai
AngularJS Training in Chennai
It was awesome to read your blog, This Great content and useful to me.Web Development Company in Chennai
ReplyDeleteHello! This is my first visit to your blog! We are a team of volunteers and starting a new initiative in a community in the same niche. Your blog provided us useful information to work on. You have done an outstanding job.
ReplyDeleteBest AWS Training in Chennai | Amazon Web Services Training in Chennai
AWS Training in Bangalore | Amazon Web Services Training in Bangalore
Amazon Web Services Training in Pune | Best AWS Training in Pune
Good Post! Thank you so much for sharing this pretty post , it was so good to read and useful to improve my knowledge as updated one, keep blogging
ReplyDeleteHTML5 Training in Chennai
HTML Training
Pleasant Tips..Thanks for Sharing….We keep up hands on approach at work and in the workplace, keeping our business pragmatic, which recommends we can help you with your tree clearing and pruning in an invaluable and fit way.
ReplyDeleteangularjs Training in chennai
angularjs Training in chennai
angularjs-Training in tambaram
angularjs-Training in sholinganallur
angularjs-Training in velachery
Wonderful article, very useful and well explanation. Your post is extremely incredible. I will refer this to my candidates...
ReplyDeletepython interview questions and answers | python tutorials
Great thoughts you got there, believe I may possibly try just some of it throughout my daily life.
ReplyDeleteBest Devops training in sholinganallur
Devops training in velachery
Devops training in annanagar
Devops training in tambaram
This blog is the general information for the feature. You got a good work for these blog.We have a developing our creative content of this mind.Thank you for this blog. This for very interesting and useful.
ReplyDeleteJava training in Marathahalli | Java training in Btm layout
Java training in Jaya nagar | Java training in Electronic city
Excellent post!!!. The strategy you have posted on this technology helped me to get into the next level and had lot of information in it.
ReplyDeleteData Science course in rajaji nagar | Data Science with Python course in chenni
Data Science course in electronic city | Data Science course in USA
Data science course in pune | Data science course in kalyan nagar
Nice post, Thanks for sharing this with us.For more information check it once
ReplyDeleteaws online training
aws training in hyderabad
amazon web services online training(AWS)
amazon web services(AWS) training online
I enjoy what you guys are usually up too. This sort of clever work and coverage! Keep up the wonderful works guys I’ve added you guys to my blog roll.
ReplyDeleteiosh course in chennai
One of the best tool for professionals is Hadoop Training in Chennai
ReplyDeleteGreat content thanks for sharing this informative blog which provided me technical information keep posting.
ReplyDeletedevops online training
aws online training
data science with python online training
data science online training
rpa online training
It was very interesting and I really glad to see your wonderful blog. Surely It will be helping for my professional oriented. Please updated more posts...
ReplyDeleteExcel Training in Chennai
Advanced Excel Training in Chennai
corporate training in chennai
Unix Training in Chennai
Linux Training in Chennai
Social Media Marketing Courses in Chennai
Oracle Training in Chennai
Power BI Training in Chennai
Excel Training in Chennai
Advanced Excel Training in Chennai
Thanks for providing the good post. Best Dental Clinic in Velachery
ReplyDeleteDental surgeon In Velachery
Dental hospital in Velachery
Dentist in Chennai Velachery
Dental hospital in Velachery Chennai
Best Dental Clinic In Chennai Velachery
Dental care in Velachery Chennai
Best Dental Clinic In Chennai Velachery
good dentist in velachery
A perfect smile gives additional advantage to one's dignity and also it makes the person's inner confidence stronger.
This information is really useful to me.
ReplyDeletehadoop interview questions and answers for freshers
hadoop interview questions and answers pdf
hadoop interview questions and answers
hadoop interview questions and answers for experienced
hadoop interview questions and answers for testers
hadoop interview questions and answers pdf download
I love the way you write Business Analytics Online Course and share your niche! Very interesting and different! Keep it coming!
ReplyDeleteInteresting blog. Got a lotb of information about this technology.
ReplyDeleteSpoken English Classes in Chennai
Best Spoken English Classes in Chennai
IELTS Coaching in Chennai
Japanese Classes in Chennai
French Classes in Chennai
pearson vue test center in chennai
Spoken English Classes in OMR
Spoken English Classes in Porur
Thanks for sharing valuable information.
ReplyDeleteDigital Marketing training Course in chennai
digital marketing training institute in chennai
digital marketing training in Chennai
digital marketing course in Chennai
digital marketing course training in omr
digital marketing certification in omr
digital marketing course training in velachery
digital marketing training center in chennai
digital marketing courses with placement in chennai
digital marketing certification in chennai
digital marketing institute in Chennai
digital marketing certification course in Chennai
digital marketing course training in Chennai
Digital Marketing course in Chennai with placement
digital marketing courses in chennai
Nice blog
ReplyDeletefreeinplanttrainingcourseforECEstudents
internship-in-chennai-for-bsc
inplant-training-for-automobile-engineering-students
freeinplanttrainingfor-ECEstudents-in-chennai
internship-for-cse-students-in-bsnl
application-for-industrial-training
Nice
ReplyDeleteinterview-questions/aptitude/permutation-and-combination/how-many-groups-of-6-persons-can-be-formed
tutorials/oracle/oracle-delete
technology/chrome-flags-complete-guide-enhance-browsing-experience/
interview-questions/aptitude/time-and-work/a-alone-can-do-1-4-of-the-work-in-2-days
interview-questions/programming/recursion-and-iteration/integer-a-40-b-35-c-20-d-10-comment-about-the-output-of-the-following-two-statements
Great blog thanks for sharing The world around is changing at turbo speed. With digital marketing companies booming up at every corner, it can be hard to decide which is the best place for you to begin your online marketing journey. If you are based in Chennai, the answer is plain simple - Adhuntt Media has the best team that cover all your branding needs - SEO, Graphic Design, Logo Design, Social Media Marketing, Google Ads, Competitor Analysis and much more.
ReplyDeletedigital marketing company in chennai
Nice blog thanks for sharing Buy unique easy to maintain indoor plants and exotic garden plants all at the same place - Karuna Nursery - the best nursery garden in Chennai. With our exclusive collection of plants and special deals on bulk orders - you know you are at the right place.
ReplyDeleteplant nursery in chennai
Excellent blog thanks for sharing Shopping for international cosmetics in Chennai? Look no further, the Pixies Beauty Shop has got your back with hundreds of international brands to choose from, that too with the best value.
ReplyDeletebeauty Shop in Chennai
nice....!
ReplyDeletedominican republic web hosting
iran hosting
palestinian territory web hosting
panama web hosting
syria hosting
services hosting
afghanistan shared web hosting
andorra web hosting
belarus web hosting
good....
ReplyDeletebrunei darussalam hosting
inplant training in chennai
nice...
ReplyDeletebrunei darussalam web hosting
costa rica web hosting
costa rica web hosting
hong kong web hosting
jordan web hosting
turkey web hosting
nice...
ReplyDeletegibraltar web hosting
iceland web hosting
lebanon web hosting
lithuania shared web hosting
inplant training in chennai
nice............
ReplyDeleteinplant training in chennai
inplant training in chennai
inplant training in chennai for it.php
algeeria hosting
angola hostig
shared hosting
bangladesh hosting
botswana hosting
central african republi hosting
shared hosting
awesome blogs
ReplyDeleteinplant training in chennai
inplant training in chennai
inplant training in chennai for it.php
italy web hosting
afghanistan hosting
angola hosting
afghanistan web hosting
bahrain web hosting
belize web hosting
india shared web hosting
inplant training in chennai
ReplyDeleteinplant training in chennai
inplant training in chennai for it.php
chile web hosting
colombia web hosting
croatia web hosting
cyprus web hosting
bahrain web hosting
india web hosting
iran web hosting
nice blogs....
ReplyDeleteinternship in chennai for ece students
internships in chennai for cse students 2019
Inplant training in chennai
internship for eee students
free internship in chennai
eee internship in chennai
internship for ece students in chennai
inplant training in bangalore for cse
inplant training in bangalore
ccna training in chennai
Excellent post.....
ReplyDeleter programming training in chennai
internship in bangalore for ece students
inplant training for mechanical engineering students
summer internships in hyderabad for cse students 2019
final year project ideas for information technology
bba internship certificate
internship in bangalore for ece
internship for cse students in hyderabad
summer training for ece students after second year
robotics courses in chennai
very useful post... thank you for giving this post....
ReplyDeleteinplant training in chennai
inplant training in chennai
inplant training in chennai for it
Australia hosting
mexico web hosting
moldova web hosting
albania web hosting
andorra hosting
australia web hosting
denmark web hosting
it is excellent blogs...!!
ReplyDeleteinplant training for diploma students
mechanical internship in chennai
civil engineering internship in chennai
internship for b.arch students in chennai
internship for ece students in core companies in chennai
internship in chandigarh for ece
industrial training report for computer science engineering on python
internship for automobile engineering students in chennai
big data training in chennai
ethical hacking internship in chennai
nice information....
ReplyDeletewinter internship for engineering students
internship for mca students
inplant training for eee students
inplant training for eee students/
java training in chennai
internships for eee students in hyderabad
ece internship
internship certificate for mechanical engineering students
internship in nagpur for computer engineering students
kaashiv infotech internship
internship for aeronautical engineering students in india 2019
nice information......
ReplyDeleteree internship in bangalore for computer science students
internship for aeronautical engineering
internship for eee students in hyderabad
internship in pune for computer engineering students 2018
kaashiv infotech internship fees
industrial training certificate format for mechanical engineering students
internship report on machine learning with python
internship for biomedical engineering students in chennai
internships in bangalore for cse
internship in coimbatore for ece
good blogs.....!!!
ReplyDeletechile web hosting
colombia web hosting
croatia web hosting
cyprus web hosting
bahrain web hosting
india web hosting
iran web hosting
kazakhstan web hosting
korea web hosting
moldova web hosting
nice...
ReplyDeleteslovakia web hosting
timor lestes hosting
egypt hosting
egypt web hosting
ghana hosting
iceland hosting
italy shared web hosting
jamaica web hosting
kenya hosting
kuwait web hosting
very nice blogger thanks for sharing............!!!
ReplyDeletepoland web hosting
russian federation web hosting
slovakia web hosting
spain web hosting
suriname
syria web hosting
united kingdom
united kingdom shared web hosting
zambia web hosting
superb...
ReplyDeletekyrgyzstan web hosting
lebanon web hosting
lithuania web hosting
macao hosting
madagascar web hosting
pakistan hosting
panama shared web hosting
paraguay web hosting
peru web hosting
philippines hosting
ReplyDeleteit is best blogs for you...!!!
paid internships in pune for computer science students
machine learning training in chennai
data science internship in chennai
dot net training in chennai
kaashiv infotech chennai
internship for aeronautical engineering students in india
internship in automobile industry
big data internship in chennai
machine learning internship in chennai
internship in chennai for it students
nice.....it is use full...
ReplyDeleteaeronautical internship in india
free internship in chennai for mechanical engineering student
architectural firms in chennai for internship
internship in coimbatore for eee
online internships for cse students
mechanical internship certificate
inplant training report
internships in hyderabad for cse
internship for mba students in chennai
internship in trichy for cse
ReplyDeletegood.....
kaashiv infotech pune
industrial training report for electronics and communication
internships for cse
internship for automobile engineering students in bangalore
internships in bangalore for eee students
internship for civil engineering students in chennai 2019
internship in automobile companies in chennai
robotics chennai
final year projects for information technology
ReplyDeleteGet inspired by your blog. Keep doing like this....
Best IELTS Coaching in Bangalore
IELTS Training in Bangalore
IELTS Coaching centre in Chennai
IELTS Classes in Bangalore
IELTS Coaching in Bangalore
IELTS Coaching centre in coimbatore
IELTS Coaching in madurai
IELTS Coaching in Hyderabad
Selenium Training in Chennai
Ethical hacking course in bangalore
Your article is very informative. Thanks for sharing the valuable information.
ReplyDeleteData Science Course in Chennai
Data Science Courses in Bangalore
Data Science Course in Marathahalli
Best Data Science Training in Marathahalli
Data Science Institute in Marathahalli
AWS Training in Bangalore
Data Science Training in Bangalore
Data Science Institute in Bangalore
Spoken English Classes in Bangalore
DevOps Training in Bangalore
thank you sharing this blog, it is very useful information.
ReplyDeleteHadoop training bangalore
Data Science training bangalore
Very useful blog thanks for sharing IndPac India the German technology Packaging and sealing machines in India is the leading manufacturer and exporter of Packing Machines in India.
ReplyDeleteI like it and help me to development very well.Thank you for this brief explanation and very nice information.Well, got a good knowledge.
ReplyDeleteAWS training in chennai | AWS training in annanagar | AWS training in omr | AWS training in porur | AWS training in tambaram | AWS training in velachery
Thanks for sharing such information. This is really helpful for me. you can also visit our blog
ReplyDeleteBanquets in Indore
Thank you for this wonderful blog.It is really informative to all keep updating more information like this blog.
ReplyDeleteIELTS Coaching in chennai
German Classes in Chennai
GRE Coaching Classes in Chennai
TOEFL Coaching in Chennai
spoken english classes in chennai | Communication training
This is good information and really helpful for the people who need information about this.
ReplyDeletejava substring
string manipulation programs in java
string handling functions in java
date format in java
advantages of aws
software testing interview question and answer
Very nice and interesting blog. You can also check my articles as well.
ReplyDeletehow to get salesforce certification
interview preparation tips
courses after bsc computer science
data science software tools
oracle sql interview questions
pega interview questions and answers
Thanks for sharing information to our knowledge, it helps me plenty keep sharing…
ReplyDeleteBig Data Training Institute in Pune
Big Data Analytics Training in Pune
This is one of the best content for this topic and this is very useful for me. Thank you!
ReplyDeleteUnix Training in Chennai
Linux Training in Chennai
Linux Course in Chennai
Đặt vé má bay Aivivu, tham khảo
ReplyDeletevé máy bay đi Mỹ bao nhiêu tiền
vé máy bay từ houston về việt nam
vé máy bay đi Los Angeles bao nhiêu tiền
chuyến bay từ canada về việt nam
Thanks for sharing such nice info. I hope you will share more information like this. please keep on sharing!
ReplyDeletePython Training In Bangalore | Python Online Training
Artificial Intelligence Training In Bangalore | Artificial Intelligence Online Training
Data Science Training In Bangalore | Data Science Online Training
Machine Learning Training In Bangalore | Machine Learning Online Training
AWS Training In Bangalore | AWS Online Training
IoT Training In Bangalore | IoT Online Training
Adobe Experience Manager (AEM) Training In Bangalore | Adobe Experience Manager (AEM) Online Training
Oracle Apex Training In Bangalore | Oracle Apex Online Training
Wow it is really wonderful and awesome thus it is very much useful for me to understand many concepts and helped me a lot. it is really explainable very well and i got more information from your blog.
ReplyDeletePython Institutes in Pune
Python Classes in Pune
This information is really awesome thanks for sharing most valuable information.
ReplyDeletePython Training Institutes in Pune
Best Training Institute for AWS in Pune
Data Science Course in Pune
Thanks for posting the best information and the blog is very helpful.
ReplyDeleteAWS Training in bangalore | AWS Online Training
Python Training in Bangalore | Python Online Training
Artificial Intelligence Training in Bangalore | Artificial Intelligence Online Training
Strategies help create the main framework and provide marketers the big picture. Tactics involve the implementation part of the marketing plan. These two elements must work together in synchrony for direct automation to produce results. https://updigital.ca
ReplyDelete