Hadoop伪分布式安装.docx
- 文档编号:3913169
- 上传时间:2023-05-06
- 格式:DOCX
- 页数:14
- 大小:1.06MB
Hadoop伪分布式安装.docx
《Hadoop伪分布式安装.docx》由会员分享,可在线阅读,更多相关《Hadoop伪分布式安装.docx(14页珍藏版)》请在冰点文库上搜索。
Hadoop伪分布式安装
Hadoop伪分布式安装
1.Hadoop组件依赖关系
1.
环境变量
1)系统环境变量:
/etc/profile
2)用户环境变量:
.bash_profile
2.开始安装
1.关闭防火墙,禁用selinux
[root@centos1simba]#serviceiptablesstop
iptables:
SettingchainstopolicyACCEPT:
filter[OK]
iptables:
Flushingfirewallrules:
[OK]
iptables:
Unloadingmodules:
[OK]
[root@centos1simba]#serviceiptablesstatus
iptables:
Firewallisnotrunning.
[root@centos1simba]#vi/etc/sysconfig/selinux
:
SELINUX=disabled
2.设置静态IP地址()
[root@centos1simba]#vi/etc/sysconfig/network-scripts/ifcfg-eth0
3.重命名主机
[root@centos1simba]#hostnamenew-name------effectiveimmediately
[root@centos1simba]#more/etc/sysconfig/network
NETWORKING=yes
HOSTNAME=centos1
NTPSERVERARGS=iburst-------effectafterrestart
4.IP与hostname绑定
[root@centos1simba]#vi/etc/hosts-------ipconnecthostname
127.0.0.1localhostlocalhost.localdomainlocalhost4localhost4.localdomain4
:
:
1localhostlocalhost.localdomainlocalhost6localhost6.localdomain6
192.168.1.180centos1
192.168.1.181centos2
5.设置ssh自动登录
##ssh-----(inputnothingjustenter-key一直按回车直到出现图为止)
[simba@centos1~]$ssh-keygen-trsa
Generatingpublic/privatersakeypair.
Enterfileinwhichtosavethekey(/home/simba/.ssh/id_rsa):
Createddirectory'/home/simba/.ssh'.
Enterpassphrase(emptyfornopassphrase):
Entersamepassphraseagain:
Youridentificationhasbeensavedin/home/simba/.ssh/id_rsa.
Yourpublickeyhasbeensavedin/home/simba/.ssh/id_rsa.pub.
Thekeyfingerprintis:
2c:
fa:
90:
3a:
8a:
0a:
25:
a6:
81:
99:
e3:
1d:
90:
c7:
13:
6esimba@centos1
Thekey'srandomartimageis:
[simba@centos1~]$cd.ssh
[simba@centos1.ssh]$ls
id_rsaid_rsa.pub
[simba@centos1.ssh]$ll
total8
-rw-------.1simbasimba1675Jul611:
09id_rsa-------privatekey
-rw-r--r--.1simbasimba395Jul611:
09id_rsa.pub-------publickey
[simba@centos1.ssh]$cp~/.ssh/id_rsa.pub~/.ssh/authorized_keys
[simba@centos1.ssh]$ll
total12
-rw-r--r--.1simbasimba395Jul611:
29authorized_keys
-rw-------.1simbasimba1675Jul611:
09id_rsa
-rw-r--r--.1simbasimba395Jul611:
09id_rsa.pub
[simba@centos1.ssh]$sshlocalhost
Theauthenticityofhost'localhost(:
:
1)'can'tbeestablished.
RSAkeyfingerprintisee:
0a:
04:
a3:
b7:
6d:
33:
77:
66:
95:
bb:
ad:
0c:
a8:
12:
e4.
Areyousureyouwanttocontinueconnecting(yes/no)?
yes
Warning:
Permanentlyadded'localhost'(RSA)tothelistofknownhosts.
[simba@centos1~]$exit
logout
Connectiontolocalhostclosed.
[simba@centos1.ssh]$ll
total16
-rw-r--r--.1simbasimba395Jul611:
29authorized_keys
-rw-------.1simbasimba1675Jul611:
09id_rsa
-rw-r--r--.1simbasimba395Jul611:
09id_rsa.pub
-rw-r--r--.1simbasimba391Jul611:
31known_hosts
[simba@centos1.ssh]$moreknown_hosts
localhostssh-rsaAAAAB3NzaC1yc2EAAAABIwAAAQEAvqCuME5Qb0+mDD2GDbWiVcL6Y0ffuChYfm
LYwGtpYJYh+CMpFsuwiy5bI75BHtrPN+ypW+Dwk1K7WC6014wmSFGao1cabSI3X2avYl+BmJV0i3XkSN
+7ijyz7uCuqUXvmy7D06w4gBIOPUkmcTRCPmW5relqEULyonOuDXJBroWleAlm0LqhVdHyBKS+JAAjxu
KlfeY9HpjCNCyr+RC3+gniK8mG+DiQCNnOdSI0zdcpvDgGU2hevqwVESvdEWM57263hnhD/y5lgcAC3s
+gdk2Go4hkivetsy1FQM4ad8IPoQOifc8csjJGvSc+mhDguU+AGdPbK8sCZ+0L7BEwsQ==
[simba@centos1.ssh]$sshlocalhost
Lastlogin:
MonJul611:
31:
052015fromlocalhost
[simba@centos1~]$exit
logout
Connectiontolocalhostclosed.
[simba@centos1.ssh]$sshcentos2
Theauthenticityofhost'simba(192.168.1.180)'can'tbeestablished.
RSAkeyfingerprintisee:
0a:
04:
a3:
b7:
6d:
33:
77:
66:
95:
bb:
ad:
0c:
a8:
12:
e4.
Areyousureyouwanttocontinueconnecting(yes/no)?
yes
Warning:
Permanentlyadded'simba,192.168.1.180'(RSA)tothelistofknownhosts.
Lastlogin:
MonJul611:
33:
562015fromlocalhost
[simba@centos1~]$exit
logout
Connectiontosimbaclosed.
[simba@centos1.ssh]$ll
total16
-rw-r--r--.1simbasimba395Jul611:
29authorized_keys
-rw-------.1simbasimba1675Jul611:
09id_rsa
-rw-r--r--.1simbasimba395Jul611:
09id_rsa.pub
-rw-r--r--.1simbasimba792Jul611:
35known_hosts
[simba@centos1.ssh]$moreknown_hosts
localhostssh-rsaAAAAB3NzaC1yc2EAAAABIwAAAQEAvqCuME5Qb0+mDD2GDbWiVcL6Y0ffuChYfm
LYwGtpYJYh+CMpFsuwiy5bI75BHtrPN+ypW+Dwk1K7WC6014wmSFGao1cabSI3X2avYl+BmJV0i3XkSN
+7ijyz7uCuqUXvmy7D06w4gBIOPUkmcTRCPmW5relqEULyonOuDXJBroWleAlm0LqhVdHyBKS+JAAjxu
KlfeY9HpjCNCyr+RC3+gniK8mG+DiQCNnOdSI0zdcpvDgGU2hevqwVESvdEWM57263hnhD/y5lgcAC3s
+gdk2Go4hkivetsy1FQM4ad8IPoQOifc8csjJGvSc+mhDguU+AGdPbK8sCZ+0L7BEwsQ==
centos2,192.168.1.180ssh-rsaAAAAB3NzaC1yc2EAAAABIwAAAQEAvqCuME5Qb0+mDD2GDbWiVcL6
Y0ffuChYfmLYwGtpYJYh+CMpFsuwiy5bI75BHtrPN+ypW+Dwk1K7WC6014wmSFGao1cabSI3X2avYl+B
mJV0i3XkSN+7ijyz7uCuqUXvmy7D06w4gBIOPUkmcTRCPmW5relqEULyonOuDXJBroWleAlm0LqhVdHy
BKS+JAAjxuKlfeY9HpjCNCyr+RC3+gniK8mG+DiQCNnOdSI0zdcpvDgGU2hevqwVESvdEWM57263hnhD
/y5lgcAC3s+gdk2Go4hkivetsy1FQM4ad8IPoQOifc8csjJGvSc+mhDguU+AGdPbK8sCZ+0L7BEwsQ==
[simba@centos1.ssh]$sshcentos1
ssh:
connecttohostsimba-1port22:
Noroutetohost
[simba@centos1.ssh]$ssh192.168.1.180
Lastlogin:
MonJul611:
35:
482015fromcentos2
6.安装jdk
7.安装hadoop
修改conf文件:
1)修改core-site.xml
//192.168.1.181:
9000
2)创建/opt/data/tmp目录
[root@centos1.ssh]#cd
[root@centos1~]#cd/opt/data/
[root@centos1data]#ll
total16
-rw-r--r--.1rootroot5135Jul611:
54123.txt
drwxr-xr-x.2rootroot4096Jul116:
18input
drwxr-xr-x.2rootroot4096Jul522:
14output
[root@centos1data]#mkdirtmp
[root@centos1data]#ll
total20
-rw-r--r--.1rootroot5135Jul611:
54123.txt
drwxr-xr-x.2rootroot4096Jul116:
18input
drwxr-xr-x.2rootroot4096Jul522:
14output
drwxr-xr-x2rootroot4096Jul617:
46tmp
3.修改mapred-site.xml
[root@centos1conf]#vimapred-site.xml
9001
4.修改master
[root@centos1conf]#vislaves
192.168.1.181
5.修改slaves
[root@centos1conf]#vislaves
192.168.1.181
6.修改hdfs-site.xml
[root@centos1conf]#vihdfs-site.xml
7.格式化:
[root@centos2bin]#./hadoopnamenode-format
8.启动hadoop
[root@centos2bin]#start-all.sh
startingnamenode,loggingto/opt/modules/hadoop-0.20.0/bin/../logs/hadoop-root-namenode-centos2.out
192.168.1.181:
datanoderunningasprocess3086.Stopitfirst.
192.168.1.181:
secondarynamenoderunningasprocess3447.Stopitfirst.
startingjobtracker,loggingto/opt/modules/hadoop-0.20.0/bin/../logs/hadoop-root-jobtracker-centos2.out
192.168.1.181:
tasktrackerrunningasprocess3634.Stopitfirst.
[root@centos2bin]#jps
3634TaskTracker
4180Jps
3524JobTracker
2981NameNode
3447SecondaryNameNode
3086DataNode
[root@centos2bin]#
成功截图:
hdfs管理界面:
Mapreduce管理界面:
Tasktracker管理界面:
- 配套讲稿:
如PPT文件的首页显示word图标,表示该PPT已包含配套word讲稿。双击word图标可打开word文档。
- 特殊限制:
部分文档作品中含有的国旗、国徽等图片,仅作为作品整体效果示例展示,禁止商用。设计者仅对作品中独创性部分享有著作权。
- 关 键 词:
- Hadoop 分布式 安装
![提示](https://static.bingdoc.com/images/bang_tan.gif)