hadoop 3.0.2配置（Ubuntu18.04）

内容导读

互联网集市收集整理的这篇技术教程文章主要介绍了hadoop 3.0.2配置（Ubuntu18.04），小编现在分享给大家，供广大互联网技能从业者学习和参考。文章包含2907字，纯文字阅读大概需要5分钟。

内容图文

我的Java目录是/opt/jdk1.8.0_211，hadoop目录是/opt/bigdata/hadoop-3.0.2

1.环境变量 /etc/profile

#java
export JAVA_HOME=/opt/jdk1.8.0_211

export CLASSPATH=.:$JAVA_HOME/lib/

export PATH=$PATH:$JAVA_HOME/bin

export JAVA_HOME PATH CLASSPATH

#hadoop

export HADOOP_HOME=/opt/bigdata/hadoop-3.0.2

export PATH=$PATH:$HADOOP_HOME/sbin

export PATH=$PATH:$HADOOP_HOME/bin

export HADOOP_MAPRED_HOME=$HADOOP_HOME

export HADOOP_YARN_HOME=$HADOOP_HOME

export HADOOP_MAPRED_HOME=$HADOOP_HOME

export HADOOP_COMMON_HOME=$HADOOP_HOME

export HADOOP_HDFS_HOME=$HADOOP_HOME

export YARN_HOME=$HADOOP_HOME

export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop

export YARN_CONF_DIR=$HADOOP_HOME/etc/hadoop

export PATH=$PATH:$HADOOP_HOME/bin

export PATH=$PATH:$HADOOP_HOME/sbin

2.hadoop-env.sh

export JAVA_HOME=/opt/jdk1.8.0_211

export HADOOP_HOME=/opt/bigdata/hadoop-3.0.2

3.hdfs-site.xml

<configuration>

<property>

<name>dfs.namenode.name.dir</name>

<value>/opt/bigdata/hadoop-3.0.2/dfs/name</value>

<final>true</final>

</property>



<property>

<name>dfs.datanode.data.dir</name>

<value>/opt/bigdata/hadoop-3.0.2/dfs/data</value>

<final>true</final>

</property>




<property>

<name>dfs.replication</name>

<value>1</value>




</property>

<property>

<name>dfs.permissions</name>

<value>false</value>

</property>

</configuration>

4.core-site.xml

<

configuration>

<property>

<name>fs.defaultFS</name>

<value>hdfs://localhost:9820</value>

</property>

<property>

<name>hadoop.tmp.dir</name>

<value>/opt/bigdata/hadoop-3.0.2/tmp</value>

<description>Abase for other temporary directories.</description>

</property>

</configuration>

5.mapred-site.xml

<configuration>


<property>

<name>mapreduce.framework.name</name>

<value>yarn</value>

</property>

<property>

<name>mapreduce.application.classpath</name>

<value>

${HADOOP_HOME}/etc/hadoop,

${HADOOP_HOME}/share/hadoop/common/*,

${HADOOP_HOME}/share/hadoop/common/lib/*,

${HADOOP_HOME}/share/hadoop/hdfs/*,

${HADOOP_HOME}/share/hadoop/hdfs/lib/*,

${HADOOP_HOME}/share/hadoop/mapreduce/*,

${HADOOP_HOME}/share/hadoop/mapreduce/lib/*,

${HADOOP_HOME}/share/hadoop/yarn/*,

${HADOOP_HOME}/share/hadoop/yarn/lib/*

</value>

</property><configuration>

6.yarn-site.xml

<configuration>


<!-- Site specific YARN configuration properties -->


<!-- Site specific YARN configuration properties -->


<property>

<name>yarn.nodemanager.aux-services</name>

<value>mapreduce_shuffle</value>

</property>

<property>

<name>yarn.resourcemanager.hostname</name>

<value>localhost</value>

</property>

<!--

<property>

<name>yarn.resourcemanager.address</name>

<value>namenode:8032</value>

</property>

<property>

<name>yarn.resourcemanager.scheduler.address</name>

<value>namenode:8030</value>

</property>

<property>

<name>yarn.resourcemanager.resource-tracker.address</name>

<value>namenode:8031</value>

</property>

<property>

<name>yarn.resourcemanager.admin.address</name>

<value>namenode:8033</value>

</property>

<property>

<name>yarn.resourcemanager.webapp.address</name>

<value>namenode:8088</value>

</property>

-->

</configuration>

内容总结

以上是互联网集市为您收集整理的hadoop 3.0.2配置（Ubuntu18.04）全部内容，希望文章能够帮你解决hadoop 3.0.2配置（Ubuntu18.04）所遇到的程序开发问题。 如果觉得互联网集市技术教程内容还不错，欢迎将互联网集市网站推荐给程序员好友。

内容备注

版权声明：本文内容由互联网用户自发贡献，该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容， 请发送邮件至 gblab@vip.qq.com 举报，一经查实，本站将立刻删除。

内容手机端

---