Geek asks and answers

Hadoop fs commands show local file system, not hdfs

I installed hadoop on several laptops to form a hadoop cluster. First, we installed it in pseudo-distributed mode, and in all cases except one, everything was perfect (i.e., all services started, and when I do tests with it hadoop fs, it shows hdfs). In aftermarket laptop (with problems) team `hadoop fs -lsshows local directory information, instead of hdfsthe same thing happening with the team -cat, -mkdir, -put. What can i do wrong?

Any help would be appreciated

Here is my core-site.xml

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
 <name>hadoop.tmp.dir</name>
 <value>/home/hduser/hdfs_dir/tmp</value>
 <description></description>
</property>

<property>
 <name>fs.default.name</name>
 <value>hdfs://localhost:54310</value>
 <description>.</description>
</property>
</configuration>

I have to say that this is the same file for all other laptops, and they work fine.

+5
source share
3 answers

, fs.default.name core-site.xml datanode ex:

<property>
     <name>fs.default.name</name>
     <value>hdfs://target-namenode:54310</value>
</property>
+4

, , fs.default.name / :

<property>
 <name>fs.default.name</name>
 <value>hdfs://localhost:54310/</value>
 <description>.</description>
</property>
+4

fs.default.name core-site.xml hdfs://localhost:54310/ /, , . cloudera cdh4 :

ls -l /etc/hadoop/conf
** /etc/hadoop/conf -> /etc/alternatives/hadoop-conf
ls -l /etc/alternatives/hadoop-conf
** /etc/alternatives/hadoop-conf -> /etc/hadoop/conf.cloudera.yarn1

MRv1 MRv2 (YARN), :

ls -l /etc/hadoop/conf
** /etc/hadoop/conf -> /etc/alternatives/hadoop-conf
ls -l /etc/alternatives/hadoop-conf
** /etc/alternatives/hadoop-conf -> /etc/hadoop/conf.cloudera.mapreduce1
ls -l /etc/hadoop/conf.cloudera.mapreduce1
ls: cannot access /etc/hadoop/conf.cloudera.mapreduce1: No such file or directory

Also, update-alternatives was run to have high priority for /etc/hadoop/conf.cloudera.mapreduce1 path as:

alternatives --display hadoop-conf
hadoop-conf - status is manual.
link currently points to /etc/hadoop/conf.cloudera.mapreduce1
/etc/hadoop/conf.cloudera.hdfs1 - priority 90
/etc/hadoop/conf.cloudera.mapreduce1 - priority 92
/etc/hadoop/conf.empty - priority 10
/etc/hadoop/conf.cloudera.yarn1 - priority 91
Current `best' version is /etc/hadoop/conf.cloudera.mapreduce1.

:

update-alternatives --remove hadoop-conf/etc/hadoop/conf.cloudera.mapreduce1
rm -f/etc/alternatives/hadoop-conf
ln -s/etc/hadoop/conf.cloudera.yarn1/etc/alternatives/hadoop-conf
>

+1
source

More articles:


All Articles