close

Articles about Apache Hadoop installation, performance tuning and general tutorials.

rss_feed Subscribe RSS

local_offer hadoop local_offer linux local_offer WSL

visibility 14201
thumb_up 8
access_time 2 years ago

In my previous post , I showed how to configure a single node Hadoop instance on Windows 10. The steps are not too difficult to follow if you have Java programming backgr...

open_in_new Hadoop

local_offer hadoop local_offer yarn local_offer hdfs

visibility 6154
thumb_up 0
access_time 3 years ago

Previously, I summarized the steps to install Hadoop in a single node Windows machine. Install Hadoop 3.0.0 in Windows (Single Node) In this page, ...

open_in_new Hadoop

local_offer hadoop local_offer hive local_offer WSL

visibility 3616
thumb_up 0
access_time 2 years ago

Previously, I demonstrated how to configured Apache Hive 3.0.0 on Windows 10. Apache Hive 3.0.0 Installation on Windows 10 Step by Step Guide...

open_in_new Hadoop

local_offer hadoop local_offer hdfs

visibility 952
thumb_up 0
access_time 2 years ago

Copy file from HDFS to local Use the following command: hadoop fs [-copyToLocal [-f] [-p] [-ignoreCrc] [-crc] <src> ... <localdst>] For example, copy a file from /hdfs-file.txt in HDFS to local /tmp/ using the following command: ...

open_in_new Hadoop

local_offer hadoop

visibility 350
thumb_up 0
access_time 2 years ago

Solution to fix the issue If you have been running Hadoop on Windows machines, you may encounter issues about unhealthy data nodes. Usually this will happen if there is no enough disk space in your local drive. For example, if I start the HDFS and YARN demons under the context...

open_in_new Hadoop

local_offer hadoop local_offer hdfs

visibility 894
thumb_up 0
access_time 3 years ago

Issue After finishing installation Hadoop 3.0.0 in my Windows: Install Hadoop 3.0.0 in Windows (Single Node) , I got the following error after I formated the name node several ti...

open_in_new Hadoop

local_offer hadoop local_offer hdfs

visibility 417
thumb_up 0
access_time 3 years ago

In Safe Mode, the HDFS cluster is read-only. After completion of block replication maintenance activity, the name node leaves safe mode automatically. If you try to delete files in safe mode, the following exception may raise: org.apache.hadoop.ipc.RemoteException(org.apac...

open_in_new Hadoop

local_offer hadoop local_offer yarn

visibility 2625
thumb_up 0
access_time 3 years ago

When configuring YARN and MapReduce in Hadoop cluster, it is very important to configure the memory and virtual processors correctly. If the configurations are incorrect, the nodes may not be able to start properly and the applications may not be able to run successfully. For example...

open_in_new Hadoop

local_offer hadoop local_offer yarn local_offer hdfs

visibility 11039
thumb_up 0
access_time 3 years ago

This page summarizes the default ports used by Hadoop services. It is useful when configuring network interfaces in a cluster. Hadoop 3.1.0 HDFS The secondary namenode http/https server address and port. ...

open_in_new Hadoop

local_offer SSIS local_offer hadoop local_offer hdfs

visibility 3480
thumb_up 0
access_time 3 years ago

Context SQL Server Integration Service ( SSIS ) has tasks to perform operations against Hadoop, for example: Hadoop File System Task Hadoop Hive Task Hadoop Pig Task In Data Flow Task, you can also use: Hadoop HDFS Source ...

open_in_new Hadoop