Tag - hdfs

Load Data into HDFS from SQL Server via Sqoop

19 views   0 comments last modified about 3 days ago hdfs

This page shows how to import data from SQL Server into Hadoop via Apache Sqoop. Prerequisites Please follow the link below to install Sqoop in your machine if you don’t have one environment ready. ...

View detail

Install Hadoop 3.0.0 in Windows (Single Node)

489 views   8 comments last modified about 3 months ago hdfs

This page summarizes the steps to install Hadoop 3.0.0 in your Windows environment. Reference page: https://wiki.apache.org/hadoop/Hadoop2OnWindows ...

View detail

Write and Read Parquet Files in HDFS through Spark/Scala

59 views   0 comments last modified about 2 months ago hdfs

In my previous post, I demonstrated how to write and read parquet files in Spark/Scala. The parquet file destination is a local folder. Write and Read Parquet Files in Spark/Scala In this page...

View detail

Use Hadoop File System Task in SSIS to Write File into HDFS

62 views   0 comments last modified about 3 months ago hdfs

Context SQL Server Integration Service ( SSIS ) has tasks to perform operations against Hadoop, for example: Hadoop File System Task Hadoop Hive Task Hadoop Pig Task In Data Flow Task, you can also use: Hadoop HDFS Source ...

View detail

Invoke Hadoop WebHDFS APIs in .NET Core

40 views   0 comments last modified about 2 months ago hdfs

Background Apache doesn't provide native official .NET APIs for Hadoop HDFS. The HTTP REST API supports the complete FileSystem / ...

View detail

Hadoop datanode issue and resolution - ‘Incompatible clusterIDs’

14 views   0 comments last modified about 3 months ago hdfs

Issue After finishing installation Hadoop 3.0.0 in my Windows: Install Hadoop 3.0.0 in Windows (Single Node) , I got the following error after I formated the name node several tim...

View detail