This site uses cookies to deliver our services. By using this site, you acknowledge that you have read and understand our Cookie and Privacy policy. Your use of Kontext website is subject to this policy. Allow Cookies and Dismiss

Analytics & BI

Data Analytics,Big Data,Data Storage and Business Intelligence.

Subscribe

lite-log spark hdfs scala parquet

Write and Read Parquet Files in HDFS through Spark/Scala

1401 views   0 comments last modified about 7 months ago

In my previous post, I demonstrated how to write and read parquet files in Spark/Scala. The parquet file destination is a local folder. Write and Read Parquet Files in Spark/Scala In this page...

View detail
lite-log scala

Convert String to Date in Spark (Scala)

1367 views   0 comments last modified about 7 months ago

Context This pages demonstrates how to convert string to java.util.Date in Spark via Scala. Prerequisites If you have not installed Spark, follow the page below to install it: ...

View detail
zeppelin spark hadoop rdd

Read Text File from Hadoop in Zeppelin through Spark Context

1071 views   0 comments last modified about 7 months ago

Background This page provides an example to load text file from HDFS through SparkContext in Zeppelin (sc). Reference The details about this method can be found at: SparkContext.textFile ...

View detail
ssis hadoop hdfs

Use Hadoop File System Task in SSIS to Write File into HDFS

571 views   0 comments last modified about 7 months ago

Context SQL Server Integration Service ( SSIS ) has tasks to perform operations against Hadoop, for example: Hadoop File System Task Hadoop Hive Task Hadoop Pig Task In Data Flow Task, you can also use: Hadoop HDFS Source ...

View detail
lite-log spark

Install Spark 2.2.1 in Windows

234 views   0 comments last modified about 8 months ago

This page summarizes the steps to install Spark 2.2.1 in your Windows environment. Tools and Environment GIT Bash Command Prompt Windows 10 Download Binary Package Download the latest binary from the following site: ...

View detail
lite-log hadoop hdfs

Hadoop datanode issue and resolution - ‘Incompatible clusterIDs’

75 views   0 comments last modified about 8 months ago

Issue After finishing installation Hadoop 3.0.0 in my Windows: Install Hadoop 3.0.0 in Windows (Single Node) , I got the following error after I formated the name node several tim...

View detail
teradata python

Connect to Teradata database through Python

2034 views   0 comments last modified about 9 months ago

Teradata published an official Python module which can be used in DevOps projects. More details can be found at the following GitHub site: https://github.com/Teradata/PyTd Install Teradata module ...

View detail
teradata

Teradata Tutorials Summary - October 2017

260 views   0 comments last modified about 12 months ago

This post summarizes the tutorials I created in the past about Teradata. It is trying to help you gain the basic SQL skills with Teradata especially if you are a new beginner or you just move from SQL Server or Oracle. It also includes some guides about setting up your own Teradata server (latest Teradata Express version TDExpress16.10.00.03_Sles11_40GB.7z).

View detail
windows azure teradata

Setup Teradata in Microsoft Azure

250 views   0 comments last modified about 12 months ago

This page provides the steps to create a Teradata database in Microsoft cloud computing platform Azure.

View detail
teradata sql

Teradata SQL Tricks for SQL Server/Oracle Developers

729 views   0 comments last modified about 12 months ago

For many SQL Server or Oracle developers, you may encounter some inconveniences when writing SQL queries. For example, how to select from dummy table or local defined variables. This page summarize the equivalents in Teradata SQL.

View detail