Hadoop
Articles about Apache Hadoop installation, performance tuning and general tutorials.
*The yellow elephant logo is a registered trademark of Apache Hadoop.
Create Temporary Table - Hive SQL
local_offer hive local_offer SQL local_offer hive-sql-ddl
This page shows how to create a temporary Hive table via Hive SQL (HQL). Example: CREATE TEMPORARY TABLE temp_customer (`cust_id` int, `name` string,`created_date` date) STORED AS PARQUET; Temporary Hive tables are only visible to the creation session and will be deleted automatically when ...
Create Table as SELECT - Hive SQL
local_offer hive local_offer SQL local_offer hive-sql-ddl
This page shows how to create a managed(internal) Hive table from a SELECT statement via Hive SQL (HQL). Example: CREATE TABLE IF NOT EXISTS hql.transactions_copy STORED AS PARQUET AS SELECT * FROM hql.transactions; A MapReduce job will be submitted to create the table from SELECT statement.
Create Bucketed Sorted Table - Hive SQL
local_offer hive local_offer SQL local_offer hive-sql-ddl
This page shows how to create bucketed sorted Hive tables via Hive SQL (HQL). CLUSTERD BY is used to create bucketed table Example: CREATE TABLE IF NOT EXISTS hql.transactions_bucketed(txn_id BIGINT, cust_id INT, amount DECIMAL(20,2),txn_type STRING, created_date DATE) COMMENT 'A table to ...
Create Partitioned Table - Hive SQL
local_offer hive local_offer SQL local_offer hive-sql-ddl
This page shows how to create partitioned Hive tables via Hive SQL (HQL). Example: CREATE TABLE IF NOT EXISTS hql.transactions(txn_id BIGINT, cust_id INT, amount DECIMAL(20,2),txn_type STRING, created_date DATE) COMMENT 'A table to store transactions' PARTITIONED BY (txn_date DATE) STORED AS ...
local_offer hive local_offer SQL local_offer hive-sql-ddl
This page shows how to create Hive tables with storage file format as CSV or TSV via Hive SQL (HQL). Example: CREATE TABLE IF NOT EXISTS hql.customer_csv(cust_id INT, name STRING, created_date DATE) COMMENT 'A table to store customer records.' ROW FORMAT SERDE ...
local_offer hive local_offer SQL local_offer hive-sql-ddl
This page shows how to create Hive tables with storage file format as Parquet, Orc and Avro via Hive SQL (HQL). The following examples show you how to create managed tables and similar syntax can be applied to create external tables if Parquet, Orc or Avro format already exist in HDFS. Example ...
local_offer hive local_offer SQL local_offer hive-sql-ddl
This page shows how to create, drop, and truncate Hive tables via Hive SQL (HQL). Refer to Differences between Hive External and Internal (Managed) Tables to understand the differences between managed and unmanaged tables in Hive. Example: CREATE TABLE IF NOT EXISTS ...
local_offer hive local_offer SQL local_offer hive-sql-ddl
This page shows how to create, drop, alter and use Hive databases via Hive SQL (HQL). CREATE (DATABASE|SCHEMA) [IF NOT EXISTS] database_name [COMMENT database_comment] [LOCATION hdfs_path] [MANAGEDLOCATION hdfs_path] [WITH DBPROPERTIES (property_name=property_value, ...)]; LOCATION is ...
Load File into HDFS through WebHDFS APIs
local_offer hadoop local_offer hdfs
To ingest data into HDFS, one of the commonly used approach is to upload files into a temporary folder in one of the Edge server of Hadoop cluster, where HDFS CLIs are available to copy file from local to the distributed file system. In the past, I've published several related articles about ...
local_offer hive local_offer hadoop local_offer windows10 local_offer big-data-on-windows-10
Hive 3.1.2 was released on 26th Aug 2019. It is still the latest 3.x release and works with Hadoop 3.x.y releases. In this article, I’m going to provide step by step instructions about installing Hive 3.1.2 on Windows 10. * Logos are registered trademarks of Apache Hive and Microsoft Windows.
