Raymond Tang
Big Data Engineer, Full Stack .NET and Cross-Platform Software Engineer/Architect
I'm passionate about building data driven, scalable, cloud native applications and products.
Microsoft MVP C#/.NET (2010-2016)/Visual Studio | MCP | MCSE: Data Management and Analytics | Google Cloud Platform Certified Professional Data Engineer | AWS Certified Cloud Practitioner
Articles
The following code snippet shows an example of converting Pandas DataFrame to Spark DataFrame: import mysql.connector import pandas as pd from pyspark.sql import SparkSession appName = "PySpark MySQL Example - via mysql.connector" master = "local" spark = ...
Spark Scala: Load Data from MySQL
In article Connect to MySQL in Spark (PySpark) , I showed how to connect to MySQL in PySpark. In this article, I will directly use JDBC driver to load data from MySQL database with Scala. Download JDBC Driver for MySQL from the following website: MySQL :: Download Connector/J ...
Connect to MySQL in Spark (PySpark)
Spark is an analytics engine for big data processing. There are various ways to connect to a MySQL database in Spark. This page summarizes some of common approaches to connect to MySQL using Python as programming language. Similar as Connect to SQL Server in Spark (PySpark) , there ...
EntityFramework Core - Connect to MySQL
In article Connect to MySQL in .NET 5 , I showed how to use MySQL.Data ADO.NET approach to read data from MySQL database. This article shows a different approach which utilizes EntityFramework Core APIs. We will use code-first approach even there is already test table created. There ...
Connect to MySQL in .NET 5
To connect to MySQL databases in .NET 5, ASP.NET Core and .NET applications, we can utilize MySQL.Data library published by MySQL. This article provides step by step guide of connecting to MySQL using C# as programming language. .NET or .NET Core SDKs are required for the following ...
Create Pandas DataFrame from MySQL
MySQL connector is required which will be used to establish connection to MySQL database. Refer to the following page for more details about installation. Python: Load Data from MySQL The following code snippet connects to a database named test_db in server localhost (runs on port ...
Python: Load Data from MySQL
To connect to MySQL in Python, there are various approaches: JDBC driver - JayDeBeApi python wrapper package. Native python MySQL packages, for example, MySQL connector, etc. This article provides an example of using MySQL connector package to connect to MySQL. Python 3 MySQL server.
Hadoop Daemon Log Files Location
To start a Hadoop service, we use scripts under sbin folder of Hadoop home folder. For example, the following two commands start Hadoop HDFS services (namenode and datanode) on Windows and UNIX-alike systems respectively. %HADOOP_HOME%\sbin\start-dfs.cmd ...
The following code snippet grants SELECT access (code R) on column id only of table TestDb.test_table to a role named TestRole. grant select (id) on TestDb.test_table to TestRole; To grant SELECT access on multiple columns only, use similar SQL as the following code snippet: grant select ...
Teradata: Rights on a Database
Teradata Administrator tool used to have a function to show rights on a database. You can also directly use SQL to query that instead of relying on the GUI tool. select * from dbc.allrights where DatabaseName='TestDb2'; The above code snippet returns all the access rights on a database ...
Columns
SQL relational databases incl. SQLite, SQL Server, MySQL, PostgreSQL, Oracle, etc.
Code snippets and tips for various programming languages/frameworks. All code examples are under MIT or Apache 2.0 license unless specified.
AspNetCore.XmlRpc - a XML Remote Procedure Call library for ASP.NET Core.