Raymond Tang

Big Data Engineer, Full Stack .NET and Cross-Platform Software Engineer/Architect


I'm passionate about building data driven, scalable, cloud native applications and products.


Microsoft MVP C#/.NET (2010-2016)/Visual Studio | MCP | MCSE: Data Management and Analytics | Google Cloud Platform Certified Professional Data Engineer | AWS Certified Cloud Practitioner

Articles

visibility 2
thumb_up 0
access_time 1 day ago

The following code snippet shows an example of converting Pandas DataFrame to Spark DataFrame: import mysql.connector import pandas as pd from pyspark.sql import SparkSession appName = "PySpark MySQL Example - via mysql.connector" master = "local" spark = ...

Spark Scala: Load Data from MySQL
visibility 4
thumb_up 0
access_time 1 day ago

In article Connect to MySQL in Spark (PySpark) ,  I showed how to connect to MySQL in PySpark. In this article, I will directly use JDBC driver to load data from MySQL database with Scala. Download JDBC Driver for MySQL from the following website: MySQL :: Download Connector/J ...

Connect to MySQL in Spark (PySpark)
visibility 9
thumb_up 0
access_time 1 day ago

Spark is an analytics engine for big data processing. There are various ways to connect to a MySQL database in Spark.  This page summarizes some of common approaches to connect to MySQL using Python as programming language. Similar as  Connect to SQL Server in Spark (PySpark) , there ...

visibility 3
thumb_up 0
access_time 2 days ago

In article  Connect to MySQL in .NET 5 , I showed how to use MySQL.Data ADO.NET approach to read data from MySQL database. This article shows a different approach which utilizes EntityFramework Core APIs. We will use code-first approach even there is already test table created.  There ...

visibility 5
thumb_up 0
access_time 2 days ago

To connect to MySQL databases in .NET 5, ASP.NET Core and .NET applications, we can utilize MySQL.Data library published by MySQL. This article provides step by step guide of connecting to MySQL using C# as programming language.  .NET or .NET Core SDKs are required for the following ...

visibility 4
thumb_up 0
access_time 2 days ago

MySQL connector is required which will be used to establish connection to MySQL database. Refer to the following page for more details about installation.  Python: Load Data from MySQL The following code snippet connects to a database named test_db in server localhost (runs on port ...

visibility 7
thumb_up 0
access_time 2 days ago

To connect to MySQL in Python, there are various approaches: JDBC driver - JayDeBeApi python wrapper package. Native python MySQL packages, for example, MySQL connector, etc.  This article provides an example of using MySQL connector package to connect to MySQL. Python 3 MySQL server.

visibility 4
thumb_up 0
access_time 4 days ago

To start a Hadoop service, we use scripts under sbin folder of Hadoop home folder.  For example, the following two commands start Hadoop HDFS services (namenode and datanode) on Windows and UNIX-alike systems respectively.  %HADOOP_HOME%\sbin\start-dfs.cmd ...

visibility 2
thumb_up 0
access_time 6 days ago

The following code snippet grants SELECT access (code R) on column id only of table TestDb.test_table to a role named TestRole. grant select (id) on TestDb.test_table to TestRole; To grant SELECT access on multiple columns only, use similar SQL as the following code snippet: grant select ...

visibility 5
thumb_up 0
access_time 6 days ago

Teradata Administrator tool used to have a function to show rights on a database. You can also directly use SQL to query that instead of relying on the GUI tool. select * from dbc.allrights where DatabaseName='TestDb2'; The above code snippet returns all the access rights on a database ...

Columns

SQL relational databases incl. SQLite, SQL Server, MySQL, PostgreSQL, Oracle, etc. 

Programming with R language - tutorials about R. 

Streaming analytics related tutorials and ideas.

Code snippets and tips for various programming languages/frameworks. All code examples are under MIT or Apache 2.0 license unless specified. 

AspNetCore.XmlRpc - a XML Remote Procedure Call library for ASP.NET Core.

Data analytics with Google Cloud Platform.

Data analytics, application development with Microsoft Azure cloud platform.