Kontext Newsletter #3 (2021-09-03)

visibility 51 access_time 9 months ago languageEnglish
Kontext Newsletter #3 (2021-09-03)

This week's newsletter will feature some basic Spark DataFrame transformation related articles. To view complete list of articles in this series, visit Spark DataFrame Transformation Tutorials.

If you have missed out our previous newsletters, you can find them here.

Convert Python Dictionary List to PySpark DataFrame

This article shows how to convert a Python dictionary list to a DataFrame in Spark using Python.

PySpark: Convert Python Array/List to Spark Data Frame

Sometimes it's useful to construct a Spark DataFrame from Python array or list objects.

PySpark: Convert JSON String Column to Array of Object (StructType) in Data Frame

How can we forget about JSON? This article shows you how to transform JSON column in Spark DataFrame.

Filter Spark DataFrame Columns with None or Null Values

This article shows you how to filter NULL/None values from a Spark data frame using Python. Function DataFrame.filter or DataFrame.where can be used to filter out null values. Function filter is alias name for where function.

Change DataFrame Column Names in PySpark

This article shows you how to rename columns.

Change Column Type in PySpark DataFrame

Do you want to change column types in Spark DataFrame? You can easily do that in Spark.

Kontext Column

Columns are like blogs which can be used to publish articles on Kontext. Follow three steps to create your columns.

Learn more

Kontext Forums

If you have a question, you can post it on our Forums.

Go to Forums
info Last modified by Administrator 9 months ago copyright This page is subject to Site terms.

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts

timeline Stats
Page index 0.20
More from Kontext
Kontext Newsletter #11 (2021-10-29)
visibility 24
thumb_up 0
access_time 7 months ago
Kontext Newsletter #11 (2021-10-29)
Kontext Newsletter #15 (2022-01-01)
visibility 55
thumb_up 0
access_time 5 months ago
Kontext Newsletter #15 (2022-01-01)
Kontext Diagrams is now live
visibility 85
thumb_up 0
access_time 6 months ago
Kontext Diagrams is now live