Tag - python

python spark

PySpark: Convert JSON String Column to Array of Object (StructType) in Data Frame

8,819   0   about 10 months ago

This post shows how to derive new column in a Spark data frame from a JSON array string column. I am running the code in Spark 2.2.1 though it is compatible with Spark 1.6.0 (with less JSON SQL functions). Prerequisites Refer to the following post to install Spark in Windows. ...

View detail