Kontext Newsletter #14 (2021-12-23)

visibility 40 access_time 8 months ago languageEnglish
more_vert
Kontext Newsletter #14 (2021-12-23)

Dear Kontext users,
I hope you and your family are well and ready for the festive season celebrations. Thank you very much for using Kontext in 2021. I wish you a happy and safe holiday! Sharing knowledge is Kontext's passion and we sincerely welcome you to create columns on Kontext and become one of our writers in 2022! This week's newsletter will feature some articles about Spark, Hyperspace, JMESPath, .NET, Data Masking, JSON Lines, Hadoop, etc.

If you have missed out our previous newsletters, you can find them here. You can now also subscribe to individual columns to get notified when your favourite columns have articles published.

Create Spark Indexes via Hyperspace

What?! yes, you heard it right. You can use Hyperspace to create indexes for your Spark DataFrame. This can potentially accelerate your query and reduce cost in your data lake solution. Find out more details and sample code in this article.

Query JSON via JMESPath in .NET

For XML document, XPath can be used to query the data including nodes (elements) and attributes. Similarly, for JSON document, we can use JMESPath to query it. Azure CLI supports using JMESPath to query resource information. This article shows you some examples of querying JSON using JMESPath .NET library. 

Static and Dynamic Data Masking

Check out this diagram to understand the differences between static and dynamic data masking that are commonly used in data projects.  

Spark Read JSON Lines (.jsonl) File

JSON Lines text file is a newline-delimited JSON object document. It is commonly used in many data related products. For example, Spark by default reads JSON line document, BigQuery provides APIs to load JSON Lines file. 

Install Hadoop 3.2.1 on Windows 10 Step by Step Guide

This Hadoop installation guide on Windows is still very relevant as many Kontext users use it to configure a Hadoop system on Windows machine recently. Follow it if you also want to configure one to practice. 

info Last modified by Administrator 8 months ago copyright This page is subject to Site terms.
Like this article?
Share on

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts