.NET for Apache Spark v1.0.0 Released

access_time 4 months ago visibility26 comment 0

.NET for Apache Spark v1.0.0 was released officially on 2020-10-14. This page summarizes some important resources for you to get started on .NET for Spark.


*Image credit: https://github.com/dotnet/spark/raw/master/docs/img/dotnetsparklogo-6.png

Features and release notes

Release Notes on GitHub

Source code 

https://github.com/dotnet/spark 

Learning resources


info Last modified by Administrator 28 days ago copyright This page is subject to Site terms.
Like this article?
Share on

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts

Follow Kontext

Get our latest updates on LinkedIn or Twitter.

Want to publish your article on Kontext?

Learn more

More from Kontext

visibility 31
thumb_up 0
access_time 2 months ago

About 12 months ago, I shared an article about reading and writing XML files in Spark using Python . For many companies, Scala is still preferred for better performance and also to utilize full features that Spark offers.  Thus, this article will provide examples about how to load XML file as ...

visibility 154
thumb_up 0
access_time 4 months ago

Recently, one of my colleague asked me one question about Spark: for the same SQL statement on finding max value of partition column, different values are returned in Spark SQL and Hive/Impala SQL. The SQL statement looks like the following: SELECT MAX(PART_COL) FROM HiveDb.TestSQL; ...

visibility 1143
thumb_up 0
access_time 6 months ago

Spark is a robust framework with logging implemented in all modules. Sometimes it might get too verbose to show all the INFO logs. This article shows you how to hide those INFO logs in the console output. Log level can be setup using function pyspark.SparkContext.setLogLevel . The ...