1. Home
  2. Columns
  3. Spark
  4. .NET for Apache Spark v1.0.0 Released
R
Raymond
account_circle Profile
share
Twitter Facebook LinkedIn
more_vert

.NET for Apache Spark v1.0.0 Released

access_time 4 months ago visibility26 comment 0

.NET for Apache Spark v1.0.0 was released officially on 2020-10-14. This page summarizes some important resources for you to get started on .NET for Spark.


*Image credit: https://github.com/dotnet/spark/raw/master/docs/img/dotnetsparklogo-6.png

Features and release notes

Release Notes on GitHub

Source code 

https://github.com/dotnet/spark 

Learning resources


local_offer .NET local_offer spark local_offer dotnet-spark
info Last modified by Administrator 28 days ago copyright This page is subject to Site terms.
Like this article?
Share on

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts

open_in_new 0 comments

Follow Kontext

Get our latest updates on LinkedIn or Twitter.

Want to publish your article on Kontext?

Learn more

More from Kontext

Spark Scala: Read XML File as DataFrame

more_vert
local_offer scala local_offer spark local_offer how-to
visibility 31
thumb_up 0
access_time 2 months ago

About 12 months ago, I shared an article about reading and writing XML files in Spark using Python . For many companies, Scala is still preferred for better performance and also to utilize full features that Spark offers.  Thus, this article will provide examples about how to load XML file as ...

open_in_new Spark arrow_forward

About Configuration spark.sql.optimizer.metadataOnly

more_vert
local_offer spark
visibility 154
thumb_up 0
access_time 4 months ago

Recently, one of my colleague asked me one question about Spark: for the same SQL statement on finding max value of partition column, different values are returned in Spark SQL and Hive/Impala SQL. The SQL statement looks like the following: SELECT MAX(PART_COL) FROM HiveDb.TestSQL; ...

open_in_new Spark arrow_forward

Turn off INFO logs in Spark

more_vert
local_offer tutorial local_offer spark local_offer how-to
visibility 1143
thumb_up 0
access_time 6 months ago

Spark is a robust framework with logging implemented in all modules. Sometimes it might get too verbose to show all the INFO logs. This article shows you how to hide those INFO logs in the console output. Log level can be setup using function pyspark.SparkContext.setLogLevel . The ...

open_in_new Spark arrow_forward