In this article, you will find information about the Spark Declarative Pipelines (SDP) feature in Spark v4.1.

You’ll find in this article, some informations about the Variant Data Type from Spark v4.x.

You’ll find in this article, some informations about the SQL features (Script, Session, Compliance) from Spark v4.x.

You’ll find in this article, some informations about the string SQL collation support feature from Spark v4.x.

You’ll find in this article, some information about the Spark Connect feature from Spark v4.x.

You’ll find in this article some information about Spark v4.x and how to create a local cluster with Docker.