Dataproc
20 updates from Google Cloud.
New Dataproc on Compute Engine subminor image versions:
New <a href="https://docs.cloud.google.com/dataproc/docs/concepts/versioning/dataproc-version-clusters#supported-dataproc-image-versions">Dataproc on Compute Engine subminor image versions</a>: •…
New Dataproc on Compute Engine subminor image versions:
New <a href="https://docs.cloud.google.com/dataproc/docs/concepts/versioning/dataproc-version-clusters#supported-dataproc-image-versions">Dataproc on Compute Engine subminor image versions</a>: •…
New Serverless for Apache Spark runtime versions:
New <a href="https://cloud.google.com/dataproc-serverless/docs/concepts/versions/dataproc-serverless-versions">Serverless for Apache Spark runtime versions</a>: • 1.2.76 • 2.2.76 • 2.3.29 • 3.0.12
New Dataproc on Compute Engine subminor image versions:
New <a href="https://docs.cloud.google.com/dataproc/docs/concepts/versioning/dataproc-version-clusters#supported-dataproc-image-versions">Dataproc on Compute Engine subminor image versions</a>: •…
New Dataproc on Compute Engine subminor image versions:
New <a href="https://docs.cloud.google.com/dataproc/docs/concepts/versioning/dataproc-version-clusters#supported-dataproc-image-versions">Dataproc on Compute Engine subminor image versions</a>: •…
New Serverless for Apache Spark runtime versions:
New <a href="https://cloud.google.com/dataproc-serverless/docs/concepts/versions/dataproc-serverless-versions">Serverless for Apache Spark runtime versions</a>: • 1.2.75 • 2.2.75 • 2.3.28 • 3.0.11
Dataproc on Compute Engine: The following subminor image versions announced on March 08, 2026 have been rolled back:
Dataproc on Compute Engine: The following subminor image versions announced on <a href="https://docs.cloud.google.com/dataproc/docs/release-notes#March_08_2026">March 08, 2026</a> have been rolled…
New Dataproc on Compute Engine subminor image versions:
New <a href="https://docs.cloud.google.com/dataproc/docs/concepts/versioning/dataproc-version-clusters#supported-dataproc-image-versions">Dataproc on Compute Engine subminor image versions</a>: •…
Enabled Optimized Iceberg Vacuum by default in Spark for premium tier clusters.
Enabled Optimized Iceberg Vacuum by default in Spark for premium tier clusters. When enabled, Dataproc will use a shuffle-based approach to rewrite data files, which can improve performance for MERGE…
Serverless for Apache Spark 1.2, 2.2 and 2.3 runtime versions:
Serverless for Apache Spark <a href="https://cloud.google.com/dataproc-serverless/docs/concepts/versions/spark-runtime-1.2">1.2</a>, <a…
New Serverless for Apache Spark runtime versions:
New <a href="https://cloud.google.com/dataproc-serverless/docs/concepts/versions/dataproc-serverless-versions">Serverless for Apache Spark runtime versions</a>: • 1.2.74 • 2.2.74 • 2.3.27 • 3.0.10
New Serverless for Apache Spark runtime versions:
New <a href="https://cloud.google.com/dataproc-serverless/docs/concepts/versions/dataproc-serverless-versions">Serverless for Apache Spark runtime versions</a>: • 1.2.73 • 2.2.73 • 2.3.26
New Serverless for Apache Spark runtime versions:
New <a href="https://cloud.google.com/dataproc-serverless/docs/concepts/versions/dataproc-serverless-versions">Serverless for Apache Spark runtime versions</a>: • 1.2.72 • 2.2.72 • 2.3.25 • 3.0.9
New Dataproc on Compute Engine subminor image versions:
New <a href="https://docs.cloud.google.com/dataproc/docs/concepts/versioning/dataproc-version-clusters#supported-dataproc-image-versions">Dataproc on Compute Engine subminor image versions</a>: •…
Fixed: Fixed an issue that could cause gsutil failures on clusters using custom images built from new base images.
Fixed an issue that could cause gsutil failures on clusters using custom images built from new base images. This problem occurred when the gcloud core/universe_domain property was not set in the…
New Dataproc on Compute Engine subminor image versions:
New <a href="https://docs.cloud.google.com/dataproc/docs/concepts/versioning/dataproc-version-clusters#supported-dataproc-image-versions">Dataproc on Compute Engine subminor image versions</a>: •…
New Serverless for Apache Spark runtime versions:
New <a href="https://cloud.google.com/dataproc-serverless/docs/concepts/versions/dataproc-serverless-versions">Serverless for Apache Spark runtime versions</a>: • 1.2.70 • 2.2.70 • 2.3.23 • 3.0.7
Dataproc on Compute Engine: Sharing snapshot diagnostic data: Setting the...
Dataproc on Compute Engine: Sharing snapshot diagnostic data: Setting the --tarball-access=GOOGLE_DATAPROC_DIAGNOSE flag with the gcloud dataproc clusters diagnose command shares all of the output…