Problem

When Spark job is configured with default hive metastore catalog like

        SparkSession.builder()
            .master("local[*]")
            .config("spark.sql.catalogImplementation", "hive")
            .config("spark.sql.warehouse.dir", "...")
            .config("hive.metastore.uris", "...")
            ...
            .enableHiveSupport().getOrCreate();

The CatalogDatasetFacet doesn't have the name field set, which is a problem because it's a required property in the facet spec.

Solution

As the name is not set in the case of this catalog, we can use just any default, I chose default.

One-line summary:

Add missing name property to CatalogDatasetFacet in case of default hive catalog to make it compatible with the spec.

Checklist

• You've signed-off your work
• Your pull request title follows our guidelines
• Your changes are accompanied by tests (if relevant)
• Your change contains a small diff and is self-contained
• You've updated any relevant documentation (if relevant)
• Your comment includes a one-liner for the changelog about the specific purpose of the change (not required for changes to tests, docs, or CI config)
• You've versioned the core OpenLineage model or facets according to SchemaVer (if relevant)
• You've added a header to source files (if relevant)

SPDX-License-Identifier: Apache-2.0
Copyright 2018-2025 contributors to the OpenLineage project