[auto-merge] release/26.02 to main [skip ci] [bot]

[nvauto]

auto-merge triggered by github actions on release/26.02 to create a PR keeping main up-to-date. If this PR is unable to be merged due to conflicts, it will remain open until manually fix.

[nvauto]

SUCCESS - auto-merge

[greptile-apps]

Greptile Overview

Greptile Summary

This PR merges changes from the release/26.02 branch to main, including a fix for Spark 4.1.1+ compatibility with null_list.parquet testing.

• Updated copyright year from 2025 to 2026
• Added import for is_spark_411_or_later function from spark_session module
• Added conditional xfail for null_list.parquet when running on Spark 4.1.1+ due to schema inference differences (array vs array)
• The xfail is properly documented with a reference to issue [AUDIT][SPARK-54220] NullType/VOID/UNKNOWN Type Support in Parquet causes test failures in Spark 4.1.0+ #14242

The changes follow existing patterns in the codebase for version-specific test handling and are consistent with similar conditional logic for Spark 3.5.0+ compatibility.

Confidence Score: 5/5

• This PR is safe to merge with minimal risk
• The changes are straightforward and low-risk: a copyright year update, an import addition, and a version-specific xfail for a known incompatibility. The implementation follows established patterns in the codebase and is well-documented with issue references.
• No files require special attention

Important Files Changed

Filename	Overview
integration_tests/src/main/python/parquet_testing_test.py	Added xfail for null_list.parquet on Spark 4.1.1+ due to array inference change, updated copyright year to 2026

Sequence Diagram

sequenceDiagram
    participant Test as Parquet Testing Test
    participant SparkSession as spark_session.py
    participant TestFramework as PyTest Framework
    
    Note over Test: Module initialization
    Test->>SparkSession: is_spark_411_or_later()
    SparkSession-->>Test: Returns boolean (True/False)
    
    alt Spark >= 4.1.1
        Test->>Test: Add null_list.parquet to _xfail_files
        Note over Test: Mark as expected failure<br/>due to array<void> inference
    end
    
    Test->>Test: gen_testing_params_for_valid_files()
    Test->>Test: Check if null_list.parquet in _xfail_files
    
    alt File is in _xfail_files
        Test->>TestFramework: Create test with xfail marker
        Note over TestFramework: Test will be marked as<br/>expected failure
    else File is valid
        Test->>TestFramework: Create regular test parameter
    end
    
    TestFramework->>Test: Execute test_parquet_testing_valid_files()
    Test->>Test: assert_gpu_and_cpu_are_equal_collect()
    
    alt Test marked as xfail and fails
        Test-->>TestFramework: Expected failure (xfail)
        Note over TestFramework: Test passes as expected
    else Test succeeds
        Test-->>TestFramework: Success
    end

Loading

[greptile-apps]

_{1 file reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile}