Skip to content

feat: Retrieve In-Commit Timestamp when performing protocol and metadata scan for snapshot #1001

Open
@OussamaSaoudi

Description

@OussamaSaoudi
Collaborator

Please describe why this is necessary.

The In-Commit timestamp is used to ensure that the data files at a given snapshot are still present. (see #1000 ).

Initially reported by @scovich

Describe the functionality you are proposing.

Make the Protocol and Metadata scan return the In-Commit Timestamp if it is present. See here for prior work in delta-spark.

Additional context

This should leverage the In-Commit Timestamp present in the CRC file if it is present. See here for more details.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

      Development

      No branches or pull requests

        Participants

        @OussamaSaoudi

        Issue actions

          feat: Retrieve In-Commit Timestamp when performing protocol and metadata scan for snapshot · Issue #1001 · delta-io/delta-kernel-rs