Skip to content

[Data] dataset.write_iceberg to support upserts #53438

@gero90

Description

@gero90

Description

As pyiceberg now supports upserts (example), it would ideal to support the 3 modes in Ray Data (append, overwrite, upsert).

Related: This one is adding overwrite mode #51951

Use case

With upserts, the ray data capabilities would be greatly extended, reducing the need of post-processing of append-only tables

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Important issue, but not time-criticaldataRay Data-related issuesenhancementRequest for new feature and/or capabilitygood-first-issueGreat starter issue for someone just starting to contribute to Rayusability

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions