Skip to content

Bump Apache Arrow to 10.0.0 #1764

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
Yicong-Huang merged 4 commits into from
Dec 13, 2022
Merged

Bump Apache Arrow to 10.0.0 #1764

Yicong-Huang merged 4 commits into from
Dec 13, 2022

Conversation

@Yicong-Huang
Copy link
Contributor

@Yicong-Huang Yicong-Huang commented Dec 8, 2022 •
edited
Loading

This PR bumps Apache Arrow version from 9.0.0 to 10.0.0.

Main changes related to PyAmber:

Java/Scala side:

  • JDBC Driver for Arrow Flight SQL (13800)
  • Initial implementation of immutable Table API (14316)
  • Substrait, transaction, cancellation for Flight SQL (13492)
  • Read Arrow IPC, CSV, and ORC files by NativeDatasetFactory (13811, 13973, 14182)
  • Add utility to bind Arrow data to JDBC parameters (13589)

Python side:

  • The batch_readahead and fragment_readahead arguments for scanning Datasets are exposed in Python (ARROW-17299).
  • ExtensionArrays can now be created from a storage array through the pa.array(..) constructor (ARROW-17834).
  • Converting ListArrays containing ExtensionArray values to numpy or pandas works by falling back to the storage array (ARROW-17813).
  • Casting Tables to a new schema now honors the nullability flag in the target schema (ARROW-16651).

@Yicong-Huang Yicong-Huang requested a review from zuozhiw December 8, 2022 08:49
@Yicong-Huang Yicong-Huang self-assigned this Dec 8, 2022
@Yicong-Huang Yicong-Huang added the dependencies Pull requests that update a dependency file label Dec 8, 2022
@Yicong-Huang Yicong-Huang merged commit 2ff37bd into master Dec 13, 2022
@Yicong-Huang Yicong-Huang deleted the yicong-update-arrow-10 branch December 13, 2022 04:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@zuozhiw zuozhiw zuozhiw approved these changes

Assignees

@Yicong-Huang Yicong-Huang

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Yicong-Huang @zuozhiw