ARROW-14892: [Python][C++] GCS Bindings#12763

Merged

pitrou merged 85 commits intoapache:masterfrom

emkornfield:gcsp

Jun 12, 2022

Commits on Jun 11, 2022

parent a23c6dd5b404cfcabf70762d693720b849d9501b

Micah Kornfield
authored and
pitrou
committed
address PR comment pt 1

Micah Kornfield
authored and
pitrou
committed
Update cpp/src/arrow/filesystem/gcsfs.cc

emkornfield
and
pitrou
committed
Update cpp/src/arrow/filesystem/gcsfs.cc

emkornfield
and
pitrou
committed
Update cpp/src/arrow/filesystem/gcsfs.cc

emkornfield
and
pitrou
committed
pr comments pt2.

Micah Kornfield
authored and
pitrou
committed
pr comments pt3.

Micah Kornfield
authored and
pitrou
committed
Update cpp/src/arrow/filesystem/gcsfs.cc

emkornfield
and
pitrou
committed
Update dev/archery/archery/cli.py

emkornfield
and
pitrou
committed
Update cpp/src/arrow/filesystem/gcsfs.cc

emkornfield
and
pitrou
committed
Update python/pyarrow/_gcsfs.pyx

emkornfield
and
pitrou
committed
Apply suggestions from code review

emkornfield
and
pitrou
committed
Update cpp/src/arrow/filesystem/gcsfs.cc

emkornfield
and
pitrou
committed
pr review comments #4

Micah Kornfield
authored and
pitrou
committed
Update python/pyarrow/_gcsfs.pyx

emkornfield
and
pitrou
committed
Update python/pyarrow/_gcsfs.pyx

emkornfield
and
pitrou
committed
ninja format

emkornfield
authored and
pitrou
committed
more pr fixes

Micah Kornfield
authored and
pitrou
committed
make ensure_metadata cpdef

Micah Kornfield
authored and
pitrou
committed
remove build_absl_once

Micah Kornfield
authored and
pitrou
committed
fix lint

Micah Kornfield
authored and
pitrou
committed
cast expiration to system clock (mac)

Micah Kornfield
authored and
pitrou
committed
try to remove separate testbench install

Micah Kornfield
authored and
pitrou
committed
some simplication

Micah Kornfield
authored and
pitrou
committed
simplify further

Micah Kornfield
authored and
pitrou
committed
Avoid counting trailing slash in Depth

Micah Kornfield
authored and
pitrou
committed
Revert "try to remove separate testbench install"

Micah Kornfield
authored and
pitrou
committed
use latest version and remove DO NOT SUBMIT

Micah Kornfield
authored and
pitrou
committed
Update python/pyarrow/tests/conftest.py

emkornfield
and
pitrou
committed
comment out GCS ON instead of set it to off

Micah Kornfield
authored and
pitrou
committed
add gs/gcs to filesystemfromuri docs

Micah Kornfield
authored and
pitrou
committed
remove duplicate code

Micah Kornfield
authored and
pitrou
committed
remove duplicate PYARROW_WITH_GCS

Micah Kornfield
authored and
pitrou
committed
remove duplicate cli.py

Micah Kornfield
authored and
pitrou
committed
add smoke test for FileSystemFromUri

Micah Kornfield
authored and
pitrou
committed
separate gcs and s3 variables in tasks.yml

Micah Kornfield
authored and
pitrou
committed
make GcsOptions default constructible

Micah Kornfield
authored and
pitrou
committed
run install_gcs_test_bench if it exists

Micah Kornfield
authored and
pitrou
committed
turn of gcs on macos github workflow

Micah Kornfield
authored and
pitrou
committed
install testbench on wheel test

Micah Kornfield
authored and
pitrou
committed
fix error for calculating directory presence

Micah Kornfield
authored and
pitrou
committed
Install the testbench using the right Python
pitrou
committed
add ARROW_EXPORT

Micah Kornfield
authored and
pitrou
committed
fix alphabeetic order in build-pyarrow.sh

Micah Kornfield
authored and
pitrou
committed
enable macOS 10.13 gcs build

Micah Kornfield
authored and
pitrou
committed
use install_gcs_bench.sh in unix wheel test script

Micah Kornfield
authored and
pitrou
committed
Update python/pyarrow/_gcsfs.pyx

authored and
pitrou
committed
Update python/pyarrow/_gcsfs.pyx

authored and
pitrou
committed
fixup tests per feedback

Micah Kornfield
authored and
pitrou
committed
make close idempotent

Micah Kornfield
authored and
pitrou
committed
Use bundled google-cloud-cpp-storage

kou
authored and
pitrou
committed
Install test dependencies in Dockerfile

kou
authored and
pitrou
committed
Enable GCS on Debian and Fedora

kou
authored and
pitrou
committed
Don't enable GCS on Debian 10

kou
authored and
pitrou
committed
Update installing testing dependency in dev/tasks/python-wheels/

kou
authored and
pitrou
committed
Fix wrong Python use

kou
authored and
pitrou
committed
Make failures of testbench short lived

Micah Kornfield
authored and
pitrou
committed
Add missing arch

kou
authored and
pitrou
committed
use 5 second timeout for tests

Micah Kornfield
authored and
pitrou
committed
Try installing testbench on arm64 macOS

kou
authored and
pitrou
committed
Install python3-dev to build crc32c locally

kou
authored and
pitrou
committed
x86 and arm are only enabled

kou
authored and
pitrou
committed
Don't use wheel for grpcio on arm64 macOS

kou
authored and
pitrou
committed
Use grpcio 1.44.0

kou
authored and
pitrou
committed
Disable GCS on s390x

kou
authored and
pitrou
committed
up timeout to 20 seconds

Micah Kornfield
authored and
pitrou
committed
add back conftest

Micah Kornfield
authored and
pitrou
committed
add logging to equality for debugging

Micah Kornfield
authored and
pitrou
committed
add logging for timepoint

Micah Kornfield
authored and
pitrou
committed
accept nanos and use it for expiration

Micah Kornfield
authored and
pitrou
committed
Revert "add logging for timepoint"

Micah Kornfield
authored and
pitrou
committed
Revert "add logging to equality for debugging"

Micah Kornfield
authored and
pitrou
committed
fix lint

Micah Kornfield
authored and
pitrou
committed
Revert "fix lint"

Micah Kornfield
authored and
pitrou
committed
Revert "accept nanos and use it for expiration"

Micah Kornfield
authored and
pitrou
committed
pass timezone to datetime

Micah Kornfield
authored and
pitrou
committed
increase timeout

emkornfield
authored and
pitrou
committed
Apply suggestions from code review

emkornfield
and
pitrou
committed
address code review feedback

Micah Kornfield
authored and
pitrou
committed
bump client policy

Micah Kornfield
authored and
pitrou
committed
Try to understand arch issues
pitrou
committed
Try to rationalize uses of arch
pitrou
committed
Revert "Try to rationalize uses of arch"
pitrou
committed
Revert "Try to understand arch issues"
pitrou
committed

Commits on Jun 12, 2022

Make error more informative in warnings check
pitrou
committed