[EXP] GH-44792: [C++] Require C++20

[pitrou]

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

[github-actions]

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

See also:

• Other pull requests
• Contribution Guidelines - Contributing Overview

[pitrou]

@github-actions crossbow submit -g cpp -g python

[pitrou]

@github-actions crossbow submit -g cpp -g python -g wheel

[pitrou]

@github-actions crossbow submit -g linux -g r

[pitrou]

So, it seems two main issues may be blocking this:

1. The AWS SDK fails to build ("Could not determine support for atomic operations")
2. CentOS 8 and Almalinux 8 do not have a C++20 compliant C++ stdlib (by default)

Edit: a couple R builds also seem to have a non-C++20 compliant stdlib.

@kou What is our policy for Almalinux and CentOS support?

[kou]

We can use gcc-toolset-{9,10,11,12,13,14} on AlmaLinux 8 and CentOS Stream 8 if we needed. For example, AlmaLinux 9 uses gcc-toolset-12:

arrow/dev/tasks/linux-packages/apache-arrow/yum/almalinux-9/Dockerfile

Line 21 in 16c7f1a

ENV SCL=gcc-toolset-12

arrow/dev/tasks/linux-packages/apache-arrow/yum/almalinux-9/Dockerfile

Line 29 in 16c7f1a

${SCL} \

[pitrou]

I see, thanks. So there are probably no insurmountable issues against switching to C++20. Of course, this will have to be discussed on the ML at some point (and there's no urgency).

[kou]

this will have to be discussed on the ML at some point

Right.

FYI: There is a related issue: #44792

[pitrou]

@github-actions crossbow submit centos*

[pitrou]

@github-actions crossbow submit -g cpp

[pitrou]

@github-actions crossbow submit wheelcp313*

[pitrou]

@github-actions crossbow submit -g r

[pitrou]

@assignUser See R Crossbow build results just above. Can you check whether the failures are actually related?

[assignUser]

@pitrou They are not related, they all show the same error that also shows up in the nightly builds:

── Error ('test-s3-minio.R:64:1'): copy files with s3 ──────────────────────────
Error: Key error: Attempted to register factory for scheme 's3' but that scheme is already registered.
Backtrace:
    ▆
 1. └─arrow::copy_files(uri_formatter("hive_dir"), td) at tests/testthat/helper-filesystems.R:173:7
 2.   └─arrow:::get_path_and_filesystem(from)
 3.     └─arrow:::get_paths_and_filesystem(x, filesystem)
 4.       └─base::lapply(x, FileSystem$from_uri)
 5.         └─arrow (local) FUN(X[[i]], ...)
 6.           └─arrow:::fs___FileSystemFromUri(uri)

[pitrou]

@pitrou They are not related, they all show the same error that also shows up in the nightly builds:

Relatedly, is someone trying to fix them? Is there an issue open?

[pitrou]

@github-actions crossbow submit -g cpp -g python

[pitrou]

@github-actions crossbow submit wheelcp313*

[github-actions]

Revision: a711a38

Submitted crossbow builds: ursacomputing/crossbow @ actions-8c72ad3e54

Task	Status
wheel-macos-monterey-cp313-cp313-amd64
wheel-macos-monterey-cp313-cp313-arm64
wheel-macos-monterey-cp313-cp313t-amd64
wheel-macos-monterey-cp313-cp313t-arm64
wheel-manylinux-2-28-cp313-cp313-amd64
wheel-manylinux-2-28-cp313-cp313-arm64
wheel-manylinux-2-28-cp313-cp313t-amd64
wheel-manylinux-2-28-cp313-cp313t-arm64
wheel-manylinux-2014-cp313-cp313-amd64
wheel-manylinux-2014-cp313-cp313-arm64
wheel-manylinux-2014-cp313-cp313t-amd64
wheel-manylinux-2014-cp313-cp313t-arm64
wheel-musllinux-1-2-cp313-cp313-amd64
wheel-musllinux-1-2-cp313-cp313-arm64
wheel-musllinux-1-2-cp313-cp313t-amd64
wheel-musllinux-1-2-cp313-cp313t-arm64
wheel-windows-cp313-cp313-amd64
wheel-windows-cp313-cp313t-amd64

[github-actions]

Revision: a711a38

Submitted crossbow builds: ursacomputing/crossbow @ actions-884015d237

Task	Status
example-cpp-minimal-build-static
example-cpp-minimal-build-static-system-dependency
example-cpp-tutorial
example-python-minimal-build-fedora-conda
example-python-minimal-build-ubuntu-venv
test-alpine-linux-cpp
test-build-cpp-fuzz
test-conda-cpp
test-conda-cpp-meson
test-conda-cpp-valgrind
test-conda-python-3.10
test-conda-python-3.10-hdfs-2.9.2
test-conda-python-3.10-hdfs-3.2.1
test-conda-python-3.10-pandas-latest-numpy-latest
test-conda-python-3.11
test-conda-python-3.11-dask-latest
test-conda-python-3.11-dask-upstream_devel
test-conda-python-3.11-hypothesis
test-conda-python-3.11-pandas-latest-numpy-1.26
test-conda-python-3.11-pandas-latest-numpy-latest
test-conda-python-3.11-pandas-nightly-numpy-nightly
test-conda-python-3.11-pandas-upstream_devel-numpy-nightly
test-conda-python-3.11-spark-master
test-conda-python-3.12
test-conda-python-3.12-cpython-debug
test-conda-python-3.13
test-conda-python-3.9
test-conda-python-3.9-pandas-1.1.3-numpy-1.19.5
test-conda-python-emscripten
test-cuda-cpp-ubuntu-22.04-cuda-11.7.1
test-cuda-python-ubuntu-22.04-cuda-11.7.1
test-debian-12-cpp-amd64
test-debian-12-cpp-i386
test-debian-12-python-3-amd64
test-debian-12-python-3-i386
test-fedora-39-cpp
test-fedora-39-python-3
test-ubuntu-22.04-cpp
test-ubuntu-22.04-cpp-20
test-ubuntu-22.04-cpp-bundled
test-ubuntu-22.04-cpp-emscripten
test-ubuntu-22.04-cpp-no-threading
test-ubuntu-22.04-python-3
test-ubuntu-22.04-python-313-freethreading
test-ubuntu-24.04-cpp
test-ubuntu-24.04-cpp-bundled-offline
test-ubuntu-24.04-cpp-gcc-13-bundled
test-ubuntu-24.04-cpp-gcc-14
test-ubuntu-24.04-cpp-minimal-with-formats
test-ubuntu-24.04-cpp-thread-sanitizer
test-ubuntu-24.04-python-3

[pitrou]

@github-actions crossbow submit -g linux

[github-actions]

Revision: a711a38

Submitted crossbow builds: ursacomputing/crossbow @ actions-43a66e208a

Task	Status
almalinux-8-amd64
almalinux-8-arm64
almalinux-9-amd64
almalinux-9-arm64
amazon-linux-2023-amd64
amazon-linux-2023-arm64
centos-7-amd64
centos-8-stream-amd64
centos-8-stream-arm64
centos-9-stream-amd64
centos-9-stream-arm64
debian-bookworm-amd64
debian-bookworm-arm64
debian-trixie-amd64
debian-trixie-arm64
ubuntu-jammy-amd64
ubuntu-jammy-arm64
ubuntu-noble-amd64
ubuntu-noble-arm64

[pitrou]

@github-actions crossbow submit -g r

[github-actions]

Revision: a711a38

Submitted crossbow builds: ursacomputing/crossbow @ actions-3da723357b

Task	Status
r-binary-packages
r-recheck-most
test-r-arrow-backwards-compatibility
test-r-depsource-bundled
test-r-depsource-system
test-r-dev-duckdb
test-r-devdocs
test-r-extra-packages
test-r-gcc-11
test-r-gcc-12
test-r-install-local
test-r-install-local-minsizerel
test-r-linux-as-cran
test-r-linux-rchk
test-r-linux-sanitizers
test-r-linux-valgrind
test-r-m1-san
test-r-macos-as-cran
test-r-minimal-build
test-r-offline-maximal
test-r-offline-minimal
test-r-rhub-debian-gcc-devel-lto-latest
test-r-rhub-debian-gcc-release-custom-ccache
test-r-rhub-ubuntu-release-latest
test-r-rocker-r-ver-latest
test-r-rstudio-r-base-4.2-jammy
test-r-ubuntu-22.04
test-r-versions

[pitrou]

This PR was getting unwieldy, I opened a new fresh one at #48414