no kernel image available for execution on the GPU device

[mmcilrath]

Centos 8, gcc 12.2.0, openmpi 5.0.6, cuda 12.4.0
Tried with L40S, A100, H100, H200 GPUs.
Built a few days ago with PALACE_WITH_CUDA=ON, all else defaults.

Palace version: v0.13.0-567-gfe3b414b

git describe --tags
v0.13.0-567-gfe3b414b

[mbm@node2417 palace]$ git show
commit fe3b414 (HEAD -> main, origin/main, origin/HEAD)
Merge: 2bcd715 098146c
Author: Gabriele Bozzola 9167485+Sbozzolo@users.noreply.github.com
Date: Tue Jul 29 08:49:14 2025 -0700

Merge pull request #413 from awslabs/gbozzola/typos

Fix typos

[mmcilrath]

Sorry! Here's the part that got lost.

With solve device set to GPU, example computations apparently proceed through assembling multigrid hierarchy, then
the error occurs.

CUDA ERROR (code = 209, no kernel image is available for execution on the device) at ./csr_spgemm_device_numer.h:865
[bunch of these]
terminate called after throwing an instance of 'thrust::THRUST_200301_520_NS::system::system_error'
what(): after reduction step 2: cudaErrorNoKernelImageForDevice: no kernel image is available for execution on the device

LIBXSMM_VERSION: main-1.17-3910 (25694022)
LIBXSMM_TARGET: spr [INTEL(R) XEON(R) PLATINUM 8562Y+]

With solve device CPU, examples appear to complete successfully.

Just changed solve device to GPU in example configs and run palace script, no other arguments.
Above is from examples/coaxial/coaxial_open.

[simlapointe]

Hi @mmcilrath, you probably need to add the CMAKE_CUDA_ARCHITECTURES flag when building Palace, with the appropriate number for the GPU(s) you plan to use. For example to build for an A100 gpu, use:

cmake .. -DPALACE_WITH_CUDA=ON -DCMAKE_CUDA_ARCHITECTURES="80"

Give this a try and let us know if it resolves your issue.

[mmcilrath]

On 8/4/25 6:41 PM, Simon Lapointe wrote: *simlapointe* left a comment (awslabs/palace#426) <#426 (comment)> Hi @mmcilrath <https://github.com/mmcilrath>, you probably need to add the CMAKE_CUDA_ARCHITECTURES flag when building Palace, with the appropriate number for the GPU(s) you plan to use. For example to build for an A100 gpu, use: |cmake .. -DPALACE_WITH_CUDA=ON -DCMAKE_CUDA_ARCHITECTURES="80"| Give this a try and let us know if it resolves your issue. —Simon, thanks for your reply. I've rebuilt with -DCMAKE_CUDA_ARCHITECTURES="80;89;90".

Looks like it works for the A100 (80) and L40S (89), but not the H100/200 (90). They still give the error. Mike

[hughcars]

Hi @mmcilrath,

I'm sorry to hear Palace isn't working straight out the box on h100/200, if you could run cmake .. -DPALACE_WITH_CUDA=ON -DCMAKE_CUDA_ARCHITECTURES="90" |& tee cmake_log.txt and then make |& tee build_log.txt then attach the result here, we might be able to provide some more input. We've not had a chance to actually test on H100 or H200 ourselves yet.

Hugh

[mmcilrath]

On 8/6/25 11:07 AM, Hugh Carson wrote: *hughcars* left a comment (awslabs/palace#426) <#426 (comment)> Hi @mmcilrath <https://github.com/mmcilrath>, I'm sorry to hear Palace isn't working straight out the box on h100/200, if you could run |cmake .. -DPALACE_WITH_CUDA=ON -DCMAKE_CUDA_ARCHITECTURES="90" |& tee cmake_log.txt| and then |make |& tee build_log.txt| then attach the result here, we might be able to provide some more input. We've not had a chance to actually test on H100 or H200 ourselves yet.

Hi, Hugh, Building with 90 alone looks like it worked, with both H100 and H200. If there are tests you'd like me to run, let me know (but I have only somewhat limited access). There is another wrinkle: my builds have been bombing out in petsc: ... CUDAC arch-linux-c-opt/obj/src/vec/vec/impls/seq/cupm/cuda/vecseqcupm.o CUDAC.dep arch-linux-c-opt/obj/src/vec/vec/impls/seq/cupm/cuda/vecseqcupm.o make[5]: *** [/orcd/home/002/mbm/palace/build90/extern/petsc/lib/petsc/conf/rules_doc.mk:5: libs] Error 2 **************************ERROR************************************* Error during compile, check arch-linux-c-opt/lib/petsc/conf/make.log Send it and arch-linux-c-opt/lib/petsc/conf/configure.log to ***@***.*** ******************************************************************** make[4]: *** [makefile:44: all] Error 1 make[3]: *** [GNUmakefile:9: all] Error 2 make[2]: *** [extern/CMakeFiles/petsc.dir/build.make:87: extern/petsc-cmake/src/petsc-stamp/petsc-build] Error 2 make[1]: *** [CMakeFiles/Makefile2:359: extern/CMakeFiles/petsc.dir/all] Error 2 make: *** [Makefile:91: all] Error 2 and I've been running make by hand in extern/petsc and then re-running from the top and that appears to work. I believe I've saved all the build pieces if you want to look at them. Thanks, Mike

[hughcars]

Hi @mmcilrath,

Glad to hear it's working, and congrats on being the first H100/H200 user of Palace to my knowledge (and for having access to those chips). If you can attach the cmake_log.txt and build_log.txt from those previous command here, I can try and see what's going on. That particular petsc error message doesn't give very much, but if you send that configure.log it is generating, that might have some insight. It's particularly weird that building petsc yourself works, but from the build folder fails, that suggests something odd is happening.

Hugh

[mmcilrath]

On 8/11/25 10:19 AM, Hugh Carson wrote: *hughcars* left a comment (awslabs/palace#426) <#426 (comment)> Hi @mmcilrath <https://github.com/mmcilrath>, Glad to hear it's working, and congrats on being the first H100/H200 user of Palace to my knowledge (and for having access to those chips). If you can attach the |cmake_log.txt| and |build_log.txt| from those previous command here, I can try and see what's going on. That particular petsc error message doesn't give very much, but if you send that |configure.log| it is generating, that might have some insight. It's particularly weird that building petsc yourself works, but from the |build| folder fails, that suggests something odd is happening.

Hi, Hugh, attached are cmake_log.txt build_log.txt (up to petsc abort) build-petsc_log.txt (make in petsc directory) configure.log (petsc) build_log-2.txt (restart/continue from top) Mike

…

-- The CXX compiler identification is GNU 12.2.0 -- The C compiler identification is GNU 12.2.0 -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/g++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/gcc - skipped -- Detecting C compile features -- Detecting C compile features - done -- The CUDA compiler identification is NVIDIA 12.4.99 -- Detecting CUDA compiler ABI info -- Detecting CUDA compiler ABI info - done -- Check for working CUDA compiler: /orcd/software/core/001/pkg/cuda/12.4/bin/nvcc - skipped -- Detecting CUDA compile features -- Detecting CUDA compile features - done -- Found CUDAToolkit: /orcd/software/core/001/pkg/cuda/12.4/include (found version "12.4.99") -- Performing Test CMAKE_HAVE_LIBC_PTHREAD -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed -- Looking for pthread_create in pthreads -- Looking for pthread_create in pthreads - not found -- Looking for pthread_create in pthread -- Looking for pthread_create in pthread - found -- Found Threads: TRUE -- Setting CMAKE_BUILD_TYPE to 'Release' as none was specified -- Setting CMAKE_INSTALL_PREFIX to '/home/mbm/palace/build90' as none was specified -- Setting BUILD_SHARED_LIBS to 'OFF' as it was not specified -- Setting CMAKE_INSTALL_RPATH to '${CMAKE_INSTALL_PREFIX}/lib;${CMAKE_INSTALL_PREFIX}/lib64' as it was not specified -- Setting CMAKE_INSTALL_RPATH_USE_LINK_PATH to 'ON' as it was not specified -- ====================== Configuring MPI dependency ====================== -- Found MPI_C: /orcd/software/community/001/pkg/openmpi/5.0.6/lib/libmpi.so (found version "3.1") -- Found MPI_CXX: /orcd/software/community/001/pkg/openmpi/5.0.6/lib/libmpi.so (found version "3.1") -- Found MPI: TRUE (found version "3.1") -- ================= Configuring BLAS/LAPACK dependencies ================= -- Using BLAS/LAPACK located by CMake -- Using BLAS/LAPACK from OpenBLAS -- Looking for sgemm_ -- Looking for sgemm_ - found -- Found BLAS: /orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so -- Looking for cheev_ -- Looking for cheev_ - found -- Found LAPACK: /orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so;/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so -- ================ Configuring METIS/ParMETIS dependencies =============== -- METIS_OPTIONS: -DCMAKE_INSTALL_PREFIX=/home/mbm/palace/build90; -DCMAKE_BUILD_TYPE=Release; -DBUILD_SHARED_LIBS=OFF; -DCMAKE_EXE_LINKER_FLAGS=; -DCMAKE_MODULE_LINKER_FLAGS=; -DCMAKE_SHARED_LINKER_FLAGS=; -DCMAKE_STATIC_LINKER_FLAGS=; -DCMAKE_PREFIX_PATH=/home/mbm/palace/build90; -DCMAKE_INSTALL_RPATH=/home/mbm/palace/build90/lib$<SEMICOLON>/home/mbm/palace/build90/lib64; -DCMAKE_INSTALL_RPATH_USE_LINK_PATH=ON; -DCMAKE_C_COMPILER=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/gcc; -DCMAKE_C_FLAGS=; -DGKLIB_PATH=/home/mbm/palace/build90/extern/metis/GKlib; -DGKRAND=1; -DMATH_LIB=m; -DDEBUG=0; -DSHARED=0; -DMSVC=0; -DMETIS_USE_LONGINDEX=0 -- PARMETIS_OPTIONS: -DCMAKE_INSTALL_PREFIX=/home/mbm/palace/build90; -DCMAKE_BUILD_TYPE=Release; -DBUILD_SHARED_LIBS=OFF; -DCMAKE_EXE_LINKER_FLAGS=; -DCMAKE_MODULE_LINKER_FLAGS=; -DCMAKE_SHARED_LINKER_FLAGS=; -DCMAKE_STATIC_LINKER_FLAGS=; -DCMAKE_PREFIX_PATH=/home/mbm/palace/build90; -DCMAKE_INSTALL_RPATH=/home/mbm/palace/build90/lib$<SEMICOLON>/home/mbm/palace/build90/lib64; -DCMAKE_INSTALL_RPATH_USE_LINK_PATH=ON; -DCMAKE_C_COMPILER=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/gcc; -DCMAKE_C_FLAGS=; -DGKLIB_PATH=/home/mbm/palace/build90/extern/metis/GKlib; -DMETIS_PATH=/home/mbm/palace/build90; -DSHARED=0; -DMSVC=0; -DMPI_LIBRARIES=/orcd/software/community/001/pkg/openmpi/5.0.6/lib/libmpi.so; -DMPI_INCLUDE_PATH=/orcd/software/community/001/pkg/openmpi/5.0.6/include -- ================= Configuring SuperLU_DIST dependency ================== -- SUPERLU_OPTIONS: -DCMAKE_INSTALL_PREFIX=/home/mbm/palace/build90; -DCMAKE_BUILD_TYPE=Release; -DBUILD_SHARED_LIBS=OFF; -DCMAKE_EXE_LINKER_FLAGS=; -DCMAKE_MODULE_LINKER_FLAGS=; -DCMAKE_SHARED_LINKER_FLAGS=; -DCMAKE_STATIC_LINKER_FLAGS=; -DCMAKE_PREFIX_PATH=/home/mbm/palace/build90; -DCMAKE_INSTALL_RPATH=/home/mbm/palace/build90/lib$<SEMICOLON>/home/mbm/palace/build90/lib64; -DCMAKE_INSTALL_RPATH_USE_LINK_PATH=ON; -DCMAKE_CXX_COMPILER=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/g++; -DCMAKE_CXX_FLAGS=; -DCMAKE_C_COMPILER=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/gcc; -DCMAKE_C_FLAGS=; -DXSDK_ENABLE_Fortran=OFF; -Denable_tests=OFF; -Denable_examples=OFF; -Denable_double=ON; -Denable_single=ON; -Denable_complex16=ON; -Denable_python=OFF; -DTPL_ENABLE_PARMETISLIB=ON; -DTPL_PARMETIS_LIBRARIES=/home/mbm/palace/build90/lib/libparmetis.a$<SEMICOLON>/home/mbm/palace/build90/lib/libmetis.a; -DTPL_PARMETIS_INCLUDE_DIRS=/home/mbm/palace/build90/include; -DTPL_ENABLE_COMBBLASLIB=OFF; -Denable_openmp=OFF; -DTPL_ENABLE_LAPACKLIB=ON; -DTPL_ENABLE_INTERNAL_BLASLIB=OFF; -DLAPACK_LIBRARIES=/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so$<SEMICOLON>-lm; -DBLAS_LIBRARIES=/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so$<SEMICOLON>-lm; -DTPL_ENABLE_CUDALIB=OFF; -DTPL_ENABLE_HIPLIB=OFF -- ===================== Configuring MAGMA dependency ===================== -- MAGMA_OPTIONS: -DCMAKE_INSTALL_PREFIX=/home/mbm/palace/build90; -DCMAKE_BUILD_TYPE=Release; -DBUILD_SHARED_LIBS=ON; -DCMAKE_EXE_LINKER_FLAGS=; -DCMAKE_MODULE_LINKER_FLAGS=; -DCMAKE_SHARED_LINKER_FLAGS=; -DCMAKE_STATIC_LINKER_FLAGS=; -DCMAKE_PREFIX_PATH=/home/mbm/palace/build90; -DCMAKE_INSTALL_RPATH=/home/mbm/palace/build90/lib$<SEMICOLON>/home/mbm/palace/build90/lib64; -DCMAKE_INSTALL_RPATH_USE_LINK_PATH=ON; -DCMAKE_C_COMPILER=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/gcc; -DCMAKE_C_FLAGS=; -DCMAKE_CXX_COMPILER=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/g++; -DCMAKE_CXX_FLAGS=; -DUSE_FORTRAN=OFF; -DLAPACK_LIBRARIES=/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so$<SEMICOLON>-lm; -DMAGMA_ENABLE_CUDA=ON; -DCMAKE_CUDA_COMPILER=/orcd/software/core/001/pkg/cuda/12.4/bin/nvcc; -DCUDA_NVCC_FLAGS=; -DGPU_TARGET=sm_90; -DCMAKE_CUDA_ARCHITECTURES=90 -- =============== Configuring PETSc and SLEPc dependencies =============== -- PETSC_OPTIONS: COPTFLAGS= -O3 -DNDEBUG; CXXOPTFLAGS= -O3 -DNDEBUG; --prefix=/home/mbm/palace/build90; --with-cc=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/gcc; --with-cxx=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/g++; --with-fc=0; --with-scalar-type=complex; --with-precision=double; --with-clanguage=c; --with-x=0; --with-debugging=0; --with-shared-libraries=0; --known-64-bit-blas-indices=0; --with-mpi-lib=[/orcd/software/community/001/pkg/openmpi/5.0.6/lib/libmpi.so]; --with-mpi-include=[/orcd/software/community/001/pkg/openmpi/5.0.6/include]; --with-blaslapack-lib=[/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so,-lm]; --with-blaslapack-include=[/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/include]; --with-cuda; --with-cuda-arch=90 -- SLEPC_OPTIONS: --prefix=/home/mbm/palace/build90; --with-feast=0; --with-arpack=0 -- ==================== Configuring LIBXSMM dependency ==================== -- LIBXSMM_OPTIONS: OUTDIR=/home/mbm/palace/build90/lib; DIRSTATE=.; CC=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/gcc; CXX=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/g++; FC=; FORTRAN=0; BLAS=0; SYM=1; VERBOSE=1; STATIC=0 -- ===================== Configuring HYPRE dependency ===================== -- HYPRE_OPTIONS: CC=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/gcc; CFLAGS= -O3 -DNDEBUG -isystem /orcd/software/core/001/pkg/cuda/12.4/include -I/orcd/software/community/001/pkg/openmpi/5.0.6/include; CXX=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/g++; CXXFLAGS= -O3 -DNDEBUG -isystem /orcd/software/core/001/pkg/cuda/12.4/include -I/orcd/software/community/001/pkg/openmpi/5.0.6/include; FC=; LDFLAGS= /orcd/software/community/001/pkg/openmpi/5.0.6/lib/libmpi.so -lm; --prefix=/home/mbm/palace/build90; --disable-fortran; --with-MPI; --disable-debug; --disable-shared; --disable-mixedint; --disable-bigint; --with-MPI-libs=mpi; --with-MPI-lib-dirs=/orcd/software/community/001/pkg/openmpi/5.0.6/lib; --with-MPI-include=/orcd/software/community/001/pkg/openmpi/5.0.6/include; --with-blas-lib=/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so -lm; --with-lapack-lib=/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so -lm; --disable-unified-memory; --disable-gpu-aware-mpi; --with-cuda; --with-cuda-home=/orcd/software/core/001/pkg/cuda/12.4; --enable-curand; --enable-cusparse; --enable-device-memory-pool; --with-gpu-arch=90 -- ================= Configuring nlohmann/json dependency ================= -- JSON_OPTIONS: -DCMAKE_INSTALL_PREFIX=/home/mbm/palace/build90; -DCMAKE_BUILD_TYPE=Release; -DBUILD_SHARED_LIBS=OFF; -DCMAKE_EXE_LINKER_FLAGS=; -DCMAKE_MODULE_LINKER_FLAGS=; -DCMAKE_SHARED_LINKER_FLAGS=; -DCMAKE_STATIC_LINKER_FLAGS=; -DCMAKE_PREFIX_PATH=/home/mbm/palace/build90; -DCMAKE_INSTALL_RPATH=/home/mbm/palace/build90/lib$<SEMICOLON>/home/mbm/palace/build90/lib64; -DCMAKE_INSTALL_RPATH_USE_LINK_PATH=ON; -DCMAKE_CXX_COMPILER=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/g++; -DCMAKE_CXX_FLAGS=; -DJSON_Install=ON; -DJSON_BuildTests=OFF -- ====================== Configuring fmt dependency ====================== -- FMT_OPTIONS: -DCMAKE_INSTALL_PREFIX=/home/mbm/palace/build90; -DCMAKE_BUILD_TYPE=Release; -DBUILD_SHARED_LIBS=OFF; -DCMAKE_EXE_LINKER_FLAGS=; -DCMAKE_MODULE_LINKER_FLAGS=; -DCMAKE_SHARED_LINKER_FLAGS=; -DCMAKE_STATIC_LINKER_FLAGS=; -DCMAKE_PREFIX_PATH=/home/mbm/palace/build90; -DCMAKE_INSTALL_RPATH=/home/mbm/palace/build90/lib$<SEMICOLON>/home/mbm/palace/build90/lib64; -DCMAKE_INSTALL_RPATH_USE_LINK_PATH=ON; -DCMAKE_CXX_COMPILER=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/g++; -DCMAKE_CXX_FLAGS=; -DFMT_INSTALL=ON; -DFMT_DOC=OFF; -DFMT_TEST=OFF -- ===================== Configuring Eigen dependency ===================== -- EIGEN_OPTIONS: -DCMAKE_INSTALL_PREFIX=/home/mbm/palace/build90; -DCMAKE_BUILD_TYPE=Release; -DBUILD_SHARED_LIBS=OFF; -DCMAKE_EXE_LINKER_FLAGS=; -DCMAKE_MODULE_LINKER_FLAGS=; -DCMAKE_SHARED_LINKER_FLAGS=; -DCMAKE_STATIC_LINKER_FLAGS=; -DCMAKE_PREFIX_PATH=/home/mbm/palace/build90; -DCMAKE_INSTALL_RPATH=/home/mbm/palace/build90/lib$<SEMICOLON>/home/mbm/palace/build90/lib64; -DCMAKE_INSTALL_RPATH_USE_LINK_PATH=ON; -DCMAKE_CXX_COMPILER=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/g++; -DCMAKE_CXX_FLAGS=; -DEIGEN_BUILD_DOC=OFF; -DBUILD_TESTING=OFF; -DCMAKE_Fortran_COMPILER= -- ===================== Configuring SUNDIALS dependency ===================== -- SUNDIALS_OPTIONS: -DCMAKE_INSTALL_PREFIX=/home/mbm/palace/build90; -DCMAKE_BUILD_TYPE=Release; -DBUILD_SHARED_LIBS=OFF; -DCMAKE_EXE_LINKER_FLAGS=; -DCMAKE_MODULE_LINKER_FLAGS=; -DCMAKE_SHARED_LINKER_FLAGS=; -DCMAKE_STATIC_LINKER_FLAGS=; -DCMAKE_PREFIX_PATH=/home/mbm/palace/build90; -DCMAKE_INSTALL_RPATH=/home/mbm/palace/build90/lib$<SEMICOLON>/home/mbm/palace/build90/lib64; -DCMAKE_INSTALL_RPATH_USE_LINK_PATH=ON; -DCMAKE_CXX_COMPILER=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/g++; -DCMAKE_CXX_FLAGS=; -DCMAKE_C_COMPILER=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/gcc; -DCMAKE_C_FLAGS=; -DEXAMPLES_ENABLE_C=OFF; -DEXAMPLES_ENABLE_CXX=OFF; -DEXAMPLES_ENABLE_CUDA=OFF; -DEXAMPLES_INSTALL=OFF; -DENABLE_MPI=ON; -DBUILD_IDA=OFF; -DBUILD_IDAS=OFF; -DBUILD_SUNLINSOL_LAPACKBAND=OFF; -DBUILD_SUNLINSOL_LAPACKDENSE=OFF; -DENABLE_OPENMP=OFF; -DENABLE_LAPACK=ON; -DLAPACK_LIBRARIES=/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so$<SEMICOLON>-lm; -DLAPACK_WORKS:BOOL=TRUE; -DCMAKE_CUDA_ARCHITECTURES=90; -DENABLE_CUDA=ON -- ===================== Configuring GSLIB dependency ===================== -- GSLIB_OPTIONS: INSTALL_ROOT=/home/mbm/palace/build90; CC=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/gcc; MPI=1; STATIC=1; SHARED=0; BLAS=0; CFLAGS= -O3 -DNDEBUG -I/orcd/software/community/001/pkg/openmpi/5.0.6/include; LDFLAGS= /orcd/software/community/001/pkg/openmpi/5.0.6/lib/libmpi.so -- ==================== Configuring libCEED dependency ==================== -- Performing Test SUPPORTS_OMP_SIMD -- Performing Test SUPPORTS_OMP_SIMD - Success -- LIBCEED_OPTIONS: prefix=/home/mbm/palace/build90; LDFLAGS=; CC=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/gcc; CXX=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/g++; FC=; OPT= -O3 -DNDEBUG -fopenmp-simd -isystem /orcd/software/core/001/pkg/cuda/12.4/include; STATIC=; PEDANTIC=; XSMM_DIR=/home/mbm/palace/build90; BLAS_LIB=/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so -lm; CUDA_DIR=/orcd/software/core/001/pkg/cuda/12.4; CUDA_ARCH=sm_90; MAGMA_DIR=/home/mbm/palace/build90 -- ====================== Configuring MFEM dependency ===================== -- Found ZLIB: /usr/lib64/libz.so (found version "1.2.11") -- Building MFEM with zlib support for binary output compression -- MFEM_OPTIONS: -DCMAKE_INSTALL_PREFIX=/home/mbm/palace/build90; -DCMAKE_BUILD_TYPE=Release; -DBUILD_SHARED_LIBS=OFF; -DCMAKE_EXE_LINKER_FLAGS=; -DCMAKE_MODULE_LINKER_FLAGS=; -DCMAKE_SHARED_LINKER_FLAGS=; -DCMAKE_STATIC_LINKER_FLAGS=; -DCMAKE_PREFIX_PATH=/home/mbm/palace/build90; -DCMAKE_INSTALL_RPATH=/home/mbm/palace/build90/lib$<SEMICOLON>/home/mbm/palace/build90/lib64; -DCMAKE_INSTALL_RPATH_USE_LINK_PATH=ON; -DCMAKE_CXX_COMPILER=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/g++; -DCMAKE_CXX_FLAGS=; -DMFEM_USE_MPI=YES; -DMFEM_USE_OPENMP=OFF; -DMFEM_THREAD_SAFE=OFF; -DMFEM_USE_SUPERLU=ON; -DMFEM_USE_STRUMPACK=OFF; -DMFEM_USE_MUMPS=OFF; -DMFEM_USE_ZLIB=YES; -DMFEM_USE_LIBUNWIND=NO; -DMFEM_USE_METIS_5=YES; -DMFEM_USE_CEED=NO; -DMFEM_USE_SUNDIALS=ON; -DMFEM_USE_EXCEPTIONS=NO; -DBLAS_LIBRARIES=/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so$<SEMICOLON>-lm; -DLAPACK_LIBRARIES=/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so$<SEMICOLON>-lm; -DMFEM_USE_CUDA=YES; -DCMAKE_CUDA_COMPILER=/orcd/software/core/001/pkg/cuda/12.4/bin/nvcc; -DCMAKE_CUDA_FLAGS=; -DCMAKE_CUDA_ARCHITECTURES=90; -DCUDA_ARCH=90; -DMFEM_USE_HIP=NO; -DMFEM_USE_GSLIB=YES; -DGSLIB_DIR=/home/mbm/palace/build90; -DMETIS_LIBRARIES=/home/mbm/palace/build90/lib/libmetis.a; -DMETIS_INCLUDE_DIRS=/home/mbm/palace/build90/include; -DHYPRE_DIR=/home/mbm/palace/build90; -DHYPRE_REQUIRED_PACKAGES=LAPACK$<SEMICOLON>BLAS; -DParMETIS_LIBRARIES=/home/mbm/palace/build90/lib/libparmetis.a$<SEMICOLON>/home/mbm/palace/build90/lib/libmetis.a; -DParMETIS_INCLUDE_DIRS=/home/mbm/palace/build90/include; -DHYPRE_REQUIRED_PACKAGES=CUDAToolkit; -DSuperLUDist_DIR=/home/mbm/palace/build90; -DSuperLUDist_REQUIRED_PACKAGES=ParMETIS$<SEMICOLON>METIS$<SEMICOLON>LAPACK$<SEMICOLON>BLAS$<SEMICOLON>MPI$<SEMICOLON>CUDAToolkit; -DSuperLUDist_REQUIRED_LIBRARIES=/orcd/software/core/001/pkg/cuda/12.4/targets/x86_64-linux/lib/libcublas.so$<SEMICOLON>/orcd/software/core/001/pkg/cuda/12.4/targets/x86_64-linux/lib/libcublasLt.so$<SEMICOLON>/orcd/software/core/001/pkg/cuda/12.4/targets/x86_64-linux/lib/libcusolver.so; -DSUNDIALS_DIR=/home/mbm/palace/build90; -DSUNDIALS_REQUIRED_PACKAGES=LAPACK$<SEMICOLON>BLAS$<SEMICOLON>MPI$<SEMICOLON>CUDAToolkit; -DSUNDIALS_REQUIRED_LIBRARIES=/orcd/software/core/001/pkg/cuda/12.4/targets/x86_64-linux/lib/libcublas.so$<SEMICOLON>/orcd/software/core/001/pkg/cuda/12.4/targets/x86_64-linux/lib/libcublasLt.so$<SEMICOLON>/orcd/software/core/001/pkg/cuda/12.4/targets/x86_64-linux/lib/libcusolver.so -- ========================== Configuring Palace ========================== -- PALACE_OPTIONS: -DCMAKE_INSTALL_PREFIX=/home/mbm/palace/build90; -DCMAKE_BUILD_TYPE=Release; -DBUILD_SHARED_LIBS=OFF; -DCMAKE_EXE_LINKER_FLAGS=; -DCMAKE_MODULE_LINKER_FLAGS=; -DCMAKE_SHARED_LINKER_FLAGS=; -DCMAKE_STATIC_LINKER_FLAGS=; -DCMAKE_PREFIX_PATH=/home/mbm/palace/build90; -DCMAKE_INSTALL_RPATH=/home/mbm/palace/build90/lib$<SEMICOLON>/home/mbm/palace/build90/lib64; -DCMAKE_INSTALL_RPATH_USE_LINK_PATH=ON; -DCMAKE_CXX_COMPILER=/orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/g++; -DCMAKE_CXX_FLAGS=; -DPALACE_WITH_OPENMP=OFF; -DPALACE_WITH_SLEPC=ON; -DPALACE_WITH_ARPACK=OFF; -DANALYZE_SOURCES_CLANG_TIDY=OFF; -DANALYZE_SOURCES_CPPCHECK=OFF; -DBLAS_LIBRARIES=/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so$<SEMICOLON>-lm; -DLAPACK_LIBRARIES=/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so$<SEMICOLON>-lm; -DPALACE_WITH_CUDA=ON; -DCMAKE_CUDA_COMPILER=/orcd/software/core/001/pkg/cuda/12.4/bin/nvcc; -DCMAKE_CUDA_FLAGS=; -DCMAKE_CUDA_ARCHITECTURES=90; -DPALACE_WITH_HIP=OFF -- ======================= Configure stage complete ======================= -- Configuring done (14.0s) -- Generating done (0.3s) -- Build files have been written to: /home/mbm/palace/build90 [ 1%] Creating directories for 'gslib' [ 2%] Performing download step (git clone) for 'gslib' Cloning into 'gslib'... HEAD is now at 95acf5b use die instead of MPI_Abort [ 3%] No update step for 'gslib' [ 4%] No patch step for 'gslib' [ 5%] No configure step for 'gslib' [ 5%] No build step for 'gslib' [ 5%] Performing install step for 'gslib' ar: creating src/libgs.a a - src/gs.o a - src/sort.o a - src/sarray_transfer.o a - src/sarray_sort.o a - src/gs_local.o a - src/fail.o a - src/crystal.o a - src/comm.o a - src/tensor.o a - src/fcrystal.o a - src/findpts.o a - src/findpts_local.o a - src/obbox.o a - src/poly.o a - src/lob_bnd.o a - src/findpts_el_3.o a - src/findpts_el_2.o [ 5%] No test step for 'gslib' [ 6%] Completed 'gslib' [ 6%] Built target gslib [ 6%] Creating directories for 'metis' [ 7%] Performing download step (git clone) for 'metis' Cloning into 'metis'... HEAD is now at 08c3082 update cmake minver to 3.5 [ 7%] No update step for 'metis' [ 8%] No patch step for 'metis' [ 8%] Performing configure step for 'metis' -- The C compiler identification is GNU 12.2.0 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/gcc - skipped -- Detecting C compile features -- Detecting C compile features - done -- Looking for execinfo.h -- Looking for execinfo.h - found -- Looking for getline -- Looking for getline - found -- Performing Test HAVE__thread -- Performing Test HAVE__thread - Success -- checking for __thread thread-local storage - found -- Configuring done (1.4s) -- Generating done (0.1s) -- Build files have been written to: /home/mbm/palace/build90/extern/metis-build [ 9%] Performing build step for 'metis' [ 1%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/b64.c.o [ 3%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/blas.c.o [ 4%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/csr.c.o /home/mbm/palace/build90/extern/metis/GKlib/csr.c: In function 'gk_csr_Normalize': /home/mbm/palace/build90/extern/metis/GKlib/csr.c:1344:14: warning: this 'if' clause does not guard... [-Wmisleading-indentation] 1344 | else if (norm == 1) | ^~ /home/mbm/palace/build90/extern/metis/GKlib/csr.c:1346:11: note: ...this statement, but the latter is misleadingly indented as if it were guarded by the 'if' 1346 | for (j=ptr[i]; j<ptr[i+1]; j++) | ^~~ /home/mbm/palace/build90/extern/metis/GKlib/csr.c:1371:14: warning: this 'if' clause does not guard... [-Wmisleading-indentation] 1371 | else if (norm == 1) | ^~ /home/mbm/palace/build90/extern/metis/GKlib/csr.c:1373:11: note: ...this statement, but the latter is misleadingly indented as if it were guarded by the 'if' 1373 | for (j=ptr[i]; j<ptr[i+1]; j++) | ^~~ [ 6%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/error.c.o [ 8%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/evaluate.c.o [ 9%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/fkvkselect.c.o [ 11%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/fs.c.o [ 12%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/getopt.c.o /home/mbm/palace/build90/extern/metis/GKlib/getopt.c: In function 'gk_getopt_internal': /home/mbm/palace/build90/extern/metis/GKlib/getopt.c:343:5: warning: this 'if' clause does not guard... [-Wmisleading-indentation] 343 | if (gk_optind == 0) | ^~ /home/mbm/palace/build90/extern/metis/GKlib/getopt.c:345:7: note: ...this statement, but the latter is misleadingly indented as if it were guarded by the 'if' 345 | optstring = gk_getopt_initialize (argc, argv, optstring); | ^~~~~~~~~ /home/mbm/palace/build90/extern/metis/GKlib/getopt.c:700:9: warning: this 'else' clause does not guard... [-Wmisleading-indentation] 700 | else | ^~~~ /home/mbm/palace/build90/extern/metis/GKlib/getopt.c:703:11: note: ...this statement, but the latter is misleadingly indented as if it were guarded by the 'else' 703 | nextchar = NULL; | ^~~~~~~~ [ 14%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/gkregex.c.o [ 16%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/graph.c.o [ 17%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/htable.c.o [ 19%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/io.c.o [ 20%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/itemsets.c.o [ 22%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/mcore.c.o [ 24%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/memory.c.o [ 25%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/omp.c.o [ 27%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/pdb.c.o [ 29%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/pqueue.c.o In file included from /home/mbm/palace/build90/extern/metis/GKlib/GKlib.h:74, from /home/mbm/palace/build90/extern/metis/GKlib/pqueue.c:12: /home/mbm/palace/build90/extern/metis/GKlib/pqueue.c: In function 'gk_ipqCheckHeap': /home/mbm/palace/build90/extern/metis/GKlib/gk_mkpqueue.h:386:8: warning: variable 'heap' set but not used [-Wunused-but-set-variable] 386 | KVT *heap;\ | ^~~~ /home/mbm/palace/build90/extern/metis/GKlib/pqueue.c:19:1: note: in expansion of macro 'GK_MKPQUEUE' 19 | GK_MKPQUEUE(gk_ipq, gk_ipq_t, gk_ikv_t, int, gk_idx_t, gk_ikvmalloc, INT_MAX, key_gt) | ^~~~~~~~~~~ /home/mbm/palace/build90/extern/metis/GKlib/pqueue.c: In function 'gk_i32pqCheckHeap': /home/mbm/palace/build90/extern/metis/GKlib/gk_mkpqueue.h:386:8: warning: variable 'heap' set but not used [-Wunused-but-set-variable] 386 | KVT *heap;\ | ^~~~ /home/mbm/palace/build90/extern/metis/GKlib/pqueue.c:20:1: note: in expansion of macro 'GK_MKPQUEUE' 20 | GK_MKPQUEUE(gk_i32pq, gk_i32pq_t, gk_i32kv_t, int32_t, gk_idx_t, gk_i32kvmalloc, INT32_MAX, key_gt) | ^~~~~~~~~~~ /home/mbm/palace/build90/extern/metis/GKlib/pqueue.c: In function 'gk_i64pqCheckHeap': /home/mbm/palace/build90/extern/metis/GKlib/gk_mkpqueue.h:386:8: warning: variable 'heap' set but not used [-Wunused-but-set-variable] 386 | KVT *heap;\ | ^~~~ /home/mbm/palace/build90/extern/metis/GKlib/pqueue.c:21:1: note: in expansion of macro 'GK_MKPQUEUE' 21 | GK_MKPQUEUE(gk_i64pq, gk_i64pq_t, gk_i64kv_t, int64_t, gk_idx_t, gk_i64kvmalloc, INT64_MAX, key_gt) | ^~~~~~~~~~~ /home/mbm/palace/build90/extern/metis/GKlib/pqueue.c: In function 'gk_fpqCheckHeap': /home/mbm/palace/build90/extern/metis/GKlib/gk_mkpqueue.h:386:8: warning: variable 'heap' set but not used [-Wunused-but-set-variable] 386 | KVT *heap;\ | ^~~~ /home/mbm/palace/build90/extern/metis/GKlib/pqueue.c:22:1: note: in expansion of macro 'GK_MKPQUEUE' 22 | GK_MKPQUEUE(gk_fpq, gk_fpq_t, gk_fkv_t, float, gk_idx_t, gk_fkvmalloc, FLT_MAX, key_gt) | ^~~~~~~~~~~ /home/mbm/palace/build90/extern/metis/GKlib/pqueue.c: In function 'gk_dpqCheckHeap': /home/mbm/palace/build90/extern/metis/GKlib/gk_mkpqueue.h:386:8: warning: variable 'heap' set but not used [-Wunused-but-set-variable] 386 | KVT *heap;\ | ^~~~ /home/mbm/palace/build90/extern/metis/GKlib/pqueue.c:23:1: note: in expansion of macro 'GK_MKPQUEUE' 23 | GK_MKPQUEUE(gk_dpq, gk_dpq_t, gk_dkv_t, double, gk_idx_t, gk_dkvmalloc, DBL_MAX, key_gt) | ^~~~~~~~~~~ /home/mbm/palace/build90/extern/metis/GKlib/pqueue.c: In function 'gk_idxpqCheckHeap': /home/mbm/palace/build90/extern/metis/GKlib/gk_mkpqueue.h:386:8: warning: variable 'heap' set but not used [-Wunused-but-set-variable] 386 | KVT *heap;\ | ^~~~ /home/mbm/palace/build90/extern/metis/GKlib/pqueue.c:24:1: note: in expansion of macro 'GK_MKPQUEUE' 24 | GK_MKPQUEUE(gk_idxpq, gk_idxpq_t, gk_idxkv_t, gk_idx_t, gk_idx_t, gk_idxkvmalloc, GK_IDX_MAX, key_gt) | ^~~~~~~~~~~ [ 30%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/random.c.o [ 32%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/rw.c.o [ 33%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/seq.c.o [ 35%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/sort.c.o [ 37%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/string.c.o [ 38%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/timers.c.o [ 40%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/tokenizer.c.o [ 41%] Building C object libmetis/CMakeFiles/metis.dir/__/GKlib/util.c.o [ 43%] Building C object libmetis/CMakeFiles/metis.dir/auxapi.c.o [ 45%] Building C object libmetis/CMakeFiles/metis.dir/balance.c.o [ 46%] Building C object libmetis/CMakeFiles/metis.dir/bucketsort.c.o [ 48%] Building C object libmetis/CMakeFiles/metis.dir/checkgraph.c.o [ 50%] Building C object libmetis/CMakeFiles/metis.dir/coarsen.c.o /home/mbm/palace/build90/extern/metis/libmetis/coarsen.c: In function 'libmetis__Match_RM': /home/mbm/palace/build90/extern/metis/libmetis/coarsen.c:152:33: warning: variable 'adjwgt' set but not used [-Wunused-but-set-variable] 152 | idx_t *xadj, *vwgt, *adjncy, *adjwgt, *maxvwgt; | ^~~~~~ [ 51%] Building C object libmetis/CMakeFiles/metis.dir/compress.c.o [ 53%] Building C object libmetis/CMakeFiles/metis.dir/contig.c.o /home/mbm/palace/build90/extern/metis/libmetis/contig.c: In function 'libmetis__EliminateComponents': /home/mbm/palace/build90/extern/metis/libmetis/contig.c:345:11: warning: variable 'tpwgts' set but not used [-Wunused-but-set-variable] 345 | real_t *tpwgts; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/contig.c: In function 'libmetis__MoveGroupContigForCut': /home/mbm/palace/build90/extern/metis/libmetis/contig.c:534:34: warning: variable 'nvtxs' set but not used [-Wunused-but-set-variable] 534 | idx_t i, ii, iii, j, jj, k, l, nvtxs, nbnd, from, me; | ^~~~~ /home/mbm/palace/build90/extern/metis/libmetis/contig.c: In function 'libmetis__MoveGroupContigForVol': /home/mbm/palace/build90/extern/metis/libmetis/contig.c:605:34: warning: variable 'nvtxs' set but not used [-Wunused-but-set-variable] 605 | idx_t i, ii, iii, j, jj, k, l, nvtxs, from, me, other, xgain; | ^~~~~ [ 54%] Building C object libmetis/CMakeFiles/metis.dir/debug.c.o /home/mbm/palace/build90/extern/metis/libmetis/debug.c: In function 'libmetis__CheckBnd': /home/mbm/palace/build90/extern/metis/libmetis/debug.c:124:43: warning: variable 'bndind' set but not used [-Wunused-but-set-variable] 124 | idx_t *xadj, *adjncy, *where, *bndptr, *bndind; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/debug.c:124:34: warning: variable 'bndptr' set but not used [-Wunused-but-set-variable] 124 | idx_t *xadj, *adjncy, *where, *bndptr, *bndind; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/debug.c: In function 'libmetis__CheckBnd2': /home/mbm/palace/build90/extern/metis/libmetis/debug.c:161:43: warning: variable 'bndind' set but not used [-Wunused-but-set-variable] 161 | idx_t *xadj, *adjncy, *where, *bndptr, *bndind; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/debug.c:161:34: warning: variable 'bndptr' set but not used [-Wunused-but-set-variable] 161 | idx_t *xadj, *adjncy, *where, *bndptr, *bndind; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/debug.c: In function 'libmetis__CheckNodeBnd': /home/mbm/palace/build90/extern/metis/libmetis/debug.c:198:43: warning: variable 'bndind' set but not used [-Wunused-but-set-variable] 198 | idx_t *xadj, *adjncy, *where, *bndptr, *bndind; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/debug.c:198:34: warning: variable 'bndptr' set but not used [-Wunused-but-set-variable] 198 | idx_t *xadj, *adjncy, *where, *bndptr, *bndind; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/debug.c:198:17: warning: variable 'adjncy' set but not used [-Wunused-but-set-variable] 198 | idx_t *xadj, *adjncy, *where, *bndptr, *bndind; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/debug.c:198:10: warning: variable 'xadj' set but not used [-Wunused-but-set-variable] 198 | idx_t *xadj, *adjncy, *where, *bndptr, *bndind; | ^~~~ /home/mbm/palace/build90/extern/metis/libmetis/debug.c: In function 'libmetis__CheckRInfo': /home/mbm/palace/build90/extern/metis/libmetis/debug.c:235:11: warning: variable 'nbrs' set but not used [-Wunused-but-set-variable] 235 | cnbr_t *nbrs; | ^~~~ /home/mbm/palace/build90/extern/metis/libmetis/debug.c: In function 'libmetis__CheckNodePartitionParams': /home/mbm/palace/build90/extern/metis/libmetis/debug.c:258:26: warning: variable 'adjwgt' set but not used [-Wunused-but-set-variable] 258 | idx_t *xadj, *adjncy, *adjwgt, *vwgt, *where; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/debug.c: In function 'libmetis__IsSeparable': /home/mbm/palace/build90/extern/metis/libmetis/debug.c:312:17: warning: variable 'adjncy' set but not used [-Wunused-but-set-variable] 312 | idx_t *xadj, *adjncy, *where; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/debug.c:311:22: warning: variable 'other' set but not used [-Wunused-but-set-variable] 311 | idx_t i, j, nvtxs, other; | ^~~~~ [ 56%] Building C object libmetis/CMakeFiles/metis.dir/fm.c.o [ 58%] Building C object libmetis/CMakeFiles/metis.dir/fortran.c.o [ 59%] Building C object libmetis/CMakeFiles/metis.dir/frename.c.o [ 61%] Building C object libmetis/CMakeFiles/metis.dir/gklib.c.o In file included from /home/mbm/palace/build90/extern/metis/GKlib/GKlib.h:74, from /home/mbm/palace/build90/extern/metis/libmetis/metislib.h:17, from /home/mbm/palace/build90/extern/metis/libmetis/gklib.c:12: /home/mbm/palace/build90/extern/metis/libmetis/gklib.c: In function 'libmetis__ipqCheckHeap': /home/mbm/palace/build90/extern/metis/GKlib/gk_mkpqueue.h:386:8: warning: variable 'heap' set but not used [-Wunused-but-set-variable] 386 | KVT *heap;\ | ^~~~ /home/mbm/palace/build90/extern/metis/libmetis/gklib.c:33:1: note: in expansion of macro 'GK_MKPQUEUE' 33 | GK_MKPQUEUE(ipq, ipq_t, ikv_t, idx_t, idx_t, ikvmalloc, IDX_MAX, key_gt) | ^~~~~~~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/gklib.c: In function 'libmetis__rpqCheckHeap': /home/mbm/palace/build90/extern/metis/GKlib/gk_mkpqueue.h:386:8: warning: variable 'heap' set but not used [-Wunused-but-set-variable] 386 | KVT *heap;\ | ^~~~ /home/mbm/palace/build90/extern/metis/libmetis/gklib.c:34:1: note: in expansion of macro 'GK_MKPQUEUE' 34 | GK_MKPQUEUE(rpq, rpq_t, rkv_t, real_t, idx_t, rkvmalloc, REAL_MAX, key_gt) | ^~~~~~~~~~~ [ 62%] Building C object libmetis/CMakeFiles/metis.dir/graph.c.o [ 64%] Building C object libmetis/CMakeFiles/metis.dir/initpart.c.o /home/mbm/palace/build90/extern/metis/libmetis/initpart.c: In function 'libmetis__RandomBisection': /home/mbm/palace/build90/extern/metis/libmetis/initpart.c:119:33: warning: variable 'adjwgt' set but not used [-Wunused-but-set-variable] 119 | idx_t *xadj, *vwgt, *adjncy, *adjwgt, *where; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/initpart.c:119:24: warning: variable 'adjncy' set but not used [-Wunused-but-set-variable] 119 | idx_t *xadj, *vwgt, *adjncy, *adjwgt, *where; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/initpart.c:119:10: warning: variable 'xadj' set but not used [-Wunused-but-set-variable] 119 | idx_t *xadj, *vwgt, *adjncy, *adjwgt, *where; | ^~~~ /home/mbm/palace/build90/extern/metis/libmetis/initpart.c: In function 'libmetis__GrowBisection': /home/mbm/palace/build90/extern/metis/libmetis/initpart.c:195:33: warning: variable 'adjwgt' set but not used [-Wunused-but-set-variable] 195 | idx_t *xadj, *vwgt, *adjncy, *adjwgt, *where; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/initpart.c: In function 'libmetis__GrowBisectionNode': /home/mbm/palace/build90/extern/metis/libmetis/initpart.c:438:33: warning: variable 'adjwgt' set but not used [-Wunused-but-set-variable] 438 | idx_t *xadj, *vwgt, *adjncy, *adjwgt, *where, *bndind; | ^~~~~~ [ 66%] Building C object libmetis/CMakeFiles/metis.dir/kmetis.c.o [ 67%] Building C object libmetis/CMakeFiles/metis.dir/kwayfm.c.o /home/mbm/palace/build90/extern/metis/libmetis/kwayfm.c: In function 'libmetis__Greedy_KWayCutOptimize': /home/mbm/palace/build90/extern/metis/libmetis/kwayfm.c:69:74: warning: variable 'adwgts' set but not used [-Wunused-but-set-variable] 69 | idx_t maxndoms, *safetos=NULL, *nads=NULL, *doms=NULL, **adids=NULL, **adwgts=NULL; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/kwayfm.c: In function 'libmetis__Greedy_KWayVolOptimize': /home/mbm/palace/build90/extern/metis/libmetis/kwayfm.c:382:74: warning: variable 'adwgts' set but not used [-Wunused-but-set-variable] 382 | idx_t maxndoms, *safetos=NULL, *nads=NULL, *doms=NULL, **adids=NULL, **adwgts=NULL; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/kwayfm.c:380:33: warning: variable 'bndptr' set but not used [-Wunused-but-set-variable] 380 | idx_t *where, *pwgts, *perm, *bndptr, *bndind, *minwgt, *maxwgt, *itpwgts; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/kwayfm.c: In function 'libmetis__Greedy_McKWayCutOptimize': /home/mbm/palace/build90/extern/metis/libmetis/kwayfm.c:696:74: warning: variable 'adwgts' set but not used [-Wunused-but-set-variable] 696 | idx_t maxndoms, *safetos=NULL, *nads=NULL, *doms=NULL, **adids=NULL, **adwgts=NULL; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/kwayfm.c: In function 'libmetis__Greedy_McKWayVolOptimize': /home/mbm/palace/build90/extern/metis/libmetis/kwayfm.c:1038:74: warning: variable 'adwgts' set but not used [-Wunused-but-set-variable] 1038 | idx_t maxndoms, *safetos=NULL, *nads=NULL, *doms=NULL, **adids=NULL, **adwgts=NULL; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/kwayfm.c:1036:33: warning: variable 'bndptr' set but not used [-Wunused-but-set-variable] 1036 | idx_t *where, *pwgts, *perm, *bndptr, *bndind, *minwgt, *maxwgt; | ^~~~~~ [ 69%] Building C object libmetis/CMakeFiles/metis.dir/kwayrefine.c.o /home/mbm/palace/build90/extern/metis/libmetis/kwayrefine.c: In function 'libmetis__ComputeKWayVolGains': /home/mbm/palace/build90/extern/metis/libmetis/kwayrefine.c:565:34: warning: variable 'adjwgt' set but not used [-Wunused-but-set-variable] 565 | idx_t *xadj, *vsize, *adjncy, *adjwgt, *where, | ^~~~~~ [ 70%] Building C object libmetis/CMakeFiles/metis.dir/mcutil.c.o [ 72%] Building C object libmetis/CMakeFiles/metis.dir/mesh.c.o [ 74%] Building C object libmetis/CMakeFiles/metis.dir/meshpart.c.o [ 75%] Building C object libmetis/CMakeFiles/metis.dir/minconn.c.o /home/mbm/palace/build90/extern/metis/libmetis/minconn.c: In function 'libmetis__ComputeSubDomainGraph': /home/mbm/palace/build90/extern/metis/libmetis/minconn.c:21:26: warning: variable 'adjwgt' set but not used [-Wunused-but-set-variable] 21 | idx_t *xadj, *adjncy, *adjwgt, *where; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/minconn.c:21:17: warning: variable 'adjncy' set but not used [-Wunused-but-set-variable] 21 | idx_t *xadj, *adjncy, *adjwgt, *where; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/minconn.c:21:10: warning: variable 'xadj' set but not used [-Wunused-but-set-variable] 21 | idx_t *xadj, *adjncy, *adjwgt, *where; | ^~~~ /home/mbm/palace/build90/extern/metis/libmetis/minconn.c: In function 'libmetis__MoveGroupMinConnForCut': /home/mbm/palace/build90/extern/metis/libmetis/minconn.c:480:29: warning: variable 'nvtxs' set but not used [-Wunused-but-set-variable] 480 | idx_t i, ii, j, jj, k, l, nvtxs, nbnd, from, me; | ^~~~~ /home/mbm/palace/build90/extern/metis/libmetis/minconn.c: In function 'libmetis__MoveGroupMinConnForVol': /home/mbm/palace/build90/extern/metis/libmetis/minconn.c:564:29: warning: variable 'nvtxs' set but not used [-Wunused-but-set-variable] 564 | idx_t i, ii, j, jj, k, l, nvtxs, from, me, other, xgain, ewgt; | ^~~~~ [ 77%] Building C object libmetis/CMakeFiles/metis.dir/mincover.c.o [ 79%] Building C object libmetis/CMakeFiles/metis.dir/mmd.c.o [ 80%] Building C object libmetis/CMakeFiles/metis.dir/ometis.c.o /home/mbm/palace/build90/extern/metis/libmetis/ometis.c: In function 'libmetis__MlevelNestedDissection': /home/mbm/palace/build90/extern/metis/libmetis/ometis.c:186:15: warning: variable 'nvtxs' set but not used [-Wunused-but-set-variable] 186 | idx_t i, j, nvtxs, nbnd; | ^~~~~ /home/mbm/palace/build90/extern/metis/libmetis/ometis.c: In function 'libmetis__SplitGraphOrder': /home/mbm/palace/build90/extern/metis/libmetis/ometis.c:426:33: warning: variable 'adjwgt' set but not used [-Wunused-but-set-variable] 426 | idx_t *xadj, *vwgt, *adjncy, *adjwgt, *label, *where, *bndptr, *bndind; | ^~~~~~ /home/mbm/palace/build90/extern/metis/libmetis/ometis.c: In function 'libmetis__SplitGraphOrderCC': /home/mbm/palace/build90/extern/metis/libmetis/ometis.c:556:33: warning: variable 'adjwgt' set but not used [-Wunused-but-set-variable] 556 | idx_t *xadj, *vwgt, *adjncy, *adjwgt, *label, *where, *bndptr, *bndind; | ^~~~~~ [ 82%] Building C object libmetis/CMakeFiles/metis.dir/options.c.o [ 83%] Building C object libmetis/CMakeFiles/metis.dir/parmetis.c.o [ 85%] Building C object libmetis/CMakeFiles/metis.dir/pmetis.c.o [ 87%] Building C object libmetis/CMakeFiles/metis.dir/refine.c.o [ 88%] Building C object libmetis/CMakeFiles/metis.dir/separator.c.o /home/mbm/palace/build90/extern/metis/libmetis/separator.c: In function 'libmetis__ConstructMinCoverSeparator': /home/mbm/palace/build90/extern/metis/libmetis/separator.c:73:27: warning: variable 'bndptr' set but not used [-Wunused-but-set-variable] 73 | idx_t *where, *bndind, *bndptr, *vmap, *ivmap, *cover; | ^~~~~~ [ 90%] Building C object libmetis/CMakeFiles/metis.dir/sfm.c.o [ 91%] Building C object libmetis/CMakeFiles/metis.dir/srefine.c.o [ 93%] Building C object libmetis/CMakeFiles/metis.dir/stat.c.o [ 95%] Building C object libmetis/CMakeFiles/metis.dir/timing.c.o [ 96%] Building C object libmetis/CMakeFiles/metis.dir/util.c.o [ 98%] Building C object libmetis/CMakeFiles/metis.dir/wspace.c.o [100%] Linking C static library libmetis.a [100%] Built target metis [ 10%] Performing install step for 'metis' [100%] Built target metis Install the project... -- Install configuration: "Release" -- Installing: /home/mbm/palace/build90/include/metis.h -- Installing: /home/mbm/palace/build90/include/gklib_tls.h -- Installing: /home/mbm/palace/build90/lib/libmetis.a -- Installing: /home/mbm/palace/build90/include/gklib_defs.h -- Installing: /home/mbm/palace/build90/include/gklib_rename.h [ 11%] No test step for 'metis' [ 12%] Completed 'metis' [ 12%] Built target metis [ 13%] Creating directories for 'parmetis' [ 13%] Performing download step (git clone) for 'parmetis' Cloning into 'parmetis'... HEAD is now at 53c9341 update cmake minver to 3.5 [ 14%] No update step for 'parmetis' [ 14%] No patch step for 'parmetis' [ 15%] Performing configure step for 'parmetis' -- The C compiler identification is GNU 12.2.0 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/gcc - skipped -- Detecting C compile features -- Detecting C compile features - done -- Configuring done (0.6s) -- Generating done (0.0s) -- Build files have been written to: /home/mbm/palace/build90/extern/parmetis-build [ 16%] Performing build step for 'parmetis' [ 2%] Building C object libparmetis/CMakeFiles/parmetis.dir/ComputeVertexSeparator.c.o [ 4%] Building C object libparmetis/CMakeFiles/parmetis.dir/akwayfm.c.o [ 7%] Building C object libparmetis/CMakeFiles/parmetis.dir/ametis.c.o [ 9%] Building C object libparmetis/CMakeFiles/parmetis.dir/balancemylink.c.o [ 12%] Building C object libparmetis/CMakeFiles/parmetis.dir/comm.c.o [ 14%] Building C object libparmetis/CMakeFiles/parmetis.dir/csrmatch.c.o [ 17%] Building C object libparmetis/CMakeFiles/parmetis.dir/ctrl.c.o [ 19%] Building C object libparmetis/CMakeFiles/parmetis.dir/debug.c.o [ 21%] Building C object libparmetis/CMakeFiles/parmetis.dir/diffutil.c.o [ 24%] Building C object libparmetis/CMakeFiles/parmetis.dir/frename.c.o [ 26%] Building C object libparmetis/CMakeFiles/parmetis.dir/gkmetis.c.o [ 29%] Building C object libparmetis/CMakeFiles/parmetis.dir/gkmpi.c.o [ 31%] Building C object libparmetis/CMakeFiles/parmetis.dir/graph.c.o [ 34%] Building C object libparmetis/CMakeFiles/parmetis.dir/initbalance.c.o [ 36%] Building C object libparmetis/CMakeFiles/parmetis.dir/initmsection.c.o [ 39%] Building C object libparmetis/CMakeFiles/parmetis.dir/initpart.c.o [ 41%] Building C object libparmetis/CMakeFiles/parmetis.dir/kmetis.c.o [ 43%] Building C object libparmetis/CMakeFiles/parmetis.dir/kwayrefine.c.o [ 46%] Building C object libparmetis/CMakeFiles/parmetis.dir/match.c.o [ 48%] Building C object libparmetis/CMakeFiles/parmetis.dir/mdiffusion.c.o [ 51%] Building C object libparmetis/CMakeFiles/parmetis.dir/mesh.c.o [ 53%] Building C object libparmetis/CMakeFiles/parmetis.dir/mmetis.c.o [ 56%] Building C object libparmetis/CMakeFiles/parmetis.dir/move.c.o [ 58%] Building C object libparmetis/CMakeFiles/parmetis.dir/msetup.c.o [ 60%] Building C object libparmetis/CMakeFiles/parmetis.dir/node_refine.c.o [ 63%] Building C object libparmetis/CMakeFiles/parmetis.dir/ometis.c.o [ 65%] Building C object libparmetis/CMakeFiles/parmetis.dir/pspases.c.o [ 68%] Building C object libparmetis/CMakeFiles/parmetis.dir/redomylink.c.o [ 70%] Building C object libparmetis/CMakeFiles/parmetis.dir/remap.c.o [ 73%] Building C object libparmetis/CMakeFiles/parmetis.dir/renumber.c.o [ 75%] Building C object libparmetis/CMakeFiles/parmetis.dir/rmetis.c.o [ 78%] Building C object libparmetis/CMakeFiles/parmetis.dir/selectq.c.o [ 80%] Building C object libparmetis/CMakeFiles/parmetis.dir/serial.c.o [ 82%] Building C object libparmetis/CMakeFiles/parmetis.dir/stat.c.o [ 85%] Building C object libparmetis/CMakeFiles/parmetis.dir/timer.c.o [ 87%] Building C object libparmetis/CMakeFiles/parmetis.dir/util.c.o [ 90%] Building C object libparmetis/CMakeFiles/parmetis.dir/wave.c.o [ 92%] Building C object libparmetis/CMakeFiles/parmetis.dir/weird.c.o [ 95%] Building C object libparmetis/CMakeFiles/parmetis.dir/wspace.c.o [ 97%] Building C object libparmetis/CMakeFiles/parmetis.dir/xyzpart.c.o [100%] Linking C static library libparmetis.a [100%] Built target parmetis [ 17%] Performing install step for 'parmetis' [100%] Built target parmetis Install the project... -- Install configuration: "Release" -- Installing: /home/mbm/palace/build90/include/parmetis.h -- Installing: /home/mbm/palace/build90/lib/libparmetis.a [ 18%] No test step for 'parmetis' [ 19%] Completed 'parmetis' [ 19%] Built target parmetis [ 19%] Creating directories for 'superlu_dist' [ 20%] Performing download step (git clone) for 'superlu_dist' Cloning into 'superlu_dist'... HEAD is now at 80b7ae1d satisfy MAGMA's new API. Merge remote-tracking branch 'origin/magma_fix' [ 21%] No update step for 'superlu_dist' [ 22%] Performing patch step for 'superlu_dist' [ 22%] Performing configure step for 'superlu_dist' -- The C compiler identification is GNU 12.2.0 -- The CXX compiler identification is GNU 12.2.0 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/gcc - skipped -- Detecting C compile features -- Detecting C compile features - done -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /orcd/software/core/001/spack/pkg/gcc/12.2.0/yt6vabm/bin/g++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done -- SuperLU_DIST will be built as a static library. -- Found MPI_C: /orcd/software/community/001/pkg/openmpi/5.0.6/lib/libmpi.so (found version "3.1") -- Found MPI_CXX: /orcd/software/community/001/pkg/openmpi/5.0.6/lib/libmpi.so (found version "3.1") -- Found MPI: TRUE (found version "3.1") -- Found BLAS: /orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so;-lm -- Using TPL_BLAS_LIBRARIES='/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so;-lm' -- Found LAPACK: /orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so;-lm -- Using TPL_LAPACK_LIBRARIES='/orcd/software/core/001/spack/pkg/openblas/0.3.26/ro5tivv/lib/libopenblas.so;-lm' -- Will not link with MAGMA. -- Enabled support for PARMETIS. -- Will not link with COLAMD. -- Will not link with CombBLAS. -- EXTRA_LIB_EXPORT='-lgcc_s -lgcc -lc -lgcc_s -lgcc ' -- Configuring done (5.3s) -- Generating done (0.4s) -- Build files have been written to: /home/mbm/palace/build90/extern/superlu_dist-build [ 23%] Performing build step for 'superlu_dist' [ 0%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/sp_ienv.c.o [ 0%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/etree.c.o [ 1%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/sp_colorder.c.o [ 1%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/get_perm_c.c.o [ 2%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/mmd.c.o [ 2%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/comm.c.o [ 3%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/memory.c.o [ 3%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/util.c.o [ 4%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/gpu_api_utils.c.o [ 4%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/superlu_grid.c.o [ 5%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/pxerr_dist.c.o [ 5%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/superlu_timer.c.o [ 6%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/symbfact.c.o [ 6%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/ilu_level_symbfact.c.o [ 7%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/psymbfact.c.o [ 7%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/psymbfact_util.c.o [ 8%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/get_perm_c_parmetis.c.o [ 8%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/mc64ad_dist.c.o [ 9%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/xerr_dist.c.o [ 9%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/smach_dist.c.o [ 10%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/dmach_dist.c.o [ 10%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/superlu_dist_version.c.o [ 11%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/comm_tree.c.o [ 11%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/superlu_grid3d.c.o [ 12%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/supernodal_etree.c.o [ 12%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/supernodalForest.c.o [ 13%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/trfAux.c.o [ 13%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/communication_aux.c.o [ 14%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/treeFactorization.c.o [ 14%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/sec_structs.c.o [ 15%] Building C object SRC/CMakeFiles/superlu_dist.dir/prec-independent/get_perm_c_batch.c.o [ 15%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dsuperlu_blas.c.o [ 16%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/ssuperlu_blas.c.o [ 16%] Building C object SRC/CMakeFiles/superlu_dist.dir/complex16/zsuperlu_blas.c.o [ 16%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dlangs_dist.c.o [ 17%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dgsequ_dist.c.o [ 17%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dlaqgs_dist.c.o [ 18%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dutil_dist.c.o [ 18%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dmemory_dist.c.o [ 19%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dmyblas2_dist.c.o [ 19%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dsp_blas2_dist.c.o [ 20%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dsp_blas3_dist.c.o [ 20%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgssvx.c.o [ 21%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgssvx_ABglobal.c.o [ 21%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dreadhb.c.o [ 22%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dreadrb.c.o [ 22%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dreadtriple.c.o [ 23%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dreadtriple_noheader.c.o [ 23%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dbinary_io.c.o [ 24%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dreadMM.c.o [ 24%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgsequ.c.o [ 25%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdlaqgs.c.o [ 25%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dldperm_dist.c.o [ 26%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdlangs.c.o [ 26%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdutil.c.o [ 27%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdsymbfact_distdata.c.o [ 27%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/ddistribute.c.o [ 28%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pddistribute.c.o [ 28%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pddistribute3d.c.o [ 29%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/d3DPartition.c.o /home/mbm/palace/build90/extern/superlu_dist/SRC/double/d3DPartition.c: In function 'dnewTrfPartitionInit': /home/mbm/palace/build90/extern/superlu_dist/SRC/double/d3DPartition.c:147:73: warning: trigraph ??) ignored, use -trigraphs to enable [-Wtrigraphs] 147 | gemmCsizes[offset] = SUPERLU_MAX(ldts[offset], ???); | /home/mbm/palace/build90/extern/superlu_dist/SRC/double/d3DPartition.c: In function 'dbcastPermutedSparseA': /home/mbm/palace/build90/extern/superlu_dist/SRC/double/d3DPartition.c:340:39: warning: dereferencing 'void *' pointer 340 | MPI_Bcast( &(Astore->nzval[idx]), count*sizeof(double), MPI_BYTE, 0, grid3d->zscp.comm); | ^ [ 29%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/distCheckArray.c.o [ 30%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pddistribute-aux3d.c.o [ 30%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgstrf.c.o [ 31%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dstatic_schedule.c.o [ 31%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgstrf2.c.o [ 32%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgstrs.c.o [ 32%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgstrs3d.c.o [ 33%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgstrs1.c.o [ 33%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgstrs_lsum.c.o [ 33%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgstrs_Bglobal.c.o [ 34%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgsrfs.c.o [ 34%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgsmv.c.o [ 35%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgsrfs_ABXglobal.c.o [ 35%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgsmv_AXglobal.c.o [ 36%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdGetDiagU.c.o [ 36%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgssvx3d.c.o [ 37%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dssvx3dAux.c.o [ 37%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dnrformat_loc3d.c.o [ 38%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgstrf3d.c.o [ 38%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dtreeFactorization.c.o [ 39%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dtreeFactorizationGPU.c.o [ 39%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dgather.c.o [ 40%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dscatter3d.c.o [ 40%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pd3dcomm.c.o [ 41%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dtrfAux.c.o /home/mbm/palace/build90/extern/superlu_dist/SRC/double/dtrfAux.c:722:73: warning: trigraph ??) ignored, use -trigraphs to enable [-Wtrigraphs] 722 | gemmCsizes[offset] = SUPERLU_MAX(ldts[offset], ???); | /home/mbm/palace/build90/extern/superlu_dist/SRC/double/dtrfAux.c:906:73: warning: trigraph ??) ignored, use -trigraphs to enable [-Wtrigraphs] 906 | gemmCsizes[offset] = SUPERLU_MAX(ldts[offset], ???); | /home/mbm/palace/build90/extern/superlu_dist/SRC/double/dtrfAux.c:1092:73: warning: trigraph ??) ignored, use -trigraphs to enable [-Wtrigraphs] 1092 | gemmCsizes[offset] = SUPERLU_MAX(ldts[offset], ???); | [ 41%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dcommunication_aux.c.o [ 42%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dtrfCommWrapper.c.o [ 42%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/pdgssvx3d_csc_batch.c.o [ 43%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dequil_batch.c.o [ 43%] Building C object SRC/CMakeFiles/superlu_dist.dir/double/dpivot_batch.c.o [ 44%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/slangs_dist.c.o [ 44%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sgsequ_dist.c.o [ 45%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/slaqgs_dist.c.o [ 45%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sutil_dist.c.o [ 46%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/smemory_dist.c.o [ 46%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/smyblas2_dist.c.o [ 47%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/ssp_blas2_dist.c.o [ 47%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/ssp_blas3_dist.c.o [ 48%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgssvx.c.o [ 48%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgssvx_d2.c.o [ 49%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgssvx_ABglobal.c.o [ 49%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sreadhb.c.o [ 50%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sreadrb.c.o [ 50%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sreadtriple.c.o [ 50%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sreadtriple_noheader.c.o [ 51%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sbinary_io.c.o [ 51%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sreadMM.c.o [ 52%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgsequ.c.o [ 52%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/pslaqgs.c.o [ 53%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sldperm_dist.c.o [ 53%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/pslangs.c.o [ 54%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psutil.c.o [ 54%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/pssymbfact_distdata.c.o [ 55%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sdistribute.c.o [ 55%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psdistribute.c.o [ 56%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psdistribute3d.c.o [ 56%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/s3DPartition.c.o /home/mbm/palace/build90/extern/superlu_dist/SRC/single/s3DPartition.c: In function 'snewTrfPartitionInit': /home/mbm/palace/build90/extern/superlu_dist/SRC/single/s3DPartition.c:147:73: warning: trigraph ??) ignored, use -trigraphs to enable [-Wtrigraphs] 147 | gemmCsizes[offset] = SUPERLU_MAX(ldts[offset], ???); | /home/mbm/palace/build90/extern/superlu_dist/SRC/single/s3DPartition.c: In function 'sbcastPermutedSparseA': /home/mbm/palace/build90/extern/superlu_dist/SRC/single/s3DPartition.c:339:39: warning: dereferencing 'void *' pointer 339 | MPI_Bcast( &(Astore->nzval[idx]), count*sizeof(float), MPI_BYTE, 0, grid3d->zscp.comm); | ^ [ 57%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psdistribute-aux3d.c.o [ 57%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgstrf.c.o [ 58%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sstatic_schedule.c.o [ 58%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgstrf2.c.o [ 59%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgstrs.c.o [ 59%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgstrs3d.c.o [ 60%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgstrs1.c.o [ 60%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgstrs_lsum.c.o [ 61%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgstrs_Bglobal.c.o [ 61%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgsrfs.c.o [ 62%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgsrfs_d2.c.o [ 62%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgsmv.c.o [ 63%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgsrfs_ABXglobal.c.o [ 63%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgsmv_AXglobal.c.o [ 64%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psGetDiagU.c.o [ 64%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgssvx3d.c.o [ 65%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sssvx3dAux.c.o [ 65%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/snrformat_loc3d.c.o [ 66%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgstrf3d.c.o [ 66%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/streeFactorization.c.o [ 66%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/streeFactorizationGPU.c.o [ 67%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sgather.c.o [ 67%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sscatter3d.c.o [ 68%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/ps3dcomm.c.o [ 68%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/strfAux.c.o /home/mbm/palace/build90/extern/superlu_dist/SRC/single/strfAux.c:721:73: warning: trigraph ??) ignored, use -trigraphs to enable [-Wtrigraphs] 721 | gemmCsizes[offset] = SUPERLU_MAX(ldts[offset], ???); | /home/mbm/palace/build90/extern/superlu_dist/SRC/single/strfAux.c:905:73: warning: trigraph ??) ignored, use -trigraphs to enable [-Wtrigraphs] 905 | gemmCsizes[offset] = SUPERLU_MAX(ldts[offset], ???); | /home/mbm/palace/build90/extern/superlu_dist/SRC/single/strfAux.c:1091:73: warning: trigraph ??) ignored, use -trigraphs to enable [-Wtrigraphs] 1091 | gemmCsizes[offset] = SUPERLU_MAX(ldts[offset], ???); | [ 69%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/scommunication_aux.c.o [ 69%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/strfCommWrapper.c.o [ 70%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgsmv_d2.c.o [ 70%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgsequb.c.o [ 71%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/psgssvx3d_csc_batch.c.o [ 71%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/sequil_batch.c.o [ 72%] Building C object SRC/CMakeFiles/superlu_dist.dir/single/spivot_batch.c.o [ 72%] Building C object SRC/CMakeFiles/superlu_dist.dir/complex16/dcomplex_dist.c.o [ 73%] Building C object SRC/CMakeFiles/superlu_dist.dir/complex16/zlangs_dist.c.o [ 73%] Building C object SRC/CMakeFiles/superlu_dist.dir/complex16/zgsequ_dist.c.o [ 74%] Building C object SRC/CMakeFiles/superlu_dist.dir/complex16/zlaqgs_dist.c.o [ 74%] Building C object SRC/CMakeFiles/superlu_dist.dir/complex16/zutil_dist.c.o [ 75%] Building C object SRC/CMakeFiles/superlu_dist.dir/complex16/zmemory_dist.c.o [ 75%] Building C object SRC/CMakeFiles/superlu_dist.dir/complex16/zmyblas2_dist.c.o [ 76%] Building C object SRC/CMakeFiles/superlu_dist.dir/complex16/zsp_blas2_dist.c.o [ 76%] Building C object SRC/CMakeFiles/superlu_dist.dir/complex16/zsp_blas3_dist.c.o [ 77%] Building C object SRC/CMakeFiles/superlu_dist.dir/complex16/pzgssvx.c.o [ 77%] Building C object SRC/CMakeFiles/superlu_dist.dir/complex16/pzgssvx_ABglobal.c.o [ 78%] Building C object SRC/CMakeFiles/supe

[hughcars]

Hi @mmcilrath,

I am not seeing any attached files, there is a clipped text quote. Maybe they failed to upload?