Build Errors

[dhirschfeld]

Documenting problems building when following the instructions at:
https://github.com/apache/arrow/blob/master/python/doc/source/development.rst#developing-on-windows

[dhirschfeld]

$env:ARROW_HOME='C:\dev\lib'
$env:ARROW_BUILD_TOOLCHAIN='C:\Miniconda3\Library'

cmake -G "Visual Studio 14 2015 Win64" `
      -DCMAKE_INSTALL_PREFIX="$env:ARROW_HOME" `
      -DCMAKE_BUILD_TYPE=Release `
      -DARROW_BUILD_TESTS=on `
      -DARROW_CXXFLAGS="/WX" `
      -DARROW_PYTHON=on ..

Missing GFLAGS_INCLUDE_DIR environment variable

λ cmake -G "Visual Studio 14 2015 Win64" `
>>       -DCMAKE_INSTALL_PREFIX=%ARROW_HOME% `
>>       -DCMAKE_BUILD_TYPE=Release `
>>       -DARROW_BUILD_TESTS=on `
>>       -DARROW_CXXFLAGS="/WX" `
>>       -DARROW_PYTHON=on ..
>>
clang-tidy not found
clang-format not found
infer not found
INFOCompiler command: C:/Program Files (x86)/Microsoft Visual Studio 14.0/VC/bin/x86_amd64/cl.exe
INFOCompiler version:
INFOCompiler id: MSVC
Selected compiler msvc
Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
-- Build Type: RELEASE
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1059 ] _boost_TEST_VERSIONS = 1.65.0;1.65;1.64.0;1.64;1.63.0;1.63;1.62.0;1.61;1.61.0;1.62;1.60.0;1.60;1.65.1;1.65.0;1.65;1.64.0;1.64;1.63.0;1.63;1.62.0;1.62;1.61.0;1.61;1.60.0;1.60;1.59.0;1.59;1.58.0;1.58;1.57.0;1.57;1.56.0;1.56;1.55.0;1.55;1.54.0;1.54;1.53.0;1.53;1.52.0;1.52;1.51.0;1.51;1.50.0;1.50;1.49.0;1.49;1.48.0;1.48;1.47.0;1.47;1.46.1;1.46.0;1.46;1.45.0;1.45;1.44.0;1.44;1.43.0;1.43;1.42.0;1.42;1.41.0;1.41;1.40.0;1.40;1.39.0;1.39;1.38.0;1.38;1.37.0;1.37;1.36.1;1.36.0;1.36;1.35.1;1.35.0;1.35;1.34.1;1.34.0;1.34;1.33.1;1.33.0;1.33
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1061 ] Boost_USE_MULTITHREADED = ON
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1063 ] Boost_USE_STATIC_LIBS = OFF
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1065 ] Boost_USE_STATIC_RUNTIME =
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1067 ] Boost_ADDITIONAL_VERSIONS = 1.65.0;1.65;1.64.0;1.64;1.63.0;1.63;1.62.0;1.61;1.61.0;1.62;1.60.0;1.60
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1069 ] Boost_NO_SYSTEM_PATHS =
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1137 ] Declared as CMake or Environmental Variables:
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1139 ]   BOOST_ROOT =
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1141 ]   BOOST_INCLUDEDIR =
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1143 ]   BOOST_LIBRARYDIR =
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1145 ] _boost_TEST_VERSIONS = 1.65.0;1.65;1.64.0;1.64;1.63.0;1.63;1.62.0;1.61;1.61.0;1.62;1.60.0;1.60;1.65.1;1.65.0;1.65;1.64.0;1.64;1.63.0;1.63;1.62.0;1.62;1.61.0;1.61;1.60.0;1.60;1.59.0;1.59;1.58.0;1.58;1.57.0;1.57;1.56.0;1.56;1.55.0;1.55;1.54.0;1.54;1.53.0;1.53;1.52.0;1.52;1.51.0;1.51;1.50.0;1.50;1.49.0;1.49;1.48.0;1.48;1.47.0;1.47;1.46.1;1.46.0;1.46;1.45.0;1.45;1.44.0;1.44;1.43.0;1.43;1.42.0;1.42;1.41.0;1.41;1.40.0;1.40;1.39.0;1.39;1.38.0;1.38;1.37.0;1.37;1.36.1;1.36.0;1.36;1.35.1;1.35.0;1.35;1.34.1;1.34.0;1.34;1.33.1;1.33.0;1.33
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1244 ] location of version.hpp: C:/Miniconda3/Library/include/boost/version.hpp
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1268 ] version.hpp reveals boost 1.65.1
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1354 ] guessed _boost_COMPILER = -vc140
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1364 ] _boost_MULTITHREADED = -mt
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1408 ] _boost_RELEASE_ABI_TAG = -
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1410 ] _boost_DEBUG_ABI_TAG = -gd
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1472 ] _boost_LIBRARY_SEARCH_DIRS_RELEASE = C:/Miniconda3/Library/lib;NO_DEFAULT_PATH;NO_CMAKE_FIND_ROOT_PATH_boost_LIBRARY_SEARCH_DIRS_DEBUG   = C:/dev/lib/boost/boost_1_61_0/lib/x64;C:/dev/lib/boost/boost_1_61_0/lib;C:/dev/lib/boost/boost_1_61_0/stage/lib;C:/dev/lib/boost/boost_1_61_0/lib64-msvc-14.0;C:/Miniconda3/Library/include/lib;C:/Miniconda3/Library/include/../lib;C:/Miniconda3/Library/include/stage/lib;C:/Miniconda3/Library/include/../lib64-msvc-14.0;C:/local/boost_1_65_0/lib64-msvc-14.0;C:/local/boost_1_65/lib64-msvc-14.0;C:/local/boost_1_64_0/lib64-msvc-14.0;C:/local/boost_1_64/lib64-msvc-14.0;C:/local/boost_1_63_0/lib64-msvc-14.0;C:/local/boost_1_63/lib64-msvc-14.0;C:/local/boost_1_62_0/lib64-msvc-14.0;C:/local/boost_1_61/lib64-msvc-14.0;C:/local/boost_1_61_0/lib64-msvc-14.0;C:/local/boost_1_62/lib64-msvc-14.0;C:/local/boost_1_60_0/lib64-msvc-14.0;C:/local/boost_1_60/lib64-msvc-14.0;C:/local/boost_1_65_1/lib64-msvc-14.0;C:/local/boost_1_65_0/lib64-msvc-14.0;C:/local/boost_1_65/lib64-msvc-14.0;C:/local/boost_1_64_0/lib64-msvc-14.0;C:/local/boost_1_64/lib64-msvc-14.0;C:/local/boost_1_63_0/lib64-msvc-14.0;C:/local/boost_1_63/lib64-msvc-14.0;C:/local/boost_1_62_0/lib64-msvc-14.0;C:/local/boost_1_62/lib64-msvc-14.0;C:/local/boost_1_61_0/lib64-msvc-14.0;C:/local/boost_1_61/lib64-msvc-14.0;C:/local/boost_1_60_0/lib64-msvc-14.0;C:/local/boost_1_60/lib64-msvc-14.0;C:/local/boost_1_59_0/lib64-msvc-14.0;C:/local/boost_1_59/lib64-msvc-14.0;C:/local/boost_1_58_0/lib64-msvc-14.0;C:/local/boost_1_58/lib64-msvc-14.0;C:/local/boost_1_57_0/lib64-msvc-14.0;C:/local/boost_1_57/lib64-msvc-14.0;C:/local/boost_1_56_0/lib64-msvc-14.0;C:/local/boost_1_56/lib64-msvc-14.0;C:/local/boost_1_55_0/lib64-msvc-14.0;C:/local/boost_1_55/lib64-msvc-14.0;C:/local/boost_1_54_0/lib64-msvc-14.0;C:/local/boost_1_54/lib64-msvc-14.0;C:/local/boost_1_53_0/lib64-msvc-14.0;C:/local/boost_1_53/lib64-msvc-14.0;C:/local/boost_1_52_0/lib64-msvc-14.0;C:/local/boost_1_52/lib64-msvc-14.0;C:/local/boost_1_51_0/lib64-msvc-14.0;C:/local/boost_1_51/lib64-msvc-14.0;C:/local/boost_1_50_0/lib64-msvc-14.0;C:/local/boost_1_50/lib64-msvc-14.0;C:/local/boost_1_49_0/lib64-msvc-14.0;C:/local/boost_1_49/lib64-msvc-14.0;C:/local/boost_1_48_0/lib64-msvc-14.0;C:/local/boost_1_48/lib64-msvc-14.0;C:/local/boost_1_47_0/lib64-msvc-14.0;C:/local/boost_1_47/lib64-msvc-14.0;C:/local/boost_1_46_1/lib64-msvc-14.0;C:/local/boost_1_46_0/lib64-msvc-14.0;C:/local/boost_1_46/lib64-msvc-14.0;C:/local/boost_1_45_0/lib64-msvc-14.0;C:/local/boost_1_45/lib64-msvc-14.0;C:/local/boost_1_44_0/lib64-msvc-14.0;C:/local/boost_1_44/lib64-msvc-14.0;C:/local/boost_1_43_0/lib64-msvc-14.0;C:/local/boost_1_43/lib64-msvc-14.0;C:/local/boost_1_42_0/lib64-msvc-14.0;C:/local/boost_1_42/lib64-msvc-14.0;C:/local/boost_1_41_0/lib64-msvc-14.0;C:/local/boost_1_41/lib64-msvc-14.0;C:/local/boost_1_40_0/lib64-msvc-14.0;C:/local/boost_1_40/lib64-msvc-14.0;C:/local/boost_1_39_0/lib64-msvc-14.0;C:/local/boost_1_39/lib64-msvc-14.0;C:/local/boost_1_38_0/lib64-msvc-14.0;C:/local/boost_1_38/lib64-msvc-14.0;C:/local/boost_1_37_0/lib64-msvc-14.0;C:/local/boost_1_37/lib64-msvc-14.0;C:/local/boost_1_36_1/lib64-msvc-14.0;C:/local/boost_1_36_0/lib64-msvc-14.0;C:/local/boost_1_36/lib64-msvc-14.0;C:/local/boost_1_35_1/lib64-msvc-14.0;C:/local/boost_1_35_0/lib64-msvc-14.0;C:/local/boost_1_35/lib64-msvc-14.0;C:/local/boost_1_34_1/lib64-msvc-14.0;C:/local/boost_1_34_0/lib64-msvc-14.0;C:/local/boost_1_34/lib64-msvc-14.0;C:/local/boost_1_33_1/lib64-msvc-14.0;C:/local/boost_1_33_0/lib64-msvc-14.0;C:/local/boost_1_33/lib64-msvc-14.0;C:/boost/lib64-msvc-14.0;PATHS;C:/boost/lib;C:/boost;/sw/local/lib
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1618 ] Searching for SYSTEM_LIBRARY_RELEASE: boost_system-vc140-mt-1_65_1;boost_system-vc140-mt;boost_system-mt-1_65_1;boost_system-mt;boost_system
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:365 ]  Boost_LIBRARY_DIR_RELEASE = C:/Miniconda3/Library/lib _boost_LIBRARY_SEARCH_DIRS_RELEASE = C:/Miniconda3/Library/lib;NO_DEFAULT_PATH;NO_CMAKE_FIND_ROOT_PATH
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1667 ] Searching for SYSTEM_LIBRARY_DEBUG: boost_system-vc140-mt-gd-1_65_1;boost_system-vc140-mt-gd;boost_system-mt-gd-1_65_1;boost_system-mt-gd;boost_system-mt;boost_system
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1618 ] Searching for FILESYSTEM_LIBRARY_RELEASE: boost_filesystem-vc140-mt-1_65_1;boost_filesystem-vc140-mt;boost_filesystem-mt-1_65_1;boost_filesystem-mt;boost_filesystem
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:365 ]  Boost_LIBRARY_DIR_RELEASE = C:/Miniconda3/Library/lib _boost_LIBRARY_SEARCH_DIRS_RELEASE = C:/Miniconda3/Library/lib;NO_DEFAULT_PATH;NO_CMAKE_FIND_ROOT_PATH
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1667 ] Searching for FILESYSTEM_LIBRARY_DEBUG: boost_filesystem-vc140-mt-gd-1_65_1;boost_filesystem-vc140-mt-gd;boost_filesystem-mt-gd-1_65_1;boost_filesystem-mt-gd;boost_filesystem-mt;boost_filesystem
-- [ C:/Miniconda3/Library/share/cmake-3.9/Modules/FindBoost.cmake:1740 ] Boost_FOUND = 1
-- Boost version: 1.65.1
-- Found the following Boost libraries:
--   system
--   filesystem
-- Boost include dir: C:/Miniconda3/Library/include
-- Boost libraries: C:/Miniconda3/Library/lib/boost_system-vc140-mt-1_65_1.libC:/Miniconda3/Library/lib/boost_filesystem-vc140-mt-1_65_1.lib
Added shared library dependency boost_system: C:/Miniconda3/Library/lib/boost_system-vc140-mt-1_65_1.lib
Added shared library dependency boost_filesystem: C:/Miniconda3/Library/lib/boost_filesystem-vc140-mt-1_65_1.lib
-- GTest include dir: C:/dev/src/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/include
-- GTest static library: C:/dev/src/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/lib/gtest.lib
Added static library dependency gtest: C:/dev/src/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/lib/gtest.lib
Added static library dependency gtest_main: C:/dev/src/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/lib/gtest_main.lib
-- Could NOT find GFLAGS (missing: GFLAGS_SHARED_LIB GFLAGS_STATIC_LIB GFLAGS_INCLUDE_DIR)
-- GFlags include dir: GFLAGS_INCLUDE_DIR-NOTFOUND
-- GFlags static library: GFLAGS_STATIC_LIB-NOTFOUND
CMake Error at cmake_modules/BuildUtils.cmake:88 (message):
  No static or shared library provided for gflags
Call Stack (most recent call first):
  cmake_modules/ThirdpartyToolchain.cmake:339 (ADD_THIRDPARTY_LIB)
  CMakeLists.txt:264 (include)


CMake Error: The following variables are used in this project, but they are set to NOTFOUND.
Please set them or make sure they are set and tested correctly in the CMake files:
GFLAGS_INCLUDE_DIR
   used as include directory in directory C:/dev/src/arrow/cpp
   used as include directory in directory C:/dev/src/arrow/cpp
   used as include directory in directory C:/dev/src/arrow/cpp
   used as include directory in directory C:/dev/src/arrow/cpp

-- Configuring incomplete, errors occurred!
See also "C:/dev/src/arrow/cpp/build/CMakeFiles/CMakeOutput.log".
See also "C:/dev/src/arrow/cpp/build/CMakeFiles/CMakeError.log".

After running

conda install gflags lz4-c zstd

I then get another error:

Missing GFLAGS_STATIC_LIB

λ cmake -G "Visual Studio 14 2015 Win64" `
>>       -DCMAKE_INSTALL_PREFIX=%ARROW_HOME% `
>>       -DCMAKE_BUILD_TYPE=Release `
>>       -DARROW_BUILD_TESTS=on `
>>       -DARROW_CXXFLAGS="/WX" `
>>       -DARROW_PYTHON=on ..
>>
clang-tidy not found
clang-format not found
infer not found
INFOCompiler command: C:/Program Files (x86)/Microsoft Visual Studio 14.0/VC/bin/x86_amd64/cl.exe
INFOCompiler version:
INFOCompiler id: MSVC
Selected compiler msvc
Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
-- Build Type: RELEASE
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:946 ] _boost_TEST_VERSIONS = 1.65.0;1.65;1.64.0;1.64;1.63.0;1.63;1.62.0;1.61;1.61.0;1.62;1.60.0;1.60;1.61.0;1.61;1.60.0;1.60;1.59.0;1.59;1.58.0;1.58;1.57.0;1.57;1.56.0;1.56;1.55.0;1.55;1.54.0;1.54;1.53.0;1.53;1.52.0;1.52;1.51.0;1.51;1.50.0;1.50;1.49.0;1.49;1.48.0;1.48;1.47.0;1.47;1.46.1;1.46.0;1.46;1.45.0;1.45;1.44.0;1.44;1.43.0;1.43;1.42.0;1.42;1.41.0;1.41;1.40.0;1.40;1.39.0;1.39;1.38.0;1.38;1.37.0;1.37;1.36.1;1.36.0;1.36;1.35.1;1.35.0;1.35;1.34.1;1.34.0;1.34;1.33.1;1.33.0;1.33
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:948 ] Boost_USE_MULTITHREADED = ON
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:950 ] Boost_USE_STATIC_LIBS = OFF
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:952 ] Boost_USE_STATIC_RUNTIME =
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:954 ] Boost_ADDITIONAL_VERSIONS = 1.65.0;1.65;1.64.0;1.64;1.63.0;1.63;1.62.0;1.61;1.61.0;1.62;1.60.0;1.60
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:956 ] Boost_NO_SYSTEM_PATHS =
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1024 ] Declared as CMake or Environmental Variables:
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1026 ]   BOOST_ROOT =
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1028 ]   BOOST_INCLUDEDIR =
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1030 ]   BOOST_LIBRARYDIR =
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1032 ] _boost_TEST_VERSIONS = 1.65.0;1.65;1.64.0;1.64;1.63.0;1.63;1.62.0;1.61;1.61.0;1.62;1.60.0;1.60;1.61.0;1.61;1.60.0;1.60;1.59.0;1.59;1.58.0;1.58;1.57.0;1.57;1.56.0;1.56;1.55.0;1.55;1.54.0;1.54;1.53.0;1.53;1.52.0;1.52;1.51.0;1.51;1.50.0;1.50;1.49.0;1.49;1.48.0;1.48;1.47.0;1.47;1.46.1;1.46.0;1.46;1.45.0;1.45;1.44.0;1.44;1.43.0;1.43;1.42.0;1.42;1.41.0;1.41;1.40.0;1.40;1.39.0;1.39;1.38.0;1.38;1.37.0;1.37;1.36.1;1.36.0;1.36;1.35.1;1.35.0;1.35;1.34.1;1.34.0;1.34;1.33.1;1.33.0;1.33
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1125 ] location of version.hpp: C:/Miniconda3/Library/include/boost/version.hpp
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1149 ] version.hpp reveals boost 1.65.1
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1235 ] guessed _boost_COMPILER = -vc140
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1245 ] _boost_MULTITHREADED = -mt
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1288 ] _boost_RELEASE_ABI_TAG = -
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1290 ] _boost_DEBUG_ABI_TAG = -gd
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1344 ] _boost_LIBRARY_SEARCH_DIRS_RELEASE = C:/Miniconda3/Library/lib;NO_DEFAULT_PATH;NO_CMAKE_FIND_ROOT_PATH_boost_LIBRARY_SEARCH_DIRS_DEBUG   = C:/dev/lib/boost/boost_1_61_0/lib/x64;C:/dev/lib/boost/boost_1_61_0/lib;C:/dev/lib/boost/boost_1_61_0/stage/lib;C:/Miniconda3/Library/include/lib;C:/Miniconda3/Library/include/../lib;C:/Miniconda3/Library/include/stage/lib;PATHS;C:/boost/lib;C:/boost;/sw/local/lib
CMake Warning at C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:743 (message):
  Imported targets not available for Boost version 106501
Call Stack (most recent call first):
  C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:842 (_Boost_COMPONENT_DEPENDENCIES)
  C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1395 (_Boost_MISSING_DEPENDENCIES)
  cmake_modules/ThirdpartyToolchain.cmake:205 (find_package)
  CMakeLists.txt:264 (include)


CMake Warning at C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:743 (message):
  Imported targets not available for Boost version 106501
Call Stack (most recent call first):
  C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:842 (_Boost_COMPONENT_DEPENDENCIES)
  C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1395 (_Boost_MISSING_DEPENDENCIES)
  cmake_modules/ThirdpartyToolchain.cmake:205 (find_package)
  CMakeLists.txt:264 (include)


-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1483 ] Searching for SYSTEM_LIBRARY_RELEASE: boost_system-vc140-mt-1_65_1;boost_system-vc140-mt;boost_system-mt-1_65_1;boost_system-mt;boost_system
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:378 ]  Boost_LIBRARY_DIR_RELEASE = C:/Miniconda3/Library/lib _boost_LIBRARY_SEARCH_DIRS_RELEASE = C:/Miniconda3/Library/lib;NO_DEFAULT_PATH;NO_CMAKE_FIND_ROOT_PATH
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1525 ] Searching for SYSTEM_LIBRARY_DEBUG: boost_system-vc140-mt-gd-1_65_1;boost_system-vc140-mt-gd;boost_system-mt-gd-1_65_1;boost_system-mt-gd;boost_system-mt;boost_system
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1483 ] Searching for FILESYSTEM_LIBRARY_RELEASE: boost_filesystem-vc140-mt-1_65_1;boost_filesystem-vc140-mt;boost_filesystem-mt-1_65_1;boost_filesystem-mt;boost_filesystem
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:378 ]  Boost_LIBRARY_DIR_RELEASE = C:/Miniconda3/Library/lib _boost_LIBRARY_SEARCH_DIRS_RELEASE = C:/Miniconda3/Library/lib;NO_DEFAULT_PATH;NO_CMAKE_FIND_ROOT_PATH
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1525 ] Searching for FILESYSTEM_LIBRARY_DEBUG: boost_filesystem-vc140-mt-gd-1_65_1;boost_filesystem-vc140-mt-gd;boost_filesystem-mt-gd-1_65_1;boost_filesystem-mt-gd;boost_filesystem-mt;boost_filesystem
-- [ C:/Miniconda3/Library/share/cmake-3.6/Modules/FindBoost.cmake:1595 ] Boost_FOUND = 1
-- Boost version: 1.65.1
-- Found the following Boost libraries:
--   system
--   filesystem
-- Boost include dir: C:/Miniconda3/Library/include
-- Boost libraries: C:/Miniconda3/Library/lib/boost_system-vc140-mt-1_65_1.libC:/Miniconda3/Library/lib/boost_filesystem-vc140-mt-1_65_1.lib
Added shared library dependency boost_system: C:/Miniconda3/Library/lib/boost_system-vc140-mt-1_65_1.lib
Added shared library dependency boost_filesystem: C:/Miniconda3/Library/lib/boost_filesystem-vc140-mt-1_65_1.lib
-- GTest include dir: C:/dev/src/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/include
-- GTest static library: C:/dev/src/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/lib/gtest.lib
Added static library dependency gtest: C:/dev/src/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/lib/gtest.lib
Added static library dependency gtest_main: C:/dev/src/arrow/cpp/build/googletest_ep-prefix/src/googletest_ep/lib/gtest_main.lib
-- Could NOT find GFLAGS (missing:  GFLAGS_STATIC_LIB)
-- GFlags include dir: C:/Miniconda3/Library/include
-- GFlags static library: GFLAGS_STATIC_LIB-NOTFOUND
CMake Error at cmake_modules/BuildUtils.cmake:88 (message):
  No static or shared library provided for gflags
Call Stack (most recent call first):
  cmake_modules/ThirdpartyToolchain.cmake:339 (ADD_THIRDPARTY_LIB)
  CMakeLists.txt:264 (include)


-- Configuring incomplete, errors occurred!
See also "C:/dev/src/arrow/cpp/build/CMakeFiles/CMakeOutput.log".
See also "C:/dev/src/arrow/cpp/build/CMakeFiles/CMakeError.log".

Looks like it's looking for a gflags_static.lib file:

arrow/cpp/cmake_modules/ThirdpartyToolchain.cmake

Lines 309 to 313 in a6a97a9

	if(MSVC)
	set(GFLAGS_STATIC_LIB "${GFLAGS_PREFIX}/lib/gflags_static.lib")
	else()
	set(GFLAGS_STATIC_LIB "${GFLAGS_PREFIX}/lib/libgflags.a")
	endif()

...but there's no such file in the conda gflags package. Perhaps a naming issue?

The obvious patch:

@@ -307,7 +307,7 @@ if(ARROW_BUILD_TESTS OR ARROW_BUILD_BENCHMARKS)
     set(GFLAGS_HOME "${GFLAGS_PREFIX}")
     set(GFLAGS_INCLUDE_DIR "${GFLAGS_PREFIX}/include")
     if(MSVC)
-      set(GFLAGS_STATIC_LIB "${GFLAGS_PREFIX}/lib/gflags_static.lib")
+      set(GFLAGS_STATIC_LIB "${GFLAGS_PREFIX}/lib/gflags.lib")
     else()
       set(GFLAGS_STATIC_LIB "${GFLAGS_PREFIX}/lib/libgflags.a")
     endif()

didn't work because the GFLAGS_HOME is set to the $env:ARROW_BUILD_TOOLCHAIN so it skips that branch entirely.

The logic seems busted?

  if("${GFLAGS_HOME}" STREQUAL "")
    <snip>
      # skipped because ${GFLAGS_HOME} = ARROW_BUILD_TOOLCHAIN
    </snip>
  else()
    set(GFLAGS_VENDORED 0)
    find_package(GFlags REQUIRED)
    # GFLAGS_STATIC_LIB never set in this branch!
  endif()

  message(STATUS "GFlags include dir: ${GFLAGS_INCLUDE_DIR}")
  # GFLAGS_STATIC_LIB is assumed to be set which isn't true if the else branch was taken above
  message(STATUS "GFlags static library: ${GFLAGS_STATIC_LIB}")

Forcing the GFLAGS_STATIC_LIB allows the configure to complete - phew!

--- a/cpp/cmake_modules/ThirdpartyToolchain.cmake
+++ b/cpp/cmake_modules/ThirdpartyToolchain.cmake
@@ -333,6 +333,7 @@ if(ARROW_BUILD_TESTS OR ARROW_BUILD_BENCHMARKS)
     find_package(GFlags REQUIRED)
   endif()

+  set(GFLAGS_STATIC_LIB "C:/Miniconda3/Library/lib/gflags.lib")
   message(STATUS "GFlags include dir: ${GFLAGS_INCLUDE_DIR}")
   message(STATUS "GFlags static library: ${GFLAGS_STATIC_LIB}")
   include_directories(SYSTEM ${GFLAGS_INCLUDE_DIR})

And then the actual build works:

cmake --build . --target INSTALL --config Release

Done Building Project "C:\dev\src\arrow\cpp\build\INSTALL.vcxproj" (default targets).


Build succeeded.

"C:\dev\src\arrow\cpp\build\INSTALL.vcxproj" (default target) (1) ->
"C:\dev\src\arrow\cpp\build\ALL_BUILD.vcxproj" (default target) (3) ->
"C:\dev\src\arrow\cpp\build\src\arrow\allocator-test.vcxproj" (default target) (4) ->
"C:\dev\src\arrow\cpp\build\googletest_ep.vcxproj" (default target) (8) ->
(CustomBuild target) ->
  CUSTOMBUILD : CMake warning :  [C:\dev\src\arrow\cpp\build\googletest_ep.vcxproj]


"C:\dev\src\arrow\cpp\build\INSTALL.vcxproj" (default target) (1) ->
"C:\dev\src\arrow\cpp\build\ALL_BUILD.vcxproj" (default target) (3) ->
"C:\dev\src\arrow\cpp\build\src\arrow\python\arrow_python_shared.vcxproj" (default target) (10) ->
"C:\dev\src\arrow\cpp\build\src\arrow\arrow_shared.vcxproj" (default target) (11) ->
(Link target) ->
  LINK : warning LNK4098: defaultlib 'LIBCMT' conflicts with use of other libs; use /NODEFAULTLIB:library [C:\dev\src\arrow\cpp\build\src\arrow\arrow_shared.vcxproj]


"C:\dev\src\arrow\cpp\build\INSTALL.vcxproj" (default target) (1) ->
"C:\dev\src\arrow\cpp\build\ALL_BUILD.vcxproj" (default target) (3) ->
"C:\dev\src\arrow\cpp\build\src\arrow\util\compression-test.vcxproj" (default target) (16) ->
  LINK : warning LNK4098: defaultlib 'LIBCMT' conflicts with use of other libs; use /NODEFAULTLIB:library [C:\dev\src\arrow\cpp\build\src\arrow\util\compression-test.vcxproj]

    3 Warning(s)
    0 Error(s)

Time Elapsed 00:06:15.42

[dhirschfeld]

======= 376 passed, 59 skipped, 2 xfailed, 5 warnings in 34.05 seconds ========

🎉

[xhochy]

I'm wondering a bit why the find_package(GFlags REQUIRED) branch did not work. It should actually search for GFLAGS_STATIC_LIB in
https://github.com/apache/arrow/blob/master/cpp/cmake_modules/FindGFlags.cmake#L63 . The correct suffix is set in https://github.com/apache/arrow/blob/master/cpp/cmake_modules/FindGFlags.cmake#L32-L34

Can you try a clean build after you have installed gflags in your conda env? Might be that it didn't pick it up because some other variable was already pre-filled.

[dhirschfeld]

I'm not sure that suffix is right? I don't think there should be an _static anywhere. As can be seen in the pic above the library is called gflags.lib for me on Windows, with no _static suffix.

[xhochy]

@Maxris can you have a look at this, please?

[maxhora]

@dhirschfeld one of the reasons why _static suffix is expected by default is our preference to use GLAGS (and others 3rd party libs) installed from conda packages. Lib package contains both static and dynamic libraries which reside in the same lib folder. That's why static lib files are named there with suffix _static and dynamic import lib files are without any suffix.
As @xhochy mentioned, you should be able to configure the suffix for your custom build of gflags. Since there is no suffix, it seems you should pass -DGFLAGS_MSVC_STATIC_LIB_SUFFIX="" equal to empty string, so it will be not replaced with _static.

[maxhora]

@dhirschfeld sorry, it seems you are trying to use gflags from conda. It's expected that lib with _static suffix is there, but it isn't.

[maxhora]

Okay, got it, @dhirschfeld you have installed gflags from defaults, but it's expected that you should use gflags from conda-forge channel. Try to install it with:

conda install gflags -c conda-forge

And gflags_static.lib will appear in place. Others 3rd party libs are expected from conda-forge as well.

[maxhora]

It seems https://github.com/apache/arrow/blob/master/cpp/apidoc/Windows.md and https://github.com/apache/arrow/blob/master/python/doc/source/development.rst#developing-on-windows should be updated to have -c conda-forge in cmd

[xhochy]

Make https://issues.apache.org/jira/browse/ARROW-1764 for that, see #1277

[maxhora]

@xhochy thank you!

[dhirschfeld]

Cheers for looking into it! I'd make a big point about it having to be conda-forge as I have it in my channels but below defaults so the command I would have to use would be

conda install --override-channels -c conda-forge gflags

[maxhora]

@dhirschfeld for me just adding of -c conda-forge without --override-channels worked fine to re-install gflags from conda-forge

[dhirschfeld]

It could be that that prepends the channel to the list. I'd have to look closely at it to be sure. I also have channel_priority set to False by default which does affect things.

[maxhora]

@dhirschfeld additionally you always can reference https://github.com/apache/arrow/blob/master/ci/msvc-build.bat#L56 to get an idea what commands are executed to do automatic builds on Windows. For Appveyor build using libs from conda-forge the variable %JOB% is set to "Toolchain".