Merge bitcoin/bitcoin#30454: build: Introduce CMake-based build system

41051290ab cmake: Ignore build subdirectories within source directory (Hennadii Stepanov) 6ce50fd9d0 doc: Update for CMake-based build system (Hennadii Stepanov) 9730288a0c ci: Migrate CI scripts to CMake (Hennadii Stepanov) c360837ca5 cmake, lint: Adjust `lint_includes_build_config` (Hennadii Stepanov) 3885441ee0 cmake: Add presets for native Windows builds (Hennadii Stepanov) 7681746b20 cmake: Add vcpkg manifest file (Hennadii Stepanov) 8b6f1c4353 cmake: Add `Coverage` and `CoverageFuzz` scripts (Hennadii Stepanov) 65bdbc1ff2 cmake: Add `docs` build target (Hennadii Stepanov) fb75ebbc33 cmake: Add compiler diagnostic flags (Hennadii Stepanov) e821f0a37a cmake: Migrate Guix build scripts to CMake (Hennadii Stepanov) 747adb6ffe cmake: Add `Maintenance` module (Hennadii Stepanov) 1f60b30df0 cmake: Add `APPEND_{CPP,C,CXX,LD}FLAGS` cache variables (Hennadii Stepanov) 2b43c45b13 cmake: Add `AddWindowsResources` module (Hennadii Stepanov) 973a3b0c5d cmake: Implement `install` build target (Hennadii Stepanov) 84ac35cfd4 cmake: Add cross-compiling support (Hennadii Stepanov) 0d01c228a7 build: Generate `toolchain.cmake` in depends (Hennadii Stepanov) 91a799247d depends: Add host-specific `cmake_system_version` variables (Hennadii Stepanov) 9b31209b4c depends: Rename `cmake_system` -> `cmake_system_name` (Hennadii Stepanov) 4a5208a81d Revert "build, qt: Do not install *.prl files" (Hennadii Stepanov) 6522af62af depends: Amend handling flags environment variables (Hennadii Stepanov) 90cec4d251 cmake: Add `MULTIPROCESS` option (Hennadii Stepanov) bb1a450dcb cmake: Build `bitcoin-chainstate` executable (Hennadii Stepanov) aed38ea58c cmake: Build `bitcoinkernel` library (Hennadii Stepanov) 975d67369b cmake: Build `test_bitcoin-qt` executable (Hennadii Stepanov) 10fcc668a3 cmake: Add `WITH_DBUS` option (Hennadii Stepanov) 5bb5a4bc75 cmake: Add `libqrencode` optional package support (Hennadii Stepanov) 57a6e2ef4a cmake: Build `bitcoin-qt` executable (Hennadii Stepanov) 30f642952c cmake: Add `WERROR` option (Hennadii Stepanov) c98d4a4c34 cmake: Add `REDUCE_EXPORTS` option (Hennadii Stepanov) a01cb6e63f cmake: Add `HARDENING` option (Hennadii Stepanov) a8a2e364ac cmake: Add Python-based tests (Hennadii Stepanov) 3d85379570 cmake: Add fuzzing options (Hennadii Stepanov) 908530e312 cmake: Add `SANITIZERS` option (Hennadii Stepanov) 8bb0e85631 cmake: Build `bench_bitcoin` executable (Hennadii Stepanov) 801735163a cmake: Add external signer support (Hennadii Stepanov) 353e0c9e96 cmake: Add `systemtap-sdt` optional package support (Hennadii Stepanov) d2fda82b49 cmake: Add `libzmq` optional package support (Hennadii Stepanov) ae7b39a0e1 cmake: Add `libminiupnpc` optional package support (Hennadii Stepanov) 6480e1dcdb cmake: Add `libnatpmp` optional package support (Hennadii Stepanov) e73e9304a1 cmake: Build `bitcoin-util` executable (Hennadii Stepanov) 027c6d7caa cmake: Build `bitcoin-tx` executable (Hennadii Stepanov) d10c5c34c3 cmake: Add wallet functionality (Hennadii Stepanov) ab2e99b0d9 cmake: Create test suite for `ctest` (Hennadii Stepanov) 959370bd76 cmake: Build `test_bitcoin` executable (Hennadii Stepanov) b27bf9700d cmake: Build `bitcoin-cli` executable (Hennadii Stepanov) a9813df826 cmake: Build `bitcoind` executable (Hennadii Stepanov) 97829ce2d5 cmake: Add `FindLibevent` module (Hennadii Stepanov) 3118e40c61 cmake: Build `bitcoin_consensus` library (Hennadii Stepanov) 809a2f1929 cmake: Build `bitcoin_util` static library (Hennadii Stepanov) 0a9a521a70 cmake: Build `bitcoin_crypto` library (Hennadii Stepanov) 958971f476 cmake: Build `univalue` static library (Hennadii Stepanov) 752747fda8 cmake: Generate `obj/build.h` header (Hennadii Stepanov) 1f0a78edf3 cmake: Build `minisketch` static library (Hennadii Stepanov) 12bfbc8154 cmake: Build `leveldb` static library (Hennadii Stepanov) 51985c5304 cmake: Build `crc32c` static library (Hennadii Stepanov) db7a198f29 cmake: Build `secp256k1` subtree (Hennadii Stepanov) dbb7ed14e8 cmake: Add `ccache` support (Hennadii Stepanov) cedfdf6c72 cmake: Redefine/adjust per-configuration flags (Hennadii Stepanov) b6b5e732c8 cmake: Add global compiler and linker flags (Hennadii Stepanov) f98327931b cmake: Add `TryAppendLinkerFlag` module (Hennadii Stepanov) 4a0af29697 cmake: Add `TryAppendCXXFlags` module (Hennadii Stepanov) 35cffc497d cmake: Add POSIX threads support (Hennadii Stepanov) fd72d00ffe cmake: Add position independent code support (Hennadii Stepanov) 07069e2bb0 cmake: Add introspection module (Hennadii Stepanov) 27d687fc1f cmake: Add `config/bitcoin-config.h` support (Hennadii Stepanov) fe5cdace5f cmake: Print compiler and linker flags in summary (Hennadii Stepanov) 70683884c5 cmake: Introduce interface libraries to encapsulate common flags (Hennadii Stepanov) a2317e27b7 cmake: Add root `CMakeLists.txt` file (Hennadii Stepanov) Pull request description: This PR introduces a new CMake-based build system, which is a drop-in replacement for the current Autotools-based build system. ML announcement: https://groups.google.com/g/bitcoindev/c/hgKkfQWzrTo As discussed during the recent CoreDev meetup in April, the switch from Autotools to CMake is intended to happen as soon as possible after branching 28.x off, which means that 29.0 will be built using CMake. This PR branch is essentially the [staging branch](https://github.com/hebasto/bitcoin/tree/cmake-staging), with every change reviewed and tested by a group of contributors, including (in alphabetical order): - [**achow101**](https://github.com/achow101) - [**fanquake**](https://github.com/fanquake) - [**maflcko**](https://github.com/maflcko) - [**m3dwards**](https://github.com/m3dwards) - [**pablomartin4btc**](https://github.com/pablomartin4btc) - [**real-or-random**](https://github.com/real-or-random) - [**ryanofsky**](https://github.com/ryanofsky) - [**sipsorcery**](https://github.com/sipsorcery) - [**TheCharlatan**](https://github.com/TheCharlatan) - [**theStack**](https://github.com/theStack) - [**theuni**](https://github.com/theuni) - [**vasild**](https://github.com/vasild) Reviewing in a separate staging repo was suggested in https://github.com/bitcoin/bitcoin/pull/27060#issuecomment-1431798320. The accompanying changes to the OSS-Fuzz project are available in https://github.com/hebasto/oss-fuzz/pull/8. Please refer to the [build options parity table](https://gist.github.com/hebasto/2ef97d3a726bfce08ded9df07f7dab5e). The "auto" value is no longer available; non-default values must be specified explicitly. Additionally, the new default values have been chosen to suit the everyday build experience for the majority of developers. System requirements for using the CMake-based build system: - CMake >= 3.22 (if not available in your system's repository, it can be downloaded from https://cmake.org/download/) - a build tool of your choice: - any Make (GNU Make is no longer a requirement); GNU Make is still required to build depends - Ninja (https://ninja-build.org/) - MSBuild - Xcode A note for Windows users: The default installation of the latest version of MSVC 17.10.4 includes both CMake 3.28.3 and the vcpkg package manager). --- We, the build system developers, kindly ask reviewers to refrain from making suggestions that are not directly related to the migration process or can be implemented separately. Bugs in the scripts and errors in the updated documentation should be the focus of this PR. Please be advised that comments not aligned with this PR's goal may be ignored. Thank you all for your understanding. ACKs for top commit: maflcko: review ACK 41051290ab 🐥 sipsorcery: ACK 41051290ab. vasild: ACK 41051290ab TheCharlatan: ACK 41051290ab pablomartin4btc: tACK 41051290ab i-am-yuvi: tACK [`4105129`](41051290ab) theuni: ACK 41051290ab. fanquake: ACK 41051290ab Tree-SHA512: 6c1445054436c6c00ad63bfa0f19d64091a2b25c9bd694f85bf2218ac358ffb774d6c000685b3ca1e9b50401babed989fa2a0694b774c211d226bfd1944c9b39
2026-05-02 17:59:45 +02:00 · 2024-08-28 10:51:24 +01:00
parent 80f00cafde 41051290ab
commit 338bc2cd26
113 changed files with 5878 additions and 524 deletions
--- a/contrib/guix/README.md
+++ b/contrib/guix/README.md
@@ -261,6 +261,7 @@ details.

  - `guix` build commands as in `guix shell --cores="$JOBS"`
  - `make` as in `make --jobs="$JOBS"`
+  - `cmake` as in `cmake --build build -j "$JOBS"`
  - `xargs` as in `xargs -P"$JOBS"`

  See [here](#controlling-the-number-of-threads-used-by-guix-build-commands) for
--- a/contrib/guix/libexec/build.sh
+++ b/contrib/guix/libexec/build.sh
@@ -206,13 +206,13 @@ mkdir -p "$OUTDIR"
 ###########################

 # CONFIGFLAGS
-CONFIGFLAGS="--enable-reduce-exports --disable-bench --disable-gui-tests --disable-fuzz-binary"
+CONFIGFLAGS="-DREDUCE_EXPORTS=ON -DBUILD_BENCH=OFF -DBUILD_GUI_TESTS=OFF -DBUILD_FUZZ_BINARY=OFF"

 # CFLAGS
 HOST_CFLAGS="-O2 -g"
 HOST_CFLAGS+=$(find /gnu/store -maxdepth 1 -mindepth 1 -type d -exec echo -n " -ffile-prefix-map={}=/usr" \;)
 case "$HOST" in
-    *linux*)  HOST_CFLAGS+=" -ffile-prefix-map=${PWD}=." ;;
+    *linux*)  HOST_CFLAGS+=" -ffile-prefix-map=${DISTSRC}/src=." ;;
    *mingw*)  HOST_CFLAGS+=" -fno-ident" ;;
    *darwin*) unset HOST_CFLAGS ;;
 esac
@@ -239,38 +239,31 @@ mkdir -p "$DISTSRC"
    # Extract the source tarball
    tar --strip-components=1 -xf "${GIT_ARCHIVE}"

-    ./autogen.sh
-
    # Configure this DISTSRC for $HOST
    # shellcheck disable=SC2086
-    env CONFIG_SITE="${BASEPREFIX}/${HOST}/share/config.site" \
-        ./configure --prefix=/ \
-                    --disable-ccache \
-                    --disable-maintainer-mode \
-                    --disable-dependency-tracking \
-                    ${CONFIGFLAGS} \
-                    ${HOST_CFLAGS:+CFLAGS="${HOST_CFLAGS}"} \
-                    ${HOST_CXXFLAGS:+CXXFLAGS="${HOST_CXXFLAGS}"} \
-                    ${HOST_LDFLAGS:+LDFLAGS="${HOST_LDFLAGS}"}
-
-    sed -i.old 's/-lstdc++ //g' config.status libtool
+    env CFLAGS="${HOST_CFLAGS}" CXXFLAGS="${HOST_CXXFLAGS}" LDFLAGS="${HOST_LDFLAGS}" \
+    cmake -S . -B build \
+          --toolchain "${BASEPREFIX}/${HOST}/toolchain.cmake" \
+          -DWITH_CCACHE=OFF \
+          ${CONFIGFLAGS}

    # Build Bitcoin Core
-    make --jobs="$JOBS" ${V:+V=1}
+    cmake --build build -j "$JOBS" ${V:+--verbose}

    # Check that symbol/security checks tools are sane.
-    make test-security-check ${V:+V=1}
+    cmake --build build --target test-security-check ${V:+--verbose}
    # Perform basic security checks on a series of executables.
-    make -C src --jobs=1 check-security ${V:+V=1}
+    cmake --build build -j 1 --target check-security ${V:+--verbose}
    # Check that executables only contain allowed version symbols.
-    make -C src --jobs=1 check-symbols  ${V:+V=1}
+    cmake --build build -j 1 --target check-symbols ${V:+--verbose}

    mkdir -p "$OUTDIR"

    # Make the os-specific installers
    case "$HOST" in
        *mingw*)
-            make deploy ${V:+V=1} BITCOIN_WIN_INSTALLER="${OUTDIR}/${DISTNAME}-win64-setup-unsigned.exe"
+            cmake --build build -j "$JOBS" -t deploy ${V:+--verbose}
+            mv build/bitcoin-win64-setup.exe "${OUTDIR}/${DISTNAME}-win64-setup-unsigned.exe"
            ;;
    esac

@@ -282,20 +275,25 @@ mkdir -p "$DISTSRC"
    # Install built Bitcoin Core to $INSTALLPATH
    case "$HOST" in
        *darwin*)
-            make install-strip DESTDIR="${INSTALLPATH}" ${V:+V=1}
+            # This workaround can be dropped for CMake >= 3.27.
+            # See the upstream commit 689616785f76acd844fd448c51c5b2a0711aafa2.
+            find build -name 'cmake_install.cmake' -exec sed -i 's| -u -r | |g' {} +
+
+            cmake --install build --strip --prefix "${INSTALLPATH}" ${V:+--verbose}
            ;;
        *)
-            make install DESTDIR="${INSTALLPATH}" ${V:+V=1}
+            cmake --install build --prefix "${INSTALLPATH}" ${V:+--verbose}
            ;;
    esac

    case "$HOST" in
        *darwin*)
-            make deploydir ${V:+V=1}
+            cmake --build build --target deploy ${V:+--verbose}
+            mv build/dist/Bitcoin-Core.zip "${OUTDIR}/${DISTNAME}-${HOST}-unsigned.zip"
            mkdir -p "unsigned-app-${HOST}"
            cp  --target-directory="unsigned-app-${HOST}" \
                contrib/macdeploy/detached-sig-create.sh
-            mv --target-directory="unsigned-app-${HOST}" dist
+            mv --target-directory="unsigned-app-${HOST}" build/dist
            (
                cd "unsigned-app-${HOST}"
                find . -print0 \
@@ -304,23 +302,18 @@ mkdir -p "$DISTSRC"
                    | gzip -9n > "${OUTDIR}/${DISTNAME}-${HOST}-unsigned.tar.gz" \
                    || ( rm -f "${OUTDIR}/${DISTNAME}-${HOST}-unsigned.tar.gz" && exit 1 )
            )
-            make deploy ${V:+V=1} OSX_ZIP="${OUTDIR}/${DISTNAME}-${HOST}-unsigned.zip"
            ;;
    esac
    (
        cd installed

-        # Prune libtool and object archives
-        find . -name "lib*.la" -delete
-        find . -name "lib*.a" -delete
-
        case "$HOST" in
            *darwin*) ;;
            *)
                # Split binaries from their debug symbols
                {
                    find "${DISTNAME}/bin" -type f -executable -print0
-                } | xargs -0 -P"$JOBS" -I{} "${DISTSRC}/contrib/devtools/split-debug.sh" {} {} {}.dbg
+                } | xargs -0 -P"$JOBS" -I{} "${DISTSRC}/build/split-debug.sh" {} {} {}.dbg
                ;;
        esac