replace build_bench_env.sh with a Makefile

[derSteFfi]

pushing this draft as a starter to get your opinions - I'll be on vacation the next weeks and won't be working on it anyway. There are a few open tasks, but the general vibe should already come across. Feedback very welcome.

Decisions made:

• VERSIONS: demand versions instead of reporting them in the end
• switched from git cloning to grabbing a snapshot of the reqeuested version from github
• dh: move build directory (dh/src/build -> dh/build)
• lua: moved to extern benchmarks because it is built in extern/
• benchmarks: if something is updated, CMakeLists.txt needs to be touched (or replaced with a Makefile longterm)
• sm: instead of default target, switched to building supermalloc only
• linux: updated version to LTS series
• lean: switched to smaller build target

TODO

• put archives in extra storage after versionizing them (see here) docker caches these already
• adapt CI-scripts to use Makefile
• package installation
  • document in README: bazel5 missing, rest is done
  • move to CI instead of build_bench_env.sh
• bench.sh needs to be adapted in the way it finds 'installed allocators' -- fixed in Detect allocators present and functional #247

open Questions:

1. partial_checkout
   1. scudo
   2. lp Also, github does not serve archives on that repo. Re-add when solved.
2. pa: re-add, but smaller? (see here), but: Add partitionalloc #184
3. sed patches in Makefile: port to proper patch? at least gd, hd, rp are patched with sed right now, we could port that to a patch

[derSteFfi]

one ToDo I forgot in notes: tar can exclude files from extraction. The current shell-script does delete a few folders in a few repositories - we could modify the tar call to not extract them in the first place.

[derSteFfi]

the remaining CI failures are not specific to the Makefile but actual problems, so marking this ready.

[Copilot]

Pull Request Overview

This PR replaces the build_bench_env.sh script with a Makefile-based build system to improve consistency and maintainability. The change switches from git cloning to downloading versioned archives from GitHub and centralizes version management.

Key changes:

• Replace shell script with comprehensive Makefile for building allocators and benchmarks
• Introduce VERSIONS file to centralize version management across all components
• Move package installation documentation from script to README with per-distribution instructions

Reviewed Changes

Copilot reviewed 7 out of 8 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
build-bench-env.sh	Add python-six dependency for ArchLinux package installation
bench.sh	Update library paths and remove hardcoded version variables
VERSIONS	New file defining versions and sources for all allocators and benchmarks
README.md	Replace build script documentation with Makefile usage and detailed dependency lists
Makefile	New comprehensive build system with targets for all allocators and benchmarks
Dockerfile	Update to use Makefile instead of build script and add package installations
.github/workflows/all.yml	Remove Fedora exclusion from CI matrix

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[mjp41]

This is looking pretty tidy. Thanks for working on this.

[mjp41]

LGTM, thanks for the changes.

@jvoisin, @derSteFfi I don't want to hold these changes holding off on fixing issues for individual allocators/platforms. But I really like to only have a Green CI. Thoughts?

[derSteFfi]

Absolutely agree. I still have at least scudo and lp on my list and will re-check all comments here afterwards. With that fixed, I would also be pro-merging to make it easier to hunt individual bugs. The branch-switching sometimes takes time, and we would have a clear stand - fixing individual things is much easier than to always have to model the whole process.

[derSteFfi]

@jvoisin the MR is up-to-date with master - what do you think about merging?

[jvoisin]

~All the tests are failing :/

[derSteFfi]

sorry, missed a reference to build-bench-env.sh. Should be fixed.

[jvoisin]

There are still a bunch of failures it seems

[derSteFfi]

these are the same we have on master, except that fedora is deactivated in the CI on master (don't remember why). alpine base container and ubuntu/tcg fail with master, too.

[jvoisin]

Then it does look good to me. I'll let @daanx hit the merge button as it's his project :)

[derSteFfi]

re-synced with master. Also added rmalloc and fixed sc. Would love to not have to resolve merge conflicts like these every few months...

[derSteFfi]

I missed a few bumps in the merge, should be synchronized now.