Reproducible FreeBSD ?

Reproducible builds enable anyone to reproduce bit by bit identical binary packages from a given source, so that anyone can verify that a given binary derived from the source it was said to be derived. There is more information about reproducible builds on the Debian wiki and on https://reproducible-builds.org. These pages explain in more depth why this is useful, what common issues exist and which workarounds and solutions are known.

Reproducible FreeBSD is an effort to apply this to FreeBSD. Thus FreeBSD is build twice, with a few variations added and then the resulting filesystems from the two builds are put into a compressed tar archive, which is finally compared using diffoscope. Please note that the toolchain is not varied at all as the rebuild happens on exactly the same system. More variations are expected to be seen in the wild.

There is a weekly run jenkins job to test the main branch of freebsd.git. The jenkins job is running reproducible_freebsd.sh, which via ssh triggers a build on a FreeBSD system and this script is solely responsible for creating this page. Feel invited to join #reproducible-builds (on irc.oftc.net) to request job runs whenever sensible. Patches and other feedback are very much appreciated - if you want to help, please start by looking at the ToDo list for FreeBSD, you might find something easy to contribute.
Thanks to IONOS for donating the virtual machines this is running on!

0 (0%) out of 0 FreeBSD files were reproducible in our test setup . These tests were last run on 2024-05-09 for the branch main at commit cd917a17b using diffoscope 265.

variation	first build	second build
hostname	osuosl1-amd64 or osuosl2-amd64	the other one
domainname	is not yet varied between rebuilds of FreeBSD.
env TZ	TZ="/usr/share/zoneinfo/Etc/GMT+12"	TZ="/usr/share/zoneinfo/Etc/GMT-14"
env LANG	LANG="en_GB.UTF-8"	LANG="et_EE.UTF-8"
env LC_ALL	not set	LC_ALL="et_EE.UTF-8"
env PATH	is not yet varied between rebuilds of FreeBSD.
env USER	is not yet varied between rebuilds of FreeBSD.
uid	is not yet varied between rebuilds of FreeBSD.
gid	is not yet varied between rebuilds of FreeBSD.
FreeBSD kernel version	is not yet varied between rebuilds of FreeBSD.
umask	is not yet varied between rebuilds of FreeBSD.
CPU type	AMD Opteron 62xx class CPU	same for both builds
/bin/sh	is not yet varied between rebuilds of FreeBSD.
year, month, date	osuosl1-amd64: today (2024-05-09) or osuosl1-amd64: 398 days in the future (2025-06-11)	the other one
year, month, date	today (2024-05-09)	the 2nd build is done with the build node set 1 year, 1 month and 1 day in the future
hour, minute	hour and minute will vary between two builds	additionally the "future build" also runs 6h and 23min ahead
filesystem of the build directory	ufs	same for both builds
Filesystem	tmpfs	same for both builds (currently, this could be varied using disorderfs)
everything else...	is likely the same. There will be more variations in the wild.

Artifacts for `freebsd_main_gitcd917a17b`
freebsd_main_gitcd917a17b failed to build from source.

commit cd917a17bc39991bb1ee11b90716bcabfcd42791
Author: Lexi Winter 
Date:   Thu May 9 17:26:41 2024 -0600

    arp.8: don't document a syntax that doesn't exist
    
    The arp.8 manpage documents 'arp -d  pub', but the 'pub' flag is
    not accepted by the arp command.  Remove this incorrect documentation.
    
    Reviewed by: imp, gleb, mp
    Pull Request: https://github.com/freebsd/freebsd-src/pull/1215