Reproducible NetBSD !

Reproducible builds enable anyone to reproduce bit by bit identical binary packages from a given source, so that anyone can verify that a given binary derived from the source it was said to be derived. There is more information about reproducible builds on the Debian wiki and on https://reproducible-builds.org. These pages explain in more depth why this is useful, what common issues exist and which workarounds and solutions are known.

Reproducible NetBSD is an effort to apply this to NetBSD. Thus each NetBSD target is build twice, with a few variations added and then the resulting files from the two builds are compared using diffoscope. Please note that the toolchain is not varied at all as the rebuild happens on exactly the same system. More variations are expected to be seen in the wild.

There is a weekly run jenkins job to test the master branch of netbsd.git. The jenkins job is running reproducible_netbsd.sh in a Debian environment and this script is solely responsible for creating this page. Feel invited to join #reproducible-builds (on irc.oftc.net) to request job runs whenever sensible. Patches and other feedback are very much appreciated - if you want to help, please start by looking at the ToDo list for NetBSD, you might find something easy to contribute.
Thanks to Profitbricks for donating the virtual machines this is running on!

54 (100.0%) out of 54 built NetBSD files were reproducible in our test setup ! These tests were last run on 2018-04-18 for version 4a985cb82 with MKREPRO=yes and MKREPRO_TIMESTAMP=1524074287 and were compared using diffoscope 93.

variation	first build	second build
hostname	profitbricks-build3-amd64 or profitbricks-build4-amd64	the other one
domainname	is not yet varied between rebuilds of NetBSD.
env CAPTURE_ENVIRONMENT	not set	CAPTURE_ENVIRONMENT="I capture the environment"
env TZ	TZ="/usr/share/zoneinfo/Etc/GMT+12"	TZ="/usr/share/zoneinfo/Etc/GMT-14"
env LANG	LANG="en_GB.UTF-8"	LANG="fr_CH.UTF-8"
env LC_ALL	not set	LC_ALL="fr_CH.UTF-8"
env PATH	PATH="/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:"	PATH="/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/i/capture/the/path"
env USER	is not yet varied between rebuilds of NetBSD.
uid	is not yet varied between rebuilds of NetBSD.
gid	is not yet varied between rebuilds of NetBSD.
UTS namespace	is not yet varied between rebuilds of NetBSD.
kernel version, modified using /usr/bin/linux64 --uname-2.6	Linux 4.9.0-6-amd64	Linux 2.6.69-6-amd64
umask	0022	0002
CPU type	AMD Opteron 62xx class CPU	same for both builds
/bin/sh	is not yet varied between rebuilds of NetBSD.
year, month, date	today (2018-04-18)	same for both builds (currently, work in progress)
hour, minute	hour and minute will probably vary between two builds...	the future system actually runs 398 days, 6 hours and 23 minutes ahead...
Filesystem	tmpfs	same for both builds (currently, this could be varied using disorderfs)
everything else...	is likely the same. There will be more variations in the wild.

Reproducible artifacts for `amd64`
binary/kernel/netbsd-GENERIC.gz (2e670e5c785185dc08d5caee9c469d1dcce1d4073453e92b3e4bc50c8fb7e894, 8317K) is reproducible.
binary/kernel/netbsd-GENERIC.symbols.gz (f05465b033ddc9f46bb262ff9377bec46f67e296b317694df763c7f2cf0c168b, 415K) is reproducible.
binary/kernel/netbsd-INSTALL.gz (987d118155320d29585f5379eeac2ac89cf3aa6ed8919399be6f0565c89f84f1, 7243K) is reproducible.
binary/kernel/netbsd-INSTALL.symbols.gz (b7a20b008c02ff3c53efc15049cd9d1d9b3c21757ab592c65487215f3ad3c22d, 332K) is reproducible.
binary/kernel/netbsd-INSTALL_XEN3_DOMU.gz (49516933dfef526ba91f2ddb418451b2b0eb01bab60870dc898a6edaab53c726, 3869K) is reproducible.
binary/kernel/netbsd-XEN3_DOM0.gz (92f61fd046bd2f7dbf32e98a05696dab564bf83bbb5039a917cd3bc1db74cb9f, 6031K) is reproducible.
binary/kernel/netbsd-XEN3_DOMU.gz (1215ab475581b8638725bb99bde43602758aa539e96a07a9b21f58a5f183e581, 2632K) is reproducible.
binary/sets/base.tgz (c1c72bb5d77efc7c578610834c1f4a3c45e402998094a339ab1ec22df3187a4c, 70M) is reproducible.
binary/sets/comp.tgz (ec6304eb048b071a5693beb56dfe260a3aef5d0b510dfcb275bdaa94f23db9b4, 149M) is reproducible.
binary/sets/etc.tgz (de7fe66bf9bbf1c1d55df903b21e4dd540e041574b66c860df3c77193b0882f0, 621K) is reproducible.
binary/sets/games.tgz (ce02357f06e66478f2c79bfe732fe5c1e9c217e25d4ad357777298c27840775d, 3263K) is reproducible.
binary/sets/kern-GENERIC.tgz (8b5c33de260850a52a01581ebe1f1055bf93589b502ac3eb97aec96f9ef597a2, 8318K) is reproducible.
binary/sets/kern-XEN3_DOM0.tgz (1e6b05c812f382bdccd2c61ccc12bdd05d7755c25637c7bd4ede9af13c6fd46b, 6031K) is reproducible.
binary/sets/kern-XEN3_DOMU.tgz (c36d12ea059e94359a08f21d772cb485579ac9d0a9bba53c1a9d0cd0b02ad11b, 2633K) is reproducible.
binary/sets/man.tgz (97f471b55e02a8da44be8dc22dac3f74bfb45c889dcab9873caa9714099b1396, 11570K) is reproducible.
binary/sets/misc.tgz (840ed728c39af3e9e681ef5ce7ba3d13482ff5c7c6855db6e33b72a97b63d9ea, 5227K) is reproducible.
binary/sets/modules.tgz (5cc9970fc1bde40a601c386641ac738a68a9646b028ea4fcb60b49dfaaf069fd, 16M) is reproducible.
binary/sets/tests.tgz (bf21f0bfac2d8ef5cb20aa81b508195752ff301c921ce3a3fac0018ebb51d6ac, 9325K) is reproducible.
binary/sets/text.tgz (49a7d15b34abd360de928566da57b56557881f8f1e7cab8c29dd55c10bd64ebb, 2895K) is reproducible.
installation/cdrom/boot-com.iso (6036bfe271b9da6f24a4e31076df3397e51972bb28f20a36fea9d8088d7f605f, 232M) is reproducible.
installation/cdrom/boot.iso (cf4b2bb36998c58a3e69a427b6ccbbbe9c130ab0c46aa2349b05716524b767e0, 232M) is reproducible.
installation/miniroot/cgdroot.kmod (7f87a5b9daa203d086e23f126f9f3ae08e4776a17ad06527b049d2c317f28c98, 1112K) is reproducible.
installation/miniroot/miniroot.kmod (f18b5ff0f70ee604a77592d41980ee13a49e436574feb564c691583e30061097, 1238K) is reproducible.
installation/misc/pxeboot_ia32.bin (2dfa34d25898613467e9c2bcca63a1c0c30f8bf2f247b6f6f70efe1df7bdfd74, 56K) is reproducible.
INSTALL.html (0cba2a426bfe79eb142e52dd0535a8935fb97e7726daa32f3b7a28c3aeab88f2, 131K) is reproducible.
INSTALL.more (71502ec90698ef6a798300c1eb04298fccc33e9168e5768dfcab107cb50a6f58, 103K) is reproducible.
INSTALL.ps (167566e10ed373cda207c328677498d767002c67b8cf5f4ec2d62bce17d8a002, 152K) is reproducible.
INSTALL.txt (d79a0247023993160a4946da9108e21bf6059c05d522f54761b51dc9e58f2d0d, 95K) is reproducible.

Reproducible artifacts for `sparc64`
binary/kernel/netbsd-GENERIC.gz (1cdd0bb42c1d9b767f0ba86b6ebeb2b2cd1ee750d5ede4956312b84ba8400952, 5265K) is reproducible.
binary/kernel/netbsd-GENERIC.UP.gz (0334ff676a6611a89154011532ffdcb21cec0f7e9f4fbbda4c62438e91bffe02, 5251K) is reproducible.
binary/kernel/netbsd-INSTALL.gz (08b84029f3bac707aceb5384004a1e02dbcca9cd0c88223a31d7439579733481, 6313K) is reproducible.
binary/kernel/netbsd-INSTALL.symbols.gz (1213830f003cea0b28d7c095ad471e7e01d559581b927e18b3646b8a9796f996, 240K) is reproducible.
binary/sets/base.tgz (b4561170c54676c8dff1f65ba597e1c500eed5caa84af395ec374b688a68725f, 69M) is reproducible.
binary/sets/comp.tgz (8a589d0589bca497bc8f69056b220535678755922bc02da1cf383038208cfef1, 143M) is reproducible.
binary/sets/etc.tgz (ff8241965d6ac7e885ac2068ab0eaacea4d4dce2a01b4be90b8e33ccea486e94, 620K) is reproducible.
binary/sets/games.tgz (3c0d55135b7bebdeffdbc06842e3e1eb7ea9b6be173ce08607c8798adb6d28d7, 3421K) is reproducible.
binary/sets/kern-GENERIC.tgz (d4e3e5c03273582dcf2f6957fbd1d85a5024839fae3e4af567062252954d29a6, 5264K) is reproducible.
binary/sets/kern-GENERIC.UP.tgz (d8cfbceb07ee27f75524e585ed7ae3970da3c19c193511f79581f4d6d8cecb83, 5251K) is reproducible.
binary/sets/man.tgz (7ae1c1b4ea08ff1068f690b9a36144c115beffd04862c0f311199552401caa1b, 11459K) is reproducible.
binary/sets/misc.tgz (840ed728c39af3e9e681ef5ce7ba3d13482ff5c7c6855db6e33b72a97b63d9ea, 5227K) is reproducible.
binary/sets/modules.tgz (e96b7f1c019e6912370c855bdc2f011e22db0c6cb98e831ff46ef6a24d00540b, 2392K) is reproducible.
binary/sets/tests.tgz (920a1ec64e9333c6696797ebba7605358b65d4f126997f6f7ed01c75b2ddc60e, 9184K) is reproducible.
binary/sets/text.tgz (054caa52297ed785b5e024c7497b8904f5dbd000d063d6bac3f97da334f2b486, 3041K) is reproducible.
installation/miniroot/miniroot.fs.gz (f43cbba98ed56036dfbf4b6af230adb8fd6e7e853fd7706d0932c31d2f41cc25, 7252K) is reproducible.
installation/misc/bootblk (99b37fbde6cf6d795adf645a7f820eacc7a7f36e4c30eb2d5315b0ff113af74a, 7K) is reproducible.
installation/misc/boot.fs.gz (649778b87d70f6ab636489276b10692229079fbb3abd578751f9a3ebdac5a176, 58K) is reproducible.
installation/misc/installboot (65d6d448dc51dabdc5465311dd3b5b87221068bf0df50c703a65914a125d049e, 98K) is reproducible.
installation/misc/instfs.tgz (30bd32427f3c0fd2284a57148b0bb859edcf7d702eb318968eb5cd93b8a60e06, 1997K) is reproducible.
installation/misc/ofwboot (ffe57f0868177a803e0822dd8ea1b6330082620a27389802f4dba0e18a246585, 111K) is reproducible.
installation/netboot/ofwboot.net (ffe57f0868177a803e0822dd8ea1b6330082620a27389802f4dba0e18a246585, 111K) is reproducible.
INSTALL.html (4f00e4cdced030d7e426f7dcc4aa5c799605aea62e37e439d2a567285951d138, 185K) is reproducible.
INSTALL.more (bebd839bb6ab991f74c53a5f6b7911917c5f29dc1229df2aa7d55bc9e95cff90, 145K) is reproducible.
INSTALL.ps (0b2ccd5b4db78e863d235e6a5e0dee1610b833de948955b12f848e008f9f6b7f, 215K) is reproducible.
INSTALL.txt (0b56d4d3acc3b9011ffcc7f8639e6891c574cb68ed73a5c53b6d0b760d0a3b66, 136K) is reproducible.

commit 4a985cb82ed80063a586ae42790a829e2ec7a59b
Author: maxv 
Date:   Wed Apr 18 17:58:07 2018 +0000

    Simplify the IPv4 parser. Get the option length in 'optlen', and sanitize
    it earlier. A new check is added (off + optlen > skip).
    
    In the IPv6 parser we reuse 'optlen', and remove 'ad' as a result.