Reproducible NetBSD ?

Reproducible builds enable anyone to reproduce bit by bit identical binary packages from a given source, so that anyone can verify that a given binary derived from the source it was said to be derived. There is more information about reproducible builds on the Debian wiki and on https://reproducible-builds.org. These pages explain in more depth why this is useful, what common issues exist and which workarounds and solutions are known.

Reproducible NetBSD is an effort to apply this to NetBSD. Thus each NetBSD target is build twice, with a few variations added and then the resulting files from the two builds are compared using diffoscope. Please note that the toolchain is not varied at all as the rebuild happens on exactly the same system. More variations are expected to be seen in the wild.

There is a weekly run jenkins job to test the master branch of netbsd.git. The jenkins job is running reproducible_netbsd.sh in a Debian environment and this script is solely responsible for creating this page. Feel invited to join #reproducible-builds (on irc.oftc.net) to request job runs whenever sensible. Patches and other feedback are very much appreciated - if you want to help, please start by looking at the ToDo list for NetBSD, you might find something easy to contribute.
Thanks to Profitbricks for donating the virtual machines this is running on!

48 (82.7%) out of 58 built NetBSD files were reproducible in our test setup . These tests were last run on 2020-04-08 for version 433f3e40a with MKREPRO=yes and MKREPRO_TIMESTAMP=1586127291 and were compared using diffoscope 137.

variation	first build	second build
hostname	osuosl-build169-amd64 or osuosl-build170-amd64	the other one
domainname	is not yet varied between rebuilds of NetBSD.
env CAPTURE_ENVIRONMENT	not set	CAPTURE_ENVIRONMENT="I capture the environment"
env TZ	TZ="/usr/share/zoneinfo/Etc/GMT+12"	TZ="/usr/share/zoneinfo/Etc/GMT-14"
env LANG	LANG="en_GB.UTF-8"	LANG="et_EE.UTF-8"
env LC_ALL	not set	LC_ALL="et_EE.UTF-8"
env PATH	PATH="/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:"	PATH="/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/i/capture/the/path"
env USER	is not yet varied between rebuilds of NetBSD.
uid	is not yet varied between rebuilds of NetBSD.
gid	is not yet varied between rebuilds of NetBSD.
UTS namespace	is not yet varied between rebuilds of NetBSD.
kernel version, modified using /usr/bin/linux64 --uname-2.6	Linux 4.19.0-8-amd64	Linux 2.6.79-8-amd64
umask	0022	0002
CPU type	Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz	same for both builds
/bin/sh	is not yet varied between rebuilds of NetBSD.
year, month, date	today (2020-04-08)	same for both builds (currently, work in progress)
hour, minute	hour and minute will probably vary between two builds...	the future system actually runs 398 days, 6 hours and 23 minutes ahead...
Filesystem	tmpfs	same for both builds (currently, this could be varied using disorderfs)
everything else...	is likely the same. There will be more variations in the wild.

Unreproducible artifacts for `amd64`
binary/sets/kern-GENERIC_KASLR.tar.xz (8084K) is unreproducible.
binary/sets/kern-GENERIC.tar.xz (7866K) is unreproducible.
binary/sets/man.tar.xz (7190K) is unreproducible.
INSTALL.more (76K) is unreproducible.
INSTALL.ps (128K) is unreproducible.
INSTALL.txt (76K) is unreproducible.

Unreproducible artifacts for `sparc64`
binary/sets/man.tar.xz (7152K) is unreproducible.
INSTALL.more (119K) is unreproducible.
INSTALL.ps (192K) is unreproducible.
INSTALL.txt (117K) is unreproducible.

Reproducible artifacts for `amd64`
binary/kernel/netbsd-GENERIC.gz (56c5fddcea7bcfea447a5fa6a883143e71f281d782cf7fa2e188201f8cf85d8a, 9838K) is reproducible.
binary/kernel/netbsd-GENERIC_KASLR.gz (c6ba52335ed901ec36c3c8ea9af310db8d300272f41451918dfe55cc43f5bae4, 10697K) is reproducible.
binary/kernel/netbsd-GENERIC.symbols.gz (31afb01f7e595fd127e4170a6d807ec2430a582ce616d7c1d9a6b58c392dd999, 458K) is reproducible.
binary/kernel/netbsd-INSTALL.gz (30f9b33f964dbe57ad42e1c70957aeb9c5a02838d33210bb6f5418cacece5381, 8240K) is reproducible.
binary/kernel/netbsd-INSTALL.symbols.gz (dcdbd706ec444a461c6be503411007f12ec1d4b10724870cf18a252a61234cc2, 350K) is reproducible.
binary/kernel/netbsd-INSTALL_XEN3_DOMU.gz (12887cdb07e57926ac7f085ce1554fde18a969508e60b0f96ef3a0df295b89a3, 3980K) is reproducible.
binary/kernel/netbsd-XEN3_DOM0.gz (d843d9f6f0bda94ebfcfa657b911ebafd899d68296584f604787270413275965, 6024K) is reproducible.
binary/kernel/netbsd-XEN3_DOMU.gz (0af380afa6c0335f9cae41624ade668df5a213a97987fb1b6d4669413b52bded, 2653K) is reproducible.
binary/sets/base.tar.xz (12199ee43c4277f75a558bf6e30f61ddf68870faed851999f079066cc551218c, 39M) is reproducible.
binary/sets/comp.tar.xz (b230b66224bc4e91a9df72ec274ac02340927a916569c4f359df88ad10d2ffd4, 58M) is reproducible.
binary/sets/etc.tar.xz (209ca69ed00926fe4abc58203c9f6e2cfc560e5d0ad4f982059837edb19f0cec, 470K) is reproducible.
binary/sets/games.tar.xz (e03e9f45444947aa5d7e39bac902486ddcbfc0e1efb5abf5ed4d6808dc677ce2, 2420K) is reproducible.
binary/sets/kern-XEN3_DOM0.tar.xz (5d6fc426d13a2263380423254a0b46fab47822ba9d25e4aa5388a198acd079f2, 4734K) is reproducible.
binary/sets/kern-XEN3_DOMU.tar.xz (55e48186b6f8565b45dbd3c7332db2a2d4c8f72c6c0b7dfd092ed5792b87d2bf, 2140K) is reproducible.
binary/sets/misc.tar.xz (ce5d3a67ab97b79f96ca13cefce25466c6b3124d41548dcc9e4c6cc17e93af41, 4154K) is reproducible.
binary/sets/modules.tar.xz (54a99e669a73a200235b7e43012325becfc92289a53bec12af7a683c1470c72e, 8873K) is reproducible.
binary/sets/rescue.tar.xz (bcae1ad4f5f8f2538d7145486f9d1de0c555d2d0a45e1941d5202820e8aae3f1, 2652K) is reproducible.
binary/sets/tests.tar.xz (260504f80472c57bcde3bd44af20b929c2ace8ff243674955d18cc1874b5a9eb, 9747K) is reproducible.
binary/sets/text.tar.xz (f7ddb8fc7cb8a44882f56a1608c4c2f44797dd95c81b0e4164fd58b851d3a89d, 1852K) is reproducible.
installation/cdrom/boot-com.iso (d2e1b8cdf82557fc3d296d2466d613a74c476e2526088686f052a8fd6a71e6a7, 226M) is reproducible.
installation/cdrom/boot.iso (00df73bbaedcd0582b174698e3aad0907b00570e1d8ec2fbe3103b4e4bfb4628, 226M) is reproducible.
installation/miniroot/cgdroot.kmod (47884a83af9dc25adaa469ae7e878879f6f229452b6f7c4f3f4b35d052fc357f, 1161K) is reproducible.
installation/miniroot/miniroot.kmod (f0e196277f164a630999102a29c5ba6145edf9e3f4da868f13069ceb46f7b1da, 1329K) is reproducible.
installation/misc/pxeboot_ia32.bin (c831fad87feefffddf0fc4e2d6ec1e7004f951d138772b32f71c526cb4fe8afa, 72K) is reproducible.
INSTALL.html (00641609d2c380065304fc2ed506d578e42c7f645fbf98944e2494233c53cdf1, 79K) is reproducible.

Reproducible artifacts for `sparc64`
binary/kernel/netbsd-GENERIC.gz (dc4165f96f7b2e503f41f953a97191a656fe8c5517ae6375a5a0ca52376413b2, 5399K) is reproducible.
binary/kernel/netbsd-GENERIC.UP.gz (f81cd9bb40ef44658bd3cba270211f8c2cd79f64bfaa0eaddd0896674c430a77, 5382K) is reproducible.
binary/kernel/netbsd-INSTALL.gz (4fddd5d0e488e1eaf3e378bbba7060a75923ed3f7203e829f3d73f492ae7267a, 6400K) is reproducible.
binary/kernel/netbsd-INSTALL.symbols.gz (5a0fb3ee70e8fa91263399bdcec20936b34bfb226e1f3e13cc5501c04550dd34, 252K) is reproducible.
binary/sets/base.tar.xz (ef27c9041aec1dfadb2f43d3444c4ff378ae239ededad1236f416babf554ee49, 35M) is reproducible.
binary/sets/comp.tar.xz (0a7a7c63a44dece389aa69c8bd84b22160e93d96160e126246e521629597f028, 48M) is reproducible.
binary/sets/etc.tar.xz (9c3c896b641c6f9d6be25838cbf49e64d12774672828d07d28e3ec39733c975e, 469K) is reproducible.
binary/sets/games.tar.xz (cf060a87e6168d79be10487415f5530ab81b4c6a534a381a017da10eefc21996, 2425K) is reproducible.
binary/sets/kern-GENERIC.tar.xz (2738c570be5c077192cb94195c7ff970519e1e2cbfdd1c187acb5656a0438047, 3870K) is reproducible.
binary/sets/kern-GENERIC.UP.tar.xz (32816053379a1f2e4027037be5f706054135701d1a56c7c94d9db27880f9bd2d, 3857K) is reproducible.
binary/sets/misc.tar.xz (ce5d3a67ab97b79f96ca13cefce25466c6b3124d41548dcc9e4c6cc17e93af41, 4154K) is reproducible.
binary/sets/modules.tar.xz (07255a8ffc2a8c6472cee081238316fc3e7a69ff4d45a7deade5d40679c783e9, 2305K) is reproducible.
binary/sets/rescue.tar.xz (905889bf0934f1a13a9ddb982546855dc871a8a5085160ee61872d240c7eb336, 2664K) is reproducible.
binary/sets/tests.tar.xz (921491b16c0ce04233828a0b1e6c1fa154e9f8de1622f8fd5f1f37f7b1d93251, 8878K) is reproducible.
binary/sets/text.tar.xz (304a7b868ecf2d87822e3c2483b04dac44cbb5a0410cf4843a69c7f2c45596c6, 1797K) is reproducible.
installation/miniroot/miniroot.fs.gz (53d8385b8a501675b1e9827a87a909a6eb81fe8ab260df7692b0d31b157dab92, 7431K) is reproducible.
installation/misc/bootblk (99b37fbde6cf6d795adf645a7f820eacc7a7f36e4c30eb2d5315b0ff113af74a, 7K) is reproducible.
installation/misc/boot.fs.gz (5e669621666373d54dfed34d68540c1d7dc132d559fb40e311b96e1bec993dca, 58K) is reproducible.
installation/misc/installboot (bde769df3699e92eb8090f635bc5aacb7d4315111c60ba25b91eaf3f00706e8d, 138K) is reproducible.
installation/misc/instfs.tgz (1ae428b04a97d28444b8d35e6d82b29c84ca60f1bd0da7a5d5fab7f5beb65a9f, 2040K) is reproducible.
installation/misc/ofwboot (1631b4190f7e0b0e4ee4f7587cef920859c093d7bed219454538a0e01480e83a, 120K) is reproducible.
installation/netboot/ofwboot.net (1631b4190f7e0b0e4ee4f7587cef920859c093d7bed219454538a0e01480e83a, 120K) is reproducible.
INSTALL.html (dee2af49b109e83bef902d0337a9b264bb798f946f7a4478003186722acb2d47, 125K) is reproducible.

commit 433f3e40ad05fb3aee3fcb1b3f8022a7d4dd0949
Author: jmcneill 
Date:   Sun Apr 5 22:54:51 2020 +0000

    Cleanup CPU attach output:
     - Always print the core's vendor and product name.
     - Print the CPU ID on the same line as the name. Single line of dmesg
       per core.
     - Use aprint_verbose for reporting additional details.