Reproducible NetBSD !

Reproducible builds enable anyone to reproduce bit by bit identical binary packages from a given source, so that anyone can verify that a given binary derived from the source it was said to be derived. There is more information about reproducible builds on the Debian wiki and on https://reproducible-builds.org. These pages explain in more depth why this is useful, what common issues exist and which workarounds and solutions are known.

Reproducible NetBSD is an effort to apply this to NetBSD. Thus each NetBSD target is build twice, with a few variations added and then the resulting files from the two builds are compared using diffoscope. Please note that the toolchain is not varied at all as the rebuild happens on exactly the same system. More variations are expected to be seen in the wild.

There is a weekly run jenkins job to test the master branch of netbsd.git. The jenkins job is running reproducible_netbsd.sh in a Debian environment and this script is solely responsible for creating this page. Feel invited to join #reproducible-builds (on irc.oftc.net) to request job runs whenever sensible. Patches and other feedback are very much appreciated - if you want to help, please start by looking at the ToDo list for NetBSD, you might find something easy to contribute.
Thanks to Profitbricks for donating the virtual machines this is running on!

56 (100.0%) out of 56 built NetBSD files were reproducible in our test setup ! These tests were last run on 2018-10-24 for version 8f45fc972 with MKREPRO=yes and MKREPRO_TIMESTAMP=1540412752 and were compared using diffoscope 103.

variation	first build	second build
hostname	profitbricks-build3-amd64 or profitbricks-build4-amd64	the other one
domainname	is not yet varied between rebuilds of NetBSD.
env CAPTURE_ENVIRONMENT	not set	CAPTURE_ENVIRONMENT="I capture the environment"
env TZ	TZ="/usr/share/zoneinfo/Etc/GMT+12"	TZ="/usr/share/zoneinfo/Etc/GMT-14"
env LANG	LANG="en_GB.UTF-8"	LANG="fr_CH.UTF-8"
env LC_ALL	not set	LC_ALL="fr_CH.UTF-8"
env PATH	PATH="/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:"	PATH="/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/i/capture/the/path"
env USER	is not yet varied between rebuilds of NetBSD.
uid	is not yet varied between rebuilds of NetBSD.
gid	is not yet varied between rebuilds of NetBSD.
UTS namespace	is not yet varied between rebuilds of NetBSD.
kernel version, modified using /usr/bin/linux64 --uname-2.6	Linux 4.9.0-8-amd64	Linux 2.6.69-8-amd64
is always set to 0022 by the OpenWrt build system.
CPU type	AMD Opteron 62xx class CPU	same for both builds
/bin/sh	is not yet varied between rebuilds of NetBSD.
year, month, date	today (2018-10-24)	same for both builds (currently, work in progress)
hour, minute	hour and minute will probably vary between two builds...	the future system actually runs 398 days, 6 hours and 23 minutes ahead...
Filesystem	tmpfs	same for both builds (currently, this could be varied using disorderfs)
everything else...	is likely the same. There will be more variations in the wild.

Reproducible artifacts for `amd64`
binary/kernel/netbsd-GENERIC.gz (7aaac4885ec04eaf9440a31a8d14431b2f55501446e297746688867cba34fc90, 8653K) is reproducible.
binary/kernel/netbsd-GENERIC_KASLR.gz (0af69443a0cda694f4964503196e7acf0dcc4138e1851bfef64658ceb53706f9, 9531K) is reproducible.
binary/kernel/netbsd-GENERIC.symbols.gz (dbb14c0dd1bbb7b7b96cac6f397449cb942e26768997e920cc6a1bd3d9f2481f, 443K) is reproducible.
binary/kernel/netbsd-INSTALL.gz (e3ba86a3d7baef57aaa48aba64abc64ebfc13f21180673b6809252392605cb54, 7204K) is reproducible.
binary/kernel/netbsd-INSTALL.symbols.gz (c4af519535a85240224a83f1f76442f4ea72cd7eb78364a02ce09ef6c05ab8f7, 334K) is reproducible.
binary/kernel/netbsd-INSTALL_XEN3_DOMU.gz (b600a7cd99ff13318edaec727350101b44f274c1abed66bf7d6dd6ae20f53f6e, 3816K) is reproducible.
binary/kernel/netbsd-XEN3_DOM0.gz (409f413ea73e18c5e28bb6bae0ceaabbb075087c0e52e75a54254836c5abf35f, 5929K) is reproducible.
binary/kernel/netbsd-XEN3_DOMU.gz (86e230d8f0743288e38961f3bd61a351db7ae970e7c0accf82443374c3d6cef2, 2543K) is reproducible.
binary/sets/base.tar.xz (e4f1cb71f61b7690b437df75c99c653af66860fd0844cfbfb8a050ddfe621463, 37M) is reproducible.
binary/sets/comp.tar.xz (096df0ce63bd9d71aa4c4210b79f42f939fa103b8993ca85330397fec4eae604, 58M) is reproducible.
binary/sets/etc.tar.xz (4252f4959801a01a2deb1d8e73f85bc2724d458c474f3aca5ef00230cd07756a, 453K) is reproducible.
binary/sets/games.tar.xz (cd4c92381e374376c4092660c88ad4a484a9575bd5028a301fcd18a000b96979, 2417K) is reproducible.
binary/sets/kern-GENERIC_KASLR.tar.xz (67e66799b1d9a84755d317a7d44e93812f98236bee00d44268fbbf62fb0e92ac, 7019K) is reproducible.
binary/sets/kern-GENERIC.tar.xz (a6bca726febf5d75c186a7b146d1ec4bcfebe21d701a1aa80d1bf8abebd2bdc2, 6733K) is reproducible.
binary/sets/kern-XEN3_DOM0.tar.xz (a4116bcbe8cce2fcccf16b1a171d36e04e019ad634b55117021115f204e59de5, 4649K) is reproducible.
binary/sets/kern-XEN3_DOMU.tar.xz (0ed58cd901c973ba5137a554fffceb9aeaf936580bde196fe08193c1e4f6abe2, 2050K) is reproducible.
binary/sets/man.tar.xz (51d4e71e9417af5308a8a021f50c6931aef2c0e7a068d8ef86fcbbb82ab519d2, 7021K) is reproducible.
binary/sets/misc.tar.xz (7b31252a375cec01050b624d10e32f74cab3b0d47a64afc3560390fb1d6355e7, 4127K) is reproducible.
binary/sets/modules.tar.xz (21cde6bb87e3f0921cd274a4d73ff15f20f3acf330421d6304673a4ccdded904, 7395K) is reproducible.
binary/sets/tests.tar.xz (4d9f944f91ace5ddb7ba4d6d95d4afda167e025aeac79d889bce29f707dbb038, 5779K) is reproducible.
binary/sets/text.tar.xz (335205a4c1efde136ee404b54b91f9e7247e8613a6ae46948faf76b1921c71f3, 1838K) is reproducible.
installation/cdrom/boot-com.iso (50f29dd7418a55e5346e8173a9c4a68f43f96925d2ebf4ee363c8a71726e7a16, 212M) is reproducible.
installation/cdrom/boot.iso (d5e75929b6b7ee022db930a8cff3366b687609b05eda57868ae57edd00b895cb, 212M) is reproducible.
installation/miniroot/cgdroot.kmod (56ce8c841be667c3dc732007cc4fcbe0cc22fd61b140b365efe9a24815000096, 1145K) is reproducible.
installation/miniroot/miniroot.kmod (e11ef2cb9b2057b43252163736af27e0b1cf8e296671b40829529a307900df83, 1275K) is reproducible.
installation/misc/pxeboot_ia32.bin (4163db30f1328a9684a6c4e87677661e740ac068c47289eafcdbfcc91fda3937, 56K) is reproducible.
INSTALL.html (5ae1a1133f841be910ee63b06609738a3b9f8a2f45b9ce7e231abe68ee87cb2c, 97K) is reproducible.
INSTALL.more (1357252d20dba550f29c47a95566bec2a7623c8baa7646ae1dd0c0ae3f83596d, 77K) is reproducible.
INSTALL.ps (d0ad49b5461095080b716186c2badc1eb950fb472fe235b08dfb2beb2bbab485, 125K) is reproducible.
INSTALL.txt (8b36f1464165afea3924b21f6b7f7e796b49a36a27b65301612265cd995ed6ff, 84K) is reproducible.

Reproducible artifacts for `sparc64`
binary/kernel/netbsd-GENERIC.gz (6084801fdd6897731064fb0a129da3320962886a0d41aad8718452d6e090fe23, 5164K) is reproducible.
binary/kernel/netbsd-GENERIC.UP.gz (49a29b4be9d259d752ddcad240c385508e5268ab9a253d0f032ee7aa3f9bcac5, 5145K) is reproducible.
binary/kernel/netbsd-INSTALL.gz (216c40d07905b701012287a4758eba4d26158c2967735af27a6fd5fce7291458, 6268K) is reproducible.
binary/kernel/netbsd-INSTALL.symbols.gz (a46e8df0ed75bb6c81571b18e13bad3b6cffdd68a90fb45a76c791c609c33a82, 240K) is reproducible.
binary/sets/base.tar.xz (83e4000b5c028de5fb03c0dc65b4544e69151d728ad461a6074a12256e5a8bc6, 32M) is reproducible.
binary/sets/comp.tar.xz (2e803c4bab277a8dcf468f49cd8dc8ead86aa3928219780a04bc1b3d744e30a9, 44M) is reproducible.
binary/sets/etc.tar.xz (22f0110a0d5ace27c1ac1fe2196b866a174c851746af38d59fcdc3acb724eb55, 453K) is reproducible.
binary/sets/games.tar.xz (44c2419223115874bb03ee1c8c3689fe862436866d3837edf82a5c2f66fa590a, 2430K) is reproducible.
binary/sets/kern-GENERIC.tar.xz (9377ddbb9d4334e608edf18360dc8bcf61daab155ea1dc52f80b71d33c9a404b, 3707K) is reproducible.
binary/sets/kern-GENERIC.UP.tar.xz (3a9254893b9258bb255f7d22f64baef405e936df7c3e8f41000f3d7e14027a7d, 3696K) is reproducible.
binary/sets/man.tar.xz (f8806d7c7f6328bd5863a580c3347bbcba163f7fc356ea79b84f52080e382acd, 6932K) is reproducible.
binary/sets/misc.tar.xz (7b31252a375cec01050b624d10e32f74cab3b0d47a64afc3560390fb1d6355e7, 4127K) is reproducible.
binary/sets/modules.tar.xz (8c50d294bb6467ac1be072fd1d3c5e98d2b006bb6518f784a7f3b158ceb1e393, 1619K) is reproducible.
binary/sets/tests.tar.xz (6b36b69500a1f73d4556446b1097b31da51347df0982b4b4c0791e9003d64ee2, 5156K) is reproducible.
binary/sets/text.tar.xz (cc2db3da2e119db831084619e44e2de1676328b6ec502b4ced9d66df241ade31, 1803K) is reproducible.
installation/miniroot/miniroot.fs.gz (534be2bfd6e966aea3e2327d19f2906026c179e17079b4f738d6bc9552cd65e7, 7201K) is reproducible.
installation/misc/bootblk (99b37fbde6cf6d795adf645a7f820eacc7a7f36e4c30eb2d5315b0ff113af74a, 7K) is reproducible.
installation/misc/boot.fs.gz (073d886e1e4db6b23534c60ff46edac54036cb8a3670303b3b90c0a60191c13f, 58K) is reproducible.
installation/misc/installboot (c1428607b8cf9252d7d5c6dd2191e4e0993b8cf73278de79bac6719c6831305d, 98K) is reproducible.
installation/misc/instfs.tgz (ae15c0bc892518fdf6d4273cd5d7b4faadbfe4e5b1f7c262c2e54aa8e0d1aceb, 2046K) is reproducible.
installation/misc/ofwboot (29ba7c63086b84592ed302992cfe4110c00219448b98a9170a4be3f96c60f52c, 111K) is reproducible.
installation/netboot/ofwboot.net (29ba7c63086b84592ed302992cfe4110c00219448b98a9170a4be3f96c60f52c, 111K) is reproducible.
INSTALL.html (5a67a1a9eb402c07117c715a8af214e3b3c4611df79e3d8f58913acceecda172, 151K) is reproducible.
INSTALL.more (6b2bd897d571dda48d6116bd8c618689e51b0060345d92e31dd8188afad5f0f3, 121K) is reproducible.
INSTALL.ps (d00e31fde6ed21a2f5a1154e9901d985b425f057147349dc78a74969ad5a3735, 187K) is reproducible.
INSTALL.txt (d9bda45857857fc362941515d0e49520cf6ed86cda2a6296a7e4d36e0045cf58, 129K) is reproducible.

commit 8f45fc97217d94beb57f65115edec8591ef0f980
Author: jdolecek 
Date:   Wed Oct 24 20:25:52 2018 +0000

    ata_kill_active() needs to drop channel drop before calling kill_xfer() hook,
    otherwise code tries to lock against itself when deactivating the xfer