Reproducible NetBSD ?

Reproducible builds enable anyone to reproduce bit by bit identical binary packages from a given source, so that anyone can verify that a given binary derived from the source it was said to be derived. There is more information about reproducible builds on the Debian wiki and on https://reproducible-builds.org. These pages explain in more depth why this is useful, what common issues exist and which workarounds and solutions are known.

Reproducible NetBSD is an effort to apply this to NetBSD. Thus each NetBSD target is build twice, with a few variations added and then the resulting files from the two builds are compared using diffoscope. Please note that the toolchain is not varied at all as the rebuild happens on exactly the same system. More variations are expected to be seen in the wild.

There is a weekly run jenkins job to test the master branch of netbsd.git. The jenkins job is running reproducible_netbsd.sh in a Debian environment and this script is solely responsible for creating this page. Feel invited to join #reproducible-builds (on irc.oftc.net) to request job runs whenever sensible. Patches and other feedback are very much appreciated - if you want to help, please start by looking at the ToDo list for NetBSD, you might find something easy to contribute.
Thanks to IONOS for donating the virtual machines this is running on!

59 (98.3%) out of 60 built NetBSD files were reproducible in our test setup . These tests were last run on 2023-02-06 for version 3013c7cb3 with MKREPRO=yes and MKREPRO_TIMESTAMP=1675246940 and were compared using diffoscope 234.

variation	first build	second build
hostname	osuosl184-amd64 or osuosl170-amd64	the other one
domainname	is not yet varied between rebuilds of NetBSD.
env CAPTURE_ENVIRONMENT	not set	CAPTURE_ENVIRONMENT="I capture the environment"
env TZ	TZ="/usr/share/zoneinfo/Etc/GMT+12"	TZ="/usr/share/zoneinfo/Etc/GMT-14"
env LANG	LANG="en_GB.UTF-8"	LANG="et_EE.UTF-8"
env LC_ALL	not set	LC_ALL="et_EE.UTF-8"
env PATH	PATH="/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:"	PATH="/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/i/capture/the/path"
env USER	is not yet varied between rebuilds of NetBSD.
uid	is not yet varied between rebuilds of NetBSD.
gid	is not yet varied between rebuilds of NetBSD.
UTS namespace	is not yet varied between rebuilds of NetBSD.
kernel version, modified using /usr/bin/linux64 --uname-2.6	Linux 5.10.0-21-amd64	Linux 2.6.70-21-amd64
umask	0022	0002
CPU type	Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz	same for both builds
/bin/sh	is not yet varied between rebuilds of NetBSD.
year, month, date	today (2023-02-06)	same for both builds (currently, work in progress)
hour, minute	hour and minute will probably vary between two builds...	the future system actually runs 398 days, 6 hours and 23 minutes ahead...
Filesystem	tmpfs	same for both builds (currently, this could be varied using disorderfs)
everything else...	is likely the same. There will be more variations in the wild.

Unreproducible artifacts for `sparc64`
binary/sets/man.tar.xz (7380K) is unreproducible.

Reproducible artifacts for `amd64`
binary/kernel/netbsd-GENERIC.gz (0945e68bd4ba93ed462238d840e48a4db455494061e58b3a68da8f2400acbf54, 10781K) is reproducible.
binary/kernel/netbsd-GENERIC_KASLR.gz (d10d567db60e0627f869e6a1d7a388653ec92d82cb9f4453978dc680f969e221, 11793K) is reproducible.
binary/kernel/netbsd-GENERIC.symbols.gz (ba3608d1886fbd6151eff9deb8b30966ca5645af7b7dca5e285afd1f003d18cb, 503K) is reproducible.
binary/kernel/netbsd-INSTALL.gz (e97e04c0f6e9f55d3e89e42cba45bb6d7161fd98c881a531783464663c808192, 8918K) is reproducible.
binary/kernel/netbsd-INSTALL.symbols.gz (b78d1de971cfe0e85aa2c95d8a08a3e2e2a8ab20d810c5cead0350787cef04b0, 366K) is reproducible.
binary/kernel/netbsd-INSTALL_XEN3_DOMU.gz (3e436160abfdd320382504059a96960eb92dae32e45851350caf2a03ed3d415b, 4338K) is reproducible.
binary/kernel/netbsd-XEN3_DOM0.gz (0d00921a7a897baa1345b2463191cb0597487f48c3910925e86198350cf43319, 7288K) is reproducible.
binary/kernel/netbsd-XEN3_DOMU.gz (0b7e5bb4311f5716aff0a301da13e123ae3eac4d65bf92cbe8977d8d0546aded, 2726K) is reproducible.
binary/sets/base.tar.xz (acb1a87b86255e61557d3947fee39f12f4b4f220ebabd6d077413a090ea90e3f, 41M) is reproducible.
binary/sets/comp.tar.xz (42ff4153dcb0eb36c45ade34cfb2041afbc0437494f0a8265c5eadb6c2bff16c, 67M) is reproducible.
binary/sets/etc.tar.xz (795d84c026686c69181561edff1f687673be817358f1dad43cfe7fc72b8f6920, 484K) is reproducible.
binary/sets/games.tar.xz (29a310b0f5b66f7ec082d2bba1cf579612fb12df0797e04d5e5c5f286e881338, 2488K) is reproducible.
binary/sets/gpufw.tar.xz (95b3973a8a771a7b918e051fd2216cb024650daae46525f45b832bd6831a7313, 4045K) is reproducible.
binary/sets/kern-GENERIC_KASLR.tar.xz (d49182aaa543b3498c30bc3807d87811157295a18aff3cffbe90e0704da3898d, 8898K) is reproducible.
binary/sets/kern-GENERIC.tar.xz (e0bc46e8eff010d45561e29e7d850fe4546e540efb2fd949a744e2832c8c4240, 8623K) is reproducible.
binary/sets/kern-XEN3_DOM0.tar.xz (07b4cec4f0c8a23d38259f2486932b5ad054113521d1737357527d1467dda70b, 5716K) is reproducible.
binary/sets/kern-XEN3_DOMU.tar.xz (a3430c8651c95222823f70e1b2c17755848f9923d79991c3936f1ae4c8032fd7, 2208K) is reproducible.
binary/sets/man.tar.xz (b5ae9256db807395b5e42df8a588cf6cce4be5445fae99e03966ebb94e1a4390, 7402K) is reproducible.
binary/sets/misc.tar.xz (aea3dc8540251be3a9acd550038ad03638480237c6e783e70c7e07e8b990258c, 4035K) is reproducible.
binary/sets/modules.tar.xz (39359012a98283fba4ece0ce0ee32f54f906d9e7be098b380e04728a1d1b57ae, 9608K) is reproducible.
binary/sets/rescue.tar.xz (978001f79aab9e21c517a76636505001450cadfb7543a3c6cb82291333c1b182, 2953K) is reproducible.
binary/sets/tests.tar.xz (9a196deb53ffc1385fed8bdaad2c6de93c45574c9371ff0f29e8ef0d97e636ad, 10242K) is reproducible.
binary/sets/text.tar.xz (6534d70a84d01be1ad7aa0e75f5beb9217c8b8ee3ecf920b74a03a1f45f27788, 1874K) is reproducible.
installation/cdrom/boot-com.iso (1acbdb07e5b950adbb6df9d8e79b7f3cbf32cc8a2b6213b586f71d487a2e19d6, 287M) is reproducible.
installation/cdrom/boot.iso (236394c6dce9d6162138dce212c8e07e1eb7ce30f745c1df0b49ab8aa214c0ed, 287M) is reproducible.
installation/miniroot/cgdroot.kmod (6dc00fd8a236f4f8997eaddb0614c403fa4835b7b1e8b626742b8322323ad834, 1440K) is reproducible.
installation/miniroot/miniroot.kmod (4e2e4a2737bf45f33626d0f6ca4b6c89675f8d48c0047fdd537b93ca87744c12, 1610K) is reproducible.
installation/misc/pxeboot_ia32.bin (37146b3ea75df268ae26ff595bfa7491b7c21f38f4ef14fc84af75e6dc22c52f, 68K) is reproducible.
INSTALL.html (4193d2f7d8d049aa189b044b2c6a2a121b1294d7f0d2e0def6b447f3d45de4fb, 81K) is reproducible.
INSTALL.more (2ef9abc8fe8b32cad7cc270371de57fd47124df1c9250e04ca0f3a78bfa47bb7, 79K) is reproducible.
INSTALL.ps (94dc4128659152eb999b990125314b2d07a51c5988ebf3fcc2634ea14aaf792f, 131K) is reproducible.
INSTALL.txt (ac609763eb60552b49c5bddf958a45aef4b55ea4f1320116770f4d3be3259f3f, 78K) is reproducible.

Reproducible artifacts for `sparc64`
binary/kernel/netbsd-GENERIC.gz (180d05a6ebd7e5f0ce70dfe4e70d031dc088b2509dc6a5488e46325bf8dc157b, 5979K) is reproducible.
binary/kernel/netbsd-GENERIC.UP.gz (c549bcc63668f0f1b3d7f568e381d5a557e50d6a7dc985a171e275c9e5663ffd, 5969K) is reproducible.
binary/kernel/netbsd-INSTALL.gz (66ea098f3eb5b066cc3c3413b4683e12962e89aa8ece65ecf613bcfc07e0476c, 6870K) is reproducible.
binary/kernel/netbsd-INSTALL.symbols.gz (b9bcedc7f7e69233ca28ebd45df28f73c54502f366f566c5b5387946c1443683, 274K) is reproducible.
binary/sets/base.tar.xz (3b8bfa4edc97a5e6ad518b931f82551b7c124d6a389fff6dd9b066ed86ed9b93, 37M) is reproducible.
binary/sets/comp.tar.xz (2917700cd4d80dbb13b8ecd86a36c650136b789bc5a0f2e39db8f328d6a42b30, 59M) is reproducible.
binary/sets/etc.tar.xz (bcae1b065da466752e9935f316a91b5029dec1c13bea8054da1ccccd6bc9d55d, 483K) is reproducible.
binary/sets/games.tar.xz (6020fb73e5746151785b7d818112299019a66d54cbee7686ba421e3d650f7403, 2498K) is reproducible.
binary/sets/gpufw.tar.xz (e0c46b815309bf1f170e490662e7e98efbb16aa76b779c2eca887f21a10dc31f, 1K) is reproducible.
binary/sets/kern-GENERIC.tar.xz (1e0d208c04f4b67c5a82bcb7f03ae79c8a0d08e99eb3a3a9e92db8444e041615, 4276K) is reproducible.
binary/sets/kern-GENERIC.UP.tar.xz (2e41ed688adadcaabd9036c4cc92e18d240e8e8c26448005f7e02325335dccd9, 4269K) is reproducible.
binary/sets/misc.tar.xz (aea3dc8540251be3a9acd550038ad03638480237c6e783e70c7e07e8b990258c, 4035K) is reproducible.
binary/sets/modules.tar.xz (d9385e9dd11df89cd779f5841febfe2ccdd00b987423440fc87d1316fc65980e, 2562K) is reproducible.
binary/sets/rescue.tar.xz (e153c0fe0c19fe92728a1a7c9526a3b38163f98a5064927d600281bc7a4421f2, 2770K) is reproducible.
binary/sets/tests.tar.xz (4716b35412750c0f3f1009a8ddc5023d1f1f5c38295077c63c6e98051cf770a8, 9456K) is reproducible.
binary/sets/text.tar.xz (c424e97c8ebce3a31430c65a88588a6580ead993488340d33bce2c1cfdaed93d, 1816K) is reproducible.
installation/miniroot/miniroot.fs.gz (4f7d67cdda792545785cf024f5689a656098343a7238f9c7a2d5f4f2fe4e2227, 8061K) is reproducible.
installation/misc/bootblk (9b8f33a1031160240cfe3ce389abb78437e2ceb51e6449182ac65423bae65922, 7K) is reproducible.
installation/misc/boot.fs.gz (04f219a7ea0907055fb9ba8f10c92d8d2053c754c052b61cc04fdb57c9b5234d, 58K) is reproducible.
installation/misc/installboot (140617a9d4d3bac00598a9b416603d914997977d36a2ce837db6792c4b9d0f4a, 138K) is reproducible.
installation/misc/instfs.tgz (37cc25edad3b6cb32e9985a741498fb2d9f962b73de45897091f6ced8eb59708, 2094K) is reproducible.
installation/misc/ofwboot (baeb20e0762e71d6f56964b191f758e322f031cfd37e2c1d5c8151cad28704d1, 121K) is reproducible.
installation/netboot/ofwboot.net (baeb20e0762e71d6f56964b191f758e322f031cfd37e2c1d5c8151cad28704d1, 121K) is reproducible.
INSTALL.html (21e0a9281cfa0405ab3a87329c3ecc2a0530c770e9e5042b9514aa3bf12ba8b8, 126K) is reproducible.
INSTALL.more (8cb21a63e4deb3e70f474830b7486eb356038902b11dcb6e0431921fb6fa0338, 121K) is reproducible.
INSTALL.ps (a810c9b7297bf9dcbbd1b5783ab8266342d2f89abfbf1ad7fd8123326c60efd3, 196K) is reproducible.
INSTALL.txt (58fd3f5a4f99a165c2d7a585747de4f91cc74620b2ad4287fc72964bb17a3259, 119K) is reproducible.

commit 3013c7cb346682f89f992238794c438d22702e20
Author: uwe 
Date:   Wed Feb 1 10:22:20 2023 +0000

    ddbping - restore the original narration of the example, NFCI
    
    Adjust previous change so that it only replaces my home-grown define
    for the end marker with the new official DDB_END_CMD marker that it
    introduced.  Undo the rest of that last change.
    
    As the author of this example I'm pretty sure what example I wanted to
    set and this narration order is an important part of it.