Hi, This month, I got confirmation that NLnet will sponsor my project https://en.opensuse.org/openSUSE:Reproducible_openSUSE to create an openSUSE-based distribution that consists of only bit-reproducible packages. In previous r-b-summits, one common question was "How can a user know if a package builds reproducibly?" and here the answer is simple: if it is in the repo, it must be reproducible. And there are tools to rebuild and check. Another good answer would be http://ismypackagereproducibleyet.org/?pkg=perl This will need patches for some long-standing issues in emacs, llvm/rust and more. In other news: We reached 13400 packages where I could verify binaries as bit-identical in rebuilds. This leaves less than 2000 remaining. Some of these have not been rebuilt with the new rpm version yet and some have minor issues such as .jar files with updated mtimes. Here are the autogenerated bits: last month's status: https://lists.opensuse.org/archives/list/factory@lists.opensuse.org/thread/NAST5PZPQGJ5JTHYAM6CWB7PCNCLLK6P/ Last months' reproducible builds project updates (including my work): https://reproducible-builds.org/reports/2024-03/ I uploaded https://rb.zq1.de/compare.factory-20240430/ today https://rb.zq1.de/spec/glossar.txt explains the meaning of below values: total-packages: 15456 (+56) build-tried: 15401 (+57) build-failed: 59 (+20) build-n-a: 198 (-14) build-succeeded: 15144 (+51) build-official-failed+na: 85 (-48) build-compare-failed: 150 (-11) build-compare-succeeded: 14994 (+62) verify-failed: 290 (-28) verified-semi-reproducible: 14658 (+3184) verified-bit-identical: 13406 (+12394) bit-by-bit-identical: 14429 (+87) not-bit-by-bit-identical: 724 (-21) not-bit-by-bit-identicalcheck: 715 (-36) https://rb.zq1.de/compare.factory-20240430/graph.png shows the change over time https://rb.zq1.de/compare.factory-20240430/unreproduciblerings.txt lists very unreproducible core packages (bootstrap+DVD) Of the badly unreproducible packages, 5 were in ring0 30 were in ring1 That makes it 35/4043 => 0.87 % which is below the overall average of 150/15144 => 0.99 % 724/15144 => 4.78 % of packages are not perfectly reproducible package notes: ==> ./apache-chainsaw/.rb.notes <== javadoc, minor jar ==> ./armagetron/.rb.notes <== #=> https://gitlab.com/armagetronad/armagetronad/-/merge_requests/162 date ==> ./arpack-ng/.rb.notes <== FTBFS-j1 ==> ./binutils/.rb.notes <== PGO from --enable-pgo-build=lto no problem? ==> ./caddy/.rb.notes <== => SR 1163784 FTBFS-nocheck ==> ./coredns/.rb.notes <== FTBFS-j1 parallelism ==> ./dlib/.rb.notes <== +++ /var/tmp/build-root.10b/.mount/home/abuild/rpmbuild/BUILD/dlib-19.24.4/build/temp.linux-x86_64-cpython-311/CMakeCache.txt 2040-05-22 11:23:02.039999995 +0200 @@ -474,7 +474,7 @@ ==> ./eclipse-ecf/.rb.notes <== FTBFS ?random? ==> ./fakeroot/.rb.notes <== FTBFS [ 48s] FAIL t.tar (exit status: 1) ==> ./fractal/.rb.notes <== minor build-id diff ==> ./geany/.rb.notes <== #=> SR 1169977 toolchain random = https://github.com/geany/geany/pull/3785 ==> ./ghc-timerep/.rb.notes <== parallelism ==> ./gitui/.rb.notes <== => https://github.com/extrawurst/gitui/pull/2202 date not `date` ==> ./go1.13/.rb.notes <== #=> SR 1168496 parallelism ==> ./go1.14/.rb.notes <== #=> SR 1167936 parallelism parallelism ; can -trimpath help? ==> ./go1.15/.rb.notes <== #=> SR 1168495 parallelism go buildid ==> ./gromacs/.rb.notes <== -j1 failed and other? -M openmpi ==> ./java-21-openjdk/.rb.notes <== = https://bugzilla.opensuse.org/show_bug.cgi?id=1221224 java-21-openjdk parallelism +?ASLR? becomes reproducible with oscbuildextrapkg=--extra-pkgs=reproducible-faketools-j1 rbk ==> ./java-22-openjdk/.rb.notes <== becomes reproducible with oscbuildextrapkg=--extra-pkgs=reproducible-faketools-j1 rbk ==> ./libical/.rb.notes <== FTBFS-j4 ==> ./libraw/.rb.notes <== date+ASLR+random? bogus? ==> ./libressl/.rb.notes <== found range 1872949611 -> 1872951536 ==> ./librsvg/.rb.notes <== FTBFS-cpu osc build --vm-type=kvm --clean --noservice --build-opt=--vm-custom-opt="-cpu qemu64" standard ==> ./lua-lmod/.rb.notes <== => https://github.com/TACC/Lmod/pull/702 date+time from `date` /usr/share/lmod/8.7.37/libexec/Version.lua differs (ASCII text) ==> ./mbedtls-2/.rb.notes <== FTBFS-SSL 2027-06-23 found range 1813749955 -> 1813751879 ==> ./metis/.rb.notes <== => SR 1164284 %check issue ==> ./musique/.rb.notes <== => SR 1163266 date -DEFINES = -DAPP_VERSION=1.12 -DAPP_NAME=Musique -DAPP_UNIX_NAME=musique -DBUILD_YEAR=2024 -DQT_NO_DEBUG_OUTPUT -DQT_USE_QSTRINGBUILDER -DHTTP -DMEDIA_MPV -DMEDIA_AUDIOONLY -DQAPPLICATION_CLASS=QApplication -DAPP_LINUX -DDATADIR=\"/usr/share\" -DPKGDATADIR=\"/usr/share/musique\" -DQT_NO_EXCEPTIONS -DQT_NO_DEBUG -DQT_WIDGETS_LIB -DQT_GUI_LIB -DQT_QML_LIB -DQT_NETWORK_LIB -DQT_SQL_LIB -DQT_DBUS_LIB -DQT_QMLINTEGRATION_LIB -DQT_CORE_LIB ==> ./nautilus/.rb.notes <== date from data/org.gnome.Nautilus.metainfo.xml.in.in: ==> ./nebula/.rb.notes <== = https://github.com/slackhq/nebula/issues/1124 FTBFS-2027-11-11 SSL osc build --no-service --vm-type=kvm --build-opt=--vm-custom-opt=-rtc\ base=2027-11-12T00:00:00 standard ==> ./nfdump/.rb.notes <== => SR 1163778 ==> ./ollama/.rb.notes <== #=> SR 1168020 (on top of prior 1.28 update that did not make it to Factory) #=> https://github.com/ollama/ollama/pull/2836 gzip ==> ./openssl-3/.rb.notes <== = https://bugzilla.opensuse.org/show_bug.cgi?id=1223336 random debugsource FTBFS-2035-07-02 ==> ./openssl_tpm2_engine/.rb.notes <== FTBFS ==> ./openttd/.rb.notes <== ASLR into build-id ==> ./pandoc-cli/.rb.notes <== = ghc toolchain parallelism https://gitlab.haskell.org/ghc/ghc/-/issues/12935 ==> ./perl-Verilog-Perl/.rb.notes <== FTBFS-j4 dependency error ==> ./perl/.rb.notes <== embeds build machine kernel version => must build in KVM ==> ./php-memcache/.rb.notes <== FTBFS-2038-01-05 found range 2146272623 -> 2146274548 ==> ./postfish/.rb.notes <== => SR 1168486 = https://github.com/FFTW/fftw3/issues/337 toolchain fftw3 postfish-wisdomrc random order ==> ./postgresql14/.rb.notes <== FTBFS found range good=1713439043 bad=1713440967 ==> ./postgresql15/.rb.notes <== FTBFS-? not only -j1 ==> ./pspp/.rb.notes <== parallelism issue = https://bugzilla.opensuse.org/show_bug.cgi?id=1221321 FTBFS-nocheck ==> ./python-Scrapy/.rb.notes <== FTBFS-j1 ==> ./python-WSME/.rb.notes <== FTBFS [ 18s] =========================== short test summary info ============================ ==> ./python-ZEO/.rb.notes <== FTBFS-j1 + date found range 2147460804 -> 2147462729 ==> ./python-billiard/.rb.notes <== FTBFS-j1 ==> ./python-cPyparsing/.rb.notes <== .note.gnu.build-id varies ==> ./python-django-request/.rb.notes <== FTBFS-2037? found range 2198695595 -> 2198697519 ==> ./python-gpstime/.rb.notes <== FTBFS-2024-12-28 found range 1735343872 -> 1735345797 ==> ./python-khal/.rb.notes <== = https://github.com/pimutils/khal/issues/1343 FTBFS-2028-03-12 + 2037-05-04 => https://github.com/pimutils/khal/pull/1185 flaky FTBFS ==> ./python-osprofiler/.rb.notes <== FTBFS ==> ./python-paho-mqtt/.rb.notes <== FTBFS-j1 + SSL expired found range 1783313692 -> 1783315617 ==> ./python-paramiko/.rb.notes <== FTBFS-j1 python .pyc ASLR ==> ./python-pony/.rb.notes <== FTBFS-j1 ==> ./python-pytest-httpbin/.rb.notes <== FTBFS-j1 FTBFS-2038 SSL ==> ./python-python-datamatrix/.rb.notes <== FTBFS osc build --vm-type=kvm --clean --noservice standard ==> ./python-python-for-android/.rb.notes <== FTBFS-j1 ==> ./python-python-stdnum/.rb.notes <== = https://github.com/arthurdejong/python-stdnum/issues/431 FTBFS-2039 found range 2202507502 -> 2202509426 ==> ./python-sherpa/.rb.notes <== FTBFS-j1 FTBFS-date?random? found range 1745398457 -> 1745400596 ==> ./python-spyder-notebook/.rb.notes <== FTBFS /var/tmp/rpm-tmp.xbK78N: line 85: 2912 Segmentation fault PYTHONPATH=${PYTHONPATH:+$PYTHONPATH:}/home/abuild/rpmbuild/BUILDROOT/python-spyder-notebook-0.5.1-0.x86_64/usr/lib/python3.11/site-packages PYTHONDONTWRITEBYTECODE=1 pytest-3.11 --ignore=_build.python3 -v ==> ./python-urlextract/.rb.notes <== => SR 1161342 extra file from %check +/usr/lib/python3.9/site-packages/urlextract/data/tlds-alpha-by-domain.txt.lock 0 (none) 100644 root root 0 4294967295 ==> ./python-websockets/.rb.notes <== FTBFS-j1 ==> ./rmw/.rb.notes <== = https://github.com/theimpossibleastronaut/rmw/issues/439 FTBFS-2038 found range 2147482293 -> 2147484218 ==> ./sequoia-sq/.rb.notes <== FTBFS-2026-10-05 --build-opt=--vm-custom-opt=-rtc base=2040-01-25T00:00:00 failed ==> ./tor/.rb.notes <== FTBFS-2037-04-20 found range good=2123823843 bad=2123825767 (2037-04-20T07:36:07) ==> ./ugrep/.rb.notes <== => https://bugzilla.suse.com/show_bug.cgi?id=1222752 => SR 818786 CPU ==> ./xorg-x11-fonts/.rb.notes <== toolchain fonttosfnt, -M=converted = https://bugzilla.opensuse.org/show_bug.cgi?id=1173396 ASLR : x*3 uninit bytes 'checksum adjustment'