Reproducible Builds/Status

From ArchWiki
Jump to navigation Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

Tango-go-next.pngThis article or section is a candidate for moving to Reproducible builds/Status.Tango-go-next.png

Arch Linux is constantly rebuilding core and extra packages and has a status page. This page contains a status of bad packages and what needs to be fixed.

Issues

General

  • A rebuild is required for all packages build with pacman < 5.2 to resolve file order issues and a btrfs size bug. For the file order issue the affecting extra packages can be found running the following one liner on a mirror directory:
for i in /srv/ftp/extra/os/x86_64/*.pkg.tar.??; do
   bsdtar -tf $i | grep "^\." > pkg-order
   sort pkg-order > sort-order
   if ! diff pkg-order sort-order &>/dev/null; then
     echo $i;
   fi
   rm pkg-order sort-order
done

File order rebuild FTBFS

accounts-qml-module-0.7-2-x86_64.pkg.tar.xz
archboot-2019.03-1-any.pkg.tar.xz
cmark-0.29.0-1-x86_64.pkg.tar.xz
gtk-sharp-2-2.12.45-2-x86_64.pkg.tar.xz
guile1.8-1.8.8-7-x86_64.pkg.tar.xz
java11-openjfx-11.0.3.u1-1-x86_64.pkg.tar.xz
java11-openjfx-doc-11.0.3.u1-1-x86_64.pkg.tar.xz
java11-openjfx-src-11.0.3.u1-1-x86_64.pkg.tar.xz
java8-openjfx-8.u202-3-x86_64.pkg.tar.xz
java8-openjfx-doc-8.u202-3-x86_64.pkg.tar.xz
java8-openjfx-src-8.u202-3-x86_64.pkg.tar.xz
java-openjfx-13.u14-1-x86_64.pkg.tar.xz
java-openjfx-doc-13.u14-1-x86_64.pkg.tar.xz
java-openjfx-src-13.u14-1-x86_64.pkg.tar.xz
jdk10-openjdk-10.0.2.u13-2-x86_64.pkg.tar.xz
jre10-openjdk-10.0.2.u13-2-x86_64.pkg.tar.xz
jre10-openjdk-headless-10.0.2.u13-2-x86_64.pkg.tar.xz
jsonrpc-glib-3.34.0-1-x86_64.pkg.tar.xz
libva-vdpau-driver-0.7.4-4-x86_64.pkg.tar.xz
liferea-1.12.7-1-x86_64.pkg.tar.xz
linux-atm-2.5.2-6-x86_64.pkg.tar.xz
mono-tools-4.2-2-x86_64.pkg.tar.xz
npapi-sdk-0.27.2-2-any.pkg.tar.xz
nss_ldap-265-7-x86_64.pkg.tar.xz
openjdk10-doc-10.0.2.u13-2-x86_64.pkg.tar.xz
openjdk10-src-10.0.2.u13-2-x86_64.pkg.tar.xz
pam_ldap-186-6-x86_64.pkg.tar.xz
portaudio-1:19.6.0-6-x86_64.pkg.tar.xz
qtav-1.13.0-1-x86_64.pkg.tar.xz

Packages with JAR files

JARs include a modification timestamp for each file, making them unreproducible. Depending on the build system, there are different solutions available for this.

Ant

Currently has no support for reproducible builds, see the upstream feature request.

Gradle

Should support reproducible builds out of the box.

Maven

Supports the project.build.outputTimestamp property that can be set to a fixed timestamp. Recent versions of Maven plugins respect this property to create reproducible artefacts. The property should be set in the project's pom.xml file, if upstream does not already do this, you can define it at compile time using a command like

mvn -Dproject.build.outputTimestamp="$SOURCE_DATE_EPOCH" clean package

It might be necessary to patch the project's pom.xml to update plugins to a more recent version with support for reproducible builds, see the Maven guide to reproducible builds for the minimum required versions and more information like additional necessary configuration options.

Example package (including a patch for a Maven plugin version update): junit-system-rules.

OpenJDK jar command

The builtin OpenJDK jar program will support SOURCE_DATE_EPOCH starting with OpenJDK version 15.

strip-nondeterminism

As a last resort, strip-nondeterminism from Debian is able to strip unreproducible metadata like file timestamps from a variety of file types, including JARs. It is not a cure-all (e.g. build systems might include additional unreproducible metadata in the JAR manifest, strip-nondeterminism removes some, but not all of these) and should only be used as a last resort if no native support for reproducible builds is available:

strip-nondeterminism --timestamp "$SOURCE_DATE_EPOCH"

Example package: pdftk.

KDE Kdeveloper project files

KDE creates Package App template .tar.bz2 files which tar files and userid is different when reproducing with repro which might be a bug in repro. https://gist.githubusercontent.com/jelly/570313f56ee59be7674ad4cc002232e7/raw/b85536690c48b23ce97650e8db8f0ca18c2dbf1a/gistfile1.txt

The cmake file which generates the issue.

Doxygen documentation build with graphviz-2.44.0-2

graphviz lacked a dependency on libpng, making PNG generation unavailable in dot as graphviz was installed before libpng was available and therefore not marking it as to be dlopen'd. All packages which depend on doxygen for generation documentation and with the following diff require a rebuild.

│ │ --rw-r--r--   0 root         (0) root         (0)    20234 2020-05-16 12:32:36.000000 usr/share/doc/grantlee/classGrantlee_1_1Parser.html
│ │ --rw-r--r--   0 root         (0) root         (0)      265 2020-05-16 12:32:36.000000 usr/share/doc/grantlee/classGrantlee_1_1Parser__inherit__graph.map
│ │ --rw-r--r--   0 root         (0) root         (0)       32 2020-05-16 12:32:36.000000 usr/share/doc/grantlee/classGrantlee_1_1Parser__inherit__graph.md5
│ │ --rw-r--r--   0 root         (0) root         (0)     3136 2020-05-16 12:32:36.000000 usr/share/doc/grantlee/classGrantlee_1_1Parser__inherit__graph.png
│ │ +-rw-r--r--   0 root         (0) root         (0)    19961 2020-05-16 12:32:36.000000 usr/share/doc/grantlee/classGrantlee_1_1Parser.html
│ │ +-rw-r--r--   0 root         (0) root         (0)      598 2020-05-16 12:32:36.000000 usr/share/doc/grantlee/classGrantlee_1_1Parser__inherit__graph.dot

[core]

Package Issue Solution/Patch Assignee Solved
dnssec-anchors /etc/trusted-key.key differs none none No
gcc-ada File times within some .ads files none none No
linux Signed modules none none No
linux-docs lots of issues - ordering, linking, ... none none No
linux-headers /usr/lib/modules/*/build/vmlinux diff[dead link 2021-11-15 ⓘ] none none No
linux-lts as for linux none none No
linux-lts-docs as for linux-docs none none No
linux-lts-headers as for linux-headers none none No
nss Binary differences in /usr/lib/lib{freebl3,freeblpriv3,softokn3}.chk from shlibsign none none No
perl timestamp, uname encoded in build none none No

[extra]

Package Issue Solution/Patch Assignee Solved
abiword usr/lib/python2.7/site-packages/gi/overrides/Abi.pyc and .pyo none none No
accounts-qml-module .BUILDINFO size issue - FTBFS during rebuild none none No
amdvlk many differences in usr/lib/amdvlk64.so none none No
ant .jar file differences none none No
ant-doc lots of timestamps (javadoc), and .zip file difference none none No
antlr2 usr/share/java/antlr2.jar none none No
apparmor Adding files to backup array needs sorting, usr/lib/python3.8/site-packages/LibAppArmor/__pycache__/LibAppArmor.cpython-38.pyc none none No
archboot FTBFS - missing dependencies none none No
asymptote Dates in html and info. PDF document differences (dates?) none none No
autogen Timestamp in man pages, sr/share/autogen/libopts-42.1.17.tar.gz with different file ownership, and a small binary change in usr/bin/autogen need export MAN_PAGE_DATE=... and configure --enable-timeout=70 none No
bigloo uname and timestamps all over the place none none No
breezy 3.0.2.3-3 reproducible with both repro and makechrootpkg tooling issue? none No
brltty usr/share/java/brlapi.jar none none No
check-docs lots of texi2html timestamps none none No
chromaprint binary difference in usr/bin/fpcalc none none No
clisp ip address; timestamps in ps docs, likely much more none none No
colord Profile ID differs in usr/share/color/icc/colord/{Crayons,x11-colors}.icc and binary differences in usr/lib/colord none none No
conky timestamp (from toluapp) and uname (at minimum) none none No
deluge .pyc file, .egg files none none No
doxygen-docs lots of pdfs with differences none none No
ecl uname, timestamp, gzip, lots of other binary differences none none No
eclipse-ecj .jar file none none No
efitools /usr/share/efitools/efi/LockDown.efi has binary differences none none No
efl lots of binary differences none none No
efl-docs pdf differences, including dates none none No
emacs binary differences in usr/bin/emacs none none No
extra-cmake-modules Small ordering diff in /usr/share/doc/ECM/ExtraCMakeModules.qch none none No
firefox It is firefox ; PGO? bug + patch none No
fontconfig FTBFS with repro. Timestamp inside man pages none none No
fontconfig-docs[broken link: package not found] Timestamp inside man pages none none No
fontforge Binary differences in fontforge and some libraries none none No
libakonadi user/group names of files in usr/share/kdevappwizard/templates/akonadi{resource,serializer}.tar.bz2 none none No
libbluray file attribute(?) differences in usr/share/java/{libbluray{,-awt}-j2se-1.2.0.jar none none No
libgee Binary differences in usr/lib/libgee-0.8.so.2.6.1 none none No
libgtop uname in /usr/bin/libgtop_server2 none none No
libibus /usr/lib/python2.7/site-packages/gi/overrides/IBus.pyc and .pyo have differences none none No
libjpeg-turbo FTBFS under repro. makerepropkg - many differences everywhere... none none No
liblangtag /usr/share/gir-1.0/LangTag-0.6.gir none none No
libmp4v2 timestamp in usr/include/mp4v2/project.h & usr/lib/libmp4v2.so.2.0.0 none none No
libquvi timestamp in libquvi-0.9-0.9.4.so none none No
lirc timestamp in yaml files, usr/share/lirc/lirc-0.10.1.tar.gz has lots of timestamp differences, repro causes poll() detection issue not found in makerepropkg patch none No
meson .pyc files, also some test .pyc files missing none none No
r Lots of timestamps in files, gzip timestamps, randomly(?) generated paths in /tmp/, binary differences... none none No
transmission-gtk uname in usr/bin/transmission-gtk, build with vendored depencies (miniupncpc which contains uname -r) none none No
zabbix-agent2 Timestamp in /usr/bin/zabbix_agent2 none none No
zeitgeist diff[dead link 2021-11-15 ⓘ] Weird text differences in /usr/lib/libzeitgeist-2.0.so.0.0.0 none none No