Debian Bug report logs - #977154
cctools: reproducible builds: python files contain different content depending on parallelism

version graph

Package: src:cctools; Maintainer for src:cctools is Alastair McKinstry <mckinstry@debian.org>;

Reported by: Vagrant Cascadian <vagrant@reproducible-builds.org>

Date: Fri, 11 Dec 2020 20:21:01 UTC

Severity: normal

Tags: patch

Fixed in version cctools/7.1.2-5

Done: Alastair McKinstry <mckinstry@debian.org>

Bug is archived. No further changes may be made.

Toggle useless messages

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to debian-bugs-dist@lists.debian.org, reproducible-bugs@lists.alioth.debian.org, Alastair McKinstry <mckinstry@debian.org>:
Bug#977154; Package src:cctools. (Fri, 11 Dec 2020 20:21:03 GMT) (full text, mbox, link).


Acknowledgement sent to Vagrant Cascadian <vagrant@reproducible-builds.org>:
New Bug report received and forwarded. Copy sent to reproducible-bugs@lists.alioth.debian.org, Alastair McKinstry <mckinstry@debian.org>. (Fri, 11 Dec 2020 20:21:03 GMT) (full text, mbox, link).


Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Vagrant Cascadian <vagrant@reproducible-builds.org>
To: submit@bugs.debian.org
Subject: cctools: reproducible builds: python files contain different content depending on parallelism
Date: Fri, 11 Dec 2020 12:18:17 -0800
[Message part 1 (text/plain, inline)]
Source: cctools
Severity: normal
Tags: patch
User: reproducible-builds@lists.alioth.debian.org
Usertags: randomness
X-Debbugs-Cc: reproducible-bugs@lists.alioth.debian.org

Various .py files contain different code dependending on the level of
parallelism of the build.


The attached patch to debian/rules passes --no-parallel to dh, which
results in a reproducible build, but it is unclear weather the resulting
code is "correct", as some files contain additional code compared to
builds done with parallelism.


In general, I've found the parallel builds to produce the same code as
other parallel builds with different levels of parallelism, but clearly
different than serial builds.

Presumably there are jobs when run in parallel complete in a relatively
consistent order (e.g. two jobs, one very fast and one very slow), but
different than when run in serial (e.g. the slow job runs first?). I
have attached diffoscope output from a serial vs. parallel build.


Thanks for maintaining cctools!


live well,
  vagrant
[0003-debian-rules-Disable-parallel-builds-to-avoid-change.patch (text/x-diff, inline)]
From 6577696033df719f86734a7647d241374bc1b7ea Mon Sep 17 00:00:00 2001
From: Vagrant Cascadian <vagrant@reproducible-builds.org>
Date: Fri, 11 Dec 2020 19:04:08 +0000
Subject: [PATCH 3/3] debian/rules: Disable parallel builds to avoid changes in
 Chirp.py.

---
 debian/rules | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/debian/rules b/debian/rules
index 48eb287..9a70f9b 100755
--- a/debian/rules
+++ b/debian/rules
@@ -6,7 +6,7 @@ export DH_VERBOSE=1
 
 # one ring to rule them all ...
 %:
-	dh $@ 
+	dh $@ --no-parallel
 
 PY3:=$(shell py3versions -d)
 CF:=$(shell dpkg-buildflags --get CFLAGS) 
-- 
2.29.2

[experiment-1.diffoscope.out (application/octet-stream, attachment)]
[signature.asc (application/pgp-signature, inline)]

Reply sent to Alastair McKinstry <mckinstry@debian.org>:
You have taken responsibility. (Tue, 15 Dec 2020 13:51:07 GMT) (full text, mbox, link).


Notification sent to Vagrant Cascadian <vagrant@reproducible-builds.org>:
Bug acknowledged by developer. (Tue, 15 Dec 2020 13:51:07 GMT) (full text, mbox, link).


Message #10 received at 977154-close@bugs.debian.org (full text, mbox, reply):

From: Debian FTP Masters <ftpmaster@ftp-master.debian.org>
To: 977154-close@bugs.debian.org
Subject: Bug#977154: fixed in cctools 7.1.2-5
Date: Tue, 15 Dec 2020 13:49:16 +0000
Source: cctools
Source-Version: 7.1.2-5
Done: Alastair McKinstry <mckinstry@debian.org>

We believe that the bug you reported is fixed in the latest version of
cctools, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 977154@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Alastair McKinstry <mckinstry@debian.org> (supplier of updated cctools package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Format: 1.8
Date: Tue, 15 Dec 2020 12:55:50 +0000
Source: cctools
Architecture: source
Version: 7.1.2-5
Distribution: unstable
Urgency: medium
Maintainer: Alastair McKinstry <mckinstry@debian.org>
Changed-By: Alastair McKinstry <mckinstry@debian.org>
Closes: 977151 977153 977154
Changes:
 cctools (7.1.2-5) unstable; urgency=medium
 .
   [ Vagrant Cascadian ]
   * Embeds the home dir in binaries. Closes: #977151
   * Embeds the home dir in binaries. Closes: #977153
 .
   [ Alastair McKinstry ]
   * Set no-parallel to make build reproducible. Closes: #977154
Checksums-Sha1:
 45dd3aa195d995be1b29e000ac7061364e4775d0 2488 cctools_7.1.2-5.dsc
 869114852376e24d04a448e846c189108fec2222 22864 cctools_7.1.2-5.debian.tar.xz
Checksums-Sha256:
 b9a9137da485e47bd10f9d3fd2dc7ed34c953eb4bc66c6faa059b0f6c3accd35 2488 cctools_7.1.2-5.dsc
 3d7bc10ad9c6ea40510e4fc76bc4c43de8485c0e89a1cc59e08803da8908f20d 22864 cctools_7.1.2-5.debian.tar.xz
Files:
 4d400b0135478b0cc94354ffe7694395 2488 utils optional cctools_7.1.2-5.dsc
 7b3ff43365df0f9752433dc3050e7ba4 22864 utils optional cctools_7.1.2-5.debian.tar.xz

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCAAdFiEEgjg86RZbNHx4cIGiy+a7Tl2a06UFAl/YvGEACgkQy+a7Tl2a
06UYWw/+Nq3GaX9f87yGbViYxe3F+1fBpLFxlQvkKhTSGl61TUDvvSsrJOJePTcA
SaHaeTqTHsACan/mo479X7KYIBEnYWOP6E6G9n4PNu5TtBUBk0DNPmemrpV4cURd
f3rS/HnLXXKf1UWC+3Z6PZOzXcEi8/Ln9f0YOA1bnKjwQgafs1H4lpE2ShC3B1pD
ndq2U3G76bcH2qUowoMoljiHczJrg7/2vsycH3otQoNWNbAyboSOICX3CfwRVvqy
cVne1nC4OP21SXcH3wtU1YnvO7Jxe++bsp8+k4W08nbUPilkerYd/3FM+z/2Q3mk
45Wu920YDlskcTXQ0xJa05h5H1qUJppkpxAeX8fz3NKJN01Gftig1QzBGdOpzPn7
VMBBWDzDsMEXg2PksodZ6f8rSQbRBWa6uEg8VqYhJV1eohpnrsl9y20XelYFj8OP
1s1j9Af2T2G6FEt6fKsuZ8YkSk43Qr+poyQQS59voMcchOUZonRQ0j8as60ku66r
q0WBInEqD/cAAPOafEUXKLuLXGomtyqKG78GZ2FZwI2qZOZaAuWhKt81RxPBrh0Q
ZPkxc3BZwkGL89LxUE4+ugrZNfujCel/VTiLA+x4EoZs3Efe9X/dIP1h16Lnf2Bg
XBYL+sVARG64yip1Pbb00P1Hwc974bhrheArux9bZGrbGdyNYFg=
=vO23
-----END PGP SIGNATURE-----




Bug archived. Request was from Debbugs Internal Request <owner@bugs.debian.org> to internal_control@bugs.debian.org. (Sun, 17 Jan 2021 07:29:06 GMT) (full text, mbox, link).


Send a report that this bug log contains spam.


Debian bug tracking system administrator <owner@bugs.debian.org>. Last modified: Wed May 17 12:50:56 2023; Machine Name: buxtehude

Debian Bug tracking system

Debbugs is free software and licensed under the terms of the GNU Public License version 2. The current version can be obtained from https://bugs.debian.org/debbugs-source/.

Copyright © 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson, 2005-2017 Don Armstrong, and many other contributors.