Debian Bug report logs - #863015
jellyfish: please make the output reproducible

version graph

Package: src:jellyfish; Maintainer for src:jellyfish is Debian Med Packaging Team <debian-med-packaging@lists.alioth.debian.org>;

Reported by: Chris Lamb <lamby@debian.org>

Date: Sat, 20 May 2017 07:39:01 UTC

Severity: wishlist

Tags: patch

Found in version jellyfish/2.2.6-1

Fixed in version jellyfish/2.2.6-4

Done: Andreas Tille <tille@debian.org>

Bug is archived. No further changes may be made.

Toggle useless messages

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to debian-bugs-dist@lists.debian.org, reproducible-bugs@lists.alioth.debian.org, Debian Med Packaging Team <debian-med-packaging@lists.alioth.debian.org>:
Bug#863015; Package src:jellyfish. (Sat, 20 May 2017 07:39:04 GMT) (full text, mbox, link).


Acknowledgement sent to Chris Lamb <lamby@debian.org>:
New Bug report received and forwarded. Copy sent to reproducible-bugs@lists.alioth.debian.org, Debian Med Packaging Team <debian-med-packaging@lists.alioth.debian.org>. (Sat, 20 May 2017 07:39:04 GMT) (full text, mbox, link).


Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Chris Lamb <lamby@debian.org>
To: submit@bugs.debian.org
Subject: jellyfish: please make the output reproducible
Date: Sat, 20 May 2017 08:34:49 +0100
[Message part 1 (text/plain, inline)]
Source: jellyfish
Version: 2.2.6-1
Severity: wishlist
Tags: patch
User: reproducible-builds@lists.alioth.debian.org
Usertags: timestamps toolchain buildpath
X-Debbugs-Cc: reproducible-bugs@lists.alioth.debian.org

Hi,

Whilst working on the Reproducible Builds effort [0], we noticed
that jellyfish generated JSON files that are not reproducible.

This is due to including the output of getcwd(3) and the current date
in the local timezone. It affects other packages in the archive (eg.
src:quorum).

Patch attached.

 [0] https://reproducible-builds.org/


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby@debian.org / chris-lamb.co.uk
       `-
[jellyfish.diff.txt (text/plain, attachment)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Med Packaging Team <debian-med-packaging@lists.alioth.debian.org>:
Bug#863015; Package src:jellyfish. (Fri, 25 Aug 2017 20:54:10 GMT) (full text, mbox, link).


Acknowledgement sent to Andreas Tille <andreas@fam-tille.de>:
Extra info received and forwarded to list. Copy sent to Debian Med Packaging Team <debian-med-packaging@lists.alioth.debian.org>. (Fri, 25 Aug 2017 20:54:10 GMT) (full text, mbox, link).


Message #10 received at 863015@bugs.debian.org (full text, mbox, reply):

From: Andreas Tille <andreas@fam-tille.de>
To: 863015@bugs.debian.org
Subject: Patch for reproducible builds breaks build time test
Date: Fri, 25 Aug 2017 22:18:05 +0200
Hi Chris,

thanks for the patch (and sorry for taking so much time to respond).
Unfurtunately if I activate the patch[1] one test
(unit_tests/unit_tests.sh) fails which is not the case if the patch
is deactivated in debian/patches/series:

...
PASS: tests/large_key.sh
PASS: tests/parallel_hashing.sh
FAIL: unit_tests/unit_tests.sh
=======================================
   jellyfish 2.2.6: ./test-suite.log
=======================================

# TOTAL: 13
# PASS:  9
# SKIP:  3
# XFAIL: 0
# FAIL:  1
# XPASS: 0
# ERROR: 0
...


It might be that the test relies somehow on the date in the json file.

Should I report this to upstream or do you want to investigate into the
test suite?  I admit I'm overwhelmed with gcc-7 and other bugs and will
not manage to track this down in any sensible time frame.

Kind regards and thanks in any case for the reprodicible build effort

     Andreas.


[1] https://anonscm.debian.org/git/debian-med/jellyfish.git/tree/debian/patches/reproducible.patch

-- 
http://fam-tille.de



Information forwarded to debian-bugs-dist@lists.debian.org, Debian Med Packaging Team <debian-med-packaging@lists.alioth.debian.org>:
Bug#863015; Package src:jellyfish. (Sun, 27 Aug 2017 09:09:05 GMT) (full text, mbox, link).


Acknowledgement sent to Chris Lamb <lamby@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Med Packaging Team <debian-med-packaging@lists.alioth.debian.org>. (Sun, 27 Aug 2017 09:09:05 GMT) (full text, mbox, link).


Message #15 received at 863015@bugs.debian.org (full text, mbox, reply):

From: Chris Lamb <lamby@debian.org>
To: Andreas Tille <andreas@fam-tille.de>, 863015@bugs.debian.org
Subject: Re: [Debian-med-packaging] Bug#863015: Patch for reproducible builds breaks build time test
Date: Sun, 27 Aug 2017 02:07:58 -0700
Hi Andreas,

> # FAIL:  1

Just pasting this here for now so I don't lose it. Here is the entry
in unit_tests/unit_tests.log after a failed build:

   543 [----------] 2 tests from FileHeader
   544 [ RUN      ] FileHeader.Standard
   545 unit_tests/test_file_header.cc:26: Failure
   546 Expected: ("") != (h["hostname"]), actual: "" vs ""
   547 [  FAILED  ] FileHeader.Standard (0 ms)
   548 [ RUN      ] FileHeader.WriteRead
   549 [       OK ] FileHeader.WriteRead (1 ms)
   550 [----------] 2 tests from FileHeader (1 ms total)

(More later unless you fix this first...)


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby@debian.org / chris-lamb.co.uk
       `-



Information forwarded to debian-bugs-dist@lists.debian.org, Debian Med Packaging Team <debian-med-packaging@lists.alioth.debian.org>:
Bug#863015; Package src:jellyfish. (Sun, 27 Aug 2017 21:03:03 GMT) (full text, mbox, link).


Acknowledgement sent to Chris Lamb <lamby@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Med Packaging Team <debian-med-packaging@lists.alioth.debian.org>. (Sun, 27 Aug 2017 21:03:03 GMT) (full text, mbox, link).


Message #20 received at 863015@bugs.debian.org (full text, mbox, reply):

From: Chris Lamb <lamby@debian.org>
To: Andreas Tille <andreas@fam-tille.de>, 863015@bugs.debian.org
Subject: Re: [Debian-med-packaging] Bug#863015: Patch for reproducible builds breaks build time test
Date: Sun, 27 Aug 2017 22:00:09 +0100
Hi Andreas,

  7 --- a/include/jellyfish/generic_file_header.hpp
  8 +++ b/include/jellyfish/generic_file_header.hpp
  9 @@ -180,6 +180,8 @@ public:
 10 
 11  protected:
 12    std::string get_hostname() const {
 13 +    if(std::getenv("SOURCE_DATE_EPOCH"))
 14 +      return "";
                  ^^

Just change this to "hostname".

The test was checking whether it was not the empty string. Thinking about
it, returning an empty string is probably not a good idea anyway.

Enjoy :)


Best wishes,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby@debian.org / chris-lamb.co.uk
       `-



Reply sent to Andreas Tille <tille@debian.org>:
You have taken responsibility. (Mon, 28 Aug 2017 13:39:09 GMT) (full text, mbox, link).


Notification sent to Chris Lamb <lamby@debian.org>:
Bug acknowledged by developer. (Mon, 28 Aug 2017 13:39:09 GMT) (full text, mbox, link).


Message #25 received at 863015-close@bugs.debian.org (full text, mbox, reply):

From: Andreas Tille <tille@debian.org>
To: 863015-close@bugs.debian.org
Subject: Bug#863015: fixed in jellyfish 2.2.6-4
Date: Mon, 28 Aug 2017 13:35:23 +0000
Source: jellyfish
Source-Version: 2.2.6-4

We believe that the bug you reported is fixed in the latest version of
jellyfish, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 863015@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Andreas Tille <tille@debian.org> (supplier of updated jellyfish package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Format: 1.8
Date: Mon, 28 Aug 2017 14:40:40 +0200
Source: jellyfish
Binary: jellyfish libjellyfish-2.0-2 libjellyfish-2.0-dev python3-dna-jellyfish libjellyfish-perl jellyfish-examples
Architecture: source
Version: 2.2.6-4
Distribution: unstable
Urgency: medium
Maintainer: Debian Med Packaging Team <debian-med-packaging@lists.alioth.debian.org>
Changed-By: Andreas Tille <tille@debian.org>
Description:
 jellyfish  - count k-mers in DNA sequences
 jellyfish-examples - count k-mers in DNA sequences (examples for testing)
 libjellyfish-2.0-2 - count k-mers in DNA sequences (dynamic library of jellyfish)
 libjellyfish-2.0-dev - count k-mers in DNA sequences (development files of jellyfish)
 libjellyfish-perl - count k-mers in DNA sequences (Perl bindings of jellyfish)
 python3-dna-jellyfish - count k-mers in DNA sequences (Python bindings of jellyfish)
Closes: 863015
Changes:
 jellyfish (2.2.6-4) unstable; urgency=medium
 .
   * Make sure reproducible patch will not break test suite (Thanks to
     Chris Lamb <lamby@debian.org> for the fix)
     Closes: #863015
   * Autoreconf not needed with debhelper 10
   * Do not parse debian/changelog
   * Fix whatis entry in manpage
   * Fix spelling in manpage
Checksums-Sha1:
 57d9b23d7d5ac347b1a19eb1e8d6e3652bcaff33 2570 jellyfish_2.2.6-4.dsc
 f5567d9718a128770f331ea64926df4ddcc88763 12240 jellyfish_2.2.6-4.debian.tar.xz
 4a9d9017ca1ba65d0f4ddaba20740255a302d168 13018 jellyfish_2.2.6-4_source.buildinfo
Checksums-Sha256:
 f6019ac0bea1dc452c728a085bdf042bc3841c6f59cc4a7d59554410a6d1e792 2570 jellyfish_2.2.6-4.dsc
 d5fd20cd31019c8fef541c96a4c6206b9cc02891906ae0526db0fea38b93d457 12240 jellyfish_2.2.6-4.debian.tar.xz
 8a84bd7ea92610d308923b4f935f7ec2b8fff12ef7e1acbe33e81e7fe731e2a6 13018 jellyfish_2.2.6-4_source.buildinfo
Files:
 d7a7a41fde6f6ea5d636b9314d31c8f6 2570 science optional jellyfish_2.2.6-4.dsc
 897d3d52a131c462604f63cdfb025d0f 12240 science optional jellyfish_2.2.6-4.debian.tar.xz
 fbed2483e0ef9dbe0f241cb8d86a99b8 13018 science optional jellyfish_2.2.6-4_source.buildinfo

-----BEGIN PGP SIGNATURE-----

iQJCBAEBCgAsFiEE8fAHMgoDVUHwpmPKV4oElNHGRtEFAlmkGQYOHHRpbGxlYUBy
a2kuZGUACgkQV4oElNHGRtGUuxAAmqYi1YyzCf+yj+g9KAMv2B6vqMkdpp5ZCRip
6Hm4JUc8deKizeqsseICy/U0fenEATvtd1qMzZGQtXojMJO0DJrw+CYxKr7Bg6FZ
60SlCnyJbZ+3v5W7kVkRp6DNcQ6YdFzO8EfSdgbdRTig9jTcgxi2P1l6YKKbp0N5
o+uulO6F+owxyYvBrsKcINJXGg/rsFvIvRcvRD0B/mU8VOwwZgYIcMSEBCDSBeNa
KuskoNuAsgplkKGV4WZc3gHVLA3Zh96JcFng/yURr7BOr/2RcUbQR1jZgUXT7jqu
SKg0g4voatDMSc8WpSSaJR7U2IuNnO58UHDy9FJfrpNR3DPXpjxgDub6LU+UPRov
BAHfWpb0QsyybYAAaTbyNYJnIJfXTYqEmXAFCK06YnyqVIsblwJjpMcILbst+HAI
aljZchRRlyU7goSaFx6vSGwXeqg2rnFasNxASVO3byyfLb1qCuTba+wG2/wT49cT
n6vodvbJo8f7rp5jswVnSt736LxZ5OMWNVT4Mjco+LTJ6+LWuOXqkgbyZFIj9jPc
sLVTzPrm2pY0mHguodeCrGUxqob2CcwDmwQBzYkaYyy8U1w3R4DtT4jUSUk5K2+V
rmdwbjx7DINvUiPXrl9UVdneU8NSEic+2/GUczn76w1wPmY0B7aY0R6IFcDqthxj
pDm2Y00=
=HoIo
-----END PGP SIGNATURE-----




Bug archived. Request was from Debbugs Internal Request <owner@bugs.debian.org> to internal_control@bugs.debian.org. (Wed, 04 Oct 2017 07:25:10 GMT) (full text, mbox, link).


Send a report that this bug log contains spam.


Debian bug tracking system administrator <owner@bugs.debian.org>. Last modified: Wed May 17 10:14:29 2023; Machine Name: buxtehude

Debian Bug tracking system

Debbugs is free software and licensed under the terms of the GNU Public License version 2. The current version can be obtained from https://bugs.debian.org/debbugs-source/.

Copyright © 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson, 2005-2017 Don Armstrong, and many other contributors.