Debian Bug report logs - #903444
diffoscope: FileNotFoundError: [Errno 2] No such file or directory: '$HOME/.binwalk/magic' with gfxboot/4.5.2-1.1-6

Toggle useless messages

Message #3 received at submit@bugs.debian.org (full text, mbox, reply):

From: Mattia Rizzolo <mattia@debian.org>

To: submit@bugs.debian.org

Subject: diffoscope: FileNotFoundError with gfxboot/4.5.2-1.1-6

Date: Tue, 10 Jul 2018 10:06:51 +0200

[Message part 1 (text/plain, inline)]

Package: diffoscope
Version 98
Severity: important

As seen with gfxboot/4.5.2-1.1-6 (both buster/sid and amd64/i386):

Sun Jul  8 23:41:52 UTC 2018  I: diffoscope 98 will be used to compare the two builds:
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/diffoscope/main.py", line 460, in main
    sys.exit(run_diffoscope(parsed_args))
  File "/usr/lib/python3/dist-packages/diffoscope/main.py", line 432, in run_diffoscope
    difference = compare_root_paths(path1, path2)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/compare.py", line 68, in compare_root_paths
    difference = compare_files(file1, file2)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/compare.py", line 118, in compare_files
    return file1.compare(file2, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/debian.py", line 184, in compare
    differences = super().compare(other, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/file.py", line 366, in compare
    difference = self._compare_using_details(other, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/file.py", line 321, in _compare_using_details
    other.as_container, no_recurse=no_recurse))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/container.py", line 177, in compare_pair
    file1, file2, source=None, diff_content_only=no_recurse)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/compare.py", line 118, in compare_files
    return file1.compare(file2, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/file.py", line 366, in compare
    difference = self._compare_using_details(other, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/file.py", line 321, in _compare_using_details
    other.as_container, no_recurse=no_recurse))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/container.py", line 177, in compare_pair
    file1, file2, source=None, diff_content_only=no_recurse)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/compare.py", line 118, in compare_files
    return file1.compare(file2, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/file.py", line 366, in compare
    difference = self._compare_using_details(other, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/file.py", line 321, in _compare_using_details
    other.as_container, no_recurse=no_recurse))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/container.py", line 177, in compare_pair
    file1, file2, source=None, diff_content_only=no_recurse)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/compare.py", line 118, in compare_files
    return file1.compare(file2, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/file.py", line 366, in compare
    difference = self._compare_using_details(other, source)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/file.py", line 321, in _compare_using_details
    other.as_container, no_recurse=no_recurse))
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/container.py", line 177, in compare_pair
    file1, file2, source=None, diff_content_only=no_recurse)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/compare.py", line 108, in compare_files
    specialize(file1)
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/specialize.py", line 49, in specialize
    if try_recognize(file, cls, cls.recognizes):
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/utils/specialize.py", line 36, in try_recognize
    if not recognizes(file):
  File "/usr/lib/python3/dist-packages/diffoscope/comparators/binwalk.py", line 88, in recognizes
    directory=unpacked.name,
  File "/usr/lib/python3/dist-packages/binwalk/__init__.py", line 8, in scan
    objs = m.execute()
  File "/usr/lib/python3/dist-packages/binwalk/core/module.py", line 729, in execute
    obj = self.run(module)
  File "/usr/lib/python3/dist-packages/binwalk/core/module.py", line 746, in run
    obj = self.load(module, kwargs)
  File "/usr/lib/python3/dist-packages/binwalk/core/module.py", line 774, in load
    argv.update(self.dependencies(module, argv['enabled']))
  File "/usr/lib/python3/dist-packages/binwalk/core/module.py", line 800, in dependencies
    depobj = self.run(dependency.module, dependency=True, kwargs=dependency.kwargs)
  File "/usr/lib/python3/dist-packages/binwalk/core/module.py", line 746, in run
    obj = self.load(module, kwargs)
  File "/usr/lib/python3/dist-packages/binwalk/core/module.py", line 775, in load
    return module(self, **argv)
  File "/usr/lib/python3/dist-packages/binwalk/core/module.py", line 233, in __init__
    self.plugins = binwalk.core.plugin.Plugins(self)
  File "/usr/lib/python3/dist-packages/binwalk/core/plugin.py", line 93, in __init__
    self.settings = binwalk.core.settings.Settings()
  File "/usr/lib/python3/dist-packages/binwalk/core/settings.py", line 44, in __init__
    magic=self._magic_signature_files(user_only=True),
  File "/usr/lib/python3/dist-packages/binwalk/core/settings.py", line 70, in _magic_signature_files
    files += [os.path.join(user_dir, x) for x in os.listdir(user_dir)]
FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/jenkins/.binwalk/magic'


Interestingly, I couldn't reproduce this locally, so it might have
something to do with the environment we are calling diffoscope in
jenkins (notice the odd file it seems to be looking for while
crashing…).

Artifacts are available in
https://tests.reproducible-builds.org/debian/artifacts/r00t-me/gfxboot_unstable_amd64_tmp-dakAv/b1/
for a few more hours, or I have a copy with me as well for now.

-- 
regards,
                        Mattia Rizzolo

GPG Key: 66AE 2B4A FCCF 3F52 DA18  4D18 4B04 3FCD B944 4540      .''`.
more about me:  https://mapreri.org                             : :'  :
Launchpad user: https://launchpad.net/~mapreri                  `. `'`
Debian QA page: https://qa.debian.org/developer.php?login=mattia  `-

[signature.asc (application/pgp-signature, inline)]

Message #10 received at 903444@bugs.debian.org (full text, mbox, reply):

From: Chris Lamb <lamby@debian.org>

To: 903444@bugs.debian.org

Subject: Re: diffoscope: FileNotFoundError: [Errno 2] No such file or directory: '/home/lamby/.binwalk/magic' with gfxboot/4.5.2-1.1-6

Date: Mon, 10 Sep 2018 18:06:47 +0100

tags 903444 + pending
thanks

Fixed in Git, pending upload:

  https://salsa.debian.org/reproducible-builds/diffoscope/commit/075acf2f8c599e0f53463fee368a1a929e94a8eb

  diffoscope/comparators/binwalk.py | 8 ++++++++
  1 file changed, 8 insertions(+)


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby@debian.org / chris-lamb.co.uk
       `-

Message #15 received at 903444@bugs.debian.org (full text, mbox, reply):

From: Mattia Rizzolo <mattia@debian.org>

To: Chris Lamb <lamby@debian.org>, 903444@bugs.debian.org

Subject: Re: Bug#903444: diffoscope: FileNotFoundError: [Errno 2] No such file or directory: '/home/lamby/.binwalk/magic' with gfxboot/4.5.2-1.1-6

Date: Mon, 10 Sep 2018 19:34:01 +0200

[Message part 1 (text/plain, inline)]

On Mon, Sep 10, 2018 at 06:06:47PM +0100, Chris Lamb wrote:
> tags 903444 + pending
> thanks
> 
> Fixed in Git, pending upload:
> 
>   https://salsa.debian.org/reproducible-builds/diffoscope/commit/075acf2f8c599e0f53463fee368a1a929e94a8eb

.oO  wow

That's a crazy one, thanks for tracking this down!

-- 
regards,
                        Mattia Rizzolo

GPG Key: 66AE 2B4A FCCF 3F52 DA18  4D18 4B04 3FCD B944 4540      .''`.
more about me:  https://mapreri.org                             : :'  :
Launchpad user: https://launchpad.net/~mapreri                  `. `'`
Debian QA page: https://qa.debian.org/developer.php?login=mattia  `-

[signature.asc (application/pgp-signature, inline)]

Message #20 received at 903444-close@bugs.debian.org (full text, mbox, reply):

From: Chris Lamb <lamby@debian.org>

To: 903444-close@bugs.debian.org

Subject: Bug#903444: fixed in diffoscope 101

Date: Sat, 15 Sep 2018 15:49:07 +0000

Source: diffoscope
Source-Version: 101

We believe that the bug you reported is fixed in the latest version of
diffoscope, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 903444@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Chris Lamb <lamby@debian.org> (supplier of updated diffoscope package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Format: 1.8
Date: Sat, 15 Sep 2018 16:37:45 +0100
Source: diffoscope
Binary: diffoscope
Built-For-Profiles: nocheck
Architecture: source all
Version: 101
Distribution: unstable
Urgency: medium
Maintainer: Reproducible builds folks <reproducible-builds@lists.alioth.debian.org>
Changed-By: Chris Lamb <lamby@debian.org>
Description:
 diffoscope - in-depth comparison of files, archives, and directories
Closes: 903444 908072 908074
Changes:
 diffoscope (101) unstable; urgency=medium
 .
   * Fix testsuite under LLVM >= 7.0. (Closes: #908074)
   * Substvar generation:
     - Ensure Debian substvar generation is deterministic regardless of
       installed packages. (Closes: #908072)
     - Clarify distinction between tools (eg. gpg) and packages (eg. gnupg) when
       generating Debian substvars.
     - Revert updating generated debian/tests/control made in diffoscope 100.
   * Disable binwalk's own user configuration for predictable results and to
     ensure it does not create unnecessary directories. (Closes: #903444)
   * Ensure we return "bytes" objects from Command.filter to avoid a
     "TypeError: Unicode-objects must be encoded before hashing" traceback.
   * Don't print GPG output in diffoscope.changes.
Checksums-Sha1:
 707d3f5ad91d129b32531cd573218bceaab2a08a 4067 diffoscope_101.dsc
 0ff3833cdf03a3aa196acc4b92f730159012cad4 9251288 diffoscope_101.tar.xz
 e8c1b6899b1143c6fe82afc8db48f9ce7f404ab1 123352 diffoscope_101_all.deb
 a9f838e848394a50a32f7a24ab9789649fec50cc 6716 diffoscope_101_amd64.buildinfo
Checksums-Sha256:
 14aa454ce299cff4934e243f799574fc7bde40d271891bec7edfd73482f51350 4067 diffoscope_101.dsc
 ace9e5f99e26e3f7fdee93d66384eacb46c37f41036d591475287f4060ccb4d4 9251288 diffoscope_101.tar.xz
 a8e8c788e7a65db91c2d071d5576f58ff4ff76c24ed22ebfbff7546df6a0d31b 123352 diffoscope_101_all.deb
 4b3448eb2457ba4c1ea90229db2cb585b29f1ba399412dc886a7ee70a71f1996 6716 diffoscope_101_amd64.buildinfo
Files:
 e557e849d1d057420f5c04e424b61cbb 4067 devel optional diffoscope_101.dsc
 48e1b01bd839b36be11665729e8544e0 9251288 devel optional diffoscope_101.tar.xz
 b9a14fa1ae24999ad933a7e54247c4d4 123352 devel optional diffoscope_101_all.deb
 76ddcb1491f6c21ca8c80d8f71541771 6716 devel optional diffoscope_101_amd64.buildinfo

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCAAdFiEEwv5L0nHBObhsUz5GHpU+J9QxHlgFAludKKwACgkQHpU+J9Qx
HlgTpA/9H3SJ45WzI3RO/wGJpIf3ElJzMypibsPPnIqxEeZM/8dl2RI5at+x//50
o4rzeEnNivgZ5CJdYRQjcXo9z+xZI2s+ovVfw4ODc865AI5YD6xe691tduMOI0FR
7O6QmbsHlrt5uSxmPt7kOsC4va9P7cCPfz/6+szctm5hSkPDYLSS6pvauGYyablg
a9N/ltTPZ80pWzyg0/meAGiqRkH+EPC/UJqxpJRXhK7bqlAPou49eCkx7fW0f8BZ
/PPAg19EKdh0JspDnhbd86bmGy0gKwM++LUl0ZVxajjSEY5KYw2RWSS9i8MsqmyZ
u5Bl6lqWbcVj+aDuJZtLVXBJLSnjkB+WkKvN8Vf28Saj3hmwCHs/tV3T3Y7Kq1Cl
a3z6bNhvAg+0aZLspr6i6/peeAynEzF3ez1999Dv27XYNQVoZm+HuSsszLPRF9RR
oUADuhM0MHvx2vdk/BplUUrf/re1jmXall+/47cVwqhjng1R80ftt6XZKG4uYyza
J1hOaPJBMpA1p48DLzLF9UC05meswWpWvNyLs9YpqRleIXkKoftF2Fp05rTG7ZH5
OCwFSIvsHi9OgY+44mMsf5iw+TwoRrzAeU+R9HF/1p5ab7W24DDAuSjPofUrQoR1
jdbRNO49B28qqW5/pB/h+QxMe/B3W9P24KglfGrVyPX2hdgM2tQ=
=UgNh
-----END PGP SIGNATURE-----

Send a report that this bug log contains spam.