Debian Bug report logs - #833738
python-popcon: assumes all-popcon-results.txt.gz is UTF-8

Toggle useless messages

Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Chris Lamb <lamby@debian.org>

To: submit@bugs.debian.org

Subject: python-popcon: assumes all-popcon-results.txt.gz is UTF-8

Date: Mon, 08 Aug 2016 13:17:42 +0200

[Message part 1 (text/plain, inline)]

Source: python-popcon
Version: 1.3
Severity: serious
Tags: patch
X-Debbugs-Cc: reproducible-builds@lists.alioth.debian.org

Hi,

Since (at least) 07-Aug-2016 14:04, the all-popcon-results.txt.gz file
contains an invalid line:

    Package: libfyba0-dbg                       0     2     0     0
--> Package: libf erdp-ommon                    0     0     0     1
    Package: libg++2.8.1.3-dbg                  0     0     0     1

That's (currently) line 54869. The "space" on the second line is actually
a 0xa0 character. This is making the package unusable.

$ python3
Python 3.5.2+ (default, Aug  5 2016, 08:07:14) 
[GCC 6.1.1 20160724] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import popcon
>>> popcon.package("foo")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib/python3/dist-packages/popcon.py", line 145, in package
    raw = package_raw(*packages)
  File "/usr/lib/python3/dist-packages/popcon.py", line 189, in package_raw
    data = _fetch()
  File "/usr/lib/python3/dist-packages/popcon.py", line 108, in _fetch
    txt = _decompress(txt)
  File "/usr/lib/python3/dist-packages/popcon.py", line 134, in _decompress
    data = data.decode()
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xa0 in position 3574857: invalid start byte

You can see this happening here:

  https://jenkins.debian.net/view/reproducible/view/problems/job/reproducible_html_notes/


Patch attached. NB. the comment in the lookup section.


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby@debian.org / chris-lamb.co.uk
       `-

[python-popcon.diff.txt (text/plain, attachment)]

Message #10 received at 833738-close@bugs.debian.org (full text, mbox, reply):

From: Ximin Luo <infinity0@debian.org>

To: 833738-close@bugs.debian.org

Subject: Bug#833738: fixed in python-popcon 1.3+nmu1

Date: Sun, 25 Sep 2016 19:29:52 +0000

Source: python-popcon
Source-Version: 1.3+nmu1

We believe that the bug you reported is fixed in the latest version of
python-popcon, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 833738@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Ximin Luo <infinity0@debian.org> (supplier of updated python-popcon package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Format: 1.8
Date: Tue, 13 Sep 2016 19:58:28 +0200
Source: python-popcon
Binary: python-popcon python3-popcon
Architecture: source
Version: 1.3+nmu1
Distribution: unstable
Urgency: medium
Maintainer: Bastian Venthur <venthur@debian.org>
Changed-By: Ximin Luo <infinity0@debian.org>
Description:
 python-popcon - Python interface to Debian's Popularity Contest (popcon)
 python3-popcon - Python interface to Debian's Popularity Contest (popcon)
Closes: 833693 833738
Changes:
 python-popcon (1.3+nmu1) unstable; urgency=medium
 .
   * Non-maintainer upload.
   * Add support for querying sourcemax statistics.
   * Don't mix up pickle formats; this causes bad lookups when py2/py3 both
     use the same file.
   * Update to latest Standards-Version; no changes required.
 .
   [ Chris Lamb ]
   * Fix missing Depends on python3-xdg. (Closes: #833693)
   * Don't assume all-popcon-results.txt.gz is UTF-8. (Closes: #833738)
Checksums-Sha1:
 3a0d7f454135a6fb312b2325f5eda062790987b2 1609 python-popcon_1.3+nmu1.dsc
 7422b45030ae5ae7581e4992ddd8d4e8974e50e6 4904 python-popcon_1.3+nmu1.tar.xz
Checksums-Sha256:
 62fdf5347aac80e0eac702e418eb78fbc4706cac3f89cbd65fc5ab30dc3ffaae 1609 python-popcon_1.3+nmu1.dsc
 3229a3550292b7fa79bea8043053d0066a0031355d7ee6d93a29202e004271f0 4904 python-popcon_1.3+nmu1.tar.xz
Files:
 24924ef52cd109431d06040d41f91f3e 1609 python extra python-popcon_1.3+nmu1.dsc
 59932c83a5eff7016a70b96b9bee1c99 4904 python extra python-popcon_1.3+nmu1.tar.xz

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQIcBAEBCgAGBQJX2D9KAAoJEIYN7zuPZQt5W3YQAKnpZu313fkW+jUeGENbUnyY
Ux37dAWmW3GuH46WCZf+B107OFlXGKBNUVEVo2lndGZGk2/OPka7tYphmdh5raNf
GVowqcfYqHUEFILXCQuRATv3ZhDJBIoki9pOQ4jQ98XwgaM7SCzLzVTbhq6sch0E
a7bbHrHAOGmg1ZQ9qaDFLPe6FLldDhvALCgsI1wdnPvqOkPOHJ0dQPTl25zXHTC1
KWYM1t+owkBn7KeWk86THeal2GKaNjtvZjEs5pUwzMI/+i4O/4mh/OtmWY297UJs
/B+1DQvdHKn047oCOBi9ySiAavvbwhiGS4fPfTbeuoZRfrYslMA8hjuDnwgA0UTq
hec7SFiEM8pKsqQ72CxapP3479ZreUkO6LKkM0fPOPlBq2IJTsshD1DIPmPrKz+D
X8eEGdhdukYNL1JQQ6CSvWSR2PMxSB7AYGaVXhiz4t2fcVRCSNVUReSa/308IKbm
lj2/vQDaaEWPyrcxEWe/pnYkwp/+KzOkLHatEmdG/38AZ4JEqtZonWDUViwRLnKB
36y51YQQ2lmrifd9C987Nbwyg2vpEm0iaH0P56ZxV2t+6GWULMRhsntVXFR4M2GA
JeDLsexvdenZTlymLTsmCtaAL1R6rVfIPzeKa0Ih1GYN0wiB2eSvU2xzje594/0s
VxJPtjvPA2q6mativhgM
=f+k0
-----END PGP SIGNATURE-----

Send a report that this bug log contains spam.