Debian Bug report logs - #859294
hunspell-dict-ko: FTBFS: UnicodeDecodeError: 'ascii' codec can't decode byte 0xed in position 38: ordinal not in range(128)

Toggle useless messages

Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Chris Lamb <lamby@debian.org>

To: submit@bugs.debian.org

Subject: hunspell-dict-ko: FTBFS: UnicodeDecodeError: 'ascii' codec can't decode byte 0xed in position 38: ordinal not in range(128)

Date: Sat, 01 Apr 2017 19:24:58 +0100

[Message part 1 (text/plain, inline)]

Source: hunspell-dict-ko
Version: 0.6.0-2
Severity: serious
Justification: fails to build from source
User: reproducible-builds@lists.alioth.debian.org
Usertags: ftbfs
X-Debbugs-Cc: reproducible-bugs@lists.alioth.debian.org

Dear Maintainer,

hunspell-dict-ko fails to build from source in unstable/amd64:

  […]

  dh build
     dh_testdir
     dh_update_autotools_config
     dh_auto_configure
     dh_auto_build
  	make -j1
  make[1]: Entering directory '«BUILDDIR»'
  python3 make-aff-dic.py ko.aff ko.dic dict-ko-builtins.json dict-ko-galkwi.json 
  Traceback (most recent call last):
    File "make-aff-dic.py", line 329, in <module>
      dic.load_json(open(filename))
    File "make-aff-dic.py", line 166, in load_json
      d = json.load(infile)
    File "/usr/lib/python3.5/json/__init__.py", line 265, in load
      return loads(fp.read(),
    File "/usr/lib/python3.5/encodings/ascii.py", line 26, in decode
      return codecs.ascii_decode(input, self.errors)[0]
  UnicodeDecodeError: 'ascii' codec can't decode byte 0xed in position 38: ordinal not in range(128)
  Makefile:28: recipe for target 'ko.aff' failed
  make[1]: *** [ko.aff] Error 1
  make[1]: Leaving directory '«BUILDDIR»'
  dh_auto_build: make -j1 returned exit code 2
  debian/rules:5: recipe for target 'build' failed
  make: *** [build] Error 2
  dpkg-buildpackage: error: debian/rules build gave error exit status 2

  […]

The full build log is attached.


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby@debian.org / chris-lamb.co.uk
       `-

[hunspell-dict-ko.0.6.0-2.unstable.amd64.log.txt.gz (application/octet-stream, attachment)]

Message #10 received at 859294@bugs.debian.org (full text, mbox, reply):

From: Changwoo Ryu <cwryu@debian.org>

To: Chris Lamb <lamby@debian.org>, 859294@bugs.debian.org

Subject: Re: Bug#859294: hunspell-dict-ko: FTBFS: UnicodeDecodeError: 'ascii' codec can't decode byte 0xed in position 38: ordinal not in range(128)

Date: Wed, 5 Apr 2017 12:44:52 +0900

It only fails on a legacy non-Unicode locale, such as "C".

So what is a solution? Specifying a UTF-8 locale and Build-Depending
on locales-all do not seems to be a right way.

Message #15 received at 859294@bugs.debian.org (full text, mbox, reply):

From: Changwoo Ryu <cwryu@debian.org>

To: Chris Lamb <lamby@debian.org>, 859294@bugs.debian.org

Subject: Re: Bug#859294: hunspell-dict-ko: FTBFS: UnicodeDecodeError: 'ascii' codec can't decode byte 0xed in position 38: ordinal not in range(128)

Date: Wed, 5 Apr 2017 12:53:33 +0900

OK I found a way of specifying the encoding of the I/O files.


diff --git a/make-aff-dic.py b/make-aff-dic.py
index 47dff10..98aba41 100644
--- a/make-aff-dic.py
+++ b/make-aff-dic.py
@@ -308,9 +308,9 @@ if __name__ == '__main__':
     dic = Dictionary()
     for filename in infilenames:
         if filename.endswith('.json'):
-            dic.load_json(open(filename))
+            dic.load_json(open(filename, encoding='utf-8'))
         else:
             print('ERROR: unknown file type: ' + filename)
             sys.exit(1)
     dic.process()
-    dic.output(open(afffilename, 'w'), open(dicfilename, 'w'))
+    dic.output(open(afffilename, 'w', encoding='utf-8'),
open(dicfilename, 'w', encoding='utf-8'))


2017-04-05 12:44 GMT+09:00 Changwoo Ryu <cwryu@debian.org>:
> It only fails on a legacy non-Unicode locale, such as "C".
>
> So what is a solution? Specifying a UTF-8 locale and Build-Depending
> on locales-all do not seems to be a right way.

Message #24 received at 859294-close@bugs.debian.org (full text, mbox, reply):

From: Changwoo Ryu <cwryu@debian.org>

To: 859294-close@bugs.debian.org

Subject: Bug#859294: fixed in hunspell-dict-ko 0.6.2-1

Date: Mon, 14 Aug 2017 10:49:59 +0000

Source: hunspell-dict-ko
Source-Version: 0.6.2-1

We believe that the bug you reported is fixed in the latest version of
hunspell-dict-ko, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 859294@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Changwoo Ryu <cwryu@debian.org> (supplier of updated hunspell-dict-ko package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Format: 1.8
Date: Thu, 23 Feb 2017 01:57:17 +0900
Source: hunspell-dict-ko
Binary: hunspell-ko
Architecture: source all
Version: 0.6.2-1
Distribution: unstable
Urgency: medium
Maintainer: Debian Korean L10N <debian-l10n-korean@lists.debian.org>
Changed-By: Changwoo Ryu <cwryu@debian.org>
Description:
 hunspell-ko - Korean dictionary for hunspell
Closes: 859294
Changes:
 hunspell-dict-ko (0.6.2-1) unstable; urgency=medium
 .
   * New upstream version (Closes: #859294)
   * debian/gbp.conf: Use master branch for gbp
Checksums-Sha1:
 cad96b09a915c5811ba60016de8ba8130ca50707 2074 hunspell-dict-ko_0.6.2-1.dsc
 2352a81de802a6524637c3b51b3d1a43c33a399c 179236 hunspell-dict-ko_0.6.2.orig.tar.xz
 542e375ac1773f3f7b3ba3525cf3eb2028a27383 12028 hunspell-dict-ko_0.6.2-1.debian.tar.xz
 5428e38901be3ac314ebcfb37fc4957d3b2e21ee 6023 hunspell-dict-ko_0.6.2-1_amd64.buildinfo
 3beea36e2a06a54142c79037d7acc2e9fdb5bf92 2564336 hunspell-ko_0.6.2-1_all.deb
Checksums-Sha256:
 62042454e278c62de53f2184a10c0a1facb7f0da50149523495628cfb4419712 2074 hunspell-dict-ko_0.6.2-1.dsc
 2e284219e6c00d160eeba68f5f9aa8e8024e79208b269683fa69cf3711952926 179236 hunspell-dict-ko_0.6.2.orig.tar.xz
 829bd065c2cea72834c737eef5b63bd178518413010bbdf70c3cb100ed3dd75c 12028 hunspell-dict-ko_0.6.2-1.debian.tar.xz
 37609de135fe77b577e005a2251f8b787c59437412accba1fcc1ebcce593edda 6023 hunspell-dict-ko_0.6.2-1_amd64.buildinfo
 053827c14a9311d932b980d93716904381d20ae0c3eb90e20de6a00e21fbc984 2564336 hunspell-ko_0.6.2-1_all.deb
Files:
 cee227431aa16fe906008ae8cb02c7ed 2074 text optional hunspell-dict-ko_0.6.2-1.dsc
 1d73e4b5e4358ae9abe095ca7d0819d1 179236 text optional hunspell-dict-ko_0.6.2.orig.tar.xz
 a6aa4332f6e2274529b3d70c73dca80d 12028 text optional hunspell-dict-ko_0.6.2-1.debian.tar.xz
 696cb2444eb749860127e54b1c8c4875 6023 text optional hunspell-dict-ko_0.6.2-1_amd64.buildinfo
 386eb53313659b48d36fb729343d704c 2564336 text optional hunspell-ko_0.6.2-1_all.deb

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCAAdFiEEony+ujUlaGU4DgzJ7Bh50HbYq0gFAlmRevQACgkQ7Bh50HbY
q0iTLBAAlGJcoUt16B/ZT4xSzzRfdBqrP4rn9A0ldK+4w/U8X5EEwQdw97OXvfp6
QZkxryH/6wpvJ4SNE2RmsgJoyYCizs8hz06Qz3R63pj53y9zvOgsPdDLUocYAU3l
eMOI6L0yin8g92Diher1SGJNMe1dvG5+YxzbqnrnFux5VpZuTklEIT6cEiHirTMG
cgwDSEwGojYL4tslVmr7o7IjiSN6U4XDhhWEWrqJeZcvVKia6HYPR6F1NheutYus
bdPbQPpS6Aw60vHLrX3ZOUhf0tjolKa7vcWK7H0j+9MpTSh4Zrxslo82XvRB6FYJ
uH8Z4MXtKkT/pP4CyAhnACTv4otcdOJeVU4ZTO1HSWf2Y3ED2YBXxyp9zOgBT7W0
d4R2rkpWdaf0ux0UAOuZflSWvjuDZC3KzZMiPGhdrlje3intY1+KOTF5YttPq/iI
6J1JEp+QjqwbhH/rXth5BinswOI8Z4xju6VAJ25FzmvZml3gQjaeG1HUeZ7ZmjHx
0yydPbMc4g/vqa5jvMSHr42jfGKkLwYbxW6FuuG9WAszyU/6WRd0JGKXeIsLN9x8
hkAp79xLLRdMcMd1uq9PayOKWvq2Hn/IXe5jIEM1Ddq3oILytby5Srk0sylktUHD
OtiWBRdIrV9fSfvYmjAj1SCGvzuR7Y0GyI8w3SC3UIJnQ6H8QiQ=
=0Rb9
-----END PGP SIGNATURE-----

Message #29 received at 859294@bugs.debian.org (full text, mbox, reply):

From: Adrian Bunk <bunk@debian.org>

To: Changwoo Ryu <cwryu@debian.org>, 859294@bugs.debian.org

Cc: Chris Lamb <lamby@debian.org>

Subject: Re: Bug#859294: hunspell-dict-ko: FTBFS: UnicodeDecodeError: 'ascii' codec can't decode byte 0xed in position 38: ordinal not in range(128)

Date: Sun, 27 Aug 2017 21:36:24 +0300

Control: reopen -1

On Wed, Apr 05, 2017 at 12:53:33PM +0900, Changwoo Ryu wrote:
> OK I found a way of specifying the encoding of the I/O files.
> 
> 
> diff --git a/make-aff-dic.py b/make-aff-dic.py
> index 47dff10..98aba41 100644
> --- a/make-aff-dic.py
> +++ b/make-aff-dic.py
> @@ -308,9 +308,9 @@ if __name__ == '__main__':
>      dic = Dictionary()
>      for filename in infilenames:
>          if filename.endswith('.json'):
> -            dic.load_json(open(filename))
> +            dic.load_json(open(filename, encoding='utf-8'))
>          else:
>              print('ERROR: unknown file type: ' + filename)
>              sys.exit(1)
>      dic.process()
> -    dic.output(open(afffilename, 'w'), open(dicfilename, 'w'))
> +    dic.output(open(afffilename, 'w', encoding='utf-8'),
> open(dicfilename, 'w', encoding='utf-8'))
> 
> 
> 2017-04-05 12:44 GMT+09:00 Changwoo Ryu <cwryu@debian.org>:
> > It only fails on a legacy non-Unicode locale, such as "C".
> >
> > So what is a solution? Specifying a UTF-8 locale and Build-Depending
> > on locales-all do not seems to be a right way.

Unfortunately it is still failing (this time in a different place?):

https://tests.reproducible-builds.org/debian/rb-pkg/unstable/amd64/hunspell-dict-ko.html

...
make[1]: Entering directory '/build/1st/hunspell-dict-ko-0.6.3'
python3 make-aff-dic.py ko.aff ko.dic dict-ko-builtins.json 
dict-ko-galkwi-ccby.json dict-ko-galkwi-mplgpllgpl.json 
Progress: \ubcf5\uc218\ud615 \ud655\uc7a5...
Progress: \ud50c\ub798\uadf8 \uacc4\uc0b0...
Progress: \ubcf4\uc870\uc6a9\uc5b8 \ud655\uc7a5...
Progress: dic \ucd9c\ub825...
Progress: aff \ucd9c\ub825...
Traceback (most recent call last):
  File "make-aff-dic.py", line 333, in <module>
    open(dicfilename, 'w', encoding='utf-8'))
  File "make-aff-dic.py", line 181, in output
    self.output_aff(afffile)
  File "make-aff-dic.py", line 203, in output_aff
    template = Template(open('template.aff').read())
  File "/usr/lib/python3.5/encodings/ascii.py", line 26, in decode
    return codecs.ascii_decode(input, self.errors)[0]
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 
423: ordinal not in range(128)
Makefile:28: recipe for target 'ko.aff' failed
make[1]: *** [ko.aff] Error 1
make[1]: Leaving directory '/build/1st/hunspell-dict-ko-0.6.3'
dh_auto_build: make -j1 returned exit code 2
debian/rules:5: recipe for target 'build' failed
make: *** [build] Error 2


cu
Adrian

-- 

       "Is there not promise of rain?" Ling Tan asked suddenly out
        of the darkness. There had been need of rain for many days.
       "Only a promise," Lao Er said.
                                       Pearl S. Buck - Dragon Seed

Message #38 received at 859294@bugs.debian.org (full text, mbox, reply):

From: Changwoo Ryu <cwryu@debian.org>

To: Adrian Bunk <bunk@debian.org>, control@bugs.debian.org

Cc: 859294@bugs.debian.org, Chris Lamb <lamby@debian.org>

Subject: Re: Bug#859294: hunspell-dict-ko: FTBFS: UnicodeDecodeError: 'ascii' codec can't decode byte 0xed in position 38: ordinal not in range(128)

Date: Mon, 28 Aug 2017 04:13:29 +0900

OK, another encoding= parameter is needed.

--- a/make-aff-dic.py
+++ b/make-aff-dic.py
@@ -200,7 +200,7 @@ class Dictionary:
     def output_aff(self, outfile):
         from string import Template
         import aff
-        template = Template(open('template.aff').read())
+        template = Template(open('template.aff', encoding='utf-8').read())

         # 주의: flag alias를 변경하므로 get_AF() 앞에 와야 한다.
         suffix_str = aff.get_suffix_defines(self.flag_aliases)

Actually I'm the upstream maintainer so it will be applied in the next
upstream revision.


2017-08-28 3:36 GMT+09:00 Adrian Bunk <bunk@debian.org>:
> Control: reopen -1
>
> On Wed, Apr 05, 2017 at 12:53:33PM +0900, Changwoo Ryu wrote:
>> OK I found a way of specifying the encoding of the I/O files.
>>
>>
>> diff --git a/make-aff-dic.py b/make-aff-dic.py
>> index 47dff10..98aba41 100644
>> --- a/make-aff-dic.py
>> +++ b/make-aff-dic.py
>> @@ -308,9 +308,9 @@ if __name__ == '__main__':
>>      dic = Dictionary()
>>      for filename in infilenames:
>>          if filename.endswith('.json'):
>> -            dic.load_json(open(filename))
>> +            dic.load_json(open(filename, encoding='utf-8'))
>>          else:
>>              print('ERROR: unknown file type: ' + filename)
>>              sys.exit(1)
>>      dic.process()
>> -    dic.output(open(afffilename, 'w'), open(dicfilename, 'w'))
>> +    dic.output(open(afffilename, 'w', encoding='utf-8'),
>> open(dicfilename, 'w', encoding='utf-8'))
>>
>>
>> 2017-04-05 12:44 GMT+09:00 Changwoo Ryu <cwryu@debian.org>:
>> > It only fails on a legacy non-Unicode locale, such as "C".
>> >
>> > So what is a solution? Specifying a UTF-8 locale and Build-Depending
>> > on locales-all do not seems to be a right way.
>
> Unfortunately it is still failing (this time in a different place?):
>
> https://tests.reproducible-builds.org/debian/rb-pkg/unstable/amd64/hunspell-dict-ko.html
>
> ...
> make[1]: Entering directory '/build/1st/hunspell-dict-ko-0.6.3'
> python3 make-aff-dic.py ko.aff ko.dic dict-ko-builtins.json
> dict-ko-galkwi-ccby.json dict-ko-galkwi-mplgpllgpl.json
> Progress: \ubcf5\uc218\ud615 \ud655\uc7a5...
> Progress: \ud50c\ub798\uadf8 \uacc4\uc0b0...
> Progress: \ubcf4\uc870\uc6a9\uc5b8 \ud655\uc7a5...
> Progress: dic \ucd9c\ub825...
> Progress: aff \ucd9c\ub825...
> Traceback (most recent call last):
>   File "make-aff-dic.py", line 333, in <module>
>     open(dicfilename, 'w', encoding='utf-8'))
>   File "make-aff-dic.py", line 181, in output
>     self.output_aff(afffile)
>   File "make-aff-dic.py", line 203, in output_aff
>     template = Template(open('template.aff').read())
>   File "/usr/lib/python3.5/encodings/ascii.py", line 26, in decode
>     return codecs.ascii_decode(input, self.errors)[0]
> UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position
> 423: ordinal not in range(128)
> Makefile:28: recipe for target 'ko.aff' failed
> make[1]: *** [ko.aff] Error 1
> make[1]: Leaving directory '/build/1st/hunspell-dict-ko-0.6.3'
> dh_auto_build: make -j1 returned exit code 2
> debian/rules:5: recipe for target 'build' failed
> make: *** [build] Error 2
>
>
> cu
> Adrian
>
> --
>
>        "Is there not promise of rain?" Ling Tan asked suddenly out
>         of the darkness. There had been need of rain for many days.
>        "Only a promise," Lao Er said.
>                                        Pearl S. Buck - Dragon Seed
>

Message #43 received at 859294-close@bugs.debian.org (full text, mbox, reply):

From: Changwoo Ryu <cwryu@debian.org>

To: 859294-close@bugs.debian.org

Subject: Bug#859294: fixed in hunspell-dict-ko 0.6.4-1

Date: Thu, 07 Sep 2017 21:20:47 +0000

Source: hunspell-dict-ko
Source-Version: 0.6.4-1

We believe that the bug you reported is fixed in the latest version of
hunspell-dict-ko, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 859294@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Changwoo Ryu <cwryu@debian.org> (supplier of updated hunspell-dict-ko package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Format: 1.8
Date: Fri, 08 Sep 2017 05:52:37 +0900
Source: hunspell-dict-ko
Binary: hunspell-ko
Architecture: source all
Version: 0.6.4-1
Distribution: unstable
Urgency: medium
Maintainer: Debian Korean L10N <debian-l10n-korean@lists.debian.org>
Changed-By: Changwoo Ryu <cwryu@debian.org>
Description:
 hunspell-ko - Korean dictionary for hunspell
Closes: 859294
Changes:
 hunspell-dict-ko (0.6.4-1) unstable; urgency=medium
 .
   * New upstream version (Closes: #859294)
Checksums-Sha1:
 692a803e95228a6dd8030f42e5f6371b54f71bc7 2074 hunspell-dict-ko_0.6.4-1.dsc
 174de92f6109f38fae89eb9a067721630fb8d31c 238527 hunspell-dict-ko_0.6.4.orig.tar.gz
 940cd2b831029fd56a65f37b9f255f0a85644a28 12056 hunspell-dict-ko_0.6.4-1.debian.tar.xz
 6b7770ac8f2ca4d7bbc0d63675ac916f5c9d60c9 6132 hunspell-dict-ko_0.6.4-1_amd64.buildinfo
 23554449568d80f2c76b5aef5f2770f9c3557aca 2616754 hunspell-ko_0.6.4-1_all.deb
Checksums-Sha256:
 f2182a49a9f7e461f26814674975ab67e544cae265e637be6417e4ea08589df9 2074 hunspell-dict-ko_0.6.4-1.dsc
 9278d4cd11a340c3204a6cdb1fe85df9974ab9c879d04727646012a7a9d516d2 238527 hunspell-dict-ko_0.6.4.orig.tar.gz
 60689a737603591ff755f8af24505c89d0c7db4cb73b7cb4dd09b145c63abff6 12056 hunspell-dict-ko_0.6.4-1.debian.tar.xz
 411ecd7fd2d207521cd1742aed5ea929a5756bdaf9c1e514711bd25851b5ff86 6132 hunspell-dict-ko_0.6.4-1_amd64.buildinfo
 7c584893e7f3bd09631cc01192af2925930e6580db35c5e25c1c07f8948c2170 2616754 hunspell-ko_0.6.4-1_all.deb
Files:
 52bf63219e31816c5dc0e9e6a3eca508 2074 text optional hunspell-dict-ko_0.6.4-1.dsc
 d48c5534110bdf39eb0dd7294135c5de 238527 text optional hunspell-dict-ko_0.6.4.orig.tar.gz
 10853f694bba076fdd9f5fe59c3efb30 12056 text optional hunspell-dict-ko_0.6.4-1.debian.tar.xz
 eb42f1f4e77e80b2a85961cb83b37a15 6132 text optional hunspell-dict-ko_0.6.4-1_amd64.buildinfo
 e2eabc6363f0ffe26d328e29805af5ae 2616754 text optional hunspell-ko_0.6.4-1_all.deb

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCAAdFiEEony+ujUlaGU4DgzJ7Bh50HbYq0gFAlmxsjUACgkQ7Bh50HbY
q0jI0w//RZzhp+XLcbI7tDFWxk7Jcz81oJL5PSuVc+0Qsh43Ip8XuunQPecSPErL
G5suNelGvZrixIuplyk7StFhgoW1wtxqWdTIInTHiWarRUpyRC2NZ9gP/KPlVF7U
Vz7mJb9F1lJ1GeSDgpZqht23caEGewusucbFPZw5Q+xeAnSrSr55FoEKTyVlXcWV
dlgRP+9Yvmku5jjONwNPSULVgDk/nFPwFcRIhCeKTtw/xWrUbshCd/e/TYZVNJ9o
aIqXVTtj2wBGB/g14yU9LiANwzsseU3+gScOrMDbN6V3hgpVAlRYQtHMb2MzfQ30
eOXTqdldDki+9jy2Vzjv4HkUtWzHKQwCzr1lWeF5ev4LvoU5ZJp63gw/QeK40l1G
LjTDN2avOjcAngPbmszvhg+ntvmlnXNF2CtiLNB6/84lwxwmNgecUrdlaNAJHe9n
5h4A6lGvbd/6CMXUIEku05bBVAZpDyqRZMCEIlkoQVW0/VtLDtk8bH8yPLcnRjir
BxhVzm2jz8zBHhgVK/rVFHnQh5/85ozYQtQ7/h1wmMFMY7oqBBi9k37YIutVR/jd
AkuF7tGygNdnHN4wc9h/tWS+j3BwLrsSJhduTqT+Qd1asthMUFvvJxQbAImmfwDV
F95Yc1vWQxDfqxweA/GPrq4h88WbeDKdkJo8ig/tx6UJ9mjxvW4=
=bYvT
-----END PGP SIGNATURE-----

Send a report that this bug log contains spam.