Debian Bug report logs - #483290
unzip: Can not open shift-jis zip file on UTF-8 environment

Toggle useless messages

Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Nobuhiro Iwamatsu <iwamatsu@nigauri.org>

To: submit@bugs.debian.org

Cc: iwamatsu@nigauri.org, Hideki Yamane <henrich@debian.or.jp>

Subject: unzip: Can not open shift-jis zip file on UTF-8 environment

Date: Wed, 28 May 2008 14:42:22 +0900

[Message part 1 (text/plain, inline)]

Package: unzip
Version: 5.52-11
Severity: important
Tags: patch

In current version, can not open shift-jis zip file on UTF-8 environment.
These problems are in shift-jis, cp949(extended euc-kr) and other.

Details for this problem are in this URL [0], and patch to evade this 
problem is taken in Ubuntu.
 
I confirmed the patch was extracted, applied, ,checked , and the problem was evaded. 
I attached this patch.

Please check this problem and apply patch.

Best regards,
 Nobuhiro

[0]: https://bugs.launchpad.net/ubuntu/+source/unzip/+bug/203609


-- System Information:
Debian Release: lenny/sid
  APT prefers unstable
  APT policy: (500, 'unstable')
Architecture: i386 (i686)

Kernel: Linux 2.6.25-1-686-bigmem (SMP w/2 CPU cores)
Locale: LANG=ja_JP.UTF-8, LC_CTYPE=ja_JP.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/bash

Versions of packages unzip depends on:
ii  libc6                         2.7-11     GNU C Library: Shared libraries

unzip recommends no packages.

-- no debconf information

[unzip_fix.diff (text/x-diff, attachment)]

Message #10 received at 483290@bugs.debian.org (full text, mbox, reply):

From: Santiago Vila <sanvila@unex.es>

To: Nobuhiro Iwamatsu <iwamatsu@nigauri.org>, 483290@bugs.debian.org, control@bugs.debian.org

Cc: Hideki Yamane <henrich@debian.or.jp>

Subject: Re: Bug#483290: unzip: Can not open shift-jis zip file on UTF-8 environment

Date: Wed, 4 Jun 2008 18:12:15 +0200 (CEST)

severity 483290 normal
thanks

On Wed, 28 May 2008, Nobuhiro Iwamatsu wrote:

> Package: unzip
> Version: 5.52-11
> Severity: important
> Tags: patch
> 
> In current version, can not open shift-jis zip file on UTF-8 environment.
> These problems are in shift-jis, cp949(extended euc-kr) and other.

I can rename the file using tab-completion and extract the file using
the current unzip package on a UTF-8 environment.

Please note that this is more a "I need a feature that has not been
implemented yet" than "it's not working as documented".

Will forward upstream, but I don't like the idea of introducing new
features on my own not in the original (which could become incompatible with
the features finally implemented by the original authors).

Thanks.

Message #19 received at 483290@bugs.debian.org (full text, mbox, reply):

From: Hideki Yamane <henrich@debian.or.jp>

To: Santiago Vila <sanvila@unex.es>

Cc: Nobuhiro Iwamatsu <iwamatsu@nigauri.org>, 483290@bugs.debian.org, debian-i18n@lists.debian.org

Subject: unzip: Can not handle shift-jis (or other locale set) zip file with expected characters

Date: Sun, 27 Jul 2008 01:41:00 +0900

[Message part 1 (text/plain, inline)]

Hi Santiago,

On Wed, 4 Jun 2008 18:12:15 +0200 (CEST)
Santiago Vila <sanvila@unex.es> wrote:
> I can rename the file using tab-completion and extract the file using
> the current unzip package on a UTF-8 environment.

 Yes, but filename is NOT shown with characters what we expected.
 See example screenshots.
 1. http://wiki.debian.org/L10n/Japanese?action=AttachFile&do=get&target=debian-hiragana-mojibake.png
 2. http://wiki.debian.org/L10n/Japanese?action=AttachFile&do=get&target=debian-hiragana.png

 1 is non-patched unzip handles files (named "Debian" with Japanese 
 hiragana character but it causes mojibake) and 2 is patched one.

 What I and Nobuhiro want is 2nd (patched) one.


 What we (at least Japanese Debian Developers/Users) want is that
 we see and extract zipped file with original -EXPECTED- filename.

 # some other distro users say "hey, Debian cannot handle Japanese zip files 
   from Windows, but we can do that. Ha!" ... I cannot endure it anymore... ;-)

   I'm proud to use Debian, and hope other Debian Desktop users not think 
   "Debian does not take care about us, but other distros do". 
   It's very very sad.


> Please note that this is more a "I need a feature that has not been
> implemented yet" than "it's not working as documented".
> 
> Will forward upstream, but I don't like the idea of introducing new
> features on my own not in the original (which could become incompatible with
> the features finally implemented by the original authors).

 Um, but this patch is tested in other distro, at Ubuntu 2007-03-31, at least 
 for a year ago, and they did not report any problems. 
 see https://bugs.launchpad.net/ubuntu/+source/unzip/+bug/10979

 That's longer than days packages moves from Unstable to Testing.
 Don't you think so? :-) 

 So, it does not cause any wrong side effects, I believe. 
 Please consider to patch for your package, please and please...

 And IMPORTANT! The patch that Nobuhiro sent is NOT right one, I think.
 Because I cannot extract zip file with correct characters. 
 So I did
  - make a (just ugly) patch from Ubuntu package (debian-ubuntu.diff)
  - merged it build test package and installed it
  - set "UNZIP=-O CP932" to environment variables (*)
  - execute file-roller
 
 *) we should set such an environment variables for each locales



 and upstream intend to upgrade unzip,
 see http://www.info-zip.org/board/board.pl?m-1203938133/ and 
 ftp://ftp.info-zip.org/pub/infozip/beta/unzip60d.zip

 So, we should try unzip 6.0 beta and check it works well or not (if you 
 can package and upload it to experimental, it would be good :-)

-- 
Regards,

 Hideki Yamane     henrich @ debian.or.jp/iijmio-mail.jp
 Japanese Debian Maintainer, see http://wiki.debian.org/HidekiYamane

[debian-ubuntu.diff (text/x-diff, attachment)]

Message #24 received at 483290@bugs.debian.org (full text, mbox, reply):

From: Hideki Yamane <henrich@debian.or.jp>

To: Santiago Vila <sanvila@unex.es>

Cc: Nobuhiro Iwamatsu <iwamatsu@nigauri.org>, 483290@bugs.debian.org

Subject: Re: Bug#483290: unzip: Can not handle shift-jis (or other locale set) zip file with expected characters

Date: Sun, 3 Aug 2008 09:58:59 +0900

Hi Santiago,

 I've tried to merge similar bugs but I got an error from BTS.

> > merge 483290 197427 197428 339021
> Bug#197427: unzip: chinese filenames unwrapped on unix wrongly
> Bug#197428: unzip: zipinfo (and unzip) can't deal with chinese filenames like miniunzip can
> Bug#339021: unzip: incorrectly converts cyrillic file names from Windows-created ZIPs
> Mismatch - only Bugs in same state can be merged:
> Values for `forwarded addr' don't match:
>  #197427 has `Zip-Bugs@lists.wku.edu';
>  #339021 has `http://www.info-zip.org/zip-bug.html'

 But those bugs says same thing, I think.
 FYI.

-- 
Regards,

 Hideki Yamane     henrich @ debian.or.jp/iijmio-mail.jp
 http://wiki.debian.org/HidekiYamane

Message #31 received at 483290@bugs.debian.org (full text, mbox, reply):

From: Junichi Uekawa <dancer@netfort.gr.jp>

To: 483290@bugs.debian.org

Subject: status of merge?

Date: Fri, 02 Jan 2009 16:11:00 +0900

Hi,

What's the status of this bugreport?
Are we waiting for a better patch or is it held back by something?

Message #36 received at 483290@bugs.debian.org (full text, mbox, reply):

From: Santiago Vila <sanvila@unex.es>

To: Junichi Uekawa <dancer@netfort.gr.jp>, 483290@bugs.debian.org

Subject: Re: Bug#483290: status of merge?

Date: Fri, 2 Jan 2009 16:40:05 +0100 (CET)

On Fri, 2 Jan 2009, Junichi Uekawa wrote:

> What's the status of this bugreport?
> Are we waiting for a better patch or is it held back by something?

AFAIK, the patch is neither approved or blessed by upstream, and I
personally do not like it because it introduces new features not
guaranteed to be present on the next official version.

I know that they are working on unzip version 6.0. Does the patch
apply cleanly to the latest beta for unzip 6.0?

If so, I could try to remind them about this.

Message #41 received at 483290@bugs.debian.org (full text, mbox, reply):

From: Junichi Uekawa <dancer@netfort.gr.jp>

To: Santiago Vila <sanvila@unex.es>

Cc: Junichi Uekawa <dancer@netfort.gr.jp>, 483290@bugs.debian.org, debian-japanese@lists.debian.org

Subject: Re: Bug#483290: status of merge?

Date: Sat, 03 Jan 2009 09:10:18 +0900

Hi,

At Fri, 2 Jan 2009 16:40:05 +0100 (CET),
Santiago Vila wrote:
> 
> On Fri, 2 Jan 2009, Junichi Uekawa wrote:
> 
> > What's the status of this bugreport?
> > Are we waiting for a better patch or is it held back by something?
> 
> AFAIK, the patch is neither approved or blessed by upstream, and I
> personally do not like it because it introduces new features not
> guaranteed to be present on the next official version.
> 
> I know that they are working on unzip version 6.0. Does the patch
> apply cleanly to the latest beta for unzip 6.0?
> 
> If so, I could try to remind them about this.

Do you have a package for 6.0 in experimental ?


Cc:'ing debian-japanese: 
Anyone tried applying the patch against 6.0 and if it works?

regards,
	junichi
-- 
dancer@{netfort.gr.jp,debian.org}

Message #46 received at 483290@bugs.debian.org (full text, mbox, reply):

From: Junichi Uekawa <dancer@netfort.gr.jp>

To: Santiago Vila <sanvila@unex.es>

Cc: Junichi Uekawa <dancer@netfort.gr.jp>, 483290@bugs.debian.org

Subject: Re: Bug#483290: status of merge?

Date: Sat, 03 Jan 2009 09:16:58 +0900

At Fri, 2 Jan 2009 16:40:05 +0100 (CET),
Santiago Vila wrote:
> 
> On Fri, 2 Jan 2009, Junichi Uekawa wrote:
> 
> > What's the status of this bugreport?
> > Are we waiting for a better patch or is it held back by something?
> 
> AFAIK, the patch is neither approved or blessed by upstream, and I
> personally do not like it because it introduces new features not
> guaranteed to be present on the next official version.
> 
> I know that they are working on unzip version 6.0. Does the patch
> apply cleanly to the latest beta for unzip 6.0?
> 
> If so, I could try to remind them about this.
> 

Hmm...

In 6.0d, I see some code about wide-char support and Unicode (UTF-8)
experimental support, so I guess someone is trying to get something
in.

Quoting suspicious lines from ./History.600:

 - zipinfo.c: added support for "UTF-8 path" extra field display to zi_long().
    [Chr. Spieler]

 - unzip.h: enable H_flag and U_flag for UNIX, VMS, WIN32 (those systems that
    are currently supposed to support UTF8 names); unzip.h must not depend on
    internal configuration settings like UNICODE_SUPPORT.  [Chr. Spieler]

Message #51 received at 483290@bugs.debian.org (full text, mbox, reply):

From: Charles Plessy <plessy@debian.org>

To: debian-japanese@lists.debian.org

Cc: Santiago Vila <sanvila@unex.es>, 483290@bugs.debian.org, 496989@bugs.debian.org

Subject: Re: Bug#483290: status of merge?

Date: Sun, 11 Jan 2009 12:20:48 +0900

Le Sat, Jan 03, 2009 at 09:10:18AM +0900, Junichi Uekawa a écrit :
> 
> Cc:'ing debian-japanese: 
> Anyone tried applying the patch against 6.0 and if it works?

Hi all,

I had a look at 6.0d. First of all, it is unredistributable:

  aqwa『unzip-6.0d』$ head README 
  This is a public beta release of UnZip, version 6.00d,  2008 February 17
  
        DO NOT DISTRIBUTE THIS ARCHIVE OUTSIDE THE INFO-ZIP GROUP!!
  ______________________ Cut here for public release _______________________
  This is the README file for the 29 February 2008 public release of the
  Info-ZIP group's portable UnZip zipfile-extraction program (and related
  utilities).
  
  unzip60.zip       portable UnZip, version 6.0, source code distribution
  unzip60.tar.Z     same as above, but compress'd tar format

(hence the CC to #496989)

Unzip version 6.0d compiles well with the /debian directory of 5.52-12. It
seems to have new Unicode facilities, that can be enabled by compiling with
-DUNICODE_SUPPORT. It adds two options:

  -H  use escapes for all non-ASCII Unicode
  -U  ignore any Unicode fields

I did not manage to make something useful with them.

I downloaded Ubuntu's unzip package (5.52-12ubuntu1) and tested their -O
option. I confirm that it works and is very handy. The option seems to be
implemented by a single patch to unzip.c (and a reciprocal one to zipinfo.c).
The patch does not apply well to the 6.0d source as there are conflicts with
some parts modified to implement UNICODE_SUPPORT.

The Ubuntu's patch works by adding the -O option only when compiled with
-DUNIX, because of many #if(n)def UNIX statements. It is difficult to transpose
it without making it mutually exclusive with UNICODE_SUPPORT or managing
combinations of both. I did not go further. Have Unzip's upstream authors reacted
to this issue? http://www.info-zip.org/zip-bug.html seems to be down…

Have a nice day,

-- 
Charles Plessy
Tsurumi, Kanagawa, Japan

Message #56 received at 483290@bugs.debian.org (full text, mbox, reply):

From: Junichi Uekawa <dancer@netfort.gr.jp>

To: debian-japanese@lists.debian.org, Santiago Vila <sanvila@unex.es>, 483290@bugs.debian.org, 496989@bugs.debian.org

Subject: Re: Bug#483290: status of merge?

Date: Mon, 12 Jan 2009 17:24:52 +0900

Hi,

> 
> Unzip version 6.0d compiles well with the /debian directory of 5.52-12. It
> seems to have new Unicode facilities, that can be enabled by compiling with
> -DUNICODE_SUPPORT. It adds two options:
> 
>   -H  use escapes for all non-ASCII Unicode
>   -U  ignore any Unicode fields
> 
> I did not manage to make something useful with them.

I think this new upstream feature is not quite sufficient, and would
like to have features that is found in Ubuntu patch.

Please correct me if I'm wrong, historically filenames in Japanese ZIP
files are encoded in SJIS(windows), and EUC(UNIX), and to maintain
compatibility with them, UNZIP needs to be able to convert filename
encoding from SJIS/EUC-JP to the current filesystem locale (which may
or may not be what current locale (EUC-JP until sarge, or UTF-8 after
etch).


regards,
	junichi
-- 
dancer@{netfort.gr.jp,debian.org}

Message #61 received at 483290@bugs.debian.org (full text, mbox, reply):

From: Changwoo Ryu <cwryu@debian.org>

To: debian-japanese <debian-japanese@lists.debian.org>

Cc: 483290@bugs.debian.org, 496989@bugs.debian.org

Subject: Re: Bug#483290: status of merge?

Date: Tue, 13 Jan 2009 14:50:21 +0900

[Message part 1 (text/plain, inline)]

2009-01-12 (월), 17:24 +0900, Junichi Uekawa:
> Hi,
> 
> > 
> > Unzip version 6.0d compiles well with the /debian directory of 5.52-12. It
> > seems to have new Unicode facilities, that can be enabled by compiling with
> > -DUNICODE_SUPPORT. It adds two options:
> > 
> >   -H  use escapes for all non-ASCII Unicode
> >   -U  ignore any Unicode fields
> > 
> > I did not manage to make something useful with them.
> 
> I think this new upstream feature is not quite sufficient, and would
> like to have features that is found in Ubuntu patch.
> 
> Please correct me if I'm wrong, historically filenames in Japanese ZIP
> files are encoded in SJIS(windows), and EUC(UNIX), and to maintain
> compatibility with them, UNZIP needs to be able to convert filename
> encoding from SJIS/EUC-JP to the current filesystem locale (which may
> or may not be what current locale (EUC-JP until sarge, or UTF-8 after
> etch).

Agreed.

That unicode feature is useful only when the zip archive is created in
Unicode enabled way. Using unicode filenames in zip is not widely
accepted yet.

It's almost impossible to make all the MS-Windows created zip files in
the world use Unicode filename. Ubuntu-like workaround is more feasible
than modifying the zip files directly.


-- 
Changwoo Ryu <cwryu@debian.org>

[signature.asc (application/pgp-signature, inline)]

Message #76 received at 483290@bugs.debian.org (full text, mbox, reply):

From: Сергей Нагайцев <sergey.nagaytsev@gmail.com>

To: zip-unzip broken non-Latin filename encoding <483290@bugs.debian.org>

Subject: Solution proposal from Ubuntu, tested OK in Russian UTF-8

Date: Thu, 13 Jan 2011 17:02:35 +0300

[Message part 1 (text/plain, inline)]

Hello !

Where's the working solution made in Ubuntu:
1) Add the repositories referenced at
 * https://launchpad.net/~frol/+archive/zip-i18n/ - Zip/unzip patched to use
'libnatspec', patches are taken from AltLinux, updated to apply to zip 3.0
and unzip 6.0, console output fixed. Work is done by humble Russian
developer who neglects worldwide sites objecting his poor English, I have
contacted him. Here's Google translation of the original publication:
http://goo.gl/paR5i , along with discussion board and author's spam-cloaked
email.
 * https://launchpad.net/~r0lf/+archive/ppa - libnatspec, it's dependency (
http://sourceforge.net/projects/natspec/ ). The library itself originates
from Russian company http://etersoft.ru, it makes Russian business software
run on Linux with modified commercial Wine clone and compatibility layers
for MS SQL etc.
2) apt-get update; apt-get install zip unzip

After installing this software in Ubuntu 10.11 amd64, my file-roller Gnome
GUI reads and writes ZIP archives compatible with Wine-run GUI 7z for
Windows.

Please, test this with your native non-latin languages other than Russian,
and take appropriate action for inclusion into Debian if good or
bugreporting/fixing if broken.

[Message part 2 (text/html, inline)]

Message #81 received at 483290@bugs.debian.org (full text, mbox, reply):

From: Alkis Georgopoulos <alkisg@gmail.com>

To: 483290@bugs.debian.org

Subject: Upstream fix in unzip 6.1b

Date: Thu, 10 Mar 2011 15:08:40 +0200

It appears that this bug has been fixed upstream on 2010/12/10. From
ftp://ftp.info-zip.org/pub/infozip/beta/unzip610b.zip, unzip610b.ann:

> Quick list of major changes in UnZip 6.10b:
> - Add -I and -O options for setting ISO and OEM character sets, respectively,
>   used by UnZip when doing character set translations.  This support is based
>   on the unzip60-alt-iconv-utf8 patch suggested in an Info-ZIP forum thread
>   and uses the iconv library which must be available.  These options are enabled
>   using the USE_ICONV_MAPPING compiler define.  Suggestions welcome on how to
>   improve this limited character translation support.


About "suggestions welcome": I suggest we just add some more locales to
the hardcoded translations table upon request, and try to forward them
upstream.
For Greek users, this would do it: el_GR.UTF-8 ==> cp1253.

'libnatspec' wasn't used in the upstream fix, but it fails to autodetect
some locales anyway (e.g. Greek), so I don't think it'd be more useful
than the hardcoded table.

Message #88 received at 483290@bugs.debian.org (full text, mbox, reply):

From: Thomas Ward <teward@ubuntu.com>

To: 483290@bugs.debian.org

Subject: Is this a duplicate of now-fixed 682682?

Date: Wed, 6 Nov 2013 11:00:07 -0500

Reading through bugs in Ubuntu, it was discovered that a fix for the
UTF8 filename issues were fixed in bug 682682 [0] and that was fixed
as part of unzip/6.0-9.  This bug was linked to a Critical level bug
in Ubuntu, however, regarding UTF8 filename encodings [1].

Is this bug a duplicate of 682682, considering that these seem to be
related to each other with the UTF8 filename issues?

[0] http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=682682
[1] https://bugs.launchpad.net/ubuntu/+source/unzip/+bug/580961

Message #93 received at 483290@bugs.debian.org (full text, mbox, reply):

From: Santiago Vila <sanvila@unex.es>

To: Thomas Ward <teward@ubuntu.com>, 483290@bugs.debian.org

Subject: Re: Bug#483290: Is this a duplicate of now-fixed 682682?

Date: Wed, 06 Nov 2013 19:23:58 +0100

El 06/11/13 17:00, Thomas Ward escribió:
> Reading through bugs in Ubuntu, it was discovered that a fix for the
> UTF8 filename issues were fixed in bug 682682 [0] and that was fixed
> as part of unzip/6.0-9.  This bug was linked to a Critical level bug
> in Ubuntu, however, regarding UTF8 filename encodings [1].
> 
> Is this bug a duplicate of 682682, considering that these seem to be
> related to each other with the UTF8 filename issues?
> 
> [0] http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=682682
> [1] https://bugs.launchpad.net/ubuntu/+source/unzip/+bug/580961

No, I don't think they are the same.

Message #94 received at 197427-close@bugs.debian.org (full text, mbox, reply):

From: Maxwell Watford <kevorsogba28@gmail.com>

To: kevorsogba28@gmail.com

Subject: i need your reply

Date: Mon, 9 Aug 2021 15:48:54 +0000

Greetings,

We are writing to you from Ecowas Finance Controller Office Lome Togo,
because we have received a file from the Ministry of Finance Lome-
Togo, concerning an Inherited Fund bearing your name on it, And after
our verifications, we found out that the funds belong to you.

It has been awarded and I will like to guide you to claim the funds.
Please contact me at my private email address
(mrmaxwellwatford@gmail.com) for more information and directive

I am looking forward to your urgent reply,
Best regards
Mr Maxwell Watford

Send a report that this bug log contains spam.