Debian Bug report logs - #407387
w3m: not supporting chunked transfer encoding

Reply or subscribe to this bug.

Toggle useless messages

Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Joe Thompson <debianbugreports@orion-com.com>

To: Debian Bug Tracking System <submit@bugs.debian.org>

Subject: w3m corrupts binary downloads

Date: Wed, 17 Jan 2007 21:24:31 -0500

Package: w3m
Version: 0.5.1-3
Severity: important


I have a TiVo DVR, which includes a simple web interface to download the
recordings in an encrypted format.  Typically I store them on my home
server, crowley, which has a large mostly-unused disk (80 GB).  When I
use w3m to download them directly, the files end up corrupted; if I
download them to my laptop first using Firefox and sftp them to crowley,
everything is fine.  Here is a sample file listing;

-rw-r--r--  1 kensey kensey 1677862051 Jan 15 20:21 show-firefox.TiVo
-rw-rw-r--  1 kensey kensey 1678725594 Jan 14 15:15 show-w3m.TiVo

Note that the version downloaded by w3m is almost 1 MB larger than the
valid version.  When I do a "head" of the respective files, the w3m
version includes the line "1400" at the top of the file that the normal
version does not; an attempt to do a diff failed because by default diff
treats them as binary files (which they basically are); when I tried to
do a diff -a --speed-large-files, diff errored out with no output due to
memory being exhausted.

-- System Information:
Debian Release: 3.1
Architecture: i386 (i686)
Kernel: Linux 2.4.24
Locale: LANG=C, LC_CTYPE=C (charmap=ANSI_X3.4-1968)

Versions of packages w3m depends on:
ii  libc6                 2.3.2.ds1-22sarge4 GNU C Library: Shared
libraries an
ii  libgc1                1:6.4-1            conservative garbage
collector for
ii  libgpmg1              1.19.6-19sarge1    General Purpose Mouse -
shared lib
ii  libncurses5           5.4-4              Shared libraries for
terminal hand
ii  libssl0.9.7           0.9.7e-3sarge4     SSL shared libraries
ii  zlib1g                1:1.2.2-4.sarge.2  compression library -
runtime

-- no debconf information

Message #10 received at 407387@bugs.debian.org (full text, mbox, reply):

From: Edwin Olson <ebolson@umich.edu>

To: 407387@bugs.debian.org

Subject: bug reconfirmed

Date: Fri, 15 May 2009 02:49:20 -0400

[Message part 1 (text/plain, inline)]

Hi,

I am experiencing precisely the same bug. Again, connecting to a tivo web
server, the downloaded videos are corrupted.

w3m version w3m/0.5.2, options
lang=en,m17n,image,color,ansi-color,mouse,gpm,menu,cookie,ssl,ssl-verify,external-uri-loader,w3mmailer,nntp,gopher,ipv6,alarm,mark,migemo

Linux menuin 2.6.27-9-generic #1 SMP Thu Nov 20 22:15:32 UTC 2008 x86_64
GNU/Linux
(Ubuntu 9.04)

To reiterate the previous poster, if I download the files via firefox, the
files are fine.

Happy to provide additional information...

-Edwin

[Message part 2 (text/html, inline)]

Message #17 received at 407387-done@bugs.debian.org (full text, mbox, reply):

From: d+deb@vdr.jp

To: 407387-done@bugs.debian.org

Cc: control@bugs.debian.org

Subject: Re: w3m corrupts binary downloads

Date: Thu, 12 Aug 2010 12:29:03 +0900

[Message part 1 (text/plain, inline)]

tags 407387 + unreproducible
thanks

I have no TiVo, so I simply download 1.6GB and 3GB file,
but I cannot reproduce this problem.
Maybe, is it TiVo web server's bug?
So, I am afraid to close this bug.
If this problem still exists, please reopen it.
-- 
Regards,
	dai

GPG Fingerprint = 0B29 D88E 42E6 B765 B8D8 EA50 7839 619D D439 668E

[signature.asc (application/pgp-signature, inline)]

Message #22 received at 407387@bugs.debian.org (full text, mbox, reply):

From: Joe Thompson <joe@orion-com.com>

To: 407387@bugs.debian.org

Subject: Re: Bug#407387 closed by d+deb@vdr.jp (Re: w3m corrupts binary downloads)

Date: Thu, 12 Aug 2010 00:18:40 -0400

In the intervening three and a half years, the original system I
reported this from is packed away at the moment, but testing using the
latest version of w3m available on my other system (0.5.2 on Ubuntu)
the problem still exists.  It appears to be w3m (and various other
command-line tools) not handling chunked encoding of the data stream
correctly, so the chunk-size headers get included as part of the data
in the file. -- Joe
-- 
Joe Thompson | joe@orion-com.com | "...I did delay long enough to
check the spam filter logs and savor the
From: addresses and Subject: lines he had experienced."
-- unnamed sysadmin

Message #27 received at 407387@bugs.debian.org (full text, mbox, reply):

From: d+deb@vdr.jp

To: Joe Thompson <joe@orion-com.com>, 407387@bugs.debian.org

Cc: control@bugs.debian.org

Subject: Re: Bug#407387: closed by d+deb@vdr.jp (Re: w3m corrupts binary downloads)

Date: Thu, 12 Aug 2010 13:45:46 +0900

[Message part 1 (text/plain, inline)]

reopen 407387
retitle 407387 w3m: not supporting chunked transfer encoding
severity 407387 wishlist
tags 407387 - unreproducible
tags 407387 + upstream
forcemerge 407387 560153
thanks

On Thu, Aug 12, 2010 at 12:18:40AM -0400, Joe Thompson wrote:
> In the intervening three and a half years, the original system I
> reported this from is packed away at the moment, but testing using the
> latest version of w3m available on my other system (0.5.2 on Ubuntu)
> the problem still exists.  It appears to be w3m (and various other
> command-line tools) not handling chunked encoding of the data stream
> correctly, so the chunk-size headers get included as part of the data
> in the file. -- Joe

Thank you for your investigation.
I will send it to upstream.
And I reopen it and update bug status.
-- 
Regards,
	dai

GPG Fingerprint = 0B29 D88E 42E6 B765 B8D8 EA50 7839 619D D439 668E

[signature.asc (application/pgp-signature, inline)]

Send a report that this bug log contains spam.