Debian Bug report logs - #687669
pdftk seems to fail to operate on freshly generated using pdflatex PDF 1.5 but works on PDF 1.4

Toggle useless messages

Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Yaroslav Halchenko <debian@onerussian.com>

To: Debian Bug Tracking System <submit@bugs.debian.org>

Subject: pdftk seems to fail to operate on freshly generated using pdflatex PDF 1.5 but works on PDF 1.4

Date: Fri, 14 Sep 2012 18:05:09 -0400

[Message part 1 (text/plain, inline)]

Package: pdftk
Version: 1.44-6
Severity: important

It is important since it fails to work for me in conjunction with current
pdftk. pdftk is a dependency of impressive and thus this bug fails correct
operation of impressive as well.

Here is attached the output of running:

{ pdflatex s.tex && file s.pdf && LC_ALL= pdftk s.pdf output s_.pdf uncompress; } >| /tmp/pdftk-output2.log 2>&1

which ends with

Output written on s.pdf (26 pages, 2986225 bytes).
Transcript written on s.log.
s.pdf: PDF document, version 1.5
Error: Failed to open PDF file: 
   s.pdf
Errors encountered.  No output created.
Done.  Input errors, so no output created.

and it seems to work fine on files I previously generated and for which
file reports PDF version 1.4


-- System Information:
Debian Release: wheezy/sid
  APT prefers testing
  APT policy: (900, 'testing'), (600, 'unstable'), (300, 'experimental'), (100, 'stable')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 3.2.0-3-amd64 (SMP w/2 CPU cores)
Locale: LANG=en_US, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/bash

Versions of packages pdftk depends on:
ii  libc6       2.13-33
ii  libgcc1     1:4.7.1-2
ii  libgcj12    4.6.3-1
ii  libstdc++6  4.7.1-2

pdftk recommends no packages.

Versions of packages pdftk suggests:
ii  poppler-utils [xpdf-utils]  0.18.4-3

-- no debconf information

[pdftk-output2.log (text/x-asm, attachment)]

Message #8 received at 687669-submitter@bugs.debian.org (full text, mbox, reply):

From: Johann Felix Soden <johfel@debian.org>

To: 687669-submitter@bugs.debian.org

Subject: Re: Bug#687669: pdftk seems to fail to operate on freshly generated using pdflatex PDF 1.5 but works on PDF 1.4

Date: Sun, 30 Sep 2012 15:26:11 +0200

[Message part 1 (text/plain, inline)]

Hi,

thanks for your report about pdftk problems with PDF 1.5 files.

I generated several PDF 1.5 files with pdfLaTeX and other programs, but
could not (yet) reproduce the bug. So it would be helpful, if you could
send me an affected file or write me how I can generate it.

Nevertheless, there was a discussion in a German TeX newsgroup [1]. They
wrote, that pdftk has sometimes problems with PDF 1.5 object stream
compression, which is used in current pdfTeX version by default.
Adding 
 \pdfobjcompresslevel=0
to the header of your .tex file should circumvent this. 

Best regards
 Johann Felix Soden


[1]
http://de.comp.text.tex.narkive.com/jITnWgYL/pdftk-unter-ubuntu-ohne-erfolg

[signature.asc (application/pgp-signature, inline)]

Message #13 received at 687669@bugs.debian.org (full text, mbox, reply):

From: Yaroslav Halchenko <yoh@debian.org>

To: Johann Felix Soden <johfel@debian.org>

Cc: 687669@bugs.debian.org

Subject: Re: Bug#687669: pdftk seems to fail to operate on freshly generated using pdflatex PDF 1.5 but works on PDF 1.4

Date: Sun, 30 Sep 2012 11:14:20 -0400

Thank you a lot Johann,

Although \pdfobjcompresslevel=0   does seems to be help for me in some
minimalistic case, it didn't help for the whole document.
I have tried to bisect it a bit to minimize the size of .pdf to share...
seems to have boiled to the heaviest section -- so here is the pdf
http://www.onerussian.com/tmp/s-pdf1.5-failpdftk.pdf  (~7.5MB)
built with \pdfobjcompresslevel=0  which still fails pdftk

$> pdftk s-pdf1.5-failpdftk.pdf  output s_.pdf uncompress     
Error: Failed to open PDF file: 
   s-pdf1.5-failpdftk.pdf
Errors encountered.  No output created.
Done.  Input errors, so no output created.
pdftk s-pdf1.5-failpdftk.pdf output s_.pdf uncompress  2,58s user 5,94s system 99% cpu 8,538 total

License terms (CC BY-SA 3.0) are in the acknowledgement page so feel free
to share happen that would be needed.

Please let me know if I should provide more information/bisection

On Sun, 30 Sep 2012, Johann Felix Soden wrote:
> thanks for your report about pdftk problems with PDF 1.5 files.

> I generated several PDF 1.5 files with pdfLaTeX and other programs, but
> could not (yet) reproduce the bug. So it would be helpful, if you could
> send me an affected file or write me how I can generate it.

> Nevertheless, there was a discussion in a German TeX newsgroup [1]. They
> wrote, that pdftk has sometimes problems with PDF 1.5 object stream
> compression, which is used in current pdfTeX version by default.
> Adding 
>  \pdfobjcompresslevel=0
> to the header of your .tex file should circumvent this. 

> Best regards
>  Johann Felix Soden


> [1]
> http://de.comp.text.tex.narkive.com/jITnWgYL/pdftk-unter-ubuntu-ohne-erfolg




-- 
Yaroslav O. Halchenko
Postdoctoral Fellow,   Department of Psychological and Brain Sciences
Dartmouth College, 419 Moore Hall, Hinman Box 6207, Hanover, NH 03755
Phone: +1 (603) 646-9834                       Fax: +1 (603) 646-1419
WWW:   http://www.linkedin.com/in/yarik        

Message #20 received at 687669@bugs.debian.org (full text, mbox, reply):

From: Robin Houston <robin.houston@gmail.com>

To: 687669@bugs.debian.org

Subject: I think I’ve got it

Date: Mon, 7 Jan 2013 15:24:06 +0000

[Message part 1 (text/plain, inline)]

It took a bit of work to get to the bottom of this one, but I think I have
it. In fact the problem doesn’t really have anything to do at all with the
lack of a trailer: Pdftk can handle this case okay, though the way it does
it did cause a spurious exception here, which put me on the wrong track for
a while.

The actual bug is in the method PRTokeniser#nextValidToken. This method has
the feature that it treats an indirect object reference (such as 24 0 R) as
a single token. Therefore when it sees a number, it has to look ahead to
see if the number is actually the start of an indirect object reference.
If, however, the object stream ends during this lookahead then it would
wrongly fail. So it will go wrong whenever the last object in an object
stream is a number. It is perhaps surprising that this causes so apparently
few problems!

The attached patch (against Pdftk 1.45) corrects this issue, and appears to
fix the problem with Yaroslav’s example file.

Robin

[Message part 2 (text/html, inline)]

[963ed82.patch (application/octet-stream, attachment)]

Message #29 received at 687669-close@bugs.debian.org (full text, mbox, reply):

From: Johann Felix Soden <johfel@debian.org>

To: 687669-close@bugs.debian.org

Subject: Bug#687669: fixed in pdftk 1.44-7

Date: Tue, 08 Jan 2013 11:02:32 +0000

Source: pdftk
Source-Version: 1.44-7

We believe that the bug you reported is fixed in the latest version of
pdftk, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 687669@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Johann Felix Soden <johfel@debian.org> (supplier of updated pdftk package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Format: 1.8
Date: Tue, 08 Jan 2013 00:36:58 +0100
Source: pdftk
Binary: pdftk
Architecture: source i386
Version: 1.44-7
Distribution: unstable
Urgency: low
Maintainer: Johann Felix Soden <johfel@debian.org>
Changed-By: Johann Felix Soden <johfel@debian.org>
Description: 
 pdftk      - tool for manipulating PDF documents
Closes: 687669
Changes: 
 pdftk (1.44-7) unstable; urgency=low
 .
   * Add patch to solve failures with particular PDF 1.5 documents generated
     e.g. by newer pdflatex versions: Do not fail if an ObjStm ends with a
     number. (Closes: #687669)
     Thanks to Robin Houston <robin.houston@gmail.com>.
Checksums-Sha1: 
 124aa4ff89475c0b4669e0bc81a66656b8919721 1847 pdftk_1.44-7.dsc
 1d1512f60aca789c984a5f2afc111e6263c2d3b8 12471 pdftk_1.44-7.debian.tar.gz
 09a19905f2479d49396c2560f4b8d61179638377 955420 pdftk_1.44-7_i386.deb
Checksums-Sha256: 
 8980ab89e398b5ad0d88ba9b3cc5ae298d5cff1d4cf158f635e220e9408612c1 1847 pdftk_1.44-7.dsc
 2a1aefa1ff99f3bef869823ce46559a9f27f56b97048f6af1dad52c4ef555692 12471 pdftk_1.44-7.debian.tar.gz
 b6720bb4f3adcce81d5bdd330151a9ea6d7564d8add2d45583b23ee01700edb2 955420 pdftk_1.44-7_i386.deb
Files: 
 e257b5b39ee3c127aa69f550b384ed37 1847 text optional pdftk_1.44-7.dsc
 76659169b99cc0400bbbbbfd89ea434d 12471 text optional pdftk_1.44-7.debian.tar.gz
 03d410a98408d8a3b3735ecc0735ebe9 955420 text optional pdftk_1.44-7_i386.deb

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.12 (GNU/Linux)

iQIcBAEBCgAGBQJQ6/lIAAoJEINZGTv9ywnExSEP/2KzJqYQPUZ0NVXKLcprS7y6
lYbrFYIy3ZJWvOJFFTNxffy66zgufyrzjrUfIyUqF1cvcM06Sny9gR3Eq1Majc0U
IuK56U2Sk5Av1C9AsW7+wwgViPxY5cZtoJt6X+Zy5qy1gUugzK5N784AmFmU+HfF
IHylOoAcfXHcyH0chLf9VgZDQ7mO5/tTzPo6S8oilqJHqTxRseVepQLP+NYCApWC
0v0haqqTJW1myTcNFqlcYOzBPKOFGHC4OVCWsIM/Fg082wQt86YAxzLgXEBviFPj
Wh19S43UPfcCjNxvObIuX31l0mK8e1SIJgFz0lIrDDfSguvEK5W48B/sGUGl3Ezb
oz18WokY0eN/XydSHyKieoR4msC7VWR1GwTRDU+ySIr+6Xrd4KRCjIOCEemkSH5d
qNblK6kcIien1000WQPh9Sp2MpGfBRXhNRB4xDGtQHjP9ZrNvb73IJGOlcGeAyAl
irC2w5MLrrhVKNnfhk0cUOkDmRkV+DvfQ3vIPtKe0Bpc40y98uSrKe25BwObOvlP
95DIJzmI3o6jiBbYpuWpMn1gWyG/MqFaWGM4AaRI2zk+9q6MFE7VQIK+ICb/YX4a
5qFbWbhx+n7m5aZ2528VH16F0CFV1gyj7m+yJatXs9X3MIM1dvl9erTbMehL6PqL
fnGyF4ShGMvjadjcXzyD
=o/8v
-----END PGP SIGNATURE-----

Send a report that this bug log contains spam.