Debian Bug report logs - #622272
apt-cacher-ng: should treat InRelease as a volatile file

Toggle useless messages

Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Simon McVittie <smcv@debian.org>

To: Debian Bug Tracking System <submit@bugs.debian.org>

Subject: apt-cacher-ng: should treat InRelease as a volatile file

Date: Mon, 11 Apr 2011 17:37:17 +0100

Package: apt-cacher-ng
Version: 0.6.1-1
Severity: important

Recent versions of apt prefer to download a clear-signed Release file,
"InRelease", instead of the combination of Release and Release.gpg. This
results in hash-matching failures, when acng returns a cached InRelease and a
fresh Packages/Sources. Adding it to my VfilePattern seems to fix this.

It would perhaps be better to treat all unknown files as volatile, in fact?

    S

-- System Information:
Debian Release: wheezy/sid
  APT prefers unstable
  APT policy: (500, 'unstable'), (500, 'testing'), (500, 'stable'), (101, 'experimental')
Architecture: amd64 (x86_64)

Kernel: Linux 2.6.38-2-amd64 (SMP w/2 CPU cores)
Locale: LANG=en_GB.UTF-8, LC_CTYPE=en_GB.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash

Versions of packages apt-cacher-ng depends on:
ii  adduser                 3.112+nmu2       add and remove users and groups
ii  debconf [debconf-2.0]   1.5.38           Debian configuration management sy
ii  libbz2-1.0              1.0.5-6          high-quality block-sorting file co
ii  libc6                   2.11.2-13        Embedded GNU C Library: Shared lib
ii  libfuse2                2.8.4-1.3        Filesystem in USErspace library
ii  libgcc1                 1:4.6.0-2        GCC support library
ii  liblzma2                5.0.0-2          XZ-format compression library
ii  libstdc++6              4.6.0-2          The GNU Standard C++ Library v3
ii  zlib1g                  1:1.2.3.4.dfsg-3 compression library - runtime

Versions of packages apt-cacher-ng recommends:
ii  ed                            1.4-3      The classic UNIX line editor
ii  perl                          5.10.1-19  Larry Wall's Practical Extraction 

Versions of packages apt-cacher-ng suggests:
ii  doc-base                      0.10.1     utilities to manage online documen

-- Configuration Files:
/etc/apt-cacher-ng/acng.conf changed:
CacheDir: /var/cache/apt-cacher-ng
LogDir: /var/log/apt-cacher-ng
Port:3142
BindAddress: 127.0.0.1
Remap-debrep: file:deb_mirror*.gz /debian ; file:backends_debian
Remap-uburep: file:ubuntu_mirrors /ubuntu ; file:backends_ubuntu
Remap-debvol: file:debvol_mirror*.gz /debian-volatile ; file:backends_debvol
Remap-cygwin: file:cygwin_mirrors /cygwin # ; file:backends_cygwin # incomplete, please create this file or specify preferred mirrors here
Remap-sfnet:  file:sfnet_mirrors # ; file:backends_sfnet # incomplete, please create this file or specify preferred mirrors here
Remap-alxrep: file:archlx_mirrors /archlinux # ; file:backend_archlx # incomplete, please create this file or specify preferred mirrors here
ReportPage: acng-report.html
ExTreshold: 4
VfilePattern = (^|.*?/)(Index|Packages\.bz2|Packages\.gz|Packages|Release|Release\.gpg|InRelease|Sources\.bz2|Sources\.gz|Sources|release|index\.db-.*\.gz|Contents-[^/]*\.gz|pkglist[^/]*\.bz2|rclist[^/]*\.bz2|/meta-release[^/]*|Translation[^/]*\.bz2)$

/etc/apt-cacher-ng/backends_debian changed:
http://www.mirrorservice.org/sites/ftp.debian.org/debian/
http://ftp.uk.debian.org/debian/

/etc/apt-cacher-ng/backends_debvol changed:
http://ftp.uk.debian.org/debian-volatile/

/etc/apt-cacher-ng/security.conf [Errno 13] Permission denied: u'/etc/apt-cacher-ng/security.conf'

-- debconf information:
  apt-cacher-ng/gentargetmode: No automated setup

Message #10 received at 622272@bugs.debian.org (full text, mbox, reply):

From: Eduard Bloch <edi@gmx.de>

To: Simon McVittie <smcv@debian.org>, 622272@bugs.debian.org

Subject: Re: Bug#622272: apt-cacher-ng: should treat InRelease as a volatile file

Date: Mon, 11 Apr 2011 21:59:40 +0200

#include <hallo.h>
* Simon McVittie [Mon, Apr 11 2011, 05:37:17PM]:
> Package: apt-cacher-ng
> Version: 0.6.1-1
> Severity: important
> 
> Recent versions of apt prefer to download a clear-signed Release file,
> "InRelease", instead of the combination of Release and Release.gpg. This
> results in hash-matching failures, when acng returns a cached InRelease and a
> fresh Packages/Sources. Adding it to my VfilePattern seems to fix this.
> 
> It would perhaps be better to treat all unknown files as volatile, in fact?

Are you sure about the Version? Because it should be already there:

$ /usr/sbin/apt-cacher-ng debug=20 2>&1 | grep InRelease
VfilePattern = (^|.*?/)(Index|Packages(\.gz|\.bz2|\.lzma|\.xz)?|InRelease|Release|Release\.gpg|Sources(\.gz|\.bz2|\.lzma|\.xz)?|release|index\.db-.*\.gz|Contents-[^/]*(\.gz|\.bz2|\.lzma|\.xz)|pkglist[^/]*\.bz2|rclist[^/]*\.bz2|/meta-release[^/]*|Translation[^/]*(\.gz|\.bz2|\.lzma|\.xz)|MD5SUMS|SHA1SUMS|((setup|setup-legacy)(\.ini|\.bz2|\.hint)(\.sig)?)|mirrors\.lst|repo(index|md)\.xml(\.asc|\.key)?|directory\.yast|products|content(\.asc|\.key)?|media|packages\.[a-zA-Z][a-zA-Z]\.gz|info\.txt|license\.tar\.gz|license\.zip|.*\.db\.tar\.gz|.*\.files\.tar\.gz|.*\.abs\.tar\.gz)$|/dists/.*/installer-[^/]+/[^0-9][^/]+/images/.*
WfilePattern = (^|.*?/)(Release|InRelease|Release\.gpg|(Packages|Sources)(\.gz|\.bz2|\.lzma|\.xz)?|Translation[^/]*(\.gz|\.bz2|\.lzma|\.xz)|MD5SUMS|SHA1SUMS|.*\.xml|.*\.db\.tar\.gz|.*\.files\.tar\.gz|.*\.abs\.tar\.gz|[a-z]+32.exe)$|/dists/.*/installer-.*/images/.*
VfilePattern = (^|.*?/)(Index|Packages(\\.gz|\\.bz2|\\.lzma|\\.xz)?|InRelease|Release|Release\\.gpg|Sources(\\.gz|\\.bz2|\\.lzma|\\.xz)?|release|index\\.db-.*\\.gz|Contents-[^/]*(\\.gz|\\.bz2|\\.lzma|\\.xz)|pkglist[^/]*\\.bz2|rclist[^/]*\\.bz2|/meta-release[^/]*|Translation[^/]*(\\.gz|\\.bz2|\\.lzma|\\.xz)|MD5SUMS|SHA1SUMS|((setup|setup-legacy)(\\.ini|\\.bz2|\\.hint)(\\.sig)?)|mirrors\\.lst|repo(index|md)\\.xml(\\.asc|\\.key)?|directory\\.yast|products|content(\\.asc|\\.key)?|media|packages\\.[a-zA-Z][a-zA-Z]\\.gz|info\\.txt|license\\.tar\\.gz|license\\.zip|.*\\.db\\.tar\\.gz|.*\\.files\\.tar\\.gz|.*\\.abs\\.tar\\.gz)$|/dists/.*/installer-[^/]+/[^0-9][^/]+/images/.*
WfilePattern = (^|.*?/)(Release|InRelease|Release\\.gpg|(Packages|Sources)(\\.gz|\\.bz2|\\.lzma|\\.xz)?|Translation[^/]*(\\.gz|\\.bz2|\\.lzma|\\.xz)|MD5SUMS|SHA1SUMS|.*\\.xml|.*\\.db\\.tar\\.gz|.*\\.files\\.tar\\.gz|.*\\.abs\\.tar\\.gz|[a-z]+32.exe)$|/dists/.*/installer-.*/images/.*

Regards,
Eduard.

Message #15 received at 622272@bugs.debian.org (full text, mbox, reply):

From: Simon McVittie <smcv@debian.org>

To: Eduard Bloch <edi@gmx.de>

Cc: 622272@bugs.debian.org

Subject: Re: Bug#622272: apt-cacher-ng: should treat InRelease as a volatile file

Date: Tue, 12 Apr 2011 07:33:36 +0100

On Mon, 11 Apr 2011 at 21:59:40 +0200, Eduard Bloch wrote:
> Are you sure about the Version? Because it should be already there:

I'd assumed that the commented-out VfilePattern in acng.conf was the default,
but the one you quoted below does seem much more complete. Uncommenting it
and adding InRelease did seem to fix this for me, but I'll try with the
default again...

    S

Message #20 received at 622272@bugs.debian.org (full text, mbox, reply):

From: Eduard Bloch <edi@gmx.de>

To: Simon McVittie <smcv@debian.org>

Cc: 622272@bugs.debian.org

Subject: Re: Bug#622272: apt-cacher-ng: should treat InRelease as a volatile file

Date: Tue, 12 Apr 2011 23:37:42 +0200

#include <hallo.h>
* Simon McVittie [Tue, Apr 12 2011, 07:33:36AM]:
> On Mon, 11 Apr 2011 at 21:59:40 +0200, Eduard Bloch wrote:
> > Are you sure about the Version? Because it should be already there:
> 
> I'd assumed that the commented-out VfilePattern in acng.conf was the default,
> but the one you quoted below does seem much more complete. Uncommenting it
> and adding InRelease did seem to fix this for me, but I'll try with the
> default again...

Now I am really confused. The shown example was made with a default
config. It's definitely the default string from the binary:

$ strings /usr/sbin/apt-cacher-ng  | grep InRelease | wc -l
3

Regards,
Eduard.

Message #25 received at 622272@bugs.debian.org (full text, mbox, reply):

From: Peter Chubb <peter.chubb@nicta.com.au>

To: 622272@bugs.debian.org

Subject: InRelease woes

Date: Wed, 25 May 2011 17:09:23 +1000

I'm seeing what I think is the same problem.

On a client machine:

   sudo aptitude update
   ...
52% [InRelease gpgv 158829] [Waiting for headers] [1 InRelease 70276/135 kB 52%]E: Release file expired, ignoring http://croak:9999/debian/dists/experimental/InRelease (invalid since 2d 10h 40min 42s)

And in the server logs:

Wed May 25 17:02:43 2011|known data hit, don't write to...
Wed May 25 17:02:43 2011|/var/cache/apt-cacher-ng/debrep/dists/unstable/InRelease

--
Dr Peter Chubb  http://www.gelato.unsw.edu.au  peterc AT gelato.unsw.edu.au
http://www.ertos.nicta.com.au           ERTOS within National ICT Australia

Message #30 received at 622272@bugs.debian.org (full text, mbox, reply):

From: Eduard Bloch <edi@gmx.de>

To: Peter Chubb <peter.chubb@nicta.com.au>, 622272@bugs.debian.org

Subject: Re: Bug#622272: InRelease woes

Date: Wed, 25 May 2011 23:21:14 +0200

#include <hallo.h>
* Peter Chubb [Wed, May 25 2011, 05:09:23PM]:
> 
> I'm seeing what I think is the same problem.
> 
> On a client machine:
> 
>    sudo aptitude update
>    ...
> 52% [InRelease gpgv 158829] [Waiting for headers] [1 InRelease 70276/135 kB 52%]E: Release file expired, ignoring http://croak:9999/debian/dists/experimental/InRelease (invalid since 2d 10h 40min 42s)

Is your system clock set correctly? What's in the header of that file if
you download it manually?

> And in the server logs:
> 
> Wed May 25 17:02:43 2011|known data hit, don't write to...
> Wed May 25 17:02:43 2011|/var/cache/apt-cacher-ng/debrep/dists/unstable/InRelease

Normal behavior. The upstream mirror was asked to resume a file download
(with date check) and the cached file had the same length and same (or
more recent) date as the remote file. 

I still suspect incorrect clock settings on the client or on the proxy
machine, or maybe a bad mirror which is no longer uptodate.

Regards,
Eduard.

Message #35 received at 622272@bugs.debian.org (full text, mbox, reply):

From: Eduard Bloch <edi@gmx.de>

To: 622272@bugs.debian.org

Subject: any news?

Date: Tue, 4 Oct 2011 21:10:11 +0200

tags 622272 + unreproducible moreinfo
thanks

Hello,

can you provide any news on this topic? I consider closing the bug
because AFAICS the support for InRelease is complete.

Regards,
Eduard.

Message #42 received at 622272-done@bugs.debian.org (full text, mbox, reply):

From: Eduard Bloch <edi@gmx.de>

To: 622272-done@bugs.debian.org

Subject: Re: Bug#622272: InRelease woes

Date: Sun, 11 Nov 2012 11:08:30 +0100

Version: 0.6-1

Since no more information has been provided and all oddities seem to be
explainable, closing with the version that got InRelease support.

Regards,
Eduard.

Send a report that this bug log contains spam.