Debian Bug report logs - #613584
apt-get not handling Multi-Arch: foreign, Arch: all packages correctly

Toggle useless messages

Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Steve Langasek <vorlon@debian.org>

To: submit@bugs.debian.org

Subject: apt-get not handling Multi-Arch: foreign, Arch: all packages correctly

Date: Tue, 15 Feb 2011 13:03:53 -0800

[Message part 1 (text/plain, inline)]

Package: apt
Version: 0.8.11.3
Severity: important

Hi again :)

apt-get does not seem to be handling Multi-Arch: foreign packages correctly
when they are Architecture: all:

# apt-get install libc6:i386
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 libc6:i386 : Depends: tzdata:i386 but it is not installable
E: Broken packages
#

This is the Ubuntu libc6, which has foreign dependencies on both tzdata,
which is Architecture: all, and libc-bin, which is Architecture: any.

tzdata itself has the correct Multi-Arch: foreign flag set (in the Debian
and Ubuntu archives):

$ apt-cache show tzdata
Package: tzdata
Priority: required
Section: libs
Installed-Size: 6288
Maintainer: GNU Libc Maintainers <debian-glibc@lists.debian.org>
Architecture: all
Version: 2011b-2
Replaces: libc0.1, libc0.3, libc6, libc6.1
Provides: tzdata-squeeze
Depends: debconf (>= 0.5) | debconf-2.0
[...]
Multi-Arch: foreign
[...]
$

This may be because the Multiarch spec was confusing on the point of Arch:
all packages, for which I apologize.  The spec has been updated to make it
clear that Multi-Arch: foreign is allowed for Arch: all packages, and an
explanation sent to the dpkg mailing list:

  http://lists.debian.org/debian-dpkg/2011/02/msg00021.html

Raphael has already committed the fix to the experimental multiarch branch
for this.  Can you please adjust the apt resolver to match?

Thanks,
-- 
Steve Langasek                   Give me a lever long enough and a Free OS
Debian Developer                   to set it on, and I can move the world.
Ubuntu Developer                                    http://www.debian.org/
slangasek@ubuntu.com                                     vorlon@debian.org

[signature.asc (application/pgp-signature, inline)]

Message #10 received at 613584@bugs.debian.org (full text, mbox, reply):

From: David Kalnischkies <kalnischkies+debian@gmail.com>

To: Steve Langasek <vorlon@debian.org>, 613584@bugs.debian.org

Subject: Re: Bug#613584: apt-get not handling Multi-Arch: foreign, Arch: all packages correctly

Date: Tue, 15 Feb 2011 22:59:25 +0100

On Tue, Feb 15, 2011 at 22:03, Steve Langasek <vorlon@debian.org> wrote:
> This may be because the Multiarch spec was confusing on the point of Arch:
> all packages, for which I apologize.  The spec has been updated to make it
> clear that Multi-Arch: foreign is allowed for Arch: all packages, and an
> explanation sent to the dpkg mailing list:
>
>  http://lists.debian.org/debian-dpkg/2011/02/msg00021.html
>
> Raphael has already committed the fix to the experimental multiarch branch
> for this.  Can you please adjust the apt resolver to match?


Urgh… I really assumed that Multi-Arch field on arch:all packages are illegal
and that arch:all is automatic foreign as it sounds rather counter intuitive
to have an architecture independent package which needs to specify explicitly
that it is architecture independent and can therefore be used as foreign…

The whole concept of pseudo-packages emerged from the need to make arch:all
packages upgradeable (especially if changed from any to all and v.v. which
still has some smaller problems, but thats a different track) and architecture
dependent in a sense that any -> all -> any dependencies doesn't use
different any's. The pseudo-package thing allows the resolver to think
always in pseudo dependent packages. Pseudo packages just have an internal
MultiArch flag indicating that they are 'all' packages and they depend on
an architecture independent 'all' package (with no dependencies) which is
mostly used in the ordering and download system (pseudo packages can't be
downloaded - and configuring a pseudo package means that the 'all'
package and therefore also all pseudo packages are configured).

So do you have another example why this would be needed as your python
example should be dealt with the pseudo-package concept described here?
(Its discussed/documented in more detail in README.MultiArch)

If this is really changed now, I guess (I haven't touched multiarch internal
for a while, so I am not completely sure what is needed exactly) I will have
a lot of work for the next weeks, so let me end with my beginning words: Urgh


Best regards

David Kalnischkies

P.S.: I haven't checked why the install itself fails. The Multi-Arch marker is
at least completely ignored by APT for all packages. Could you tell me in
more detail how i need to setup my system to hit this problem?

Message #15 received at 613584@bugs.debian.org (full text, mbox, reply):

From: Steve Langasek <vorlon@debian.org>

To: David Kalnischkies <kalnischkies+debian@gmail.com>

Cc: 613584@bugs.debian.org

Subject: Re: Bug#613584: apt-get not handling Multi-Arch: foreign, Arch: all packages correctly

Date: Tue, 15 Feb 2011 14:42:15 -0800

[Message part 1 (text/plain, inline)]

On Tue, Feb 15, 2011 at 10:59:25PM +0100, David Kalnischkies wrote:
> On Tue, Feb 15, 2011 at 22:03, Steve Langasek <vorlon@debian.org> wrote:
> > This may be because the Multiarch spec was confusing on the point of Arch:
> > all packages, for which I apologize.  The spec has been updated to make it
> > clear that Multi-Arch: foreign is allowed for Arch: all packages, and an
> > explanation sent to the dpkg mailing list:

> >  http://lists.debian.org/debian-dpkg/2011/02/msg00021.html

> > Raphael has already committed the fix to the experimental multiarch branch
> > for this.  Can you please adjust the apt resolver to match?

> Urgh… I really assumed that Multi-Arch field on arch:all packages are
> illegal and that arch:all is automatic foreign as it sounds rather counter
> intuitive to have an architecture independent package which needs to
> specify explicitly that it is architecture independent and can therefore
> be used as foreign…

> The whole concept of pseudo-packages emerged from the need to make arch:all
> packages upgradeable (especially if changed from any to all and v.v. which
> still has some smaller problems, but thats a different track) and architecture
> dependent in a sense that any -> all -> any dependencies doesn't use
> different any's. The pseudo-package thing allows the resolver to think
> always in pseudo dependent packages. Pseudo packages just have an internal
> MultiArch flag indicating that they are 'all' packages and they depend on
> an architecture independent 'all' package (with no dependencies) which is
> mostly used in the ordering and download system (pseudo packages can't be
> downloaded - and configuring a pseudo package means that the 'all'
> package and therefore also all pseudo packages are configured).

> So do you have another example why this would be needed as your python
> example should be dealt with the pseudo-package concept described here?
> (Its discussed/documented in more detail in README.MultiArch)

I don't have other examples besides python off-hand.  But even if we decide
python is an exception and that the package should be fixed (how?  making it
arch: any?), a multiarch apt needs to correctly handle packages /as they
exist today/, not just packages as we think they should exist later.  If we
treat an arch: all package as satisfying dependencies on any arch, the
package manager will inevitably allow broken upgrade solutions in some cases
and possibly break the user's system entirely. :/

> If this is really changed now, I guess (I haven't touched multiarch
> internal for a while, so I am not completely sure what is needed exactly)
> I will have a lot of work for the next weeks, so let me end with my
> beginning words: Urgh


> P.S.: I haven't checked why the install itself fails. The Multi-Arch
> marker is at least completely ignored by APT for all packages.  Could you
> tell me in more detail how i need to setup my system to hit this problem?

Oh, really?  If it's ignored, I guess that's a separate bug!  Let me work on
reproducing this in a from-scratch chroot; in the meantime if you want to
play with the packages, I have a ppa of multiarchified packages here:

  https://launchpad.net/~vorlon/+archive/multiarch

They're built against Ubuntu natty, but I'm just installing them against a
sid chroot at the moment for testing.

(Note: the dpkg in that ppa doesn't support actually *installing* multiarch
packages; this one is just patched for use as a build-dependency, with a
dpkg-architecture that knows about the proposed non-GNU multiarch paths.)

-- 
Steve Langasek                   Give me a lever long enough and a Free OS
Debian Developer                   to set it on, and I can move the world.
Ubuntu Developer                                    http://www.debian.org/
slangasek@ubuntu.com                                     vorlon@debian.org

[signature.asc (application/pgp-signature, inline)]

Message #20 received at 613584@bugs.debian.org (full text, mbox, reply):

From: Steve Langasek <vorlon@debian.org>

To: David Kalnischkies <kalnischkies+debian@gmail.com>

Cc: 613584@bugs.debian.org

Subject: Re: Bug#613584: apt-get not handling Multi-Arch: foreign, Arch: all packages correctly

Date: Tue, 15 Feb 2011 15:10:05 -0800

[Message part 1 (text/plain, inline)]

On Tue, Feb 15, 2011 at 10:59:25PM +0100, David Kalnischkies wrote:

> P.S.: I haven't checked why the install itself fails. The Multi-Arch marker is
> at least completely ignored by APT for all packages. Could you tell me in
> more detail how i need to setup my system to hit this problem?

Reproduced in a clean sid buildd-style chroot.

 - enable multiarch (amd64+i386)
 - add the ppa as an apt source:
   deb http://ppa.launchpad.net/vorlon/multiarch/ubuntu natty main
 - apt-get update

$ export LANG=C
$ sudo apt-get purge locales
$ sudo apt-get install libc6
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following extra packages will be installed:
  libc-bin libc-dev-bin libc6-dev
Suggested packages:
  glibc-doc
Recommended packages:
  manpages-dev
The following packages will be upgraded:
  libc-bin libc-dev-bin libc6 libc6-dev
4 upgraded, 0 newly installed, 0 to remove and 11 not upgraded.
Need to get 0 B/8186 kB of archives.
After this operation, 1417 kB of additional disk space will be used.
Do you want to continue [Y/n]? y
[...]

$ sudo apt-get install libc6:i386
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 libc6:i386 : Depends: tzdata:i386 but it is not going to be installed
E: Broken packages

Package: libc6
Architecture: amd64
Version: 2.12.1-0ubuntu15+multiarch.6
Depends: libc-bin (= 2.12.1-0ubuntu15+multiarch.6), libgcc1, tzdata

Package: libc6
Architecture: i386
Version: 2.12.1-0ubuntu15+multiarch.6
Depends: libc-bin (= 2.12.1-0ubuntu15+multiarch.6), libgcc1, tzdata

Package: tzdata
Architecture: all
Version: 2011b-2
Multi-Arch: foreign

Package: libc-bin
Architecture: amd64
Version: 2.12.1-0ubuntu15+multiarch.6
Multi-Arch: foreign

-- 
Steve Langasek                   Give me a lever long enough and a Free OS
Debian Developer                   to set it on, and I can move the world.
Ubuntu Developer                                    http://www.debian.org/
slangasek@ubuntu.com                                     vorlon@debian.org

[signature.asc (application/pgp-signature, inline)]

Message #25 received at 613584@bugs.debian.org (full text, mbox, reply):

From: Steve Langasek <vorlon@debian.org>

To: David Kalnischkies <kalnischkies+debian@gmail.com>

Cc: 613584@bugs.debian.org

Subject: Re: Bug#613584: apt-get not handling Multi-Arch: foreign, Arch: all packages correctly

Date: Tue, 15 Feb 2011 23:51:14 -0800

[Message part 1 (text/plain, inline)]

On Tue, Feb 15, 2011 at 03:10:04PM -0800, Steve Langasek wrote:
> On Tue, Feb 15, 2011 at 10:59:25PM +0100, David Kalnischkies wrote:

> > P.S.: I haven't checked why the install itself fails. The Multi-Arch marker is
> > at least completely ignored by APT for all packages. Could you tell me in
> > more detail how i need to setup my system to hit this problem?

> Reproduced in a clean sid buildd-style chroot.

>  - enable multiarch (amd64+i386)
>  - add the ppa as an apt source:
>    deb http://ppa.launchpad.net/vorlon/multiarch/ubuntu natty main

Sorry, this is down for the next 24 hours; I need to rebootstrap due to some
ppa flubbing on my part.  Multiarch chroots don't cope so well if you pull
in a newer eglibc from the Ubuntu archive that doesn't have any of your
libraries on the ld.so paths :), and I didn't think fast enough to realize I
could fix this more quickly than by having to rebuild all of gcc twice.

-- 
Steve Langasek                   Give me a lever long enough and a Free OS
Debian Developer                   to set it on, and I can move the world.
Ubuntu Developer                                    http://www.debian.org/
slangasek@ubuntu.com                                     vorlon@debian.org

[signature.asc (application/pgp-signature, inline)]

Message #30 received at 613584@bugs.debian.org (full text, mbox, reply):

From: Steve Langasek <vorlon@debian.org>

To: 613584@bugs.debian.org

Subject: Re: apt-get not handling Multi-Arch: foreign, Arch: all packages correctly

Date: Sat, 5 Mar 2011 14:45:03 -0800

[Message part 1 (text/plain, inline)]

tags 613584 patch
thanks

Hi David,

I've tried my hand at patching apt for this issue.  Please find attached my
proposed solution.  Summary: remove pseudopackage handling wherever it
occurs, and treat Arch: all packages as identical to packages for the native
architecture.

The ppa at http://ppa.launchpad.net/vorlon/multiarch/ubuntu is now in pretty
good shape for testing this; just be sure to install libc6 by hand first
since pre-depends are not yet set on the library packages.

Thanks,
-- 
Steve Langasek                   Give me a lever long enough and a Free OS
Debian Developer                   to set it on, and I can move the world.
Ubuntu Developer                                    http://www.debian.org/
slangasek@ubuntu.com                                     vorlon@debian.org

[apt-613584.merge (text/plain, attachment)]

[signature.asc (application/pgp-signature, inline)]

Message #37 received at 613584-close@bugs.debian.org (full text, mbox, reply):

From: Michael Vogt <mvo@debian.org>

To: 613584-close@bugs.debian.org

Subject: Bug#613584: fixed in apt 0.8.12

Date: Thu, 10 Mar 2011 15:20:17 +0000

Source: apt
Source-Version: 0.8.12

We believe that the bug you reported is fixed in the latest version of
apt, which is due to be installed in the Debian FTP archive:

apt-doc_0.8.12_all.deb
  to main/a/apt/apt-doc_0.8.12_all.deb
apt-transport-https_0.8.12_i386.deb
  to main/a/apt/apt-transport-https_0.8.12_i386.deb
apt-utils_0.8.12_i386.deb
  to main/a/apt/apt-utils_0.8.12_i386.deb
apt_0.8.12.dsc
  to main/a/apt/apt_0.8.12.dsc
apt_0.8.12.tar.gz
  to main/a/apt/apt_0.8.12.tar.gz
apt_0.8.12_i386.deb
  to main/a/apt/apt_0.8.12_i386.deb
libapt-pkg-dev_0.8.12_i386.deb
  to main/a/apt/libapt-pkg-dev_0.8.12_i386.deb
libapt-pkg-doc_0.8.12_all.deb
  to main/a/apt/libapt-pkg-doc_0.8.12_all.deb



A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 613584@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Michael Vogt <mvo@debian.org> (supplier of updated apt package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Format: 1.8
Date: Thu, 10 Mar 2011 14:46:48 +0100
Source: apt
Binary: apt apt-doc libapt-pkg-dev libapt-pkg-doc apt-utils apt-transport-https
Architecture: source all i386
Version: 0.8.12
Distribution: unstable
Urgency: low
Maintainer: APT Development Team <deity@lists.debian.org>
Changed-By: Michael Vogt <mvo@debian.org>
Description: 
 apt        - Advanced front-end for dpkg
 apt-doc    - Documentation for APT
 apt-transport-https - APT https transport
 apt-utils  - APT utility programs
 libapt-pkg-dev - Development files for APT's libapt-pkg and libapt-inst
 libapt-pkg-doc - Documentation for APT development
Closes: 613584 613689 614298 614395 617257
Changes: 
 apt (0.8.12) unstable; urgency=low
 .
   [ Michael Vogt ]
   * apt-pkg/deb/debindexfile.cc:
     - ignore missing deb-src files in /var/lib/apt/lists, thanks
       to Thorsten Spindler (LP: #85590)
   * apt-pkg/contrib/fileutl.cc, apt-pkg/deb/dpkgpm.cc:
     - honor Dpkg::Chroot-Directory in the RunScripts*() methods
   * apt-pkg/contrib/cdromutl.{cc,h}, apt-pkg/cdrom.{cc,h}:
     - deal with missing FSTAB_DIR when using libudev to discover cdrom
     - add experimental APT::cdrom::CdromOnly option (on by default).
       When this is set to false apt-cdrom will handle any removable
       deivce (like a usb-stick) as a "cdrom/dvd" source
 .
   [ Christian Perrier ]
   * Fix error in French translation of manpages (apt_preferences(5)).
     Merci, Rémi Vanicat. Closes: #613689
   * Complete French manpage translation
   * Italian translation update (Milo Casagrande). Closes: #614395
 .
   [ David Kalnischkies ]
   * ftparchive/multicompress.cc, apt-inst/deb/debfile.cc:
     - support xz compressor to create xz-compressed Indexes and be able
       to open data.tar.xz files
     - load the supported compressors from configuration
   * ftparchive/writer.cc:
     - ensure that Date and Valid-Until time strings are not localised
     - add options to disable specific checksums for Indexes
     - include xz-compressed Packages and Sources files in Release file
   * apt-pkg/aptconfiguration.cc:
     - support download of xz-compressed indexes files
     - support adding new compressors by configuration
   * apt-pkg/deb/debsrcrecords.cc:
     - support xz-compressed source v3 debian.tar files
     - support every compression we have a compressor configured
   * ftparchive/contents.cc:
     - remove ExtractArchive codecopy from apt-inst/deb/debfile.cc
   * apt-inst/deb/debfile.cc:
     - support data.tar's compressed with any configured compressor
   * cmdline/apt-get.cc:
     - reinstall dependencies of reinstalled "garbage" (Closes: #617257)
 .
   [ Steve Langasek ]
   * apt-pkg/deb/dpkgpm.cc:
     - make sure that for multiarch packages, we are passing the full
       qualified package name to dpkg for removals. (Closes: #614298)
   * Remove the "pseudopackage" handling of Architecture: all packages for
     Multi-Arch; instead, Arch: all packages only satisfy dependencies for
     the native arch, except where the Arch: all package is declared
     Multi-Arch: foreign.  (Closes: #613584)
Checksums-Sha1: 
 08e086ffce319baa3dbe7c86d4d0fd907dd26a37 1350 apt_0.8.12.dsc
 935377d969c75b2569bf600d6ccb83fd94d1e4ce 3364368 apt_0.8.12.tar.gz
 f8a042a2c8c5b8afaafc056f5227934b0dee53e6 234114 apt-doc_0.8.12_all.deb
 b114a6131ce4ed1d0bbf847987c5da585d749a4b 724346 libapt-pkg-doc_0.8.12_all.deb
 3851ad069350fd682e5b54e34f2937c2a6fc1951 2179332 apt_0.8.12_i386.deb
 2025f8667d22df33d84ec843e52b30dfdd21119c 155824 libapt-pkg-dev_0.8.12_i386.deb
 69574a2cc8955f53fa19e48ff184e0df86a69975 292880 apt-utils_0.8.12_i386.deb
 2719096382b7394f864fec18b83f15709c160c92 86974 apt-transport-https_0.8.12_i386.deb
Checksums-Sha256: 
 9cd84d7db0e5a0ee03352b916c1035d23689787c6e57ce3f50771ea0b58b4e3b 1350 apt_0.8.12.dsc
 5fb0884c20d5b349e58f69e59145378ae2360dce6e9380fed2bf4533d1ba783d 3364368 apt_0.8.12.tar.gz
 6bc36a915001142cd85be7535e8ba3b4c8c748cba84980397eed28d6f95e8a74 234114 apt-doc_0.8.12_all.deb
 ad9aae838ec8bcbbc2485b8737eecd9a9cd1b905b497c1833bbe16039cee91c8 724346 libapt-pkg-doc_0.8.12_all.deb
 746059bda117dbe39af0e1b0dd61e95ed5ce9ecb775936729d71efed246aa633 2179332 apt_0.8.12_i386.deb
 c7abddd0421e79306e0e0ba26bafbb5c8235ee7904026ad521fb69e182aa2abf 155824 libapt-pkg-dev_0.8.12_i386.deb
 3c0c61fe7ece2459181126fa06939d704d7e304cc17d41d078018491da1393a8 292880 apt-utils_0.8.12_i386.deb
 93049d4ff81adbc82c7d0bc036238fd1d94dd1b63ecb588545321f3714f2b1f3 86974 apt-transport-https_0.8.12_i386.deb
Files: 
 22a937f2906dffb8adfcccf556ebb33e 1350 admin important apt_0.8.12.dsc
 45901374df5a670ee39f1437606ec566 3364368 admin important apt_0.8.12.tar.gz
 15ba4990dbc6298da55588dd265a473c 234114 doc optional apt-doc_0.8.12_all.deb
 3bbdfc4659f9053ff43498b35faeb1d6 724346 doc optional libapt-pkg-doc_0.8.12_all.deb
 600d5aeb336f62f2ae563f04a5798d7e 2179332 admin important apt_0.8.12_i386.deb
 26762418b0be2a5b4f7bef2a7a34987a 155824 libdevel optional libapt-pkg-dev_0.8.12_i386.deb
 f0c609f89abab0a9a7361ba83e88bdfc 292880 admin important apt-utils_0.8.12_i386.deb
 2890469ccdfbbc323536dbfeac88f993 86974 admin optional apt-transport-https_0.8.12_i386.deb

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)

iEYEARECAAYFAk1426wACgkQliSD4VZixzS+FgCcDiBH4cZ0jkYFJhYBfmhsiQqQ
t1AAn311FwLdNXgPk5DeXKMuKUg1i9NA
=jW8R
-----END PGP SIGNATURE-----

Send a report that this bug log contains spam.