Debian Bug report logs - #602571
cannot build due to ESSENTIAL dep phase

Toggle useless messages

Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Kees Cook <kees@debian.org>

To: Debian Bugs <submit@bugs.debian.org>

Subject: cannot build due to ESSENTIAL dep phase

Date: Fri, 5 Nov 2010 17:55:34 -0700

Package: sbuild
Version: 0.60.2-1
Severity: normal
User: ubuntu-devel@lists.ubuntu.com
Usertags: origin-ubuntu natty

It seems that the ESSENTIAL dep resolution breaks me (at least on Ubuntu).
I had to "exit 1" from install_essential() to restore my ability to build
(0.60.0 was working fine).

I see this during a build of rng-tools on Ubuntu natty:

┌──────────────────────────────────────────────────────────────────────────────┐
│ Install ESSENTIAL build dependencies (internal resolver)                     │
└──────────────────────────────────────────────────────────────────────────────┘

Checking for already installed dependencies...
base-files: already installed (5.0.0ubuntu25)
base-passwd: already installed (3.5.22)
bash: already installed (4.1-2ubuntu4)
coreutils: already installed (8.5-1ubuntu3)
dash: already installed (0.5.5.1-7ubuntu1)
debianutils: already installed (3.4.1)
diffutils: already installed (1:3.0-1)
dpkg: already installed (1.15.8.5ubuntu1)
e2fsprogs: already installed (1.41.12-1ubuntu2)
findutils: already installed (4.4.2-1ubuntu1)
grep: already installed (2.6.3-3)
gzip: already installed (1.3.12-9ubuntu1.1)
hostname: already installed (3.04ubuntu1)
ncurses-base: already installed (5.7+20100626-0ubuntu1)
ncurses-bin: already installed (5.7+20100626-0ubuntu1)
perl-base: already installed (5.10.1-16ubuntu1)
sed: already installed (4.2.1-7)
login: already installed (1:4.1.4.2-1ubuntu3)
sysvinit-utils: already installed (2.87dsf-4ubuntu19)
sysvinit: missing
tar: already installed (1.23-2)
bsdutils: already installed (1:2.17.2-0ubuntu1)
mount: already installed (2.17.2-0ubuntu1)
util-linux: already installed (2.17.2-0ubuntu1)
libc6-dev: already installed (2.12.1-0ubuntu8)
gcc: already installed (4:4.5.1-1ubuntu3 >= 4:4.4.3 is satisfied)
g++: already installed (4:4.5.1-1ubuntu3 >= 4:4.4.3 is satisfied)
make: already installed (3.81-8)
dpkg-dev: already installed (1.15.8.5ubuntu1 >= 1.13.5 is satisfied)
Package installation not possible
Essential dependencies not satisfied; skipping rng-tools
Not cleaning session: cloned chroot in use
Keeping session: natty-amd64-27f66890-e388-47ec-844d-cac0b898aa36
────────────────────────────────────────────────────────────────────────────────
Finished at 20101105-1745
Build needed 00:00:00, 0k disc space
Could not spawn sbuild. Result is: None.


I assume "sysvinit: missing" is the problem, but that should be satisfied
by "sysvinit-utils":

17:47 root@(natty-amd64)gorgon# apt-get install sysvinit
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Package sysvinit is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source
However the following packages replace it:
  upstart sysvinit-utils

E: Package 'sysvinit' has no installation candidate


Thanks,

-Kees



-- 
Kees Cook                                            @debian.org

Message #10 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Roger Leigh <rleigh@codelibre.net>

To: Kees Cook <kees@debian.org>, 602571@bugs.debian.org

Subject: Re: [buildd-tools-devel] Bug#602571: cannot build due to ESSENTIAL dep phase

Date: Sat, 6 Nov 2010 21:20:01 +0000

[Message part 1 (text/plain, inline)]

On Fri, Nov 05, 2010 at 05:55:34PM -0700, Kees Cook wrote:
> Package: sbuild
> Version: 0.60.2-1
> Severity: normal
> User: ubuntu-devel@lists.ubuntu.com
> Usertags: origin-ubuntu natty
> 
> It seems that the ESSENTIAL dep resolution breaks me (at least on Ubuntu).
> I had to "exit 1" from install_essential() to restore my ability to build
> (0.60.0 was working fine).
> sysvinit: missing
> I assume "sysvinit: missing" is the problem, but that should be satisfied
> by "sysvinit-utils":

Grr, that's annoying.  I've not seen this on Debian, but I do have the
actual sysvinit package installed.  So it's likely an issue with
checking if virtual packages are installed.

Note that the "aptitude" resolver should cope just fine with this;
if you set $build_dep_resolver='aptitude' in your .sbuildrc, do
you still have any problems?  I'm planning on making the aptitude
resolver the default with the next release since situations like
this are handled much better.

The "internal" resolver has only rudimentary support for virtual
package installation (added with this release).  This is however
only currently used for installation of build-deps, not checking
if a dependency is actually installed, so doesn't do a good job
of checking in this situation.  I've taken a look at the code
(lib/Sbuild/InternalResolver.pm in git), but I'm not currently
sure what the best strategy is to handle this.


Note: the current git master may be worth trying here, since I've made
some changes to both the aptitude and internal resolvers since 0.60.2
was released.

Could you possibly try current git master and run with script to
capture all stderr and with --debug to turn on debugging messages?
This should let us know exactly where it's getting stuck.  I'm
not sure the "missing" error above is where it's getting stuck.
That's in filter_dependencies and it /should/ rewrite in
virtual_dependencies() to handle installation of a real package,
but this doesn't take into account if it's installed under another
name (which it is).  We might need to be more intelligent about this
and do the rewriting while checking if the package is already
installed.  Any thoughts?

Hopefully the "internal" resolver will be removed in time, since it's
rather limited, but the Debian buildds will use it until at least
squeeze release.  So getting this fixed would be ideal.


Thanks,
Roger

-- 
  .''`.  Roger Leigh
 : :' :  Debian GNU/Linux             http://people.debian.org/~rleigh/
 `. `'   Printing on GNU/Linux?       http://gutenprint.sourceforge.net/
   `-    GPG Public Key: 0x25BFB848   Please GPG sign your mail.

[signature.asc (application/pgp-signature, inline)]

Message #15 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Roger Leigh <rleigh@codelibre.net>

To: Kees Cook <kees@debian.org>, 602571@bugs.debian.org

Subject: Re: [buildd-tools-devel] Bug#602571: cannot build due to ESSENTIAL dep phase

Date: Sat, 6 Nov 2010 23:08:29 +0000

[Message part 1 (text/plain, inline)]

On Fri, Nov 05, 2010 at 05:55:34PM -0700, Kees Cook wrote:
> Package: sbuild
> Version: 0.60.2-1
> Severity: normal
> User: ubuntu-devel@lists.ubuntu.com
> Usertags: origin-ubuntu natty
> 
> It seems that the ESSENTIAL dep resolution breaks me (at least on Ubuntu).
> I had to "exit 1" from install_essential() to restore my ability to build
> (0.60.0 was working fine).

> Package installation not possible
> Essential dependencies not satisfied; skipping rng-tools
> Not cleaning session: cloned chroot in use
> Keeping session: natty-amd64-27f66890-e388-47ec-844d-cac0b898aa36
> 
> I assume "sysvinit: missing" is the problem, but that should be satisfied
> by "sysvinit-utils":

Actually, this should work correctly AFAICT.  It should come up as
Version == '~*=PROVIDED=*=' later on, but it aborted before that.

sbuild looks for the packages providing the package name in
Sbuild::InternalResolver::get_virtual.  This should be equivalent to

apt-cache --names-only search '^sysvinit$' | sed -e 's/\([^[:space:]][[:space:]]*\)[[:space:]].*/\1/'

What do you get in your chroot for the above?

If you set $resolve_virtual=0 in your config, does this then work OK?

TBH, fixing this might be really tricky, so it might be best to
disable installing the essential package set by default when using
the internal resolver.  Even the virtual dependency rewriting in
virtual_dependencies could do the wrong thing if a package providing
it vdep other than the one we pick is already installed; the
aptitude resolver is really the way to go since the internal
resolver is such a hairy mess it's really difficult to change without
breaking stuff.  I'm tempted to back out even the virtual_dependencies
change.


Thanks,
Roger

-- 
  .''`.  Roger Leigh
 : :' :  Debian GNU/Linux             http://people.debian.org/~rleigh/
 `. `'   Printing on GNU/Linux?       http://gutenprint.sourceforge.net/
   `-    GPG Public Key: 0x25BFB848   Please GPG sign your mail.

[signature.asc (application/pgp-signature, inline)]

Message #20 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Roger Leigh <rleigh@codelibre.net>

To: Kees Cook <kees@debian.org>, 602571@bugs.debian.org

Subject: Re: [buildd-tools-devel] Bug#602571: cannot build due to ESSENTIAL dep phase

Date: Sat, 6 Nov 2010 23:17:58 +0000

[Message part 1 (text/plain, inline)]

On Fri, Nov 05, 2010 at 05:55:34PM -0700, Kees Cook wrote:
> Package: sbuild
> Version: 0.60.2-1
> Severity: normal
> User: ubuntu-devel@lists.ubuntu.com
> Usertags: origin-ubuntu natty
> 
> It seems that the ESSENTIAL dep resolution breaks me (at least on Ubuntu).
> I had to "exit 1" from install_essential() to restore my ability to build
> (0.60.0 was working fine).

That attached patch is a crude attempt to find and eliminate
provided virtual packages before we try to install them.
If you could try it (against current git master), that would
be great.

I could still do with the debug output and other tests from
my earlier mails, though.


Thanks,
Roger

-- 
  .''`.  Roger Leigh
 : :' :  Debian GNU/Linux             http://people.debian.org/~rleigh/
 `. `'   Printing on GNU/Linux?       http://gutenprint.sourceforge.net/
   `-    GPG Public Key: 0x25BFB848   Please GPG sign your mail.

[sbuild-vpkg.patch (text/x-diff, attachment)]

[signature.asc (application/pgp-signature, inline)]

Message #25 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Kees Cook <kees@debian.org>

To: Roger Leigh <rleigh@codelibre.net>

Cc: 602571@bugs.debian.org

Subject: Re: [buildd-tools-devel] Bug#602571: cannot build due to ESSENTIAL dep phase

Date: Sat, 6 Nov 2010 17:26:37 -0700

Hi Roger,

On Sat, Nov 06, 2010 at 11:08:29PM +0000, Roger Leigh wrote:
> apt-cache --names-only search '^sysvinit$' | sed -e 's/\([^[:space:]][[:space:]]*\)[[:space:]].*/\1/'
> 
> What do you get in your chroot for the above?

This returns nothing.

17:20 root@(natty-amd64)gorgon# apt-cache --names-only search '^sysvinit$' | sed -e 's/\([^[:space:]][[:space:]]*\)[[:space:]].*/\1/' 
17:21 root@(natty-amd64)gorgon# apt-cache --names-only search '^sysvinit$'
17:21 root@(natty-amd64)gorgon# exit

I suspect this is related to how Ubuntu has replaced sysvinit with upstart?
I haven't looked too closely, but this is the first time I've run into it
causing a problem.

> If you set $resolve_virtual=0 in your config, does this then work OK?

It changes slightly but still fails:

Checking for dependency conflicts...
E: Package 'sysvinit' has no installation candidate
Installing positive dependencies: sysvinit
Reading package lists...
Building dependency tree...
Reading state information...
E: Package 'sysvinit' has no installation candidate
apt-get failed.
Package installation failed
Not removing build depends: cloned chroot in use
Essential dependencies not satisfied; skipping rng-tools

> TBH, fixing this might be really tricky, so it might be best to
> disable installing the essential package set by default when using
> the internal resolver.  Even the virtual dependency rewriting in
> virtual_dependencies could do the wrong thing if a package providing
> it vdep other than the one we pick is already installed; the
> aptitude resolver is really the way to go since the internal
> resolver is such a hairy mess it's really difficult to change without
> breaking stuff.  I'm tempted to back out even the virtual_dependencies
> change.

Thanks for looking into this! For now, I'll continue to just have
Sbuild/Build.pm install_essential() return 1. :)

-Kees

-- 
Kees Cook                                            @debian.org

Message #30 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Kees Cook <kees@debian.org>

To: Roger Leigh <rleigh@codelibre.net>

Cc: 602571@bugs.debian.org

Subject: Re: [buildd-tools-devel] Bug#602571: cannot build due to ESSENTIAL dep phase

Date: Sat, 6 Nov 2010 17:27:40 -0700

On Sat, Nov 06, 2010 at 11:17:58PM +0000, Roger Leigh wrote:
> That attached patch is a crude attempt to find and eliminate
> provided virtual packages before we try to install them.
> If you could try it (against current git master), that would
> be great.
> 
> I could still do with the debug output and other tests from
> my earlier mails, though.

I'll send this once I get git master built. Thanks again!

-- 
Kees Cook                                            @debian.org

Message #35 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Roger Leigh <rleigh@codelibre.net>

To: Kees Cook <kees@debian.org>

Cc: 602571@bugs.debian.org

Subject: Re: [buildd-tools-devel] Bug#602571: cannot build due to ESSENTIAL dep phase

Date: Sun, 7 Nov 2010 00:36:55 +0000

[Message part 1 (text/plain, inline)]

On Sat, Nov 06, 2010 at 05:26:37PM -0700, Kees Cook wrote:
> Hi Roger,
> 
> On Sat, Nov 06, 2010 at 11:08:29PM +0000, Roger Leigh wrote:
> > apt-cache --names-only search '^sysvinit$' | sed -e 's/\([^[:space:]][[:space:]]*\)[[:space:]].*/\1/'
> > 
> > What do you get in your chroot for the above?
> 
> This returns nothing.

This is the root cause of the failure in this case.  There isn't a
package providing sysvinit on your system (if there is, then we aren't
checking for it properly).

You might want to check
/usr/share/doc/build-essential/essential-packages-list (contains sysvinit)
You might want to drop sysvinit from the list on ubuntu, since this is
the definitive list we refer to when we set up the build environment.

> 17:20 root@(natty-amd64)gorgon# apt-cache --names-only search '^sysvinit$' | sed -e 's/\([^[:space:]][[:space:]]*\)[[:space:]].*/\1/' 
> 17:21 root@(natty-amd64)gorgon# apt-cache --names-only search '^sysvinit$'
> 17:21 root@(natty-amd64)gorgon# exit
> 
> I suspect this is related to how Ubuntu has replaced sysvinit with upstart?
> I haven't looked too closely, but this is the first time I've run into it
> causing a problem.

We previously installed build-essential when setting up a chroot, and
reported missing bits in the logs.  The latest release now actually
reads the lists and adds them to the positive source dependencies to
actually *ensure* they are installed.  This is supported to be an
additional sanity check to be sure the environment has the build
essential packages installed, but in your case (assuming the list is
outdated) contains an uninstallable package, and hence the error.

If this is the case, could you let me know?


Thanks,
Roger

-- 
  .''`.  Roger Leigh
 : :' :  Debian GNU/Linux             http://people.debian.org/~rleigh/
 `. `'   Printing on GNU/Linux?       http://gutenprint.sourceforge.net/
   `-    GPG Public Key: 0x25BFB848   Please GPG sign your mail.

[signature.asc (application/pgp-signature, inline)]

Message #40 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Roger Leigh <rleigh@codelibre.net>

To: Kees Cook <kees@debian.org>, 602571@bugs.debian.org

Subject: Re: [buildd-tools-devel] Bug#602571: Bug#602571: cannot build due to ESSENTIAL dep phase

Date: Sun, 7 Nov 2010 01:49:28 +0000

[Message part 1 (text/plain, inline)]

On Sat, Nov 06, 2010 at 05:27:40PM -0700, Kees Cook wrote:
> On Sat, Nov 06, 2010 at 11:17:58PM +0000, Roger Leigh wrote:
> > That attached patch is a crude attempt to find and eliminate
> > provided virtual packages before we try to install them.
> > If you could try it (against current git master), that would
> > be great.
> > 
> > I could still do with the debug output and other tests from
> > my earlier mails, though.
> 
> I'll send this once I get git master built. Thanks again!

Just FYI, the git master was changing up until 01:50 UTC
so you might want to fetch again to get the latest.


Thanks,
Roger

-- 
  .''`.  Roger Leigh
 : :' :  Debian GNU/Linux             http://people.debian.org/~rleigh/
 `. `'   Printing on GNU/Linux?       http://gutenprint.sourceforge.net/
   `-    GPG Public Key: 0x25BFB848   Please GPG sign your mail.

[signature.asc (application/pgp-signature, inline)]

Message #45 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Loïc Minier <lool@dooz.org>

To: Roger Leigh <rleigh@codelibre.net>, 602571@bugs.debian.org

Cc: Kees Cook <kees@debian.org>

Subject: Re: Bug#602571: [buildd-tools-devel] Bug#602571: cannot build due to ESSENTIAL dep phase

Date: Fri, 12 Nov 2010 17:11:25 +0100

        Hey

On Sat, Nov 06, 2010, Roger Leigh wrote:
> That attached patch is a crude attempt to find and eliminate
> provided virtual packages before we try to install them.
> If you could try it (against current git master), that would
> be great.
> 
> I could still do with the debug output and other tests from
> my earlier mails, though.

 I tried applying the patch on top of 0.60.4 which I think is posterior
 to this comment, but I got:
┌──────────────────────────────────────────────────────────────────────────────┐
│ Install core build dependencies (internal resolver)                          │
└──────────────────────────────────────────────────────────────────────────────┘

Build-Depends: build-essential, fakeroot
Checking for already installed dependencies...
build-essential: already installed (11.5)
fakeroot: already installed (1.14.4-1ubuntu1)
Checking for dependency conflicts...
Installing positive dependencies: 
Removing negative dependencies: 
Checking correctness of dependencies...
┌──────────────────────────────────────────────────────────────────────────────┐
│ Install dpkg build dependencies (internal resolver)                          │
└──────────────────────────────────────────────────────────────────────────────┘

Build-Depends: base-files, base-passwd, bash, coreutils, dash, debianutils, diffutils, dpkg, e2fsprogs, findutils, grep, gzip, hostname, ncurses-base, ncurses-bin, perl-base, sed, login, sysvinit-utils, sysvinit, tar, bsdutils, mount, util-linux, libc6-dev | libc-dev, gcc (>= 4:4.4.3), g++ (>= 4:4.4.3), make, dpkg-dev (>= 1.13.5), debhelper (>= 6.0.7), pkg-config, gettext (>= 0.18), po4a (>= 0.33.1), libncursesw5-dev, zlib1g-dev (>= 1:1.1.3-19.1), libbz2-dev, flex, libselinux1-dev (>= 1.28-4), libtimedate-perl, libio-string-perl
Checking for already installed dependencies...
base-files: already installed (5.0.0ubuntu25)
base-passwd: already installed (3.5.22)
bash: already installed (4.1-2ubuntu4)
coreutils: already installed (8.5-1ubuntu3)
dash: already installed (0.5.5.1-7ubuntu1)
debianutils: already installed (3.4.1)
diffutils: already installed (1:3.0-1)
dpkg: already installed (1.15.8.5ubuntu1)
e2fsprogs: already installed (1.41.12-1ubuntu2)
findutils: already installed (4.4.2-1ubuntu1)
grep: already installed (2.6.3-3)
gzip: already installed (1.3.12-9ubuntu1.1)
hostname: already installed (3.04ubuntu1)
ncurses-base: already installed (5.7+20100626-0ubuntu1)
ncurses-bin: already installed (5.7+20100626-0ubuntu1)
perl-base: already installed (5.10.1-15ubuntu2)
sed: already installed (4.2.1-7)
login: already installed (1:4.1.4.2-1ubuntu3)
sysvinit-utils: already installed (2.87dsf-4ubuntu18)
sysvinit: missing
tar: already installed (1.23-2)
bsdutils: already installed (1:2.17.2-0ubuntu1)
mount: already installed (2.17.2-0ubuntu1)
util-linux: already installed (2.17.2-0ubuntu1)
libc6-dev: already installed (2.12.1-0ubuntu7)
gcc: already installed (4:4.5.1-1ubuntu2 >= 4:4.4.3 is satisfied)
g++: already installed (4:4.5.1-1ubuntu2 >= 4:4.4.3 is satisfied)
make: already installed (3.81-8)
dpkg-dev: already installed (1.15.8.5ubuntu1 >= 1.13.5 is satisfied)
debhelper: missing
Using default version 8.0.0ubuntu1
pkg-config: missing
gettext: missing
Using default version 0.18.1.1-1ubuntu2
po4a: missing
Using default version 0.40.1-1
libncursesw5-dev: missing
zlib1g-dev: missing
Using default version 1:1.2.3.4.dfsg-3ubuntu1
libbz2-dev: missing
flex: missing
libselinux1-dev: missing
Using default version 2.0.96-1
libtimedate-perl: already installed (1.2000-1)
libio-string-perl: missing
Checking for dependency conflicts...
E: Package 'sysvinit' has no installation candidate
Installing positive dependencies: sysvinit debhelper pkg-config gettext po4a libncursesw5-dev zlib1g-dev libbz2-dev flex libselinux1-dev libio-string-perl
Reading package lists...
Building dependency tree...
Reading state information...
E: Package 'sysvinit' has no installation candidate
apt-get failed.
Package installation failed
Not removing build depends: cloned chroot in use
[...]

  Cheers,
-- 
Loïc Minier

Message #50 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Loïc Minier <lool@dooz.org>

To: Roger Leigh <rleigh@codelibre.net>, 602571@bugs.debian.org

Cc: Kees Cook <kees@debian.org>

Subject: Re: Bug#602571: [buildd-tools-devel] Bug#602571: cannot build due to ESSENTIAL dep phase

Date: Fri, 12 Nov 2010 17:13:44 +0100

[Message part 1 (text/plain, inline)]

On Sat, Nov 06, 2010, Roger Leigh wrote:
> Grr, that's annoying.  I've not seen this on Debian, but I do have the
> actual sysvinit package installed.  So it's likely an issue with
> checking if virtual packages are installed.

 There's a quick and easy way to reproduce if you're tempted!  ;-)
 Launchpad exposes the chroot tarballs used for Ubuntu buildds via it's
 web API.

 To setup, I use this schroot.conf snippet:
    [natty]
    type=file
    description=Ubuntu natty
    root-users=lool
    file=/srv/schroot/chroot-ubuntu-natty-amd64.tar.bz2
    location=/chroot-autobuild
    preserve-environment=true

 /srv/schroot/chroot-ubuntu-natty-amd64.tar.bz2 is the chroot used on
 Launchpad buildds for natty/amd64.  I'm attaching dl-lp-chroot which
 downloads such a chroot; it's a trivial wrapper around
 https://launchpad.net/api/devel/ubuntu/$dist/$arch/chroot_url URLs

-- 
Loïc Minier

[dl-lp-chroot (text/plain, attachment)]

Message #55 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Roger Leigh <rleigh@codelibre.net>

To: Loïc Minier <lool@dooz.org>

Cc: 602571@bugs.debian.org, Kees Cook <kees@debian.org>

Subject: Re: Bug#602571: [buildd-tools-devel] Bug#602571: cannot build due to ESSENTIAL dep phase

Date: Fri, 12 Nov 2010 22:42:08 +0000

[Message part 1 (text/plain, inline)]

On Fri, Nov 12, 2010 at 05:13:44PM +0100, Loïc Minier wrote:
> On Sat, Nov 06, 2010, Roger Leigh wrote:
> > Grr, that's annoying.  I've not seen this on Debian, but I do have the
> > actual sysvinit package installed.  So it's likely an issue with
> > checking if virtual packages are installed.
> 
>  There's a quick and easy way to reproduce if you're tempted!  ;-)

I'm afraid I don't have the time to commit to it :(

The main question that needs answering is:
Are all the packages listed in
/usr/share/doc/build-essential/essential-packages-list and
/usr/share/doc/build-essential/list
available and installable?

If not, then the list is outdated and needs fixing.  If they
are, then there's a problem with sbuild.

Virtual packages are not resolved automatically in 0.60.4;
you'll need to set $resolve_virtual=1 in your sbuild configuration
(for the internal resolver; the apt/aptitude resolvers do this
automatically).


Thanks,
Roger

-- 
  .''`.  Roger Leigh
 : :' :  Debian GNU/Linux             http://people.debian.org/~rleigh/
 `. `'   Printing on GNU/Linux?       http://gutenprint.sourceforge.net/
   `-    GPG Public Key: 0x25BFB848   Please GPG sign your mail.

[signature.asc (application/pgp-signature, inline)]

Message #60 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Loïc Minier <lool@dooz.org>

To: Roger Leigh <rleigh@codelibre.net>

Cc: 602571@bugs.debian.org, Kees Cook <kees@debian.org>

Subject: Re: Bug#602571: [buildd-tools-devel] Bug#602571: cannot build due to ESSENTIAL dep phase

Date: Sat, 13 Nov 2010 16:41:29 +0100

        Hi

On Fri, Nov 12, 2010, Roger Leigh wrote:
> The main question that needs answering is:
> Are all the packages listed in
> /usr/share/doc/build-essential/essential-packages-list and
> /usr/share/doc/build-essential/list
> available and installable?

 Argh, thanks for pointing that out!!

 I was assuming that sysvinit was indeed a virtual package in Ubuntu per
 the original bug report, but it's not!

 "apt-get install sysvinit" indeed suggests upstart and sysvinit-utils;
 that's because each of them Replaces: sysvinit, but sysvinit-utils
 Provides: sysvutils, not sysvinit!  (and upstart has unrelated
 Provides)

 I checked and there is no sysvinit Provides in Ubuntu; simply an
 out-of-date essential.list in build-essential... (it's not generated at
 build time)

 Once I fixed /usr/share/doc/build-essential/essential-packages-list not
 to list sysvinit in the chroot, I could build packages just fine.

 I've uploaded a fixed build-essential package to Ubuntu.

> Virtual packages are not resolved automatically in 0.60.4;
> you'll need to set $resolve_virtual=1 in your sbuild configuration
> (for the internal resolver; the apt/aptitude resolvers do this
> automatically).

 Ah, I didn't know about this config either; thanks for pointing it out!

 With the /usr/share/doc/build-essential/essential-packages-list fix,
 "$resolve_virtual = 1;" didn't affect the build (it would still build
 with virtuals enabled).


 With the /usr/share/doc/build-essential/essential-packages-list fix, I
 tried your sbuild-vpkg.patch again; packages still build fine both with
 "$resolve_virtual = 1;" and without.

 Without the /usr/share/doc/build-essential/essential-packages-list fix,
 I found that the output was a bit more cryptic with your patch, since I
 got:
┌──────────────────────────────────────────────────────────────────────────────┐
│ Install core build dependencies (internal resolver)                          │
└──────────────────────────────────────────────────────────────────────────────┘

Build-Depends: build-essential, fakeroot
Checking for already installed dependencies...
build-essential: already installed (11.5)
fakeroot: already installed (1.14.4-1ubuntu1)
Checking for dependency conflicts...
Installing positive dependencies: 
Removing negative dependencies: 
Checking correctness of dependencies...

┌──────────────────────────────────────────────────────────────────────────────┐
│ Install dpkg build dependencies (internal resolver)                          │
└──────────────────────────────────────────────────────────────────────────────┘

Build-Depends: base-files, base-passwd, bash, coreutils, dash, debianutils, diffutils, dpkg, e2fsprogs, findutils, grep, gzip, hostname, ncurses-base, ncurses-bin, perl-base, sed, login, sysvinit-utils, sysvinit, tar, bsdutils, mount, util-linux, libc6-dev | libc-dev, gcc (>= 4:4.4.3), g++ (>= 4:4.4.3), make, dpkg-dev (>= 1.13.5), debhelper (>= 6.0.7), pkg-config, gettext (>= 0.18), po4a (>= 0.33.1), libncursesw5-dev, zlib1g-dev (>= 1:1.1.3-19.1), libbz2-dev, flex, libselinux1-dev (>= 1.28-4), libtimedate-perl, libio-string-perl
Checking for already installed dependencies...
base-files: already installed (5.0.0ubuntu25)
base-passwd: already installed (3.5.22)
bash: already installed (4.1-2ubuntu4)
coreutils: already installed (8.5-1ubuntu3)
dash: already installed (0.5.5.1-7ubuntu1)
debianutils: already installed (3.4.1)
diffutils: already installed (1:3.0-1)
dpkg: already installed (1.15.8.5ubuntu1)
e2fsprogs: already installed (1.41.12-1ubuntu2)
findutils: already installed (4.4.2-1ubuntu1)
grep: already installed (2.6.3-3)
gzip: already installed (1.3.12-9ubuntu1.1)
hostname: already installed (3.04ubuntu1)
ncurses-base: already installed (5.7+20100626-0ubuntu1)
ncurses-bin: already installed (5.7+20100626-0ubuntu1)
perl-base: already installed (5.10.1-15ubuntu2)
sed: already installed (4.2.1-7)
login: already installed (1:4.1.4.2-1ubuntu3)
sysvinit-utils: already installed (2.87dsf-4ubuntu18)
sysvinit: missing
tar: already installed (1.23-2)
bsdutils: already installed (1:2.17.2-0ubuntu1)
mount: already installed (2.17.2-0ubuntu1)
util-linux: already installed (2.17.2-0ubuntu1)
libc6-dev: already installed (2.12.1-0ubuntu7)
gcc: already installed (4:4.5.1-1ubuntu2 >= 4:4.4.3 is satisfied)
g++: already installed (4:4.5.1-1ubuntu2 >= 4:4.4.3 is satisfied)
make: already installed (3.81-8)
dpkg-dev: already installed (1.15.8.5ubuntu1 >= 1.13.5 is satisfied)
debhelper: missing
pkg-config: missing
gettext: missing
po4a: missing
libncursesw5-dev: missing
zlib1g-dev: missing
libbz2-dev: missing
flex: missing
libselinux1-dev: missing
libtimedate-perl: already installed (1.2000-1)
libio-string-perl: missing
Package installation not possible: failed to find virtual dependencies
Source-dependencies not satisfied; skipping dpkg
Not cleaning session: cloned chroot in use

 The error message is more confusing than the original one since the
 mention of ESSENTIAL as a separate step was bit more explicit; I
 suspect the change is not related to your patch though, but rather to
 other sbuild updates.

 I'm not familiar with sbuild, but from reading sbuild-vpkg.patch it
 seemed entirely appropriate, but since I can't confirm it fixes
 anything, I don't know whether you want to include it or not.

 It seems this bug can be closed since it's a problem in Ubuntu's
 build-essential, I'm leaving it open in case you'd like to merge
 sbuild-vpkg.patch.

    Thanks!
-- 
Loïc Minier

Message #65 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Roger Leigh <rleigh@codelibre.net>

To: Loïc Minier <lool@dooz.org>, 602571@bugs.debian.org

Cc: Kees Cook <kees@debian.org>

Subject: Re: [buildd-tools-devel] Bug#602571: Bug#602571: cannot build due to ESSENTIAL dep phase

Date: Sun, 14 Nov 2010 16:47:39 +0000

[Message part 1 (text/plain, inline)]

On Sat, Nov 13, 2010 at 04:41:29PM +0100, Loïc Minier wrote:
> On Fri, Nov 12, 2010, Roger Leigh wrote:
> > The main question that needs answering is:
> > Are all the packages listed in
> > /usr/share/doc/build-essential/essential-packages-list and
> > /usr/share/doc/build-essential/list
> > available and installable?
> 
>  The error message is more confusing than the original one since the
>  mention of ESSENTIAL as a separate step was bit more explicit; I
>  suspect the change is not related to your patch though, but rather to
>  other sbuild updates.

We should probably do one or both of

- making the error messages much more explicit about what went wrong
- separating the essential and package build deps.

The essential and package deps were merged since they can all be
installed in a single apt-get/aptitude run, which is more efficient
and lets the resolver make a more informed decision based on what
the final outcome should be.

>  I'm not familiar with sbuild, but from reading sbuild-vpkg.patch it
>  seemed entirely appropriate, but since I can't confirm it fixes
>  anything, I don't know whether you want to include it or not.
> 
>  It seems this bug can be closed since it's a problem in Ubuntu's
>  build-essential, I'm leaving it open in case you'd like to merge
>  sbuild-vpkg.patch.

I've now applied the patch.  It does make sense to do this, but it
doesn't make the diagnostics better when things go wrong.  It's
only activated when $resolve_virtual is enabled, so by default it
won't attempt to find virtual packages.


Regards,
Roger

-- 
  .''`.  Roger Leigh
 : :' :  Debian GNU/Linux             http://people.debian.org/~rleigh/
 `. `'   Printing on GNU/Linux?       http://gutenprint.sourceforge.net/
   `-    GPG Public Key: 0x25BFB848   Please GPG sign your mail.

[signature.asc (application/pgp-signature, inline)]

Message #70 received at 602571-done@bugs.debian.org (full text, mbox, reply):

From: Roger Leigh <rleigh@codelibre.net>

To: Loïc Minier <lool@dooz.org>, 602571-done@bugs.debian.org

Cc: Kees Cook <kees@debian.org>

Subject: Re: [buildd-tools-devel] Bug#602571: Bug#602571: cannot build due to ESSENTIAL dep phase

Date: Sat, 20 Nov 2010 17:01:00 +0000

[Message part 1 (text/plain, inline)]

Version: 0.60.5-1

On Sat, Nov 13, 2010 at 04:41:29PM +0100, Loïc Minier wrote:
>  It seems this bug can be closed since it's a problem in Ubuntu's
>  build-essential, I'm leaving it open in case you'd like to merge
>  sbuild-vpkg.patch.

That's now merged; closing.


Regards,
Roger

-- 
  .''`.  Roger Leigh
 : :' :  Debian GNU/Linux             http://people.debian.org/~rleigh/
 `. `'   Printing on GNU/Linux?       http://gutenprint.sourceforge.net/
   `-    GPG Public Key: 0x25BFB848   Please GPG sign your mail.

[signature.asc (application/pgp-signature, inline)]

Message #75 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Jamie Strandboge <jamie@ubuntu.com>

To: 602571@bugs.debian.org

Cc: Roger Leigh <rleigh@codelibre.net>, Kees Cook <kees@outflux.net>, Loïc Minier <lool@dooz.org>

Subject: Re: cannot build due to ESSENTIAL dep phase

Date: Fri, 03 Dec 2010 14:52:56 -0600

[Message part 1 (text/plain, inline)]

Hi,

While Loïc's change is the technically correct change, it does not
address existing Ubuntu releases which do not have an updated
build-essential[1]. Even if we changed build-essential for all current
active stable releases of Ubuntu, people would still not be able to
build packages on EOL releases, which is desirable.

As such, after discussing this with Kees, I have uploaded a workaround
in Ubuntu which removes 'sysvinit' from the list of essential packages
to install when building packages in Ubuntu chroots. While this is an
Ubuntu-specific change, the patch is small, obvious, and should not
affect Debian or any of its other derivatives. While we can carry this
delta going forward, I request that you include it in sbuild proper
(though I understand if this is unacceptable).

Thank you for your consideration.

[1] https://launchpad.net/bugs/684931

[sbuild_0.60.5-1ubuntu2.debdiff (text/x-patch, attachment)]

[signature.asc (application/pgp-signature, inline)]

Message #80 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Loïc Minier <loic.minier@ubuntu.com>

To: Jamie Strandboge <jamie@ubuntu.com>

Cc: 602571@bugs.debian.org, Roger Leigh <rleigh@codelibre.net>, Kees Cook <kees@outflux.net>

Subject: Re: cannot build due to ESSENTIAL dep phase

Date: Sat, 4 Dec 2010 14:22:08 +0100

On Fri, Dec 03, 2010, Jamie Strandboge wrote:
>                                                      While this is an
> Ubuntu-specific change, the patch is small, obvious, and should not
> affect Debian or any of its other derivatives. While we can carry this
> delta going forward, I request that you include it in sbuild proper
> (though I understand if this is unacceptable).

 In fact this is useful whenever using an Ubuntu chroot, from Ubuntu or
 from Debian, so it would definitely make sense in Debian's sbuild.

-- 
Loïc Minier

Message #85 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Roger Leigh <rleigh@codelibre.net>

To: Loïc Minier <loic.minier@ubuntu.com>

Cc: Jamie Strandboge <jamie@ubuntu.com>, 602571@bugs.debian.org, Kees Cook <kees@outflux.net>

Subject: Re: cannot build due to ESSENTIAL dep phase

Date: Sat, 4 Dec 2010 13:35:09 +0000

[Message part 1 (text/plain, inline)]

On Sat, Dec 04, 2010 at 02:22:08PM +0100, Loïc Minier wrote:
> On Fri, Dec 03, 2010, Jamie Strandboge wrote:
> >                                                      While this is an
> > Ubuntu-specific change, the patch is small, obvious, and should not
> > affect Debian or any of its other derivatives. While we can carry this
> > delta going forward, I request that you include it in sbuild proper
> > (though I understand if this is unacceptable).
> 
>  In fact this is useful whenever using an Ubuntu chroot, from Ubuntu or
>  from Debian, so it would definitely make sense in Debian's sbuild.

Would it be rather simpler, and a more general solution, to just
add a configuration option to disable installation of build essential,
to allow disabling on any system?  You could then just put

  $install_build_essential = 0;

in your sbuild.conf and it will never be used.


Regards,
Roger

-- 
  .''`.  Roger Leigh
 : :' :  Debian GNU/Linux             http://people.debian.org/~rleigh/
 `. `'   Printing on GNU/Linux?       http://gutenprint.sourceforge.net/
   `-    GPG Public Key: 0x25BFB848   Please GPG sign your mail.

[signature.asc (application/pgp-signature, inline)]

Message #90 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Roger Leigh <rleigh@codelibre.net>

To: Loïc Minier <loic.minier@ubuntu.com>

Cc: Jamie Strandboge <jamie@ubuntu.com>, 602571@bugs.debian.org, Kees Cook <kees@outflux.net>

Subject: Re: cannot build due to ESSENTIAL dep phase

Date: Sat, 4 Dec 2010 13:36:14 +0000

[Message part 1 (text/plain, inline)]

On Sat, Dec 04, 2010 at 02:22:08PM +0100, Loïc Minier wrote:
> On Fri, Dec 03, 2010, Jamie Strandboge wrote:
> >                                                      While this is an
> > Ubuntu-specific change, the patch is small, obvious, and should not
> > affect Debian or any of its other derivatives. While we can carry this
> > delta going forward, I request that you include it in sbuild proper
> > (though I understand if this is unacceptable).
> 
>  In fact this is useful whenever using an Ubuntu chroot, from Ubuntu or
>  from Debian, so it would definitely make sense in Debian's sbuild.

Are all Ubuntu releases affected, or just the later ones?  When was
sysvinit removed?


Thanks,
Roger

-- 
  .''`.  Roger Leigh
 : :' :  Debian GNU/Linux             http://people.debian.org/~rleigh/
 `. `'   Printing on GNU/Linux?       http://gutenprint.sourceforge.net/
   `-    GPG Public Key: 0x25BFB848   Please GPG sign your mail.

[signature.asc (application/pgp-signature, inline)]

Message #95 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Loïc Minier <loic.minier@ubuntu.com>

To: Roger Leigh <rleigh@codelibre.net>

Cc: Jamie Strandboge <jamie@ubuntu.com>, 602571@bugs.debian.org, Kees Cook <kees@outflux.net>

Subject: Re: cannot build due to ESSENTIAL dep phase

Date: Sat, 4 Dec 2010 15:26:12 +0100

On Sat, Dec 04, 2010, Roger Leigh wrote:
> Would it be rather simpler, and a more general solution, to just
> add a configuration option to disable installation of build essential,
> to allow disabling on any system?  You could then just put
> 
>   $install_build_essential = 0;

 While this particular option might make sense on its own right, it's
 kind of orthogonal to the problem at hand: sysvinit is listed in
 build-essential packages but isn't actually build-essential.  It's
 really a bug in the build-essential package in Ubuntu, but it's
 intrusive to fix it in build-essential in very old releases, hence the
 sbuild workaround.

 IOW, it would be desirable to be able to keep install_build_essential=1
 even if targetting broken Ubuntu releases.  Also you will have to
 support this config option forever.

On Sat, Dec 04, 2010, Roger Leigh wrote:
> Are all Ubuntu releases affected, or just the later ones?  When was
> sysvinit removed?

 The current Ubuntu development release (natty, to be 11.04) is not
 affected anymore as I fixed build-essential there, but pretty much all
 the maintained one are affected.  We still support 6.06 (dapper) which
 will be end-of-lifed in 2011/06 (+5y), and it didn't have upstart, but
 all releases since 6.06 had upstart:
   upstart |    0.3.9-2 |         hardy | source, amd64, i386
   upstart |    0.3.9-8 |        jaunty | source, amd64, i386
   upstart |   0.6.3-10 |        karmic | source, amd64, i386
   upstart |    0.6.5-6 |         lucid | source, amd64, i386
   upstart |    0.6.6-3 |      maverick | source, amd64, i386
 in particular 10.04 (lucid), which is to be supported until 2015/04.

 I'm not sure 6.06 is a big issue, but Jamie is in the Ubuntu security
 team, so he can comment about that one.  My guess is that sysvinit is
 already installed in the chroot anyway, so the sysvinit workaround
 doesn't hurt.

-- 
Loïc Minier

Message #100 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Jamie Strandboge <jamie@ubuntu.com>

To: Loïc Minier <loic.minier@ubuntu.com>

Cc: Roger Leigh <rleigh@codelibre.net>, 602571@bugs.debian.org, Kees Cook <kees@outflux.net>

Subject: Re: cannot build due to ESSENTIAL dep phase

Date: Mon, 06 Dec 2010 11:52:50 -0600

[Message part 1 (text/plain, inline)]

On Sat, 2010-12-04 at 15:26 +0100, Loïc Minier wrote:
> On Sat, Dec 04, 2010, Roger Leigh wrote:
> > Are all Ubuntu releases affected, or just the later ones?  When was
> > sysvinit removed?
> 
>  The current Ubuntu development release (natty, to be 11.04) is not
>  affected anymore as I fixed build-essential there, but pretty much all
>  the maintained one are affected.  We still support 6.06 (dapper) which
>  will be end-of-lifed in 2011/06 (+5y), and it didn't have upstart, but
>  all releases since 6.06 had upstart:
>    upstart |    0.3.9-2 |         hardy | source, amd64, i386
>    upstart |    0.3.9-8 |        jaunty | source, amd64, i386
>    upstart |   0.6.3-10 |        karmic | source, amd64, i386
>    upstart |    0.6.5-6 |         lucid | source, amd64, i386
>    upstart |    0.6.6-3 |      maverick | source, amd64, i386
>  in particular 10.04 (lucid), which is to be supported until 2015/04.
> 
For clarity, the above are the currently supported Ubuntu releases
affected by the bug. There are also the EOL releases 6.10 (with upstart
0.2.7-7), 7.04, 7.10, and 8.10) and it may be desirable for some people
to build things in these EOL chroots.

>  I'm not sure 6.06 is a big issue, but Jamie is in the Ubuntu security
>  team, so he can comment about that one.  My guess is that sysvinit is
>  already installed in the chroot anyway, so the sysvinit workaround
>  doesn't hurt.
6.06 is not an issue for our team as the way that we build our chroots
includes sysvinit. The patch as submitted is currently quite simple, but
the technique could be refined such that we check for only specific
releases, but I don't think that this is required since in natty and
latter there is no sysvinit to remove from the list anyway.

-- 
Jamie Strandboge             | http://www.ubuntu.com

[signature.asc (application/pgp-signature, inline)]

Message #105 received at 602571@bugs.debian.org (full text, mbox, reply):

From: Roger Leigh <rleigh@codelibre.net>

To: Jamie Strandboge <jamie@ubuntu.com>, 602571@bugs.debian.org

Cc: Loïc Minier <lool@dooz.org>, Kees Cook <kees@outflux.net>

Subject: Re: [buildd-tools-devel] Bug#602571: cannot build due to ESSENTIAL dep phase

Date: Tue, 7 Dec 2010 20:53:32 +0000

[Message part 1 (text/plain, inline)]

On Fri, Dec 03, 2010 at 02:52:56PM -0600, Jamie Strandboge wrote:
> --- sbuild-0.60.5.orig/lib/Sbuild/Build.pm
> +++ sbuild-0.60.5/lib/Sbuild/Build.pm
> @@ -1483,6 +1483,20 @@
>  	warn "Cannot open $self->{'Chroot Dir'}/usr/share/doc/build-essential/list: $!\n";
>      }
>  
> +    # Workaround http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=602571
> +    if (open( F, "$self->{'Chroot Dir'}/etc/lsb-release" )) {
> +        while( <F> ) {
> +            if ($_ eq "DISTRIB_ID=Ubuntu\n") {
> +                @essential = grep(!/^sysvinit$/, @essential);
> +                last;
> +            }
> +        }
> +        close( F );
> +    }
> +    else {
> +        warn "Cannot open $self->{'Chroot Dir'}/etc/lsb-release: $!\n";
> +    }
> +
>      return join( ", ", @essential );
>  }
>  

Applied to git master.


Thanks,
Roger

-- 
  .''`.  Roger Leigh
 : :' :  Debian GNU/Linux             http://people.debian.org/~rleigh/
 `. `'   Printing on GNU/Linux?       http://gutenprint.sourceforge.net/
   `-    GPG Public Key: 0x25BFB848   Please GPG sign your mail.

[signature.asc (application/pgp-signature, inline)]

Send a report that this bug log contains spam.