Debian Bug report logs - #913229
release.debian.org: RC status of merged-/usr bugs?

Package: release.debian.org; Maintainer for release.debian.org is Debian Release Team <debian-release@lists.debian.org>;

Reported by: Simon McVittie <smcv@debian.org>

Date: Thu, 8 Nov 2018 13:48:02 UTC

Severity: normal

Done: Niels Thykier <niels@thykier.net>

Bug is archived. No further changes may be made.

Toggle useless messages

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Thu, 08 Nov 2018 13:48:04 GMT) (full text, mbox, link).


Acknowledgement sent to Simon McVittie <smcv@debian.org>:
New Bug report received and forwarded. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Thu, 08 Nov 2018 13:48:04 GMT) (full text, mbox, link).


Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Simon McVittie <smcv@debian.org>
To: Debian Bug Tracking System <submit@bugs.debian.org>
Subject: release.debian.org: RC status of merged-/usr bugs?
Date: Thu, 8 Nov 2018 13:44:14 +0000
Package: release.debian.org
Severity: normal
User: md@linux.it
Usertags: usrmerge

debootstrap in >= buster produces merged-/usr chroots for buster and sid
by default. Some packages are misbuilt in such chroots: the only concrete
example I have that is currently open is <https://bugs.debian.org/913226>
in quilt, in which a package built in a merged-/usr environment will
work on merged-/usr systems but won't work (at all) on a non-merged-/usr
system.

There are almost certainly others; most of them are probably similar to
the quilt bug, where the absolute path to an executable on the build
system ends up in the package, but to support non-merged-/usr systems
we need to canonicalize that path to the version that would work on the
non-merged-/usr systems. For instance, src:systemd used to have a similar
bug <https://bugs.debian.org/843433>.

I've opened sbuild-createchroot bug <https://bugs.debian.org/913228>
suggesting that it should create non-merged-/usr chroots to sidestep
this for buildd builds, but there are many other ways for maintainers
and testers to build binaries.

If binary packages in the archive don't work on a non-merged-/usr system,
is that a RC bug in the binary packages? For instance, if an uploader
of quilt uploaded binaries that had been built on a merged-/usr system
without first fixing #913228, would that be RC? (I'm assuming the answer
is yes; certainly systemd's #843433 was treated as RC.)

Are bugs like #843433 and #913226, in which a package built in a
merged-/usr environment won't work in a non-merged-/usr environment,
considered to be RC bugs in the *source package* even if the binaries
in the archive happen to be OK?

See also <https://bugs.debian.org/901473> which proposes that
reproducible.debian.org should exercise merged vs. non-merged /usr,
as a way to detect this class of bug.

    smcv



Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Thu, 08 Nov 2018 14:24:04 GMT) (full text, mbox, link).


Message #8 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Mattia Rizzolo <mattia@debian.org>
To: Simon McVittie <smcv@debian.org>, 913229@bugs.debian.org
Cc: md@linux.it
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Thu, 8 Nov 2018 14:59:29 +0100
[Message part 1 (text/plain, inline)]
On Thu, Nov 08, 2018 at 01:44:14PM +0000, Simon McVittie wrote:
> debootstrap in >= buster produces merged-/usr chroots for buster and sid
> by default. Some packages are misbuilt in such chroots: the only concrete
> example I have that is currently open is <https://bugs.debian.org/913226>
> in quilt, in which a package built in a merged-/usr environment will
> work on merged-/usr systems but won't work (at all) on a non-merged-/usr
> system.

Just a thing: consider that yesterday Julien Cristau updated the buildd
to use debootstrap from stretch-backports.  I just so happens that the
backport is outdated right now, but this also means the buildd will use
merged-usr chroots once somebody updates the debootstrap backports.

> I've opened sbuild-createchroot bug <https://bugs.debian.org/913228>
> suggesting that it should create non-merged-/usr chroots to sidestep
> this for buildd builds, but there are many other ways for maintainers
> and testers to build binaries.

Yes, this is not a solution in any way.

-- 
regards,
                        Mattia Rizzolo

GPG Key: 66AE 2B4A FCCF 3F52 DA18  4D18 4B04 3FCD B944 4540      .''`.
more about me:  https://mapreri.org                             : :'  :
Launchpad user: https://launchpad.net/~mapreri                  `. `'`
Debian QA page: https://qa.debian.org/developer.php?login=mattia  `-
[signature.asc (application/pgp-signature, inline)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Thu, 08 Nov 2018 15:24:03 GMT) (full text, mbox, link).


Acknowledgement sent to Michael Biebl <biebl@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Thu, 08 Nov 2018 15:24:03 GMT) (full text, mbox, link).


Message #13 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Michael Biebl <biebl@debian.org>
To: Simon McVittie <smcv@debian.org>, 913229@bugs.debian.org
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Thu, 8 Nov 2018 16:21:07 +0100
[Message part 1 (text/plain, inline)]
Am 08.11.18 um 14:44 schrieb Simon McVittie:

> There are almost certainly others; most of them are probably similar to
> the quilt bug, where the absolute path to an executable on the build
> system ends up in the package, but to support non-merged-/usr systems
> we need to canonicalize that path to the version that would work on the
> non-merged-/usr systems. For instance, src:systemd used to have a similar
> bug <https://bugs.debian.org/843433>.

A more recent issue I've encountered is with meson not handling RUNPATH
correctly on merged-usr systems:
https://github.com/mesonbuild/meson/issues/4392

I haven't filed a corresponding downstream bug report (yet).
Would probably make sense to have such a bug for tracking this in Debian.

Regards,
Michael


-- 
Why is it that all of the instruments seeking intelligent life in the
universe are pointed away from Earth?

[signature.asc (application/pgp-signature, attachment)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Thu, 08 Nov 2018 15:24:04 GMT) (full text, mbox, link).


Acknowledgement sent to Simon McVittie <smcv@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Thu, 08 Nov 2018 15:24:04 GMT) (full text, mbox, link).


Message #18 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Simon McVittie <smcv@debian.org>
To: Mattia Rizzolo <mattia@debian.org>, 913229@bugs.debian.org
Cc: md@linux.it
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Thu, 8 Nov 2018 15:21:49 +0000
On Thu, 08 Nov 2018 at 14:59:29 +0100, Mattia Rizzolo wrote:
> On Thu, Nov 08, 2018 at 01:44:14PM +0000, Simon McVittie wrote:
> > I've opened sbuild-createchroot bug <https://bugs.debian.org/913228>
> > suggesting that it should create non-merged-/usr chroots to sidestep
> > this for buildd builds, but there are many other ways for maintainers
> > and testers to build binaries.
> 
> Yes, this is not a solution in any way.

Of course not, but it might be a good idea anyway, to mitigate the class
of bugs that resemble #843433 and #913226 (source packages that sometimes
produce broken binaries are obviously bad, but they're less immediately
disruptive than the binaries in the archive actually being broken).

Or are you advocating deliberately breaking buildd-built packages that
have bugs similar to #843433 and #913226, as a way to detect them?

    smcv



Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Thu, 08 Nov 2018 15:33:02 GMT) (full text, mbox, link).


Acknowledgement sent to Michael Biebl <biebl@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Thu, 08 Nov 2018 15:33:03 GMT) (full text, mbox, link).


Message #23 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Michael Biebl <biebl@debian.org>
To: Simon McVittie <smcv@debian.org>, 913229@bugs.debian.org, Mattia Rizzolo <mattia@debian.org>
Cc: md@linux.it
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Thu, 8 Nov 2018 16:31:32 +0100
[Message part 1 (text/plain, inline)]
Am 08.11.18 um 16:21 schrieb Simon McVittie:
> On Thu, 08 Nov 2018 at 14:59:29 +0100, Mattia Rizzolo wrote:
>> On Thu, Nov 08, 2018 at 01:44:14PM +0000, Simon McVittie wrote:
>>> I've opened sbuild-createchroot bug <https://bugs.debian.org/913228>
>>> suggesting that it should create non-merged-/usr chroots to sidestep
>>> this for buildd builds, but there are many other ways for maintainers
>>> and testers to build binaries.
>>
>> Yes, this is not a solution in any way.
> 
> Of course not, but it might be a good idea anyway, to mitigate the class
> of bugs that resemble #843433 and #913226 (source packages that sometimes
> produce broken binaries are obviously bad, but they're less immediately
> disruptive than the binaries in the archive actually being broken).
> 
> Or are you advocating deliberately breaking buildd-built packages that
> have bugs similar to #843433 and #913226, as a way to detect them?

Wasn't there the idea to utilise the reproducible-build effort to detect
binaries that differ depending on whether they were built in merged-usr
environment or not? If that is feasible, this would allow for a less
disruptive way then to rely on finding those issues by "breaking" unstable.

Regards,
Michael

-- 
Why is it that all of the instruments seeking intelligent life in the
universe are pointed away from Earth?

[signature.asc (application/pgp-signature, attachment)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Thu, 08 Nov 2018 16:03:03 GMT) (full text, mbox, link).


Acknowledgement sent to Holger Levsen <holger@layer-acht.org>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Thu, 08 Nov 2018 16:03:03 GMT) (full text, mbox, link).


Message #28 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Holger Levsen <holger@layer-acht.org>
To: Michael Biebl <biebl@debian.org>, 913229@bugs.debian.org
Cc: Simon McVittie <smcv@debian.org>, Mattia Rizzolo <mattia@debian.org>, md@linux.it
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Thu, 8 Nov 2018 15:50:48 +0000
[Message part 1 (text/plain, inline)]
On Thu, Nov 08, 2018 at 04:31:32PM +0100, Michael Biebl wrote:
> Wasn't there the idea to utilise the reproducible-build effort to detect
> binaries that differ depending on whether they were built in merged-usr
> environment or not? If that is feasible, this would allow for a less
> disruptive way then to rely on finding those issues by "breaking" unstable.

(see the bug report linked in the initial mail.)

we could (*) do that, however, I would prefer a way which would prevent such
buggy binary packages from entering the archive in the first place...


(*) and should


-- 
cheers,
	Holger

-------------------------------------------------------------------------------
               holger@(debian|reproducible-builds|layer-acht).org
       PGP fingerprint: B8BF 5413 7B09 D35C F026 FE9D 091A B856 069A AA1C
[signature.asc (application/pgp-signature, inline)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Thu, 08 Nov 2018 17:57:05 GMT) (full text, mbox, link).


Acknowledgement sent to Simon McVittie <smcv@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Thu, 08 Nov 2018 17:57:05 GMT) (full text, mbox, link).


Message #33 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Simon McVittie <smcv@debian.org>
To: Holger Levsen <holger@layer-acht.org>, 913229@bugs.debian.org, Michael Biebl <biebl@debian.org>
Cc: Mattia Rizzolo <mattia@debian.org>, md@linux.it
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Thu, 8 Nov 2018 17:53:59 +0000
On Thu, 08 Nov 2018 at 15:50:48 +0000, Holger Levsen wrote:
> On Thu, Nov 08, 2018 at 04:31:32PM +0100, Michael Biebl wrote:
> > Wasn't there the idea to utilise the reproducible-build effort to detect
> > binaries that differ depending on whether they were built in merged-usr
> > environment or not?

<https://bugs.debian.org/901473>

> however, I would prefer a way which would prevent such
> buggy binary packages from entering the archive in the first place...

Do you have a way in mind?

Are you saying that buildds should stick to unmerged /usr until we are
more confident that merged /usr buildds will not misbuild packages, as
I suggested? Or something else?

For maintainer uploads, there's a lintian tag that would have caught
the quilt bug (if maintainers run lintian before uploading, which they
should but perhaps don't), but the systemd bug was probably not feasible
to catch with static checks like that.

On Thu, 08 Nov 2018 at 16:21:07 +0100, Michael Biebl wrote:
> A more recent issue I've encountered is with meson not handling RUNPATH
> correctly on merged-usr systems:
> https://github.com/mesonbuild/meson/issues/4392

This seems like another indication that we are not yet ready for
merged-/usr buildds.

    smcv



Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Thu, 08 Nov 2018 18:06:07 GMT) (full text, mbox, link).


Acknowledgement sent to Michael Biebl <biebl@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Thu, 08 Nov 2018 18:06:07 GMT) (full text, mbox, link).


Message #38 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Michael Biebl <biebl@debian.org>
To: Simon McVittie <smcv@debian.org>, Holger Levsen <holger@layer-acht.org>, 913229@bugs.debian.org
Cc: Mattia Rizzolo <mattia@debian.org>, md@linux.it
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Thu, 8 Nov 2018 19:03:44 +0100
[Message part 1 (text/plain, inline)]
Am 08.11.18 um 18:53 schrieb Simon McVittie:
> On Thu, 08 Nov 2018 at 15:50:48 +0000, Holger Levsen wrote:
>> On Thu, Nov 08, 2018 at 04:31:32PM +0100, Michael Biebl wrote:
>>> Wasn't there the idea to utilise the reproducible-build effort to detect
>>> binaries that differ depending on whether they were built in merged-usr
>>> environment or not?
> 
> <https://bugs.debian.org/901473>
> 
>> however, I would prefer a way which would prevent such
>> buggy binary packages from entering the archive in the first place...
> 
> Do you have a way in mind?
> 
> Are you saying that buildds should stick to unmerged /usr until we are
> more confident that merged /usr buildds will not misbuild packages, as
> I suggested? Or something else?

I'm basically with you on this.
I think we should stick with unmerged-usr on the buildds as the
resulting binaries are more likely to work with both merged and unmerged
usr setups (at least for the time being).
If we made merged-usr the default, even for upgraded systems, I wouldn't
worry as much. The current plan though afaik is to only have merged-usr
for newly deployed systems.

I'm well aware that we don't enforce source-only uploads yet, i.e.
rebuild everything. So we still might have binaries which are built
locally in a merged-usr setup. So this would only minimize the risk.

That's why I hope that we can more systematically detect any such issues
via reproducible-builds.

Michael

-- 
Why is it that all of the instruments seeking intelligent life in the
universe are pointed away from Earth?

[signature.asc (application/pgp-signature, attachment)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Thu, 08 Nov 2018 18:21:07 GMT) (full text, mbox, link).


Acknowledgement sent to Michael Biebl <biebl@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Thu, 08 Nov 2018 18:21:07 GMT) (full text, mbox, link).


Message #43 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Michael Biebl <biebl@debian.org>
To: Simon McVittie <smcv@debian.org>, Holger Levsen <holger@layer-acht.org>, 913229@bugs.debian.org
Cc: Mattia Rizzolo <mattia@debian.org>, md@linux.it
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Thu, 8 Nov 2018 19:16:51 +0100
[Message part 1 (text/plain, inline)]
Am 08.11.18 um 19:03 schrieb Michael Biebl:
> I'm basically with you on this.
> I think we should stick with unmerged-usr on the buildds as the
> resulting binaries are more likely to work with both merged and unmerged
> usr setups (at least for the time being).

To be clear: I don't think sticking with unmerged-usr on the buildds is
a viable long-term strategy if we want to embrace merged-usr (which I'm
convinced we should).

This should only be a temporary measure, until we have a better idea of
the impact on the archive.

Michael
-- 
Why is it that all of the instruments seeking intelligent life in the
universe are pointed away from Earth?

[signature.asc (application/pgp-signature, attachment)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Thu, 08 Nov 2018 19:12:03 GMT) (full text, mbox, link).


Acknowledgement sent to Holger Levsen <holger@layer-acht.org>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Thu, 08 Nov 2018 19:12:03 GMT) (full text, mbox, link).


Message #48 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Holger Levsen <holger@layer-acht.org>
To: Simon McVittie <smcv@debian.org>
Cc: 913229@bugs.debian.org, Michael Biebl <biebl@debian.org>, Mattia Rizzolo <mattia@debian.org>, md@linux.it
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Thu, 8 Nov 2018 19:08:58 +0000
[Message part 1 (text/plain, inline)]
On Thu, Nov 08, 2018 at 05:53:59PM +0000, Simon McVittie wrote:
> On Thu, 08 Nov 2018 at 15:50:48 +0000, Holger Levsen wrote:
> > On Thu, Nov 08, 2018 at 04:31:32PM +0100, Michael Biebl wrote:
> > > Wasn't there the idea to utilise the reproducible-build effort to detect
> > > binaries that differ depending on whether they were built in merged-usr
> > > environment or not?
> 
> <https://bugs.debian.org/901473>
> 
> > however, I would prefer a way which would prevent such
> > buggy binary packages from entering the archive in the first place...
> 
> Do you have a way in mind?
 
source only uploads, for one.

> Are you saying that buildds should stick to unmerged /usr until we are
> more confident that merged /usr buildds will not misbuild packages, as
> I suggested? Or something else?

that's probably something which would help a bit, yes. (but its of
course not enough.)

> For maintainer uploads, there's a lintian tag that would have caught

can we have autorejects based on that?


As said, I'll happily merge a fix for #901473, I just think it's
fundamentally wrong to use a CI system to detect bugs done by manual
mistakes if such mistakes can be systematically avoided. also these bugs
still need to be manually filed.

(and because jenkins.d.n had severe issues the last days which I only
managed to address today I'm a bit reluctant to merge that fix right now
or probably even tomorrow. give us two days of nicely working jenkins
again, first, please :)


-- 
cheers,
	Holger

-------------------------------------------------------------------------------
               holger@(debian|reproducible-builds|layer-acht).org
       PGP fingerprint: B8BF 5413 7B09 D35C F026 FE9D 091A B856 069A AA1C
[signature.asc (application/pgp-signature, inline)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Fri, 09 Nov 2018 06:39:03 GMT) (full text, mbox, link).


Acknowledgement sent to Niels Thykier <niels@thykier.net>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Fri, 09 Nov 2018 06:39:03 GMT) (full text, mbox, link).


Message #53 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Niels Thykier <niels@thykier.net>
To: Simon McVittie <smcv@debian.org>, 913229@bugs.debian.org, Michael Biebl <biebl@debian.org>, Holger Levsen <holger@layer-acht.org>, Mattia Rizzolo <mattia@mapreri.org>
Cc: Marco d'Itri <md@linux.it>
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Fri, 09 Nov 2018 06:31:00 +0000
Simon McVittie:
> Package: release.debian.org
> Severity: normal
> User: md@linux.it
> Usertags: usrmerge
> 
> debootstrap in >= buster produces merged-/usr chroots for buster and sid
> by default. Some packages are misbuilt in such chroots: the only concrete
> example I have that is currently open is <https://bugs.debian.org/913226>
> in quilt, in which a package built in a merged-/usr environment will
> work on merged-/usr systems but won't work (at all) on a non-merged-/usr
> system.
> 
> There are almost certainly others; [...]
> 
> If binary packages in the archive don't work on a non-merged-/usr system,
> is that a RC bug in the binary packages? [...]
> 
>     smcv
> 

Hi Simon,

Thanks for bringing the issue to our attention.

TL;DR summary:

  Can we effectively/measurably answer "which packages are affected?"
  (or "when do we know that all packages work when built-in in a
   merged-/usr?")?

As I understand it, what this question effectively ends up being is "Do
we commit to supporting merged-/usr in Buster in all source packages
(making such bugs RC) OR do we rollback the default merged-/usr in
debootstrap (making them non-RC)?".

To answer such a question at this point in the release cycle, we need to
understand the number of affected packages to tell whether it is
realistic to complete this by the freeze (regardless of which "part" of
the freeze we choose as deadline for it).

In the absence of a clear way to define "when is everything fixed", I
gut feeling is that we might be opening pandora's box right before a
release.

Thanks,
~Niels




Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Fri, 09 Nov 2018 12:27:08 GMT) (full text, mbox, link).


Acknowledgement sent to Simon McVittie <smcv@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Fri, 09 Nov 2018 12:27:08 GMT) (full text, mbox, link).


Message #58 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Simon McVittie <smcv@debian.org>
To: Niels Thykier <niels@thykier.net>, 913229@bugs.debian.org
Cc: Michael Biebl <biebl@debian.org>, Holger Levsen <holger@layer-acht.org>, Mattia Rizzolo <mattia@mapreri.org>, Marco d'Itri <md@linux.it>
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Fri, 9 Nov 2018 12:26:15 +0000
On Fri, 09 Nov 2018 at 06:31:00 +0000, Niels Thykier wrote:
> As I understand it, what this question effectively ends up being is "Do
> we commit to supporting merged-/usr in Buster in all source packages
> (making such bugs RC) OR do we rollback the default merged-/usr in
> debootstrap (making them non-RC)?".

Well, there's a middle ground, which I think would be a good short
term plan: we can ensure that the official buildds build packages in a
non-merged-/usr environment (for example by backporting a fix for #913228
to the packages used on those buildds), which means misbuilt binary
packages uploaded by maintainers remain potentially RC (as systemd's
#843433 was), but source packages that would theoretically be misbuilt
in a merged-/usr environment (like quilt #913226) don't necessarily have
to be treated as RC.

I've sent a proposed patch to #913228.

    smcv



Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Sat, 17 Nov 2018 11:45:02 GMT) (full text, mbox, link).


Acknowledgement sent to Adrian Bunk <bunk@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Sat, 17 Nov 2018 11:45:02 GMT) (full text, mbox, link).


Message #63 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Adrian Bunk <bunk@debian.org>
To: Simon McVittie <smcv@debian.org>, 913229@bugs.debian.org
Cc: Niels Thykier <niels@thykier.net>, Michael Biebl <biebl@debian.org>, Holger Levsen <holger@layer-acht.org>, Mattia Rizzolo <mattia@mapreri.org>, Marco d'Itri <md@linux.it>
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Sat, 17 Nov 2018 13:41:51 +0200
On Fri, Nov 09, 2018 at 12:26:15PM +0000, Simon McVittie wrote:
> On Fri, 09 Nov 2018 at 06:31:00 +0000, Niels Thykier wrote:
> > As I understand it, what this question effectively ends up being is "Do
> > we commit to supporting merged-/usr in Buster in all source packages
> > (making such bugs RC) OR do we rollback the default merged-/usr in
> > debootstrap (making them non-RC)?".
> 
> Well, there's a middle ground, which I think would be a good short
> term plan: we can ensure that the official buildds build packages in a
> non-merged-/usr environment (for example by backporting a fix for #913228
> to the packages used on those buildds), which means misbuilt binary
> packages uploaded by maintainers remain potentially RC (as systemd's
> #843433 was), but source packages that would theoretically be misbuilt
> in a merged-/usr environment (like quilt #913226) don't necessarily have
> to be treated as RC.
>...

This would be a huge regression, buildds aren't the only place where 
packages get built.

It doesn't sounds right that we suddenly start declaring it "misbuilt" 
when a user builds a package locally with dpkg-buildpackage as has been 
working for the past 25 years.

I am not aware of any real benefits of merged /usr for users, so let's 
go back from "How can we mitigate some regressions of merged /usr?" to 
"Can we make merged /usr working in buster without causing any
 regressions at all?".

Either we fully support merged /usr everywhere, or merged /usr should 
not be supported in buster and the usrmerge package removed from buster 
as has been done in #863965 for stretch.

>     smcv

cu
Adrian

-- 

       "Is there not promise of rain?" Ling Tan asked suddenly out
        of the darkness. There had been need of rain for many days.
       "Only a promise," Lao Er said.
                                       Pearl S. Buck - Dragon Seed




Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Sat, 17 Nov 2018 13:03:03 GMT) (full text, mbox, link).


Acknowledgement sent to Michael Biebl <biebl@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Sat, 17 Nov 2018 13:03:04 GMT) (full text, mbox, link).


Message #68 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Michael Biebl <biebl@debian.org>
To: Adrian Bunk <bunk@debian.org>, 913229@bugs.debian.org, Simon McVittie <smcv@debian.org>
Cc: Niels Thykier <niels@thykier.net>, Holger Levsen <holger@layer-acht.org>, Mattia Rizzolo <mattia@mapreri.org>, Marco d'Itri <md@linux.it>
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Sat, 17 Nov 2018 14:00:03 +0100
[Message part 1 (text/plain, inline)]
Am 17.11.18 um 12:41 schrieb Adrian Bunk:

> This would be a huge regression, buildds aren't the only place where 
> packages get built.
> 
> It doesn't sounds right that we suddenly start declaring it "misbuilt" 
> when a user builds a package locally with dpkg-buildpackage as has been 
> working for the past 25 years.
> 
> I am not aware of any real benefits of merged /usr for users, so let's 
> go back from "How can we mitigate some regressions of merged /usr?" to 
> "Can we make merged /usr working in buster without causing any
>  regressions at all?".

Of course there are benefits for the users, otherwise we wouldn't be
doing it. That said, I don't think this bug report is the right place to
discuss this.

The way I see this is, that building locally is still supported.
Some few packages will be affected by this and be misbuilt a in
merged-usr environment.
That is not too different from packages being buggy because they have
been built locally and e.g. picked up a library dependency from say
experimental or some (unwanted) package features where turned on because
./configure auto-detected a locally installed libray.
We can binNMU those packages in both cases to have working packages again.

Michael

-- 
Why is it that all of the instruments seeking intelligent life in the
universe are pointed away from Earth?

[signature.asc (application/pgp-signature, attachment)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Sat, 17 Nov 2018 13:09:03 GMT) (full text, mbox, link).


Acknowledgement sent to Holger Levsen <holger@layer-acht.org>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Sat, 17 Nov 2018 13:09:03 GMT) (full text, mbox, link).


Message #73 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Holger Levsen <holger@layer-acht.org>
To: Michael Biebl <biebl@debian.org>
Cc: Adrian Bunk <bunk@debian.org>, 913229@bugs.debian.org, Simon McVittie <smcv@debian.org>, Niels Thykier <niels@thykier.net>, Mattia Rizzolo <mattia@mapreri.org>, Marco d'Itri <md@linux.it>
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Sat, 17 Nov 2018 13:05:23 +0000
[Message part 1 (text/plain, inline)]
hi,

while I don't really disagree with what you said... I also think:

On Sat, Nov 17, 2018 at 02:00:03PM +0100, Michael Biebl wrote:
> The way I see this is, that building locally is still supported.

this is an important, unfixed bug.

> We can binNMU those packages in both cases to have working packages again.

and this is a workaround for the above bug.

(sorry to add nothing new, but if one is spending too much time with
workarounds it might be useful to remind this once in a while...)


-- 
cheers,
	Holger

-------------------------------------------------------------------------------
               holger@(debian|reproducible-builds|layer-acht).org
       PGP fingerprint: B8BF 5413 7B09 D35C F026 FE9D 091A B856 069A AA1C
[signature.asc (application/pgp-signature, inline)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Sat, 17 Nov 2018 16:57:08 GMT) (full text, mbox, link).


Acknowledgement sent to Steve McIntyre <steve@einval.com>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Sat, 17 Nov 2018 16:57:08 GMT) (full text, mbox, link).


Message #78 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Steve McIntyre <steve@einval.com>
To: Holger Levsen <holger@layer-acht.org>, 913229@bugs.debian.org
Cc: Michael Biebl <biebl@debian.org>, Adrian Bunk <bunk@debian.org>, Simon McVittie <smcv@debian.org>
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Sat, 17 Nov 2018 16:51:21 +0000
[ Trimming the large CC list a bit... ]

On Sat, Nov 17, 2018 at 01:05:23PM +0000, Holger Levsen wrote:
>hi,
>
>while I don't really disagree with what you said... I also think:
>
>On Sat, Nov 17, 2018 at 02:00:03PM +0100, Michael Biebl wrote:
>> The way I see this is, that building locally is still supported.
>
>this is an important, unfixed bug.

for upload to the archive, agreed. However, we still support people
building packages for their own use, of course. And they shouldn't
fail unexpectedly due to merged-/usr.

-- 
Steve McIntyre, Cambridge, UK.                                steve@einval.com
"This dress doesn't reverse." -- Alden Spiess




Information forwarded to debian-bugs-dist@lists.debian.org, Debian Release Team <debian-release@lists.debian.org>:
Bug#913229; Package release.debian.org. (Sat, 17 Nov 2018 18:33:03 GMT) (full text, mbox, link).


Acknowledgement sent to Holger Levsen <holger@layer-acht.org>:
Extra info received and forwarded to list. Copy sent to Debian Release Team <debian-release@lists.debian.org>. (Sat, 17 Nov 2018 18:33:03 GMT) (full text, mbox, link).


Message #83 received at 913229@bugs.debian.org (full text, mbox, reply):

From: Holger Levsen <holger@layer-acht.org>
To: Steve McIntyre <steve@einval.com>
Cc: 913229@bugs.debian.org, Michael Biebl <biebl@debian.org>, Adrian Bunk <bunk@debian.org>, Simon McVittie <smcv@debian.org>
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Sat, 17 Nov 2018 18:30:29 +0000
[Message part 1 (text/plain, inline)]
On Sat, Nov 17, 2018 at 04:51:21PM +0000, Steve McIntyre wrote:
> >> The way I see this is, that building locally is still supported.
> >this is an important, unfixed bug.
> for upload to the archive, agreed. However, we still support people
> building packages for their own use, of course. And they shouldn't
> fail unexpectedly due to merged-/usr.

agreed & thanks for pointing this out.


-- 
cheers,
	Holger

-------------------------------------------------------------------------------
               holger@(debian|reproducible-builds|layer-acht).org
       PGP fingerprint: B8BF 5413 7B09 D35C F026 FE9D 091A B856 069A AA1C
[signature.asc (application/pgp-signature, inline)]

Reply sent to Niels Thykier <niels@thykier.net>:
You have taken responsibility. (Wed, 21 Nov 2018 08:42:08 GMT) (full text, mbox, link).


Notification sent to Simon McVittie <smcv@debian.org>:
Bug acknowledged by developer. (Wed, 21 Nov 2018 08:42:08 GMT) (full text, mbox, link).


Message #88 received at 913229-done@bugs.debian.org (full text, mbox, reply):

From: Niels Thykier <niels@thykier.net>
To: Simon McVittie <smcv@debian.org>, 913229-done@bugs.debian.org
Cc: Michael Biebl <biebl@debian.org>, Holger Levsen <holger@layer-acht.org>, Mattia Rizzolo <mattia@mapreri.org>, Marco d'Itri <md@linux.it>
Subject: Re: Bug#913229: release.debian.org: RC status of merged-/usr bugs?
Date: Wed, 21 Nov 2018 08:37:00 +0000
[Message part 1 (text/plain, inline)]
Simon McVittie:
> [...]
> 
> Well, there's a middle ground, which I think would be a good short
> term plan: we can ensure that the official buildds build packages in a
> non-merged-/usr environment (for example by backporting a fix for #913228
> to the packages used on those buildds), which means misbuilt binary
> packages uploaded by maintainers remain potentially RC (as systemd's
> #843433 was), but source packages that would theoretically be misbuilt
> in a merged-/usr environment (like quilt #913226) don't necessarily have
> to be treated as RC.
> 
> I've sent a proposed patch to #913228.
> 
>     smcv
> 

Hi,

Thanks for clarifying.

I think Simon's proposal as quoted above is a good resolution for this
question (scoped for the buster release).  It is also aligned with other
parts of Debian working on resetting the buildds to use non-/usr merged
chroots.

If there are any objections or clarification points to this, please
follow up and we will reconsider the decision.

Thanks,
~Niels

[signature.asc (application/pgp-signature, attachment)]

Bug archived. Request was from Debbugs Internal Request <owner@bugs.debian.org> to internal_control@bugs.debian.org. (Thu, 20 Dec 2018 07:30:27 GMT) (full text, mbox, link).


Send a report that this bug log contains spam.


Debian bug tracking system administrator <owner@bugs.debian.org>. Last modified: Tue Sep 20 08:46:54 2022; Machine Name: buxtehude

Debian Bug tracking system

Debbugs is free software and licensed under the terms of the GNU Public License version 2. The current version can be obtained from https://bugs.debian.org/debbugs-source/.

Copyright © 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson, 2005-2017 Don Armstrong, and many other contributors.