Debian Bug report logs - #657212
include extra sources in Sources

Package: ftp.debian.org; Maintainer for ftp.debian.org is Debian FTP Master <ftpmaster@ftp-master.debian.org>;

Reported by: Ansgar Burchardt <ansgar@debian.org>

Date: Tue, 24 Jan 2012 21:03:01 UTC

Severity: wishlist

Done: Ansgar Burchardt <ansgar@debian.org>

Bug is archived. No further changes may be made.

Toggle useless messages

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to debian-bugs-dist@lists.debian.org, Debian FTP Master <ftpmaster@ftp-master.debian.org>:
Bug#657212; Package ftp.debian.org. (Tue, 24 Jan 2012 21:03:04 GMT) Full text and rfc822 format available.

Acknowledgement sent to Ansgar Burchardt <ansgar@debian.org>:
New Bug report received and forwarded. Copy sent to Debian FTP Master <ftpmaster@ftp-master.debian.org>. (Tue, 24 Jan 2012 21:03:04 GMT) Full text and rfc822 format available.

Message #5 received at submit@bugs.debian.org (full text, mbox):

From: Ansgar Burchardt <ansgar@debian.org>
To: Debian Bug Tracking System <submit@bugs.debian.org>
Subject: include extra sources in Sources
Date: Tue, 24 Jan 2012 22:01:33 +0100
Package: ftp.debian.org
Severity: wishlist
User: ftp.debian.org@packages.debian.org

I would like to include sources in extra_src_references in the Sources
index or an extra file.

This would allow to retrieve sources only referenced via Built-Using to
be retrieved via apt-get should one have interest in them.  It also
allows debmirror and similar tools to grab the entire source for a
release (including source packages only referenced via Built-Using).

Ansgar




Added blocking bug(s) of 657212: 661078 Request was from Ansgar Burchardt <ansgar@debian.org> to control@bugs.debian.org. (Fri, 24 Feb 2012 00:27:09 GMT) Full text and rfc822 format available.

Information forwarded to debian-bugs-dist@lists.debian.org, Debian FTP Master <ftpmaster@ftp-master.debian.org>:
Bug#657212; Package ftp.debian.org. (Tue, 31 Jul 2012 07:39:03 GMT) Full text and rfc822 format available.

Acknowledgement sent to Ansgar Burchardt <ansgar@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian FTP Master <ftpmaster@ftp-master.debian.org>. (Tue, 31 Jul 2012 07:39:03 GMT) Full text and rfc822 format available.

Message #12 received at 657212@bugs.debian.org (full text, mbox):

From: Ansgar Burchardt <ansgar@debian.org>
To: 657212@bugs.debian.org
Cc: 661078@bugs.debian.org
Subject: Re: Bug#661078: britney: ignore additional packages in Sources index
Date: Tue, 31 Jul 2012 09:30:02 +0200
Hi,

Niels Thykier <niels@thykier.net> writes:
> On 2012-02-24 01:22, Ansgar Burchardt wrote:
>> I would like to include additional packages referenced by Built-Using in
>> the Sources index[1] at some undefined point in the future.  This might
>> confuse britney which would need to just ignore them.
>> 
>> Ansgar
>> 
>> [1] <http://bugs.debian.org/657212>
>
> In light of our IRC chat in #d-ftp today and the asumption that the
> "Only-Extra-Source" field will be implemented, I believe I have a
> trivial patch that will work[1].  There is an updated test for it in the
> "britney2-tests"[2] (the new repository announced today - not the old one).
>   The patch is backwards compatible and could be applied before the
> extra sources appear in the Sources files (and without updating any of
> the unrelated existing tests).

I remembered we don't have overrides and thus no Priority or Section
fields for the extra sources.  As even the current values for overrides
aren't that useful (most source packages have Priority: source), I had
an alternative idea:

Instead of introducing a new field, use Priority: optional for regular
sources and Priority: extra for the extra sources introduced by
Built-Using.  At least the latter would also go to Section: source.

This would also fix #626394 ("Priority: source" in Sources).

Ansgar



Information forwarded to debian-bugs-dist@lists.debian.org, Debian FTP Master <ftpmaster@ftp-master.debian.org>:
Bug#657212; Package ftp.debian.org. (Tue, 31 Jul 2012 08:15:05 GMT) Full text and rfc822 format available.

Acknowledgement sent to Niels Thykier <niels@thykier.net>:
Extra info received and forwarded to list. Copy sent to Debian FTP Master <ftpmaster@ftp-master.debian.org>. (Tue, 31 Jul 2012 08:15:05 GMT) Full text and rfc822 format available.

Message #17 received at 657212@bugs.debian.org (full text, mbox):

From: Niels Thykier <niels@thykier.net>
To: Ansgar Burchardt <ansgar@debian.org>, 661078@bugs.debian.org
Cc: 657212@bugs.debian.org
Subject: Re: Bug#661078: britney: ignore additional packages in Sources index
Date: Tue, 31 Jul 2012 10:11:53 +0200
On 2012-07-31 09:30, Ansgar Burchardt wrote:
> Hi,
> 
> [...]
> 
> I remembered we don't have overrides and thus no Priority or Section
> fields for the extra sources.  As even the current values for overrides
> aren't that useful (most source packages have Priority: source), I had
> an alternative idea:
> 
> Instead of introducing a new field, use Priority: optional for regular
> sources and Priority: extra for the extra sources introduced by
> Built-Using.  At least the latter would also go to Section: source.
> 
> This would also fix #626394 ("Priority: source" in Sources).
> 
> Ansgar
> 
> 

Short: Sounds good to me.


AFAICT, we don't use Priority for any thing in Britney, so it won't
cause a lot of issues.  The only thing is that Britney does not include
"Priority" in the control files she writes.
  However, I believe she is the only consumer of those control files.
If we assume "Priority: optional" if the field is missing, this should
not be an issue[1].

If you change the value of the source field, that should also be fine.
I see it is written to the "HeidiResult" file, but I think that
particular column is stripped by another of our scripts before it is
passed on (I think we use that column to strip out our "faux" packages).

~Niels

[1] The filtering would ensure that she would never write a "Priority:
extra" source in the control files, so the assumption should be reasonable.




Information forwarded to debian-bugs-dist@lists.debian.org, Debian FTP Master <ftpmaster@ftp-master.debian.org>:
Bug#657212; Package ftp.debian.org. (Tue, 31 Jul 2012 22:36:03 GMT) Full text and rfc822 format available.

Acknowledgement sent to Philipp Kern <pkern@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian FTP Master <ftpmaster@ftp-master.debian.org>. (Tue, 31 Jul 2012 22:36:03 GMT) Full text and rfc822 format available.

Message #22 received at 657212@bugs.debian.org (full text, mbox):

From: Philipp Kern <pkern@debian.org>
To: Ansgar Burchardt <ansgar@debian.org>, 657212@bugs.debian.org
Cc: debian-wb-team@lists.debian.org
Subject: Re: Bug#657212: include extra sources in Sources
Date: Wed, 1 Aug 2012 00:33:05 +0200
[Message part 1 (text/plain, inline)]
On Tue, Jan 24, 2012 at 10:01:33PM +0100, Ansgar Burchardt wrote:
> I would like to include sources in extra_src_references in the Sources
> index or an extra file.
> 
> This would allow to retrieve sources only referenced via Built-Using to
> be retrieved via apt-get should one have interest in them.  It also
> allows debmirror and similar tools to grab the entire source for a
> release (including source packages only referenced via Built-Using).

How would one distinguish them? wanna-build might in some circumstances try to
build them because they're obviously missing their binaries. (It should not
happen if there's a newer source version available, but it could happen for
instance with source package (and binary packages) renames.)

So it would be better if we could filter them out somehow, I think.

Kind regards
Philipp Kern
[signature.asc (application/pgp-signature, inline)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian FTP Master <ftpmaster@ftp-master.debian.org>:
Bug#657212; Package ftp.debian.org. (Thu, 02 Aug 2012 19:03:03 GMT) Full text and rfc822 format available.

Acknowledgement sent to Ansgar Burchardt <ansgar@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian FTP Master <ftpmaster@ftp-master.debian.org>. (Thu, 02 Aug 2012 19:03:03 GMT) Full text and rfc822 format available.

Message #27 received at 657212@bugs.debian.org (full text, mbox):

From: Ansgar Burchardt <ansgar@debian.org>
To: Philipp Kern <pkern@debian.org>
Cc: 657212@bugs.debian.org, debian-wb-team@lists.debian.org
Subject: Re: Bug#657212: include extra sources in Sources
Date: Thu, 02 Aug 2012 20:58:51 +0200
Hi,

Philipp Kern <pkern@debian.org> writes:
> On Tue, Jan 24, 2012 at 10:01:33PM +0100, Ansgar Burchardt wrote:
>> I would like to include sources in extra_src_references in the Sources
>> index or an extra file.
>> 
>> This would allow to retrieve sources only referenced via Built-Using to
>> be retrieved via apt-get should one have interest in them.  It also
>> allows debmirror and similar tools to grab the entire source for a
>> release (including source packages only referenced via Built-Using).
>
> How would one distinguish them? wanna-build might in some circumstances try to
> build them because they're obviously missing their binaries. (It should not
> happen if there's a newer source version available, but it could happen for
> instance with source package (and binary packages) renames.)

The last idea was to use the Priority field for this as it is not really
used for Sources right now (most source packages have Priority: source).
The extra sources would have Priority: extra while the "regular" source
packages would be Priority: optional.

Note that we cannot guarantee anything about version numbers: a source
introduced by Built-Using might be older or newer than the regular
source package; or it might introduce packages that would otherwise not
be in the given suite.

Ansgar



Information forwarded to debian-bugs-dist@lists.debian.org, Debian FTP Master <ftpmaster@ftp-master.debian.org>:
Bug#657212; Package ftp.debian.org. (Thu, 02 Aug 2012 19:48:03 GMT) Full text and rfc822 format available.

Message #30 received at 657212@bugs.debian.org (full text, mbox):

From: Philipp Kern <pkern@debian.org>
To: 657212@bugs.debian.org, debian-wb-team@lists.debian.org
Subject: Re: Bug#657212: include extra sources in Sources
Date: Thu, 2 Aug 2012 21:45:23 +0200
[Message part 1 (text/plain, inline)]
On Thu, Aug 02, 2012 at 08:58:51PM +0200, Ansgar Burchardt wrote:
> The last idea was to use the Priority field for this as it is not really
> used for Sources right now (most source packages have Priority: source).
> The extra sources would have Priority: extra while the "regular" source
> packages would be Priority: optional.

I find that very crude. It would really be an implementation detail of how to
deal with the missing overrides than a way of marking
not-really-part-of-the-suite source packages.

> Note that we cannot guarantee anything about version numbers: a source
> introduced by Built-Using might be older or newer than the regular
> source package; or it might introduce packages that would otherwise not
> be in the given suite.

Yep. That's what concerns me from the wanna-build side. We really need a
reliable way to filter them out.

Kind regards
Philipp Kern
[signature.asc (application/pgp-signature, inline)]

Added blocking bug(s) of 657212: 697694 Request was from Ansgar Burchardt <ansgar@debian.org> to submit@bugs.debian.org. (Tue, 08 Jan 2013 15:57:04 GMT) Full text and rfc822 format available.

Reply sent to Ansgar Burchardt <ansgar@debian.org>:
You have taken responsibility. (Sat, 19 Jan 2013 17:15:14 GMT) Full text and rfc822 format available.

Notification sent to Ansgar Burchardt <ansgar@debian.org>:
Bug acknowledged by developer. (Sat, 19 Jan 2013 17:15:14 GMT) Full text and rfc822 format available.

Message #37 received at 657212-done@bugs.debian.org (full text, mbox):

From: Ansgar Burchardt <ansgar@debian.org>
To: 657212-done@bugs.debian.org
Subject: Re: include extra sources in Sources
Date: Sat, 19 Jan 2013 18:12:46 +0100
commit 8edf5e1387ee12c35076a8c60f61e71cd6cb8e23
Author: Ansgar Burchardt <ansgar@debian.org>
Date:   Tue Jan 8 15:49:21 2013 +0100

    include Built-Using sources in Sources indices
    
    Bug: http://bugs.debian.org/657212



Bug archived. Request was from Debbugs Internal Request <owner@bugs.debian.org> to internal_control@bugs.debian.org. (Sun, 17 Feb 2013 07:26:12 GMT) Full text and rfc822 format available.

Send a report that this bug log contains spam.


Debian bug tracking system administrator <owner@bugs.debian.org>. Last modified: Thu Apr 17 01:46:59 2014; Machine Name: buxtehude.debian.org

Debian Bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.