Debian Bug report logs - #845034
initramfs-tools: please ensure initrd images are reproducible

Toggle useless messages

Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Chris Lamb <lamby@debian.org>

To: submit@bugs.debian.org

Subject: initramfs-tools: please ensure initrd images are reproducible

Date: Sat, 19 Nov 2016 18:42:10 +0100

[Message part 1 (text/plain, inline)]

Source: initramfs-tools
Version: 0.125
Severity: wishlist
Tags: patch
User: reproducible-builds@lists.alioth.debian.org
Usertags: timestamps toolchain
X-Debbugs-Cc: reproducible-bugs@lists.alioth.debian.org

Hi,

Whilst working on the Reproducible Builds effort [0] on behalf of
Tails [1], I noticed that mkinitramfs generates non-reproducible
ramdisk images.

Patch attached.

 [0] https://reproducible-builds.org/
 [1] https://tails.boum.org/


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby@debian.org / chris-lamb.co.uk
       `-

[initramfs-tools.diff.txt (text/plain, attachment)]

Message #10 received at 845034@bugs.debian.org (full text, mbox, reply):

From: Chris Lamb <lamby@debian.org>

To: 845034@bugs.debian.org

Subject: Re: initramfs-tools: please ensure initrd images are reproducible

Date: Sun, 20 Nov 2016 16:13:25 +0100

[Message part 1 (text/plain, inline)]

Hi,

Updated patch attached.


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby@debian.org / chris-lamb.co.uk
       `-

[845034.diff.txt (text/plain, attachment)]

Message #15 received at 845034@bugs.debian.org (full text, mbox, reply):

From: Chris Lamb <lamby@debian.org>

To: 845034@bugs.debian.org

Subject: Re: initramfs-tools: please ensure initrd images are reproducible

Date: Sun, 20 Nov 2016 22:35:13 +0100

[Message part 1 (text/plain, inline)]

Chris Lamb wrote:

> Patch attached.

Updated patch attached, which passes --reproducible to cpio (>= 2.12)
to ensure inode numbers are renumbered.


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby@debian.org / chris-lamb.co.uk
       `-

[845034.diff.txt (text/plain, attachment)]

Message #20 received at 845034@bugs.debian.org (full text, mbox, reply):

From: Chris Lamb <lamby@debian.org>

To: 845034@bugs.debian.org

Subject: Re: initramfs-tools: please ensure initrd images are reproducible

Date: Sun, 27 Nov 2016 12:13:31 +0100

Chris Lamb wrote:

> initramfs-tools: please ensure initrd images are reproducible

See also:

 * #845194: amd64-microcode: please make the early initramfs image reproducible
 * #804063: cpio: New version 2.12 available


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby@debian.org / chris-lamb.co.uk
       `-

Message #25 received at 845034@bugs.debian.org (full text, mbox, reply):

From: Ben Hutchings <ben@decadent.org.uk>

To: Chris Lamb <lamby@debian.org>

Cc: 845034@bugs.debian.org

Subject: Re: initramfs-tools: please ensure initrd images are reproducible

Date: Thu, 15 Dec 2016 05:02:30 +0000

[Message part 1 (text/plain, inline)]

Control: block -1 with 804063

On Sun, 20 Nov 2016 22:35:13 +0100 Chris Lamb <lamby@debian.org> wrote:
> Chris Lamb wrote:
> 
> > Patch attached.
> 
> Updated patch attached, which passes --reproducible to cpio (>= 2.12)
> to ensure inode numbers are renumbered.

I'd much prefer to add a versioned dependency on the new cpio (when
available) than to probe for it ar run-time.  (initramfs-tools already
has dependencies and incompatibilities that prevent it from being
backported to jessie, so this wouldn't make that any worse.)

Ben.

-- 
Ben Hutchings
It is easier to change the specification to fit the program than vice
versa.

[signature.asc (application/pgp-signature, inline)]

Message #32 received at 845034@bugs.debian.org (full text, mbox, reply):

From: Ben Hutchings <ben@decadent.org.uk>

To: Chris Lamb <lamby@debian.org>

Cc: 845034@bugs.debian.org

Subject: Re: initramfs-tools: please ensure initrd images are reproducible

Date: Thu, 15 Dec 2016 05:03:49 +0000

[Message part 1 (text/plain, inline)]

I also have a coding style nit-pick - please use [ -n "..." ] rather
than [ "..." != "" ]

Ben.

-- 
Ben Hutchings
It is easier to change the specification to fit the program than vice
versa.

[signature.asc (application/pgp-signature, inline)]

Message #37 received at 845034@bugs.debian.org (full text, mbox, reply):

From: Chris Lamb <lamby@debian.org>

To: 845034@bugs.debian.org, Ben Hutchings <ben@decadent.org.uk>

Subject: Re: initramfs-tools: please ensure initrd images are reproducible

Date: Sun, 01 Jan 2017 11:28:20 +0000

[Message part 1 (text/plain, inline)]

Hi Ben,

> initramfs-tools: please ensure initrd images are reproducible

Thanks for the review; updated patch attached.

> Control: block -1 with 804063
[..]
> I'd much prefer to add a versioned dependency on the new cpio (when
> available) than to probe for it ar run-time

The new cpio is now available in experimental. Obviously, uploading
this patch to != experimental right now would currently make us
uninstallable, but do you fancy making an upload there?

> I also have a coding style nit-pick - please use [ -n "..." ] rather
> than [ "..." != "" ]

Sure.


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby@debian.org / chris-lamb.co.uk
       `-

[initramfs-tools.diff.txt (text/plain, attachment)]

Message #44 received at 845034@bugs.debian.org (full text, mbox, reply):

From: Kristian Klausen <klausenbusk@hotmail.com>

To: "845034@bugs.debian.org" <845034@bugs.debian.org>

Subject: Updated patch

Date: Mon, 29 Jan 2018 09:01:57 +0000

[Message part 1 (text/plain, inline)]

Hello

Attached is a updated patch, which disable the ldconfig aux-cache 
(/var/cache/ldconfig/aux-cache), as it isn't reproducible (at least not 
on my system).

Can I in anyway help getting this merged?


- Kristian Klausen

[initramfs-tools.patch (text/x-patch, attachment)]

Message #49 received at 845034@bugs.debian.org (full text, mbox, reply):

From: Ben Hutchings <ben@decadent.org.uk>

To: 845034@bugs.debian.org, Kristian Klausen <klausenbusk@hotmail.com>

Cc: Chris Lamb <lamby@debian.org>

Subject: Re: Updated patch

Date: Wed, 18 Jul 2018 22:04:21 +0100

[Message part 1 (text/plain, inline)]

On Mon, 29 Jan 2018 09:01:57 +0000 Kristian Klausen <klausenbusk@hotmail.com> wrote:
> Hello
> 
> Attached is a updated patch, which disable the ldconfig aux-cache 
> (/var/cache/ldconfig/aux-cache), as it isn't reproducible (at least not 
> on my system).
>
> Can I in anyway help getting this merged?

I've applied Chris's patch, but I think your changes on top of that are
a step too far.

I had a look at the source for ldconfig, and here's what I found:

* The entries in /etc/ld.so.cache are sorted by, so far as I can see,
  attributes that are derived from the contents of libraries.  So this
  cache should be reproducible, and we should include it in the
  initramfs image.

* The entries in /var/cache/ldconfig/aux-cache are organised as an
  associative array, with the keys including file attributes like
  device number, inode number and inode change time.  This means it is
  not only unreproducible, but completely useless at boot time since
  the device and inode numbers of libraries will be different.

* Before writing the aux-cache file, ldconfig will try to create
  /var/cache/ldconfig if it doesn't exist, but not any of the parent
  directories.  Since mkinitramfs does not create /var/cache itself,
  the aux-cache file is only created if a hook script creates that
  directory.  I think that explains why Chris didn't find this
  problem.

Since there is no option to explicitly disable creation of the aux-
cache file, I propose to delete it ldconfig creates it.

Ben.

-- 
Ben Hutchings
Logic doesn't apply to the real world. - Marvin Minsky

[signature.asc (application/pgp-signature, inline)]

Message #56 received at 845034-close@bugs.debian.org (full text, mbox, reply):

From: Ben Hutchings <ben@decadent.org.uk>

To: 845034-close@bugs.debian.org

Subject: Bug#845034: fixed in initramfs-tools 0.131

Date: Thu, 19 Jul 2018 00:19:36 +0000

Source: initramfs-tools
Source-Version: 0.131

We believe that the bug you reported is fixed in the latest version of
initramfs-tools, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 845034@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Ben Hutchings <ben@decadent.org.uk> (supplier of updated initramfs-tools package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Format: 1.8
Date: Thu, 19 Jul 2018 01:06:01 +0100
Source: initramfs-tools
Binary: initramfs-tools initramfs-tools-core
Architecture: source
Version: 0.131
Distribution: unstable
Urgency: medium
Maintainer: Debian kernel team <debian-kernel@lists.debian.org>
Changed-By: Ben Hutchings <ben@decadent.org.uk>
Description:
 initramfs-tools - generic modular initramfs generator (automation)
 initramfs-tools-core - generic modular initramfs generator (core tools)
Closes: 845034 856589 856929 862013 865691 866521 871595 878829 880584 882380 883664 883735 886349 886424 887211 893845
Changes:
 initramfs-tools (0.131) unstable; urgency=medium
 .
   [ Ben Hutchings ]
   * [34bf250] debian/control: Remove maximilian attems and Adam Conrad from
     Uploaders field
   * [5ad3976] hooks/resume: Generalise logic to replace dev name with UUID when
     RESUME=auto
   * [0170b7f] hooks/resume: Store /dev/mapper path for swap if possible when
     RESUMEauto (Closes: #883735)
   * [5bf4c29] debian/control: Point Vcs URLs to Salsa
   * [e8377b3] hooks/fsck: Fix invocation of fstype at build time.
     Thanks to Simon Tatham <anakin@pobox.com> (Closes: #865691)
   * [492763a] docs: Convert maintainer notes to Markdown format
   * [0214976] docs/maintainer-notes.md: Update references to Alioth, to Salsa
   * [b71c6c9] docs/maintainer-notes.md: Delete mention of git-core package
   * [89daebf] docs/maintainer-notes.md: Change BTS link to specify source
     package
   * [8e539dc] docs/maintainer-notes.md: Link to tracker.debian.org instead of
     PTS
   * [3f27197] docs/maintainer-notes.md: Remove stale link to Debian bug count
     graph
   * [7dece27] docs/maintainer-notes.md: Use HTTP-S for Debian wiki and popcon
     links
   * [838b6ec] docs/maintainer-notes.md: Link directly to Ubuntu bug list
   * [eaa61d4] docs/maintainer-notes.md: Add myself as co-author
   * [fa7df8f] hook-functions: Correct the comment above hidden_dep_add_modules
   * [0ffbeb9] hook-functions: Remove directory information from
     hidden_dep_add_modules
   * [78e95c1] hook-functions: Check modules.builtin in hidden_dep_add_modules
   * [976aeb9] hook-functions: Handle i8042 hidden dependency on psmouse
     (Closes: #878829)
   * [211e050] hook-functions: Handle nvme hidden dependency on vmd.
     Thanks to Mario Limonciello <Mario.Limonciello@dell.com> (Closes: #886349)
   * [28536f6] unmkinitramfs, lsinitramfs: Split multiple early initramfs
     sections (Closes: #886424)
   * [2a9d97d] debian/control: Add e2fsprogs to Depends for initramfs-tools-core
     (Closes: #887211)
   * [577c94e] initramfs.conf: Update documentation of the DEVICE variable
   * [f1cbe6f] mkinitramfs: Build reproducible images when SOURCE_DATE_EPOCH is
     set. Thanks to Chris Lamb <lamby@debian.org> (Closes: #845034)
   * [717e6bd] mkinitramfs: Exclude ldconfig auxiliary cache from initramfs
     image. Thanks to Kristian Klausen <klausenbusk@hotmail.com>
   * [8bddfe4] mkinitramfs(8): Remove description of nonexistent options
   * [ecd6ce2] mkinitramfs(8), hook-functions: Correct references to "ramdisk"
   * [63cec7b] docs: Move initramfs-tools man page to section 7
   * [562d86e] docs: Update man page header dates
   * [9bd960e] docs: Set man page header source and manual parameters correctly
   * [97cc7e7] docs: Don't package maintainer documentation in
     initramfs-tools-core
   * [4e19a6f] docs: Remove outdated "HACKING" documentation file
   * [6c02622] debian/control: Remove obsolete Breaks and Depends relations
   * [749751c] debian/control: Update Standards-Version to 4.1.5
     - Set Rules-Requires-Root: no
   * [db469f0] initramfs-tools: Override lintian warning "breaks-without-version
     upstart"
 .
   [ Riku Voipio ]
   * [72b6419] auto_add_modules: add mfd for MODULES==most (Closes: #880584)
 .
   [ Benjamin Drung ]
   * [7ca4d0d] Add mlx4 and mlx5 InfiniBand modules to hidden_dep_add_modules
     (Closes: #871595)
   * [df7d7e8] Add option to clear screen at the beginning (Closes: #856929)
   * [a33cb62] Fix indentation (spaces to tabs)
   * [3962c4f] Fix config directory in error message (Closes: #856589)
   * [be2b91c] Double quote to prevent globbing and word splitting
   * [ae339ff] Make size of /run configurable (Closes: #862013)
 .
   [ Steve Langasek ]
   * [c198331] Skip dmsetup resume devices if they are randomly encrypted.
 .
   [ Paul Menzel ]
   * [e28b865] mkinitramfs: Add LZ4 support (Closes: #893845)
   * [5091a5e] control: Remove suggestion of *lz4-tools*
 .
   [ Colin Watson ]
   * [b4804dd] Only sync the filesystem containing the initramfs
     (Closes: #882380) (LP: #1667512)
 .
   [ Karsten Merker ]
   * [281ad9a] Include the axp20x_usb_power module in the base modules list for
     MODULES=most (Closes: #866521)
 .
   [ Ivan Kozik ]
   * [54367c0] init: export DEVICE so that when configured, it is actually set
     in configure_networking (Closes: #883664)
Checksums-Sha1:
 395067443279e14a823c9f9dc21427ed8508f9bb 1755 initramfs-tools_0.131.dsc
 0baf15009aef379337114f4d2821a03bbb50dd03 87676 initramfs-tools_0.131.tar.xz
 ff07f9dae7e3fef062668b4afe834eae86f1a3d9 6160 initramfs-tools_0.131_source.buildinfo
Checksums-Sha256:
 ba0ec72bfa05b449f76064f75c0f2bc0dc573bbb75e24cb03ea6c4d916e35429 1755 initramfs-tools_0.131.dsc
 126ea8044b07e9953ecc881788fe67cc7951f9b857237288d0c4ae125d214f21 87676 initramfs-tools_0.131.tar.xz
 8262cb83d8be04d748b6a29141bb361839221e138e13668690e6e397cdb0fbff 6160 initramfs-tools_0.131_source.buildinfo
Files:
 1c4b81907fd0299d410a88bfb913ecc2 1755 utils optional initramfs-tools_0.131.dsc
 729c1645eaa7e2bdc1cc8ae9eef81b2a 87676 utils optional initramfs-tools_0.131.tar.xz
 2142a4b53fe3938fb685c37f659f0221 6160 utils optional initramfs-tools_0.131_source.buildinfo

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEErCspvTSmr92z9o8157/I7JWGEQkFAltP1rMACgkQ57/I7JWG
EQkstw//YnGrERYbjmycnYc4trZ0j6fMeglupSG6hCaF9mXE9Xc7ofDVnqQ6fAuh
Dqgg0KBdbM5dR4yjXkgE/0eBLTWAk9YDoe8QqAeqne7NF953boLEuB0TtD2IR15k
hf9rDY1TFAlKT17RXsO5whJpXihR6OtHPmoe7nCWzKw9krjIiD3vjORoqts5Dwqu
zG2EKy738LYyEPknNi2r+GuZOod/UubgKpG8wxDPVlR2pzcVnK1cJfSrOo2z+JBw
U5P+vIlO2eq6bmi9uWS87OLlyRtvmMUunUJ9fN6+qrBbffvD36EbW1xXIXuCsPaf
DcZerKiWhU5CrO8k/f9QUTy1sCtWwqR0jfNzLKmygreuhp2XvGtmZAhs9GFW7RpH
TLzgE846sxw4M6H4I417IFRgWXFELfIGDfN3jxGmkgWMLX24HGwx3kRnNjZF2YDP
JIdieeJriwB6B1l0IPO0sVx3kkGZuggsyu472Gu02hJeX9IeoE0SuqCD6vZBF/RW
LWAakzmfYCdXukrYvEQqFNWLcHrxhreAP/BFBPTKJ5skRf9aebuvBX8JONE4Ap6Y
BZX+093Zg/DN/uv4WWiugT4eL5cqYwyQQWFbA860uHHrtKspBOO0GSnIpw+xF2W5
yrUEVgYSBLOHvXObKV0DvwltuCM3KDiVHyOAMqS6liS0fgpajJk=
=dU0O
-----END PGP SIGNATURE-----

Message #61 received at 845034@bugs.debian.org (full text, mbox, reply):

From: Chris Lamb <lamby@debian.org>

To: Ben Hutchings <ben@decadent.org.uk>, 845034@bugs.debian.org, Kristian Klausen <klausenbusk@hotmail.com>

Subject: Re: Updated patch

Date: Thu, 19 Jul 2018 01:37:28 +0100

Hi Ben & Kristian,

Curiously enough I don't remember receiving Kristian's patch. :)

>   not only unreproducible, but completely useless at boot time since
>   the device and inode numbers of libraries will be different.
[…] 
> Since there is no option to explicitly disable creation of the aux-
> cache file, I propose to delete it ldconfig creates it.
                                    ^

Missing "if"? :)


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby@debian.org / chris-lamb.co.uk
       `-

Message #66 received at 845034@bugs.debian.org (full text, mbox, reply):

From: Ben Hutchings <ben@decadent.org.uk>

To: Chris Lamb <lamby@debian.org>, 845034@bugs.debian.org, Kristian Klausen <klausenbusk@hotmail.com>

Subject: Re: Updated patch

Date: Thu, 19 Jul 2018 01:59:15 +0100

[Message part 1 (text/plain, inline)]

On Thu, 2018-07-19 at 01:37 +0100, Chris Lamb wrote:
> Hi Ben & Kristian,
> 
> Curiously enough I don't remember receiving Kristian's patch. :)
> 
> >   not only unreproducible, but completely useless at boot time since
> >   the device and inode numbers of libraries will be different.
> 
> […] 
> > Since there is no option to explicitly disable creation of the aux-
> > cache file, I propose to delete it ldconfig creates it.
> 
>                                     ^
> 
> Missing "if"? :)

Yes, "... delete it if ldconfig creates it."

Ben.

-- 
Ben Hutchings
We get into the habit of living before acquiring the habit of thinking.
                                                         - Albert Camus

[signature.asc (application/pgp-signature, inline)]

Message #71 received at 845034@bugs.debian.org (full text, mbox, reply):

From: "Trent W. Buck" <trentbuck@gmail.com>

To: 845034@bugs.debian.org

Cc: Ben Hutchings <ben@decadent.org.uk>

Subject: Re: Bug#845034: marked as done (initramfs-tools: please ensure initrd images are reproducible)

Date: Thu, 19 Jul 2018 15:53:45 +1000

Debian Bug Tracking System wrote:
> +		LC_ALL=C sort
> [and similar LC_ALL=C elsewhere]

I think you can dial that back from LC_ALL=C to just LC_COLLATE=C.

Informal proof:

    bash4$ printf %s\\n README ReadMe readme | LC_COLLATE=en_AU.UTF-8 sort
    readme
    ReadMe
    README

    bash4$ printf %s\\n README ReadMe readme | LC_COLLATE=C sort
    README
    ReadMe
    readme

    bash4$ printf %s\\n README ReadMe readme | LC_ALL=C sort
    README
    ReadMe
    readme

Message #76 received at 845034@bugs.debian.org (full text, mbox, reply):

From: Ben Hutchings <ben@decadent.org.uk>

To: "Trent W. Buck" <trentbuck@gmail.com>, 845034@bugs.debian.org

Subject: Re: Bug#845034: marked as done (initramfs-tools: please ensure initrd images are reproducible)

Date: Thu, 19 Jul 2018 15:48:00 +0100

[Message part 1 (text/plain, inline)]

On Thu, 2018-07-19 at 15:53 +1000, Trent W. Buck wrote:
> Debian Bug Tracking System wrote:
> > +		LC_ALL=C sort
> > [and similar LC_ALL=C elsewhere]
> 
> I think you can dial that back from LC_ALL=C to just LC_COLLATE=C.
[...]

Now try with LC_ALL=en_AU.UTF-8 already set in the environment.  That
overrides LC_COLLATE etc.

Ben.

-- 
Ben Hutchings
We get into the habit of living before acquiring the habit of thinking.
                                                         - Albert Camus

[signature.asc (application/pgp-signature, inline)]

Send a report that this bug log contains spam.