Debian Bug report logs - #678731
linux-2.6: Please build dummy_hcd and g_mass_storage modules

Package: src:linux; Maintainer for src:linux is Debian Kernel Team <debian-kernel@lists.debian.org>;

Reported by: intrigeri@debian.org

Date: Sun, 24 Jun 2012 06:45:02 UTC

Severity: wishlist

Done: Moritz Mühlenhoff <jmm@inutil.org>

Bug is archived. No further changes may be made.

Toggle useless messages

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to debian-bugs-dist@lists.debian.org, tails-dev@boum.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#678731; Package linux-2.6. (Sun, 24 Jun 2012 06:45:05 GMT) Full text and rfc822 format available.

Acknowledgement sent to intrigeri@debian.org:
New Bug report received and forwarded. Copy sent to tails-dev@boum.org, Debian Kernel Team <debian-kernel@lists.debian.org>. (Sun, 24 Jun 2012 06:45:06 GMT) Full text and rfc822 format available.

Message #5 received at submit@bugs.debian.org (full text, mbox):

From: intrigeri@debian.org
To: Debian Bug Tracking System <submit@bugs.debian.org>
Subject: linux-2.6: Please build dummy_hcd and g_mass_storage modules
Date: Sun, 24 Jun 2012 08:41:00 +0200
Package: linux-2.6
Severity: wishlist
X-Debbugs-CC: tails-dev@boum.org
User: tails-dev@boum.org
Usertags: testing

Hi!

Please build dummy_hcd and g_mass_storage modules.

The USB dummy HCD and Mass Storage Gadget would be very useful to
implement automated testing of Live systems such as Tails [0], where
some features are only available when installed on USB: it would be
great to avoid plugging a bunch of real USB sticks into an server in
a datacenter, while the Linux kernel has the needed functionality to
emulate such hardware.

Thank you.

  [0] https://tails.boum.org/
  [1] https://mailman.boum.org/pipermail/tails-dev/2012-June/001320.html




Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#678731; Package linux-2.6. (Sun, 24 Jun 2012 22:15:03 GMT) Full text and rfc822 format available.

Acknowledgement sent to Ben Hutchings <ben@decadent.org.uk>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Sun, 24 Jun 2012 22:15:03 GMT) Full text and rfc822 format available.

Message #10 received at 678731@bugs.debian.org (full text, mbox):

From: Ben Hutchings <ben@decadent.org.uk>
To: intrigeri@debian.org, 678731@bugs.debian.org
Subject: Re: Bug#678731: linux-2.6: Please build dummy_hcd and g_mass_storage modules
Date: Sun, 24 Jun 2012 23:12:00 +0100
[Message part 1 (text/plain, inline)]
On Sun, 2012-06-24 at 08:41 +0200, intrigeri@debian.org wrote:
> Package: linux-2.6
> Severity: wishlist
> X-Debbugs-CC: tails-dev@boum.org
> User: tails-dev@boum.org
> Usertags: testing
> 
> Hi!
> 
> Please build dummy_hcd and g_mass_storage modules.
> 
> The USB dummy HCD and Mass Storage Gadget would be very useful to
> implement automated testing of Live systems such as Tails [0], where
> some features are only available when installed on USB: it would be
> great to avoid plugging a bunch of real USB sticks into an server in
> a datacenter, while the Linux kernel has the needed functionality to
> emulate such hardware.

Couldn't you also use usbip for this?

Ben.

-- 
Ben Hutchings
I say we take off; nuke the site from orbit.  It's the only way to be sure.
[signature.asc (application/pgp-signature, inline)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#678731; Package linux-2.6. (Mon, 25 Jun 2012 03:39:05 GMT) Full text and rfc822 format available.

Acknowledgement sent to intrigeri <intrigeri@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Mon, 25 Jun 2012 03:39:05 GMT) Full text and rfc822 format available.

Message #15 received at 678731@bugs.debian.org (full text, mbox):

From: intrigeri <intrigeri@debian.org>
To: Ben Hutchings <ben@decadent.org.uk>
Cc: 678731@bugs.debian.org
Subject: Re: Bug#678731: linux-2.6: Please build dummy_hcd and g_mass_storage modules
Date: Mon, 25 Jun 2012 05:36:33 +0200
Hi Ben,

Ben Hutchings wrote (24 Jun 2012 22:12:00 GMT) :
> Couldn't you also use usbip for this?

Thank you for mentionning usbip, I did not know about it!
After a quick look at it, I must say I'm happy to learn about it, and
I may use it for unrelated tasks, but it does not really seem to be
fit for the Live USB system autotesting usecase.

E.g. it looks like it's not easily possible to boot a VM from a USB
stick shared with the VM using usbip, is it? (I've successfully booted
a VM using libvirt/qemu-kvm's USB 2.0 passthrough feature, from
a virtual USB stick emulated by g_mass_storage. This is the kind of
things we need to automatically test.)

And, even if it was, as far as I understand it, moving a bunch of
bare-metal USB sticks from some an always-on server in a datacenter to
another one, and sharing the stick over IP, is no solution for us: our
problem is to avoid plugging a bunch of bare-metal USB sticks into
a server in a datacenter, in the first place.

So, unfortunately, it looks like no existing solution currently in
Debian is good enough for our needs.




Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#678731; Package linux-2.6. (Wed, 27 Jun 2012 03:36:03 GMT) Full text and rfc822 format available.

Acknowledgement sent to Ben Hutchings <ben@decadent.org.uk>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Wed, 27 Jun 2012 03:36:03 GMT) Full text and rfc822 format available.

Message #20 received at 678731@bugs.debian.org (full text, mbox):

From: Ben Hutchings <ben@decadent.org.uk>
To: intrigeri <intrigeri@debian.org>, 678731@bugs.debian.org
Subject: Re: Bug#678731: linux-2.6: Please build dummy_hcd and g_mass_storage modules
Date: Wed, 27 Jun 2012 04:32:31 +0100
[Message part 1 (text/plain, inline)]
On Mon, 2012-06-25 at 05:36 +0200, intrigeri wrote:
> Hi Ben,
> 
> Ben Hutchings wrote (24 Jun 2012 22:12:00 GMT) :
> > Couldn't you also use usbip for this?
> 
> Thank you for mentionning usbip, I did not know about it!
> After a quick look at it, I must say I'm happy to learn about it, and
> I may use it for unrelated tasks, but it does not really seem to be
> fit for the Live USB system autotesting usecase.
> 
> E.g. it looks like it's not easily possible to boot a VM from a USB
> stick shared with the VM using usbip, is it?

I don't know; probably not.

[...]
> And, even if it was, as far as I understand it, moving a bunch of
> bare-metal USB sticks from some an always-on server in a datacenter to
> another one, and sharing the stick over IP, is no solution for us: our
> problem is to avoid plugging a bunch of bare-metal USB sticks into
> a server in a datacenter, in the first place.
> 
> So, unfortunately, it looks like no existing solution currently in
> Debian is good enough for our needs.

Yes, but I think it would make more sense to emulate a USB storage
device in qemu rather than the host kernel.

I don't know; would be interested to hear other people's opinions on
this.

Ben.

-- 
Ben Hutchings
Lowery's Law:
             If it jams, force it. If it breaks, it needed replacing anyway.
[signature.asc (application/pgp-signature, inline)]

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#678731; Package linux-2.6. (Wed, 27 Jun 2012 11:14:01 GMT) Full text and rfc822 format available.

Acknowledgement sent to bertagaz@ptitcanardnoir.org:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Wed, 27 Jun 2012 11:14:20 GMT) Full text and rfc822 format available.

Message #25 received at 678731@bugs.debian.org (full text, mbox):

From: bertagaz@ptitcanardnoir.org
To: Ben Hutchings <ben@decadent.org.uk>, 678731@bugs.debian.org
Subject: Re: Bug#678731: linux-2.6: Please build dummy_hcd and g_mass_storage modules
Date: Wed, 27 Jun 2012 13:00:22 +0200
On Wed, Jun 27, 2012 at 04:32:31AM +0100, Ben Hutchings wrote:
> On Mon, 2012-06-25 at 05:36 +0200, intrigeri wrote:
> > And, even if it was, as far as I understand it, moving a bunch of
> > bare-metal USB sticks from some an always-on server in a datacenter to
> > another one, and sharing the stick over IP, is no solution for us: our
> > problem is to avoid plugging a bunch of bare-metal USB sticks into
> > a server in a datacenter, in the first place.
> > 
> > So, unfortunately, it looks like no existing solution currently in
> > Debian is good enough for our needs.
> 
> Yes, but I think it would make more sense to emulate a USB storage
> device in qemu rather than the host kernel.
> 
> I don't know; would be interested to hear other people's opinions on
> this.

AFAIK, you're right, qemu can emulate USB, but it's quite slow, not really
completely implemented yet, and I haven't found a way to boot on such an
emulated usb device in the VM. Sounds like it's more usefull when you want
to hot{plus,unplug} USB devices in a running VM.

So it doesn't appear so reliable nor covering our use cases compared to
the kernel module we are talking about, which is in the kernel tree since
a lot of time and as such is more stable.

I believe that adding this module to the Debian kernel might also be
usefull for Debian Live, but I don't want to speak for them.

bert.




Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#678731; Package linux-2.6. (Thu, 28 Jun 2012 19:51:03 GMT) Full text and rfc822 format available.

Acknowledgement sent to intrigeri <intrigeri@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Thu, 28 Jun 2012 19:51:03 GMT) Full text and rfc822 format available.

Message #30 received at 678731@bugs.debian.org (full text, mbox):

From: intrigeri <intrigeri@debian.org>
To: 678731@bugs.debian.org
Cc: Ben Hutchings <ben@decadent.org.uk>, bertagaz@ptitcanardnoir.org, debian-live@lists.debian.org
Subject: Re: Bug#678731: linux-2.6: Please build dummy_hcd and g_mass_storage modules
Date: Thu, 28 Jun 2012 21:48:19 +0200
Hi,

bertagaz@ptitcanardnoir.org wrote (27 Jun 2012 11:00:22 GMT) :
> On Wed, Jun 27, 2012 at 04:32:31AM +0100, Ben Hutchings wrote:

>> Yes, but I think it would make more sense to emulate a USB storage
>> device in qemu rather than the host kernel.

I do agree.

bertagaz and I have spent a bit more time testing and comparing the
available options. Our results are summed up there:
https://tails.boum.org/todo/automated_builds_and_tests/USB/

tl;dr --> as far as Wheezy is concerned:
  * qemu-kvm emulates just fine a USB 2.0 mass storage device, and
    knows how to boot from it; personally, I'd rather use that than
    a dedicated kernel module.
  * with qemu-kvm on the command-line: no need for an additional
    kernel module
  * with a libvirt stack: a missing interface in some abstraction
    layer makes it a pain to use the qemu-kvm USB emulation of
    removable mass storage devices.

We are going to request the missing interface to upstream libvirt,
but it's unlikely the result thereof is ready in time for Wheezy.

So, with my Tails developer hat, we would be happy to use
g_mass_storage at least from now to the Wheezy+1 release.

> I don't know; would be interested to hear other people's opinions
> on this.

I'd be interested too!

Cc'ing the Debian Live mailing-list, as there may be folks there who
have experience on this topic.

Perhaps debian-boot and/or debian-installer should be added to the mix
as well, what do you think?




Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#678731; Package linux-2.6. (Fri, 29 Jun 2012 00:33:03 GMT) Full text and rfc822 format available.

Acknowledgement sent to Ben Hutchings <ben@decadent.org.uk>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Fri, 29 Jun 2012 00:33:03 GMT) Full text and rfc822 format available.

Message #35 received at 678731@bugs.debian.org (full text, mbox):

From: Ben Hutchings <ben@decadent.org.uk>
To: intrigeri <intrigeri@debian.org>
Cc: 678731@bugs.debian.org, bertagaz@ptitcanardnoir.org, debian-live@lists.debian.org
Subject: Re: Bug#678731: linux-2.6: Please build dummy_hcd and g_mass_storage modules
Date: Fri, 29 Jun 2012 01:29:07 +0100
[Message part 1 (text/plain, inline)]
On Thu, 2012-06-28 at 21:48 +0200, intrigeri wrote:
> Hi,
> 
> bertagaz@ptitcanardnoir.org wrote (27 Jun 2012 11:00:22 GMT) :
> > On Wed, Jun 27, 2012 at 04:32:31AM +0100, Ben Hutchings wrote:
> 
> >> Yes, but I think it would make more sense to emulate a USB storage
> >> device in qemu rather than the host kernel.
> 
> I do agree.
> 
> bertagaz and I have spent a bit more time testing and comparing the
> available options. Our results are summed up there:
> https://tails.boum.org/todo/automated_builds_and_tests/USB/
> 
> tl;dr --> as far as Wheezy is concerned:
>   * qemu-kvm emulates just fine a USB 2.0 mass storage device, and
>     knows how to boot from it; personally, I'd rather use that than
>     a dedicated kernel module.
>   * with qemu-kvm on the command-line: no need for an additional
>     kernel module
>   * with a libvirt stack: a missing interface in some abstraction
>     layer makes it a pain to use the qemu-kvm USB emulation of
>     removable mass storage devices.
>
> We are going to request the missing interface to upstream libvirt,
> but it's unlikely the result thereof is ready in time for Wheezy.
> 
> So, with my Tails developer hat, we would be happy to use
> g_mass_storage at least from now to the Wheezy+1 release.
[...]

So you're asking for extra kernel modules to work around a libvirt
deficiency, not even a missing feature in qemu?

I think this is ridiculous.

Ben.

-- 
Ben Hutchings
Lowery's Law:
             If it jams, force it. If it breaks, it needed replacing anyway.
[signature.asc (application/pgp-signature, inline)]

Bug reassigned from package 'linux-2.6' to 'src:linux'. Request was from Moritz Muehlenhoff <jmm@debian.org> to control@bugs.debian.org. (Mon, 08 Jul 2013 16:24:21 GMT) Full text and rfc822 format available.

Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#678731; Package src:linux. (Mon, 08 Jul 2013 16:24:25 GMT) Full text and rfc822 format available.

Acknowledgement sent to Moritz Mühlenhoff <jmm@inutil.org>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Mon, 08 Jul 2013 16:24:25 GMT) Full text and rfc822 format available.

Message #42 received at 678731@bugs.debian.org (full text, mbox):

From: Moritz Mühlenhoff <jmm@inutil.org>
To: intrigeri <intrigeri@debian.org>
Cc: 678731@bugs.debian.org, Ben Hutchings <ben@decadent.org.uk>, bertagaz@ptitcanardnoir.org, debian-live@lists.debian.org
Subject: Re: Bug#678731: linux-2.6: Please build dummy_hcd and g_mass_storage modules
Date: Mon, 8 Jul 2013 18:22:52 +0200
On Thu, Jun 28, 2012 at 09:48:19PM +0200, intrigeri wrote:
> Hi,
> 
> bertagaz@ptitcanardnoir.org wrote (27 Jun 2012 11:00:22 GMT) :
> > On Wed, Jun 27, 2012 at 04:32:31AM +0100, Ben Hutchings wrote:
> 
> >> Yes, but I think it would make more sense to emulate a USB storage
> >> device in qemu rather than the host kernel.
> 
> I do agree.
> 
> bertagaz and I have spent a bit more time testing and comparing the
> available options. Our results are summed up there:
> https://tails.boum.org/todo/automated_builds_and_tests/USB/
> 
> tl;dr --> as far as Wheezy is concerned:
>   * qemu-kvm emulates just fine a USB 2.0 mass storage device, and
>     knows how to boot from it; personally, I'd rather use that than
>     a dedicated kernel module.
>   * with qemu-kvm on the command-line: no need for an additional
>     kernel module
>   * with a libvirt stack: a missing interface in some abstraction
>     layer makes it a pain to use the qemu-kvm USB emulation of
>     removable mass storage devices.

How's the state of affairs with libvirt 1.1 from unstable?

Cheers,
        Moritz



Information forwarded to debian-bugs-dist@lists.debian.org, Debian Kernel Team <debian-kernel@lists.debian.org>:
Bug#678731; Package src:linux. (Tue, 09 Jul 2013 19:39:09 GMT) Full text and rfc822 format available.

Acknowledgement sent to intrigeri <intrigeri@debian.org>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <debian-kernel@lists.debian.org>. (Tue, 09 Jul 2013 19:39:09 GMT) Full text and rfc822 format available.

Message #47 received at 678731@bugs.debian.org (full text, mbox):

From: intrigeri <intrigeri@debian.org>
To: Moritz Mühlenhoff <jmm@inutil.org>
Cc: 678731@bugs.debian.org, Ben Hutchings <ben@decadent.org.uk>, bertagaz@ptitcanardnoir.org, debian-live@lists.debian.org
Subject: Re: Bug#678731: linux-2.6: Please build dummy_hcd and g_mass_storage modules
Date: Tue, 09 Jul 2013 21:35:28 +0200
Hi,

Moritz Mühlenhoff wrote (08 Jul 2013 16:22:52 GMT) :
> How's the state of affairs with libvirt 1.1 from unstable?

We (at Tails) have submitted a patchset upstream to add the support we
need to libvirt and virt-manager. It's waiting for their review.

So, I think we won't need the functionality we've asked for in this
bug report. I wouldn't mind if the maintainers closed it.

Thanks for caring!

Cheers,
-- 
  intrigeri
  | GnuPG key @ https://gaffer.ptitcanardnoir.org/intrigeri/intrigeri.asc
  | OTR fingerprint @ https://gaffer.ptitcanardnoir.org/intrigeri/otr.asc



Reply sent to Moritz Mühlenhoff <jmm@inutil.org>:
You have taken responsibility. (Thu, 11 Jul 2013 21:21:16 GMT) Full text and rfc822 format available.

Notification sent to intrigeri@debian.org:
Bug acknowledged by developer. (Thu, 11 Jul 2013 21:21:16 GMT) Full text and rfc822 format available.

Message #52 received at 678731-done@bugs.debian.org (full text, mbox):

From: Moritz Mühlenhoff <jmm@inutil.org>
To: intrigeri <intrigeri@debian.org>
Cc: 678731-done@bugs.debian.org, bertagaz@ptitcanardnoir.org
Subject: Re: Bug#678731: linux-2.6: Please build dummy_hcd and g_mass_storage modules
Date: Thu, 11 Jul 2013 23:20:11 +0200
On Tue, Jul 09, 2013 at 09:35:28PM +0200, intrigeri wrote:
> Hi,
> 
> Moritz Mühlenhoff wrote (08 Jul 2013 16:22:52 GMT) :
> > How's the state of affairs with libvirt 1.1 from unstable?
> 
> We (at Tails) have submitted a patchset upstream to add the support we
> need to libvirt and virt-manager. It's waiting for their review.
> 
> So, I think we won't need the functionality we've asked for in this
> bug report. I wouldn't mind if the maintainers closed it.
> 
> Thanks for caring!

Ok, let's close the bug, then.

Cheers,
        Moritz



Bug archived. Request was from Debbugs Internal Request <owner@bugs.debian.org> to internal_control@bugs.debian.org. (Fri, 09 Aug 2013 07:28:46 GMT) Full text and rfc822 format available.

Send a report that this bug log contains spam.


Debian bug tracking system administrator <owner@bugs.debian.org>. Last modified: Wed Apr 16 16:24:59 2014; Machine Name: buxtehude.debian.org

Debian Bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.