[Linuxppc-users] Live VM disk removal failure

Tue Jul 4 22:27:33 AEST 2017

Also, "for the archives", the reason you won't need rpadlpar_io module 
(and linux-image-extra-*) on 16.10 and onwards is because ppc64-diag no 
longer requires it in more recent versions.

Saudações / Best Regards,
--
Ricardo Marin Matinata
STSM, Linux, KVM and Cloud on POWER
IBM Linux Technology Center | Open Systems Development | IBM Systems

"Linuxppc-users" <linuxppc-users-bounces+rmm=br.ibm.com at lists.ozlabs.org> 
wrote on 06/29/2017 04:08:34 PM:

> From: "Samuel D Matzek" <smatzek at us.ibm.com>
> To: furmanek at linux.vnet.ibm.com
> Cc: linuxppc-users at lists.ozlabs.org
> Date: 06/29/2017 04:15 PM
> Subject: Re: [Linuxppc-users] Live VM disk removal failure
> Sent by: "Linuxppc-users" <linuxppc-users-bounces
> +rmm=br.ibm.com at lists.ozlabs.org>
> 
> Thanks Leo, Rafael, and Jason.
> 
> Following your pointers I was able to get the hot plug of volumes 
> working through OpenStack.
> 
> For the record, and mail archive searching purposes, the Ubuntu 16.
> 04 cloud image from Canonical did not have ppc64-diag nor linux-
> image-extra-<version>-generic installed.
> The cloud image already had librtas2 and powerpc-utils.  I simply 
> did an apt-get update followed by the install of those two packages,
> a reboot, and live attach/detach worked.
> 
> Also of interest is that the 16.10 Yakkety image was different:
> ppc64-diag was in main and installed
> linux-image-extra-<version>-generic was NOT installed
> It did not have the rpadlpar module in the file system.
> However, given rpadlpar and the linux-image-extra package was not 
> installed, live attach/detach works at Yakkety.
> 
> 
> ----- Original message -----
> From: Jason Furmanek <furmanek at linux.vnet.ibm.com>
> Sent by: "Linuxppc-users" <linuxppc-users-bounces
> +smatzek=us.ibm.com at lists.ozlabs.org>
> To: linuxppc-users at lists.ozlabs.org
> Cc:
> Subject: Re: [Linuxppc-users] Live VM disk removal failure
> Date: Thu, Jun 29, 2017 10:30 AM
> 
> One more thing:
> That rpadlpar module comes along with the 
linux-image-extra-generic-<version> 
> package, so make sure to have that. (credit to Folco again on that 
> one - he helped me with a similar issue not long back). A lot of 
> "minimal" cloud images don't come with the extra package.
> 
> So for hotplug you want:
> - powerpc-utils 
> - ppc64_diag
> - librtas
> - linux-image-extra-generic-<version>
> 
> On 06/28/2017 07:15 PM, Rafael Folco wrote:
> Hi Sam,
> 
> Xenial should hotplug pci afaik.
> If I remember right, the missing package in a base ubuntu cloud 
> image (xenial) was ppc64-diag. Just confirm powerpc-utils and 
> librtas are also installed. So after installing it, make sure 
> rtas_errd service is up and running inside your guest.
> 
> When you attach / detach using virsh or via openstack, it will call 
> drmgr tool under the covers, which in turn will load rpadlpar module
> and perform the hotplug operation.
> I am not sure about min versions but latest available in xenial 16.
> 04.X are enough.
> 
> Hope this helps.
> 
> That’s All Folco’s =)
> 
> Rafael Folco
> OpenStack
> IBM Linux Technology Center
> 
> 
> On Jun 28, 2017, at 8:06 PM, Leonardo Augusto Guimarães Garcia <
> lagarcia at linux.vnet.ibm.com> wrote:
> 
> Samuel,
> 
> From what you described, it doesn't seem to me, at least initially, 
> that you have an issue in libvirt. On Power systems, you need some 
> user space tools installed in the guest in order to correctly 
> perform hot plug and hot unplug operations. It may be the case that 
> the tools that come installed by default in Ubuntu 14.04 and Ubuntu 
> 16.04 are just too old. Please, check the versions of the following 
> packages: powerpc-utils, ppc64_diag, and librtas.
> 
> Cheers,
> 
> Leo
> 
> On 06/28/2017 05:24 PM, Samuel D Matzek wrote:
> I am hitting a silent error while trying to detach a volume from a 
> running VM on Ubuntu Xenial KVM.  While I am using OpenStack for 
> this, the OpenStack code is calling into the libvirt module to do 
> the detach from the transient / live domain and libvirt is failing 
> to remove the disk from the running domain and is not putting any 
> errors in libvirtd logs.
> The OpenStack error is "DeviceDetachFailed: Device detach failed for
> vdb: Unable to detach from guest transient domain."
> 
> I have discovered this is a guest OS issue.  I tried the following 
> guest OSes with Ubuntu Xenial as the host OS:
> 
> Silent detach failure / fail to detach:
> Ubuntu 14.04 ppc64le daily build of Ubuntu cloud image
> Ubuntu 16.04 ppc64le daily build of Ubuntu cloud image
> 
> Live detach succeeds:
> Ubuntu 16.10 ppc64le daily build of Ubuntu cloud image
> Ubuntu 17.04 ppc64le daily build of Ubuntu cloud image
> CentOS 7.3
> 
> What I am trying to achieve is to get the live detach to work on 
> Xenial (16.04) and am at a loss as to what packages or processes may
> be involved in the differences between 16.04 and 16.10 where it 
> works.  I have checked the kernel and both 16.04 and 16.10 are both 
> using a 4.8.x level.
> 
> In all cases the disk trying to be detached is not in use.  They are
> blank with no file system on them.  They are not mounted.  The same 
> set of steps is taken to attach, reboot, detach, between the working
> and non-working OS levels above.
> 
> Does any one have hints on what could be causing the silent detach 
> failure on Xenial?  What packages I should look at updating beyond 
> what the Ubuntu daily build has?  Note I have already tried doing 
> upgrade of all packages, including updating from a recent UCA repo.
> 
> Additionally, does anyone know what to set (and where) to get the 
> reason libvirt is not detaching the volume from the live domain? I 
> have already tried enabling the logging documented here [1].
> [1] https://wiki.libvirt.org/page/DebugLogs
> 
> _______________________________________________
> Linuxppc-users mailing list
> Linuxppc-users at lists.ozlabs.org
> https://lists.ozlabs.org/listinfo/linuxppc-users
> _______________________________________________
> Linuxppc-users mailing list
> Linuxppc-users at lists.ozlabs.org
> https://lists.ozlabs.org/listinfo/linuxppc-users
> 
> _______________________________________________
> Linuxppc-users mailing list
> Linuxppc-users at lists.ozlabs.org
> https://lists.ozlabs.org/listinfo/linuxppc-users
> 
> _______________________________________________
> Linuxppc-users mailing list
> Linuxppc-users at lists.ozlabs.org
> https://lists.ozlabs.org/listinfo/linuxppc-users
> 
> _______________________________________________
> Linuxppc-users mailing list
> Linuxppc-users at lists.ozlabs.org
> https://lists.ozlabs.org/listinfo/linuxppc-users

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ozlabs.org/pipermail/linuxppc-users/attachments/20170704/436fcd3b/attachment.html>