<div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt" ><div dir="ltr" >Thanks Leo, Rafael, and Jason.</div>
<div dir="ltr" > </div>
<div dir="ltr" >Following your pointers I was able to get the hot plug of volumes working through OpenStack.</div>
<div dir="ltr" > </div>
<div dir="ltr" >For the record, and mail archive searching purposes, the Ubuntu 16.04 cloud image from Canonical did not have ppc64-diag nor linux-image-extra-<version>-generic installed.</div>
<div dir="ltr" >The cloud image already had librtas2 and powerpc-utils. I simply did an apt-get update followed by the install of those two packages, a reboot, and live attach/detach worked.</div>
<div dir="ltr" > </div>
<div dir="ltr" >Also of interest is that the 16.10 Yakkety image was different:</div>
<div dir="ltr" >ppc64-diag was in main and installed</div>
<div dir="ltr" >linux-image-extra-<version>-generic was NOT installed</div>
<div dir="ltr" >It did not have the rpadlpar module in the file system.</div>
<div dir="ltr" >However, given rpadlpar and the linux-image-extra package was not installed, live attach/detach works at Yakkety.</div>
<div dir="ltr" ><div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt" ><div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt" ><div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt" ><div dir="ltr" ><div style="font-size: 12pt; font-weight: bold; font-family: sans-serif; color: #7C7C5F;" > </div></div></div></div></div></div>
<div dir="ltr" > </div>
<blockquote data-history-content-modified="1" dir="ltr" style="border-left:solid #aaaaaa 2px; margin-left:5px; padding-left:5px; direction:ltr; margin-right:0px" >----- Original message -----<br>From: Jason Furmanek <furmanek@linux.vnet.ibm.com><br>Sent by: "Linuxppc-users" <linuxppc-users-bounces+smatzek=us.ibm.com@lists.ozlabs.org><br>To: linuxppc-users@lists.ozlabs.org<br>Cc:<br>Subject: Re: [Linuxppc-users] Live VM disk removal failure<br>Date: Thu, Jun 29, 2017 10:30 AM<br> <br><!--Notes ACF
<meta http-equiv="Content-Type" content="text/html; charset=utf8" >-->
<p>One more thing:</p>
<p>That rpadlpar module comes along with the <b>linux-image-extra-generic-<version> </b>package, so make sure to have that. (credit to Folco again on that one - he helped me with a similar issue not long back). A lot of "minimal" cloud images don't come with the extra package.</p>
<p> </p>
<p>So for hotplug you want:</p>
<p><span>- powerpc-utils </span></p>
<p><span>- ppc64_diag</span></p>
<p><span>- librtas</span></p>
<p><span>- linux-image-extra-generic-<version></span></p>
<div>On 06/28/2017 07:15 PM, Rafael Folco wrote:</div>
<blockquote cite="mid:D11EE3BE-C3CC-47B7-92AC-292792E56E1C@linux.vnet.ibm.com" type="cite" ><!--Notes ACF
<meta http-equiv="Content-Type" content="text/html; charset=utf8" >-->
<div>Hi Sam,</div>
<div> </div>
<div>Xenial should hotplug pci afaik.</div>
<div>If I remember right, the missing package in a base ubuntu cloud image (xenial) was ppc64-diag. Just confirm powerpc-utils and librtas are also installed. So after installing it, make sure rtas_errd service is up and running inside your guest.</div>
<div> </div>
<div>When you attach / detach using virsh or via openstack, it will call drmgr tool under the covers, which in turn will load rpadlpar module and perform the hotplug operation.</div>
<div>I am not sure about min versions but latest available in xenial 16.04.X are enough.</div>
<div> </div>
<div>Hope this helps.</div>
<div> </div>
<div>That’s All Folco’s =)</div>
<div><div>Rafael Folco<br>OpenStack<br>IBM Linux Technology Center</div>
<div> </div></div>
<div><blockquote type="cite" ><div>On Jun 28, 2017, at 8:06 PM, Leonardo Augusto Guimarães Garcia <<a href="mailto:lagarcia@linux.vnet.ibm.com" moz-do-not-send="true" target="_blank" >lagarcia@linux.vnet.ibm.com</a>> wrote:</div>
<div><!--Notes ACF
<meta http-equiv="Content-Type" content="text/html; charset=utf8" class="" >-->
<div bgcolor="#FFFFFF" text="#000000" >Samuel,<br><br>From what you described, it doesn't seem to me, at least initially, that you have an issue in libvirt. On Power systems, you need some user space tools installed in the guest in order to correctly perform hot plug and hot unplug operations. It may be the case that the tools that come installed by default in Ubuntu 14.04 and Ubuntu 16.04 are just too old. Please, check the versions of the following packages:<span> powerpc-utils, ppc64_diag, and librtas.<br><br>Cheers,<br><br>Leo</span><br>
<div>On 06/28/2017 05:24 PM, Samuel D Matzek wrote:</div>
<blockquote cite="mid:OF7D91F3EF.5143BAFC-ON0025814D.006FEB67-0025814D.00701007@notes.na.collabserv.com" type="cite" ><div dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt" ><div dir="ltr" ><div>I am hitting a silent error while trying to detach a volume from a running VM on Ubuntu Xenial KVM. While I am using OpenStack for this, the OpenStack code is calling into the libvirt module to do the detach from the transient / live domain and libvirt is failing to remove the disk from the running domain and is not putting any errors in libvirtd logs.</div>
<div>The OpenStack error is "DeviceDetachFailed: Device detach failed for vdb: Unable to detach from guest transient domain."</div>
<div> </div>
<div>I have discovered this is a guest OS issue. I tried the following guest OSes with Ubuntu Xenial as the host OS:</div>
<div> </div>
<div>Silent detach failure / fail to detach:<br>Ubuntu 14.04 ppc64le daily build of Ubuntu cloud image<br>Ubuntu 16.04 ppc64le daily build of Ubuntu cloud image</div>
<div> </div>
<div>Live detach succeeds:<br>Ubuntu 16.10 ppc64le daily build of Ubuntu cloud image<br>Ubuntu 17.04 ppc64le daily build of Ubuntu cloud image<br>CentOS 7.3</div>
<div> </div>
<div>What I am trying to achieve is to get the live detach to work on Xenial (16.04) and am at a loss as to what packages or processes may be involved in the differences between 16.04 and 16.10 where it works. I have checked the kernel and both 16.04 and 16.10 are both using a 4.8.x level.</div>
<div> </div>
<div>In all cases the disk trying to be detached is not in use. They are blank with no file system on them. They are not mounted. The same set of steps is taken to attach, reboot, detach, between the working and non-working OS levels above.</div>
<div> </div>
<div>Does any one have hints on what could be causing the silent detach failure on Xenial? What packages I should look at updating beyond what the Ubuntu daily build has? Note I have already tried doing upgrade of all packages, including updating from a recent UCA repo.</div>
<div> </div>
<div>Additionally, does anyone know what to set (and where) to get the reason libvirt is not detaching the volume from the live domain? I have already tried enabling the logging documented here [1].</div>
<div>[1] <a href="https://wiki.libvirt.org/page/DebugLogs" moz-do-not-send="true" target="_blank" >https://wiki.libvirt.org/page/DebugLogs</a></div></div></div>
<fieldset> </fieldset>
<div><font face="Default Monospace,Courier New,Courier,monospace" size="2" >_______________________________________________<br>Linuxppc-users mailing list<br><a href="mailto:Linuxppc-users@lists.ozlabs.org" moz-do-not-send="true" target="_blank" >Linuxppc-users@lists.ozlabs.org</a><br><a href="https://lists.ozlabs.org/listinfo/linuxppc-users" moz-do-not-send="true" target="_blank" >https://lists.ozlabs.org/listinfo/linuxppc-users</a></font></div></blockquote></div>_______________________________________________<br>Linuxppc-users mailing list<br><a href="mailto:Linuxppc-users@lists.ozlabs.org" moz-do-not-send="true" target="_blank" >Linuxppc-users@lists.ozlabs.org</a><br><a href="https://lists.ozlabs.org/listinfo/linuxppc-users" target="_blank" >https://lists.ozlabs.org/listinfo/linuxppc-users</a></div></blockquote></div>
<fieldset> </fieldset>
<div><font face="Default Monospace,Courier New,Courier,monospace" size="2" >_______________________________________________<br>Linuxppc-users mailing list<br><a href="mailto:Linuxppc-users@lists.ozlabs.org" target="_blank" >Linuxppc-users@lists.ozlabs.org</a><br><a href="https://lists.ozlabs.org/listinfo/linuxppc-users" target="_blank" >https://lists.ozlabs.org/listinfo/linuxppc-users</a></font></div></blockquote>
<div><font face="Default Monospace,Courier New,Courier,monospace" size="2" >_______________________________________________<br>Linuxppc-users mailing list<br>Linuxppc-users@lists.ozlabs.org<br><a href="https://lists.ozlabs.org/listinfo/linuxppc-users" target="_blank" >https://lists.ozlabs.org/listinfo/linuxppc-users</a></font></div></blockquote>
<div dir="ltr" > </div></div><BR>