[PATCH 1/8] pseries: phyp dump: Docmentation
strosake at austin.ibm.com
Fri Jan 11 08:46:38 EST 2008
Linas Vepstas wrote:
> On 10/01/2008, Olof Johansson <olof at lixom.net> wrote:
>>On Wed, Jan 09, 2008 at 10:12:13PM -0600, Linas Vepstas wrote:
>>>On 09/01/2008, Olof Johansson <olof at lixom.net> wrote:
>>>>On Wed, Jan 09, 2008 at 08:33:53PM -0600, Linas Vepstas wrote:
>>>>>Heh. That's the elbow-grease of this thing. The easy part is to get
>>>>>the core function working. The hard part is to test these various configs,
>>>>>and when they don't work, figure out what went wrong. That will take
>>>>>perseverence and brains.
>>>>This just sounds like a whole lot of extra work to get a feature that
>>>Well, no. kexec is horribly ill-behaved with respect to PCI. The
>>>kexec kernel starts running with PCI devices in some random
>>>state; maybe they're DMA'ing or who knows what. kexec tries
>>>real hard to whack a few needed pci devices into submission
>>>but it has been hit-n-miss, and the source of 90% of the kexec
>>>headaches and debugging effort. Its not pretty.
>>It surprises me that this hasn't been possible to resolve with less than
>>architecting a completely new interface, given that the platform has
>>all this fancy support for isolating and resetting adapters. After all,
>>the exact same thing has to be done by the hypervisor before rebooting
> OK, point taken.
> -- The phyp interfaces are there for AIX, which I guess must
> not have kexec-like ability. So this is a case of Linux leveraging
> a feature architected for AIX.
Certainly AIX was in a more difficult position at the time, because they don't
have a kexec equivalent, and thus were collecting dump data with a potentially
faulty kernel. It makes sense to have something outside the partition collect or
maintain the data; ideally, some kind of service partition would extract dump
data from a failed partition, but giving one partition total access to the memory
of another is clearly risky. Both the PHYP-assistance method and the kexec
method are ways to simulate that without the risk.
At the risk of repeating what others have already said, the PHYP-assistance
method provides some advantages that the kexec method cannot:
- Availability of the system for production use before the dump data is
collected. As was mentioned before, some production systems may choose not to
operate with the limited memory initially available after the reboot, but it sure
is nice to provide the option.
- Ensuring that the devices are in a good state. PHYP doesn't expose a method
to force adapters into a frozen state, (which I agree would be useful), and I
don't know of any plans to do so. What we are starting to see is that some
drivers need modifications in order to work correctly with kdump . Supporting
PHYP-assisted dump would eliminate those issues.
- The small possibility that the kexec area could have been munged by the
failing kernel, preventing it from being able to collect a dump.
The NUMA issues are daunting, but not insurmountable. Release early, release
often, n'est-ce pas?
More information about the Linuxppc-dev