[PATCH v4 0/11] EEH Followup Fixes (II)

Gavin Shan shangw at linux.vnet.ibm.com
Wed Jul 24 12:24:50 EST 2013


The series of patches bases on linux-poerpc-next initially and intends to resolve
the following problems:
 
	- On pSeries platform, the EEH doesn't work after PHB hotplug
	  with "drmgr". The root cause is that the EEH resources (
	  EEH devices, EEH caches) aren't released correctly. For the
	  problem, we add one hook (pcibios_stop_dev), which is called
	  on pci_stop_and_remove_device(). In pcibios_stop_dev(), we
	  release the EEH resources.
	- Another issue is that we need put the domain (PE or PHB) into
	  quite state while doing reset on that domain. However, some
	  deivces in the domain might not have EEH sensitive drivers, or
	  even don't have driver. Those deivces can't be put into quite
	  state and possibly keep issuing PCI-CFG or MMIO request during
	  resetting the domain. That possibly causes the failure of reset
	  and eventually failure of EEH recovery. For the issue, we introduces
	  so-called "partial hotplug". That means, those devices without driver or
	  without EEH sensitive driver are removed before doing reset, and
	  plugged (probed) into the system after reset.
	- We need traverse EEH devices of one specific PE with safe variant
	  of list tranverse function. The EEH device might be removed while
	  doing iteration.
	- When doing plug for PCI bus, we need check if we need reassign the
	  resources for subordinate devices (PCI_REASSIGN_ALL_RSRC) and do that
	  accordingly.

The patchset is verified on pSeires and PowerNV platforms:

pSeries Platform:

drmgr -c phb -r -s "PHB 513"
drmgr -c phb -a -s "PHB 513"
errinjct eeh -f 1 -s net/eth2

PowerNV Platform:

cd /sys/devices/pci0005:00/0005:00:00.0/0005:01:00.0/0005:02:08.0/0005:80:00.0/0005:90:01.0
while true; do od -x config > /dev/null; sleep 1; done
echo 1 > /sys/kernel/debug/powerpc/PCI0005/err_injct

---

v3 -> v4:
	* Add some comments to explain why we needn't check the return
	  value of pci_scan_slot() in pcibios_add_pci_devices().
	* Check PCI_PROBE_ONLY while assigning those unassigned resources
	  in pcibios_finish_adding_to_bus().
v2 -> v3:
	* Make pcibios_add_pci_devices() to support "partial" hotplug
	  according to Ben's comments. arch/powerpc/kernel/pci_of_scan.c
	  has been adjusted for that.
	* Use pcibios_add_pci_devices() to do "partial" hotplug inside
	  eeh_reset_device().
	* Introduce flag EEH_DEV_SYSFS to trace the state of sysfs entries
	  of the EEH device (then PCI device) to avoid race condition during
	  "partial" hotplug.
v1 -> v2:
	* Rebase to 3.11.rc1 in order to use pcibios_release_device().
	* Use pcibios_release_device() to release EEH cache and detach
	  EEH device from PCI device.
	* Remove reference to PCI device in EEH cache since we're relying
	  on pcibios_release_device().
	* PCI device instance (struct pci_dev) isn't available during BAR
	  restore and avoid use the instance that time.
	* Fix unbalanced enable for IRQ in eeh_driver.c
	* Retest the series of patches on Firebird-L/VPL3/VPL4

---

arch/powerpc/include/asm/eeh.h               |   30 ++++++++--
arch/powerpc/include/asm/pci-bridge.h        |    1 -
arch/powerpc/kernel/eeh.c                    |   70 +++++++++++------------
arch/powerpc/kernel/eeh_cache.c              |   18 ++----
arch/powerpc/kernel/eeh_driver.c             |   77 +++++++++++++++++++++++++-
arch/powerpc/kernel/eeh_pe.c                 |   58 ++++++++-----------
arch/powerpc/kernel/eeh_sysfs.c              |   21 +++++++
arch/powerpc/kernel/pci-common.c             |    2 +
arch/powerpc/kernel/pci-hotplug.c            |   49 ++++++++--------
arch/powerpc/kernel/pci_of_scan.c            |   56 +++++++++++++-----
arch/powerpc/platforms/powernv/eeh-powernv.c |   17 +++++-
arch/powerpc/platforms/pseries/eeh_pseries.c |   67 +++++++++++++++++++++-
drivers/pci/hotplug/rpadlpar_core.c          |    1 -
13 files changed, 327 insertions(+), 140 deletions(-)

Thanks,
Gavin



More information about the Linuxppc-dev mailing list