[RFC] Add IBM Blue Gene/Q Platform

Jimi Xenidis jimix at pobox.com
Tue Dec 11 08:32:16 EST 2012 

On Dec 7, 2012, at 8:31 AM, Andrew Tauferner <ataufer at us.ibm.com> wrote:

> Jimi,
> 
> > > Do you actually want this upstream?  I assume no.
> > 
> > I needed to get these long-term patches out there for the BGQ 
> > community for test.
> 
> To which BGQ community are you referring?

This work is being done by IBM Research (me) and made possible by the US-DOE via:
  <https://sites.google.com/site/foxxstack/project-updates>

>  What is the motivation for this work?

Maintain a modern kernel that has a "reasonable" set of patches that, with the much appreciated feedback from the Linux community, _could_ go upstream.

> 
> > I would very much like to get a version of these upstream.
> > I expect only the QPX, kexec, and (maybe) the DCR changes to cause 
> > any controversy, but I've been wrong before.
> 
> Hehe.  Ben had a variety of issues with the BG/Q firmware when he 
> gave me some feedback a few years ago.

Yup, I think I have addressed these issues.

> 
> > I'll be making those patches soon and hope to get a lot of feedback 
> > from these patches.
> 
> What was the starting point for this work?  On what is it based?

  <https://repo.anl-external.org/viewvc/bgq-driver/V1R1M2/?sortdir=down>>

-jx


> 
> > -jx
> > 
> > 
> > > 
> > > Mikey
> > > 
> > >> 
> > >> Here is a are the summary logs:
> > >> 
> > >> $ git log --reverse linux-stable/linux-3.4.y..
> > >> commit 5a8edb2bdd914597693eed299119ff4c2e6d31f2
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Fri Nov 9 09:26:00 2012 -0600
> > >> 
> > >>    powerpc: Fix cputable #ifdef where CONFIG_PPC_A2 is used for 
> > CONFIG_PPC_BOOK3E_64
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit ea51920d7035c8d23801d6de46261e7d0a537dfd
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Fri Nov 9 08:58:27 2012 -0600
> > >> 
> > >>    powerpc/book3e: Remove config for PPC_A2_DD2 since there is no
> > reference to it
> > >> 
> > >>    This must have been leftover from early DD1 days which is not
> > >>    present in any current kernel code.
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit 08151401a5db4ff0d441a1b7bf8ad92bd92b14c5
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Mon Nov 5 09:38:01 2012 -0600
> > >> 
> > >>    powerpc/dcr: Some native DCR fixes
> > >> 
> > >>    The following fixes have been made:
> > >>     - dcr_read/write_native() must use the indexed version of the
> > >>       m[ft]dcrx since the non-indexed version only allows a 10-bit
> > >>       numerical space, but the C interface allows a full 32-bits.
> > >>     - C bindings for m[ft]dcrx, and the "table" versions, should use
> > >>       "unsigned long" so that they are 64/32 bit neutral.
> > >>     - The "table" versions (__m[ft]cdr) should obtain the table address
> > >>       with LOAD_REG_ADDR(), this will also make it 64/32bit neutral.
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit c8320a5daaceed03992d763302020834ea8e17dd
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Mon Nov 5 09:12:00 2012 -0600
> > >> 
> > >>    powerpc/dcr: Add 64-bit DCR access methods.
> > >> 
> > >>    This patch adds the ability to make 64-bit Device Control Register
> > >>    (DCR) accesses.
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit a763b3f8453b3bd83d7dded8c6644939863af430
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Thu Nov 29 12:49:24 2012 -0500
> > >> 
> > >>    powerpc/boot: Add a "spin_threads" hook to platform_ops
> > >> 
> > >>    It is useful for the boot program to arrange for all secondary cpus
> > >>    and threads to enter the kernel in a "kexec" fashion.  This hook makes
> > >>    it possible.
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit 391e43393380b514d4d02a42d059619542c7597b
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Thu Nov 29 13:01:23 2012 -0500
> > >> 
> > >>    powerpc/kexec: Add kexec "hold" support for Book3e processors
> > >> 
> > >>    This patch add two items:
> > >>    1) Book3e requires that GPR4 survive the "hold" process, so we make
> > >>       sure that happens.
> > >>    2) Book3e has no real mode, and the hold code exploits this.  Since
> > >>       these processors ares always translated, we arrange for the kexeced
> > >>       threads to enter the hold code using the normal kernel 
> > linear mapping.
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit f6e3c1f706cb6922349d639a74ff6c50acc8b9f8
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Wed Dec 5 13:41:25 2012 -0500
> > >> 
> > >>    powerpc: Remove unecessary VSX symbols
> > >> 
> > >>    The symbol THREAD_VSR0 is defined to be the same as THREAD_FPR0.  Its
> > >>    presence causes build issues with more complex configurations.
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit 4e817bb42ec8e3d3689877528dd97c4286a870eb
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Tue Nov 20 10:10:52 2012 -0600
> > >> 
> > >>    Blue Gene/Q wicked optimizing compiler does not know the rfdi 
> > instruction yet
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit 2071aa58b2f3b33d97c94e3a127f7c5d4ffaeb34
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Tue Nov 20 10:14:22 2012 -0600
> > >> 
> > >>    Blue Gene/Q wicked optimizing compiler does not know the 
> > mfdcrx instruction yet
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit 6e58088fabedbb2d724637b539ba180c03ed8b68
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Wed Oct 31 16:33:21 2012 -0500
> > >> 
> > >>    powerpc/book3e: IBM Blue Gene/Q Boot
> > >> 
> > >>    This patch specifically deals with the initial program load
> > >>    environment so that a boot image (dtbImage.bgq) can be loaded by the
> > >>    BGQ management tools.  The boot code is a little odd because it has to
> > >>    deal with the following issues:
> > >>     - Linux boot image wrappers are 32-bit programs
> > >>     - BGQ Tools only load 64bit ELF programs
> > >>     - BGQ Firmware information is typically loaded at an address > 4G
> > >>     - BGQ FW information contains 64-bit ABI function pointers (which are
> > >>       actually function descriptors) to access firmware methods
> > >>     - BGQ FW methods must be called in 64-bit mode
> > >> 
> > >>    Includes code contributed from:
> > >>      Andrew Tauferner <ataufer at us.ibm.com>
> > >>      Todd Inglett <tinglett at us.ibm.com>
> > >>      Eric Van Hensbergen <ericvh at gmail.com>
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit 3bc841935eb4955ce2b2db69bff16f7928464597
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Wed Oct 31 22:36:54 2012 -0500
> > >> 
> > >>    powerpc/book3e: IBM Blue Gene/Q Platform and SMP
> > >> 
> > >>    This patch introduces BGQ as a platform and adds SMP functionality
> > >> 
> > >>    Includes code contributed from:
> > >>      Andrew Tauferner <ataufer at us.ibm.com>
> > >>      Todd Inglett <tinglett at us.ibm.com>
> > >>      Eric Van Hensbergen <ericvh at gmail.com>
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit 279c0615917b959a652e81f4ad0d886e2d426d85
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Wed Dec 5 13:43:22 2012 -0500
> > >> 
> > >>    powerpc/book3e: IBM Blue Gene/Q Quad Processing eXtention (QPX)
> > >> 
> > >>    This enables kernel support for the QPX extention and is intended for
> > >>    processors that support it, usually an IBM Blue Gene processor.
> > >>    Turning it on does not effect other processors but it does add code
> > >>    and will quadruple the per thread save and restore area for the FPU
> > >>    (hense the name).  If you have enabled VSX it will only double the
> > >>    space.
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit 6ff45170ab0463fb34d7011e08c7e47c396f0fd7
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Fri Nov 23 14:52:14 2012 -0600
> > >> 
> > >>    powerpc/book3e: IBM Blue Gene/Q HVC Based Firmware Console
> > >> 
> > >>    New HVC device that uses the Blue Gene Firmware methods to erad and
> > >>    write to console.
> > >> 
> > >>        Includes code contributed from:
> > >>          Andrew Tauferner <ataufer at us.ibm.com>
> > >>          Todd Inglett <tinglett at us.ibm.com>
> > >>          Eric Van Hensbergen <ericvh at gmail.com>
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit e4ddc0c2ad8b3f0260d15d73e153095e95da84ac
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Thu Nov 29 15:52:04 2012 -0500
> > >> 
> > >>    powerpc/book3e: IBM Blue Gene/Q PCIe and MSI
> > >> 
> > >>    The following patch adds support for the BG/Q PCIe bridge and 
> > MSI interrupts.
> > >> 
> > >>    Includes code contributed from:
> > >>      Jay S. Bryant <jsbryant at us.ibm.com>
> > >>      Eric Van Hensbergen <ericvh at gmail.com>
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit 9fc0b6f729f7bd7e31338283640a718fa4b1693b
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Wed Dec 5 07:01:49 2012 -0500
> > >> 
> > >>    powerpc/book3e: IBM Blue Gene/Q Character Drivers
> > >> 
> > >>    The following patch adds support for user and administration
> > >>    applications to access the BG/Q control system.
> > >> 
> > >>    Includes code contributed from:
> > >>      Jay S. Bryant <jsbryant at us.ibm.com>
> > >>      Eric Van Hensbergen <ericvh at gmail.com>
> > >> 
> > >>    Signed-off-by: Jimi Xenidis <jimix at pobox.com>
> > >> 
> > >> commit 9df2c4dfde0ac75f8b2bfcf565f78c2b7382b031
> > >> Author: Jimi Xenidis <jimix at pobox.com>
> > >> Date:   Thu Dec 6 18:07:16 2012 -0500
> > >> 
> > >>    Linux 3.4.22-BGQ-rc1
> > >> 
> > >> 
> > >> 
> > >> 
> > >> _______________________________________________
> > >> Linuxppc-dev mailing list
> > >> Linuxppc-dev at lists.ozlabs.org
> > >> https://lists.ozlabs.org/listinfo/linuxppc-dev
> > >> 
> > 
>

More information about the Linuxppc-dev mailing list