<html><body><p><font size="2">Great. I am available from 10am Central Time US ( -5 UTC ) to 3pm on Tuesday July 2. I can set up a webex or you can use what works for you . </font><br><font size="2"><br><br><br><br>Edgar R. Cordero<br>Senior Technical Staff Member<br>IBM Systems<br>ecordero@us.ibm.com<br>(512) 286-5788 (t/l 363-5788)<br></font><br><br><img width="16" height="16" src="cid:1__=09BB0EB9DFC17B1E8f9e8a93df938690918c09B@" border="0" alt="Inactive hide details for Alexandre Ghiti ---06/28/2019 10:32:46 AM---Le ven. 28 juin 2019 à 16:58, Edgar Cordero <ecordero@us."><font size="2" color="#424282">Alexandre Ghiti ---06/28/2019 10:32:46 AM---Le ven. 28 juin 2019 à 16:58, Edgar Cordero <ecordero@us.ibm.com> a écrit : > I have a few things yo</font><br><br><font size="2" color="#5F5F5F">From: </font><font size="2">Alexandre Ghiti <aghiti@upmem.com></font><br><font size="2" color="#5F5F5F">To: </font><font size="2">Edgar Cordero <ecordero@us.ibm.com></font><br><font size="2" color="#5F5F5F">Cc: </font><font size="2">"Oliver O'Halloran" <oohall@gmail.com>, skiboot list <skiboot@lists.ozlabs.org></font><br><font size="2" color="#5F5F5F">Date: </font><font size="2">06/28/2019 10:32 AM</font><br><font size="2" color="#5F5F5F">Subject: </font><font size="2">[EXTERNAL] Re: Re: [Skiboot] DDR4 Calibration and address inversion</font><br><hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br><br><br><font size="2">Le ven. 28 juin 2019 à 16:58, Edgar Cordero <</font><a href="mailto:ecordero@us.ibm.com" target="_blank"><u><font size="2" color="#0000FF">ecordero@us.ibm.com</font></u></a><font size="2">> a écrit :</font><ul><font size="2">I have a few things you could look at at. Can you reach out to me? One thing I would like to know is the manufacturer of the buffers on your DIMMs as well as when you pulled the the firmware procedures. We had an issue we know about and I think you might have gotten caught in it. <br></font></ul><br>Hi Edgar,<br><br>Our hostboot is a fork from raptorcs team: their remote is <a href="https://scm.raptorcs.com/scm/git/talos-hostboot" target="_blank"><u><font color="#0000FF">https://scm.raptorcs.com/scm/git/talos-hostboot</font></u></a> and the commit e36ec63e58344f854317e79d060f2ab9108103c2, which is kind of outdated (last commit is April 2018).<br>Our RDIMM RCD is an IDT 4RCD0124KC0ATG.<br><br>We can arrange an hangout call or whatever whenever you are available.<br><br>Thanks for your support,<br><br>Alex<br>
<ul><font size="2"><br><br><br>Edgar R. Cordero<br>Senior Technical Staff Member<br>IBM Systems</font><u><font size="2" color="#0000FF"><br></font></u><a href="mailto:ecordero@us.ibm.com" target="_blank"><u><font size="2" color="#0000FF">ecordero@us.ibm.com</font></u></a><font size="2"><br>(512) 286-5788 (t/l 363-5788)</font><br><br><br><img src="cid:1__=09BB0EB9DFC17B1E8f9e8a93df938690918c09B@" width="16" height="16" alt="Inactive hide details for Alexandre Ghiti ---06/28/2019 12:25:33 AM---Le jeu. 27 juin 2019 à 20:05, Oliver O'Halloran <oohall@g"><font size="2" color="#424282">Alexandre Ghiti ---06/28/2019 12:25:33 AM---Le jeu. 27 juin 2019 à 20:05, Oliver O'Halloran <</font><a href="mailto:oohall@gmail.com" target="_blank"><u><font size="2" color="#0000FF">oohall@gmail.com</font></u></a><font size="2" color="#424282">> a écrit : > On Thu, Jun 27, 2019</font><br><font size="2" color="#5F5F5F"><br>From: </font><font size="2">Alexandre Ghiti <</font><a href="mailto:aghiti@upmem.com" target="_blank"><u><font size="2" color="#0000FF">aghiti@upmem.com</font></u></a><font size="2">></font><font size="2" color="#5F5F5F"><br>To: </font><font size="2">"Oliver O'Halloran" <</font><a href="mailto:oohall@gmail.com" target="_blank"><u><font size="2" color="#0000FF">oohall@gmail.com</font></u></a><font size="2">></font><font size="2" color="#5F5F5F"><br>Cc: </font><font size="2">skiboot list <</font><a href="mailto:skiboot@lists.ozlabs.org" target="_blank"><u><font size="2" color="#0000FF">skiboot@lists.ozlabs.org</font></u></a><font size="2">>, </font><a href="mailto:ecordero@us.ibm.com" target="_blank"><u><font size="2" color="#0000FF">ecordero@us.ibm.com</font></u></a><font size="2" color="#5F5F5F"><br>Date: </font><font size="2">06/28/2019 12:25 AM</font><font size="2" color="#5F5F5F"><br>Subject: </font><font size="2">[EXTERNAL] Re: [Skiboot] DDR4 Calibration and address inversion</font><br><hr width="100%" size="2" align="left" noshade><br><br><br><br>Le jeu. 27 juin 2019 à 20:05, Oliver O'Halloran <<a href="mailto:oohall@gmail.com" target="_blank"><u><font color="#0000FF">oohall@gmail.com</font></u></a>> a écrit :
<ul><ul>On Thu, Jun 27, 2019 at 10:00 PM Alexandre Ghiti <<a href="mailto:aghiti@upmem.com" target="_blank"><u><font color="#0000FF">aghiti@upmem.com</font></u></a>> wrote:<br>><br>> Le jeu. 27 juin 2019 à 12:38, Oliver O'Halloran <<a href="mailto:oohall@gmail.com" target="_blank"><u><font color="#0000FF">oohall@gmail.com</font></u></a>> a écrit :<br>>><br>>> On Thu, Jun 27, 2019 at 7:54 PM Alexandre Ghiti <<a href="mailto:aghiti@upmem.com" target="_blank"><u><font color="#0000FF">aghiti@upmem.com</font></u></a>> wrote:<br>>> ><br>>> > Hi everyone,<br>>> ><br>>> > We are currently testing our RDIMM in a Talos server which runs custom hostboot/skiboot from RaptorCS team.<br>>> > Our RDIMM (single-rank) is 'rejected' during calibration as half the DRAMs fail the DQS alignment step. We know, for some internal reasons, that if this step tries to access the DRAMs with BG1=1, it will fail, which will happen if address inversion is enabled (see RCD jedec JESD82-31 section 2.9): so half the failing DRAMs would represent the side-b.<br>>> ><br>>> > I did not succeed to disable address inversion, certainly because the piece of HW that does the actual calibration supposes the address inversion is activated and then invert the corresponding bits to prevent RCD inversion.<br>>> ><br>>> > My questions are:<br>>> > - Is the CCS responsible for executing the calibrations ?<br>>> > - Is there anyway to modify its behaviour ? (I don't think the calibration steps are purely HW...)<br>>> ><br>>> > Thanks for your answers, and if this is not the place to discuss such things, please do not hesitate to say so.<br>>><br>>> We don't mind hearing about this sort of thing, but it's very outside<br>>> our area of expertise. Memory training is handled by the hardware<br>>> procedures in hostboot, but it sounds like you've already tried to<br>>> fiddle with the stuff in src/import/chips/p9/procedures/hwp/memory<br>>> without luck? I'll see if I can find someone who might have more of a<br>>> clue.<br>><br>><br>><br>> Yes, I know that the memory training happens in the function p9_mss_draminit_training.<br>><br>> From my understanding, it is done by setting the register DDRPHY_PC_INIT_CAL_CONFIG0_P0 (Power9<br>> Processor Registers Specification, Volume 3) with the calibration steps we want to do.<br>><br>> Then, those steps are indeed executed by setting the field CCS_INST_ARR1_00_DDR_CALIBRATION_ENABLE<br>> of MC01.MCBIST.CCS.CCS_INST_ARR1_00 register. So to me it seems those steps are entirely HW.<br>><br>> Note that we do not have a Centaur platform, our processor is the Nimbus version.<br>><br>> Thanks again for your quick answer,<br>><br>> Alex<br><br>I asked around and Edgar (+cc) from the memory team said he might be<br>able to help. He does have some questions for you though.</ul></ul><br>Great, whatever he needs :)<br>Thanks Oliver,<br><br>Alex<br>
<ul><ul><br>Oliver<br></ul></ul><br><br></ul><BR>
</body></html>