<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:12.0pt;color:black">From: </span></b><span style="font-size:12.0pt;color:black">openbmc <openbmc-bounces+vijaykhemka=fb.com@lists.ozlabs.org> on behalf of Nancy Yuen <yuenn@google.com><br>
<b>Date: </b>Thursday, May 7, 2020 at 12:47 PM<br>
<b>To: </b>Andrew Jeffery <andrew@aj.id.au><br>
<b>Cc: </b>OpenBMC Maillist <openbmc@lists.ozlabs.org><br>
<b>Subject: </b>Re: Multiple BMCs in a system: IPMB? Redfish? MCTP?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Mon, May 4, 2020 at 3:31 AM Andrew Jeffery <<a href="mailto:andrew@aj.id.au">andrew@aj.id.au</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal"><br>
<br>
On Thu, 30 Apr 2020, at 17:08, Deepak Kodihalli wrote:<br>
> On 30/04/20 4:21 am, Nancy Yuen wrote:<br>
> > I've talked with some people a while back (long while back) about <br>
> > multiple BMCs in a system. Either for redundancy or managing separate <br>
> > parts of a system. I'm wondering what other people are thinking in <br>
> > this area if at all.<br>
> > <br>
> > We are considering similar designs and I'm looking into options for <br>
> > BMC-BMC communications. Some BMCs may not be externally <br>
> > accessible. Here are some options that we've looked at:<br>
> > <br>
> > 1. i2c/IPMB<br>
> > 2. usbnet/Redfish<br>
> > 3. i2c/MCTP/PLDM or something else?<br>
> > 4. internal network via switch chip/Redfish or MCTP<br>
> > <br>
> > I'd like to reduce our use of IPMI so I want to avoid (1).<br>
> > <br>
> > ----------<br>
> > Nancy<br>
> <br>
> Hi Nancy,<br>
> <br>
> I think it depends on whether the BMCs need to talk to each other for <br>
> platform management, or if they manage their own hosts and we need one <br>
> of the BMCs to broadcast out of band requests and aggregate responses.<br>
> <br>
> For the former I think PLDM over MCTP could be a good fit. This is more <br>
> of an "inband" use-case in my opinion so I'm not sure if Redfish is well <br>
> suited. For the latter, a Redfish based aggregation is a good option.<br>
<br>
I think this looks like the right approach. Certainly some thought would be<br>
required in designing the MCTP networks given the (intentionally) limited<br>
number of endpoint IDs.<br>
<br>
Andrew<o:p></o:p></p>
</blockquote>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Hi Andrew, Deepak,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Sorry for the delayed response!<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">For the purposes of this discussion I have BMCs managing their own host: BMC3<--->BMC2<--->BMC1/controller<--> external. I wrote BMC1 but there maybe some other controller there that isn't strictly a BMC. BMC2 would be "passing through"
information between BMC1 and BMC3. But I don't necessarily want BMC2 to do any form of aggregation from information from BMC3. For BMC1/Controller and BMC 2 we are thinking Redfish. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">In my case I'm interested in what ways people are thinking BMC2 and BMC3 should be connected and speaking to each other. Is MCTP/PLDM where everyone is leaning?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Nancy,<o:p></o:p></p>
<p class="MsoNormal">What is connectivity between BMC1, BMC2 and BMC3. Are these exposing any out of band connections. For security reasons, aggregator should use inband connectivity between BMCs and as Deepak said MCTP is good option for inband.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</div>
</body>
</html>