<div dir="ltr">Do you happen to be using aarch64?</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Sep 7, 2023 at 12:52 PM Chhabra, DipinderSingh <<a href="mailto:Dipinder.Chhabra@dell.com">Dipinder.Chhabra@dell.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="msg7272394838860437669">
<div lang="EN-US" style="overflow-wrap: break-word;">
<div class="m_7272394838860437669WordSection1">
<p class="MsoNormal">Hi There<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Recently we updated our OpenBMC distro to tag 2.14.0 (phosphor-network SRCREV f78a415e154bac274e1d07ce8128c69e9d1cd710).<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Since then we are seeing that the phosphor-network service crashes after configuration change due to SIGBUS.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<pre><span style="color:black">Sep 07 09:51:45 bmc phosphor-network-manager[627]: Wrote networkd file: /etc/systemd/network/00-bmc-end1.network<u></u><u></u></span></pre>
<pre><span style="color:black">Sep 07 09:51:45 bmc phosphor-network-manager[627]: Wrote networkd file: /etc/systemd/network/00-bmc-end0.network<u></u><u></u></span></pre>
<pre><span style="color:black">Sep 07 09:51:49 bmc systemd[1]: xyz.openbmc_project.Network.service: Main process exited, code=dumped, status=7/BUS<u></u><u></u></span></pre>
<pre><span style="color:black">Sep 07 09:51:49 bmc systemd[1]: xyz.openbmc_project.Network.service: Failed with result 'core-dump'.<u></u><u></u></span></pre>
<pre><span style="color:black">Sep 07 09:51:49 bmc systemd[1]: xyz.openbmc_project.Network.service: Consumed 1.365s CPU time.<u></u><u></u></span></pre>
<pre><span style="color:black">Sep 07 09:51:50 bmc systemd[1]: xyz.openbmc_project.Network.service: Scheduled restart job, restart counter is at 1.<u></u><u></u></span></pre>
<pre><span style="color:black">Sep 07 09:51:50 bmc systemd[1]: Stopped Phosphor Network Manager.<u></u><u></u></span></pre>
<pre><span style="color:black">Sep 07 09:51:50 bmc systemd[1]: xyz.openbmc_project.Network.service: Consumed 1.365s CPU time.<u></u><u></u></span></pre>
<pre><span style="color:black">Sep 07 09:51:50 bmc systemd[1]: Starting Phosphor Network Manager...<u></u><u></u></span></pre>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Based on my debugging, I can confirm that the timer gets scheduled correctly after the config write and the registered call back does get invoked. The crash happens due to the below dbus call in network_manager.cpp.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New""> try<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New""> {<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New""> bus.get()<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New""> .new_method_call("org.freedesktop.network1",<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New""> "/org/freedesktop/network1",<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New""> "org.freedesktop.network1.Manager", "Reload")<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">
<span style="background:yellow">.call();</span><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New""> lg2::info("Reloaded systemd-networkd");<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New""> }<u></u><u></u></span></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I have looked into any fixes to this in the later commits but do not find any.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I also tried to change it to call_noreply but that does not help and get the same BUS error.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<pre><span style="color:black"> try<u></u><u></u></span></pre>
<pre><span style="color:black"> {<u></u><u></u></span></pre>
<pre><span style="color:black"> lg2::info("Try systemd-networkd reload...");<u></u><u></u></span></pre>
<pre><span style="color:black"> auto method = bus.get().new_method_call(NETWORKD_BUSNAME, NETWORKD_PATH,<u></u><u></u></span></pre>
<pre><span style="color:black"> NETWORKD_INTERFACE, "Reload");<u></u><u></u></span></pre>
<pre><span style="color:black"> bus.get().call_noreply(method);<u></u><u></u></span></pre>
<pre><span style="color:black"> lg2::info("Reloaded systemd-networkd");<u></u><u></u></span></pre>
<pre><span style="color:black"> }<u></u><u></u></span></pre>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">When I manually invoke this from the shell that seems to go fine.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<pre><span style="color:black">root@bmc:~# busctl call org.freedesktop.network1 /org/freedesktop/network1 org.freedesktop.network1.Manager Reload <u></u><u></u></span></pre>
<pre><span style="color:black">root@bmc:~# echo $?<u></u><u></u></span></pre>
<pre><span style="color:black">0<u></u><u></u></span></pre>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Anyone else seeing this issue with phosphor-network or any idea why this could be happening?<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Thanks<u></u><u></u></p>
<p class="MsoNormal">Dip<u></u><u></u></p>
<br>
<p align="Left" style="margin:0px"><span style="font-size:7pt;font-family:Calibri;color:rgb(115,115,115)">Internal Use - Confidential</span></p>
</div>
</div>
</div></blockquote></div>