Phosphor inventory random failure and generating file names with weird characters?

[Kun Yi]

Hello friends,

I'm seeing a weird error and need your help. Basically I saw two symptoms
that may or may not be related, and seems no one has reported them yet in
Github issues. The BMC software stack is based on 2.6 release.

1. With repeated BMC reboot occasionally obmc-read-eeprom will fail to get
the result from a mapper DBus call:

$ systemctl status obmc-read-eeprom at system-chassis-motherboard.service

Mar 07 21:36:04  systemd[1]: Starting Read system/chassis/motherboard
EEPROM...
Mar 07 21:36:06  phosphor-read-eeprom[2598]: FRU Data
Mar 07 21:36:06  phosphor-read-eeprom[2598]: Successfully verified area.
Mar 07 21:36:06  phosphor-read-eeprom[2598]: Populated FRU areas
Mar 07 21:36:13  phosphor-read-eeprom[2598]:
[[0;1;31m[[0;1;39m[[0;1;31mException from sdbus call[[0m
Mar 07 21:36:13  phosphor-read-eeprom[2598]: sd_bus_call:
org.freedesktop.DBus.Error.FileNotFound: path or object not found
Mar 07 21:36:13  phosphor-read-eeprom[2598]:
[[0;1;31m[[0;1;39m[[0;1;31mError updating inventory.[[0m
Mar 07 21:36:13  systemd[1]:
[[0;1;39m[[0;1;31m[[0;1;39mobmc-read-eeprom at system-chassis-motherboard.service:
Main process exit
ed, code=exited, status=1/FAILURE[[0m

this is a call to mapper "GetObject sas /xyz/openbmc_project/inventory 1
xyz.openbmc_project.Inventory.Manager". However both the mapper and
inventory manager seem to run fine, and
mapper-wait-xyz.openbmc_project.Inventory.Manager exits correctly
before obmc-read-eeprom is started.

At this point, I'm not sure whether it's a problem with the object mapper,
inventory manager, or something else.

2. Upon closer inspection, the system has had many weird filenames in its
RW partition where the inventory serialization data is stored:

/var/lib/phosphor-inventory-manager/xyz/openbmc_project/inventory/system:
drwxr-xr-x    3 root     root             0 Mar  8 00:38 chassis
-rw-r--r--    1 root     root            81 Mar  8 00:38
xyz.openOby?:w=?xyz.Invebmc_?8?$xyz.tor.AssetTag
-rw-r--r--    1 root     root            81 Mar 21 03:17
xyz.openbmc_project.Inventory.Decorator.AssetTag
-rw-r--r--    1 root     root            81 Mar 20 23:29
xyz.openbmc_projxyz.Inventory.Deect.tor.AssetTag
-rw-r--r--    1 root     root            81 Mar 20 17:44
xyz.openbmc_projxyz.Inventory.Dexyz.tor.AssetTag
-rw-r--r--    1 root     root            81 Mar  8 00:38
xyz.openbmc_????xyz.Inventor???{xyz.tor.AssetTag
-rw-r--r--    1 root     root            81 Mar  8 00:38
xyz.open???t's??xyz.Invebmc_?7V?xyz.tor.AssetTag

/var/lib/phosphor-inventory-manager/xyz/openbmc_project/inventory/system/chassis:
drwxr-xr-x    2 root     root             0 Mar 20 21:35 motherboard

/var/lib/phosphor-inventory-manager/xyz/openbmc_project/inventory/system/chassis/motherboard:
-rw-r--r--    1 root     root           223 Mar  8 00:38
xyz.open6????d?!xyz.Invebmc_y??mxyz.tor.Asset
-rw-r--r--    1 root     root           223 Mar  8 00:38
xyz.openEyU?4]#?xyz.Inve???????Oxyz.tor.Asset
-rw-r--r--    1 root     root           223 Mar 20 21:42
xyz.openbmc_project.Inventory.Decorator.Asset
-rw-r--r--    1 root     root           113 Mar 20 21:42
xyz.openbmc_project.Inventory.Item
-rw-r--r--    1 root     root           223 Mar 20 17:45
xyz.openbmc_projxyz.Inventory.Deect.tor.Asset
-rw-r--r--    1 root     root           223 Mar 20 23:29
xyz.open????y??mxyz.Invebmc_project.tor.Asset
-rw-r--r--    1 root     root           223 Mar  8 00:38
xyz.open??N6m???xyz.Inve?n{??FT?xyz.tor.Asset

Is this expected? I deleted the directory for serialized data and rebooted
the BMC, and it only generates one item with valid names.

Any suggestions on how to debug these? I will convert these to Github
issues and append my findings if any.

-- 
Regards,
Kun
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ozlabs.org/pipermail/openbmc/attachments/20190321/bb0d8811/attachment.htm>