gitsm and own-mirror lead to unhappiness

[Andrew Geissler]

On Tue, Feb 12, 2019 at 9:21 AM Patrick Venture <venture at google.com> wrote:
>
> Has anyone else run into this issue?
>
> openbmcbmc works fine when building zaius as phosphor:
>
> PREMIRRORS="bzr://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n cvs://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n git://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n gitsm://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n hg://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n osc://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n p4://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n svn://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n"
>
> when using a mirror via the own-mirror class it has (and fails):
>
> PREMIRRORS=" cvs://.*/.*
> file:///google/data/ro/teams/gbmc/mirror/sources/ \n svn://.*/.*
> file:///google/data/ro/teams/gbmc/mirror/sources/ \n git://.*/.*
> file:///google/data/ro/teams/gbmc/mirror/sources/ \n gitsm://.*/.*
> file:///google/data/ro/teams/gbmc/mirror/sources/ \n hg://.*/.*
> file:///google/data/ro/teams/gbmc/mirror/sources/ \n bzr://.*/.*
> file:///google/data/ro/teams/gbmc/mirror/sources/ \n p4://.*/.*
> file:///google/data/ro/teams/gbmc/mirror/sources/ \n osc://.*/.*
> file:///google/data/ro/teams/gbmc/mirror/sources/ \n https?\$://.*/.*
> file:///google/data/ro/teams/gbmc/mirror/sources/ \n ftp://.*/.*
> file:///google/data/ro/teams/gbmc/mirror/sources/ \n npm://.*/?.*
> file:///google/data/ro/teams/gbmc/mirror/sources/ \n bzr://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n cvs://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n git://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n gitsm://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n hg://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n osc://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n p4://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n svn://.*/.*
> http://downloads.yoctoproject.org/mirror/sources/ \n"
>
> Here's the error:
>
> ERROR: dbus-broker-16+gitAUTOINC+fc874afa09-r0 do_unpack: Fetcher
> failure: Fetch command export PSEUDO_DISABLED=1; export
> P4CONFIG=".p4config"; export
> DBUS_SESSION_BUS_ADDRESS="unix:abstract=/tmp/dbus-ikQVQidiXM,guid=017a369eba1bf971869460b55c475ed9";
> export SSH_AGENT_PID="64102"; export
> SSH_AUTH_SOCK="/tmp/ssh-lw8WN8I9mmbS/agent.63979"; export
> PATH="/usr/local/google/git/workspaces/building_rebase_failure/build/tmp/work/armv5e-openbmc-linux-gnueabi/dbus-broker/16+gitAUTOINC+fc874afa09-r0/recipe-sysroot-native/usr/bin/python3-native:/usr/local/google/git/workspaces/building_rebase_failure/scripts:/usr/local/google/git/workspaces/building_rebase_failure/build/tmp/work/armv5e-openbmc-linux-gnueabi/dbus-broker/16+gitAUTOINC+fc874afa09-r0/recipe-sysroot-native/usr/bin/arm-openbmc-linux-gnueabi:/usr/local/google/git/workspaces/building_rebase_failure/build/tmp/work/armv5e-openbmc-linux-gnueabi/dbus-broker/16+gitAUTOINC+fc874afa09-r0/recipe-sysroot/usr/bin/crossscripts:/usr/local/google/git/workspaces/building_rebase_failure/build/tmp/work/armv5e-openbmc-linux-gnueabi/dbus-broker/16+gitAUTOINC+fc874afa09-r0/recipe-sysroot-native/usr/sbin:/usr/local/google/git/workspaces/building_rebase_failure/build/tmp/work/armv5e-openbmc-linux-gnueabi/dbus-broker/16+gitAUTOINC+fc874afa09-r0/recipe-sysroot-native/usr/bin:/usr/local/google/git/workspaces/building_rebase_failure/build/tmp/work/armv5e-openbmc-linux-gnueabi/dbus-broker/16+gitAUTOINC+fc874afa09-r0/recipe-sysroot-native/sbin:/usr/local/google/git/workspaces/building_rebase_failure/build/tmp/work/armv5e-openbmc-linux-gnueabi/dbus-broker/16+gitAUTOINC+fc874afa09-r0/recipe-sysroot-native/bin:/usr/local/google/git/workspaces/building_rebase_failure/poky/bitbake/bin:/usr/local/google/git/workspaces/building_rebase_failure/build/tmp/hosttools";
> export HOME="/usr/local/google/home/venture"; cp -fpLR
> /usr/local/google/git/workspaces/building_rebase_failure/build/downloads/git2/github.com.bus1.dbus-broker/modules/subprojects/c-dvar
> /usr/local/google/git/workspaces/building_rebase_failure/build/tmp/work/armv5e-openbmc-linux-gnueabi/dbus-broker/16+gitAUTOINC+fc874afa09-r0/git/.git/modules/subprojects/c-dvar
> failed with exit code 1, output:
> cp: cannot stat
> '/usr/local/google/git/workspaces/building_rebase_failure/build/downloads/git2/github.com.bus1.dbus-broker/modules/subprojects/c-dvar/modules/subprojects/c-utf8':
> No such file or directory
>
> ERROR: dbus-broker-16+gitAUTOINC+fc874afa09-r0 do_unpack: Function
> failed: base_do_unpack
> ERROR: Logfile of failure stored in:
> /usr/local/google/git/workspaces/building_rebase_failure/build/tmp/work/armv5e-openbmc-linux-gnueabi/dbus-broker/16+gitAUTOINC+fc874afa09-r0/temp/log.do_unpack.86989
> ERROR: Task (/usr/local/google/git/workspaces/building_rebase_failure/meta-openembedded/meta-oe/recipes-core/dbus/dbus-broker_git.bb:do_unpack)
> failed with exit code '1'
> NOTE: Tasks Summary: Attempted 1317 tasks of which 0 didn't need to be
> rerun and 1 failed.

Yeah, we've seen this on a few of our builder machines and some
internal machines - https://github.com/openbmc/openbmc/issues/3480

Sometimes rebuilding a few times fixes it, but sometimes it's a hard
failure (builder4 is offline due to this).

Andrew

>
>
>
> Patrick