[Patchwork-maintainers] patchwork.ozlabs.org downtime for maintenance - 15/16 August

[Jeremy Kerr]

Hi Rob,

(adding Ilya, who has done some very handy logging too)

> I have a job that runs every 20min checking PW. I added timestamps
> and
> here's all the 503 failures in the last 22 hours:
> 
> Wed Jan 17 10:12:29 AM CST 2024
> Wed Jan 17 12:16:38 PM CST 2024
> Wed Jan 17 01:37:01 PM CST 2024
> Wed Jan 17 03:00:23 PM CST 2024
> Wed Jan 17 03:43:04 PM CST 2024
> Wed Jan 17 11:52:18 PM CST 2024
> Thu Jan 18 12:32:38 AM CST 2024
> Thu Jan 18 02:33:54 AM CST 2024
> Thu Jan 18 03:34:50 AM CST 2024
> Thu Jan 18 06:20:40 AM CST 2024
> Thu Jan 18 06:40:57 AM CST 2024
> 
> Looks pretty much spread out except 4PM-11PM my time didn't have any
> failures.

Thanks for that - good to know!

Ilya: your timestamps - are they in UTC or local?

>  Must be the Europeans causing problems. ;)

I blame you all being north of the equator :D

Your data seems pretty consistent with what Ilya had found - spread out
through the day rather than just during backups.

It looks like the request load has increased enough to need tuning of
the application server's backlog queue. I'll do some adjustments to
that, but it does need to be a little careful in that we don't just
punt the problem somewhere else.

I'll try and get to that over the weekend.

Cheers,


Jeremy