[Jenkins-infra] Datadog incorrectly reports Confluence is slow

Kohsuke Kawaguchi kk at kohsuke.org
Sat Apr 23 04:41:41 UTC 2016

I got a pagerduty alert from Datadog reporting that the HTTP monitor that's
hitting https://wiki.jenkins-ci.org/display/jenkins/Git%20plugin is failing.

After a bit of digging, I discovered that the following command reports 403

$ wget --debug -O /dev/null '

... while the following command does work

$ wget --debug --header 'User-Agent: xxx' -O /dev/null '

That is, somebody in the middle is checking user-agent and refusing to
serve wget based on User-Agent.

>From inside the box that runs Confluence, if I hit confluence-cache layer
directly, then wget works fine. So it has to be Apache that's terminating
443 on this box that's doing it.

I see that commit 675e4bdf added some scary looking user agent check, so
this could be it, though that change was made back in January, so it's bit
strange that it's backfiring now.

Since the site is functioning fine for regular users and we are all
exhausted, I've snoozed the monitoring for a day. I'll leave it up to Tyler
to decide if he wants to revert this change.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.jenkins-ci.org/pipermail/jenkins-infra/attachments/20160423/3ac9a00a/attachment.html>

More information about the Jenkins-infra mailing list