[Jenkins-infra] disk space paging is not actionable

R. Tyler Croy tyler at monkeypox.org
Mon May 9 15:52:22 UTC 2016


(replies inline)

On Sun, 08 May 2016, Arnaud H?ritier wrote:

> I just have the same one :-(
> 
> And no dashboard are clearly mentioning the origin of the issue
> 
> I had a look at servers but didn't find the culprit and now it was resolved
> by itself (perhaps a ci resource).



I've known about this issue but have figured it is on Datadog's side and
haven't bothered reporting it.

My workaround has been usually to look at the monitor page itself (e.g.
<https://app.datadoghq.com/monitors#274883?group=all&live=4h>) and look at the
honeycomb of "affected hosts" to spot the culprit. It's almost always celery :-P


Anyways, I couldn't, via manual inspection of machines, identify the culprit
yesterday so I muted the monitor temporarily until today at which time I could
look more closely.


Sorry about the pager spam, it is quite annoying.



> On Sun, May 8, 2016 at 6:54 AM, Kohsuke Kawaguchi <kk at kohsuke.org> wrote:
> 
> > I just got paged that the disk space is below 1GB, but neither the alert
> > or the monitor view on Datadog shows which host & volume the alert is
> > firing for. This is not actionable.
> >
> > Looking at the configuration, {{host.name}} is meant to expand to the
> > host name in question, but clearly not such expansion is happening.
> >
> > _______________________________________________
> > Jenkins-infra mailing list
> > Jenkins-infra at lists.jenkins-ci.org
> > http://lists.jenkins-ci.org/mailman/listinfo/jenkins-infra
> >
> >


- R. Tyler Croy

------------------------------------------------------
     Code: <https://github.com/rtyler>
  Chatter: <https://twitter.com/agentdero>

  % gpg --keyserver keys.gnupg.net --recv-key 3F51E16F
------------------------------------------------------
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 181 bytes
Desc: Digital signature
URL: <http://lists.jenkins-ci.org/pipermail/jenkins-infra/attachments/20160509/238660d2/attachment.asc>


More information about the Jenkins-infra mailing list