[Jenkins-infra] (fwd) (fwd) Re: Re: Increasing rate-limit for autnenticated activity on busy/large (jenkinsci) org

Andrew Bayer andrew.bayer at gmail.com
Thu Dec 8 17:09:29 UTC 2016


The close-to-done work Stephen Connolly's been doing on
github-branch-source apparently drops the API usage by something near an
order of magnitude, which, needless to say, should help. =)

A.

On Thu, Dec 8, 2016 at 9:05 AM, R. Tyler Croy <tyler at monkeypox.org> wrote:

>
> GRUMBLEGRUMBLEGRUMBLE
>
> ----- Forwarded message from Ivan ??u??ak <support at github.com> -----
>
> Date: Thu, 08 Dec 2016 01:24:18 -0800
> From: Ivan ??u??ak <support at github.com>
> To: "R. Tyler Croy" <tyler at monkeypox.org>
> Subject: Re: Re: Increasing rate-limit for autnenticated activity on
> busy/large (jenkinsci) org
> Message-ID: <discussions/a294f398bce711e68219709904fc93cc/comments/
> 3427963 at github.com>
>
> Hello again, Tyler. Sure thing -- here are the stats for the past week:
>
> Top routes:
>
> /repositories/:repository_id/collaborators      43,669  33.348%
> /repositories/:repository_id    21,349  16.303%
> /repositories/:repository_id/contents/?*        17,410  13.295%
> /repositories/:repository_id/statuses/:sha      13,757  10.506%
> /repositories/:repository_id/pulls/:id  10,828  8.269%
> /repositories/:repository_id/git/refs/* 6,582   5.026%
> /user   5,720   4.368%
> /       5,668   4.328%
> /repositories/:repository_id/pulls      1,647   1.258%
> /repositories/:repository_id/branches   1,525   1.164%
>
> Top paths:
>
> /repositories/612587/collaborators      19,420  14.83%
> /repos/jenkinsci/jenkins/contents/      10,333  7.891%
> /repos/jenkins-infra/repository-permissions-updater     7,634   5.83%
> /repositories/1103607/collaborators     6,273   4.79%
> /repos/jenkinsci/jenkins/collaborators  6,261   4.781%
> /user   5,720   4.368%
> /       5,679   4.337%
> /repos/jenkins-infra/plugin-site-api    5,117   3.908%
> /repositories/8263652/collaborators     3,915   2.99%
> /repos/jenkins-infra/jenkins.io 3,238   2.473%
>
> Top methods:
>
> get     117,123 89.441%
> post    13,800  10.538%
> put     27      0.021%
>
> Top statuses:
>
> 200     117,081 89.409%
> 422     8,149   6.223%
> 201     5,631   4.3%
> 403     42      0.032%
> 404     35      0.027%
> 202     6       0.004%
> 204     6       0.004%
>
> Top user-agents:
>
> okhttp/2.7.5    129,727 99.066%
> Java/1.8.0_92-internal  1,223   0.934%
>
> Top tokens:
>
> 44790939        127,361 97.259% - ci.jenkins.io pipeline token (personal
> token)
> 8307920 2,366   1.807% - Used by https://jenkins.ci.cloudbees.com/
> (personal token)
>
> So, it seems JIRA is no longer making requests.
>
> Still, I did notice some time periods when the account makes lots of
> requests -- over 5000 per hour. One such period was recently, started
> around 2016-12-06T15:45:59-08:00. At that point, the account started making
> lots of requests every minute, sometimes over 650 requests per minute.
>
> The token that was being used to make all those requests was
>
> 44790939 - ci.jenkins.io pipeline token (personal token)
>
> and here are the top routes and paths being hit during that time:
>
> routes
>
> /repositories/:repository_id/collaborators      2,308   47.169%
> /repositories/:repository_id/contents/?*        1,894   38.708%
> /repositories/:repository_id/pulls/:id  522     10.668%
> /repositories/:repository_id/pulls      40      0.817%
> /repositories/:repository_id    36      0.736%
> /repositories/:repository_id/branches   30      0.613%
> /       16      0.327%
> /user   16      0.327%
> /repositories/:repository_id/statuses/:sha      15      0.306%
> /user/:user_id  10      0.204%
>
> paths
>
> /repos/jenkinsci/jenkins/contents/      1,894   38.708%
> /repos/jenkinsci/jenkins/collaborators  1,154   23.585%
> /repositories/1103607/collaborators     1,154   23.585%
> /repositories/1103607/pulls     30      0.613%
> /repositories/1103607/branches  20      0.409%
> /       16      0.327%
> /user   16      0.327%
> /repos/jenkinsci/jenkins        13      0.266%
> /repos/jenkinsci/jenkins/branches       10      0.204%
> /repos/jenkinsci/jenkins/pulls  10      0.204%
>
> For example, notice that the list of collaborators for a single repository
> is fetched over a thousand times within a few minutes. I'm not sure why
> you're doing that, but it seems wasteful and it's draining your quota.
>
> Hope this helps.
>
> Cheers,
> Ivan
>
> ----- End forwarded message -----
>
> - R. Tyler Croy
>
> ------------------------------------------------------
>      Code: <https://github.com/rtyler>
>   Chatter: <https://twitter.com/agentdero>
>
>   % gpg --keyserver keys.gnupg.net --recv-key 1426C7DC3F51E16F
> ------------------------------------------------------
>
> _______________________________________________
> Jenkins-infra mailing list
> Jenkins-infra at lists.jenkins-ci.org
> http://lists.jenkins-ci.org/mailman/listinfo/jenkins-infra
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.jenkins-ci.org/pipermail/jenkins-infra/attachments/20161208/137a57e8/attachment.html>


More information about the Jenkins-infra mailing list