[Jenkins-infra] (fwd) (fwd) Re: Re: Increasing rate-limit for autnenticated activity on busy/large (jenkinsci) org

R. Tyler Croy tyler at monkeypox.org
Thu Dec 8 17:05:13 UTC 2016


GRUMBLEGRUMBLEGRUMBLE

----- Forwarded message from Ivan ??u??ak <support at github.com> -----

Date: Thu, 08 Dec 2016 01:24:18 -0800
From: Ivan ??u??ak <support at github.com>
To: "R. Tyler Croy" <tyler at monkeypox.org>
Subject: Re: Re: Increasing rate-limit for autnenticated activity on busy/large (jenkinsci) org
Message-ID: <discussions/a294f398bce711e68219709904fc93cc/comments/3427963 at github.com>

Hello again, Tyler. Sure thing -- here are the stats for the past week:

Top routes:

/repositories/:repository_id/collaborators	43,669	33.348%	
/repositories/:repository_id	21,349	16.303%	
/repositories/:repository_id/contents/?*	17,410	13.295%	
/repositories/:repository_id/statuses/:sha	13,757	10.506%	
/repositories/:repository_id/pulls/:id	10,828	8.269%	
/repositories/:repository_id/git/refs/*	6,582	5.026%	
/user	5,720	4.368%	
/	5,668	4.328%	
/repositories/:repository_id/pulls	1,647	1.258%	
/repositories/:repository_id/branches	1,525	1.164%

Top paths:

/repositories/612587/collaborators	19,420	14.83%	
/repos/jenkinsci/jenkins/contents/	10,333	7.891%	
/repos/jenkins-infra/repository-permissions-updater	7,634	5.83%	
/repositories/1103607/collaborators	6,273	4.79%	
/repos/jenkinsci/jenkins/collaborators	6,261	4.781%	
/user	5,720	4.368%	
/	5,679	4.337%	
/repos/jenkins-infra/plugin-site-api	5,117	3.908%	
/repositories/8263652/collaborators	3,915	2.99%	
/repos/jenkins-infra/jenkins.io	3,238	2.473%

Top methods:

get	117,123	89.441%	
post	13,800	10.538%	
put	27	0.021%

Top statuses:

200	117,081	89.409%	
422	8,149	6.223%	
201	5,631	4.3%	
403	42	0.032%	
404	35	0.027%	
202	6	0.004%	
204	6	0.004%

Top user-agents:

okhttp/2.7.5	129,727	99.066%	
Java/1.8.0_92-internal	1,223	0.934%

Top tokens:

44790939	127,361	97.259%	- ci.jenkins.io pipeline token (personal token)
8307920	2,366	1.807% - Used by https://jenkins.ci.cloudbees.com/ (personal token)

So, it seems JIRA is no longer making requests.

Still, I did notice some time periods when the account makes lots of requests -- over 5000 per hour. One such period was recently, started around 2016-12-06T15:45:59-08:00. At that point, the account started making lots of requests every minute, sometimes over 650 requests per minute. 

The token that was being used to make all those requests was 

44790939 - ci.jenkins.io pipeline token (personal token)

and here are the top routes and paths being hit during that time:

routes

/repositories/:repository_id/collaborators	2,308	47.169%	
/repositories/:repository_id/contents/?*	1,894	38.708%	
/repositories/:repository_id/pulls/:id	522	10.668%	
/repositories/:repository_id/pulls	40	0.817%	
/repositories/:repository_id	36	0.736%	
/repositories/:repository_id/branches	30	0.613%	
/	16	0.327%	
/user	16	0.327%	
/repositories/:repository_id/statuses/:sha	15	0.306%	
/user/:user_id	10	0.204%

paths

/repos/jenkinsci/jenkins/contents/	1,894	38.708%	
/repos/jenkinsci/jenkins/collaborators	1,154	23.585%	
/repositories/1103607/collaborators	1,154	23.585%	
/repositories/1103607/pulls	30	0.613%	
/repositories/1103607/branches	20	0.409%	
/	16	0.327%	
/user	16	0.327%	
/repos/jenkinsci/jenkins	13	0.266%	
/repos/jenkinsci/jenkins/branches	10	0.204%	
/repos/jenkinsci/jenkins/pulls	10	0.204%

For example, notice that the list of collaborators for a single repository is fetched over a thousand times within a few minutes. I'm not sure why you're doing that, but it seems wasteful and it's draining your quota.

Hope this helps.

Cheers,
Ivan

----- End forwarded message -----

- R. Tyler Croy

------------------------------------------------------
     Code: <https://github.com/rtyler>
  Chatter: <https://twitter.com/agentdero>

  % gpg --keyserver keys.gnupg.net --recv-key 1426C7DC3F51E16F
------------------------------------------------------
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 181 bytes
Desc: Digital signature
URL: <http://lists.jenkins-ci.org/pipermail/jenkins-infra/attachments/20161208/14d12764/attachment.asc>


More information about the Jenkins-infra mailing list