[Jenkins-infra] INFRA-896

[Kohsuke Kawaguchi]

Fudging was done on usage.jenkins.io. I left the script and the record of
it here <https://github.com/jenkins-infra/INFRA-896> for the sanity
checking and re-processing later.

jenkins-infra/infra-statistics:Jenkinsfile  did indeed require updates.
I've fixed that well. I'll re-run the pipeline against this new data set
and let's see what stats.jenkins.io would say.

Andrew seemed to think there are some additional problems. So this might
not be the end of it.



On Wed, Aug 17, 2016 at 4:11 PM R. Tyler Croy <tyler at monkeypox.org> wrote:

> (replies inline)
>
> On Wed, 17 Aug 2016, Kohsuke Kawaguchi wrote:
>
> > Probably during the migration to usage.jenkins.io, the access log file
> > split has changed from daily to weekly, which broke the rest of the log
> > processing pipelines.
> >
> > Andrew reported this problem independently yesteday in INFRA-896
> > <https://issues.jenkins-ci.org/browse/INFRA-896>, so I'm fixing that
> here
> > <https://github.com/jenkins-infra/jenkins-infra/pull/558>. I'm also
> going
> > to retroactively fudge log files during the past 2 months to fix stuff
> back
> > in normal.
> >
> > Tyler suggested that we should rather fix the log processing pipeline so
> > that it doesn't make this assumption, but there are many and that's
> harder
> > to do.
> >
> > I'll make sure to save the originals just in case I mess up fudging.
>
>
> On what host are you intending to fudge the log files? The originals are on
> usage.jenkins.io, but they are rsynced around to a Jenkins agent under
> ci.jenkins.io which I *think* doesn't do an `rsync --delete` so we might
> end pu
> double-counting.
>
> Check the Jenkinsfile in jenkins-infra/infra-statistics for details on
> that.
>
>
>
>
> - R. Tyler Croy
>
> ------------------------------------------------------
>      Code: <https://github.com/rtyler>
>   Chatter: <https://twitter.com/agentdero>
>
>   % gpg --keyserver keys.gnupg.net --recv-key 1426C7DC3F51E16F
> ------------------------------------------------------
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.jenkins-ci.org/pipermail/jenkins-infra/attachments/20160818/3cfb2a60/attachment.html>