[Jenkins-infra] INFRA-2345

[Gavin Mogan]

Since Olblak merged my pr, I think the crawlers are all now be fixed

https://ci.jenkins.io/job/Infra/job/crawler/job/master/28/console ran
successfully with no errors I could see

https://updates.jenkins.io/updates/ has everything but the two legacy
crawlers updated

and
https://updates.jenkins.io/updates/hudson.plugins.play.PlayInstaller.json
has all the new releases.

I'm going to mark the original issue as resolved.

On Wed, Nov 20, 2019 at 9:31 PM Gavin Mogan <gavin at gavinmogan.com> wrote:

> I've almost got the entire setup upgraded to the newest release of
> htmlunit. This brings the javascript to something modern and runs on the
> oracle site.
>
> I've noticed a few more that don't work:
>
> [2019-11-20T21:34:14.463Z] + groovy -Dgrape.config=./grapeConfig.xml
> ./lib/runner.groovy play.groovy
> [2019-11-20T21:34:16.621Z] loading dependencies...done
> [2019-11-20T21:34:17.554Z] Caught:
> com.gargoylesoftware.htmlunit.FailingHttpStatusCodeException: 403 Forbidden
> for http://download.playframework.org/releases/
> [2019-11-20T21:34:17.554Z]
> com.gargoylesoftware.htmlunit.FailingHttpStatusCodeException: 403 Forbidden
> for http://download.playframework.org/releases/
> [2019-11-20T21:34:17.554Z] at
> com.gargoylesoftware.htmlunit.WebClient.throwFailingHttpStatusCodeExceptionIfNecessary(WebClient.java:549)
> [2019-11-20T21:34:17.554Z] at
> com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:333)
> [2019-11-20T21:34:17.554Z] at
> com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:389)
> [2019-11-20T21:34:17.554Z] at
> com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:374)
> [2019-11-20T21:34:17.554Z] at
> com.gargoylesoftware.htmlunit.WebClient$getPage.call(Unknown Source)
> [2019-11-20T21:34:17.554Z] at play.run(play.groovy:10)
> [2019-11-20T21:34:17.554Z] at runner$_run_closure1.doCall(runner.groovy:13)
> [2019-11-20T21:34:17.554Z] at runner.run(runner.groovy:10)
> [2019-11-20T21:34:17.812Z] + true
>
> ... Okay I forgot to hit send a while ago
>
> I have a new PR ready that should fix all the crawlers again -
> https://github.com/jenkins-infra/crawler/pull/85
>
> I think we should disable the `|| true` that has hidden this for so long.
>
> On Wed, Nov 20, 2019 at 1:52 PM Kohsuke Kawaguchi <kk at kohsuke.org> wrote:
>
>> Olivier contacted me about INFRA-2345
>> <https://issues.jenkins-ci.org/browse/INFRA-2345> and since the time is
>> getting very late for him, I took it over from him.
>>
>> I'm out today in a conference, so I also didn't have too much time, but I
>> spent the lunch time and successfully diagnosed the problem and put in a
>> temporary fix to unblock users. See more about this in the ticket.
>>
>> The fix is temporary, though, and somebody needs to come in to do a
>> proper fix to bring this crawler back on track. On a related note, crawler
>> run is designed such that a failure in one crawler doesn't render the
>> whole Jenkins job <https://trusted.ci.jenkins.io:1443/job/crawler/> a
>> failure. While that makes sense, the result is that this failure in JDK
>> crawler has gone unnoticed for 2 months. That needs to be fixed, too.
>>
>> --
>> Kohsuke Kawaguchi
>> _______________________________________________
>> Jenkins-infra mailing list
>> Jenkins-infra at lists.jenkins-ci.org
>> http://lists.jenkins-ci.org/mailman/listinfo/jenkins-infra
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.jenkins-ci.org/pipermail/jenkins-infra/attachments/20191125/ecb2ab94/attachment.html>