BadApples

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

BadApples

Erick Erickson
I’ve attached the full report, but this has been a _really_ ragged week. Take a look here for the gory details of what’s failing currently: http://fucit.org/solr-jenkins-reports/failure-report.html


The tests that have failed over the last 4 consecutive weeks are:

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.6      784     10      DimensionalRoutedAliasUpdateProcessorTest.testCatTime
     0123   5.6      743     56      LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
     0123  63.2      101     53      MoveReplicaHDFSTest.test
     0123   6.7       85      5      ShardSplitTest.testSplitWithChaosMonkey
     0123   2.4      714      9      SystemCollectionCompatTest.testBackCompat
     0123   9.4      795     47      TestModelManagerPersistence.testFilePersistence
     0123   9.4      797     49      TestModelManagerPersistence.testWrapperModelPersistence
     0123   1.5      724     10      TestStressLiveNodes.testStress
************ Will BadApple all tests above this line except ones listed at the top**************

Do the attachments even make it through?



---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

e-mail-2019-12-09.txt (43K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: BadApples

Kevin Risden-3
Yes the "e-mail-2019-12-09.txt" attachment made it through.

Many of the tests have failed due to the tightening of the security manager permissions for tests [1]. Most of the failures have been due to failing to null out static variables after a test run [2]. Others are real issues like TestSolrCLIRunExample [3] or the Hadoop related failures [4]. There are others that haven't been triaged yet.

Rob has been putting in a lot of effort to try to get this under control as well. Getting the tests to run under the security manager is the first step to trying to enable it for real in Solr. Any help triaging the failures would be appreciated.

If you are looking to triage some of the test failures, adding -Dargs="-Djava.security.debug=access,failure" can help find out why the security manager denied access. Some of the failures are different between OS as well where security manager allows the path on Linux but fails on Windows.


On Mon, Dec 9, 2019 at 10:43 AM Erick Erickson <[hidden email]> wrote:
I’ve attached the full report, but this has been a _really_ ragged week. Take a look here for the gory details of what’s failing currently: http://fucit.org/solr-jenkins-reports/failure-report.html


The tests that have failed over the last 4 consecutive weeks are:

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.6      784     10      DimensionalRoutedAliasUpdateProcessorTest.testCatTime
     0123   5.6      743     56      LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
     0123  63.2      101     53      MoveReplicaHDFSTest.test
     0123   6.7       85      5      ShardSplitTest.testSplitWithChaosMonkey
     0123   2.4      714      9      SystemCollectionCompatTest.testBackCompat
     0123   9.4      795     47      TestModelManagerPersistence.testFilePersistence
     0123   9.4      797     49      TestModelManagerPersistence.testWrapperModelPersistence
     0123   1.5      724     10      TestStressLiveNodes.testStress
************ Will BadApple all tests above this line except ones listed at the top**************

Do the attachments even make it through?


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

Re: BadApples

Erick Erickson
I should have been clearer that I wasn’t complaining, just observing that the badapple report is too noisy to really be of much value. I fully understand that the noise is going away at a breakneck pace…..



> On Dec 9, 2019, at 11:15 AM, Kevin Risden <[hidden email]> wrote:
>
> Yes the "e-mail-2019-12-09.txt" attachment made it through.
>
> Many of the tests have failed due to the tightening of the security manager permissions for tests [1]. Most of the failures have been due to failing to null out static variables after a test run [2]. Others are real issues like TestSolrCLIRunExample [3] or the Hadoop related failures [4]. There are others that haven't been triaged yet.
>
> Rob has been putting in a lot of effort to try to get this under control as well. Getting the tests to run under the security manager is the first step to trying to enable it for real in Solr. Any help triaging the failures would be appreciated.
>
> If you are looking to triage some of the test failures, adding -Dargs="-Djava.security.debug=access,failure" can help find out why the security manager denied access. Some of the failures are different between OS as well where security manager allows the path on Linux but fails on Windows.
>
> [1] https://issues.apache.org/jira/browse/SOLR-13991
> [2] https://issues.apache.org/jira/browse/SOLR-14000
> [3] https://issues.apache.org/jira/browse/SOLR-14028
> [4] https://issues.apache.org/jira/browse/SOLR-14033
>
> Kevin Risden
>
>
> On Mon, Dec 9, 2019 at 10:43 AM Erick Erickson <[hidden email]> wrote:
> I’ve attached the full report, but this has been a _really_ ragged week. Take a look here for the gory details of what’s failing currently: http://fucit.org/solr-jenkins-reports/failure-report.html
>
>
> The tests that have failed over the last 4 consecutive weeks are:
>
> Failures in the last 4 reports..
>    Report   Pct     runs    fails           test
>      0123   0.6      784     10      DimensionalRoutedAliasUpdateProcessorTest.testCatTime
>      0123   5.6      743     56      LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
>      0123  63.2      101     53      MoveReplicaHDFSTest.test
>      0123   6.7       85      5      ShardSplitTest.testSplitWithChaosMonkey
>      0123   2.4      714      9      SystemCollectionCompatTest.testBackCompat
>      0123   9.4      795     47      TestModelManagerPersistence.testFilePersistence
>      0123   9.4      797     49      TestModelManagerPersistence.testWrapperModelPersistence
>      0123   1.5      724     10      TestStressLiveNodes.testStress
> ************ Will BadApple all tests above this line except ones listed at the top**************
>
> Do the attachments even make it through?
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]