BadApple

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

BadApple

Erick Erickson
Short form:

Holding reasonably steady, except:

PackageManagerCLITest.testPackeageManager is failing over 50% of the time.

MoverReplicaHDFSTest.test failing over 40% of the time.

TestFstDirectAddressing.testDeDupeTails is failing 18% of the time.

Full output attached:


There were 154 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are objections

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   3.3      917     45      BasicAuthIntegrationTest.testBasicAuth
     0123   0.5      943      7      DimensionalRoutedAliasUpdateProcessorTest.testCatTime
     0123   2.7      943     18      DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
     0123   8.3      961     91      LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
     0123  43.8      202     85      MoveReplicaHDFSTest.test
     0123   0.5      903      5      ReindexCollectionTest.testSameTargetReindexing
     0123   4.8      104      5      ShardSplitTest.testSplitWithChaosMonkey
     0123   0.5      918      9      SystemCollectionCompatTest.testBackCompat
     0123   4.8      941     52      TestCloudSearcherWarming.testRepFactor1LeaderStartup
     0123   2.7      946     77      TestModelManagerPersistence.testFilePersistence
     0123   2.2      940     70      TestModelManagerPersistence.testWrapperModelPersistence
     0123   1.6      921     19      TestSkipOverseerOperations.testSkipLeaderOperations
     0123   0.6      905     11      TestStressLiveNodes.testStress
     0123   1.1      651      9      TestTlogReplica.testKillTlogReplica
     0123   4.2      112     11      TestXYMultiPolygonShapeQueries.testRandomBig
************ Will BadApple all tests above this line except ones listed at the top**************



---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

e-mail-2019-11-18.txt (19K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: BadApple

Tomás Fernández Löbbe
I’ve been working with TestTlogReplica, please don’t change that one

On Mon, Nov 18, 2019 at 8:28 AM Erick Erickson <[hidden email]> wrote:
Short form:

Holding reasonably steady, except:

PackageManagerCLITest.testPackeageManager is failing over 50% of the time.

MoverReplicaHDFSTest.test failing over 40% of the time.

TestFstDirectAddressing.testDeDupeTails is failing 18% of the time.

Full output attached:


There were 154 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are objections

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   3.3      917     45      BasicAuthIntegrationTest.testBasicAuth
     0123   0.5      943      7      DimensionalRoutedAliasUpdateProcessorTest.testCatTime
     0123   2.7      943     18      DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
     0123   8.3      961     91      LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
     0123  43.8      202     85      MoveReplicaHDFSTest.test
     0123   0.5      903      5      ReindexCollectionTest.testSameTargetReindexing
     0123   4.8      104      5      ShardSplitTest.testSplitWithChaosMonkey
     0123   0.5      918      9      SystemCollectionCompatTest.testBackCompat
     0123   4.8      941     52      TestCloudSearcherWarming.testRepFactor1LeaderStartup
     0123   2.7      946     77      TestModelManagerPersistence.testFilePersistence
     0123   2.2      940     70      TestModelManagerPersistence.testWrapperModelPersistence
     0123   1.6      921     19      TestSkipOverseerOperations.testSkipLeaderOperations
     0123   0.6      905     11      TestStressLiveNodes.testStress
     0123   1.1      651      9      TestTlogReplica.testKillTlogReplica
     0123   4.2      112     11      TestXYMultiPolygonShapeQueries.testRandomBig
************ Will BadApple all tests above this line except ones listed at the top**************


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

Re: BadApple

Michael Sokolov-4
In reply to this post by Erick Erickson
I ran TestFstDirectAddressing.testDeDupeTails > 100 times with no
failure, both on master and on branch_8x (on an Ubuntu w/a couple of
different JDKs). Can you tell which branch/jvm/os is seeing the
failures for that test? I couldn't tell from the attached report.

On Mon, Nov 18, 2019 at 11:28 AM Erick Erickson <[hidden email]> wrote:

>
> Short form:
>
> Holding reasonably steady, except:
>
> PackageManagerCLITest.testPackeageManager is failing over 50% of the time.
>
> MoverReplicaHDFSTest.test failing over 40% of the time.
>
> TestFstDirectAddressing.testDeDupeTails is failing 18% of the time.
>
> Full output attached:
>
>
> There were 154 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected
> These tests were NOT BadApple'd or AwaitsFix'd
> All tests that failed 4 weeks running will be BadApple'd unless there are objections
>
> Failures in the last 4 reports..
>    Report   Pct     runs    fails           test
>      0123   3.3      917     45      BasicAuthIntegrationTest.testBasicAuth
>      0123   0.5      943      7      DimensionalRoutedAliasUpdateProcessorTest.testCatTime
>      0123   2.7      943     18      DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
>      0123   8.3      961     91      LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
>      0123  43.8      202     85      MoveReplicaHDFSTest.test
>      0123   0.5      903      5      ReindexCollectionTest.testSameTargetReindexing
>      0123   4.8      104      5      ShardSplitTest.testSplitWithChaosMonkey
>      0123   0.5      918      9      SystemCollectionCompatTest.testBackCompat
>      0123   4.8      941     52      TestCloudSearcherWarming.testRepFactor1LeaderStartup
>      0123   2.7      946     77      TestModelManagerPersistence.testFilePersistence
>      0123   2.2      940     70      TestModelManagerPersistence.testWrapperModelPersistence
>      0123   1.6      921     19      TestSkipOverseerOperations.testSkipLeaderOperations
>      0123   0.6      905     11      TestStressLiveNodes.testStress
>      0123   1.1      651      9      TestTlogReplica.testKillTlogReplica
>      0123   4.2      112     11      TestXYMultiPolygonShapeQueries.testRandomBig
> ************ Will BadApple all tests above this line except ones listed at the top**************
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: BadApple

Michael Sokolov-4
Perhaps the failures were reported prior to the recent fix?
https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=359864c

On Mon, Nov 18, 2019 at 5:15 PM Michael Sokolov <[hidden email]> wrote:

>
> I ran TestFstDirectAddressing.testDeDupeTails > 100 times with no
> failure, both on master and on branch_8x (on an Ubuntu w/a couple of
> different JDKs). Can you tell which branch/jvm/os is seeing the
> failures for that test? I couldn't tell from the attached report.
>
> On Mon, Nov 18, 2019 at 11:28 AM Erick Erickson <[hidden email]> wrote:
> >
> > Short form:
> >
> > Holding reasonably steady, except:
> >
> > PackageManagerCLITest.testPackeageManager is failing over 50% of the time.
> >
> > MoverReplicaHDFSTest.test failing over 40% of the time.
> >
> > TestFstDirectAddressing.testDeDupeTails is failing 18% of the time.
> >
> > Full output attached:
> >
> >
> > There were 154 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected
> > These tests were NOT BadApple'd or AwaitsFix'd
> > All tests that failed 4 weeks running will be BadApple'd unless there are objections
> >
> > Failures in the last 4 reports..
> >    Report   Pct     runs    fails           test
> >      0123   3.3      917     45      BasicAuthIntegrationTest.testBasicAuth
> >      0123   0.5      943      7      DimensionalRoutedAliasUpdateProcessorTest.testCatTime
> >      0123   2.7      943     18      DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
> >      0123   8.3      961     91      LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
> >      0123  43.8      202     85      MoveReplicaHDFSTest.test
> >      0123   0.5      903      5      ReindexCollectionTest.testSameTargetReindexing
> >      0123   4.8      104      5      ShardSplitTest.testSplitWithChaosMonkey
> >      0123   0.5      918      9      SystemCollectionCompatTest.testBackCompat
> >      0123   4.8      941     52      TestCloudSearcherWarming.testRepFactor1LeaderStartup
> >      0123   2.7      946     77      TestModelManagerPersistence.testFilePersistence
> >      0123   2.2      940     70      TestModelManagerPersistence.testWrapperModelPersistence
> >      0123   1.6      921     19      TestSkipOverseerOperations.testSkipLeaderOperations
> >      0123   0.6      905     11      TestStressLiveNodes.testStress
> >      0123   1.1      651      9      TestTlogReplica.testKillTlogReplica
> >      0123   4.2      112     11      TestXYMultiPolygonShapeQueries.testRandomBig
> > ************ Will BadApple all tests above this line except ones listed at the top**************
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: [hidden email]
> > For additional commands, e-mail: [hidden email]

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: BadApple

Chris Hostetter-3
In reply to this post by Michael Sokolov-4

: I ran TestFstDirectAddressing.testDeDupeTails > 100 times with no
: failure, both on master and on branch_8x (on an Ubuntu w/a couple of
: different JDKs). Can you tell which branch/jvm/os is seeing the
: failures for that test? I couldn't tell from the attached report.

it's already been addressed - by you - in LUCENE-8920  (Erick's note was
about it's overall success rate for the past 7 days)



:
: On Mon, Nov 18, 2019 at 11:28 AM Erick Erickson <[hidden email]> wrote:
: >
: > Short form:
: >
: > Holding reasonably steady, except:
: >
: > PackageManagerCLITest.testPackeageManager is failing over 50% of the time.
: >
: > MoverReplicaHDFSTest.test failing over 40% of the time.
: >
: > TestFstDirectAddressing.testDeDupeTails is failing 18% of the time.
: >
: > Full output attached:
: >
: >
: > There were 154 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected
: > These tests were NOT BadApple'd or AwaitsFix'd
: > All tests that failed 4 weeks running will be BadApple'd unless there are objections
: >
: > Failures in the last 4 reports..
: >    Report   Pct     runs    fails           test
: >      0123   3.3      917     45      BasicAuthIntegrationTest.testBasicAuth
: >      0123   0.5      943      7      DimensionalRoutedAliasUpdateProcessorTest.testCatTime
: >      0123   2.7      943     18      DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
: >      0123   8.3      961     91      LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
: >      0123  43.8      202     85      MoveReplicaHDFSTest.test
: >      0123   0.5      903      5      ReindexCollectionTest.testSameTargetReindexing
: >      0123   4.8      104      5      ShardSplitTest.testSplitWithChaosMonkey
: >      0123   0.5      918      9      SystemCollectionCompatTest.testBackCompat
: >      0123   4.8      941     52      TestCloudSearcherWarming.testRepFactor1LeaderStartup
: >      0123   2.7      946     77      TestModelManagerPersistence.testFilePersistence
: >      0123   2.2      940     70      TestModelManagerPersistence.testWrapperModelPersistence
: >      0123   1.6      921     19      TestSkipOverseerOperations.testSkipLeaderOperations
: >      0123   0.6      905     11      TestStressLiveNodes.testStress
: >      0123   1.1      651      9      TestTlogReplica.testKillTlogReplica
: >      0123   4.2      112     11      TestXYMultiPolygonShapeQueries.testRandomBig
: > ************ Will BadApple all tests above this line except ones listed at the top**************
: >
: >
: > ---------------------------------------------------------------------
: > To unsubscribe, e-mail: [hidden email]
: > For additional commands, e-mail: [hidden email]
:
: ---------------------------------------------------------------------
: To unsubscribe, e-mail: [hidden email]
: For additional commands, e-mail: [hidden email]
:
:

-Hoss
http://www.lucidworks.com/

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: BadApple

Ishan Chattopadhyaya
In reply to this post by Erick Erickson
Thanks Erick. I've fixed the package manager tests.

On Mon, 18 Nov, 2019, 9:58 PM Erick Erickson, <[hidden email]> wrote:
Short form:

Holding reasonably steady, except:

PackageManagerCLITest.testPackeageManager is failing over 50% of the time.

MoverReplicaHDFSTest.test failing over 40% of the time.

TestFstDirectAddressing.testDeDupeTails is failing 18% of the time.

Full output attached:


There were 154 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are objections

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   3.3      917     45      BasicAuthIntegrationTest.testBasicAuth
     0123   0.5      943      7      DimensionalRoutedAliasUpdateProcessorTest.testCatTime
     0123   2.7      943     18      DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
     0123   8.3      961     91      LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
     0123  43.8      202     85      MoveReplicaHDFSTest.test
     0123   0.5      903      5      ReindexCollectionTest.testSameTargetReindexing
     0123   4.8      104      5      ShardSplitTest.testSplitWithChaosMonkey
     0123   0.5      918      9      SystemCollectionCompatTest.testBackCompat
     0123   4.8      941     52      TestCloudSearcherWarming.testRepFactor1LeaderStartup
     0123   2.7      946     77      TestModelManagerPersistence.testFilePersistence
     0123   2.2      940     70      TestModelManagerPersistence.testWrapperModelPersistence
     0123   1.6      921     19      TestSkipOverseerOperations.testSkipLeaderOperations
     0123   0.6      905     11      TestStressLiveNodes.testStress
     0123   1.1      651      9      TestTlogReplica.testKillTlogReplica
     0123   4.2      112     11      TestXYMultiPolygonShapeQueries.testRandomBig
************ Will BadApple all tests above this line except ones listed at the top**************


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

Re: BadApple

Michael Sokolov-4
> it's already been addressed - by you - in LUCENE-8920  (Erick's note was
about it's overall success rate for the past 7 days)

Yeah, thanks. Brain caught up with hands and I realized that must be
it shortly after posting.

On Tue, Nov 19, 2019 at 1:33 AM Ishan Chattopadhyaya
<[hidden email]> wrote:

>
> Thanks Erick. I've fixed the package manager tests.
>
> On Mon, 18 Nov, 2019, 9:58 PM Erick Erickson, <[hidden email]> wrote:
>>
>> Short form:
>>
>> Holding reasonably steady, except:
>>
>> PackageManagerCLITest.testPackeageManager is failing over 50% of the time.
>>
>> MoverReplicaHDFSTest.test failing over 40% of the time.
>>
>> TestFstDirectAddressing.testDeDupeTails is failing 18% of the time.
>>
>> Full output attached:
>>
>>
>> There were 154 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected
>> These tests were NOT BadApple'd or AwaitsFix'd
>> All tests that failed 4 weeks running will be BadApple'd unless there are objections
>>
>> Failures in the last 4 reports..
>>    Report   Pct     runs    fails           test
>>      0123   3.3      917     45      BasicAuthIntegrationTest.testBasicAuth
>>      0123   0.5      943      7      DimensionalRoutedAliasUpdateProcessorTest.testCatTime
>>      0123   2.7      943     18      DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
>>      0123   8.3      961     91      LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
>>      0123  43.8      202     85      MoveReplicaHDFSTest.test
>>      0123   0.5      903      5      ReindexCollectionTest.testSameTargetReindexing
>>      0123   4.8      104      5      ShardSplitTest.testSplitWithChaosMonkey
>>      0123   0.5      918      9      SystemCollectionCompatTest.testBackCompat
>>      0123   4.8      941     52      TestCloudSearcherWarming.testRepFactor1LeaderStartup
>>      0123   2.7      946     77      TestModelManagerPersistence.testFilePersistence
>>      0123   2.2      940     70      TestModelManagerPersistence.testWrapperModelPersistence
>>      0123   1.6      921     19      TestSkipOverseerOperations.testSkipLeaderOperations
>>      0123   0.6      905     11      TestStressLiveNodes.testStress
>>      0123   1.1      651      9      TestTlogReplica.testKillTlogReplica
>>      0123   4.2      112     11      TestXYMultiPolygonShapeQueries.testRandomBig
>> ************ Will BadApple all tests above this line except ones listed at the top**************
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: [hidden email]
>> For additional commands, e-mail: [hidden email]

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]