[jira] Created: (SOLR-15) OpenBitSet

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] Created: (SOLR-15) OpenBitSet

David Pilato (Jira)
OpenBitSet
----------

         Key: SOLR-15
         URL: http://issues.apache.org/jira/browse/SOLR-15
     Project: Solr
        Type: New Feature

    Reporter: Yonik Seeley
 Assigned to: Yonik Seeley


OpenBitSet, a faster, and open implementation of a set of bits.
There should be enough implemented such that it could be used for filters in Solr and/or Lucene.

Home should probably be solr.util or lucene.util if it's deemed desirable.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (SOLR-15) OpenBitSet

David Pilato (Jira)
     [ http://issues.apache.org/jira/browse/SOLR-15?page=all ]

Yonik Seeley updated SOLR-15:
-----------------------------

    Attachment: OpenBitSet.java
                BitSetPerf.java
                BitSetIterator.java

> OpenBitSet
> ----------
>
>          Key: SOLR-15
>          URL: http://issues.apache.org/jira/browse/SOLR-15
>      Project: Solr
>         Type: New Feature

>     Reporter: Yonik Seeley
>     Assignee: Yonik Seeley
>  Attachments: BitSetIterator.java, BitSetPerf.java, OpenBitSet.java, TestOpenBitSet.java
>
> OpenBitSet, a faster, and open implementation of a set of bits.
> There should be enough implemented such that it could be used for filters in Solr and/or Lucene.
> Home should probably be solr.util or lucene.util if it's deemed desirable.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (SOLR-15) OpenBitSet

David Pilato (Jira)
In reply to this post by David Pilato (Jira)
     [ http://issues.apache.org/jira/browse/SOLR-15?page=all ]

Yonik Seeley updated SOLR-15:
-----------------------------

    Attachment: TestOpenBitSet.java

> OpenBitSet
> ----------
>
>          Key: SOLR-15
>          URL: http://issues.apache.org/jira/browse/SOLR-15
>      Project: Solr
>         Type: New Feature

>     Reporter: Yonik Seeley
>     Assignee: Yonik Seeley
>  Attachments: BitSetIterator.java, BitSetPerf.java, OpenBitSet.java, TestOpenBitSet.java
>
> OpenBitSet, a faster, and open implementation of a set of bits.
> There should be enough implemented such that it could be used for filters in Solr and/or Lucene.
> Home should probably be solr.util or lucene.util if it's deemed desirable.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (SOLR-15) OpenBitSet

David Pilato (Jira)
In reply to this post by David Pilato (Jira)
    [ http://issues.apache.org/jira/browse/SOLR-15?page=comments#action_12383274 ]

Yonik Seeley commented on SOLR-15:
----------------------------------

My Home Machine: Pentium 4, HyperThreaded, dual channel memory
JVM: Java 1.5_06 -server -Xbatch -Xmx64M
BitSet size = 1,000,000

Relative Performance,  java.util.BitSet time divided by OpenBitSet time:

For 50% (500,000) bits set
cardinality  3.36
ntersect_count  3.96
union  1.44
nextSetBit  1.46
get  1.99
iterator  1.58

For 1% (10,000) bits set
cardinality  3.31
ntersect_count  3.90
nextSetBit  1.04
iterator  0.99




> OpenBitSet
> ----------
>
>          Key: SOLR-15
>          URL: http://issues.apache.org/jira/browse/SOLR-15
>      Project: Solr
>         Type: New Feature

>     Reporter: Yonik Seeley
>     Assignee: Yonik Seeley
>  Attachments: BitSetIterator.java, BitSetPerf.java, OpenBitSet.java, TestOpenBitSet.java
>
> OpenBitSet, a faster, and open implementation of a set of bits.
> There should be enough implemented such that it could be used for filters in Solr and/or Lucene.
> Home should probably be solr.util or lucene.util if it's deemed desirable.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (SOLR-15) OpenBitSet

David Pilato (Jira)
In reply to this post by David Pilato (Jira)
     [ http://issues.apache.org/jira/browse/SOLR-15?page=all ]

Yonik Seeley updated SOLR-15:
-----------------------------

    Attachment: OpenBitSet.java
                BitSetIterator.java

> OpenBitSet
> ----------
>
>          Key: SOLR-15
>          URL: http://issues.apache.org/jira/browse/SOLR-15
>      Project: Solr
>         Type: New Feature

>     Reporter: Yonik Seeley
>     Assignee: Yonik Seeley
>  Attachments: BitSetIterator.java, BitSetIterator.java, BitSetPerf.java, BitSetPerf.java, OpenBitSet.java, OpenBitSet.java, TestOpenBitSet.java, TestOpenBitSet.java
>
> OpenBitSet, a faster, and open implementation of a set of bits.
> There should be enough implemented such that it could be used for filters in Solr and/or Lucene.
> Home should probably be solr.util or lucene.util if it's deemed desirable.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (SOLR-15) OpenBitSet

David Pilato (Jira)
In reply to this post by David Pilato (Jira)
     [ http://issues.apache.org/jira/browse/SOLR-15?page=all ]

Yonik Seeley updated SOLR-15:
-----------------------------

    Attachment: TestOpenBitSet.java
                BitSetPerf.java

> OpenBitSet
> ----------
>
>          Key: SOLR-15
>          URL: http://issues.apache.org/jira/browse/SOLR-15
>      Project: Solr
>         Type: New Feature

>     Reporter: Yonik Seeley
>     Assignee: Yonik Seeley
>  Attachments: BitSetIterator.java, BitSetIterator.java, BitSetPerf.java, BitSetPerf.java, OpenBitSet.java, OpenBitSet.java, TestOpenBitSet.java, TestOpenBitSet.java
>
> OpenBitSet, a faster, and open implementation of a set of bits.
> There should be enough implemented such that it could be used for filters in Solr and/or Lucene.
> Home should probably be solr.util or lucene.util if it's deemed desirable.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (SOLR-15) OpenBitSet

David Pilato (Jira)
In reply to this post by David Pilato (Jira)
    [ http://issues.apache.org/jira/browse/SOLR-15?page=comments#action_12415225 ]

Yonik Seeley commented on SOLR-15:
----------------------------------

added flip(fromIndex, toIndex),
some expanding operations that expand the bitset if needed,
more javadoc,
Opteron performance comparison.


Machine: AMD Opteron
OS: Linux 64 bit
JVM: 64 bit Java 1.5_06 -server -Xbatch -Xmx64M
BitSet size = 1,000,000

Relative Performance, java.util.BitSet time divided by OpenBitSet time:

For 50% (500,000) bits set
cardinality 2.50
intersect_count 3.50
union 1.00
nextSetBit 1.03
get 1.12
iterator 1.25

For 1% (10,000) bits set
cardinality 2.51
intersect_count 3.49
nextSetBit 1.00
iterator 1.02

> OpenBitSet
> ----------
>
>          Key: SOLR-15
>          URL: http://issues.apache.org/jira/browse/SOLR-15
>      Project: Solr
>         Type: New Feature

>     Reporter: Yonik Seeley
>     Assignee: Yonik Seeley
>  Attachments: BitSetIterator.java, BitSetIterator.java, BitSetPerf.java, BitSetPerf.java, OpenBitSet.java, OpenBitSet.java, TestOpenBitSet.java, TestOpenBitSet.java
>
> OpenBitSet, a faster, and open implementation of a set of bits.
> There should be enough implemented such that it could be used for filters in Solr and/or Lucene.
> Home should probably be solr.util or lucene.util if it's deemed desirable.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (SOLR-15) OpenBitSet

David Pilato (Jira)
In reply to this post by David Pilato (Jira)
     [ http://issues.apache.org/jira/browse/SOLR-15?page=all ]

Yonik Seeley updated SOLR-15:
-----------------------------

    Attachment: TestOpenBitSet.java
                OpenBitSet.java

serializable, equals() implementation, javadoc updates

> OpenBitSet
> ----------
>
>          Key: SOLR-15
>          URL: http://issues.apache.org/jira/browse/SOLR-15
>      Project: Solr
>         Type: New Feature

>     Reporter: Yonik Seeley
>     Assignee: Yonik Seeley
>  Attachments: BitSetIterator.java, BitSetIterator.java, BitSetPerf.java, BitSetPerf.java, OpenBitSet.java, OpenBitSet.java, OpenBitSet.java, TestOpenBitSet.java, TestOpenBitSet.java, TestOpenBitSet.java
>
> OpenBitSet, a faster, and open implementation of a set of bits.
> There should be enough implemented such that it could be used for filters in Solr and/or Lucene.
> Home should probably be solr.util or lucene.util if it's deemed desirable.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira

Reply | Threaded
Open this post in threaded view
|

[jira] Resolved: (SOLR-15) OpenBitSet

David Pilato (Jira)
In reply to this post by David Pilato (Jira)
     [ http://issues.apache.org/jira/browse/SOLR-15?page=all ]
     
Yonik Seeley resolved SOLR-15:
------------------------------

    Resolution: Fixed

committed, with extra changes.

> OpenBitSet
> ----------
>
>          Key: SOLR-15
>          URL: http://issues.apache.org/jira/browse/SOLR-15
>      Project: Solr
>         Type: New Feature

>     Reporter: Yonik Seeley
>     Assignee: Yonik Seeley
>  Attachments: BitSetIterator.java, BitSetIterator.java, BitSetPerf.java, BitSetPerf.java, OpenBitSet.java, OpenBitSet.java, OpenBitSet.java, TestOpenBitSet.java, TestOpenBitSet.java, TestOpenBitSet.java
>
> OpenBitSet, a faster, and open implementation of a set of bits.
> There should be enough implemented such that it could be used for filters in Solr and/or Lucene.
> Home should probably be solr.util or lucene.util if it's deemed desirable.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira