[jira] [Comment Edited] (LUCENE-8462) New Arabic snowball stemmer

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Comment Edited] (LUCENE-8462) New Arabic snowball stemmer

JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/LUCENE-8462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16610847#comment-16610847 ]

Ryadh Dahimene edited comment on LUCENE-8462 at 9/14/18 8:05 AM:
-----------------------------------------------------------------

Hi [~rcmuir], what do you think of the new dataset for the test vocabulary? Should I look for other alternatives?

[~thetaphi], following your comment I've started looking at the ant task `{{ant patch-snowball`}}  and yes it needs to be updated for the new snowball generated java classes. I will try to work on that -and submit a change on a separate issue- (I have included it in this same change)


was (Author: ryadh):
Hi [~rcmuir], what do you think of the new dataset for the test vocabulary? Should I look for other alternatives?

[~thetaphi], following your comment I've started looking at the ant task `{{ant patch-snowball`}}  and yes it needs to be updated for the new snowball generated java classes. I will try to work on that and submit a change on a separate issue.

> New Arabic snowball stemmer
> ---------------------------
>
>                 Key: LUCENE-8462
>                 URL: https://issues.apache.org/jira/browse/LUCENE-8462
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Ryadh Dahimene
>            Priority: Trivial
>              Labels: Arabic, snowball, stemmer
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Added a new Arabic snowball stemmer based on [https://github.com/snowballstem/snowball/blob/master/algorithms/arabic.sbl]
> As well an Arabic test dataset in `TestSnowballVocabData.zip` from the -snowball-data- generated from the input file available here -[https://github.com/snowballstem/snowball-data/tree/master/arabic]-
> [https://github.com/ibnmalik/golden-corpus-arabic/blob/develop/core/words.txt]
>  
> It also updates the {{ant patch-snowball}} target to be compatible with
> the java classes generated by the last snowball version (tree:
> 1964ce688cbeca505263c8f77e16ed923296ce7a). The {{ant patch-snowball}} target
> is retro-compatible with the version of snowball stemmers used in
> lucene 7.x and ignores already patched classes.
>  
> Link to the corresponding Github PR:
> [https://github.com/apache/lucene-solr/pull/449]
>  Edited: updated the corpus link, PR link and description
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]