Basically, you couldn't extend StandardAnalyzer, since it's final class. But you could do the same trick, with your own tokenizer, and it's simple. Also you couldn't change existing one, since it's a bad idea.
I could imagine something like this:
public class CustomAnalyzer extends Analyzer {
protected TokenStreamComponents createComponents(String s) {
// provide your own tokenizer, that will split input string as you want it
final Tokenizer standardTokenizer = new MyStandardTokenizer();
TokenStream tok = new StandardFilter(standardTokenizer);
// make everything lowercase, remove if not needed
tok = new LowerCaseFilter(tok);
//provide stopwords if you want them
tok = new StopFilter(tok, stopwords);
return new TokenStreamComponents(standardTokenizer, tok);
}
private class MyStandardTokenizer extends Tokenizer {
public boolean incrementToken() throws IOException {
//mimic the logic of standard analyzer and add your rules
return false;
}
}
}
I put everything into one class, just to make it easier to post here. In general, you need your own logic in MyStandardTokenizer (e.g. you could copy code from StandardAnalyzer (it's final, so no extends again) and then in the incrementToken add needed stuff for your logic with dashes. Hope it will help you.
