net.nutch.analysis
Class NutchAnalysis

java.lang.Object
  net.nutch.analysis.NutchAnalysis

All Implemented Interfaces:

NutchAnalysisConstants

public class NutchAnalysis

extends Object

implements NutchAnalysisConstants

The JavaCC-generated Nutch lexical analyzer and query parser.

Field Summary

net.nutch.analysis.Token	jj_nt
boolean	lookingAhead
net.nutch.analysis.Token	token
NutchAnalysisTokenManager	token_source

Fields inherited from interface net.nutch.analysis.NutchAnalysisConstants

ACRONYM, APOSTROPHE, ATSIGN, CJK, COLON, DEFAULT, DIGIT, DOT, EOF, LETTER, MINUS, PLUS, QUOTE, SIGRAM, SLASH, tokenImage, WHITE, WORD, WORD_PUNCT

Constructor Summary

NutchAnalysis(net.nutch.analysis.CharStream stream)

NutchAnalysis(NutchAnalysisTokenManager tm)

Method Summary

ArrayList	compound(String field) Parse a compound term that is interpreted as an implicit phrase query.
void	disable_tracing()
void	enable_tracing()
net.nutch.analysis.ParseException	generateParseException()
net.nutch.analysis.Token	getNextToken()
net.nutch.analysis.Token	getToken(int index)
void	infix() Characters which can be used to form compound terms.
static boolean	isStopWord(String word) True iff word is a stop word.
static void	main(String[] args) For debugging.
void	nonOpInfix() Parse infix characters except plus and minus.
void	nonOpOrTerm() Parse anything but a term or an operator (plur or minus or quote).
void	nonTerm() Parse anything but a term or a quote.
Query	parse() Parse a query.
static Query	parseQuery(String queryString) Construct a query parser for the text in a reader.
ArrayList	phrase(String field) Parse an explcitly quoted phrase query.
void	ReInit(net.nutch.analysis.CharStream stream)
void	ReInit(NutchAnalysisTokenManager tm)
String	term() Parse a single term.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

token_source

public NutchAnalysisTokenManager token_source

token

public net.nutch.analysis.Token token

jj_nt

public net.nutch.analysis.Token jj_nt

lookingAhead

public boolean lookingAhead

Constructor Detail

NutchAnalysis

public NutchAnalysis(net.nutch.analysis.CharStream stream)

NutchAnalysis

public NutchAnalysis(NutchAnalysisTokenManager tm)

Method Detail

isStopWord

public static boolean isStopWord(String word)

True iff word is a stop word. Stop words are only removed from queries. Every word is indexed.

parseQuery

public static Query parseQuery(String queryString)
                        throws IOException

Construct a query parser for the text in a reader.

Throws:

IOException

main

public static void main(String[] args)
                 throws Exception

For debugging.

Throws:

Exception

parse

public final Query parse()
                  throws net.nutch.analysis.ParseException

Parse a query.

Throws:

net.nutch.analysis.ParseException

phrase

public final ArrayList phrase(String field)
                       throws net.nutch.analysis.ParseException

Parse an explcitly quoted phrase query. Note that this may return a single term, a trivial phrase.

Throws:

net.nutch.analysis.ParseException

compound

public final ArrayList compound(String field)
                         throws net.nutch.analysis.ParseException

Parse a compound term that is interpreted as an implicit phrase query. Compounds are a sequence of terms separated by infix characters. Note that htis may return a single term, a trivial compound.

Throws:

net.nutch.analysis.ParseException

term

public final String term()
                  throws net.nutch.analysis.ParseException

Parse a single term.

Throws:

net.nutch.analysis.ParseException

nonTerm

public final void nonTerm()
                   throws net.nutch.analysis.ParseException

Parse anything but a term or a quote.

Throws:

net.nutch.analysis.ParseException

nonOpOrTerm

public final void nonOpOrTerm()
                       throws net.nutch.analysis.ParseException

Parse anything but a term or an operator (plur or minus or quote).

Throws:

net.nutch.analysis.ParseException

infix

public final void infix()
                 throws net.nutch.analysis.ParseException

Characters which can be used to form compound terms.

Throws:

net.nutch.analysis.ParseException

nonOpInfix

public final void nonOpInfix()
                      throws net.nutch.analysis.ParseException

Parse infix characters except plus and minus.

Throws:

net.nutch.analysis.ParseException

ReInit

public void ReInit(net.nutch.analysis.CharStream stream)

ReInit

public void ReInit(NutchAnalysisTokenManager tm)

getNextToken

public final net.nutch.analysis.Token getNextToken()

getToken

public final net.nutch.analysis.Token getToken(int index)

generateParseException

public net.nutch.analysis.ParseException generateParseException()

enable_tracing

public final void enable_tracing()

disable_tracing

public final void disable_tracing()