Package com.yahoo.net

Class UrlTokenizer

java.lang.Object

com.yahoo.net.UrlTokenizer

public class UrlTokenizer
extends Object

Author:

Simon Thoresen Hult

Field Summary

Fields

Modifier and Type	Field	Description
static String	TERM_ENDHOST
static String	TERM_STARTHOST

Constructor Summary

Constructors

Constructor	Description
UrlTokenizer(Url url)
UrlTokenizer(String url)

Method Summary

Modifier and Type	Method	Description
static void	addTokens(List<UrlToken> lst, UrlToken.Type type, int offset, String image, boolean orig)
List<UrlToken>	tokenize()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

TERM_STARTHOST

public static final String TERM_STARTHOST

See Also:

Constant Field Values

TERM_ENDHOST

public static final String TERM_ENDHOST

See Also:

Constant Field Values

Constructor Detail

UrlTokenizer

public UrlTokenizer(String url)

UrlTokenizer

public UrlTokenizer(Url url)

Method Detail

tokenize

public List<UrlToken> tokenize()

addTokens

public static void addTokens(List<UrlToken> lst,
                             UrlToken.Type type,
                             int offset,
                             String image,
                             boolean orig)