Package com.yahoo.net

Class UrlTokenizer

java.lang.Object

com.yahoo.net.UrlTokenizer

public class UrlTokenizer
extends Object

Author:

Simon Thoresen Hult

Field Summary

Fields

Modifier and Type	Field	Description
static final String	TERM_ENDHOST
static final String	TERM_STARTHOST

Constructor Summary

Constructors

Constructor	Description
UrlTokenizer(Url url)
UrlTokenizer(String url)

Method Summary

Modifier and Type	Method	Description
static void	addTokens(List<UrlToken> lst, UrlToken.Type type, int offset, String image, boolean orig)
List<UrlToken>	tokenize()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

TERM_STARTHOST

public static final String TERM_STARTHOST

See Also:

• Constant Field Values

TERM_ENDHOST

public static final String TERM_ENDHOST

See Also:

• Constant Field Values

Constructor Details

UrlTokenizer

public UrlTokenizer(String url)

UrlTokenizer

public UrlTokenizer(Url url)

Method Details

tokenize

public List<UrlToken> tokenize()

addTokens

public static void addTokens(List<UrlToken> lst,
 UrlToken.Type type,
 int offset,
 String image,
 boolean orig)