Package org.archive.modules.deciderules

Class PathologicalPathDecideRule

java.lang.Object

org.archive.modules.deciderules.DecideRule

org.archive.modules.deciderules.PathologicalPathDecideRule

All Implemented Interfaces:

Serializable, HasKeyedProperties

public class PathologicalPathDecideRule
extends DecideRule

Rule REJECTs any URI which contains an excessive number of identical, consecutive path-segments (eg http://example.com/a/a/a/boo.html == 3 '/a' segments)

Author:

gojomo

See Also:

• Serialized Form

Field Summary

Fields inherited from class org.archive.modules.deciderules.DecideRule

comment, kp

Constructor Summary

Constructors

Constructor	Description
PathologicalPathDecideRule()	Constructs a new PathologicalPathFilter.

Method Summary

Modifier and Type	Method	Description
protected String	constructRegex(int rep)
int	getMaxRepetitions()
protected DecideResult	innerDecide(CrawlURI uri)
void	setMaxRepetitions(int maxRepetitions)	Number of times the pattern should be allowed to occur.

Methods inherited from class org.archive.modules.deciderules.DecideRule

accepts, decisionFor, getComment, getEnabled, getKeyedProperties, onlyDecision, setComment, setEnabled

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

PathologicalPathDecideRule

public PathologicalPathDecideRule()

Constructs a new PathologicalPathFilter.

Method Details

getMaxRepetitions

public int getMaxRepetitions()

setMaxRepetitions

public void setMaxRepetitions(int maxRepetitions)

Number of times the pattern should be allowed to occur. This rule returns its decision (usually REJECT) if a path-segment is repeated more than number of times.

innerDecide

protected DecideResult innerDecide(CrawlURI uri)

Specified by:

innerDecide in class DecideRule

constructRegex

protected String constructRegex(int rep)