net.nutch.protocol.http
Class RobotRulesParser.RobotRuleSet

java.lang.Object
  net.nutch.protocol.http.RobotRulesParser.RobotRuleSet

Enclosing class:

RobotRulesParser

public static class RobotRulesParser.RobotRuleSet

extends Object

This class holds the rules which were parsed from a robots.txt file, and can test paths against those rules.

Method Summary

long	getExpireTime() Get expire time
boolean	isAllowed(String path) Returns false if the robots.txt file prohibits us from accessing the given path, or true otherwise.
void	setExpireTime(long expireTime) Change when the ruleset goes stale.
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Method Detail

setExpireTime

public void setExpireTime(long expireTime)

Change when the ruleset goes stale.

getExpireTime

public long getExpireTime()

Get expire time

isAllowed

public boolean isAllowed(String path)

Returns false if the robots.txt file prohibits us from accessing the given path, or true otherwise.

toString

public String toString()