Uses of Class
net.nutch.parse.html.RobotsMetaProcessor.RobotsMetaIndicator

Packages that use RobotsMetaProcessor.RobotsMetaIndicator

net.nutch.parse.html

An HTML document parsing plugin.

Uses of RobotsMetaProcessor.RobotsMetaIndicator in net.nutch.parse.html

Methods in net.nutch.parse.html with parameters of type RobotsMetaProcessor.RobotsMetaIndicator

static void

RobotsMetaProcessor.getRobotsMetaDirectives(RobotsMetaProcessor.RobotsMetaIndicator robotsMeta, Node node, URL currURL) Sets the indicators in robotsMeta to appropriate values, based on any META tags found under the given node.