Package org.apache.nutch.tools
package org.apache.nutch.tools
Miscellaneous tools.
-
ClassDescriptionAbstract class that implements { @see org.apache.nutch.tools.CommonCrawlFormat } interface.The Common Crawl Data Dumper tool enables one to reverse generate the raw content from Nutch segment data directories into a common crawling data format, consumed by many applications.Interface for all CommonCrawl formatter.Factory class that creates new
CommonCrawlFormatobjects (a.k.a.This class provides methods to map crawled data on JSON using Jackson Streaming APIs.This class provides methods to map crawled data on JSON using Jettinson APIs.This class provides methods to map crawled data on JSON using a StringBuilder object.Utility that converts DMOZ RDF into a flat file of URLs to be injected.The file dumper tool enables one to reverse generate the raw content from Nutch segment data directories.This tool generates fetchlists (segments to be fetched) from plain text files containing one URL per line.A simple tool that will spin up multiple threads to resolve urls to ip addresses.Tool to list properties and their values set by the current Nutch configuration