Package org.apache.nutch.indexer.feed

Class FeedIndexingFilter

java.lang.Object

org.apache.nutch.indexer.feed.FeedIndexingFilter

All Implemented Interfaces:

Configurable, IndexingFilter, Pluggable

public class FeedIndexingFilter
extends Object
implements IndexingFilter

Since:

NUTCH-444 An IndexingFilter implementation to pull out the relevant extracted Metadata fields from the RSS feeds and into the index.

Author:

dogacan, mattmann

Field Summary

Fields

Modifier and Type	Field	Description
static final String	dateFormatStr

Fields inherited from interface org.apache.nutch.indexer.IndexingFilter

X_POINT_ID

Constructor Summary

Constructors

Constructor	Description
FeedIndexingFilter()

Method Summary

Modifier and Type	Method	Description
NutchDocument	filter(NutchDocument doc, Parse parse, Text url, CrawlDatum datum, Inlinks inlinks)	Extracts out the relevant fields: FEED_AUTHOR FEED_TAGS FEED_PUBLISHED FEED_UPDATED FEED And sends them to the Indexer for indexing within the Nutch index.
Configuration	getConf()
void	setConf(Configuration conf)	Sets the Configuration object used to configure this IndexingFilter.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

dateFormatStr

public static final String dateFormatStr

See Also:

• Constant Field Values

Constructor Details

FeedIndexingFilter

public FeedIndexingFilter()

Method Details

filter

public NutchDocument filter(NutchDocument doc,
 Parse parse,
 Text url,
 CrawlDatum datum,
 Inlinks inlinks)
                     throws IndexingException

Extracts out the relevant fields:

• FEED_AUTHOR
• FEED_TAGS
• FEED_PUBLISHED
• FEED_UPDATED
• FEED

And sends them to the Indexer for indexing within the Nutch index.

Specified by:

filter in interface IndexingFilter

Parameters:

doc - document instance for collecting fields

parse - parse data instance

url - page url

datum - crawl datum for the page (fetch datum from segment containing fetch status and fetch time)

inlinks - page inlinks

Returns:

modified (or a new) document instance, or null (meaning the document should be discarded)

Throws:

IndexingException - if an error occurs during during filtering

getConf

public Configuration getConf()

Specified by:

getConf in interface Configurable

Returns:

the Configuration object used to configure this IndexingFilter.

setConf

public void setConf(Configuration conf)

Sets the Configuration object used to configure this IndexingFilter.

Specified by:

setConf in interface Configurable

Parameters:

conf - The Configuration object used to configure this IndexingFilter.