Package org.apache.nutch.fetcher

Class Fetcher.FetcherReducer

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<Text,NutchWritable,Text,NutchWritable>

org.apache.nutch.fetcher.Fetcher.FetcherReducer

Enclosing class:

Fetcher

public static class Fetcher.FetcherReducer
extends Reducer<Text,NutchWritable,Text,NutchWritable>

Reducer that passes through (url, datum) records and merges TDigests from map tasks to set job-level latency percentile counters.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

Reducer.Context

Constructor Summary

Constructors

Constructor	Description
FetcherReducer()

Method Summary

Modifier and Type	Method	Description
void	reduce(Text key, Iterable<NutchWritable> values, Reducer<Text,NutchWritable,Text,NutchWritable>.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

cleanup, run, setup

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

FetcherReducer

public FetcherReducer()

Method Details

reduce

public void reduce(Text key,
 Iterable<NutchWritable> values,
 Reducer<Text,NutchWritable,Text,NutchWritable>.Context context)
            throws IOException,
InterruptedException

Overrides:

reduce in class Reducer<Text,NutchWritable,Text,NutchWritable>

Throws:

IOException

InterruptedException