org.apache.nutch.fetcher

Class Fetcher.InputFormat

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat<K,V>

org.apache.hadoop.mapred.SequenceFileInputFormat<org.apache.hadoop.io.Text,CrawlDatum>

org.apache.nutch.fetcher.Fetcher.InputFormat

All Implemented Interfaces:

org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.Text,CrawlDatum>

Enclosing class:

Fetcher

public static class Fetcher.InputFormat
extends org.apache.hadoop.mapred.SequenceFileInputFormat<org.apache.hadoop.io.Text,CrawlDatum>

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileInputFormat

org.apache.hadoop.mapred.FileInputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

LOG

Constructor Summary

Constructors

Constructor and Description
Fetcher.InputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapred.InputSplit[]	getSplits(org.apache.hadoop.mapred.JobConf job, int nSplits) Don't split inputs, to keep things polite.

Methods inherited from class org.apache.hadoop.mapred.SequenceFileInputFormat

getRecordReader, listStatus

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, isSplitable, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Fetcher.InputFormat

public Fetcher.InputFormat()

Method Detail

getSplits

public org.apache.hadoop.mapred.InputSplit[] getSplits(org.apache.hadoop.mapred.JobConf job,
                                              int nSplits)
                                                throws IOException

Don't split inputs, to keep things polite.

Specified by:

getSplits in interface org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.Text,CrawlDatum>

Overrides:

getSplits in class org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.Text,CrawlDatum>

Throws:

IOException