org.apache.nutch.crawl

Class CrawlDbReader.CrawlDatumCsvOutputFormat

java.lang.Object

org.apache.hadoop.mapred.FileOutputFormat<org.apache.hadoop.io.Text,CrawlDatum>

org.apache.nutch.crawl.CrawlDbReader.CrawlDatumCsvOutputFormat

All Implemented Interfaces:

org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,CrawlDatum>

Enclosing class:

CrawlDbReader

public static class CrawlDbReader.CrawlDatumCsvOutputFormat
extends org.apache.hadoop.mapred.FileOutputFormat<org.apache.hadoop.io.Text,CrawlDatum>

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	CrawlDbReader.CrawlDatumCsvOutputFormat.LineRecordWriter

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileOutputFormat

org.apache.hadoop.mapred.FileOutputFormat.Counter

Constructor Summary

Constructors

Constructor and Description
CrawlDbReader.CrawlDatumCsvOutputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.Text,CrawlDatum>	getRecordWriter(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.mapred.JobConf job, String name, org.apache.hadoop.util.Progressable progress)

Methods inherited from class org.apache.hadoop.mapred.FileOutputFormat

checkOutputSpecs, getCompressOutput, getOutputCompressorClass, getOutputPath, getPathForCustomFile, getTaskOutputPath, getUniqueName, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CrawlDbReader.CrawlDatumCsvOutputFormat

public CrawlDbReader.CrawlDatumCsvOutputFormat()

Method Detail

getRecordWriter

public org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.Text,CrawlDatum> getRecordWriter(org.apache.hadoop.fs.FileSystem fs,
                                                                                          org.apache.hadoop.mapred.JobConf job,
                                                                                          String name,
                                                                                          org.apache.hadoop.util.Progressable progress)
                                                                                            throws IOException

Specified by:

getRecordWriter in interface org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,CrawlDatum>

Specified by:

getRecordWriter in class org.apache.hadoop.mapred.FileOutputFormat<org.apache.hadoop.io.Text,CrawlDatum>

Throws:

IOException