org.apache.manifoldcf.crawler.connectors.webcrawler
Class ThrottledFetcher.DataRecorder

java.lang.Object
  org.apache.manifoldcf.crawler.connectors.webcrawler.ThrottledFetcher.DataRecorder

Enclosing class:

ThrottledFetcher

protected static class ThrottledFetcher.DataRecorder
extends java.lang.Object

This class takes care of recording data and results for posterity

Field Summary

protected int

documentNumber

Constructor Summary

ThrottledFetcher.DataRecorder()

Method Summary

ThrottledFetcher.DataSession	getSession(java.lang.String url)
java.lang.String	writeResponseRecord(java.lang.String url, int responseCode, java.util.ArrayList headerNames, java.util.ArrayList headerValues) Atomically write resultlog record, returning data file name to use

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

documentNumber

protected int documentNumber

Constructor Detail

ThrottledFetcher.DataRecorder

public ThrottledFetcher.DataRecorder()

Method Detail

getSession

public ThrottledFetcher.DataSession getSession(java.lang.String url)
                                        throws org.apache.manifoldcf.core.interfaces.ManifoldCFException

Throws:

org.apache.manifoldcf.core.interfaces.ManifoldCFException

writeResponseRecord

public java.lang.String writeResponseRecord(java.lang.String url,
                                            int responseCode,
                                            java.util.ArrayList headerNames,
                                            java.util.ArrayList headerValues)
                                     throws org.apache.manifoldcf.core.interfaces.ManifoldCFException

Atomically write resultlog record, returning data file name to use

Throws:

org.apache.manifoldcf.core.interfaces.ManifoldCFException