Package org.apache.nutch.protocol.htmlunit

Class Http

java.lang.Object

org.apache.nutch.protocol.http.api.HttpBase

org.apache.nutch.protocol.htmlunit.Http

All Implemented Interfaces:

Configurable, Pluggable, Protocol

public class Http
extends HttpBase

Field Summary

Fields

Modifier and Type	Field	Description
protected static final org.slf4j.Logger	LOG

Fields inherited from class org.apache.nutch.protocol.http.api.HttpBase

accept, acceptCharset, acceptLanguage, BUFFER_SIZE, COOKIE, enableCookieHeader, enableIfModifiedsinceHeader, maxContent, maxCrawlDelay, maxDuration, partialAsTruncated, proxyException, proxyHost, proxyPort, proxyType, RESPONSE_TIME, responseTime, storeHttpHeaders, storeHttpRequest, storeIPAddress, storeProtocolVersions, timeout, tlsCheckCertificate, tlsPreferredCipherSuites, tlsPreferredProtocols, useHttp11, useHttp2, useProxy, userAgent

Fields inherited from interface org.apache.nutch.protocol.Protocol

X_POINT_ID

Constructor Summary

Constructors

Constructor	Description
Http()	Default constructor.

Method Summary

Modifier and Type	Method	Description
protected Response	getResponse(URL url, CrawlDatum datum, boolean redirect)
static void	main(String[] args)
void	setConf(Configuration conf)	Set the Configuration object.

Methods inherited from class org.apache.nutch.protocol.http.api.HttpBase

getAccept, getAcceptCharset, getAcceptLanguage, getConf, getCookie, getMaxContent, getMaxDuration, getProtocolOutput, getProxyHost, getProxyPort, getRobotRules, getRobotRules, getTimeout, getTlsPreferredCipherSuites, getTlsPreferredProtocols, getUseHttp11, getUserAgent, isCookieEnabled, isIfModifiedSinceEnabled, isProxyException, isStoreHttpHeaders, isStoreHttpRequest, isStoreIPAddress, isStorePartialAsTruncated, isTlsCheckCertificates, logConf, main, processDeflateEncoded, processGzipEncoded, useProxy, useProxy, useProxy

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.nutch.protocol.Protocol

resolveUrl

Field Details

LOG

protected static final org.slf4j.Logger LOG

Constructor Details

Http

public Http()

Default constructor.

Method Details

setConf

public void setConf(Configuration conf)

Set the Configuration object.

Specified by:

setConf in interface Configurable

Overrides:

setConf in class HttpBase

Parameters:

conf - a popultaed Configuration

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception

getResponse

protected Response getResponse(URL url,
 CrawlDatum datum,
 boolean redirect)
                        throws ProtocolException,
IOException

Specified by:

getResponse in class HttpBase

Throws:

ProtocolException

IOException