Package io.outofprintmagazine.corpus.batch.impl

Class HttpDownload

java.lang.Object

io.outofprintmagazine.corpus.batch.CorpusBatchStep

io.outofprintmagazine.corpus.batch.impl.HttpDownload

All Implemented Interfaces:

ICorpusBatchStep

public class HttpDownload
extends CorpusBatchStep
implements ICorpusBatchStep

Field Summary

Fields inherited from class io.outofprintmagazine.corpus.batch.CorpusBatchStep

dictionaryPOS

Constructor Summary

Constructors

Constructor	Description
HttpDownload()

Method Summary

Modifier and Type	Method	Description
com.fasterxml.jackson.databind.node.ObjectNode	getDefaultProperties()
protected org.apache.http.impl.client.CloseableHttpClient	getHttpClient()
protected String	httpDownload(String url, com.fasterxml.jackson.databind.node.ObjectNode properties)
com.fasterxml.jackson.databind.node.ArrayNode	runOne(com.fasterxml.jackson.databind.node.ObjectNode inputStepItem)

Methods inherited from class io.outofprintmagazine.corpus.batch.CorpusBatchStep

copyInputToOutput, copyInputToOutput, getAuthor, getAuthor, getData, getDate, getDate, getDateFormat, getDocID, getExtensionFromMimeType, getJsonNodeFromStorage, getJsonNodeFromStorage, getJsoupDocumentFromStorage, getJsoupDocumentFromStorageNormalized, getLink, getMapper, getMimeTypeFromExtension, getOutputScratchFilePath, getOutputScratchFilePath, getOutputScratchFilePathFromInput, getParameterStore, getStorage, getStorageLink, getText, getText, getTextDocumentFromStorage, getTextDocumentFromStorage, getTextWithSelector, getThumbnail, getTitle, getTitle, isDictionaryWord, run, setAuthor, setAuthor, setData, setDate, setDate, setDate, setDocID, setLink, setParameterStore, setStorage, setStorageLink, setThumbnail, setThumbnail, setTitle, setTitle

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.outofprintmagazine.corpus.batch.ICorpusBatchStep

getData, run, setData, setParameterStore, setStorage

Constructor Detail

HttpDownload

public HttpDownload()

Method Detail

getDefaultProperties

public com.fasterxml.jackson.databind.node.ObjectNode getDefaultProperties()

Specified by:

getDefaultProperties in interface ICorpusBatchStep

Overrides:

getDefaultProperties in class CorpusBatchStep

runOne

public com.fasterxml.jackson.databind.node.ArrayNode runOne(com.fasterxml.jackson.databind.node.ObjectNode inputStepItem)
                                                     throws Exception

Specified by:

runOne in interface ICorpusBatchStep

Specified by:

runOne in class CorpusBatchStep

Throws:

Exception

httpDownload

protected String httpDownload(String url,
                              com.fasterxml.jackson.databind.node.ObjectNode properties)
                       throws IOException

Throws:

IOException

getHttpClient

protected org.apache.http.impl.client.CloseableHttpClient getHttpClient()