Package org.codelibs.fess.helper

Class CrawlerLogHelper

java.lang.Object

org.codelibs.fess.crawler.helper.impl.LogHelperImpl

org.codelibs.fess.helper.CrawlerLogHelper

All Implemented Interfaces:

org.codelibs.fess.crawler.helper.LogHelper

public class CrawlerLogHelper
extends org.codelibs.fess.crawler.helper.impl.LogHelperImpl

Helper class for crawler logging operations. Extends LogHelperImpl to provide specialized logging functionality for crawler operations, including failure URL tracking and crawler statistics integration.

Constructor Summary

Constructors

Constructor	Description
CrawlerLogHelper()	Creates a new instance of CrawlerLogHelper.

Method Summary

Modifier and Type	Method	Description
protected org.codelibs.fess.opensearch.config.exentity.CrawlingConfig	getCrawlingConfig(String sessionCountId)	Gets the crawling configuration for the specified session ID.
void	log(org.codelibs.fess.crawler.log.LogType key, Object... objs)
protected void	processCleanupCrawling(Object... objs)
protected void	processCrawlingAccessException(Object... objs)
protected void	processCrawlingException(Object... objs)
protected void	processFinishedCrawling(Object... objs)
protected void	processProcessChildUrlByException(Object... objs)
protected void	processProcessChildUrlsByException(Object... objs)
protected void	processStartCrawling(Object... objs)
protected org.codelibs.fess.opensearch.config.exentity.FailureUrl	storeFailureUrl(org.codelibs.fess.crawler.CrawlerContext crawlerContext, org.codelibs.fess.crawler.entity.UrlQueue<?> urlQueue, String errorName, Throwable e)	Stores a failure URL with error information for later analysis.

Methods inherited from class org.codelibs.fess.crawler.helper.impl.LogHelperImpl

processCheckLastModified, processDefault, processFinishedThread, processGetContent, processNoResponseProcessor, processNoRule, processNotModified, processNoUrlInQueue, processProcessResponse, processRedirectLocation, processStartThread, processSystemError, processUnsupportedUrlAtCrawlingStarted

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

CrawlerLogHelper

public CrawlerLogHelper()

Creates a new instance of CrawlerLogHelper.

Method Details

log

public void log(org.codelibs.fess.crawler.log.LogType key,
 Object... objs)

Specified by:

log in interface org.codelibs.fess.crawler.helper.LogHelper

Overrides:

log in class org.codelibs.fess.crawler.helper.impl.LogHelperImpl

processStartCrawling

protected void processStartCrawling(Object... objs)

Overrides:

processStartCrawling in class org.codelibs.fess.crawler.helper.impl.LogHelperImpl

processCleanupCrawling

protected void processCleanupCrawling(Object... objs)

Overrides:

processCleanupCrawling in class org.codelibs.fess.crawler.helper.impl.LogHelperImpl

processProcessChildUrlByException

protected void processProcessChildUrlByException(Object... objs)

Overrides:

processProcessChildUrlByException in class org.codelibs.fess.crawler.helper.impl.LogHelperImpl

processProcessChildUrlsByException

protected void processProcessChildUrlsByException(Object... objs)

Overrides:

processProcessChildUrlsByException in class org.codelibs.fess.crawler.helper.impl.LogHelperImpl

processFinishedCrawling

protected void processFinishedCrawling(Object... objs)

Overrides:

processFinishedCrawling in class org.codelibs.fess.crawler.helper.impl.LogHelperImpl

processCrawlingAccessException

protected void processCrawlingAccessException(Object... objs)

Overrides:

processCrawlingAccessException in class org.codelibs.fess.crawler.helper.impl.LogHelperImpl

processCrawlingException

protected void processCrawlingException(Object... objs)

Overrides:

processCrawlingException in class org.codelibs.fess.crawler.helper.impl.LogHelperImpl

storeFailureUrl

protected org.codelibs.fess.opensearch.config.exentity.FailureUrl storeFailureUrl(org.codelibs.fess.crawler.CrawlerContext crawlerContext,
 org.codelibs.fess.crawler.entity.UrlQueue<?> urlQueue,
 String errorName,
 Throwable e)

Stores a failure URL with error information for later analysis.

Parameters:

crawlerContext - the crawler context

urlQueue - the URL queue containing the failed URL

errorName - the name/type of the error

e - the throwable that caused the failure

Returns:

the stored FailureUrl entity

getCrawlingConfig

protected org.codelibs.fess.opensearch.config.exentity.CrawlingConfig getCrawlingConfig(String sessionCountId)

Gets the crawling configuration for the specified session ID.

Parameters:

sessionCountId - the session count ID

Returns:

the crawling configuration