Package org.codelibs.fess.crawler.service

Class FessUrlQueueService

java.lang.Object
org.codelibs.fess.crawler.service.impl.AbstractCrawlerService
org.codelibs.fess.crawler.service.impl.OpenSearchUrlQueueService
org.codelibs.fess.crawler.service.FessUrlQueueService
All Implemented Interfaces:
org.codelibs.fess.crawler.service.UrlQueueService<org.codelibs.fess.crawler.entity.OpenSearchUrlQueue>
public class FessUrlQueueService extends org.codelibs.fess.crawler.service.impl.OpenSearchUrlQueueService

  • Nested Class Summary

    Nested classes/interfaces inherited from class org.codelibs.fess.crawler.service.impl.OpenSearchUrlQueueService

    org.codelibs.fess.crawler.service.impl.OpenSearchUrlQueueService.QueueHolder

    Nested classes/interfaces inherited from class org.codelibs.fess.crawler.service.impl.AbstractCrawlerService

    org.codelibs.fess.crawler.service.impl.AbstractCrawlerService.EsTimestampConverter

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    protected static final String
    ORDER_RANDOM
     
    protected static final String
    ORDER_SEQUENTIAL
     

    Fields inherited from class org.codelibs.fess.crawler.service.impl.OpenSearchUrlQueueService

    dataService, maxCrawlingQueueSize, pollingFetchSize, sessionCache

    Fields inherited from class org.codelibs.fess.crawler.service.impl.AbstractCrawlerService

    _DOC, bulkBufferSize, CREATE_TIME, fesenClient, ID, idPrefixLength, index, LAST_MODIFIED, murmur3Hash, numberOfReplicas, numberOfShards, scrollSize, scrollTimeout, SESSION_ID, timestampFields, URL

  • Constructor Summary

    Constructors
    Constructor
    Description
    FessUrlQueueService(org.codelibs.fess.crawler.util.OpenSearchCrawlerConfig crawlerConfig)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    protected List<org.codelibs.fess.crawler.entity.OpenSearchUrlQueue>
    fetchUrlQueueList(String sessionId)
     

    Methods inherited from class org.codelibs.fess.crawler.service.impl.OpenSearchUrlQueueService

    add, clearCache, delete, destroy, exists, generateUrlQueues, getQueueHolder, init, insert, offerAll, poll, saveSession, setMaxCrawlingQueueSize, setPollingFetchSize, updateSessionId, visited

    Methods inherited from class org.codelibs.fess.crawler.service.impl.AbstractCrawlerService

    buildFailureMessage, createMapping, delete, delete, deleteAll, deleteBySessionId, doInsertAll, get, getBulkBufferSize, getClient, getCount, getDateFromSource, getIndex, getList, getList, getScrollSize, getScrollTimeout, getXContentBuilder, insert, insertAll, insertAll, refresh, setBulkBufferSize, setId, setIdPrefixLength, setIndex, setNumberOfReplicas, setNumberOfShards, setScrollSize, setScrollTimeout

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    Methods inherited from interface org.codelibs.fess.crawler.service.UrlQueueService

    deleteAll

  • Field Details

  • Constructor Details

    • FessUrlQueueService

      public FessUrlQueueService(org.codelibs.fess.crawler.util.OpenSearchCrawlerConfig crawlerConfig)

  • Method Details

    • fetchUrlQueueList

      protected List<org.codelibs.fess.crawler.entity.OpenSearchUrlQueue> fetchUrlQueueList(String sessionId)
      Overrides:
      fetchUrlQueueList in class org.codelibs.fess.crawler.service.impl.OpenSearchUrlQueueService