Package org.codelibs.fess.crawler.transformer

Class AbstractFessFileTransformer

java.lang.Object
org.codelibs.fess.crawler.transformer.impl.AbstractTransformer
org.codelibs.fess.crawler.transformer.AbstractFessFileTransformer
All Implemented Interfaces:
FessTransformer, org.codelibs.fess.crawler.transformer.Transformer
Direct Known Subclasses:
FessFileTransformer, FessStandardTransformer
public abstract class AbstractFessFileTransformer extends org.codelibs.fess.crawler.transformer.impl.AbstractTransformer implements FessTransformer
The abstract transformer for Fess.

  • Field Details

    • metaContentMapping

      protected Map<String,String> metaContentMapping
      The mapping for meta content.

    • fessConfig

      protected org.codelibs.fess.mylasta.direction.FessConfig fessConfig
      The Fess configuration.

    • dataSerializer

      protected DataSerializer dataSerializer
      The data serializer.

  • Constructor Details

    • AbstractFessFileTransformer

      public AbstractFessFileTransformer()
      Default constructor.

  • Method Details

    • getExtractor

      protected abstract org.codelibs.fess.crawler.extractor.Extractor getExtractor(org.codelibs.fess.crawler.entity.ResponseData responseData)
      Get the extractor.
      Parameters:
      responseData - The response data.
      Returns:
      The extractor.

    • transform

      public org.codelibs.fess.crawler.entity.ResultData transform(org.codelibs.fess.crawler.entity.ResponseData responseData)
      Specified by:
      transform in interface org.codelibs.fess.crawler.transformer.Transformer

    • generateData

      protected Map<String,Object> generateData(org.codelibs.fess.crawler.entity.ResponseData responseData)
      Generate the data.
      Parameters:
      responseData - The response data.
      Returns:
      The data.

    • getLastModified

      protected Date getLastModified(Map<String,Object> dataMap, org.codelibs.fess.crawler.entity.ResponseData responseData)
      Get the last modified date.
      Parameters:
      dataMap - The data map.
      responseData - The response data.
      Returns:
      The last modified date.

    • hasTitle

      protected boolean hasTitle(Map<String,Object> dataMap)
      Check if the data map has a title.
      Parameters:
      dataMap - The data map.
      Returns:
      true if the data map has a title.

    • createExtractParams

      protected Map<String,String> createExtractParams(org.codelibs.fess.crawler.entity.ResponseData responseData, org.codelibs.fess.opensearch.config.exentity.CrawlingConfig crawlingConfig)
      Create the parameters for extraction.
      Parameters:
      responseData - The response data.
      crawlingConfig - The crawling configuration.
      Returns:
      The parameters for extraction.

    • getExtractData

      protected org.codelibs.fess.crawler.entity.ExtractData getExtractData(org.codelibs.fess.crawler.extractor.Extractor extractor, InputStream in, Map<String,String> params)
      Get the extracted data.
      Parameters:
      extractor - The extractor.
      in - The input stream.
      params - The parameters.
      Returns:
      The extracted data.

    • getResourceName

      protected String getResourceName(org.codelibs.fess.crawler.entity.ResponseData responseData)
      Get the resource name.
      Parameters:
      responseData - The response data.
      Returns:
      The resource name.

    • getHostOnFile

      protected String getHostOnFile(String url)
      Get the host on file.
      Parameters:
      url - The URL.
      Returns:
      The host on file.

    • getRoleTypes

      protected List<String> getRoleTypes(org.codelibs.fess.crawler.entity.ResponseData responseData)
      Get the role types.
      Parameters:
      responseData - The response data.
      Returns:
      The role types.

    • getSiteOnFile

      protected String getSiteOnFile(String url, String encoding)
      Get the site on file.
      Parameters:
      url - The URL.
      encoding - The encoding.
      Returns:
      The site on file.

    • getData

      public Object getData(org.codelibs.fess.crawler.entity.AccessResultData<?> accessResultData)
      Specified by:
      getData in interface org.codelibs.fess.crawler.transformer.Transformer

    • addMetaContentMapping

      public void addMetaContentMapping(String metaname, String dynamicField)
      Add the meta content mapping.
      Parameters:
      metaname - The meta name.
      dynamicField - The dynamic field.