Class OutlinkExtractor

java.lang.Object
org.apache.nutch.parse.OutlinkExtractor

public class OutlinkExtractor extends Object
Extractor to extract Outlinks / URLs from plain text using Regular Expressions.
Since:
0.7
Version:
1.0
Author:
Stephan Strittmatter - http://www.sybit.de
See Also:
  • Constructor Details

    • OutlinkExtractor

      public OutlinkExtractor()
  • Method Details

    • getOutlinks

      public static Outlink[] getOutlinks(String plainText, Configuration conf)
      Extracts Outlink from given plain text. Applying this method to non-plain-text can result in extremely lengthy runtimes for parasitic cases (postscript is a known example).
      Parameters:
      plainText - the plain text from wich URLs should be extracted.
      conf - a populated Configuration
      Returns:
      Array of Outlinks within found in plainText
    • getOutlinks

      public static Outlink[] getOutlinks(String plainText, String anchor, Configuration conf)
      Extracts Outlink from given plain text and adds anchor to the extracted Outlinks
      Parameters:
      plainText - the plain text from wich URLs should be extracted.
      anchor - the anchor of the url
      conf - a populated Configuration
      Returns:
      Array of Outlinks within found in plainText