Package org.apache.nutch.collection

Class CollectionManager

java.lang.Object
org.apache.hadoop.conf.Configured
org.apache.nutch.collection.CollectionManager
All Implemented Interfaces:
Configurable
public class CollectionManager extends Configured

  • Field Details

  • Constructor Details

    • CollectionManager

      public CollectionManager(Configuration conf)

    • CollectionManager

      protected CollectionManager()
      Used for testing

  • Method Details

    • init

      protected void init()

    • parse

      protected void parse(InputStream input)

    • getCollectionManager

      public static CollectionManager getCollectionManager(Configuration conf)

    • getSubColection

      public Subcollection getSubColection(String id)
      Get the named subcollection
      Parameters:
      id - the id of a subcollection ot retrieve
      Returns:
      Named SubCollection (or null if not existing)

    • deleteSubCollection

      public void deleteSubCollection(String id) throws IOException
      Delete named subcollection
      Parameters:
      id - Id of SubCollection to delete
      Throws:
      IOException - If there is an error retrieving and deleting the subcollection from the collection.

    • createSubCollection

      public Subcollection createSubCollection(String id, String name)
      Create a new subcollection.
      Parameters:
      id - Id of SubCollection to create
      name - Name of SubCollection to create
      Returns:
      Created SubCollection or null if allready existed

    • getSubCollections

      public List<Subcollection> getSubCollections(String url)
      Return names of collections url is part of
      Parameters:
      url - The url to test against Collections
      Returns:
      A List of Subcollection's

    • getAll

      public Collection<Subcollection> getAll()
      Returns all collections
      Returns:
      All collections CollectionManager knows about

    • save

      public void save() throws IOException
      Save collections into file
      Throws:
      IOException - If there is a fatal error flushing or closing the FileOutputStream associated with the save process.