Welcome to aduana’s documentation!

Contents:

• Introduction
  • Components
  • Installation
• Python library
  • Installation
  • Using Scrapy/Frontera with Aduana
  • Single spider backend
  • Distributed spider backend
  • Running the examples
• C Library
  • CrawledPage
  • PageInfo
  • PageDB
  • PageInfoList
  • LinkStream
  • HashInfoStream
  • HashIdxStream
  • DomainTemp
  • Error handling
  • TxnManager
  • BFScheduler
  • Scorer
  • PageRankScorer
  • Settings
  • HitsScorer
  • Settings
  • PageRank
  • Hits
  • MMapArray

Indices and tables

• Index
• Module Index
• Search Page