aduana
Introduction
Components
Installation
Python library
Installation
Using Scrapy/Frontera with Aduana
Single spider backend
Distributed spider backend
WebBackend REST API
Running the examples
C Library
CrawledPage
Data structures
Constructor/Destructor
Manipulate links
Set content hash
PageInfo
Data structures
Constructor/Destructor
Functions
PageDB
URL hash
Index
Data structures
Constructor/Destructor
Add page
Get info from database
Database settings
Export database
PageInfoList
Data structures
Constructor/Destructor
Functions
LinkStream
Data structures
Constructor/Destructor
Functions
HashInfoStream
Data structures
Constructor/Destructor
Functions
HashIdxStream
Data structures
Constructor/Destructor
Functions
DomainTemp
Data structures
Constructor/Destructor
Functions
Error handling
Data structures
Constructor/Destructor
Functions
TxnManager
Data structures
Constructor/Destructor
Functions
BFScheduler
Data structures
Constructor/Destructor
Input/Output
Update scores
Settings
Scorer
PageRankScorer
Data structures
Constructor/Destructor
Functions
Settings
HitsScorer
Data structures
Constructor/Destructor
Functions
Settings
PageRank
Data structures
Constructor/Destructor
Functions
Hits
Data structures
Constructor/Destructor
Functions
MMapArray
Data structures
Constructor/Destructor
Functions
aduana
Docs
»
Welcome to aduana’s documentation!
Edit on GitHub
Welcome to aduana’s documentation!
¶
Contents:
Introduction
Components
Installation
Python library
Installation
Using Scrapy/Frontera with Aduana
Single spider backend
Distributed spider backend
Running the examples
C Library
CrawledPage
PageInfo
PageDB
PageInfoList
LinkStream
HashInfoStream
HashIdxStream
DomainTemp
Error handling
TxnManager
BFScheduler
Scorer
PageRankScorer
Settings
HitsScorer
Settings
PageRank
Hits
MMapArray
Indices and tables
¶
Index
Module Index
Search Page
Read the Docs
v: latest
Versions
latest
Downloads
pdf
htmlzip
epub
On Read the Docs
Project Home
Builds
Free document hosting provided by
Read the Docs
.