Task Server module (fcs.server)

This module contains implementation of Task Server. Each Task Server is responsible for handling just one task at the same time. However, it does not mean that one physical machine corresponds with only one Task Server, since this model is logical. Each Task Server contains its own database for storing links or crawled data.

fcs.server.content_db

fcs.server.crawling_depth_policy

fcs.server.data_base_policy_module

fcs.server.graph_db

fcs.server.link_db

fcs.server.task_server

fcs.server.url_processor

fcs.server.web_interface