Quickstart

Short instruction presenting how to launch Focused Crawling Search.

Note

Unix-based operation system and Vagrant (preferred 1.35 or higher) are required.

  1. Download project code from Github repository.

  2. Change directory into /fcs.

  3. In command line type vagrant up. Virtual machine with all requirements will be provisioned. Its ip address is 192.168.0.2.

  4. Start second shell, in both of them:

    • connect to machine with vagrant ssh,
    • activate python virtual environment: source ./fcs/bin/activate,
    • move to FCS Management web application main directory: cd /vagrant/fcs.

  5. In first terminal:

    • create data base: python manage.py syncdb,
    • apply data base migrations with python manage.py migrate,
    • set Userena permissions: python manage.py check_permissions,
    • start web application server: python manage.py runserver 192.168.0.2:8000 on local port 8000.

  6. In second terminal window start Autoscaling module: python manage.py autoscaling 192.168.0.2.

  7. Open browser and go to http://192.168.0.2:8000.

  8. Register new user. Activation mail should be displayed in console.

  9. Log in.

  10. Click Tasks ‣ Add new. Fill the form. Confirm with Add button.

  11. Crawling process will begin soon. You can monitor it in terminal’s windows and logs of crawler and server located in ./fcs/fcs.

  12. In task details(hyperlink in tasks table) you can download crawling results.