FCS basics

Registration

  1. Click on Register button on main page.
    _images/home.png
  2. Fill fields with user name, correct email and password (two times the same).
    _images/reg1.png
  3. Confirm with Register button.

  4. Check your email. Registration message should wait for you. Click the link in email content.
    _images/reg2.png
  5. Your account is activated. Now you can log in with your email or login and password.

Main page

_images/home_log.png

On main page you can:

  • API - see REST API documentation,
  • Tasks - display information about crawling tasks,
  • Change password - change your password,
  • Change your data - modify details of your account,
  • Show quota - check your permissions in creating task,
  • API keys - view keys required for using REST API,
  • Logout - finish work with system.

List of tasks

_images/task_list.png

This page presents all tasks of current user. They can be active (yellow rows), paused (grey rows) and finished (green rows). To decrease amount of elements in table you can filter them with two select lists and Filter button.

Create new task

  1. Click Add button under tasks’ list table.

  2. Fill form below. If not tell otherwise, all fields are mandatory.
    _images/c1.png
  3. In first row specify task’s name.

  4. Fill priority field with number from 1 to 10. The higher it is, the more important is this task

    in comparison with other tasks of this user.

  5. Give start links separated with white space.

  6. In the whitelist field you can specify list of regular expressions (separate them with comma)

    describing urls, which can be processed. If you leave this input empty, all urls will be crawled.

  7. Blacklist is list of regular expressions which cannot be crawled. Optional.

  8. In the next field set the maximal amount of pages which can be crawled.

  9. Select maximal date of task lasting in Expire field.

  10. In last input you can type list of MIME types which should be processed by crawler.

  11. Send form with Add.

  12. If you see message like below, task was created successfully.
    _images/c2.png

Edit existing task

  1. Click one of the rows in table with tasks.

  2. If task is finished, you cannot change anything. View should look like below:
    _images/e1.png
  3. If task is running or paused you can change some of its parameters, pause/resume it, stop, get crawling results:
    _images/e2.png
  4. After modifying task click Save changes.

Send feedback

If task is running or paused, on task edition page you can rate some pages. To send feedback to Task Server, you need to specify url and rating. Higher than 3 means that link is valuable, lower means that link is useless. Confirm with Send feedback button.

_images/f.png

Download crawling results

On the same page you can also download crawling results. Click Get data. In window which appears set size in MB of file with part of results. Click OK and download should begin.

_images/d.png