How to Use the Scraper Site

Admin Panel

The Admin panel is where you manage users, scrapes, and results.

Creating a New User

  1. Log in to the Admin panel.
  2. Go to Users and click Add User.
  3. Fill in a username, password, and email address.
  4. Enable Staff status so the user can access the Admin panel and start scrapes.
  5. Optionally, enable Superuser status if they should have full control.
  6. Save the user. They can now log in and manage scrapes.

Creating a Scrape

In the Admin panel, go to Scrapes and click Add Scrape. Fill in the fields:

Save the scrape. The system checks once per day at a scheduled time to determine which scrapes need to run (based on whether they are set to run once, daily or weekly), and executes them accordingly.

RSS Feed

The RSS feed provides a machine-readable stream of the latest results. Subscribe to it in your favorite reader to stay updated automatically.

Homepage & Results

The homepage shows the latest results, sorted newest first by default. You can search, filter, and paginate through results.

Notifications

When new results are found, the RSS feed is updated and email notifications are sent only to the users selected in the scrape's "Notify Users" field when the scrape was created.