Skip to content

RivalscopeBot

Last updated October 8, 2026

RivalscopeBot visits public web pages that Rivalscope customers track — typically pricing, features, changelog, careers and home pages — to detect changes.

How we crawl

  • User-Agent: RivalscopeBot/1.0 (+https://getrivalscope.com/bot)
  • We obey robots.txt. Disallow “RivalscopeBot” or “*” and we stop.
  • We fetch at most one page every 5 seconds per domain and check each page at most once a day.
  • We use conditional requests (ETag / If-Modified-Since) and skip unchanged pages.
  • We never log in, never solve CAPTCHAs and never try to bypass bot protection. Blocked pages are marked blocked and left alone.

Contact

Questions or problems: hello@getrivalscope.com. We respond within one business day.