RivalscopeBot
Last updated October 8, 2026
RivalscopeBot visits public web pages that Rivalscope customers track — typically pricing, features, changelog, careers and home pages — to detect changes.
How we crawl
- User-Agent:
RivalscopeBot/1.0 (+https://getrivalscope.com/bot) - We obey robots.txt. Disallow “RivalscopeBot” or “*” and we stop.
- We fetch at most one page every 5 seconds per domain and check each page at most once a day.
- We use conditional requests (ETag / If-Modified-Since) and skip unchanged pages.
- We never log in, never solve CAPTCHAs and never try to bypass bot protection. Blocked pages are marked blocked and left alone.
Contact
Questions or problems: hello@getrivalscope.com. We respond within one business day.