StackVision Bot Information

About StackVision Bot

StackVision Bot is our web crawler that respectfully gathers publicly available business information to power our competitive intelligence platform. We are committed to responsible crawling practices.

What We Crawl

• Company homepages and about pages
• Technology indicators (JavaScript libraries, meta tags)
• Business information (company names, industries)
• Publicly available review sites

What We DON'T Crawl

• Personal information or email addresses
• Password-protected areas
• Internal company documents
• Areas blocked by robots.txt

Our Crawling Practices

1. Robots.txt Compliance

We always check and respect your robots.txt file. If you disallow our bot, we will not crawl your site. Period.

2. Rate Limiting

• Default: Maximum 1 request per second per domain
• We respect Crawl-delay directives in robots.txt
• No parallel requests to the same domain

3. Identification

Our bot clearly identifies itself with a descriptive user agent that includes a link to this page.

How to Control Our Bot

Option 1: Robots.txt (Recommended)

Add the following to your robots.txt file:

# Block StackVision Bot completely
User-agent: StackVision-Bot
Disallow: /

# Or allow with restrictions
User-agent: StackVision-Bot
Crawl-delay: 5
Disallow: /private/
Disallow: /admin/
Allow: /

Option 2: Contact Us

Email us at bot@stackvision.com to request exclusion from our crawling.

Frequently Asked Questions

Why is StackVision Bot visiting my site?

Our users search for companies using specific technologies or analyze competitive landscapes. Your site may have been identified as relevant to these searches.

How often will you crawl my site?

We cache results for 90 days, so we typically won't re-crawl your site more than once every three months unless significant changes are detected.

Can I see what data you've collected?

Yes! Contact us at privacy@stackvision.com with your domain, and we'll provide any data we have.

Do you sell the data you collect?

No. We provide technology intelligence to our users for business development purposes. Users cannot bulk export or resell data.

Technical Details

• Bot Name: StackVision-Bot
• Version: 1.0
• Accepts-Encoding: gzip, deflate
• Connection: Keep-Alive (when appropriate)
• JavaScript Execution: No (static HTML only)

Report Abuse

If you believe our bot is misbehaving or not respecting your robots.txt, please contact us immediately:

• Email: abuse@stackvision.com
• Include your domain and access logs if possible
• We commit to responding within 24 hours