Bot Intelligence (/analytics/bots)

Unlike traditional analytics platforms that either silently discard bot hits or allow them to inflate your human visitor numbers, VeloStats isolates automated traffic into the dedicated Bot Intelligence view. This keeps your human metrics 100% clean while giving you full visibility into how search engines, AI scrapers, and automated tools interact with your site.

1. Bot Summary Metrics

Four top-level cards summarize automated activity over your selected date range:

• Total Bot Requests: Total automated, crawler, and non-human pings intercepted, along with percentage change vs. the prior period.
• Human vs Bot Ratio: A visual split bar comparing verified Human % against Bot % across your total incoming traffic volume.
• Search Crawler Hits: Legitimate indexing activity from search engines such as Googlebot, Bingbot, Applebot, and DuckDuckBot.
• AI Scraper Hits: Requests from LLM training crawlers and AI answer engines such as OpenAI GPTBot, Anthropic ClaudeBot, Perplexity, and ByteSpider.

2. Hierarchical Traffic & Bot Breakdown

The Traffic & Bot Breakdown panel lets you drill down interactively into three tiers of traffic classification:

1. Tier 1 (Traffic Type): Splits all incoming requests into Verified Human vs. Bot & Automated.
2. Tier 2 (Bot Function Category): Breaks down automated traffic by functional category:
   • Search Engine (SEO indexing spiders)
   • AI Crawler (LLM scrapers and AI assistants)
   • Social Media (Link preview bots from Slack, Discord, X/Twitter, LinkedIn, Facebook)
   • Datacenter / Cloud (Requests originating from AWS, Hetzner, DigitalOcean, GCP, or OVH ASNs without human verification)
   • Headless / Automation (Playwright, Puppeteer, Selenium, WebDriver, or synthetic browser traps)
3. Tier 3 (Specific Verdict Signature): Expands each category to show exact bot identities (e.g., google_search, openai_gptbot, anthropic_claudebot, linkedin, quickback_bot).

3. Endpoint Scrape Matrix & Log Table

At the bottom of the page, the Endpoint Scrape Matrix shows which URL paths bots are targeting most heavily:

• Target Endpoint: The URL path being crawled (e.g., /, /docs, /sitemap.xml).
• User-Agent Signature: The detected bot name and raw User-Agent string.
• Classification Badge: Color-coded category badge (Search, AI Scraper, Social, Datacenter, Headless).
• Hit Count & Share: Total requests and percentage share of bot traffic.
• Status Breakdown: Visual bar indicating HTTP status outcomes (200 OK, 304 Not Modified, 4xx, 5xx).
• Last Seen: Relative timestamp of the most recent hit from that crawler on that endpoint.
• Filter & Search: Filter logs by category tab or search by endpoint path or User-Agent string.