F
Fibr · ai.fibr.ai Bot Analytics
Last bot visit · 23s ago Updated Next UTC
3D 7D 14D 30D
01 · Headlines

How AI is reading us right now

7d · 13,745 successful bot pulls ↓ -9.8%
AI Citations · live reads 20 A real user asked an AI a question and it fetched our page
+33.3%
AI Training Crawls 296 Long-term knowledge accumulation
-82.1%
Unique AI tools 7/107 Of known AI tools, reading us this period
+1 new
Pages picked up 33 Distinct pages read by AI tools
-97.5%
⚠ Content gaps 35 Pages AI asked for that we don't have
-88 vs prev
Bytes served 274.2 MB Total response bytes (200-OK only)
AI share of bot traffic 52% vs. classic search engines
-42pp
02 · Trend

Bot activity, day by day

7d · 20 citations ↑ +33.3%
Last 7 days · daily hits i
Three lines, one story: AI citations vs training vs classic search.
AI Citations 20 · +33.3%
AI Training 296 · -82.1%
Search bots 294 · +200.0%
90 68 45 23 0 Aug 15 Aug 16 Aug 17 Aug 19 Aug 20 Aug 21
03 · Who's reading

The AI tool roster

7 of 107 AI tools active ↑ +16.7%
AI tool leaderboard
⌕
Tool Category Hits↓ Pages Last seen Trend
A
Ahrefs Audit
 SEO 12,064 1,506 1 hr ago
C
ClaudeBot
 Learning 256 12 23s ago
Y
Yandex
 Search 218 117 1 hr ago
P
Python-httpx
 Script 132 131 4 days ago
A
Ahrefs
 SEO 132 2 55 min ago
A
Amazonbot
 Learning 58 56 3 hr ago
B
Bingbot
 Search 46 15 7 hr ago
D
DataForSEO
 SEO 37 32 14 min ago
U
unknown-bot? untagged bot
 Other 31 16 1 hr ago
G
Googlebot
 Search 24 6 1 day ago
S
SearchGPT
 Query 17 1 18 hr ago
G
GPTBot
 Learning 16 8 18 hr ago
Bot category mix
i
13,745
Total bot hits
Learning bots
2% · 296
Search bots
2% · 294
Query bots
0% · 20
Other / unknown
7% · 895
SEO bots
89% · 12,240
04 · Content performance

What AI is reading

33 pages reached by AI ↓ -97.5%
Top pages — AI Citations
Pages winning live AI answers right now
Query bots
⌕
Page Citations↓ Tools Last cited
/robots.txt↗18218 hr ago
/llms.txt↗111 day ago
/sitemap-ai.xml↗113 days ago
Top pages — AI Training
Pages accumulating into future AI knowledge
Learning bots
⌕
Page Crawls↓ Tools Last crawled
/sitemap-ai.xml↗15334 min ago
/robots.txt↗10014 min ago
/↗7410 hr ago
/faq.md↗322 days ago
/landing-page/website-personalization-tools.md↗222 days ago
/llms.txt↗2110 hr ago
/amex-fibr-platform-v3.html↗211 day ago
/blog/website-personalization-strategies.md↗225 days ago
/faq/how-does-dynamic-image-personalization-work.md↗114 hr ago
/faq/what-are-common-cro-mistakes-to-avoid.md↗114 days ago
/conversion-rate-optimization/understanding-checkout-conversion.md↗113 days ago
/faq/what-are-effective-conversion-rate-optimization-strategies.md↗115 hr ago
/glossary/upsell-cross-sell-optimization.md↗116 days ago
/faq/how-do-i-use-analytics-to-improve-my-conversion-funnel-ux.md↗114 days ago
/faq/how-does-inventory-management-affect-a-brand-s-revenue-potential.md↗113 hr ago
/faq/how-much-do-ecommerce-cro-agencies-typically-charge.md↗114 days ago
/llm-personalization.md↗116 days ago
/ab-testing/best-practice.md↗114 days ago
/glossary/website-personalization.md↗116 days ago
/glossary/user-generated-content.md↗114 days ago
/blog/learning-from-the-best-how-these-companies-mastered-contextual-advertising.md↗116 days ago
/whitepaper/personalized-landing-pages.md↗116 days ago
/llms-full.txt↗114 days ago
/glossary/ai-personalization.md↗112 days ago
/faq/how-can-i-improve-conversion-rates-on-my-magento-store.md↗114 days ago
/faq/how-can-i-use-a-widget-to-promote-special-offers-on-my-shopify-store.md↗114 days ago
/pilot.md↗111 day ago
/faq/what-s-the-future-of-ai-image-generation-for-e-commerce-and-shopify.md↗114 days ago
/faq/what-s-the-role-of-ai-in-optimizing-critical-rendering-path-for-websites.md↗113 days ago
/faq/are-there-specific-shopify-themes-that-work-better-with-popups.md↗113 days ago
/faq/how-do-i-test-my-website-speed.md↗114 days ago
/faq/how-does-fibr-ai-analyze-the-effectiveness-of-shopify-popups.md↗114 days ago
/faq/how-do-i-determine-the-roi-of-cro-services.md↗116 days ago
05 · Content gaps

What AI wanted that we don't have

Each row is a content brief with measurable demand.

35 content gaps ↓ -71.5%
⚠ 35 gaps
Pages Query bots couldn't find
⚡ Highest urgency — real users asked, AI couldn't answer
✓
No urgent gaps
In the last 7 days, no real-user AI fetches (ChatGPT, Claude, Perplexity, SearchGPT) hit a missing page.
Pages all AI bots couldn't find
Including training crawler 404s — broader content demand
/tools↗
1 training crawl
A
1
A
1
/graphql↗
1 training crawl
C
1
/genesis↗
1 training crawl
A
1
/cookie-policy↗
1 training crawl
A
1
/debug/vars↗
1 training crawl
C
1
/privacy-policy↗
1 training crawl
A
1
/api/graphql↗
1 training crawl
C
1
/journey-personalization↗
1 training crawl
A
1
/customer-stories↗
1 training crawl
A
1
/max↗
1 training crawl
A
1
/terms-and-conditions↗
1 training crawl
A
1
/meta-ad-personalization↗
1 training crawl
A
1
/llm-personalization↗
1 training crawl
A
1
/.vscode/launch.json↗
1 training crawl
C
1
/application.properties↗
1 training crawl
G
1
/google-ad-quality-score↗
1 training crawl
A
1
A
1
A
1
/pilot/bulk-creation.md):↗
1 training crawl
C
1
A
1
A
1
A
1
A
1
C
1
/pilot/ad-personalization↗
1 training crawl
A
1
A
1
A
1
A
1
A
1
A
1
A
1
A
1
A
1
A
1
A
1
A
1
/bootstrap.properties↗
1 training crawl
C
1
Daily missing-page requests
A leading indicator: if this climbs, our coverage is falling behind AI demand.
404s from AI 7 today · new
Aug 15 Aug 18 Aug 21
06 · LLM Referral Traffic

What AI is converting for fibr.ai

Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above. The dashed marker shows when ai.fibr.ai went live.

LLM Referral Traffic 59
+5.4% vs prev 7d
LLM Platforms referring traffic 3 of 6 tracked AI surfaces
Pages receiving AI referrals 33 of 33 pages read by AI
Referral visits by AI surface — over time
Daily human click-throughs from each AI platform
i AI referral traffic up 5.4% to 59 sessions over the last 7 days. ChatGPT drove 47% of it.
NO OF VISITS 8 6 4 2 0 Aug 14 Aug 15 Aug 17 Aug 18 Aug 20 Aug 21 310 ai.fibr.ai launch

Referral traffic spikes often follow high-citation days — watch for a 1–3 day lag between AI citations and human click-throughs.

Top AI referrers
Which AI surfaces are converting citations into human visits
Tool User Sessions Page Views Landing Pages Trend
G
ChatGPT
 28 82 31
G
Gemini
 25 30 1
C
Claude
 6 3 2

ChatGPT leads with 28 sessions (47% of AI traffic). Gemini is #2 with 25 sessions.

07 · Identity

Who's really behind that user-agent?

Cross-checks the UA-claimed bot identity against the requesting IP's owning organisation. Mismatches = possible spoofers using residential proxies or fake UAs. Live since 2026-05-04

Bot × AS-Organisation pairs
Top 30 (bot, owning-organisation) combinations. Hover the verification badge for details.
Bot (claimed) AS-Organisation (actual) Hits↓ Identity
A
Ahrefs Audit
 Ahrefs USA 12,064 ? unknown
B
Browser (Chrome)
 Pfcloud UG 403 ? unknown
C
ClaudeBot
 Anthropic, PBC 251 ✓ verified
Y
Yandex
 Yandex enterprise network 218 ? unknown
P
Python-httpx
 Google LLC 130 ? unknown
A
Ahrefs
 Dmytro, Ahrefs Pte Ltd 120 ✓ verified
B
Browser (Safari)
 Pfcloud UG 92 ? unknown
B
Browser (Firefox)
 Pfcloud UG 85 ? unknown
B
Browser (Chrome)
 DigitalOcean, LLC 46 ? unknown
B
Bingbot
 Microsoft Corporation 46 ✓ verified
D
DataForSEO
 Dataforseo OU 37 ✓ verified
A
Amazonbot
 Amazon Technologies Inc. 32 ✓ verified
U
unknown-bot
 Google LLC 27 ? unknown
A
Amazonbot
 Amazon Data Services Northern Virginia 24 ✓ verified
B
Browser (Chrome)
 TECHOFF SRV LIMITED 23 ? unknown
B
Browser (Chrome)
 Oracle Corporation 20 ? unknown
B
Browser (Chrome)
 Google LLC 16 ? unknown
G
GPTBot
 Microsoft Limited 15 ✓ verified
G
Googlebot
 Google LLC 15 ✓ verified
B
Browser (Chrome)
 HostRoyale Technologies Pvt Ltd 13 ? unknown
A
Ahrefs
 Ahrefs Pte Ltd Dmytro 12 ✓ verified
F
Facebook
 Meta Platforms Ireland Limited 11 ? unknown
B
Browser (Chrome)
 Nivid Telecom India Private Limited 10 ? unknown
S
SearchGPT
 Microsoft Limited 10 ✓ verified
B
Browser (Safari)
 Amazon Data Services Northern Virginia 8 ? unknown
B
Browser (Chrome)
 TechTies Inc. 8 ? unknown
B
Browser (Chrome)
 Hetzner Online GmbH 8 ? unknown
B
Browser (Chrome)
 HOSTGNOME LTD 8 ? unknown
B
Browser (Chrome)
 netcup GmbH 7 ? unknown
B
Browser (Chrome)
 Meta Platforms Ireland Limited 7 ? unknown
08 · Infrastructure

Where and how requests reach us

Network-level signals: where the bot came from (country / ASN / Cloudflare datacenter), how modern its connection was, and how fast we responded. Some fields live since 2026-05-04

Top countries
Where bot traffic originates from. Bar shows relative volume.
🇺🇸USUnited States
12,811
🇳🇱NLNetherlands
611
🇷🇺RURussia
218
🇨🇦CACanada
121
🇩🇪DEGermany
106
🇬🇧GBUnited Kingdom
31
🇮🇳INIndia
24
🇸🇪SESweden
21
🇪🇸ESSpain
12
🇸🇬SGSingapore
10
🇨🇳CNChina
9
🇫🇷FRFrance
6
Top Cloudflare datacenters
By total hits. Bar shows relative volume.
IADAshburn
12,212
AMSAmsterdam
664
CMH—
251
FRAFrankfurt
178
SEASeattle
156
YYZToronto
123
LHRLondon
62
LAXLos Angeles
60
MXPMilan
53
ORDChicago
42
Top ASNs
Network operators by hits.
AS140577Ahrefs USA
12,064
AS51396Pfcloud UG
580
AS16509Anthropic, PBC
256
AS13238Yandex enterprise network
218
AS396982Google LLC
175
AS16276Dmytro, Ahrefs Pte Ltd
120
AS8075Microsoft Corporation
52
AS14061DigitalOcean, LLC
50
AS14618Amazon Technologies Inc.
37
AS24940Dataforseo OU
37
Top referrers
Where requests claim to come from. Sparse for bots.
RefererHits
https://ai.fibr.ai/sitemap-ai.xml129
https://ai-dashboard.fibr.ai8
http://fibr.ai8
https://ai.fibr.ai/6
https://fibr.ai/6
https://ai.fibr.ai/robots.txt6
https://fibr.ai2
https://ai.fibr.ai/customer-stories/1
Network profile
Protocol modernness as a share of all hits.
HTTP version
HTTP/2 92%HTTP/1.1 8%HTTP/3 0%
TLS version
TLSv1.3 100%TLSv1 0%
HTTP status code
200 OK 98%404 Not Found 2%
HTTP method
GET 100%HEAD 0%
Handler latency
End-to-end Worker handler duration. Includes R2 lookup + response assembly.
p50
218ms
p95
679ms
p99
1070ms
avg
287ms
samples
14,008
About this data — Real numbers from ai.fibr.ai request logs · refreshed every 5 min · 30-90s ingestion lag from edge to dashboard · bot taxonomy is hand-maintained
Rendered UTC