F
Fibr · ai.fibr.ai Bot Analytics
Last bot visit · 30 min ago Updated Next UTC

How AI is reading us right now

AI Training Crawls 777 Long-term knowledge accumulation
-49.7%
Unique AI tools 7/107 Of known AI tools, reading us this period
-7 new
Pages picked up 271 Distinct pages read by AI tools
-73.6%
⚠ Content gaps 83 Pages AI asked for that we don't have
+29 vs prev
Bytes served 568.2 MB Total response bytes (200-OK only)
AI share of bot traffic 76% vs. classic search engines
+26pp

Bot activity, day by day

Last 14 days · daily hits i
Three lines, one story: AI citations vs training vs classic search.
AI Citations 69 · +50.0%
AI Training 777 · -49.7%
Search bots 274 · -82.5%
200 150 100 50 0 Jun 20 Jun 22 Jun 25 Jun 28 Jul 1 Jul 3

The AI tool roster

AI tool leaderboard
Tool Category Hits Pages Last seen Trend
A
Ahrefs Audit
SEO 26,188 1,506 1 hr ago
S
Semrush
SEO 1,554 1,505 7 days ago
U
unknown-bot? untagged bot
Other 798 97 3 days ago
C
ClaudeBot
Learning 533 85 56 min ago
A
Ahrefs
SEO 263 2 32 min ago
A
Amazonbot
Learning 244 242 6 days ago
B
Bingbot
Search 203 103 3 hr ago
G
GPTBot
Learning 102 85 1 hr ago
Y
Yandex
Search 47 25 2 hr ago
A
axios
Script 45 1 11 hr ago
S
SearchGPT
Query 40 1 6 hr ago
G
ChatGPT
Query 29 22 17 hr ago
Bot category mix
i
34,110
Total bot hits
Learning bots
2% · 777
Search bots
1% · 274
Query bots
0% · 69
Other / unknown
15% · 4,970
SEO bots
82% · 28,020

What AI is reading

Top pages — AI Training
Pages accumulating into future AI knowledge
Learning bots
Page Crawls Tools Last crawled
/sitemap-ai.xml278356 min ago
/robots.txt18711 hr ago
/831 hr ago
/llms.txt316 days ago
/faq/what-are-quick-wins-for-shopify-cro.md223 days ago
/conversion-rate-optimization/conversion-rate-optimization-experts.md223 days ago
/glossary/multi-variate-testing-vs-a-b-testing.md223 days ago
/faq/how-much-do-cro-agencies-typically-charge.md223 days ago
/faq/can-ai-create-product-images.md223 days ago
/faq/is-fibr-gdpr-and-privacy-compliant.md223 days ago
/faq/what-are-the-key-metrics-for-conversion-based-optimization.md223 days ago
/faq/what-services-do-ecommerce-conversion-optimization-agencies-provide.md223 days ago
/faq/how-do-i-integrate-ai-generated-images-into-my-shopify-store.md223 days ago
/faq/what-are-the-ethical-implications-of-ai-in-ux-research.md223 days ago
/faq/can-ai-replace-traditional-cro-methods.md223 days ago
/glossary/information-scent.md223 days ago
/faq/what-is-yield-management-and-how-does-it-differ-from-revenue-optimization.md223 days ago
/faq/how-does-ai-generate-website-graphics.md223 days ago
/glossary/content-management-system.md223 days ago
/faq/how-can-i-improve-my-shopify-store-s-conversion-rate.md223 days ago
/faq/what-is-conversion-optimisation.md223 days ago
/faq/what-are-the-best-checkout-optimization-techniques-for-ecommerce-websites.md223 days ago
/glossary/visitor-segmentation.md223 days ago
/faq/how-can-ai-cro-tools-help-me-understand-customer-behavior-better.md223 days ago
/faq/what-are-the-best-ai-image-generators-for-websites.md223 days ago
/faq/how-do-i-optimize-website-forms-for-better-conversions.md223 days ago
/faq/are-there-specific-themes-that-are-better-for-wordpress-speed.md226 days ago
/glossary/scroll-depth-tracking.md223 days ago
/landing-page/strategy.md223 days ago
/faq/does-ai-replace-human-intuition-in-hypothesis-generation.md223 days ago
/faq/how-does-ai-ensure-the-generated-hypotheses-are-relevant-to-business-goals.md223 days ago
/faq/how-do-i-make-sure-my-popups-are-mobile-friendly.md223 days ago
/faq/how-does-ai-help-in-creating-more-accessible-user-interfaces.md223 days ago
/conversion-rate-optimization/revenue-optimization.md226 days ago
/faq/what-is-cro-for-shopify.md223 days ago
/faq/what-tools-are-available-for-image-personalization.md226 days ago
/faq/how-can-i-increase-my-shopify-store-s-conversion-rate.md223 days ago
/glossary/website-heatmaps.md223 days ago
/faq/how-does-gzip-compression-work-for-wordpress-speed-optimization.md223 days ago
/glossary/customer-data-platform.md227 days ago
/faq/can-ai-personalize-user-experiences-for-better-conversions.md226 days ago
/alternatives/adobe-target.md223 days ago
/faq/what-is-image-personalisation.md227 days ago
/faq/what-is-the-role-of-trust-signals-in-shopify-cro.md223 days ago
/conversion-rate-optimization/roi-in-cro.md223 days ago
/faq/how-do-i-use-analytics-to-improve-my-conversion-path.md223 days ago
/faq/can-subscription-models-significantly-impact-brand-revenue.md116 days ago
/ab-testing/best-practice.md116 days ago
/personalization-at-scale-cdp.md1113 days ago
/faq/are-ai-generated-images-copyright-free.md116 days ago

What AI wanted that we don't have

Each row is a content brief with measurable demand.

⚠ 83 gaps
Pages Query bots couldn't find
⚡ Highest urgency — real users asked, AI couldn't answer
No urgent gaps
In the last 14 days, no real-user AI fetches (ChatGPT, Claude, Perplexity, SearchGPT) hit a missing page.
Pages all AI bots couldn't find
Including training crawler 404s — broader content demand
2 training crawls
G
C
2
2 training crawls
G
C
2
2 training crawls
G
C
2
2 training crawls
C
G
2
2 training crawls
G
C
2
2 training crawls
G
C
2
2 training crawls
C
G
2
2 training crawls
C
G
2
2 training crawls
C
G
2
2 training crawls
C
G
2
2 training crawls
G
C
2
C
1
C
1
1 training crawl
C
1
C
1
1 training crawl
C
1
1 training crawl
C
1
1 training crawl
C
1
1 training crawl
G
1
Daily missing-page requests
A leading indicator: if this climbs, our coverage is falling behind AI demand.
404s from AI 36 today · new
Jun 20 Jun 27 Jul 3

What AI is converting for fibr.ai

Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above. The dashed marker shows when ai.fibr.ai went live.

LLM Referral Traffic 140
+0.0% vs prev 14d
LLM Platforms referring traffic 4 of 6 tracked AI surfaces
Pages receiving AI referrals 31 of 271 pages read by AI
Referral visits by AI surface — over time
Daily human click-throughs from each AI platform
i AI referral traffic held steady at 140 sessions over the last 14 days. ChatGPT drove 47% of it.
NO OF VISITS 9 7 5 2 0 Jun 19 Jun 22 Jun 25 Jun 27 Jun 30 Jul 3 3110 ai.fibr.ai launch

Referral traffic spikes often follow high-citation days — watch for a 1–3 day lag between AI citations and human click-throughs.

Top AI referrers
Which AI surfaces are converting citations into human visits
Tool User Sessions Page Views Landing Pages Trend
G
ChatGPT
66 78 24
G
Gemini
63 70 7
C
Claude
9 8 6
P
Perplexity
2 1 1

ChatGPT leads with 66 sessions (47% of AI traffic). Gemini is #2 with 63 sessions.

Who's really behind that user-agent?

Cross-checks the UA-claimed bot identity against the requesting IP's owning organisation. Mismatches = possible spoofers using residential proxies or fake UAs. Live since 2026-05-04

Bot × AS-Organisation pairs
Top 30 (bot, owning-organisation) combinations. Hover the verification badge for details.
Bot (claimed) AS-Organisation (actual) Hits Identity
A
Ahrefs Audit
Ahrefs USA 26,188 ? unknown
B
Browser (Chrome)
DigitalOcean, LLC 2,296 ? unknown
S
Semrush
SEMrush CY LTD 1,548 ✓ verified
U
unknown-bot
Carnegie Mellon University 782 ? unknown
B
Browser (Chrome)
Cloud Technologies LLC trading as Cloud.ru 756 ? unknown
C
ClaudeBot
Anthropic, PBC 533 ✓ verified
B
Browser (Safari)
DigitalOcean, LLC 447 ? unknown
B
Browser (Firefox)
DigitalOcean, LLC 421 ? unknown
A
Ahrefs
Dmytro, Ahrefs Pte Ltd 237 ✓ verified
B
Bingbot
Microsoft Corporation 203 ✓ verified
B
Browser (Chrome)
3xK Tech GmbH 202 ? unknown
B
Browser (Edge)
Cloud Technologies LLC trading as Cloud.ru 159 ? unknown
B
Browser (Safari)
Cloud Technologies LLC trading as Cloud.ru 138 ? unknown
A
Amazonbot
Amazon Technologies Inc. 132 ✓ verified
B
Browser (Firefox)
Cloud Technologies LLC trading as Cloud.ru 118 ? unknown
A
Amazonbot
Amazon Data Services Northern Virginia 107 ✓ verified
G
GPTBot
Microsoft Limited 102 ✓ verified
B
Browser (Chrome)
Hetzner Online GmbH 79 ? unknown
B
Browser (Chrome)
Google LLC 75 ? unknown
Y
Yandex
Yandex enterprise network 46 ? unknown
B
Browser (Edge)
3xK Tech GmbH 46 ? unknown
A
axios
Amazon.com, Inc. 45 ? unknown
B
Browser (Safari)
3xK Tech GmbH 44 ? unknown
B
Browser (Chrome)
EGIHosting 40 ? unknown
B
Browser (Firefox)
3xK Tech GmbH 31 ? unknown
A
Ahrefs
Ahrefs Pte Ltd Dmytro 26 ✓ verified
G
ChatGPT
Microsoft Corporation 24 ✓ verified
S
SearchGPT
Microsoft Limited 24 ✓ verified
F
Facebook
Meta Platforms Ireland Limited 22 ? unknown
B
Browser (Chrome)
TECHOFF SRV LIMITED 21 ? unknown

Where and how requests reach us

Network-level signals: where the bot came from (country / ASN / Cloudflare datacenter), how modern its connection was, and how fast we responded. Some fields live since 2026-05-04

Top countries
Where bot traffic originates from. Bar shows relative volume.
🇺🇸USUnited States
33,396
🇷🇺RURussia
1,233
🇨🇦CACanada
285
🇩🇪DEGermany
137
🇫🇮FIFinland
87
🇳🇱NLNetherlands
60
🇮🇳INIndia
49
🇧🇷BRBrazil
44
🇬🇧GBUnited Kingdom
44
🇫🇷FRFrance
38
🇨🇳CNChina
17
🇹🇼TWTaiwan
16
Top Cloudflare datacenters
By total hits. Bar shows relative volume.
IADAshburn
28,615
SJCSan Jose
3,219
ARNStockholm
764
CMH
535
EWR
359
ATLAtlanta
352
FRAFrankfurt
320
YYZToronto
286
AMSAmsterdam
217
DME
157
Top ASNs
Network operators by hits.
AS140577Ahrefs USA
26,188
AS14061DigitalOcean, LLC
3,165
AS209366SEMrush CY LTD
1,548
AS208677Cloud Technologies LLC trading as Cloud.ru
1,184
AS9Carnegie Mellon University
782
AS16509Anthropic, PBC
533
AS2003733xK Tech GmbH
324
AS8075Microsoft Corporation
243
AS16276Dmytro, Ahrefs Pte Ltd
237
AS14618Amazon Technologies Inc.
139
Top referrers
Where requests claim to come from. Sparse for bots.
RefererHits
https://ai-dashboard.fibr.ai78
https://fibr.ai/23
https://ai.fibr.ai/faq.md10
https://fibr.ai10
https://ai.fibr.ai/9
https://ai.fibr.ai/robots.txt7
https://fibr.ai/blog/best-marketing-automation-software5
https://m.baidu.com/s?word=www.jdbp.cn3
Network profile
Protocol modernness as a share of all hits.
HTTP version
HTTP/2 77%HTTP/1.1 23%HTTP/3 0%
TLS version
TLSv1.3 100%TLSv1.2 0%TLSv1 0%
HTTP status code
200 OK 96%404 Not Found 4%405 Method Not Allowed 0%
HTTP method
GET 100%HEAD 0%POST 0%OPTIONS 0%
Handler latency
End-to-end Worker handler duration. Includes R2 lookup + response assembly.
p50
222ms
p95
621ms
p99
976ms
avg
275ms
samples
35,609
About this data — Real numbers from ai.fibr.ai request logs · refreshed every 5 min · 30-90s ingestion lag from edge to dashboard · bot taxonomy is hand-maintained
Rendered UTC