F
Fibr · ai.fibr.ai Bot Analytics
Last bot visit · 30 min ago Updated Next UTC
3D 7D 14D 30D
01 · Headlines

How AI is reading us right now

14d · 34,110 successful bot pulls ↑ +1.1%
AI Citations · live reads 69 A real user asked an AI a question and it fetched our page
+50.0%
AI Training Crawls 777 Long-term knowledge accumulation
-49.7%
Unique AI tools 7/107 Of known AI tools, reading us this period
-7 new
Pages picked up 271 Distinct pages read by AI tools
-73.6%
⚠ Content gaps 83 Pages AI asked for that we don't have
+29 vs prev
Bytes served 568.2 MB Total response bytes (200-OK only)
AI share of bot traffic 76% vs. classic search engines
+26pp
02 · Trend

Bot activity, day by day

14d · 69 citations ↑ +50.0%
Last 14 days · daily hits i
Three lines, one story: AI citations vs training vs classic search.
AI Citations 69 · +50.0%
AI Training 777 · -49.7%
Search bots 274 · -82.5%
200 150 100 50 0 Jun 20 Jun 22 Jun 25 Jun 28 Jul 1 Jul 3
03 · Who's reading

The AI tool roster

7 of 107 AI tools active ↓ -50.0%
AI tool leaderboard
⌕
Tool Category Hits↓ Pages Last seen Trend
A
Ahrefs Audit
 SEO 26,188 1,506 1 hr ago
S
Semrush
 SEO 1,554 1,505 7 days ago
U
unknown-bot? untagged bot
 Other 798 97 3 days ago
C
ClaudeBot
 Learning 533 85 56 min ago
A
Ahrefs
 SEO 263 2 32 min ago
A
Amazonbot
 Learning 244 242 6 days ago
B
Bingbot
 Search 203 103 3 hr ago
G
GPTBot
 Learning 102 85 1 hr ago
Y
Yandex
 Search 47 25 2 hr ago
A
axios
 Script 45 1 11 hr ago
S
SearchGPT
 Query 40 1 6 hr ago
G
ChatGPT
 Query 29 22 17 hr ago
Bot category mix
i
34,110
Total bot hits
Learning bots
2% · 777
Search bots
1% · 274
Query bots
0% · 69
Other / unknown
15% · 4,970
SEO bots
82% · 28,020
04 · Content performance

What AI is reading

271 pages reached by AI ↓ -73.6%
Top pages — AI Citations
Pages winning live AI answers right now
Query bots
⌕
Page Citations↓ Tools Last cited
/robots.txt↗4016 hr ago
/faq/how-do-i-ensure-my-meta-ads-landing-page-is-compliant.md↗4118 hr ago
/faq/is-fibr-a-personalization-tool.md↗2113 days ago
/personalization-at-scale-cdp.md↗2113 days ago
/faq/how-do-i-personalize-meta-ads-landing-pages-for-different-audiences.md↗212 days ago
/faq/how-does-fibr-work-with-my-cdp-or-personalization-platform.md↗2113 days ago
/↗1113 days ago
/liv.md↗112 days ago
/whitepaper.md↗113 days ago
/guides/geo.md↗1113 days ago
/index.md↗1113 days ago
/landing-page.md↗1113 days ago
/experimentation.md↗1113 days ago
/faq/what-s-the-impact-of-intrusive-pop-ups-on-google-ads-landing-page-performance.md↗111 day ago
/glossary/multi-armed-bandit-testing.md↗1113 days ago
/blog/landing-page-optimization-with-fibr.md↗1113 days ago
/blog/everything-you-need-to-know-about-website-personalization.md↗1113 days ago
/faq/how-does-the-adwords-conversion-optimizer-work.md↗116 days ago
/agentic-web-personalization-ads-llm.md↗112 days ago
/faq/what-are-the-best-cxl-courses-for-conversion-rate-optimization.md↗1117 hr ago
/journey-personalization.md↗116 days ago
/blog/best-landing-page-tools.md↗113 days ago
/glossary/customer-data-platform.md↗1113 days ago
Top pages — AI Training
Pages accumulating into future AI knowledge
Learning bots
⌕
Page Crawls↓ Tools Last crawled
/sitemap-ai.xml↗278356 min ago
/robots.txt↗18711 hr ago
/↗831 hr ago
/llms.txt↗316 days ago
/faq/what-are-quick-wins-for-shopify-cro.md↗223 days ago
/conversion-rate-optimization/conversion-rate-optimization-experts.md↗223 days ago
/glossary/multi-variate-testing-vs-a-b-testing.md↗223 days ago
/faq/how-much-do-cro-agencies-typically-charge.md↗223 days ago
/faq/can-ai-create-product-images.md↗223 days ago
/faq/is-fibr-gdpr-and-privacy-compliant.md↗223 days ago
/faq/what-are-the-key-metrics-for-conversion-based-optimization.md↗223 days ago
/faq/what-services-do-ecommerce-conversion-optimization-agencies-provide.md↗223 days ago
/faq/how-do-i-integrate-ai-generated-images-into-my-shopify-store.md↗223 days ago
/faq/what-are-the-ethical-implications-of-ai-in-ux-research.md↗223 days ago
/faq/can-ai-replace-traditional-cro-methods.md↗223 days ago
/glossary/information-scent.md↗223 days ago
/faq/what-is-yield-management-and-how-does-it-differ-from-revenue-optimization.md↗223 days ago
/faq/how-does-ai-generate-website-graphics.md↗223 days ago
/glossary/content-management-system.md↗223 days ago
/faq/how-can-i-improve-my-shopify-store-s-conversion-rate.md↗223 days ago
/faq/what-is-conversion-optimisation.md↗223 days ago
/faq/what-are-the-best-checkout-optimization-techniques-for-ecommerce-websites.md↗223 days ago
/glossary/visitor-segmentation.md↗223 days ago
/faq/how-can-ai-cro-tools-help-me-understand-customer-behavior-better.md↗223 days ago
/faq/what-are-the-best-ai-image-generators-for-websites.md↗223 days ago
/faq/how-do-i-optimize-website-forms-for-better-conversions.md↗223 days ago
/faq/are-there-specific-themes-that-are-better-for-wordpress-speed.md↗226 days ago
/glossary/scroll-depth-tracking.md↗223 days ago
/landing-page/strategy.md↗223 days ago
/faq/does-ai-replace-human-intuition-in-hypothesis-generation.md↗223 days ago
/faq/how-does-ai-ensure-the-generated-hypotheses-are-relevant-to-business-goals.md↗223 days ago
/faq/how-do-i-make-sure-my-popups-are-mobile-friendly.md↗223 days ago
/faq/how-does-ai-help-in-creating-more-accessible-user-interfaces.md↗223 days ago
/conversion-rate-optimization/revenue-optimization.md↗226 days ago
/faq/what-is-cro-for-shopify.md↗223 days ago
/faq/what-tools-are-available-for-image-personalization.md↗226 days ago
/faq/how-can-i-increase-my-shopify-store-s-conversion-rate.md↗223 days ago
/glossary/website-heatmaps.md↗223 days ago
/faq/how-does-gzip-compression-work-for-wordpress-speed-optimization.md↗223 days ago
/glossary/customer-data-platform.md↗227 days ago
/faq/can-ai-personalize-user-experiences-for-better-conversions.md↗226 days ago
/alternatives/adobe-target.md↗223 days ago
/faq/what-is-image-personalisation.md↗227 days ago
/faq/what-is-the-role-of-trust-signals-in-shopify-cro.md↗223 days ago
/conversion-rate-optimization/roi-in-cro.md↗223 days ago
/faq/how-do-i-use-analytics-to-improve-my-conversion-path.md↗223 days ago
/faq/can-subscription-models-significantly-impact-brand-revenue.md↗116 days ago
/ab-testing/best-practice.md↗116 days ago
/personalization-at-scale-cdp.md↗1113 days ago
/faq/are-ai-generated-images-copyright-free.md↗116 days ago
05 · Content gaps

What AI wanted that we don't have

Each row is a content brief with measurable demand.

83 content gaps ↑ +53.7%
⚠ 83 gaps
Pages Query bots couldn't find
⚡ Highest urgency — real users asked, AI couldn't answer
✓
No urgent gaps
In the last 14 days, no real-user AI fetches (ChatGPT, Claude, Perplexity, SearchGPT) hit a missing page.
Pages all AI bots couldn't find
Including training crawler 404s — broader content demand
C
G
2
C
G
2
/asset-manifest.json↗
2 training crawls
G
C
2
/api/env↗
2 training crawls
G
C
2
/.aws/credentials↗
2 training crawls
G
C
2
G
C
2
C
G
2
G
C
2
/api/v1/config↗
2 training crawls
C
G
2
C
G
2
/firebase-messaging-sw.js↗
2 training crawls
G
C
2
G
C
2
/settings.json↗
2 training crawls
G
C
2
/secrets.yml↗
2 training crawls
C
G
2
/_nuxt/builds/latest.json↗
2 training crawls
C
G
2
/api/v1/env↗
2 training crawls
C
G
2
G
C
2
/openapi.json↗
2 training crawls
C
G
2
C
G
2
/sitemap.xml↗
2 training crawls
G
C
2
G
C
2
C
1
C
1
C
1
C
1
C
1
C
1
C
1
C
1
C
1
C
1
C
1
C
1
C
1
C
1
C
1
C
1
C
1
/pilot/ad-personalization↗
1 training crawl
C
1
C
1
C
1
C
1
/.env↗
1 training crawl
C
1
C
1
C
1
C
1
C
1
/api/settings↗
1 training crawl
C
1
/.env.test↗
1 training crawl
C
1
/keyfile.json↗
1 training crawl
G
1
Daily missing-page requests
A leading indicator: if this climbs, our coverage is falling behind AI demand.
404s from AI 36 today · new
Jun 20 Jun 27 Jul 3
06 · LLM Referral Traffic

What AI is converting for fibr.ai

Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above. The dashed marker shows when ai.fibr.ai went live.

LLM Referral Traffic 140
+0.0% vs prev 14d
LLM Platforms referring traffic 4 of 6 tracked AI surfaces
Pages receiving AI referrals 31 of 271 pages read by AI
Referral visits by AI surface — over time
Daily human click-throughs from each AI platform
i AI referral traffic held steady at 140 sessions over the last 14 days. ChatGPT drove 47% of it.
NO OF VISITS 9 7 5 2 0 Jun 19 Jun 22 Jun 25 Jun 27 Jun 30 Jul 3 3110 ai.fibr.ai launch

Referral traffic spikes often follow high-citation days — watch for a 1–3 day lag between AI citations and human click-throughs.

Top AI referrers
Which AI surfaces are converting citations into human visits
Tool User Sessions Page Views Landing Pages Trend
G
ChatGPT
 66 78 24
G
Gemini
 63 70 7
C
Claude
 9 8 6
P
Perplexity
 2 1 1

ChatGPT leads with 66 sessions (47% of AI traffic). Gemini is #2 with 63 sessions.

07 · Identity

Who's really behind that user-agent?

Cross-checks the UA-claimed bot identity against the requesting IP's owning organisation. Mismatches = possible spoofers using residential proxies or fake UAs. Live since 2026-05-04

Bot × AS-Organisation pairs
Top 30 (bot, owning-organisation) combinations. Hover the verification badge for details.
Bot (claimed) AS-Organisation (actual) Hits↓ Identity
A
Ahrefs Audit
 Ahrefs USA 26,188 ? unknown
B
Browser (Chrome)
 DigitalOcean, LLC 2,296 ? unknown
S
Semrush
 SEMrush CY LTD 1,548 ✓ verified
U
unknown-bot
 Carnegie Mellon University 782 ? unknown
B
Browser (Chrome)
 Cloud Technologies LLC trading as Cloud.ru 756 ? unknown
C
ClaudeBot
 Anthropic, PBC 533 ✓ verified
B
Browser (Safari)
 DigitalOcean, LLC 447 ? unknown
B
Browser (Firefox)
 DigitalOcean, LLC 421 ? unknown
A
Ahrefs
 Dmytro, Ahrefs Pte Ltd 237 ✓ verified
B
Bingbot
 Microsoft Corporation 203 ✓ verified
B
Browser (Chrome)
 3xK Tech GmbH 202 ? unknown
B
Browser (Edge)
 Cloud Technologies LLC trading as Cloud.ru 159 ? unknown
B
Browser (Safari)
 Cloud Technologies LLC trading as Cloud.ru 138 ? unknown
A
Amazonbot
 Amazon Technologies Inc. 132 ✓ verified
B
Browser (Firefox)
 Cloud Technologies LLC trading as Cloud.ru 118 ? unknown
A
Amazonbot
 Amazon Data Services Northern Virginia 107 ✓ verified
G
GPTBot
 Microsoft Limited 102 ✓ verified
B
Browser (Chrome)
 Hetzner Online GmbH 79 ? unknown
B
Browser (Chrome)
 Google LLC 75 ? unknown
Y
Yandex
 Yandex enterprise network 46 ? unknown
B
Browser (Edge)
 3xK Tech GmbH 46 ? unknown
A
axios
 Amazon.com, Inc. 45 ? unknown
B
Browser (Safari)
 3xK Tech GmbH 44 ? unknown
B
Browser (Chrome)
 EGIHosting 40 ? unknown
B
Browser (Firefox)
 3xK Tech GmbH 31 ? unknown
A
Ahrefs
 Ahrefs Pte Ltd Dmytro 26 ✓ verified
G
ChatGPT
 Microsoft Corporation 24 ✓ verified
S
SearchGPT
 Microsoft Limited 24 ✓ verified
F
Facebook
 Meta Platforms Ireland Limited 22 ? unknown
B
Browser (Chrome)
 TECHOFF SRV LIMITED 21 ? unknown
08 · Infrastructure

Where and how requests reach us

Network-level signals: where the bot came from (country / ASN / Cloudflare datacenter), how modern its connection was, and how fast we responded. Some fields live since 2026-05-04

Top countries
Where bot traffic originates from. Bar shows relative volume.
🇺🇸USUnited States
33,396
🇷🇺RURussia
1,233
🇨🇦CACanada
285
🇩🇪DEGermany
137
🇫🇮FIFinland
87
🇳🇱NLNetherlands
60
🇮🇳INIndia
49
🇧🇷BRBrazil
44
🇬🇧GBUnited Kingdom
44
🇫🇷FRFrance
38
🇨🇳CNChina
17
🇹🇼TWTaiwan
16
Top Cloudflare datacenters
By total hits. Bar shows relative volume.
IADAshburn
28,615
SJCSan Jose
3,219
ARNStockholm
764
CMH—
535
EWR—
359
ATLAtlanta
352
FRAFrankfurt
320
YYZToronto
286
AMSAmsterdam
217
DME—
157
Top ASNs
Network operators by hits.
AS140577Ahrefs USA
26,188
AS14061DigitalOcean, LLC
3,165
AS209366SEMrush CY LTD
1,548
AS208677Cloud Technologies LLC trading as Cloud.ru
1,184
AS9Carnegie Mellon University
782
AS16509Anthropic, PBC
533
AS2003733xK Tech GmbH
324
AS8075Microsoft Corporation
243
AS16276Dmytro, Ahrefs Pte Ltd
237
AS14618Amazon Technologies Inc.
139
Top referrers
Where requests claim to come from. Sparse for bots.
RefererHits
https://ai-dashboard.fibr.ai78
https://fibr.ai/23
https://ai.fibr.ai/faq.md10
https://fibr.ai10
https://ai.fibr.ai/9
https://ai.fibr.ai/robots.txt7
https://fibr.ai/blog/best-marketing-automation-software5
https://m.baidu.com/s?word=www.jdbp.cn3
Network profile
Protocol modernness as a share of all hits.
HTTP version
HTTP/2 77%HTTP/1.1 23%HTTP/3 0%
TLS version
TLSv1.3 100%TLSv1.2 0%TLSv1 0%
HTTP status code
200 OK 96%404 Not Found 4%405 Method Not Allowed 0%
HTTP method
GET 100%HEAD 0%POST 0%OPTIONS 0%
Handler latency
End-to-end Worker handler duration. Includes R2 lookup + response assembly.
p50
222ms
p95
621ms
p99
976ms
avg
275ms
samples
35,609
About this data — Real numbers from ai.fibr.ai request logs · refreshed every 5 min · 30-90s ingestion lag from edge to dashboard · bot taxonomy is hand-maintained
Rendered UTC