F
Fibr · ai.fibr.ai Bot Analytics
Last bot visit · 1 min ago Updated Next UTC
3D 7D 14D 30D
01 · Headlines

How AI is reading us right now

14d · 34,910 successful bot pulls ↑ +5.9%
AI Citations · live reads 69 A real user asked an AI a question and it fetched our page
+50.0%
AI Training Crawls 777 Long-term knowledge accumulation
-49.8%
Unique AI tools 7/107 Of known AI tools, reading us this period
-7 new
Pages picked up 271 Distinct pages read by AI tools
-73.6%
⚠ Content gaps 72 Pages AI asked for that we don't have
+18 vs prev
Bytes served 573.9 MB Total response bytes (200-OK only)
AI share of bot traffic 75% vs. classic search engines
+25pp
02 · Trend

Bot activity, day by day

14d · 69 citations ↑ +50.0%
Last 14 days · daily hits i
Three lines, one story: AI citations vs training vs classic search.
AI Citations 69 · +50.0%
AI Training 777 · -49.8%
Search bots 276 · -82.4%
200 150 100 50 0 Jun 20 Jun 22 Jun 25 Jun 28 Jul 1 Jul 3
03 · Who's reading

The AI tool roster

7 of 107 AI tools active ↓ -50.0%
AI tool leaderboard
⌕
Tool Category Hits↓ Pages Last seen Trend
A
Ahrefs Audit
 SEO 26,985 1,506 10 min ago
S
Semrush
 SEO 1,554 1,505 7 days ago
U
unknown-bot? untagged bot
 Other 798 97 3 days ago
C
ClaudeBot
 Learning 517 69 1 min ago
A
Ahrefs
 SEO 263 2 27 min ago
A
Amazonbot
 Learning 245 242 5 days ago
B
Bingbot
 Search 203 103 2 hr ago
G
GPTBot
 Learning 102 85 46 min ago
Y
Yandex
 Search 49 26 50 min ago
A
axios
 Script 45 1 10 hr ago
S
SearchGPT
 Query 40 1 5 hr ago
G
ChatGPT
 Query 29 22 16 hr ago
Bot category mix
i
34,910
Total bot hits
Learning bots
2% · 777
Search bots
1% · 276
Query bots
0% · 69
Other / unknown
14% · 4,971
SEO bots
83% · 28,817
04 · Content performance

What AI is reading

271 pages reached by AI ↓ -73.6%
Top pages — AI Citations
Pages winning live AI answers right now
Query bots
⌕
Page Citations↓ Tools Last cited
/robots.txt↗4015 hr ago
/faq/how-do-i-ensure-my-meta-ads-landing-page-is-compliant.md↗4116 hr ago
/faq/is-fibr-a-personalization-tool.md↗2113 days ago
/personalization-at-scale-cdp.md↗2113 days ago
/faq/how-do-i-personalize-meta-ads-landing-pages-for-different-audiences.md↗212 days ago
/faq/how-does-fibr-work-with-my-cdp-or-personalization-platform.md↗2113 days ago
/↗1113 days ago
/liv.md↗112 days ago
/whitepaper.md↗113 days ago
/guides/geo.md↗1113 days ago
/index.md↗1113 days ago
/landing-page.md↗1113 days ago
/experimentation.md↗1113 days ago
/glossary/multi-armed-bandit-testing.md↗1113 days ago
/faq/what-s-the-impact-of-intrusive-pop-ups-on-google-ads-landing-page-performance.md↗111 day ago
/blog/landing-page-optimization-with-fibr.md↗1113 days ago
/blog/everything-you-need-to-know-about-website-personalization.md↗1113 days ago
/faq/how-does-the-adwords-conversion-optimizer-work.md↗116 days ago
/agentic-web-personalization-ads-llm.md↗112 days ago
/faq/what-are-the-best-cxl-courses-for-conversion-rate-optimization.md↗1116 hr ago
/journey-personalization.md↗116 days ago
/blog/best-landing-page-tools.md↗113 days ago
/glossary/customer-data-platform.md↗1113 days ago
Top pages — AI Training
Pages accumulating into future AI knowledge
Learning bots
⌕
Page Crawls↓ Tools Last crawled
/sitemap-ai.xml↗279340 min ago
/robots.txt↗187140 min ago
/↗7247 min ago
/llms.txt↗316 days ago
/glossary/scroll-depth-tracking.md↗223 days ago
/faq/how-does-gzip-compression-work-for-wordpress-speed-optimization.md↗223 days ago
/faq/what-is-cro-for-shopify.md↗223 days ago
/faq/how-can-i-increase-my-shopify-store-s-conversion-rate.md↗223 days ago
/glossary/customer-data-platform.md↗226 days ago
/alternatives/adobe-target.md↗223 days ago
/conversion-rate-optimization/roi-in-cro.md↗223 days ago
/conversion-rate-optimization/revenue-optimization.md↗226 days ago
/faq/can-ai-personalize-user-experiences-for-better-conversions.md↗226 days ago
/faq/what-tools-are-available-for-image-personalization.md↗226 days ago
/faq/how-do-i-use-analytics-to-improve-my-conversion-path.md↗223 days ago
/faq/what-is-image-personalisation.md↗227 days ago
/faq/what-is-the-role-of-trust-signals-in-shopify-cro.md↗223 days ago
/faq/does-ai-replace-human-intuition-in-hypothesis-generation.md↗223 days ago
/faq/how-does-ai-ensure-the-generated-hypotheses-are-relevant-to-business-goals.md↗223 days ago
/landing-page/strategy.md↗223 days ago
/faq/are-there-specific-themes-that-are-better-for-wordpress-speed.md↗226 days ago
/faq/how-do-i-optimize-website-forms-for-better-conversions.md↗223 days ago
/faq/what-are-the-best-ai-image-generators-for-websites.md↗223 days ago
/faq/how-can-ai-cro-tools-help-me-understand-customer-behavior-better.md↗223 days ago
/glossary/visitor-segmentation.md↗223 days ago
/faq/what-is-conversion-optimisation.md↗223 days ago
/faq/how-does-ai-generate-website-graphics.md↗223 days ago
/faq/can-ai-replace-traditional-cro-methods.md↗223 days ago
/faq/how-do-i-integrate-ai-generated-images-into-my-shopify-store.md↗223 days ago
/faq/is-fibr-gdpr-and-privacy-compliant.md↗223 days ago
/faq/can-ai-create-product-images.md↗223 days ago
/faq/how-much-do-cro-agencies-typically-charge.md↗223 days ago
/conversion-rate-optimization/conversion-rate-optimization-experts.md↗223 days ago
/glossary/multi-variate-testing-vs-a-b-testing.md↗223 days ago
/faq/what-are-the-key-metrics-for-conversion-based-optimization.md↗223 days ago
/faq/what-services-do-ecommerce-conversion-optimization-agencies-provide.md↗223 days ago
/faq/what-are-the-ethical-implications-of-ai-in-ux-research.md↗223 days ago
/glossary/information-scent.md↗223 days ago
/faq/what-is-yield-management-and-how-does-it-differ-from-revenue-optimization.md↗223 days ago
/glossary/content-management-system.md↗223 days ago
/faq/how-can-i-improve-my-shopify-store-s-conversion-rate.md↗223 days ago
/faq/what-are-the-best-checkout-optimization-techniques-for-ecommerce-websites.md↗223 days ago
/faq/how-does-ai-help-in-creating-more-accessible-user-interfaces.md↗223 days ago
/glossary/website-heatmaps.md↗223 days ago
/faq/what-are-quick-wins-for-shopify-cro.md↗223 days ago
/faq/how-do-i-make-sure-my-popups-are-mobile-friendly.md↗223 days ago
/ab-testing/saas-a-b-testing.md↗116 days ago
/blog/google-optimize-sunset-top-alternatives-and-tips-to-consider.md↗1113 days ago
/glossary/split-testing-for-pricing.md↗116 days ago
/glossary/conversion-rate-optimization-(cro).md↗116 days ago
05 · Content gaps

What AI wanted that we don't have

Each row is a content brief with measurable demand.

72 content gaps ↑ +33.3%
⚠ 72 gaps
Pages Query bots couldn't find
⚡ Highest urgency — real users asked, AI couldn't answer
✓
No urgent gaps
In the last 14 days, no real-user AI fetches (ChatGPT, Claude, Perplexity, SearchGPT) hit a missing page.
Pages all AI bots couldn't find
Including training crawler 404s — broader content demand
C
G
2
C
G
2
G
C
2
G
C
2
G
C
2
C
G
2
G
C
2
C
G
2
C
G
2
/openapi.json↗
2 training crawls
C
G
2
/sitemap.xml↗
2 training crawls
G
C
2
/api/v1/env↗
2 training crawls
C
G
2
/secrets.yml↗
2 training crawls
C
G
2
G
C
2
/settings.json↗
2 training crawls
G
C
2
/api/v1/config↗
2 training crawls
C
G
2
/api/env↗
2 training crawls
G
C
2
C
1
/max↗
1 training crawl
C
1
C
1
C
1
/firebase-messaging-sw.js↗
1 training crawl
G
1
/genesis↗
1 training crawl
C
1
C
1
C
1
C
1
/env.js↗
1 training crawl
C
1
C
1
C
1
/api/v1/settings↗
1 training crawl
C
1
/cookie-policy↗
1 training crawl
C
1
C
1
/_nuxt/builds/latest.json↗
1 training crawl
G
1
C
1
C
1
C
1
/config.json↗
1 training crawl
C
1
C
1
C
1
C
1
C
1
/pilot/ad-personalization↗
1 training crawl
C
1
C
1
/tools↗
1 training crawl
C
1
/secrets.json↗
1 training crawl
C
1
/terms-and-conditions↗
1 training crawl
C
1
/journey-personalization↗
1 training crawl
C
1
/__/firebase/init.json↗
1 training crawl
C
1
/application.yml↗
1 training crawl
C
1
/customer-stories↗
1 training crawl
C
1
Daily missing-page requests
A leading indicator: if this climbs, our coverage is falling behind AI demand.
404s from AI 21 today · new
Jun 20 Jun 27 Jul 3
06 · LLM Referral Traffic

What AI is converting for fibr.ai

Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above. The dashed marker shows when ai.fibr.ai went live.

LLM Referral Traffic 140
+0.0% vs prev 14d
LLM Platforms referring traffic 4 of 6 tracked AI surfaces
Pages receiving AI referrals 31 of 271 pages read by AI
Referral visits by AI surface — over time
Daily human click-throughs from each AI platform
i AI referral traffic held steady at 140 sessions over the last 14 days. ChatGPT drove 47% of it.
NO OF VISITS 9 7 5 2 0 Jun 19 Jun 22 Jun 25 Jun 27 Jun 30 Jul 3 3110 ai.fibr.ai launch

Referral traffic spikes often follow high-citation days — watch for a 1–3 day lag between AI citations and human click-throughs.

Top AI referrers
Which AI surfaces are converting citations into human visits
Tool User Sessions Page Views Landing Pages Trend
G
ChatGPT
 66 78 24
G
Gemini
 63 70 7
C
Claude
 9 8 6
P
Perplexity
 2 1 1

ChatGPT leads with 66 sessions (47% of AI traffic). Gemini is #2 with 63 sessions.

07 · Identity

Who's really behind that user-agent?

Cross-checks the UA-claimed bot identity against the requesting IP's owning organisation. Mismatches = possible spoofers using residential proxies or fake UAs. Live since 2026-05-04

Bot × AS-Organisation pairs
Top 30 (bot, owning-organisation) combinations. Hover the verification badge for details.
Bot (claimed) AS-Organisation (actual) Hits↓ Identity
A
Ahrefs Audit
 Ahrefs USA 26,985 ? unknown
B
Browser (Chrome)
 DigitalOcean, LLC 2,296 ? unknown
S
Semrush
 SEMrush CY LTD 1,548 ✓ verified
U
unknown-bot
 Carnegie Mellon University 782 ? unknown
B
Browser (Chrome)
 Cloud Technologies LLC trading as Cloud.ru 756 ? unknown
C
ClaudeBot
 Anthropic, PBC 517 ✓ verified
B
Browser (Safari)
 DigitalOcean, LLC 447 ? unknown
B
Browser (Firefox)
 DigitalOcean, LLC 421 ? unknown
A
Ahrefs
 Dmytro, Ahrefs Pte Ltd 237 ✓ verified
B
Bingbot
 Microsoft Corporation 203 ✓ verified
B
Browser (Chrome)
 3xK Tech GmbH 202 ? unknown
B
Browser (Edge)
 Cloud Technologies LLC trading as Cloud.ru 159 ? unknown
B
Browser (Safari)
 Cloud Technologies LLC trading as Cloud.ru 138 ? unknown
A
Amazonbot
 Amazon Technologies Inc. 133 ✓ verified
B
Browser (Firefox)
 Cloud Technologies LLC trading as Cloud.ru 118 ? unknown
A
Amazonbot
 Amazon Data Services Northern Virginia 107 ✓ verified
G
GPTBot
 Microsoft Limited 102 ✓ verified
B
Browser (Chrome)
 Hetzner Online GmbH 79 ? unknown
B
Browser (Chrome)
 Google LLC 77 ? unknown
Y
Yandex
 Yandex enterprise network 48 ? unknown
B
Browser (Edge)
 3xK Tech GmbH 46 ? unknown
A
axios
 Amazon.com, Inc. 45 ? unknown
B
Browser (Safari)
 3xK Tech GmbH 44 ? unknown
B
Browser (Chrome)
 EGIHosting 40 ? unknown
B
Browser (Firefox)
 3xK Tech GmbH 31 ? unknown
A
Ahrefs
 Ahrefs Pte Ltd Dmytro 26 ✓ verified
G
ChatGPT
 Microsoft Corporation 24 ✓ verified
S
SearchGPT
 Microsoft Limited 24 ✓ verified
F
Facebook
 Meta Platforms Ireland Limited 22 ? unknown
G
Googlebot
 Google LLC 21 ✓ verified
08 · Infrastructure

Where and how requests reach us

Network-level signals: where the bot came from (country / ASN / Cloudflare datacenter), how modern its connection was, and how fast we responded. Some fields live since 2026-05-04

Top countries
Where bot traffic originates from. Bar shows relative volume.
🇺🇸USUnited States
34,180
🇷🇺RURussia
1,235
🇨🇦CACanada
285
🇩🇪DEGermany
137
🇫🇮FIFinland
87
🇳🇱NLNetherlands
60
🇮🇳INIndia
49
🇬🇧GBUnited Kingdom
44
🇧🇷BRBrazil
44
🇫🇷FRFrance
38
🇨🇳CNChina
17
🇧🇪BEBelgium
16
Top Cloudflare datacenters
By total hits. Bar shows relative volume.
IADAshburn
29,413
SJCSan Jose
3,219
ARNStockholm
766
CMH—
519
EWR—
359
ATLAtlanta
352
FRAFrankfurt
320
YYZToronto
286
AMSAmsterdam
217
DME—
157
Top ASNs
Network operators by hits.
AS140577Ahrefs USA
26,985
AS14061DigitalOcean, LLC
3,165
AS209366SEMrush CY LTD
1,548
AS208677Cloud Technologies LLC trading as Cloud.ru
1,184
AS9Carnegie Mellon University
782
AS16509Anthropic, PBC
519
AS2003733xK Tech GmbH
324
AS8075Microsoft Corporation
243
AS16276Dmytro, Ahrefs Pte Ltd
237
AS14618Amazon Technologies Inc.
140
Top referrers
Where requests claim to come from. Sparse for bots.
RefererHits
https://ai-dashboard.fibr.ai78
https://fibr.ai/23
https://ai.fibr.ai/faq.md10
https://fibr.ai10
https://ai.fibr.ai/9
https://ai.fibr.ai/robots.txt7
https://fibr.ai/blog/best-marketing-automation-software5
https://m.baidu.com/s?word=www.jdbp.cn3
Network profile
Protocol modernness as a share of all hits.
HTTP version
HTTP/2 78%HTTP/1.1 22%HTTP/3 0%
TLS version
TLSv1.3 100%TLSv1.2 0%TLSv1 0%
HTTP status code
200 OK 96%404 Not Found 4%405 Method Not Allowed 0%
HTTP method
GET 100%HEAD 0%POST 0%OPTIONS 0%
Handler latency
End-to-end Worker handler duration. Includes R2 lookup + response assembly.
p50
222ms
p95
617ms
p99
971ms
avg
273ms
samples
36,394
About this data — Real numbers from ai.fibr.ai request logs · refreshed every 5 min · 30-90s ingestion lag from edge to dashboard · bot taxonomy is hand-maintained
Rendered UTC