F
Fibr · ai.fibr.ai Bot Analytics
Last bot visit · 2 min ago Updated Next UTC
3D 7D 14D 30D
01 · Headlines

How AI is reading us right now

30d · 72,757 successful bot pulls ↑ +2.2%
AI Citations · live reads 121 A real user asked an AI a question and it fetched our page
+39.1%
AI Training Crawls 2,399 Long-term knowledge accumulation
-20.9%
Unique AI tools 14/107 Of known AI tools, reading us this period
+5 new
Pages picked up 1,108 Distinct pages read by AI tools
-26.3%
⚠ Content gaps 94 Pages AI asked for that we don't have
+52 vs prev
Bytes served 1.20 GB Total response bytes (200-OK only)
AI share of bot traffic 52% vs. classic search engines
+25pp
02 · Trend

Bot activity, day by day

30d · 121 citations ↑ +39.1%
Last 30 days · daily hits i
Three lines, one story: AI citations vs training vs classic search.
AI Citations 121 · +39.1%
AI Training 2,399 · -20.9%
Search bots 2,337 · -72.1%
2k 1.5k 1k 500 0 Jun 4 Jun 10 Jun 16 Jun 22 Jun 28 Jul 3
03 · Who's reading

The AI tool roster

14 of 107 AI tools active ↑ +55.6%
AI tool leaderboard
⌕
Tool Category Hits↓ Pages Last seen Trend
A
Ahrefs Audit
 SEO 53,965 1,506 17 hr ago
S
Semrush
 SEO 1,569 1,505 7 days ago
U
unknown-bot? untagged bot
 Other 1,046 98 3 days ago
A
Applebot
 Search 1,027 581 14 days ago
M
Meta Training
 Learning 1,014 1,009 2 days ago
C
ClaudeBot
 Learning 1,006 58 27 min ago
B
Bingbot
 Search 974 512 1 hr ago
A
Ahrefs
 SEO 567 2 37 min ago
A
Amazonbot
 Learning 266 256 5 days ago
G
Googlebot
 Search 197 124 6 hr ago
G
GPTBot
 Learning 180 139 13 hr ago
Y
Yandex
 Search 162 83 1 hr ago
Bot category mix
i
72,757
Total bot hits
Learning bots
3% · 2,399
Search bots
3% · 2,337
Query bots
0% · 121
Other / unknown
16% · 11,720
SEO bots
77% · 56,180
04 · Content performance

What AI is reading

1,108 pages reached by AI ↓ -26.3%
Top pages — AI Citations
Pages winning live AI answers right now
Query bots
⌕
Page Citations↓ Tools Last cited
/robots.txt↗8223 hr ago
/faq/how-do-i-ensure-my-meta-ads-landing-page-is-compliant.md↗5115 hr ago
/faq/how-does-fibr-work-with-my-cdp-or-personalization-platform.md↗2113 days ago
/faq/how-do-i-personalize-meta-ads-landing-pages-for-different-audiences.md↗211 day ago
/personalization-at-scale-cdp.md↗2113 days ago
/faq/is-fibr-a-personalization-tool.md↗2113 days ago
/↗1113 days ago
/glossary/customer-data-platform.md↗1113 days ago
/pricing.md↗1120 days ago
/ab-testing.md↗1117 days ago
/guides/geo.md↗1113 days ago
/index.md↗1113 days ago
/landing-page.md↗1113 days ago
/experimentation.md↗1113 days ago
/glossary/multi-armed-bandit-testing.md↗1113 days ago
/faq/what-s-the-impact-of-intrusive-pop-ups-on-google-ads-landing-page-performance.md↗1123 hr ago
/blog/landing-page-optimization-with-fibr.md↗1113 days ago
/blog/everything-you-need-to-know-about-website-personalization.md↗1113 days ago
/blog/google-optimize-sunset-top-alternatives-and-tips-to-consider.md↗1114 days ago
/pritam-roy.md↗1127 days ago
/seed-funding.md↗1126 days ago
/faq/how-does-the-adwords-conversion-optimizer-work.md↗116 days ago
/agentic-web-personalization-ads-llm.md↗111 day ago
/faq/what-are-the-best-cxl-courses-for-conversion-rate-optimization.md↗1115 hr ago
/ankur-aj.md↗1127 days ago
/faq/who-typically-owns-revenue-optimization-in-an-organization-(cro-revops-cfo-ceo).md↗1114 days ago
/journey-personalization.md↗116 days ago
/glossary/conversion-rate-optimization-(cro).md↗1117 days ago
/llms.txt↗1117 days ago
/liv.md↗111 day ago
/blog/best-landing-page-tools.md↗113 days ago
/whitepaper.md↗113 days ago
Top pages — AI Training
Pages accumulating into future AI knowledge
Learning bots
⌕
Page Crawls↓ Tools Last crawled
/sitemap-ai.xml↗594527 min ago
/robots.txt↗394227 min ago
/↗1132 days ago
/llms.txt↗616 days ago
/faq/are-there-specific-themes-that-are-better-for-wordpress-speed.md↗446 days ago
/whitepaper.md↗446 days ago
/faq/what-are-the-ethical-implications-of-ai-in-ux-research.md↗333 days ago
/faq/can-shopify-apps-help-with-cro.md↗3314 days ago
/glossary/scroll-depth-tracking.md↗333 days ago
/blog/ai-cms-the-complete-2026-guide-for-modern-content-teams.md↗3314 days ago
/conversion-rate-optimization-1.md↗337 days ago
/geo/generative-engine-optimization-strategies.md↗3314 days ago
/faq/are-there-any-free-or-open-source-ai-cro-tools-available.md↗3314 days ago
/blog/optimizely-alternatives.md↗3314 days ago
/faq/how-do-i-make-sure-my-popups-are-mobile-friendly.md↗333 days ago
/faq/what-is-the-role-of-trust-signals-in-shopify-cro.md↗333 days ago
/faq/can-fibr-detect-ai-traffic-like-chatgpt-or-claude.md↗3314 days ago
/faq/how-does-ai-generate-website-graphics.md↗333 days ago
/faq/how-do-i-optimize-website-forms-for-better-conversions.md↗333 days ago
/faq/what-are-the-best-ai-image-generators-for-websites.md↗333 days ago
/faq/can-ai-create-product-images.md↗333 days ago
/faq/how-do-i-integrate-ai-generated-images-into-my-shopify-store.md↗333 days ago
/meta-ad-personalization.md↗336 days ago
/report-testing.md↗336 days ago
/faq/what-are-quick-wins-for-shopify-cro.md↗333 days ago
/landing-page/strategy.md↗333 days ago
/glossary/website-heatmaps.md↗333 days ago
/ab-testing/wordpress.md↗3213 days ago
/tools/caption-generator.md↗3314 days ago
/glossary/visitor-segmentation.md↗333 days ago
/pilot/ad-personalization.md↗336 days ago
/customer-stories/expanding-reach-and-boosting-conversions.md↗3313 days ago
/faq/can-ai-personalize-user-experiences-for-better-conversions.md↗336 days ago
/faq/how-can-i-improve-website-loading-speed-for-better-conversions.md↗336 days ago
/faq/what-is-image-personalisation.md↗337 days ago
/faq/can-ai-create-images-for-my-website.md↗3314 days ago
/faq/can-shopify-brands-use-ai-for-image-generation.md↗336 days ago
/faq/how-can-ai-cro-tools-help-me-understand-customer-behavior-better.md↗333 days ago
/journey-personalization.md↗333 days ago
/conversion-rate-optimization/revenue-optimization.md↗336 days ago
/faq/how-does-ai-ensure-the-generated-hypotheses-are-relevant-to-business-goals.md↗333 days ago
/faq/how-do-i-use-analytics-to-improve-my-conversion-path.md↗333 days ago
/glossary/conversion-rate-optimization-(cro).md↗336 days ago
/glossary/customer-data-platform.md↗336 days ago
/faq/does-shared-hosting-affect-wordpress-site-speed.md↗3314 days ago
/blog/your-complete-guide-to-digital-experience-analytics.md↗3314 days ago
/faq/how-can-i-improve-my-shopify-store-s-conversion-rate.md↗333 days ago
/blog/message-match-identify-and-overcome-common-advertisement-pitfalls.md↗3314 days ago
/faq/does-ai-replace-human-intuition-in-hypothesis-generation.md↗333 days ago
/glossary/content-management-system.md↗333 days ago
05 · Content gaps

What AI wanted that we don't have

Each row is a content brief with measurable demand.

94 content gaps ↑ +123.8%
⚠ 94 gaps
Pages Query bots couldn't find
⚡ Highest urgency — real users asked, AI couldn't answer
/config.js↗
First asked Jun 7 · 26 days ago
G
S
2
/api/v1/env↗
First asked Jun 18 · 14 days ago
S
2
/api/config↗
First asked Jun 7 · 26 days ago
G
2
/.env↗
First asked Jun 18 · 15 days ago
G
1
/env.js↗
First asked Jun 18 · 15 days ago
S
1
/settings.json↗
First asked Jun 18 · 14 days ago
C
1
/secrets.yml↗
First asked Jun 18 · 14 days ago
G
1
/config.json↗
First asked Jun 18 · 15 days ago
C
1
/api/settings↗
First asked Jun 18 · 14 days ago
S
1
/api/.env↗
First asked Jun 18 · 14 days ago
G
1
/.env.example↗
First asked Jun 18 · 14 days ago
P
1
/sitemap.xml↗
First asked Jun 18 · 14 days ago
C
1
/backend/.env↗
First asked Jun 18 · 14 days ago
G
1
/application.yml↗
First asked Jun 18 · 14 days ago
C
1
/.env.production↗
First asked Jun 18 · 15 days ago
C
1
/.aws/credentials↗
First asked Jun 18 · 14 days ago
C
1
/google-services.json↗
First asked Jun 18 · 14 days ago
C
1
/build/manifest.json↗
First asked Jun 18 · 14 days ago
C
1
/asset-manifest.json↗
First asked Jun 18 · 14 days ago
G
1
Pages all AI bots couldn't find
Including training crawler 404s — broader content demand
/config.js↗
2 live reads · 4 training crawls
C
A
G
G
S
6
/config.json↗
1 live read · 5 training crawls
A
C
C
G
6
/api/settings↗
1 live read · 5 training crawls
C
A
S
G
M
6
/.env↗
1 live read · 4 training crawls
G
A
G
C
B
5
/firebase-messaging-sw.js↗
5 training crawls
G
C
G
B
5
/secrets.json↗
5 training crawls
G
M
A
P
5
/.env.production↗
1 live read · 4 training crawls
A
G
C
C
5
/secrets.yml↗
1 live read · 4 training crawls
P
G
C
G
5
/api/.env↗
1 live read · 4 training crawls
G
G
A
M
5
/api/config↗
2 live reads · 3 training crawls
G
M
G
5
/sitemap.xml↗
1 live read · 3 training crawls
P
G
C
B
4
/.aws/credentials↗
1 live read · 3 training crawls
G
G
C
C
4
/settings.json↗
1 live read · 3 training crawls
G
B
M
C
4
/application.yml↗
1 live read · 3 training crawls
C
A
A
G
4
/openapi.json↗
4 training crawls
B
G
G
A
4
/.env.example↗
1 live read · 3 training crawls
C
G
P
A
4
/google-services.json↗
1 live read · 2 training crawls
P
C
G
3
/api/env↗
3 training crawls
G
G
3
/env.js↗
1 live read · 2 training crawls
S
A
G
3
/api/v1/settings↗
3 training crawls
G
A
3
/__/firebase/init.json↗
3 training crawls
G
P
3
/api/v1/config↗
3 training crawls
A
G
3
/api/v1/env↗
2 live reads · 1 training crawl
S
G
3
/admin/.env↗
3 training crawls
G
B
3
/app/.env↗
3 training crawls
G
A
3
/backend/.env↗
1 live read · 2 training crawls
G
G
M
3
/_nuxt/builds/latest.json↗
3 training crawls
C
G
A
3
C
G
2
C
G
2
C
G
2
C
G
2
G
C
2
G
C
2
C
G
2
C
G
2
C
G
2
C
G
2
G
C
2
G
C
2
G
C
2
G
C
2
C
G
2
/application.properties↗
2 training crawls
C
G
2
C
G
2
G
C
2
G
C
2
/asset-manifest.json↗
1 live read · 1 training crawl
G
G
2
/config/secrets.yml↗
2 training crawls
G
C
2
/debug/pprof/cmdline↗
2 training crawls
G
C
2
/.env.test↗
2 training crawls
G
A
2
Daily missing-page requests
A leading indicator: if this climbs, our coverage is falling behind AI demand.
404s from AI 0 today · 0%
Jun 4 Jun 19 Jul 3
06 · LLM Referral Traffic

What AI is converting for fibr.ai

Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above. The dashed marker shows when ai.fibr.ai went live.

LLM Referral Traffic 286
+22.7% vs prev 30d
LLM Platforms referring traffic 4 of 6 tracked AI surfaces
Pages receiving AI referrals 70 of 1,108 pages read by AI
Referral visits by AI surface — over time
Daily human click-throughs from each AI platform
i AI referral traffic up 22.7% to 286 sessions over the last 30 days. ChatGPT drove 44% of it.
NO OF VISITS 9 7 5 2 0 Jun 3 Jun 9 Jun 15 Jun 21 Jun 27 Jul 3 3110 ai.fibr.ai launch

Referral traffic spikes often follow high-citation days — watch for a 1–3 day lag between AI citations and human click-throughs.

Top AI referrers
Which AI surfaces are converting citations into human visits
Tool User Sessions Page Views Landing Pages Trend
G
ChatGPT
 127 149 34
G
Gemini
 125 151 17
C
Claude
 25 71 30
P
Perplexity
 9 9 8

ChatGPT leads with 127 sessions (44% of AI traffic). Gemini is #2 with 125 sessions.

07 · Identity

Who's really behind that user-agent?

Cross-checks the UA-claimed bot identity against the requesting IP's owning organisation. Mismatches = possible spoofers using residential proxies or fake UAs. Live since 2026-05-04

Bot × AS-Organisation pairs
Top 30 (bot, owning-organisation) combinations. Hover the verification badge for details.
Bot (claimed) AS-Organisation (actual) Hits↓ Identity
A
Ahrefs Audit
 Ahrefs USA 53,965 ? unknown
B
Browser (Chrome)
 DigitalOcean, LLC 4,231 ? unknown
B
Browser (Chrome)
 Cloud Technologies LLC trading as Cloud.ru 2,308 ? unknown
S
Semrush
 SEMrush CY LTD 1,549 ✓ verified
U
unknown-bot
 Carnegie Mellon University 1,019 ? unknown
A
Applebot
 Apple Inc. 1,018 ✓ verified
M
Meta Training
 Meta Platforms Ireland Limited 1,004 ? unknown
C
ClaudeBot
 Anthropic, PBC 994 ✓ verified
B
Bingbot
 Microsoft Corporation 974 ✓ verified
B
Browser (Safari)
 DigitalOcean, LLC 881 ? unknown
B
Browser (Firefox)
 DigitalOcean, LLC 880 ? unknown
A
Ahrefs
 Dmytro, Ahrefs Pte Ltd 513 ✓ verified
B
Browser (Edge)
 Cloud Technologies LLC trading as Cloud.ru 498 ? unknown
B
Browser (Safari)
 Cloud Technologies LLC trading as Cloud.ru 422 ? unknown
B
Browser (Chrome)
 3xK Tech GmbH 421 ? unknown
B
Browser (Firefox)
 Cloud Technologies LLC trading as Cloud.ru 324 ? unknown
G
GPTBot
 Microsoft Limited 164 ✓ verified
Y
Yandex
 Yandex enterprise network 161 ? unknown
A
Amazonbot
 Amazon Technologies Inc. 136 ✓ verified
B
Browser (Chrome)
 FranTech Solutions 127 ? unknown
A
Amazonbot
 Amazon Data Services Northern Virginia 109 ✓ verified
B
Browser (Chrome)
 Google LLC 105 ? unknown
B
Browser (Edge)
 3xK Tech GmbH 88 ? unknown
B
Browser (Safari)
 3xK Tech GmbH 80 ? unknown
B
Browser (Chrome)
 Hetzner Online GmbH 79 ? unknown
C
CCBot
 Amazon Data Services Northern Virginia 77 ✓ verified
D
DataForSEO
 Dataforseo OU 65 ✓ verified
B
Browser (Firefox)
 3xK Tech GmbH 65 ? unknown
G
Googlebot
 Google LLC 63 ✓ verified
A
axios
 Amazon.com, Inc. 61 ? unknown
08 · Infrastructure

Where and how requests reach us

Network-level signals: where the bot came from (country / ASN / Cloudflare datacenter), how modern its connection was, and how fast we responded. Some fields live since 2026-05-04

Top countries
Where bot traffic originates from. Bar shows relative volume.
🇺🇸USUnited States
69,537
🇷🇺RURussia
3,803
🇨🇦CACanada
625
🇩🇪DEGermany
323
🇮🇳INIndia
201
🇫🇷FRFrance
188
🇳🇱NLNetherlands
167
🇫🇮FIFinland
109
🇬🇧GBUnited Kingdom
100
🇧🇷BRBrazil
65
🇺🇦UAUA
58
🇲🇽MXMexico
55
Top Cloudflare datacenters
By total hits. Bar shows relative volume.
IADAshburn
57,675
SJCSan Jose
6,144
ARNStockholm
1,618
ATLAtlanta
1,493
LAXLos Angeles
1,044
CMH—
1,004
FRAFrankfurt
965
SEASeattle
757
YYZToronto
615
ORDChicago
585
Top ASNs
Network operators by hits.
AS140577Ahrefs USA
53,965
AS14061DigitalOcean, LLC
6,004
AS208677Cloud Technologies LLC trading as Cloud.ru
3,595
AS209366SEMrush CY LTD
1,549
AS8075Microsoft Corporation
1,064
AS32934Meta Platforms Ireland Limited
1,049
AS9Carnegie Mellon University
1,019
AS714Apple Inc.
1,018
AS16509Anthropic, PBC
994
AS31898Oracle Corporation
941
Top referrers
Where requests claim to come from. Sparse for bots.
RefererHits
https://ai-dashboard.fibr.ai118
https://fibr.ai/39
https://ai.fibr.ai/amex-fibr-platform-v3.html32
https://ai.fibr.ai/13
https://fibr.ai11
https://ai.fibr.ai/faq.md10
https://ai.fibr.ai/robots.txt8
android-app://com.slack/6
Network profile
Protocol modernness as a share of all hits.
HTTP version
HTTP/2 78%HTTP/1.1 22%HTTP/3 0%HTTP/1.0 0%
TLS version
TLSv1.3 100%TLSv1.2 0%TLSv1 0%
HTTP status code
200 OK 96%404 Not Found 4%405 Method Not Allowed 0%
HTTP method
GET 100%HEAD 0%OPTIONS 0%POST 0%
Handler latency
End-to-end Worker handler duration. Includes R2 lookup + response assembly.
p50
225ms
p95
622ms
p99
934ms
avg
292ms
samples
75,678
About this data — Real numbers from ai.fibr.ai request logs · refreshed every 5 min · 30-90s ingestion lag from edge to dashboard · bot taxonomy is hand-maintained
Rendered UTC