F
Fibr · ai.fibr.ai Bot Analytics
Last bot visit · 23s ago Updated Next UTC
3D 7D 14D 30D
01 · Headlines

How AI is reading us right now

14d · 28,983 successful bot pulls ↓ -5.1%
AI Citations · live reads 35 A real user asked an AI a question and it fetched our page
-47.0%
AI Training Crawls 1,949 Long-term knowledge accumulation
+144.8%
Unique AI tools 8/107 Of known AI tools, reading us this period
-2 new
Pages picked up 1,308 Distinct pages read by AI tools
+354.2%
⚠ Content gaps 154 Pages AI asked for that we don't have
+65 vs prev
Bytes served 543.9 MB Total response bytes (200-OK only)
AI share of bot traffic 84% vs. classic search engines
+38pp
02 · Trend

Bot activity, day by day

14d · 35 citations ↓ -47.0%
Last 14 days · daily hits i
Three lines, one story: AI citations vs training vs classic search.
AI Citations 35 · -47.0%
AI Training 1,949 · +144.8%
Search bots 392 · -61.9%
600 450 300 150 0 Aug 8 Aug 10 Aug 13 Aug 16 Aug 19 Aug 21
03 · Who's reading

The AI tool roster

8 of 107 AI tools active ↓ -20.0%
AI tool leaderboard
⌕
Tool Category Hits↓ Pages Last seen Trend
A
Ahrefs Audit
 SEO 24,085 1,506 1 hr ago
C
CCBot
 Learning 1,290 1,284 7 days ago
C
ClaudeBot
 Learning 473 17 23s ago
A
Amazonbot
 Learning 290 286 3 hr ago
A
Ahrefs
 SEO 264 2 55 min ago
Y
Yandex
 Search 252 133 1 hr ago
P
Python-httpx
 Script 132 131 4 days ago
G
GPTBot
 Learning 87 71 18 hr ago
B
Bingbot
 Search 76 23 7 hr ago
U
unknown-bot? untagged bot
 Other 74 38 1 hr ago
N
no-ua⚠ manipulated UA
 Other 41 41 8 days ago
D
DataForSEO
 SEO 37 32 14 min ago
Bot category mix
i
28,983
Total bot hits
Learning bots
7% · 1,949
Search bots
1% · 392
Query bots
0% · 35
Other / unknown
8% · 2,206
SEO bots
84% · 24,401
04 · Content performance

What AI is reading

1,308 pages reached by AI ↑ +354.2%
Top pages — AI Citations
Pages winning live AI answers right now
Query bots
⌕
Page Citations↓ Tools Last cited
/robots.txt↗33218 hr ago
/llms.txt↗111 day ago
/sitemap-ai.xml↗113 days ago
Top pages — AI Training
Pages accumulating into future AI knowledge
Learning bots
⌕
Page Crawls↓ Tools Last crawled
/sitemap-ai.xml↗28644 min ago
/robots.txt↗19534 min ago
/↗10410 hr ago
/faq.md↗432 days ago
/faq/how-does-fibr-integrate-with-existing-marketing-tools.md↗337 days ago
/faq/is-fibr-gdpr-and-privacy-compliant.md↗339 days ago
/glossary/growth-hacking.md↗339 days ago
/faq/how-can-i-use-a-widget-to-promote-special-offers-on-my-shopify-store.md↗334 days ago
/amex-fibr-platform-v3.html↗311 day ago
/faq/how-can-i-improve-conversion-rates-on-my-magento-store.md↗334 days ago
/faq/what-s-the-role-of-ai-in-optimizing-critical-rendering-path-for-websites.md↗333 days ago
/glossary/conversion-rate-optimization.md↗339 days ago
/whitepaper/personalized-landing-pages.md↗336 days ago
/faq/is-it-possible-to-achieve-a-perfect-100-score-on-google-pagespeed-insights-for-wordpress.md↗339 days ago
/glossary/cro-services-pricing.md↗339 days ago
/glossary/multivariate-testing.md↗339 days ago
/glossary/landing-page-experience.md↗339 days ago
/glossary/exit-intent-popups.md↗339 days ago
/faq/what-are-the-legal-considerations-for-ai-generated-website-images.md↗339 days ago
/glossary/enterprise-commerce.md↗339 days ago
/glossary/email-marketing.md↗339 days ago
/llms.txt↗3210 hr ago
/glossary/ad-to-landing-page-message-match.md↗339 days ago
/faq/what-are-the-key-components-of-a-successful-cro-strategy.md↗339 days ago
/conversion-rate-optimization/metrics.md↗339 days ago
/landing-page/website-personalization-tools.md↗332 days ago
/glossary/digital-experience-platform.md↗339 days ago
/liv.md↗339 days ago
/glossary/ppc-landing-page-optimization.md↗2211 days ago
/glossary/field-level-statistics.md↗2211 days ago
/faq/how-long-does-fibr-implementation-take.md↗229 days ago
/faq/what-s-the-difference-between-segmented-and-personalized-pricing.md↗2212 days ago
/glossary/zero-second-load-landing-pages.md↗229 days ago
/tools/meta-description-generator.md↗229 days ago
/faq/what-role-does-brand-loyalty-play-in-long-term-revenue-optimization.md↗229 days ago
/faq/how-does-user-behavior-analysis-impact-shopify-cro.md↗227 days ago
/blog/website-personalization-strategies.md↗225 days ago
/faq/what-are-the-benefits-of-using-a-top-cro-firm.md↗2211 days ago
/faq/how-do-i-integrate-ai-generated-images-into-my-shopify-store.md↗2212 days ago
/faq/how-do-i-analyze-and-optimize-my-conversion-path.md↗227 days ago
/faq/what-are-the-specific-algorithms-ai-uses-for-website-speed-optimization.md↗227 days ago
/ab-testing/a-b-testing-for-ads.md↗2210 days ago
/faq/how-does-ai-image-generation-impact-shopify-loading-speed.md↗228 days ago
/faq/how-does-fibr-ai-analyze-the-effectiveness-of-shopify-popups.md↗224 days ago
/landing-page/checklist.md↗2211 days ago
/croagency/new-york.md↗229 days ago
/glossary/funnel.md↗227 days ago
/tools/linkedin-caption-generator.md↗227 days ago
/glossary/conversion-rate-optimization-checklist.md↗229 days ago
/blog/why-is-website-personalization-important-for-your-marketing-strategy.md↗227 days ago
05 · Content gaps

What AI wanted that we don't have

Each row is a content brief with measurable demand.

154 content gaps ↑ +73.0%
⚠ 154 gaps
Pages Query bots couldn't find
⚡ Highest urgency — real users asked, AI couldn't answer
✓
No urgent gaps
In the last 14 days, no real-user AI fetches (ChatGPT, Claude, Perplexity, SearchGPT) hit a missing page.
Pages all AI bots couldn't find
Including training crawler 404s — broader content demand
/actuator/env↗
3 training crawls
C
G
A
3
/.git/config↗
3 training crawls
A
C
G
3
C
G
A
3
/api/graphql↗
3 training crawls
G
C
A
3
/key.pem↗
3 training crawls
G
C
A
3
/graphql↗
3 training crawls
G
A
C
3
/genesis.md):↗
3 training crawls
C
A
G
3
/.env.development↗
3 training crawls
A
C
G
3
/bootstrap.properties↗
3 training crawls
C
G
A
3
A
G
2
G
A
2
A
G
2
A
G
2
/pilot/bulk-creation.md):↗
2 training crawls
A
C
2
G
A
2
A
G
2
/blog.md):↗
2 training crawls
A
G
2
A
G
2
A
G
2
/guides/cro.md):↗
2 training crawls
G
A
2
/tools/hook-generator.md):↗
2 training crawls
A
G
2
G
A
2
/application.properties↗
2 training crawls
A
G
2
/guides/geo.md):↗
2 training crawls
G
A
2
A
G
2
/pricing.md):↗
2 training crawls
G
A
2
G
A
2
/private-key↗
2 training crawls
G
A
2
A
G
2
/max.md):↗
2 training crawls
A
G
2
/debug/vars↗
2 training crawls
C
A
2
/secrets.yml↗
2 training crawls
A
G
2
/api/v1/settings↗
2 training crawls
G
A
2
A
1
A
1
A
1
A
1
A
1
A
1
A
1
A
1
A
1
A
1
A
1
A
1
A
1
A
1
A
1
G
1
A
1
Daily missing-page requests
A leading indicator: if this climbs, our coverage is falling behind AI demand.
404s from AI 12 today · new
Aug 8 Aug 15 Aug 21
06 · LLM Referral Traffic

What AI is converting for fibr.ai

Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above. The dashed marker shows when ai.fibr.ai went live.

LLM Referral Traffic 112
+12.0% vs prev 14d
LLM Platforms referring traffic 4 of 6 tracked AI surfaces
Pages receiving AI referrals 45 of 1,308 pages read by AI
Referral visits by AI surface — over time
Daily human click-throughs from each AI platform
i AI referral traffic up 12.0% to 112 sessions over the last 14 days. ChatGPT drove 51% of it.
NO OF VISITS 9 7 5 2 0 Aug 7 Aug 10 Aug 13 Aug 15 Aug 18 Aug 21 3100 ai.fibr.ai launch

Referral traffic spikes often follow high-citation days — watch for a 1–3 day lag between AI citations and human click-throughs.

Top AI referrers
Which AI surfaces are converting citations into human visits
Tool User Sessions Page Views Landing Pages Trend
G
ChatGPT
 57 136 38
G
Gemini
 41 48 3
C
Claude
 8 8 5
P
Perplexity
 6 7 5

ChatGPT leads with 57 sessions (51% of AI traffic). Gemini is #2 with 41 sessions.

07 · Identity

Who's really behind that user-agent?

Cross-checks the UA-claimed bot identity against the requesting IP's owning organisation. Mismatches = possible spoofers using residential proxies or fake UAs. Live since 2026-05-04

Bot × AS-Organisation pairs
Top 30 (bot, owning-organisation) combinations. Hover the verification badge for details.
Bot (claimed) AS-Organisation (actual) Hits↓ Identity
A
Ahrefs Audit
 Ahrefs USA 24,085 ? unknown
C
CCBot
 Amazon Data Services Northern Virginia 1,290 ✓ verified
B
Browser (Chrome)
 Pfcloud UG 914 ? unknown
B
Browser (Chrome)
 DigitalOcean, LLC 486 ? unknown
C
ClaudeBot
 Anthropic, PBC 468 ✓ verified
Y
Yandex
 Yandex enterprise network 252 ? unknown
A
Ahrefs
 Dmytro, Ahrefs Pte Ltd 239 ✓ verified
B
Browser (Safari)
 Pfcloud UG 190 ? unknown
B
Browser (Firefox)
 Pfcloud UG 189 ? unknown
B
Browser (Chrome)
 3xK Tech GmbH 170 ? unknown
A
Amazonbot
 Amazon Technologies Inc. 142 ✓ verified
A
Amazonbot
 Amazon Data Services Northern Virginia 138 ✓ verified
P
Python-httpx
 Google LLC 130 ? unknown
B
Browser (Firefox)
 TECHOFF SRV LIMITED 112 ? unknown
B
Browser (Safari)
 DigitalOcean, LLC 96 ? unknown
G
GPTBot
 Microsoft Limited 86 ✓ verified
B
Bingbot
 Microsoft Corporation 76 ✓ verified
B
Browser (Firefox)
 DigitalOcean, LLC 74 ? unknown
U
unknown-bot
 Google LLC 64 ? unknown
B
Browser (Chrome)
 Google LLC 50 ? unknown
N
no-ua
 NWT CRS Dynamic Pool 40 ? unknown
D
DataForSEO
 Dataforseo OU 37 ✓ verified
B
Browser (Chrome)
 TECHOFF SRV LIMITED 37 ? unknown
B
Browser (Chrome)
 SKN Subnet & Telecom Ltd 26 ? unknown
A
Ahrefs
 Ahrefs Pte Ltd Dmytro 25 ✓ verified
G
Googlebot
 Google LLC 21 ✓ verified
F
Facebook
 Meta Platforms Ireland Limited 20 ? unknown
B
Browser (Chrome)
 Oracle Corporation 20 ? unknown
B
Baidu
 China United Network Communications Corporation Limited 18 ? unknown
S
SearchGPT
 Microsoft Limited 18 ✓ verified
08 · Infrastructure

Where and how requests reach us

Network-level signals: where the bot came from (country / ASN / Cloudflare datacenter), how modern its connection was, and how fast we responded. Some fields live since 2026-05-04

Top countries
Where bot traffic originates from. Bar shows relative volume.
🇺🇸USUnited States
27,579
🇳🇱NLNetherlands
1,456
🇨🇦CACanada
274
🇷🇺RURussia
253
🇩🇪DEGermany
154
🇬🇧GBUnited Kingdom
60
🇮🇳INIndia
50
🇭🇰HKHong Kong
43
🇨🇳CNChina
34
🇫🇷FRFrance
33
🇨🇭CHSwitzerland
26
🇸🇪SESweden
25
Top Cloudflare datacenters
By total hits. Bar shows relative volume.
IADAshburn
22,479
HKGHong Kong
2,607
AMSAmsterdam
1,526
EWR—
1,347
CMH—
468
YYZToronto
442
FRAFrankfurt
284
SEASeattle
183
ATLAtlanta
116
ORDChicago
105
Top ASNs
Network operators by hits.
AS140577Ahrefs USA
24,085
AS14618Amazon Data Services Northern Virginia
1,444
AS51396Pfcloud UG
1,293
AS14061DigitalOcean, LLC
661
AS16509Anthropic, PBC
468
AS13238Yandex enterprise network
252
AS396982Google LLC
247
AS16276Dmytro, Ahrefs Pte Ltd
239
AS2003733xK Tech GmbH
196
AS14618Amazon Technologies Inc.
152
Top referrers
Where requests claim to come from. Sparse for bots.
RefererHits
https://ai.fibr.ai/sitemap-ai.xml131
https://ai-dashboard.fibr.ai72
http://fibr.ai15
https://ai.fibr.ai/robots.txt12
https://fibr.ai/6
https://ai.fibr.ai/6
https://www.google.com/3
https://fibr.ai2
Network profile
Protocol modernness as a share of all hits.
HTTP version
HTTP/2 89%HTTP/1.1 11%HTTP/3 0%HTTP/1.0 0%
TLS version
TLSv1.3 100%TLSv1 0%TLSv1.2 0%
HTTP status code
200 OK 96%404 Not Found 4%
HTTP method
GET 100%HEAD 0%
Handler latency
End-to-end Worker handler duration. Includes R2 lookup + response assembly.
p50
220ms
p95
666ms
p99
1000ms
avg
291ms
samples
30,126
About this data — Real numbers from ai.fibr.ai request logs · refreshed every 5 min · 30-90s ingestion lag from edge to dashboard · bot taxonomy is hand-maintained
Rendered UTC