F
Fibr · ai.fibr.ai Bot Analytics
Last bot visit · 15 min ago Updated Next UTC
3D 7D 14D 30D
01 · Headlines

How AI is reading us right now

30d · 63,353 successful bot pulls ↓ -4.5%
AI Citations · live reads 107 A real user asked an AI a question and it fetched our page
-19.5%
AI Training Crawls 2,820 Long-term knowledge accumulation
+38.4%
Unique AI tools 12/107 Of known AI tools, reading us this period
+4 new
Pages picked up 1,345 Distinct pages read by AI tools
+44.0%
⚠ Content gaps 172 Pages AI asked for that we don't have
+3 vs prev
Bytes served 1.15 GB Total response bytes (200-OK only)
AI share of bot traffic 64% vs. classic search engines
+4pp
02 · Trend

Bot activity, day by day

30d · 107 citations ↓ -19.5%
Last 30 days · daily hits i
Three lines, one story: AI citations vs training vs classic search.
AI Citations 107 · -19.5%
AI Training 2,820 · +38.4%
Search bots 1,645 · +11.6%
600 450 300 150 0 Jul 23 Jul 29 Aug 4 Aug 10 Aug 16 Aug 21
03 · Who's reading

The AI tool roster

12 of 107 AI tools active ↑ +50.0%
AI tool leaderboard
⌕
Tool Category Hits↓ Pages Last seen Trend
A
Ahrefs Audit
 SEO 51,051 1,506 34 min ago
U
unknown-bot? untagged bot
 Other 2,039 1,495 1 hr ago
C
CCBot
 Learning 1,292 1,285 7 days ago
C
ClaudeBot
 Learning 986 6 28 min ago
B
Baidu
 Search 939 920 1 hr ago
A
Ahrefs
 SEO 704 138 15 min ago
A
Amazonbot
 Learning 553 547 2 hr ago
Y
Yandex
 Search 382 194 1 hr ago
B
Bingbot
 Search 224 102 6 hr ago
G
GPTBot
 Learning 166 132 17 hr ago
P
Python-httpx
 Script 138 133 4 days ago
N
no-ua⚠ manipulated UA
 Other 132 72 8 days ago
Bot category mix
i
63,353
Total bot hits
Learning bots
4% · 2,820
Search bots
3% · 1,645
Query bots
0% · 107
Other / unknown
11% · 6,940
SEO bots
82% · 51,841
04 · Content performance

What AI is reading

1,345 pages reached by AI ↑ +44.0%
Top pages — AI Citations
Pages winning live AI answers right now
Query bots
⌕
Page Citations↓ Tools Last cited
/robots.txt↗68217 hr ago
/journey-personalization.md↗3219 days ago
/llms.txt↗331 day ago
/index.md↗3219 days ago
/pricing-old.md↗3219 days ago
/↗2119 days ago
/landing-page/website-personalization-tools.md↗2123 days ago
/blog/landing-page-optimization-with-fibr.md↗2219 days ago
/liv.md↗2120 days ago
/faq/what-are-the-typical-costs-associated-with-hiring-an-ai-cro-agency.md↗2219 days ago
/pilot.md↗1123 days ago
/ankur-aj.md↗1123 days ago
/sitemap-ai.xml↗113 days ago
/llm-personalization.md↗1123 days ago
/landing-page/ai.md↗1123 days ago
/experimentation.md↗1128 days ago
/guides/landingpage.md↗1123 days ago
/blog/everything-you-need-to-know-about-website-personalization.md↗1123 days ago
/faq/what-s-the-difference-between-segmented-and-personalized-pricing.md↗1124 days ago
/glossary/website-personalization.md↗1123 days ago
/agentic-web-personalization-ads-llm.md↗1124 days ago
/faq/what-tools-offer-ai-driven-website-audits.md↗1124 days ago
/whitepaper/personalized-landing-pages.md↗1123 days ago
/blog/website-personalization-strategies.md↗1123 days ago
/faq/how-does-fibr-integrate-with-existing-marketing-tools.md↗1124 days ago
/faq/how-do-i-integrate-ai-a-b-testing-with-my-existing-marketing-stack.md↗1124 days ago
/faq/how-does-fibr-work-with-my-cdp-or-personalization-platform.md↗1124 days ago
Top pages — AI Training
Pages accumulating into future AI knowledge
Learning bots
⌕
Page Crawls↓ Tools Last crawled
/sitemap-ai.xml↗612528 min ago
/robots.txt↗418528 min ago
/↗14510 hr ago
/whitepaper/optimizing-the-entire-customer-journey.md↗6413 days ago
/faq.md↗542 days ago
/glossary/customer-journey-mapping.md↗538 days ago
/llms.txt↗5210 hr ago
/faq/what-is-fibr-ai.md↗437 days ago
/faq/how-do-i-reduce-cart-abandonment-during-checkout-in-ecommerce.md↗3311 days ago
/faq/how-does-fibr-work-with-my-cdp-or-personalization-platform.md↗338 days ago
/faq/what-s-the-role-of-ai-in-optimizing-critical-rendering-path-for-websites.md↗333 days ago
/amex-fibr-platform-v3.html↗311 day ago
/faq/what-are-the-best-practices-for-using-ai-to-create-promotional-images-for-shopify.md↗3311 days ago
/blog/why-every-ad-campaign-needs-its-own-landing-page.md↗339 days ago
/glossary/multivariate-testing.md↗339 days ago
/faq/what-are-the-legal-considerations-for-ai-generated-website-images.md↗339 days ago
/glossary/cro-services-pricing.md↗339 days ago
/faq/how-can-i-use-a-widget-to-promote-special-offers-on-my-shopify-store.md↗334 days ago
/faq/how-long-should-a-shopify-a-b-test-run.md↗339 days ago
/faq/how-does-ai-streamline-the-user-testing-process.md↗3311 days ago
/glossary/account-based-marketing.md↗3313 days ago
/faq/is-it-possible-to-achieve-a-perfect-100-score-on-google-pagespeed-insights-for-wordpress.md↗339 days ago
/faq/is-fibr-gdpr-and-privacy-compliant.md↗339 days ago
/glossary/exit-intent-popups.md↗339 days ago
/whitepaper/personalized-landing-pages.md↗336 days ago
/glossary/cro-best-practices.md↗3313 days ago
/landing-page/landing-page-audit.md↗3311 days ago
/faq/what-s-the-learning-curve-like-for-using-ai-cro-tools.md↗3311 days ago
/faq/how-often-should-i-check-my-website-s-speed.md↗3311 days ago
/ab-testing/ab-testing-sample-size.md↗3310 days ago
/glossary/conversion-rate-optimization.md↗339 days ago
/glossary/website-personalization.md↗336 days ago
/faq/what-are-the-basic-principles-of-conversion-optimisation.md↗3310 days ago
/glossary/enterprise-commerce.md↗339 days ago
/faq/should-i-use-lazy-loading-for-images-on-my-wordpress-site.md↗3310 days ago
/glossary/digital-experience-platform.md↗339 days ago
/glossary/inbound-marketing.md↗3313 days ago
/faq/what-s-the-best-way-to-display-customer-reviews-using-a-shopify-widget.md↗337 days ago
/faq/what-types-of-popups-work-best-on-shopify.md↗3310 days ago
/landing-page/website-personalization-tools.md↗332 days ago
/faq/how-do-i-choose-a-conversion-rate-optimisation-professional-in-halifax.md↗339 days ago
/blog/website-optimization-case-studies-how-brands-achieved-amazing-results.md↗3312 days ago
/faq/how-can-i-improve-conversion-rates-on-my-magento-store.md↗334 days ago
/glossary/cro-automation-software.md↗3313 days ago
/faq/how-do-i-create-a-data-driven-cro-strategy.md↗3310 days ago
/faq/what-are-the-best-practices-for-automotive-website-conversion-optimization.md↗337 days ago
/conversion-rate-optimization/metrics.md↗339 days ago
/tools/meta-description-generator.md↗339 days ago
/liv.md↗339 days ago
/glossary/ai-cro-platform.md↗3313 days ago
05 · Content gaps

What AI wanted that we don't have

Each row is a content brief with measurable demand.

172 content gaps ↑ +1.8%
⚠ 172 gaps
Pages Query bots couldn't find
⚡ Highest urgency — real users asked, AI couldn't answer
✓
No urgent gaps
In the last 30 days, no real-user AI fetches (ChatGPT, Claude, Perplexity, SearchGPT) hit a missing page.
Pages all AI bots couldn't find
Including training crawler 404s — broader content demand
/actuator/env↗
5 training crawls
A
M
G
A
5
/secrets.yml↗
5 training crawls
A
A
G
M
5
/application.properties↗
4 training crawls
A
G
A
M
4
A
G
M
4
/.git/config↗
4 training crawls
M
A
G
A
4
/key.pem↗
4 training crawls
A
G
M
A
4
/graphql↗
4 training crawls
G
A
A
M
4
/.env.development↗
4 training crawls
A
G
M
A
4
/api/v1/settings↗
4 training crawls
M
G
A
A
4
/private-key↗
4 training crawls
A
G
A
M
4
/staging/.env↗
4 training crawls
A
A
M
4
/bootstrap.properties↗
4 training crawls
M
A
G
A
4
/api/graphql↗
4 training crawls
M
G
A
A
4
/genesis.md):↗
3 training crawls
M
A
G
3
A
G
M
3
/.hermes/.env↗
3 training crawls
A
A
M
3
A
G
M
3
M
G
A
3
A
M
G
3
M
G
A
3
M
G
A
3
M
G
A
3
A
G
M
3
/.vscode/launch.json↗
3 training crawls
A
M
3
M
A
G
3
/.env.example↗
3 training crawls
A
A
M
3
/guides/geo.md):↗
3 training crawls
G
A
M
3
M
A
G
3
/gcp-service.json↗
3 training crawls
A
M
3
A
M
G
3
A
M
G
3
A
G
M
3
A
M
G
3
M
G
A
3
G
A
M
3
M
G
A
3
M
G
A
3
A
G
M
3
G
A
M
3
A
G
M
3
/settings.json↗
3 training crawls
A
M
3
/debug/vars↗
3 training crawls
A
A
M
3
G
A
M
3
M
G
A
3
/.npmrc↗
3 training crawls
M
A
A
3
A
G
M
3
G
M
A
3
M
A
G
3
A
G
2
/pilot/bulk-creation.md):↗
2 training crawls
M
A
2
Daily missing-page requests
A leading indicator: if this climbs, our coverage is falling behind AI demand.
404s from AI 0 today · 0%
Jul 23 Aug 7 Aug 21
06 · LLM Referral Traffic

What AI is converting for fibr.ai

Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above. The dashed marker shows when ai.fibr.ai went live.

LLM Referral Traffic 215
-8.1% vs prev 30d
LLM Platforms referring traffic 4 of 6 tracked AI surfaces
Pages receiving AI referrals 58 of 1,345 pages read by AI
Referral visits by AI surface — over time
Daily human click-throughs from each AI platform
i AI referral traffic down 8.1% to 215 sessions over the last 30 days. ChatGPT drove 52% of it.
NO OF VISITS 9 7 5 2 0 Jul 22 Jul 28 Aug 3 Aug 9 Aug 15 Aug 21 3100 ai.fibr.ai launch

Referral traffic spikes often follow high-citation days — watch for a 1–3 day lag between AI citations and human click-throughs.

Top AI referrers
Which AI surfaces are converting citations into human visits
Tool User Sessions Page Views Landing Pages Trend
G
ChatGPT
 112 207 47
G
Gemini
 76 84 8
C
Claude
 17 14 7
P
Perplexity
 10 11 7

ChatGPT leads with 112 sessions (52% of AI traffic). Gemini is #2 with 76 sessions.

07 · Identity

Who's really behind that user-agent?

Cross-checks the UA-claimed bot identity against the requesting IP's owning organisation. Mismatches = possible spoofers using residential proxies or fake UAs. Live since 2026-05-04

Bot × AS-Organisation pairs
Top 30 (bot, owning-organisation) combinations. Hover the verification badge for details.
Bot (claimed) AS-Organisation (actual) Hits↓ Identity
A
Ahrefs Audit
 Ahrefs USA 51,051 ? unknown
U
unknown-bot
 DigitalOcean, LLC 1,491 ? unknown
B
Browser (Chrome)
 Google LLC 1,354 ? unknown
B
Browser (Chrome)
 Pfcloud UG 1,323 ? unknown
C
CCBot
 Amazon Data Services Northern Virginia 1,292 ✓ verified
C
ClaudeBot
 Anthropic, PBC 981 ✓ verified
A
Ahrefs
 Dmytro, Ahrefs Pte Ltd 650 ✓ verified
B
Baidu
 CHINANET Beijing province network 495 ? unknown
B
Browser (Chrome)
 FranTech Solutions 491 ? unknown
B
Browser (Chrome)
 DigitalOcean, LLC 488 ? unknown
B
Baidu
 China United Network Communications Corporation Limited 444 ? unknown
Y
Yandex
 Yandex enterprise network 382 ? unknown
U
unknown-bot
 Carnegie Mellon University 356 ? unknown
B
Browser (Firefox)
 Pfcloud UG 275 ? unknown
A
Amazonbot
 Amazon Technologies Inc. 273 ✓ verified
B
Browser (Safari)
 Pfcloud UG 265 ? unknown
A
Amazonbot
 Amazon Data Services Northern Virginia 259 ✓ verified
B
Bingbot
 Microsoft Corporation 223 ✓ verified
B
Browser (Chrome)
 3xK Tech GmbH 171 ? unknown
G
GPTBot
 Microsoft Limited 165 ✓ verified
P
Python-httpx
 Google LLC 130 ? unknown
B
Browser (Firefox)
 FranTech Solutions 127 ? unknown
B
Browser (Firefox)
 TECHOFF SRV LIMITED 121 ? unknown
B
Browser (Safari)
 FranTech Solutions 121 ? unknown
U
unknown-bot
 Google LLC 101 ? unknown
M
Meta Training
 Meta Platforms Ireland Limited 99 ? unknown
B
Browser (Safari)
 DigitalOcean, LLC 96 ? unknown
N
no-ua
 NWT CRS Dynamic Pool 83 ? unknown
B
Browser (Firefox)
 DigitalOcean, LLC 76 ? unknown
B
Browser (Chrome)
 Amazon Data Services Northern Virginia 74 ? unknown
08 · Infrastructure

Where and how requests reach us

Network-level signals: where the bot came from (country / ASN / Cloudflare datacenter), how modern its connection was, and how fast we responded. Some fields live since 2026-05-04

Top countries
Where bot traffic originates from. Bar shows relative volume.
🇺🇸USUnited States
60,349
🇳🇱NLNetherlands
2,303
🇨🇳CNChina
1,068
🇨🇦CACanada
689
🇷🇺RURussia
386
🇩🇪DEGermany
209
🇭🇰HKHong Kong
158
🇨🇭CHSwitzerland
104
🇬🇧GBUnited Kingdom
81
🇮🇳INIndia
77
🇸🇬SGSingapore
66
🇫🇷FRFrance
59
Top Cloudflare datacenters
By total hits. Bar shows relative volume.
IADAshburn
50,493
AMSAmsterdam
3,019
EWR—
3,018
HKGHong Kong
2,675
ORDChicago
1,410
CMH—
985
YYZToronto
863
LAXLos Angeles
754
LAS—
739
FRAFrankfurt
342
Top ASNs
Network operators by hits.
AS140577Ahrefs USA
51,051
AS14061DigitalOcean, LLC
2,156
AS51396Pfcloud UG
1,863
AS14618Amazon Data Services Northern Virginia
1,713
AS396982Google LLC
1,633
AS16509Anthropic, PBC
981
AS53667FranTech Solutions
739
AS16276Dmytro, Ahrefs Pte Ltd
650
AS23724CHINANET Beijing province network
495
AS4837China United Network Communications Corporation Limited
444
Top referrers
Where requests claim to come from. Sparse for bots.
RefererHits
https://ai.fibr.ai/sitemap-ai.xml133
https://ai-dashboard.fibr.ai120
https://ai.fibr.ai/robots.txt25
https://fibr.ai/18
https://ai.fibr.ai/faq.md15
http://fibr.ai15
https://ai.fibr.ai/8
https://ai.fibr.ai6
Network profile
Protocol modernness as a share of all hits.
HTTP version
HTTP/2 86%HTTP/1.1 14%HTTP/3 0%HTTP/1.0 0%
TLS version
TLSv1.3 100%TLSv1.2 0%TLSv1 0%
HTTP status code
200 OK 96%404 Not Found 4%405 Method Not Allowed 0%
HTTP method
GET 100%HEAD 0%POST 0%OPTIONS 0%
Handler latency
End-to-end Worker handler duration. Includes R2 lookup + response assembly.
p50
220ms
p95
617ms
p99
895ms
avg
279ms
samples
65,829
About this data — Real numbers from ai.fibr.ai request logs · refreshed every 5 min · 30-90s ingestion lag from edge to dashboard · bot taxonomy is hand-maintained
Rendered UTC