F
Fibr · ai.fibr.ai Bot Analytics
Last bot visit · 49s ago Updated Next UTC
3D 7D 14D 30D
01 · Headlines

How AI is reading us right now

7d · 14,655 successful bot pulls ↓ -25.2%
AI Citations · live reads 69 A real user asked an AI a question and it fetched our page
+91.7%
AI Training Crawls 345 Long-term knowledge accumulation
+26.4%
Unique AI tools 18/107 Of known AI tools, reading us this period
-4 new
Pages picked up 101 Distinct pages read by AI tools
+621.4%
⚠ Content gaps 116 Pages AI asked for that we don't have
-12 vs prev
Bytes served 307.0 MB Total response bytes (200-OK only)
AI share of bot traffic 42% vs. classic search engines
+10pp
02 · Trend

Bot activity, day by day

7d · 69 citations ↑ +91.7%
Last 7 days · daily hits i
Three lines, one story: AI citations vs training vs classic search.
AI Citations 69 · +91.7%
AI Training 345 · +26.4%
Search bots 571 · -13.5%
200 150 100 50 0 Oct 2 Oct 3 Oct 4 Oct 6 Oct 7 Oct 8
03 · Who's reading

The AI tool roster

18 of 107 AI tools active ↓ -18.2%
AI tool leaderboard
⌕
Tool Category Hits↓ Pages Last seen Trend
A
Ahrefs Audit
 SEO 12,031 1,506 11 hr ago
U
unknown-bot? untagged bot
 Other 449 167 2 min ago
Y
Yandex
 Search 314 171 1 hr ago
C
ClaudeBot
 Learning 245 8 49s ago
B
Baidu
 Search 234 225 26 min ago
M
Meta Training
 Learning 196 100 1 day ago
A
Ahrefs
 SEO 150 2 5 min ago
C
CCBot
 Learning 83 82 1 day ago
B
Bingbot
 Search 72 61 17 min ago
C
Claude User
 Query 40 18 3 hr ago
M
minimal-ua⚠ manipulated UA
 Other 27 18 17 hr ago
S
SearchGPT
 Query 23 3 3 hr ago
Bot category mix
i
14,655
Total bot hits
Learning bots
2% · 345
Search bots
4% · 571
Query bots
0% · 69
Other / unknown
10% · 1,471
SEO bots
83% · 12,199
04 · Content performance

What AI is reading

101 pages reached by AI ↑ +621.4%
Top pages — AI Citations
Pages winning live AI answers right now
Query bots
⌕
Page Citations↓ Tools Last cited
/robots.txt↗4023 hr ago
/pricing.md↗523 hr ago
/faq/can-a-long-form-sales-page-work-for-meta-ads-or-should-it-be-short-and-sweet.md↗211 day ago
/blog/fibr-launches-ai-cro-agents.md↗214 days ago
/tools/landing-page-analyzer.md↗2117 hr ago
/ab-testing/ab-testing-examples.md↗221 day ago
/llms.txt↗111 day ago
/ankur-aj.md↗113 days ago
/pritam-roy.md↗113 days ago
/llms-full.txt↗116 hr ago
/tools/cro-audit.md↗1117 hr ago
/landing-page/website-personalization-tools.md↗116 days ago
/faq/how-much-do-ecommerce-cro-agencies-typically-charge.md↗1110 hr ago
/faq/is-ai-image-generation-good-for-product-photography.md↗112 days ago
/faq/how-much-do-cro-freelancers-typically-charge.md↗111 day ago
/conversion-rate-optimization/conversion-rate-formula.md↗113 days ago
/faq/how-much-do-cro-agencies-typically-charge.md↗111 day ago
/pilot/ab-testing/tools-comparision.md↗115 hr ago
/faq/how-much-do-ai-cro-tools-cost.md↗117 hr ago
/faq/what-s-the-minimum-traffic-needed-to-run-a-statistically-significant-a-b-test-on-shopify.md↗1115 hr ago
/glossary/ai-landing-page-analyzer.md↗114 days ago
/pilot/audience-personalization.md↗112 days ago
Top pages — AI Training
Pages accumulating into future AI knowledge
Learning bots
⌕
Page Crawls↓ Tools Last crawled
/sitemap-ai.xml↗15047 min ago
/robots.txt↗10237 min ago
/↗722 days ago
/faq/what-s-the-connection-between-page-load-speed-and-shopify-conversion-rates.md↗712 days ago
/faq/can-i-use-ai-cro-tools-to-optimize-my-entire-marketing-funnel.md↗111 day ago
/blog/google-ads-vs-facebook-ads-choosing-the-best-for-marketing-campaigns.md↗111 day ago
/faq/how-can-fibr-ai-contribute-to-overall-website-speed-optimization.md↗111 day ago
/faq/can-contextualized-images-reduce-product-returns.md↗111 day ago
/blog/ai-cms-the-complete-2026-guide-for-modern-content-teams.md↗111 day ago
/faq/can-an-ai-cro-agency-help-optimize-for-specific-marketing-channels.md↗111 day ago
/blog/best-marketing-automation-software.md↗111 day ago
/blog/customer-experience.md↗111 day ago
/blog/boost-ad-efficiency-with-fibr.md↗111 day ago
/blog/mastering-website-localization-best-way-to-convert-global-audience.md↗111 day ago
/blog/how-conversion-marketing-transforms-website-visitors-into-customers.md↗111 day ago
/faq/are-there-any-drawbacks-to-using-popups.md↗111 day ago
/amex-fibr-platform-v3.html↗115 days ago
/blog/best-web-personalization-examples.md↗111 day ago
/blog/landing-page-optimization-how-contextualization-plays-an-important-role.md↗111 day ago
/faq/can-ai-generate-hypotheses-for-both-website-content-and-advertising.md↗111 day ago
/faq/does-ai-replace-human-intuition-in-hypothesis-generation.md↗111 day ago
/faq/can-i-personalize-images-for-individual-website-visitors-in-real-time.md↗111 day ago
/glossary/ai-cro-audit.md↗111 day ago
/blog/vwo-alternatives.md↗111 day ago
/faq/can-contextualisation-improve-conversion-rates.md↗111 day ago
/ab-testing/split-testing.md↗111 day ago
/blog/ai-audience-segmentation.md↗111 day ago
/faq/can-widgets-help-with-lead-generation-on-a-shopify-store.md↗111 day ago
/faq/can-shopify-brands-use-ai-for-image-generation.md↗111 day ago
/faq/how-can-an-ai-cro-agency-help-my-business.md↗111 day ago
/faq/can-widgets-be-used-for-upsells-and-cross-sells-on-shopify.md↗111 day ago
/faq/are-there-any-free-tools-for-creating-website-widgets-and-popups.md↗111 day ago
/faq/how-does-click-rate-optimization-affect-conversion-rates.md↗111 day ago
/faq/can-ai-generate-realistic-product-images-from-just-a-text-description.md↗111 day ago
/faq/does-fibr-ai-offer-specialized-image-generation-for-shopify-brands.md↗111 day ago
/blog/how-to-create-a-winning-omnichannel-landing-page-strategy.md↗111 day ago
/faq/can-popups-be-used-for-abandoned-cart-recovery-on-shopify.md↗111 day ago
/conversion-rate-optimization/mobile.md↗111 day ago
/blog/from-bonjour-to-%E4%BD%A0%E5%A5%BD-start-website-localization-and-build-global-profits.md↗111 day ago
/conversion-rate-optimization/10-best-conversion-rate-optimization-companies.md↗111 day ago
/blog/message-match-identify-and-overcome-common-advertisement-pitfalls.md↗111 day ago
/faq/what-s-the-role-of-ai-in-sentiment-analysis-for-ux-research.md↗111 day ago
/blog/website-personalization-strategies.md↗111 day ago
/faq/can-widgets-be-used-to-enhance-website-navigation.md↗111 day ago
/blog/web-personalization-strategies-for-b2c-saas-success.md↗111 day ago
/faq/can-a-long-form-sales-page-work-for-meta-ads-or-should-it-be-short-and-sweet.md↗111 day ago
/faq/what-services-do-the-best-conversion-rate-optimization-firms-provide.md↗111 day ago
/faq/is-it-possible-to-generate-custom-icons-and-illustrations-using-ai-for-websites.md↗111 day ago
/customer-stories/fusemi-boosts-conversions-with-fibr.md↗111 day ago
/faq/how-accurate-is-ai-in-cro-analysis.md↗111 day ago
05 · Content gaps

What AI wanted that we don't have

Each row is a content brief with measurable demand.

116 content gaps ↓ -9.4%
⚠ 116 gaps
Pages Query bots couldn't find
⚡ Highest urgency — real users asked, AI couldn't answer
/api/v1/config↗
First asked Oct 5 · 3 days ago
P
1
/assets../.env↗
First asked Oct 5 · 3 days ago
P
1
/build../.env↗
First asked Oct 5 · 3 days ago
C
1
/public/admin.json↗
First asked Oct 5 · 3 days ago
C
1
/firebase-adminsdk.json↗
First asked Oct 5 · 3 days ago
P
1
/config/gcp-credentials.json↗
First asked Oct 5 · 3 days ago
C
1
Pages all AI bots couldn't find
Including training crawler 404s — broader content demand
/files../.env↗
3 training crawls
G
M
3
/Dockerfile↗
3 training crawls
M
C
3
/uploads../.env↗
3 training crawls
M
C
3
/api%2F.env↗
3 training crawls
C
M
3
/assets../.env↗
1 live read · 2 training crawls
P
M
3
/proc/self/cmdline↗
3 training crawls
G
M
3
/dist/.env↗
3 training crawls
M
C
3
/userfiles↗
3 training crawls
C
M
3
/api/v1/config↗
1 live read · 2 training crawls
M
P
3
/localhost.key↗
3 training crawls
M
C
3
/graphql/console↗
3 training crawls
M
Y
3
/config/.env↗
2 training crawls
M
2
/server.key↗
2 training crawls
M
2
/js../.env↗
2 training crawls
M
2
/api/v1/config/↗
2 training crawls
M
2
M
2
/document.php↗
2 training crawls
M
2
/internal/.env↗
2 training crawls
M
2
/static/app/.env↗
2 training crawls
M
2
/.env.save↗
2 training crawls
M
2
/shared/.env↗
2 training crawls
M
2
/site/.env↗
2 training crawls
M
2
/model/.env↗
2 training crawls
M
2
/.env.production↗
2 training crawls
M
2
/.env.live↗
2 training crawls
M
2
/id_ed25519↗
2 training crawls
M
2
/web/.env↗
2 training crawls
M
2
/api/v1/keys↗
2 training crawls
M
2
/api/account↗
2 training crawls
M
2
/.ssh/id_rsa↗
2 training crawls
M
2
/.aws/config↗
2 training crawls
M
2
/actuator/threaddump↗
2 training crawls
M
2
/web.config↗
2 training crawls
M
2
/config/settings.py↗
2 training crawls
M
2
M
2
M
2
M
2
M
2
M
2
M
2
M
2
/instance/config.py↗
2 training crawls
M
2
/actuator/loggers↗
2 training crawls
M
2
/api/.env/public/.env↗
2 training crawls
M
2
/actuator/configprops↗
2 training crawls
M
2
/api/console/api_server↗
2 training crawls
M
2
/dashboard%2F.env↗
2 training crawls
M
2
/config/secrets.yml↗
2 training crawls
M
2
/docker-compose.yml↗
2 training crawls
M
2
/api/auth/session↗
2 training crawls
M
2
Daily missing-page requests
A leading indicator: if this climbs, our coverage is falling behind AI demand.
404s from AI 5 today · new
Oct 2 Oct 5 Oct 8
06 · LLM Referral Traffic

What AI is converting for fibr.ai

Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above. The dashed marker shows when ai.fibr.ai went live.

LLM Referral Traffic 19
-48.6% vs prev 7d
LLM Platforms referring traffic 3 of 6 tracked AI surfaces
Pages receiving AI referrals 15 of 101 pages read by AI
Referral visits by AI surface — over time
Daily human click-throughs from each AI platform
i AI referral traffic down 48.6% to 19 sessions over the last 7 days. ChatGPT drove 84% of it.
NO OF VISITS 4 3 2 1 0 Oct 1 Oct 2 Oct 4 Oct 5 Oct 7 Oct 8 000 ai.fibr.ai launch

Referral traffic spikes often follow high-citation days — watch for a 1–3 day lag between AI citations and human click-throughs.

Top AI referrers
Which AI surfaces are converting citations into human visits
Tool User Sessions Page Views Landing Pages Trend
G
ChatGPT
 16 23 12
P
Perplexity
 2 2 2
G
Gemini
 1 1 1

ChatGPT leads with 16 sessions (84% of AI traffic). Perplexity is #2 with 2 sessions.

07 · Identity

Who's really behind that user-agent?

Cross-checks the UA-claimed bot identity against the requesting IP's owning organisation. Mismatches = possible spoofers using residential proxies or fake UAs. Live since 2026-05-04

Bot × AS-Organisation pairs
Top 30 (bot, owning-organisation) combinations. Hover the verification badge for details.
Bot (claimed) AS-Organisation (actual) Hits↓ Identity
A
Ahrefs Audit
 Ahrefs USA 12,031 ? unknown
Y
Yandex
 Yandex enterprise network 314 ? unknown
U
unknown-bot
 UAB code200 290 ? unknown
C
ClaudeBot
 Anthropic, PBC 244 ✓ verified
B
Browser (Chrome)
 Interworks Networking Services 232 ? unknown
B
Browser (Chrome)
 CROCKER COMMUNICATIONS, INCORPORATED 220 ? unknown
B
Browser (Chrome)
 IPNetZone 218 ? unknown
M
Meta Training
 Meta Platforms Ireland Limited 195 ? unknown
B
Baidu
 CHINANET Beijing province network 125 ? unknown
A
Ahrefs
 OVH US LLC 121 ⚠ unverified
B
Browser (Chrome)
 Google LLC 116 ? unknown
B
Baidu
 China United Network Communications Corporation Limited 107 ? unknown
C
CCBot
 Amazon Data Services Northern Virginia 79 ✓ verified
U
unknown-bot
 Amazon.com, Inc. 78 ? unknown
B
Bingbot
 Microsoft Corporation 72 ✓ verified
C
Claude User
 Google LLC 40 ? unknown
U
unknown-bot
 Amazon Technologies Inc. 34 ? unknown
B
Browser (Chrome)
 Web2Objects LLC 34 ? unknown
B
Browser (Chrome)
 TC DATACENTER LIMITED MANAGED IP SPACE 30 ? unknown
M
minimal-ua
 TC DATACENTER LIMITED MANAGED IP SPACE 25 ? unknown
A
Ahrefs
 Ahrefs Pte Ltd Dmytro 23 ✓ verified
B
Browser (Safari)
 Snapchat, Inc 23 ? unknown
C
curl
 Elisa Oyj 23 ? unknown
B
Browser (Chrome)
 LogicWeb Inc. 21 ? unknown
B
Browser (Chrome)
 CHINANET hebei province network 20 ? unknown
B
Browser (Chrome)
 CustodianDC Limited 20 ? unknown
B
Browser (Chrome)
 China Unicom Heibei Province Network 19 ? unknown
G
Googlebot
 Google LLC 16 ✓ verified
U
unknown-bot
 Google LLC 16 ? unknown
U
unknown-bot
 Feo Prest SRL 15 ? unknown
08 · Infrastructure

Where and how requests reach us

Network-level signals: where the bot came from (country / ASN / Cloudflare datacenter), how modern its connection was, and how fast we responded. Some fields live since 2026-05-04

Top countries
Where bot traffic originates from. Bar shows relative volume.
🇺🇸USUnited States
14,276
🇷🇺RURussia
314
🇨🇳CNChina
295
🇸🇬SGSingapore
75
🇵🇱PLPoland
69
🇩🇪DEGermany
57
🇬🇧GBUnited Kingdom
37
🇫🇮FIFinland
23
🇮🇳INIndia
17
🇳🇱NLNetherlands
14
🇫🇷FRFrance
9
🇦🇹ATAustria
8
Top Cloudflare datacenters
By total hits. Bar shows relative volume.
IADAshburn
5,909
EWR—
5,158
ATLAtlanta
1,189
BOS—
519
LAXLos Angeles
311
ORDChicago
277
AMSAmsterdam
256
CMH—
233
FRAFrankfurt
139
MXPMilan
138
Top ASNs
Network operators by hits.
AS140577Ahrefs USA
12,031
AS13238Yandex enterprise network
314
AS27411UAB code200
291
AS16509Anthropic, PBC
244
AS20012Interworks Networking Services
232
AS396982Google LLC
229
AS7849CROCKER COMMUNICATIONS, INCORPORATED
220
AS2914IPNetZone
218
AS32934Meta Platforms Ireland Limited
212
AS23724CHINANET Beijing province network
125
Top referrers
Where requests claim to come from. Sparse for bots.
RefererHits
https://fibr.ai/13
https://www.fibr.ai2
https://ai.fibr.ai/faq/how-do-i-develop-a-conversion-rate-optimisation-strategy.md2
https://ai.fibr.ai/robots.txt2
https://ai.fibr.ai/tools/cro-audit.md1
https://ai.fibr.ai/faq/what-are-penetration-pricing-and-bundling-strategies.md1
https://ai.fibr.ai/glossary/click-through-page.md1
https://ai.fibr.ai/faq/what-are-the-limitations-of-ai-in-a-b-testing1
Network profile
Protocol modernness as a share of all hits.
HTTP version
HTTP/2 91%HTTP/1.1 9%HTTP/3 0%
TLS version
TLSv1.3 100%TLSv1.2 0%
HTTP status code
200 OK 96%404 Not Found 4%405 Method Not Allowed 0%
HTTP method
GET 100%POST 0%HEAD 0%DELETE 0%
Handler latency
End-to-end Worker handler duration. Includes R2 lookup + response assembly.
p50
236ms
p95
629ms
p99
910ms
avg
289ms
samples
15,253
About this data — Real numbers from ai.fibr.ai request logs · refreshed every 5 min · 30-90s ingestion lag from edge to dashboard · bot taxonomy is hand-maintained
Rendered UTC