F
Fibr · ai.fibr.ai Bot Analytics
Last bot visit · 17 min ago Updated Next UTC
3D 7D 14D 30D
01 · Headlines

How AI is reading us right now

30d · 70,216 successful bot pulls ↑ +7.9%
AI Citations · live reads 152 A real user asked an AI a question and it fetched our page
+111.1%
AI Training Crawls 1,517 Long-term knowledge accumulation
-54.6%
Unique AI tools 23/107 Of known AI tools, reading us this period
+7 new
Pages picked up 399 Distinct pages read by AI tools
-71.8%
⚠ Content gaps 411 Pages AI asked for that we don't have
+40 vs prev
Bytes served 1.29 GB Total response bytes (200-OK only)
AI share of bot traffic 44% vs. classic search engines
-19pp
02 · Trend

Bot activity, day by day

30d · 152 citations ↑ +111.1%
Last 30 days · daily hits i
Three lines, one story: AI citations vs training vs classic search.
AI Citations 152 · +111.1%
AI Training 1,517 · -54.6%
Search bots 2,158 · +9.0%
300 225 150 75 0 Sep 9 Sep 15 Sep 21 Sep 27 Oct 3 Oct 8
03 · Who's reading

The AI tool roster

23 of 107 AI tools active ↑ +43.8%
AI tool leaderboard
⌕
Tool Category Hits↓ Pages Last seen Trend
A
Ahrefs Audit
 SEO 49,625 1,506 10 hr ago
U
unknown-bot? untagged bot
 Other 4,365 1,931 17 min ago
S
Semrush
 SEO 1,544 1,506 11 hr ago
B
Baidu
 Search 1,468 949 19 min ago
C
ClaudeBot
 Learning 1,061 38 1 hr ago
A
Ahrefs
 SEO 840 192 1 hr ago
Y
Yandex
 Search 765 396 38 min ago
A
Amazonbot
 Learning 525 492 2 days ago
M
Meta Training
 Learning 251 135 1 day ago
B
Bingbot
 Search 185 108 4 hr ago
G
GPTBot
 Learning 183 133 2 hr ago
D
DataForSEO
 SEO 156 144 16 hr ago
Bot category mix
i
70,216
Total bot hits
Learning bots
2% · 1,517
Search bots
3% · 2,158
Query bots
0% · 152
Other / unknown
20% · 14,221
SEO bots
74% · 52,168
04 · Content performance

What AI is reading

399 pages reached by AI ↓ -71.8%
Top pages — AI Citations
Pages winning live AI answers right now
Query bots
⌕
Page Citations↓ Tools Last cited
/robots.txt↗11422 hr ago
/pricing.md↗622 hr ago
/faq/can-a-long-form-sales-page-work-for-meta-ads-or-should-it-be-short-and-sweet.md↗211 day ago
/tools/landing-page-analyzer.md↗2116 hr ago
/pilot/audience-personalization.md↗222 days ago
/blog/fibr-launches-ai-cro-agents.md↗214 days ago
/ab-testing/ab-testing-examples.md↗221 day ago
/faq/how-much-do-ecommerce-cro-agencies-typically-charge.md↗119 hr ago
/book-a-demo.md↗1112 days ago
/llm-personalization.md↗1112 days ago
/tools/cro-audit.md↗1116 hr ago
/pricing-old.md↗117 days ago
/landing-page/website-personalization-tools.md↗116 days ago
/landing-page/google-ads-landing-page.md↗1115 days ago
/llms-full.txt↗115 hr ago
/faq/is-ai-image-generation-good-for-product-photography.md↗112 days ago
/personalization-at-scale-cdp.md↗1112 days ago
/faq/how-much-do-cro-freelancers-typically-charge.md↗111 day ago
/conversion-rate-optimization/conversion-rate-formula.md↗113 days ago
/faq/how-much-do-cro-agencies-typically-charge.md↗111 day ago
/pilot/ab-testing/tools-comparision.md↗114 hr ago
/faq/how-much-do-ai-cro-tools-cost.md↗116 hr ago
/blog/dynamic-yield-alternatives.md↗117 days ago
/faq/what-s-the-minimum-traffic-needed-to-run-a-statistically-significant-a-b-test-on-shopify.md↗1114 hr ago
/pritam-roy.md↗113 days ago
/glossary/ai-landing-page-analyzer.md↗114 days ago
/ankur-aj.md↗113 days ago
/llms.txt↗111 day ago
/↗1124 days ago
Top pages — AI Training
Pages accumulating into future AI knowledge
Learning bots
⌕
Page Crawls↓ Tools Last crawled
/sitemap-ai.xml↗63541 hr ago
/robots.txt↗42931 hr ago
/↗2332 days ago
/faq/what-s-the-connection-between-page-load-speed-and-shopify-conversion-rates.md↗1412 days ago
/amex-fibr-platform-v3.html↗415 days ago
/llms-full.txt↗414 days ago
/faq/can-ai-generate-hypotheses-for-both-website-content-and-advertising.md↗331 day ago
/faq/are-there-any-biases-to-be-aware-of-when-using-ai-in-ux-research.md↗2220 days ago
/faq/how-does-ai-handle-complex-multi-variable-hypothesis-generation.md↗2220 days ago
/faq/how-do-shopify-brands-get-unique-images.md↗2226 days ago
/faq/how-can-an-ai-cro-agency-improve-my-business.md↗2226 days ago
/glossary/experience-analytics.md↗2226 days ago
/faq/how-often-should-i-be-running-a-b-tests-on-my-shopify-store.md↗2220 days ago
/faq/how-can-ai-help-with-consistent-visual-branding-across-a-website.md↗2220 days ago
/blog/customer-experience.md↗221 day ago
/faq/can-a-b-testing-directly-influence-brand-revenue-optimization.md↗2217 days ago
/faq/why-is-conversion-rate-optimization-important.md↗2220 days ago
/faq/how-can-an-ai-cro-agency-help-my-business.md↗221 day ago
/faq/is-it-true-that-faster-websites-get-better-search-engine-rankings.md↗2220 days ago
/tools/ai-paragraph-generator.md↗221 day ago
/faq/can-an-ai-cro-agency-help-with-both-b2b-and-b2c-businesses.md↗2220 days ago
/faq/how-can-ai-and-big-data-improve-pricing-decisions.md↗2220 days ago
/faq/does-fibr-ai-offer-solutions-for-product-image-contextualization.md↗2220 days ago
/faq/can-a-long-form-sales-page-work-for-meta-ads-or-should-it-be-short-and-sweet.md↗221 day ago
/blog/how-conversion-marketing-transforms-website-visitors-into-customers.md↗221 day ago
/faq/what-are-the-key-metrics-to-track-for-cro-in-digital-marketing.md↗221 day ago
/faq/can-ai-predict-future-website-speed-issues.md↗221 day ago
/customer-stories/fusemi-boosts-conversions-with-fibr.md↗221 day ago
/meta-ad-personalization.md↗2220 days ago
/glossary/ai-cro-audit.md↗221 day ago
/faq/how-do-subscription-models-benefit-from-revenue-optimization.md↗2220 days ago
/blog/ai-audience-segmentation.md↗221 day ago
/blog/from-bonjour-to-%E4%BD%A0%E5%A5%BD-start-website-localization-and-build-global-profits.md↗221 day ago
/google-search-ad-personalization.md↗2220 days ago
/glossary/title-tag.md↗2220 days ago
/faq/how-can-ai-help-create-engaging-lifestyle-images-for-shopify-products.md↗221 day ago
/dpa.md↗2220 days ago
/llms.txt↗221 day ago
/tools/cta-generator.md↗221 day ago
/ab-testing/shopify.md↗2220 days ago
/tools.md↗2220 days ago
/blog/why-website-localization-matters.md↗1128 days ago
/blog/vwo-vs-optimizely.md↗1127 days ago
/faq/does-ai-replace-human-intuition-in-hypothesis-generation.md↗111 day ago
/faq/can-widgets-help-with-lead-generation-on-a-shopify-store.md↗111 day ago
/faq/what-role-does-mobile-friendly-design-play-in-landing-page-cro.md↗1128 days ago
/glossary/null-hypothesis.md↗1129 days ago
/faq/can-popups-be-used-to-build-an-email-list-on-shopify.md↗1127 days ago
/glossary/clickmaps.md↗1128 days ago
/faq/how-does-conversion-optimization-work.md↗1127 days ago
05 · Content gaps

What AI wanted that we don't have

Each row is a content brief with measurable demand.

411 content gaps ↑ +10.8%
⚠ 411 gaps
Pages Query bots couldn't find
⚡ Highest urgency — real users asked, AI couldn't answer
/.env↗
First asked Sep 17 · 20 days ago
P
M
C
G
7
/public/admin.json↗
First asked Sep 13 · 24 days ago
S
P
C
5
/_astro/pages/index.astro.mjs.map↗
First asked Sep 17 · 20 days ago
S
M
G
4
/assets../.env↗
First asked Sep 17 · 20 days ago
G
P
4
/@fs/app/.env↗
First asked Sep 17 · 20 days ago
M
C
G
4
/userfiles↗
First asked Sep 17 · 20 days ago
C
M
P
C
4
/.env.bak↗
First asked Sep 17 · 20 days ago
C
G
M
3
/api%2F.env↗
First asked Sep 17 · 20 days ago
P
C
M
3
/api/v1/config↗
First asked Sep 17 · 20 days ago
C
P
3
/api/account↗
First asked Sep 17 · 20 days ago
P
S
G
3
/@fs/..%252f..%252f..%252f..%252f..%252froot/.env↗
First asked Sep 17 · 20 days ago
G
C
3
/config/.env.php↗
First asked Sep 17 · 20 days ago
M
G
3
/.env.local↗
First asked Sep 17 · 20 days ago
S
G
3
/app/.env↗
First asked Sep 17 · 20 days ago
C
P
3
/public/.env↗
First asked Sep 17 · 20 days ago
C
S
C
3
/__vite_rsc_findSourceMapURL↗
First asked Sep 17 · 20 days ago
G
S
3
/api/proc/self/environ↗
First asked Sep 17 · 20 days ago
G
S
3
/bootstrap.properties↗
First asked Sep 17 · 20 days ago
S
C
2
/terraform.tfstate↗
First asked Sep 17 · 20 days ago
C
G
2
/admin/.env↗
First asked Sep 13 · 24 days ago
G
C
2
/api/.env↗
First asked Sep 25 · 12 days ago
M
P
2
M
C
2
/values.yaml↗
First asked Sep 17 · 20 days ago
P
C
2
/manifest.webmanifest↗
First asked Sep 17 · 20 days ago
C
G
2
/config/storage.yml↗
First asked Sep 17 · 20 days ago
P
S
2
/proc/self/cgroup↗
First asked Sep 17 · 20 days ago
S
M
2
/.ssh/authorized_keys↗
First asked Sep 17 · 20 days ago
S
M
2
/gcp-service.json↗
First asked Sep 17 · 20 days ago
C
G
2
/__/firebase/init.json↗
First asked Sep 17 · 20 days ago
C
G
2
/img../.env↗
First asked Sep 17 · 20 days ago
G
M
2
/actuator/threaddump↗
First asked Sep 17 · 20 days ago
S
C
2
/@fs/var/task/.env↗
First asked Sep 17 · 20 days ago
M
G
2
/@fs/home/ec2-user/.aws/credentials↗
First asked Sep 13 · 24 days ago
M
C
2
/laravel/.env↗
First asked Sep 17 · 20 days ago
S
C
2
/@fs/.env↗
First asked Sep 17 · 20 days ago
P
G
2
/llm/.env↗
First asked Sep 17 · 20 days ago
P
C
2
/configuration.js↗
First asked Sep 13 · 24 days ago
C
C
2
/uploads../.env↗
First asked Sep 13 · 24 days ago
M
G
2
/.env.live↗
First asked Sep 17 · 20 days ago
C
2
/.env.production↗
First asked Sep 17 · 20 days ago
G
C
2
/model/.env↗
First asked Sep 17 · 20 days ago
S
C
2
/conf/.env↗
First asked Sep 18 · 19 days ago
C
2
/files../.env↗
First asked Sep 17 · 20 days ago
M
2
/frontend/.env↗
First asked Sep 17 · 20 days ago
M
C
2
/application.properties↗
First asked Sep 17 · 20 days ago
C
2
/config/gcp-credentials.json↗
First asked Sep 17 · 20 days ago
C
P
2
//.env↗
First asked Sep 17 · 20 days ago
C
P
2
/data/.env↗
First asked Sep 17 · 20 days ago
C
C
2
/api/v1/settings↗
First asked Sep 18 · 19 days ago
G
M
2
/.git-credentials↗
First asked Sep 17 · 20 days ago
C
1
Pages all AI bots couldn't find
Including training crawler 404s — broader content demand
/.env↗
7 live reads · 20 training crawls
P
G
C
M
M
27
/@fs/.env↗
2 live reads · 14 training crawls
P
Q
M
A
G
16
/__vite_rsc_findSourceMapURL↗
3 live reads · 11 training crawls
A
B
M
Q
G
14
/.env.local↗
3 live reads · 10 training crawls
Q
A
M
S
G
13
/@fs/app/.env↗
4 live reads · 8 training crawls
M
M
M
P
C
12
/@fs/src/.env↗
1 live read · 11 training crawls
C
C
M
A
Y
12
/api/proc/self/environ↗
3 live reads · 9 training crawls
G
G
G
M
D
12
/userfiles↗
4 live reads · 8 training crawls
G
C
K
M
M
12
/img../.env↗
2 live reads · 9 training crawls
G
A
G
X
M
11
/@fs/..%252f..%252f..%252f..%252f..%252froot/.env↗
3 live reads · 8 training crawls
A
C
G
G
M
11
/data/.env↗
2 live reads · 9 training crawls
C
M
C
K
C
11
/.env.production↗
2 live reads · 9 training crawls
A
M
D
G
G
11
/proc/self/cmdline↗
10 training crawls
M
B
G
A
M
10
/_astro/pages/index.astro.mjs.map↗
4 live reads · 6 training crawls
S
M
A
M
G
10
/config/storage.yml↗
2 live reads · 8 training crawls
P
S
M
B
A
10
/uploads../.env↗
2 live reads · 7 training crawls
M
M
A
G
P
9
/assets../.env↗
4 live reads · 5 training crawls
G
G
A
M
P
9
/model/.env↗
2 live reads · 7 training crawls
B
M
S
A
G
9
/secrets.env↗
9 training crawls
M
M
G
P
A
9
/proc/self/cgroup↗
2 live reads · 7 training crawls
G
A
M
S
M
9
A
X
M
M
M
9
/files../.env↗
2 live reads · 6 training crawls
M
G
A
M
8
/laravel/.env↗
2 live reads · 6 training crawls
D
S
C
M
C
8
/apps/.env↗
1 live read · 7 training crawls
A
G
D
M
C
8
/privatekey.key↗
1 live read · 7 training crawls
G
A
G
B
M
8
/.env.bak↗
3 live reads · 5 training crawls
C
G
M
M
G
8
G
A
Q
X
K
8
/.env.live↗
2 live reads · 6 training crawls
K
G
A
M
C
8
/api/v1/config↗
3 live reads · 5 training crawls
A
C
G
P
M
8
/userfiles/x↗
1 live read · 7 training crawls
X
P
M
X
A
8
/.ssh/authorized_keys↗
2 live reads · 6 training crawls
A
S
K
M
M
8
/id_ed25519↗
8 training crawls
G
M
A
G
P
8
/public/admin.json↗
5 live reads · 3 training crawls
S
M
P
Y
C
8
/.aws/config↗
1 live read · 7 training crawls
P
M
X
D
A
8
/actuator/configprops↗
1 live read · 7 training crawls
M
A
G
G
K
8
P
A
G
X
S
8
/terraform.tfstate↗
2 live reads · 6 training crawls
C
K
G
A
G
8
/localhost.key↗
1 live read · 6 training crawls
A
G
M
G
7
/api/v1/keys↗
1 live read · 6 training crawls
M
P
A
G
C
7
/dist/.env↗
1 live read · 6 training crawls
M
X
C
D
A
7
/web/.env↗
7 training crawls
G
A
M
K
C
7
/.env.development↗
1 live read · 6 training crawls
A
C
X
C
Y
7
/conf/.env↗
2 live reads · 5 training crawls
A
G
M
C
7
/@fs/home/ec2-user/.aws/credentials↗
2 live reads · 5 training crawls
M
A
M
Y
C
7
/Dockerfile↗
7 training crawls
C
A
G
M
X
7
/api/account↗
3 live reads · 4 training crawls
X
M
P
S
A
7
//.env↗
2 live reads · 5 training crawls
C
C
M
Y
X
7
/env.old↗
7 training crawls
A
G
Y
X
M
7
/llm/.env↗
2 live reads · 5 training crawls
M
P
A
M
C
7
/services/.env↗
1 live read · 6 training crawls
X
M
G
A
7
Daily missing-page requests
A leading indicator: if this climbs, our coverage is falling behind AI demand.
404s from AI 0 today · 0%
Sep 9 Sep 24 Oct 8
06 · LLM Referral Traffic

What AI is converting for fibr.ai

Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above. The dashed marker shows when ai.fibr.ai went live.

LLM Referral Traffic 105
-47.5% vs prev 30d
LLM Platforms referring traffic 3 of 6 tracked AI surfaces
Pages receiving AI referrals 53 of 399 pages read by AI
Referral visits by AI surface — over time
Daily human click-throughs from each AI platform
i AI referral traffic down 47.5% to 105 sessions over the last 30 days. ChatGPT drove 90% of it.
NO OF VISITS 7 5 4 2 0 Sep 8 Sep 14 Sep 20 Sep 26 Oct 2 Oct 8 000 ai.fibr.ai launch

Referral traffic spikes often follow high-citation days — watch for a 1–3 day lag between AI citations and human click-throughs.

Top AI referrers
Which AI surfaces are converting citations into human visits
Tool User Sessions Page Views Landing Pages Trend
G
ChatGPT
 95 169 46
G
Gemini
 7 10 6
P
Perplexity
 3 3 3

ChatGPT leads with 95 sessions (90% of AI traffic). Gemini is #2 with 7 sessions.

07 · Identity

Who's really behind that user-agent?

Cross-checks the UA-claimed bot identity against the requesting IP's owning organisation. Mismatches = possible spoofers using residential proxies or fake UAs. Live since 2026-05-04

Bot × AS-Organisation pairs
Top 30 (bot, owning-organisation) combinations. Hover the verification badge for details.
Bot (claimed) AS-Organisation (actual) Hits↓ Identity
A
Ahrefs Audit
 Ahrefs USA 49,625 ? unknown
U
unknown-bot
 Google LLC 3,649 ? unknown
B
Browser (Chrome)
 HubSpot 2,121 ? unknown
S
Semrush
 SEMrush CY LTD 1,522 ✓ verified
C
ClaudeBot
 Anthropic, PBC 1,022 ✓ verified
B
Baidu
 CHINANET Beijing province network 790 ? unknown
Y
Yandex
 Yandex enterprise network 760 ? unknown
A
Ahrefs
 OVH US LLC 731 ⚠ unverified
B
Baidu
 China United Network Communications Corporation Limited 563 ? unknown
B
Browser (Chrome)
 Google LLC 498 ? unknown
U
unknown-bot
 UAB code200 395 ? unknown
B
Browser (Chrome)
 DigitalOcean, LLC 388 ? unknown
B
Browser (Chrome)
 IPNetZone 326 ? unknown
B
Browser (Chrome)
 CROCKER COMMUNICATIONS, INCORPORATED 283 ? unknown
B
Browser (Chrome)
 Interworks Networking Services 241 ? unknown
A
Amazonbot
 Amazon Data Services Northern Virginia 224 ✓ verified
A
Amazonbot
 Amazon Technologies Inc. 210 ✓ verified
B
Browser (Chrome)
 OMEGATECH 207 ? unknown
M
Meta Training
 Meta Platforms Ireland Limited 196 ? unknown
B
Bingbot
 Microsoft Corporation 183 ✓ verified
B
Browser (Chrome)
 Comcast Cable Communications, LLC 164 ? unknown
B
Browser (Chrome)
 Amazon Data Services Northern Virginia 163 ? unknown
U
unknown-bot
 Amazon.com, Inc. 160 ? unknown
D
DataForSEO
 Dataforseo OU 156 ✓ verified
G
Googlebot
 Google LLC 145 ✓ verified
G
GPTBot
 Microsoft Limited 129 ✓ verified
A
Applebot
 Google LLC 127 ⚠ unverified
B
Browser (Chrome)
 Verizon Business 118 ? unknown
B
Baidu
 Google LLC 115 ? unknown
B
Browser (Chrome)
 AT&T Enterprises, LLC 108 ? unknown
08 · Infrastructure

Where and how requests reach us

Network-level signals: where the bot came from (country / ASN / Cloudflare datacenter), how modern its connection was, and how fast we responded. Some fields live since 2026-05-04

Top countries
Where bot traffic originates from. Bar shows relative volume.
🇺🇸USUnited States
66,237
🇨🇳CNChina
1,506
🇷🇺RURussia
766
🇹🇷TRTurkey
672
🇸🇬SGSingapore
625
🇹🇼TWTaiwan
487
🇩🇪DEGermany
427
🇧🇷BRBrazil
391
🇬🇧GBUnited Kingdom
319
🇳🇱NLNetherlands
297
🇧🇪BEBelgium
275
🇸🇦SASA
237
Top Cloudflare datacenters
By total hits. Bar shows relative volume.
IADAshburn
27,996
EWR—
19,406
ATLAtlanta
7,011
ORDChicago
1,936
SJCSan Jose
1,815
YYZToronto
1,602
AMSAmsterdam
1,477
MIAMiami
1,138
MXPMilan
1,120
CMH—
1,041
Top ASNs
Network operators by hits.
AS140577Ahrefs USA
49,625
AS396982Google LLC
5,967
AS14618HubSpot
2,121
AS16509Amazon.com, Inc.
1,683
AS209366SEMrush CY LTD
1,522
AS16509Anthropic, PBC
1,022
AS23724CHINANET Beijing province network
790
AS13238Yandex enterprise network
760
AS16276OVH US LLC
736
AS14618Amazon Data Services Northern Virginia
598
Top referrers
Where requests claim to come from. Sparse for bots.
RefererHits
https://ai-dashboard.fibr.ai99
https://fibr.ai/52
https://ai.fibr.ai37
https://fibr.ai11
https://ai-dashboard.fibr.ai/11
https://ai.fibr.ai/robots.txt10
https://ai.fibr.ai/9
https://www.google.com/8
Network profile
Protocol modernness as a share of all hits.
HTTP version
HTTP/2 83%HTTP/1.1 17%HTTP/3 0%HTTP/1.0 0%
TLS version
TLSv1.3 100%TLSv1.2 0%TLSv1 0%
HTTP status code
200 OK 93%404 Not Found 7%405 Method Not Allowed 0%
HTTP method
GET 96%HEAD 4%POST 0%DELETE 0%OPTIONS 0%
Handler latency
End-to-end Worker handler duration. Includes R2 lookup + response assembly.
p50
239ms
p95
754ms
p99
1123ms
avg
325ms
samples
75,133
About this data — Real numbers from ai.fibr.ai request logs · refreshed every 5 min · 30-90s ingestion lag from edge to dashboard · bot taxonomy is hand-maintained
Rendered UTC