F
Fibr · ai.fibr.ai Bot Analytics
Last bot visit · 23s ago Updated Next UTC
3D 7D 14D 30D
01 · Headlines

How AI is reading us right now

3d · 5,120 successful bot pulls ↓ -27.1%
AI Citations · live reads 10 A real user asked an AI a question and it fetched our page
+42.9%
AI Training Crawls 124 Long-term knowledge accumulation
-8.1%
Unique AI tools 6/107 Of known AI tools, reading us this period
no change
Pages picked up 12 Distinct pages read by AI tools
-40.0%
⚠ Content gaps 11 Pages AI asked for that we don't have
-11 vs prev
Bytes served 112.5 MB Total response bytes (200-OK only)
AI share of bot traffic 43% vs. classic search engines
-14pp
02 · Trend

Bot activity, day by day

3d · 10 citations ↑ +42.9%
Last 3 days · daily hits i
Three lines, one story: AI citations vs training vs classic search.
AI Citations 10 · +42.9%
AI Training 124 · -8.1%
Search bots 175 · +62.0%
80 60 40 20 0 Aug 19 Aug 20 Aug 21
03 · Who's reading

The AI tool roster

6 of 107 AI tools active → +0.0%
AI tool leaderboard
⌕
Tool Category Hits↓ Pages Last seen Trend
A
Ahrefs Audit
 SEO 4,542 1,506 1 hr ago
Y
Yandex
 Search 144 78 1 hr ago
C
ClaudeBot
 Learning 114 8 23s ago
A
Ahrefs
 SEO 57 2 55 min ago
B
Bingbot
 Search 21 11 7 hr ago
A
Amazonbot
 Learning 17 17 3 hr ago
U
unknown-bot? untagged bot
 Other 13 7 1 hr ago
S
SearchGPT
 Query 8 1 18 hr ago
G
Googlebot
 Search 6 5 1 day ago
F
Facebook
 Social 5 2 17 min ago
D
DataForSEO
 SEO 5 5 14 min ago
C
curl
 Script 4 1 1 day ago
Bot category mix
i
5,120
Total bot hits
Learning bots
2% · 124
Search bots
3% · 175
Query bots
0% · 10
Other / unknown
4% · 205
SEO bots
90% · 4,606
04 · Content performance

What AI is reading

12 pages reached by AI ↓ -40.0%
Top pages — AI Citations
Pages winning live AI answers right now
Query bots
⌕
Page Citations↓ Tools Last cited
/robots.txt↗9218 hr ago
/llms.txt↗111 day ago
Top pages — AI Training
Pages accumulating into future AI knowledge
Learning bots
⌕
Page Crawls↓ Tools Last crawled
/sitemap-ai.xml↗6934 min ago
/robots.txt↗4214 min ago
/↗2210 hr ago
/faq.md↗222 days ago
/llms.txt↗2110 hr ago
/pilot.md↗111 day ago
/faq/what-are-effective-conversion-rate-optimization-strategies.md↗115 hr ago
/landing-page/website-personalization-tools.md↗112 days ago
/faq/how-does-inventory-management-affect-a-brand-s-revenue-potential.md↗113 hr ago
/faq/how-does-dynamic-image-personalization-work.md↗114 hr ago
/glossary/ai-personalization.md↗112 days ago
/amex-fibr-platform-v3.html↗111 day ago
05 · Content gaps

What AI wanted that we don't have

Each row is a content brief with measurable demand.

11 content gaps ↓ -50.0%
⚠ 11 gaps
Pages Query bots couldn't find
⚡ Highest urgency — real users asked, AI couldn't answer
✓
No urgent gaps
In the last 3 days, no real-user AI fetches (ChatGPT, Claude, Perplexity, SearchGPT) hit a missing page.
Pages all AI bots couldn't find
Including training crawler 404s — broader content demand
/tools↗
1 training crawl
A
1
/max↗
1 training crawl
A
1
/graphql↗
1 training crawl
C
1
/debug/vars↗
1 training crawl
C
1
/api/graphql↗
1 training crawl
C
1
/terms-and-conditions↗
1 training crawl
A
1
/meta-ad-personalization↗
1 training crawl
A
1
/pilot/bulk-creation.md):↗
1 training crawl
C
1
/pilot/ad-personalization↗
1 training crawl
A
1
A
1
A
1
A
1
A
1
Daily missing-page requests
A leading indicator: if this climbs, our coverage is falling behind AI demand.
404s from AI 4 today · new
Aug 19 Aug 20 Aug 21
06 · LLM Referral Traffic

What AI is converting for fibr.ai

Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above. The dashed marker shows when ai.fibr.ai went live.

LLM Referral Traffic 24
-31.4% vs prev 3d
LLM Platforms referring traffic 2 of 6 tracked AI surfaces
Pages receiving AI referrals 30 of 12 pages read by AI
Referral visits by AI surface — over time
Daily human click-throughs from each AI platform
i AI referral traffic down 31.4% to 24 sessions over the last 3 days. ChatGPT drove 88% of it.
NO OF VISITS 8 6 4 2 0 Aug 18 Aug 19 Aug 20 Aug 21 31 ai.fibr.ai launch

Referral traffic spikes often follow high-citation days — watch for a 1–3 day lag between AI citations and human click-throughs.

Top AI referrers
Which AI surfaces are converting citations into human visits
Tool User Sessions Page Views Landing Pages Trend
G
ChatGPT
 21 73 30
C
Claude
 3 2 1

ChatGPT leads with 21 sessions (88% of AI traffic). Claude is #2 with 3 sessions.

07 · Identity

Who's really behind that user-agent?

Cross-checks the UA-claimed bot identity against the requesting IP's owning organisation. Mismatches = possible spoofers using residential proxies or fake UAs. Live since 2026-05-04

Bot × AS-Organisation pairs
Top 30 (bot, owning-organisation) combinations. Hover the verification badge for details.
Bot (claimed) AS-Organisation (actual) Hits↓ Identity
A
Ahrefs Audit
 Ahrefs USA 4,542 ? unknown
Y
Yandex
 Yandex enterprise network 144 ? unknown
C
ClaudeBot
 Anthropic, PBC 109 ✓ verified
A
Ahrefs
 Dmytro, Ahrefs Pte Ltd 52 ✓ verified
B
Browser (Chrome)
 DigitalOcean, LLC 37 ? unknown
B
Bingbot
 Microsoft Corporation 21 ✓ verified
B
Browser (Chrome)
 Oracle Corporation 20 ? unknown
B
Browser (Chrome)
 HostRoyale Technologies Pvt Ltd 13 ? unknown
B
Browser (Chrome)
 Google LLC 12 ? unknown
U
unknown-bot
 Google LLC 11 ? unknown
A
Amazonbot
 Amazon Technologies Inc. 9 ✓ verified
B
Browser (Chrome)
 HOSTGNOME LTD 8 ? unknown
A
Amazonbot
 Amazon Data Services Northern Virginia 7 ✓ verified
B
Browser (Chrome)
 Nivid Telecom India Private Limited 6 ? unknown
B
Browser (Chrome)
 truview LLC 6 ? unknown
D
DataForSEO
 Dataforseo OU 5 ✓ verified
F
Facebook
 Meta Platforms Ireland Limited 5 ? unknown
A
Ahrefs
 Ahrefs Pte Ltd Dmytro 5 ✓ verified
C
curl
 Ya.com Internet Factory 4 ? unknown
S
SearchGPT
 Microsoft Limited 4 ✓ verified
B
Browser (Chrome)
 Meta Platforms Ireland Limited 4 ? unknown
G
Googlebot
 Google LLC 3 ✓ verified
B
Browser (Chrome)
 Amazon.com, Inc. 3 ? unknown
S
SearchGPT
 Microsoft Corporation 3 ✓ verified
M
Meta Training
 Meta Platforms Ireland Limited 3 ? unknown
B
Browser (Chrome)
 OCULUS NETWORKS INC 3 ? unknown
B
Browser (Chrome)
 netcup GmbH 3 ? unknown
P
PetalBot
 Huawei-Cloud-SG 3 ✓ verified
B
Browser (Chrome)
 Hetzner Online GmbH 3 ? unknown
S
Spoofed PPC-Mac UA
 EGIHosting 3 ? unknown
08 · Infrastructure

Where and how requests reach us

Network-level signals: where the bot came from (country / ASN / Cloudflare datacenter), how modern its connection was, and how fast we responded. Some fields live since 2026-05-04

Top countries
Where bot traffic originates from. Bar shows relative volume.
🇺🇸USUnited States
4,812
🇷🇺RURussia
144
🇨🇦CACanada
52
🇩🇪DEGermany
50
🇬🇧GBUnited Kingdom
27
🇸🇪SESweden
21
🇪🇸ESSpain
12
🇮🇳INIndia
11
🇳🇱NLNetherlands
8
🇨🇳CNChina
3
🇸🇬SGSingapore
3
🇧🇷BRBrazil
2
Top Cloudflare datacenters
By total hits. Bar shows relative volume.
IADAshburn
4,596
CMH—
109
FRAFrankfurt
96
YYZToronto
54
LHRLondon
52
AMSAmsterdam
38
MXPMilan
36
LAXLos Angeles
26
ORDChicago
23
ARNStockholm
21
Top ASNs
Network operators by hits.
AS140577Ahrefs USA
4,542
AS13238Yandex enterprise network
144
AS16509Anthropic, PBC
109
AS16276Dmytro, Ahrefs Pte Ltd
52
AS14061DigitalOcean, LLC
40
AS396982Google LLC
25
AS8075Microsoft Corporation
24
AS60068Datacamp Limited
21
AS31898Oracle Corporation
20
AS207990HostRoyale Technologies Pvt Ltd
13
Top referrers
Where requests claim to come from. Sparse for bots.
RefererHits
http://fibr.ai8
https://ai.fibr.ai/2
https://ai.fibr.ai/robots.txt2
https://www.google.com/1
https://ai.fibr.ai/ab-testing.md1
https://ai.fibr.ai/sitemap-ai.xml1
https://ai.fibr.ai/llms.txt1
Network profile
Protocol modernness as a share of all hits.
HTTP version
HTTP/2 95%HTTP/1.1 5%HTTP/3 0%
TLS version
TLSv1.3 100%TLSv1 0%
HTTP status code
200 OK 99%404 Not Found 1%
HTTP method
GET 100%HEAD 0%
Handler latency
End-to-end Worker handler duration. Includes R2 lookup + response assembly.
p50
217ms
p95
578ms
p99
792ms
avg
256ms
samples
5,154
About this data — Real numbers from ai.fibr.ai request logs · refreshed every 5 min · 30-90s ingestion lag from edge to dashboard · bot taxonomy is hand-maintained
Rendered UTC