F
Fibr · ai.fibr.ai Bot Analytics
Last bot visit · 25 min ago Updated · next UTC

How AI is reading us right now

AI Training Crawls 385 Long-term knowledge accumulation
new
Unique AI tools 6/16 Of known AI tools, reading us this period
+6 new
Pages picked up 115 Distinct pages read by AI tools
new
⚠ Content gaps 36 Pages AI asked for that we don't have
+36 vs prev
Bytes served 16.6 MB Total response bytes (200-OK only)
AI share of bot traffic 77% vs. classic search engines
+77pp

Bot activity, day by day

Last 14 days · daily hits i
Three lines, one story: AI citations vs training vs classic search.
AI Citations 30 · new
AI Training 385 · new
Search bots 126 · new
200 150 100 50 0 Apr 21 Apr 23 Apr 26 Apr 29 May 2 May 4

The AI tool roster

AI tool leaderboard
Tool Category Hits Pages Last seen Trend
B
Browser (Chrome)
Other 411 309 1 hr ago
C
ClaudeBot
Learning 335 147 42 min ago
A
axios
Script 208 1 25 min ago
A
AhrefsBot
SEO 203 201 9 days ago
M
meta-externalagent
Learning 182 180 10 days ago
M
minimal-ua⚠ manipulated UA
Other 130 1 18 hr ago
B
Bingbot
Search 118 48 6 hr ago
P
Python-aiohttp
Script 67 1 18 hr ago
G
GPTBot
Learning 43 30 1 hr ago
B
Browser (Firefox)
Other 33 29 18 hr ago
B
Browser (Safari)
Other 29 15 1 hr ago
S
SearchGPT
Query 28 3 4 hr ago
Bot category mix
i
1,845
Total bot hits
Learning bots
31% · 385
Search bots
7% · 126
Query bots
2% · 30
Other / unknown
49% · 909
SEO bots
11% · 205

What AI is reading

Top pages — AI Citations
Pages winning live AI answers right now
Query bots
Page Citations Tools Last cited
/robots.txt2614 hr ago
/llms.txt2210 days ago
/sitemap-ai.xml1110 days ago
/pilot/ad-personalization.md1110 days ago
Top pages — AI Training
Pages accumulating into future AI knowledge
Learning bots
Page Crawls Tools Last crawled
/sitemap-ai.xml97342 min ago
/robots.txt93242 min ago
/llms.txt1342 days ago
/pilot/ad-personalization.md639 days ago
/pilot.md539 days ago
/311 hr ago
/faq.md321 hr ago

What AI wanted that we don't have

Each row is a content brief with measurable demand.

⚠ 36 gaps
Pages Query bots couldn't find
⚡ Highest urgency — real users asked, AI couldn't answer
No urgent gaps
In the last 14 days, no real-user AI fetches (ChatGPT, Claude, Perplexity, SearchGPT) hit a missing page.
Pages all AI bots couldn't find
Including training crawler 404s — broader content demand
Daily missing-page requests
A leading indicator: if this climbs, our coverage is falling behind AI demand.
404s from AI 22 today · new
Apr 21 Apr 28 May 4

Who's really behind that user-agent?

Cross-checks the UA-claimed bot identity against the requesting IP's owning organisation. Mismatches = possible spoofers using residential proxies or fake UAs. Live since 2026-05-04

Bot × AS-Organisation pairs
Top 30 (bot, owning-organisation) combinations. Hover the verification badge for details.
Bot (claimed) AS-Organisation (actual) Hits Identity
G
GPTBot
Microsoft Limited 24 ✓ verified
A
axios
Amazon.com, Inc. 12 ? unknown
C
ClaudeBot
Anthropic, PBC 2 ✓ verified

Where and how requests reach us

Network-level signals: where the bot came from (country / ASN / Cloudflare datacenter), how modern its connection was, and how fast we responded. Some fields live since 2026-05-04

Top countries
Where bot traffic originates from. Bar shows relative volume.
🇺🇸USUnited States
1,091
🇨🇦CACanada
208
🇬🇧GBUnited Kingdom
206
🇮🇪IEIreland
153
🇮🇳INIndia
43
🇳🇱NLNetherlands
16
🇧🇷BRBrazil
13
🇩🇪DEGermany
11
🇪🇸ESSpain
11
🇫🇷FRFrance
10
🇲🇽MXMexico
10
🇭🇷HRHR
5
Top Cloudflare datacenters
By total hits. Bar shows relative volume.
ATLAtlanta
24
PDX
14
SINSingapore
2
CMH
2
IADAshburn
1
Top ASNs
Network operators by hits.
AS8075Microsoft Limited
24
AS16509Amazon.com, Inc.
14
AS142477Nivid Telecom India Private Limited
2
AS16509Anthropic, PBC
2
AS14618Amazon Technologies Inc.
1
Top referrers
Where requests claim to come from. Sparse for bots.
RefererHits
https://ai.fibr.ai/faq.md19
https://ai-dashboard.fibr.ai5
https://fibr.ai4
https://getfibr.co2
https://fibr.ai/2
http://ai.fibr.ai/2
https://ai.fibr.ai/pilot/ad-personalization.md1
https://ai-dashboard.fibr.ai/1
Network profile
Protocol modernness as a share of all hits.
HTTP version
HTTP/2 65%HTTP/1.1 35%
TLS version
TLSv1.3 100%
HTTP status code
200 OK 79%404 Not Found 21%405 Method Not Allowed 0%
HTTP method
GET 100%
Handler latency
End-to-end Worker handler duration. Includes R2 lookup + response assembly.
p50
190ms
p95
262ms
p99
882ms
avg
208ms
samples
43
About this data — Real numbers from ai.fibr.ai request logs · refreshed every 5 min · 30-90s ingestion lag from edge to dashboard · bot taxonomy is hand-maintained
Rendered UTC