Fibr — Bot Analytics (14D)

01 · Headlines

How AI is reading us right now

14d · 34,256 successful bot pulls ↑ +5.9%

AI Citations · live reads 105 A real user asked an AI a question and it fetched our page

+150.0%

AI Training Crawls 618 Long-term knowledge accumulation

+3.0%

Unique AI tools 22/107 Of known AI tools, reading us this period

no change

Pages picked up 105 Distinct pages read by AI tools

+18.0%

⚠ Content gaps 179 Pages AI asked for that we don't have

-190 vs prev

Bytes served 666.7 MB Total response bytes (200-OK only)

AI share of bot traffic 37% vs. classic search engines

-8pp

02 · Trend

Bot activity, day by day

14d · 105 citations ↑ +150.0%

Last 14 days · daily hits i

Three lines, one story: AI citations vs training vs classic search.

AI Citations 105 · +150.0%

AI Training 618 · +3.0%

Search bots 1,231 · +55.6%

03 · Who's reading

The AI tool roster

22 of 107 AI tools active → +0.0%

AI tool leaderboard

⌕

Tool	Category	Hits↓	Pages	Last seen
A Ahrefs Audit	SEO	24,062	1,506	11 hr ago
U unknown-bot? untagged bot	Other	3,787	1,758	2 min ago
Y Yandex	Search	659	354	1 hr ago
B Baidu	Search	570	446	26 min ago
C ClaudeBot	Learning	499	18	49s ago
A Ahrefs	SEO	300	2	5 min ago
M Meta Training	Learning	204	104	1 day ago
B Bingbot	Search	119	91	17 min ago
C CCBot	Learning	88	86	1 day ago
A Amazonbot	Learning	62	56	2 days ago
S SearchGPT	Query	59	12	3 hr ago
C curl	Script	49	33	1 day ago

Bot category mix

i

34,256

Total bot hits

Learning bots

2% · 618

Search bots

4% · 1,231

Query bots

0% · 105

Other / unknown

23% · 7,916

SEO bots

71% · 24,386

04 · Content performance

What AI is reading

105 pages reached by AI ↑ +18.0%

Top pages — AI Citations

Pages winning live AI answers right now

Query bots

⌕

Page	Citations↓	Tools	Last cited
/robots.txt↗	69	2	3 hr ago
/pricing.md↗	6	2	3 hr ago
/faq/can-a-long-form-sales-page-work-for-meta-ads-or-should-it-be-short-and-sweet.md↗	2	1	1 day ago
/tools/landing-page-analyzer.md↗	2	1	17 hr ago
/pilot/audience-personalization.md↗	2	2	2 days ago
/blog/fibr-launches-ai-cro-agents.md↗	2	1	4 days ago
/ab-testing/ab-testing-examples.md↗	2	2	1 day ago
/faq/is-ai-image-generation-good-for-product-photography.md↗	1	1	2 days ago
/llm-personalization.md↗	1	1	12 days ago
/tools/cro-audit.md↗	1	1	17 hr ago
/book-a-demo.md↗	1	1	12 days ago
/landing-page/website-personalization-tools.md↗	1	1	6 days ago
/faq/how-much-do-ecommerce-cro-agencies-typically-charge.md↗	1	1	10 hr ago
/pricing-old.md↗	1	1	7 days ago
/personalization-at-scale-cdp.md↗	1	1	12 days ago
/faq/how-much-do-cro-freelancers-typically-charge.md↗	1	1	1 day ago
/conversion-rate-optimization/conversion-rate-formula.md↗	1	1	3 days ago
/faq/how-much-do-cro-agencies-typically-charge.md↗	1	1	1 day ago
/pilot/ab-testing/tools-comparision.md↗	1	1	5 hr ago
/faq/how-much-do-ai-cro-tools-cost.md↗	1	1	7 hr ago
/blog/dynamic-yield-alternatives.md↗	1	1	8 days ago
/faq/what-s-the-minimum-traffic-needed-to-run-a-statistically-significant-a-b-test-on-shopify.md↗	1	1	15 hr ago
/llms-full.txt↗	1	1	6 hr ago
/glossary/ai-landing-page-analyzer.md↗	1	1	4 days ago
/pritam-roy.md↗	1	1	3 days ago
/ankur-aj.md↗	1	1	3 days ago
/llms.txt↗	1	1	1 day ago

Top pages — AI Training

Pages accumulating into future AI knowledge

Learning bots

⌕

Page	Crawls↓	Tools	Last crawled
/sitemap-ai.xml↗	301	4	7 min ago
/robots.txt↗	206	3	7 min ago
/↗	16	3	2 days ago
/faq/what-s-the-connection-between-page-load-speed-and-shopify-conversion-rates.md↗	13	1	2 days ago
/llms.txt↗	2	2	1 day ago
/llms-full.txt↗	2	1	4 days ago
/amex-fibr-platform-v3.html↗	2	1	5 days ago
/faq/can-i-use-ai-cro-tools-to-optimize-my-entire-marketing-funnel.md↗	1	1	1 day ago
/blog/google-ads-vs-facebook-ads-choosing-the-best-for-marketing-campaigns.md↗	1	1	1 day ago
/faq/can-contextualized-images-reduce-product-returns.md↗	1	1	1 day ago
/faq/can-an-ai-cro-agency-help-optimize-for-specific-marketing-channels.md↗	1	1	1 day ago
/blog/ai-cms-the-complete-2026-guide-for-modern-content-teams.md↗	1	1	1 day ago
/blog/best-marketing-automation-software.md↗	1	1	1 day ago
/blog/customer-experience.md↗	1	1	1 day ago
/blog/boost-ad-efficiency-with-fibr.md↗	1	1	1 day ago
/blog/mastering-website-localization-best-way-to-convert-global-audience.md↗	1	1	1 day ago
/blog/how-conversion-marketing-transforms-website-visitors-into-customers.md↗	1	1	1 day ago
/faq/are-there-any-drawbacks-to-using-popups.md↗	1	1	1 day ago
/faq/how-can-fibr-ai-contribute-to-overall-website-speed-optimization.md↗	1	1	1 day ago
/blog/best-web-personalization-examples.md↗	1	1	1 day ago
/blog/landing-page-optimization-how-contextualization-plays-an-important-role.md↗	1	1	1 day ago
/faq/can-ai-generate-hypotheses-for-both-website-content-and-advertising.md↗	1	1	1 day ago
/faq/does-ai-replace-human-intuition-in-hypothesis-generation.md↗	1	1	1 day ago
/faq/can-i-personalize-images-for-individual-website-visitors-in-real-time.md↗	1	1	1 day ago
/glossary/ai-cro-audit.md↗	1	1	1 day ago
/blog/how-to-create-a-winning-omnichannel-landing-page-strategy.md↗	1	1	1 day ago
/faq/can-contextualisation-improve-conversion-rates.md↗	1	1	1 day ago
/ab-testing/split-testing.md↗	1	1	1 day ago
/faq/can-widgets-help-with-lead-generation-on-a-shopify-store.md↗	1	1	1 day ago
/blog/ai-audience-segmentation.md↗	1	1	1 day ago
/faq/can-shopify-brands-use-ai-for-image-generation.md↗	1	1	1 day ago
/faq/how-can-an-ai-cro-agency-help-my-business.md↗	1	1	1 day ago
/faq/can-widgets-be-used-for-upsells-and-cross-sells-on-shopify.md↗	1	1	1 day ago
/faq/are-there-any-free-tools-for-creating-website-widgets-and-popups.md↗	1	1	1 day ago
/faq/how-does-click-rate-optimization-affect-conversion-rates.md↗	1	1	1 day ago
/faq/can-ai-generate-realistic-product-images-from-just-a-text-description.md↗	1	1	1 day ago
/faq/does-fibr-ai-offer-specialized-image-generation-for-shopify-brands.md↗	1	1	1 day ago
/blog/vwo-alternatives.md↗	1	1	1 day ago
/faq/can-popups-be-used-for-abandoned-cart-recovery-on-shopify.md↗	1	1	1 day ago
/conversion-rate-optimization/mobile.md↗	1	1	1 day ago
/blog/from-bonjour-to-%E4%BD%A0%E5%A5%BD-start-website-localization-and-build-global-profits.md↗	1	1	1 day ago
/conversion-rate-optimization/10-best-conversion-rate-optimization-companies.md↗	1	1	1 day ago
/blog/message-match-identify-and-overcome-common-advertisement-pitfalls.md↗	1	1	1 day ago
/blog/website-personalization-strategies.md↗	1	1	1 day ago
/faq/can-widgets-be-used-to-enhance-website-navigation.md↗	1	1	1 day ago
/blog/web-personalization-strategies-for-b2c-saas-success.md↗	1	1	1 day ago
/faq/how-accurate-is-ai-in-cro-analysis.md↗	1	1	1 day ago
/faq/is-it-possible-to-generate-custom-icons-and-illustrations-using-ai-for-websites.md↗	1	1	1 day ago
/glossary/cro-services-pricing.md↗	1	1	1 day ago
/faq/what-services-do-the-best-conversion-rate-optimization-firms-provide.md↗	1	1	1 day ago

05 · Content gaps

What AI wanted that we don't have

Each row is a content brief with measurable demand.

179 content gaps ↓ -51.5%

⚠ 179 gaps

Pages Query bots couldn't find

⚡ Highest urgency — real users asked, AI couldn't answer

/assets../.env↗

First asked Sep 25 · 12 days ago

P

2

/.env.bak↗

First asked Sep 25 · 12 days ago

C

G

2

/public/.env↗

First asked Sep 25 · 12 days ago

S

C

2

/api/.env↗

First asked Sep 25 · 12 days ago

M

P

2

//.env↗

First asked Sep 25 · 12 days ago

P

1

/_astro/pages/index.astro.mjs.map↗

First asked Sep 25 · 12 days ago

G

1

/@fs/app/.env↗

First asked Sep 25 · 12 days ago

G

1

/static../.env↗

First asked Sep 25 · 12 days ago

S

1

/.env.staging↗

First asked Sep 25 · 12 days ago

S

1

/dist/.env↗

First asked Sep 25 · 12 days ago

S

1

/secrets.json↗

First asked Sep 25 · 12 days ago

G

1

/api/v1/settings↗

First asked Sep 25 · 12 days ago

M

1

/css../.env↗

First asked Sep 25 · 12 days ago

S

1

/.env.stage↗

First asked Sep 25 · 12 days ago

S

1

/app/.env↗

First asked Sep 25 · 12 days ago

C

1

/.ssh/config↗

First asked Sep 25 · 12 days ago

C

1

/userfiles/x↗

First asked Sep 25 · 12 days ago

P

1

/.env.local↗

First asked Sep 25 · 12 days ago

S

1

/userfiles↗

First asked Sep 25 · 12 days ago

M

1

/.env.backup↗

First asked Sep 25 · 12 days ago

S

1

/pi.php↗

First asked Sep 25 · 12 days ago

G

1

/panel/.env↗

First asked Sep 25 · 12 days ago

G

1

/build../.env↗

First asked Oct 5 · 3 days ago

C

1

/files../.env↗

First asked Sep 25 · 12 days ago

M

1

/uploads../.env↗

First asked Sep 25 · 12 days ago

M

1

/config/.env↗

First asked Sep 25 · 12 days ago

P

1

/api/account↗

First asked Sep 25 · 12 days ago

P

1

/.ssh/id_rsa↗

First asked Sep 25 · 12 days ago

C

1

/terraform.tfstate↗

First asked Sep 25 · 12 days ago

G

1

/public/admin.json↗

First asked Oct 5 · 3 days ago

C

1

/__/firebase/init.json↗

First asked Sep 25 · 12 days ago

C

1

/api/console/api_server↗

First asked Sep 25 · 12 days ago

C

1

/api/openapi.json↗

First asked Sep 25 · 12 days ago

S

1

/firebase-adminsdk.json↗

First asked Oct 5 · 3 days ago

P

1

/__vite_rsc_findSourceMapURL↗

First asked Sep 25 · 12 days ago

G

1

/config/gcp-credentials.json↗

First asked Oct 5 · 3 days ago

C

1

/api/v1/config↗

First asked Oct 5 · 3 days ago

P

1

Pages all AI bots couldn't find

Including training crawler 404s — broader content demand

/.env↗

6 training crawls

G
D
X
C
K

6

/files../.env↗

1 live read · 5 training crawls

M

G

A

M

6

/.env.bak↗

2 live reads · 4 training crawls

C

G

A

G

M

6

/userfiles↗

1 live read · 5 training crawls

M

G

B

M

C

6

/Dockerfile↗

6 training crawls

X
A
G
C
M

6

/graphql/console↗

5 training crawls

M
A
X
Y

5

/@fs/home/ubuntu/.aws/credentials↗

5 training crawls

A
K
M
G

5

/terraform.tfstate↗

1 live read · 4 training crawls

G

D

M

5

/docker-compose.yml↗

5 training crawls

C
A
M
G

5

/server.key↗

5 training crawls

A
K
M

5

/css../.env↗

1 live read · 4 training crawls

A

M

S

5

/dist/.env↗

1 live read · 4 training crawls

S

M

C

A

5

/server-status↗

5 training crawls

M
A
P

5

/.env.staging↗

1 live read · 3 training crawls

A

S

M

4

/.env.local↗

1 live read · 3 training crawls

S

M

4

/uploads../.env↗

1 live read · 3 training crawls

M

C

4

/actuator/loggers↗

4 training crawls

G
M
A

4

/@fs/.env↗

4 training crawls

D
M
G

4

/dashboard%2F.env↗

4 training crawls

A
M
G

4

/.env.stage↗

1 live read · 3 training crawls

A

M

S

4

/.gitconfig↗

4 training crawls

G
M
A

4

/pi.php↗

1 live read · 3 training crawls

G

A

M

4

/config/.env↗

1 live read · 3 training crawls

M

A

P

4

/panel/.env↗

1 live read · 3 training crawls

A

M

G

4

/@fs/src/.env↗

4 training crawls

Y
G
M

4

/__vite_rsc_findSourceMapURL↗

1 live read · 3 training crawls

M

X

G

4

/api/v1/config/↗

4 training crawls

A

M

4

/chatbot/.env↗

4 training crawls

G
A
M

4

/api/console/api_server↗

1 live read · 3 training crawls

M

A

C

4

/assets../.env↗

2 live reads · 2 training crawls

M

P

4

/.env.backup↗

1 live read · 3 training crawls

M

S

A

4

/api/auth/session↗

4 training crawls

M

A

4

/@fs/app/.env↗

1 live read · 3 training crawls

P

G

M

4

/static../.env↗

1 live read · 3 training crawls

A

M

S

4

/api/.env/public/.env↗

4 training crawls

A
M
G

4

/userfiles/x↗

1 live read · 3 training crawls

A

P

M

4

/proc/self/cmdline↗

4 training crawls

M
M
G

4

/.ssh/id_rsa↗

1 live read · 3 training crawls

C

M

A

4

/public/.env↗

2 live reads · 2 training crawls

S

C

M

4

/instance/config.py↗

3 training crawls

M

G

3

/llm/.env↗

3 training crawls

M

3

/api%2F.env↗

3 training crawls

C

M

3

/api/v1/settings↗

1 live read · 2 training crawls

M

G

C

3

/static/app/.env↗

3 training crawls

M

G

3

/@fs/home/ec2-user/.aws/credentials↗

3 training crawls

A

M

3

/proc/self/cgroup↗

3 training crawls

A

M

3

/_profiler/latest↗

3 training crawls

M

K

3

/v1/.env↗

3 training crawls

A

M

3

/.ssh/authorized_keys↗

3 training crawls

K

M

3

/.env.production↗

3 training crawls

X

M

3

Daily missing-page requests

A leading indicator: if this climbs, our coverage is falling behind AI demand.

404s from AI 5 today · new

06 · LLM Referral Traffic

What AI is converting for fibr.ai

Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above. The dashed marker shows when ai.fibr.ai went live.

LLM Referral Traffic 53

+6.0% vs prev 14d

LLM Platforms referring traffic 3 of 6 tracked AI surfaces

Pages receiving AI referrals 28 of 105 pages read by AI

Referral visits by AI surface — over time

Daily human click-throughs from each AI platform

i AI referral traffic up 6.0% to 53 sessions over the last 14 days. ChatGPT drove 81% of it.

Referral traffic spikes often follow high-citation days — watch for a 1–3 day lag between AI citations and human click-throughs.

Top AI referrers

Which AI surfaces are converting citations into human visits

Tool	User Sessions	Page Views	Landing Pages
G ChatGPT	43	62	21
G Gemini	7	10	6
P Perplexity	3	3	3

ChatGPT leads with 43 sessions (81% of AI traffic). Gemini is #2 with 7 sessions.

07 · Identity

Who's really behind that user-agent?

Cross-checks the UA-claimed bot identity against the requesting IP's owning organisation. Mismatches = possible spoofers using residential proxies or fake UAs. Live since 2026-05-04

Bot × AS-Organisation pairs

Top 30 (bot, owning-organisation) combinations. Hover the verification badge for details.

Bot (claimed)	AS-Organisation (actual)	Hits↓	Identity
A Ahrefs Audit	Ahrefs USA	24,062	? unknown
U unknown-bot	Google LLC	3,233	? unknown
Y Yandex	Yandex enterprise network	654	? unknown
C ClaudeBot	Anthropic, PBC	487	✓ verified
B Browser (Chrome)	IPNetZone	326	? unknown
B Baidu	CHINANET Beijing province network	308	? unknown
U unknown-bot	UAB code200	290	? unknown
B Browser (Chrome)	CROCKER COMMUNICATIONS, INCORPORATED	283	? unknown
B Browser (Chrome)	DigitalOcean, LLC	251	? unknown
A Ahrefs	OVH US LLC	247	⚠ unverified
B Baidu	China United Network Communications Corporation Limited	243	? unknown
B Browser (Chrome)	Interworks Networking Services	241	? unknown
M Meta Training	Meta Platforms Ireland Limited	195	? unknown
B Browser (Chrome)	Google LLC	194	? unknown
B Browser (Chrome)	Comcast Cable Communications, LLC	161	? unknown
U unknown-bot	Amazon.com, Inc.	160	? unknown
B Bingbot	Microsoft Corporation	119	✓ verified
B Browser (Chrome)	Verizon Business	109	? unknown
B Browser (Chrome)	AT&T Enterprises, LLC	94	? unknown
B Browser (Chrome)	Charter Communications Inc	80	? unknown
C CCBot	Amazon Data Services Northern Virginia	79	✓ verified
U unknown-bot	Amazon Technologies Inc.	64	? unknown
B Browser (Safari)	6 COLLYER QUAY	64	? unknown
B Browser (Chrome)	T-Mobile USA, Inc.	52	? unknown
C Claude User	Google LLC	49	? unknown
B Browser (Chrome)	TC DATACENTER LIMITED MANAGED IP SPACE	48	? unknown
A Ahrefs	Ahrefs Pte Ltd Dmytro	41	✓ verified
G Googlebot	Google LLC	40	✓ verified
B Browser (Chrome)	Web2Objects LLC	40	? unknown
B Browser (Safari)	Snapchat, Inc	37	? unknown

08 · Infrastructure

Where and how requests reach us

Network-level signals: where the bot came from (country / ASN / Cloudflare datacenter), how modern its connection was, and how fast we responded. Some fields live since 2026-05-04

Top countries

Where bot traffic originates from. Bar shows relative volume.

🇺🇸USUnited States

32,434

🇷🇺RURussia

657

🇨🇳CNChina

650

🇸🇬SGSingapore

397

🇬🇧GBUnited Kingdom

190

🇧🇷BRBrazil

172

🇩🇪DEGermany

172

🇱🇻LVLV

119

🇫🇷FRFrance

109

🇵🇱PLPoland

109

🇨🇦CACanada

90

🇨🇴COColombia

73

Top Cloudflare datacenters

By total hits. Bar shows relative volume.

IADAshburn

12,401

EWR—

9,338

ATLAtlanta

3,575

ORDChicago

1,719

YYZToronto

1,261

SJCSan Jose

854

BOS—

730

AMSAmsterdam

596

CMH—

503

LHRLondon

476

Top ASNs

Network operators by hits.

AS140577Ahrefs USA

24,062

AS396982Google LLC

3,764

AS16509Amazon.com, Inc.

884

AS13238Yandex enterprise network

654

AS16509Anthropic, PBC

488

AS2914IPNetZone

326

AS23724CHINANET Beijing province network

308

AS27411UAB code200

291

AS7849CROCKER COMMUNICATIONS, INCORPORATED

283

AS14061DigitalOcean, LLC

266

Top referrers

Where requests claim to come from. Sparse for bots.

Referer	Hits
https://ai-dashboard.fibr.ai	22
https://fibr.ai/	15
https://ai-dashboard.fibr.ai/	9
http://fibr.ai/	6
https://ai.fibr.ai/robots.txt	5
https://ai.fibr.ai	4
https://ai.fibr.ai/faq/how-can-i-measure-the-success-of-my-conversion-optimization-efforts.md	3
https://ai.fibr.ai/faq	3

Network profile

Protocol modernness as a share of all hits.

HTTP version

HTTP/2 89%HTTP/1.1 11%HTTP/3 0%

TLS version

TLSv1.3 100%TLSv1.2 0%

HTTP status code

200 OK 94%404 Not Found 5%405 Method Not Allowed 0%

HTTP method

GET 96%HEAD 4%POST 0%DELETE 0%OPTIONS 0%

Handler latency

End-to-end Worker handler duration. Includes R2 lookup + response assembly.

p50

237ms

p95

686ms

p99

1040ms

avg

303ms

samples

36,205