TheyfetchStarter
Start tracking£69/ month
- 1,500 answers a month
- ChatGPT, Claude, Perplexity, Google
- 90-day history
- 1 workspace
- Weekly digest
Can AI assistants read your website?
Theyfetch checks whether ChatGPT, Claude and Perplexity can read your pages, and shows you when they do.
Get started
From £69/month. Cancel anytime.
ExampleAI accessSample data
Assistants that can read example.com
3 of 4
Checked today. robots.txt found, llms.txt missing.
| Assistant | robots.txt | Live fetch | What to do |
|---|---|---|---|
| ChatGPTChatGPT-User | Allow | Ok | Allowed in robots.txt. |
| ClaudeClaude-User | Allow | Challenge | A challenge page is in front of this bot. Check Cloudflare AI bot settings. |
| PerplexityPerplexity-User | Allow | Ok | Allowed in robots.txt. |
| GoogleGooglebot | Allow | Ok | Allowed in robots.txt. |
Your website works for people. It might be blocking AI assistants.
Security settings and hosting defaults often stop assistants while people browse normally. Theyfetch tells you which assistant is blocked, why, and what to change. Fix it on your side, then check again.
ExampleAI accessSample data
ClaudeClaude-UserChallenge
- As a browser
- 200 OK · 41 KB of HTML
- As Claude
- 403 · challenge page, 2 KB
- robots.txt
- Allow
What to do
Cloudflare AI Crawl Control is challenging Claude-User. Allow the “Agent” category for example.com, then check again.
Last checked 2 hours ago
See which pages AI assistants actually read.
Once tracking is installed, every verified request from an assistant is recorded against the page it read. Requests for live answers are counted separately from search and training bots.
ExamplePagesSample data
Verified reads, last 30 days
329
Only requests from confirmed assistant addresses are counted.
| Page | Reads | Assistant |
|---|---|---|
| /guides/lightweight-tents | 148 | ChatGPT |
| /products/ridge-2 | 93 | Perplexity |
| /guides/packing-list | 61 | ChatGPT |
| /blog/tent-storage | 27 | Claude |
See who gets named.
Track the questions your customers ask. Theyfetch runs them on ChatGPT, Claude, Perplexity and Google every day, then shows which businesses were named and which pages the answers linked to.
ExampleQuestionsSample data
Tracked question
“Which lightweight tent is suitable for a weekend hike?”
ChatGPTClaudePerplexityGoogle AI Overviews
Who gets named
- Example OutdoorsYours75% · 9 of 12
- Alpine Supply58% · 7 of 12
- Trailhead33% · 4 of 12
Pages the answers linked to
- Best lightweight tents for weekend hikesexample.comYours
- Backpacking tent reviewsoutdoorgearlab.com
- r/Ultralight: two-person tent under 1.5 kg?reddit.com
Works with WordPress, Cloudflare, Next.js and more.
Access checks and tracked questions need nothing installed. Seeing which pages assistants read takes a plugin or a few lines of code.
- WordPress
- Cloudflare Worker
- Next.js
- Nuxt.js
- Astro
- Laravel
- TanStack Start
- Any HTTP server
One plan for access checks, page reads and tracked answers.
Every plan includes everything above. Plans differ by how many answers you can test each month and how many websites you track.
Growth
£199/ month
- 6,000 answers a month
- 3 workspaces
- 1-year history
- Weekly digest
Scale
£499/ month
- 15,000 answers a month
- 10 workspaces
- 1-year history
- Weekly digest
One answer is one question tested on one AI service, once. Testing the same question on ChatGPT, Claude and Perplexity uses three answers. Website access checks and AI visit tracking are included in every plan. A paid subscription is required. Cancel anytime in your account settings.
Questions
Do I need a developer to set this up?
Access checks and tracked questions work as soon as you add your domain. Seeing which pages assistants read needs a plugin or a small integration on your website, and you may want a developer for that part. The installation guide covers each platform.
Does an AI visit mean my website appeared in an answer?
No. A visit means an AI assistant requested a page. It does not prove the page was used, linked or recommended. Tracked questions are separate: we test questions you choose and show the businesses named and the pages linked in each answer.
Are these the answers my customers see?
They are answers to questions we test, not a recording of your customers’ conversations. We use provider and search-data APIs rather than automated browsing of consumer apps, so results can differ from what someone sees in ChatGPT or Claude.
What does a subscription include?
Every plan includes access checks, page tracking and a monthly allowance of tested answers. Choose a plan before setting up your workspace. There is no free plan or trial. Cancel anytime in your account settings.
Do they fetch you?
Check access, see which pages assistants read, and track who gets named.