Articles
Guides and analysis on aiseocheck.hu
Twelve in-depth articles by Zoltán Varga. Each one answers a single question, starting with the short answer.
AI Bots in robots.txt: GPTBot, ClaudeBot, PerplexityBot and More
A practical guide to naming AI user-agents in robots.txt to ensure your content reaches modern AI search engines.
Training Crawlers vs Search Fetchers: Why the Difference Matters
Understanding the distinct roles of AI bots determines whether your content trains models, powers answers, or remains invisible.
Testing Real Bot Access: Why robots.txt Text Is Not Enough
Reading rules is not the same as verifying access; manual testing reveals silent blocks that automated tools miss.
Silent 403s: How Firewalls and CDNs Block AI Crawlers
Standard SEO tools miss the HTTP status codes that determine whether AI models can actually read your content.
When HTTP Headers Contradict robots.txt: An Audit Pattern
A real audit revealed that a CDN-injected header blocked AI training despite an open robots.txt file, creating a silent visibility failure.
JavaScript Rendering and AI Crawlers: SSR, SSG or Client-Only?
Client-side rendering often hides your content from AI systems; server-side solutions make your text immediately visible.
Bing Indexing and IndexNow: The AI Answer Engine Layer
If Bing cannot index your site, AI assistants cannot cite it in their responses.
Sitemaps, lastmod and hreflang: Freshness Signals for AI Crawlers
A practical checklist for sitemap hygiene that ensures AI crawlers can reach, fetch, and parse your content effectively.
Technical AI-SEO Check: Access, Fetch, Parse, Index
A practical checklist for the four technical stages that determine whether AI systems can read your website.
AI Crawler Traffic Trends: What the Bot Share Numbers Say
Rapid growth in AI bot traffic reshapes server demands and access rules for site owners.
Crawler Access Glossary: User-Agents, Status Codes, Directives
A technical glossary explaining the signals that determine whether AI crawlers can reach, parse, and cite your website content.
Technical AI-SEO FAQ: Blocking, Rendering and Indexing
Blocking AI bots often backfires; technical accessibility determines whether your content enters the training data or answer generation.