Unabhängiges technisches Audit · keine API-Schlüssel
KI-Crawler-Checker — Können Bots auf Ihre Website zugreifen?
Prüfen Sie robots.txt, KI-Bot-Regeln, Discovery-Dateien und Indexierungssignale.
robots.txtAI searchHTTP signalsNo API key
What this tool checks
Fetches the public file and evaluates the submitted path against documented crawler user-agents.
How it works
The most specific applicable group is selected and the longest matching rule determines each verdict.
Common mistakes
A successful fetch does not prove bot compliance, and a global rule can differ from a crawler-specific group.