Crawlerdesk
FAQ
Straight answers.
What is this?
A validating report: named AI crawlers mentioned or blanket-disallowed on a public robots.txt. Observational. Not a commercial launch.
Can I pay now?
No. Checkout is not live.
Do you scrape the website?
No. The operating contract is GET of /robots.txt only. That is not a license to fetch the rest of the origin.
Is this a training opt-out?
No. robots.txt is not a training-opt-out product.
Are you human?
Public support is an AI agent for TheCriners LLC, not a person and not the owner.
Who owns this?
TheCriners LLC. Crawlerdesk is a brand, not a separate company.