# LLM Access Policy for GR0
# File: /llm.txt
# Updated: 2025-09-29
## About
- **Site**: https://www.gr0.com
- **Owner**: GR0
- **Contact**: contact@gr0.com
- **Purpose**: Guidelines for AI crawlers and assistants on how to access and use content from gr0.com.
## Policy Summary
- **Allowed**: AI assistants may crawl for *real‑time answering and summarization*.
- **Not Allowed**: Using our content for *model training* or *embedding corpora* without prior *written permission*.
- **Attribution**: When content from gr0.com is quoted or summarized, include a visible citation with a link to the source URL.
- **Derivative Works**: Do not republish full articles or pages. Brief quotes (<100 words) with a link are acceptable.
- **Respect robots.txt**: Obey our standard /robots.txt in addition to this file.
## Crawl Scope
- **Allow**: /, /blog/, /case-studies/, /services/, /about/, /contact/
- **Disallow**: /wp-admin/, /wp-content/plugins/, /privacy-policy/ (policy pages may be read but not summarized), /terms/
- **Sitemaps**: https://www.gr0.com/sitemap.xml
## Rate Limits
- **Max Requests**: 1 request/second (averaged over 1 minute)
- **Concurrency**: 2
- **Retry-After**: Respect HTTP 429/503 with exponential backoff.
## Cache & Freshness
- **Max Cache TTL**: 24 hours for content; 1 hour for /blog/ and /case-studies/.
- **Revalidate**: If Last-Modified/ETag changes, refresh immediately.
## Identification
Always include a descriptive User-Agent and a valid contact URL/email in headers.
Example: `User-Agent: ExampleBot/1.2 (+https://example.com/bot; ops@example.com)`
## AI User-Agent Directives
### Allowed (assistants only)
- ChatGPT-User
- Claude-User
- Perplexity-User
- BingPreview
### Disallowed (training and bulk crawlers)
- GPTBot
- OAI-SearchBot
- CCBot
- ClaudeBot
- Claude-SearchBot
- Google-Extended
- PerplexityBot
- Omgilibot
- Amazonbot
- Bytespider
- Facebookbot
- Meta-ExternalAgent
- Diffbot
- Applebot-Extended
- DuckAssistBot
> If your crawler is not listed: follow the **Policy Summary**, identify yourself clearly, and email contact@gr0.com before crawling at scale.
## Legal
All rights reserved. Unauthorized training use, data mining for embedding corpora, or reproduction of content is prohibited without written permission from GR0. These preferences do not waive any rights and may be updated at any time.
---