# robots.txt for provei.ai, generated from src/config/ai-policy.ts. # AI usage policy: https://provei.ai/ai.txt # LLM index: https://provei.ai/llms.txt (English: https://provei.ai/en/llms.txt) # Full text for LLMs: https://provei.ai/llms-full.txt (English: https://provei.ai/en/llms-full.txt) # Help center LLM index: https://provei.ai/ajuda/llms.txt # As a condition of accessing this website, you agree to abide by the following content signals: # (a) If a content-signal = yes, you may collect content for the corresponding use. # (b) If a content-signal = no, you may not collect content for the corresponding use. # (c) If the website operator does not include a content signal for a corresponding use, the website operator neither grants nor restricts permission via content signal with respect to the corresponding use. # # The content signals and their meanings are: # search: building a search index and providing search results (e.g., returning hyperlinks and short excerpts from your website's contents). Search does not include providing AI-generated search summaries. # ai-input: inputting content into one or more AI models (e.g., retrieval augmented generation, grounding, or other real-time taking of content for generative AI search answers). # ai-train: training or fine-tuning AI models. # # ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET. User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / Allow: /api/md/_catalog Disallow: /api/ Disallow: /locale/ # Search indexers and user-initiated AI fetchers: explicitly allowed. User-agent: OAI-SearchBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / Allow: /api/md/_catalog Disallow: /api/ Disallow: /locale/ User-agent: ChatGPT-User Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / Allow: /api/md/_catalog Disallow: /api/ Disallow: /locale/ User-agent: Claude-SearchBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / Allow: /api/md/_catalog Disallow: /api/ Disallow: /locale/ User-agent: Claude-User Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / Allow: /api/md/_catalog Disallow: /api/ Disallow: /locale/ User-agent: PerplexityBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / Allow: /api/md/_catalog Disallow: /api/ Disallow: /locale/ User-agent: Perplexity-User Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / Allow: /api/md/_catalog Disallow: /api/ Disallow: /locale/ # AI training crawlers are not blocked; they follow the * group above. Sitemap: https://provei.ai/sitemap.xml Sitemap: https://provei.ai/ajuda/sitemap-index.xml