User-agent: * Allow: / # AI crawlers # - OAI-SearchBot (ChatGPT search) # - ChatGPT-User (user-initiated fetch) # - PerplexityBot (search/answer engines) # We allow crawling so the site can be indexed and used for grounded answers. User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / # Content signals (intended): # - search=yes: OK to index for search results # - ai-input=yes: OK to use as input for AI answers (RAG/grounding) # - ai-train=no: Not permitted for training Content-Signal: search=yes,ai-input=yes,ai-train=no Sitemap: https://magicstrawberry.kr/sitemap.xml # English Sitemap: https://magicstrawberry.kr/en/sitemap.xml # LLMs # https://magicstrawberry.kr/llms.txt