User-agent: * Disallow: /admin Disallow: /api/v1/admin Disallow: /debug Disallow: /metrics Disallow: /internal Disallow: /graphql Allow: /