User-agent: * Allow: / Disallow: /app Disallow: /admin # /socio is deliberately NOT disallowed. It is noindex,nofollow (meta tag + the X-Robots-Tag in # public/_headers), and a crawler has to be allowed to fetch the page to read that. Disallowing it # here would hide the noindex and let the URL be indexed bare, which is the worse outcome. It is # also excluded from the sitemap (NOT_INDEXABLE in astro.config.mjs), so nothing advertises it. Sitemap: https://multiservicios.ai/sitemap-index.xml