# https://www.robotstxt.org/robotstxt.html # Block crawlers from authenticated/utility routes with no search value. # /u/ (creator profiles) is intentionally left crawlable — thin profiles are # excluded from indexing per-page via a noindex meta tag instead, so real # profiles keep their long-tail search value. See MARK-3336. User-agent: * Disallow: /home/ Disallow: /signIn Disallow: /onboarding Disallow: /secondary-onboarding Disallow: /login/ Disallow: /import Disallow: /integrations Disallow: /admin/ Disallow: /new-product/ Disallow: /subscription/ Disallow: /stripesuccessful Disallow: /instagram/connection Disallow: /google-calendar/connection Disallow: /a/ Disallow: /dm/ Disallow: /public/markit-fundraising # Sitemap location Sitemap: https://markitai.com/sitemap.xml