# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # User-Agent: * Disallow: /api/* Disallow: /new* Disallow: /inquiry_new* Disallow: /landing_pages_news* Disallow: /landing_pages_roots* Disallow: /invite/ Disallow: /invited_by/ Disallow: /invite_url_apply/ Disallow: /invite_pre_apply/ Disallow: /privacy Disallow: /invitation