User-agent: * Allow: /$ Allow: /sources Allow: /assets/ Disallow: /search Disallow: /research Disallow: /api/ Disallow: /auth/