User-Agent: * Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /dashboard/ Disallow: /login Disallow: /signup User-Agent: Googlebot-News Allow: / Allow: /news Allow: /news/ Host: http://localhost:3000 Sitemap: http://localhost:3000/sitemap.xml