# robots.txt for TheIntroDB (TIDB) User-agent: * Allow: / # Disallow certain paths if needed Disallow: /admin Disallow: /mod # API endpoints (optional - adjust based on your needs) Disallow: /api/v1/ Disallow: /api/v2/ # Sitemap Sitemap: https://theintrodb.org/sitemap.xml # Allow specific bots or disallow others if needed # User-agent: Googlebot # Allow: / # # User-agent: Bingbot # Allow: /