Merge pull request Aspen-Discovery#1778 from lizrea/patch-3

mdnoble73 · web-flow · commit 4dc8936b3296 · 2024-04-24T16:01:02.000-06:00
Add GPTBot to robots.txt
diff --git a/code/web/robots.txt b/code/web/robots.txt
@@ -80,6 +80,9 @@ Disallow: /
 User-Agent: MJ12bot
 Disallow: /
 
+User-Agent: GPTBot
+Disallow: /
+
 User-agent: 360Spider
 Disallow: /
 
