Add default robots.txt

OlegoO · web-flow · commit 3cb9f46f239b · 2023-05-04T17:51:39.000+02:00
Add default robots.txt Restrictive policy for backend environments
diff --git a/src/VirtoCommerce.Platform.Web/wwwroot/robots.txt b/src/VirtoCommerce.Platform.Web/wwwroot/robots.txt
@@ -0,0 +1,3 @@
+# Restrictive policy for backend environments 
+User-agent: *
+Disallow: /

Original file line number	Diff line number	Diff line change
`@@ -0,0 +1,3 @@`
	`1`	`+# Restrictive policy for backend environments`
	`2`	`+User-agent: *`
	`3`	`+Disallow: /`