Where Can My Robot Go? The statement of the challenge clearly suggests checking out the robots.txt file of CTFLEARN here The hint suggests checking out the HTML page mentioned in the Disallow field in robots.txt