# Robots.txt # For more information on this file see: # http://www.robotstxt.org/ # Define the sitemap path Sitemap: https://20fiftyoneapts.com/sitemap.xml # Make changes for all web spiders User-agent: * Disallow: /pdf/*