Robots.txt

A file that tells search engines which parts of your site to crawl or ignore.