Robots Text File (Robots.txt)

A file used to share your preferences with Google. Such a file could bar the search engine from private directories or point it to directories with valuable content.