# This robot.txt file is for http://www.bookbuilders.org # Each line in the group has the format # : # The purpose it to hopefully "controll" the robots/spiders # from indexing directories that have "confidential" data. # Which robot is allowed and where our case, all are welcome User-agent: * Disallow: /1996-site Disallow: /admin Disallow: /art-new Disallow: /ArtWeb Disallow: /cgi-bin Disallow: /includes Disallow: /LOGs Disallow: /private