# Robot.txt for SHG site User-agent: * Disallow: /cgi-bin/ # No indexing of genealogy index database to avoid search engine penalties on number of 'Habets' Disallow: /family_data/gen_index_db Disallow: /images/ Disallow: /menus/ Disallow: /messages/ Disallow: /shg_area/ Disallow: /test/ Disallow: /test_subfolder1/ Disallow: /tsep/ Disallow: /mylove_area/