# Slurp (El spider de Inktomi) # tiene prohibido integramente el acceso User-agent: Slurp Crawl-delay: 10 Disallow: / # Google # tiene autorizado el acceso # maximum rate is one page every 60 seconds # only visit between 00:00 and 06:00 UTC (GMT) User-agent: Googlebot # Request-rate: 1/60 # Visit-time: 0000-0600 Allow: / Disallow: /colaboradores.html Disallow: /atmos/search Disallow: /atmos/postcard Disallow: /atmos/memberlist Disallow: /atmos/data/media Disallow: /aves/search Disallow: /aves/postcard Disallow: /aves/memberlist Disallow: /aves/data/media Disallow: /etno/search Disallow: /etno/postcard Disallow: /etno/memberlist Disallow: /etno/data/media Disallow: /geologia/search Disallow: /geologia/postcard Disallow: /geologia/memberlist Disallow: /geologia/data/media Disallow: /habitats/search Disallow: /habitats/postcard Disallow: /habitats/memberlist Disallow: /habitats/data/media Disallow: /hongos/search Disallow: /hongos/postcard Disallow: /hongos/memberlist Disallow: /hongos/data/media Disallow: /mamiferos/search Disallow: /mamiferos/postcard Disallow: /mamiferos/memberlist Disallow: /mamiferos/data/media Disallow: /peces/search Disallow: /peces/postcard Disallow: /peces/memberlist Disallow: /peces/data/media Disallow: /reptiles/search Disallow: /reptiles/postcard Disallow: /reptiles/memberlist Disallow: /reptiles/data/media # Resto de bots (seņalado mediante *) # tienen prohibido integramente el acceso User-agent: * Disallow: /