# /robots.txt file for http://seamap.env.duke.edu # mail efujioka@duke.edu for constructive criticism User-agent: Sogou Disallow: /species/tsn/ User-agent: * Disallow: /digir Disallow: /functions Disallow: /widecast Disallow: /seamap2/downloads Disallow: /downloads Disallow: /species/images Disallow: /present Disallow: /Members Disallow: /ogc Disallow: /seamap2.5/ogc Disallow: /admin Disallow: /seamap2.5/admin Disallow: /coml/medres Disallow: /mabdc/matching Disallow: /login_form Disallow: /portal_memberdata Disallow: /providers Disallow: /contact-info Disallow: /about/termsofuse # old URLs still crawled by Duke-crawler Disallow: /prod Disallow: /prod/services Disallow: /prod/mapservice Disallow: /stat_center Disallow: /apps Disallow: /prod/services Disallow: /mapservice Disallow: /events Disallow: /chameleon Disallow: /docs