# Tell search engines not to index these folders User-agent: * Disallow: /clients/ Disallow: /internal/ Disallow: /Templates/ Disallow: /cgi-bin/ Disallow: /images/ Disallow: /tools/calendars/ Disallow: /admin/ Disallow: /terms/ Disallow: /testlab/ User-agent: aipbot Disallow: / User-agent: BecomeBot Disallow: / User-agent: psbot Disallow: /