# search - robots control file # use any robot without any restriction User-agent: * Disallow: /admin Disallow: /redirect User-agent: twiceler Disallow: /