User-agent: * Disallow: / User-agent: Sphider Allow: /netgen/ Disallow /netgen/admin/