User-agent:*
Disallow: /logs/

User-agent: psbot
Crawl-Delay: 86400