User-agent: Vagabondo Disallow: / # Lexxebot generates exceptions on the site by requesting made-up, non-existing URL's based on existing URL's User-agent: Lexxebot Disallow: /