# =================================== # Generator: http://pixelfolk.net/tools/robots # Exclude the following folders from indexing: / # Disallow the following search agents: User-agent: WebReaper User-agent: WebCopier User-agent: Offline Explorer User-agent: HTTrack User-agent: Microsoft.URL.Control User-agent: EmailCollector User-agent: penthesilea Disallow: / Sitemap: https://www.datascienceblog.net/sitemap.xml