Robots.txt - Version 2.0 Robots.txt is a visual editor for Robot Exclusion Filesand a log analyzer software. It allows a user toquickly and easily create the robots.txt files requiredto instruct search engine spiders, which parts of a Website are not to be indexed and made searchable by thegeneral Web public and then to identify spiders, whichdo not keep to those instructions. The program providesthe user a way to log onto his FTP or local networkserver and then select the documents and directorieswhich are not to be made searchable. By means of thisprogram you will be able to visually generate industrystandard robots.txt files; identify malicious andunwanted spiders and ban them from your site; directsearch engine crawlers to the appropriate pages formultilingual sites; use robots.txt files for doorwaypage management; keep spiders out of sensitive andprivate areas of your Web site; upload the correctlyformatted robots.txt files directly to your FTP servernot switching from Robots.txt Editor; track spidervisits; create spider visits reports in HTML, MicrosoftExcel CSV and XML formats and more. Free program`supdates and upgrades unrestricted in time; unlimitednumber of Web sites to work with