Robots.txt 2.0.1 Description:

Robots.txt is a visual editor tool for Robot Exclusion Files and a log manager package tool.

Robots.txt allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions.

The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable.

Robots.txt 2.0.1 Features:

· Visually generate industry standard Robots.txt files
· Identify malicious and unwanted spiders and ban them from your site
· Direct search engine crawlers to the appropriate pages for multilingual sites
· Keep spiders out of sensitive and private areas of your Web site
· Upload the correctly formatted robots.txt file directly to your FTP server not switching from Robots.txt Editor
· Track spider visits
· Create spider visits reports in HTML, Microsoft Excel CSV and XML formats

Robots.txt 2.0.1 Requirements:

· Internet Explorer 4.0 or higher
· WinSock 2.0
· Intel Pentium 166 processor or higher
· 64 MB RAM
· 14K internet connection
· 8MB free hard disk space (plus extra space for log files you will import from your server)

Robots.txt 2.0.1 Limitations:

· you cannot add a new spider to the list;
· you cannot edit spider information;
· you cannot save the generated instruction file robots.txt;
· web server log import is restricted to one file;
· you cannot export log analysis results;
· report generation and their customization are unavailable.

Related searches:

spider - spider man 2 - site journal - site - spider man - track - 8 track - advanced robots txt generator - asset track

Robots.txt security information

You cannot download any crack or serial number for Robots.txt on this page. Every software that you are able to download on our site is legal. There is no crack, serial number, hack or activation key for Robots.txt present here. Our collection also doesn't contain any keygens, because keygen programs are being used in illegal ways which we do not support. All software that you can find here is freely downloadable and legal.

Robots.txt installation package is prepared to be downloaded from our fast download servers. It is checked for possible viruses and is proven to be 100% clean and safe. Various leading antiviruses have been used to test Robots.txt, if it contains any viruses. No infections have been found and downloading Robots.txt is completelly problem free because of that reason. Our experts on malware detection tested Robots.txt with various spyware and malware detection programs, including fyxm.net custom malware and spyware detection, and absolutelly no malware or spyware was found in Robots.txt.

All software that you can find on our servers, including Robots.txt, is either freeware, shareware or open-source, some of the software packages are demo, trial or patch versions and if possible (public domain licence), we also host official full versions of software.

Because we want to be one of the fastest download sites on the web, we host all the software including Robots.txt on our servers. You cannot find here any torrents or download links that would lead you to dangerous sites.

Fyxm.net does support free software, however we do not support warez or illegal downloads. Warez is harming producers of the software.

Enjoy!