Free Downloads: Crawlers

ETagFix is an add-on for Microsoft Internet Information Server (IIS) or any web server that supports ISAPI filters, that cuts off part of the etag that IIS produces so that is does not change every time your computer is rebooted.

ETagFix is an add-on for Microsoft Internet Information Server (IIS) or any web server that supports ISAPI filters, that cuts off part of the etag that IIS produces so that is does not change every time your computer is rebooted. Etag is an HTTP header that is produced by IIS to allow web Crawlers and user clients to check against to see if a web page has changed. ETagFix fixes the...

Category: Internet / Tools & Utilities
Publisher: ISAPILabs, License: Freeware, Price: USD $0.00, File Size: 696.3 KB
Platform: Windows

The web crawler is a program that automatically traverses the web by downloading the pages and following the links from page to page.

The web crawler is a program that automatically traverses the web by downloading the pages and following the links from page to page. A general purpose of web crawler is to download any web page that can be accessed through the links.

This process is called web crawling or spidering. Many sites, in particular search engines, use spidering as a means of providing up-to-date data. Web...

Category: Internet / Misc. Plugins
Publisher: VietSpider, License: Freeware, Price: USD $0.00, File Size: 48.8 MB
Platform: Windows, Linux

Free Large Android Icons picture various space creatures, such as robots, crawlers and androids. Not only does the set present the creatures themselves, it also shows their moods and actions.

Free Large Android Icons picture various space creatures, such as robots, Crawlers and androids. Not only does the set present the creatures themselves, it also shows their moods and actions. All the images are created by professional artists and demonstrate bright colors and well-finished edges. This free icon set is a perfect choice for your personal desktop customization. Each...

Category: Desktop Enhancements / Icon Tools
Publisher: large-icons.com, License: Freeware, Price: USD $0.00, File Size: 13.7 MB
Platform: Windows, Mac, Linux, Pocket PC, Other, Android, BlackBerry, iPhone, iPod, iTouch, Palm, Unix, Handheld/Mobile Other, Java, AS/400, OS/2

This program lets you to substitute URI for symbol codes of the ASCII table.

This program lets you to substitute URI for symbol codes of the ASCII table. It's very useful to prevent scanning of web pages by the Crawlers gathering e-mail addresses for broadcasting spam messages on the next step. Using this software you can protect your mailbox from tons of junk mail, and will not be afraid of publishing contacts on your home page or a company's web site....

Category: Security & Privacy / Encrypting
Publisher: Loonies Software, License: Freeware, Price: USD $0.00, File Size: 63.3 KB
Platform: Windows

Files Crawler is a file search application.

Files Crawler is a file search application. It lets you search tons of files and download music, videos, images, documents and software. Files Crawler is actually performing its search at Google. As Google allows us to search for more than just Web pages, due to its special indexing method of directory listing. Directory listing of Websites, is actually what allows Google to see all sort of...

Category: Internet / Tools & Utilities
Publisher: Speedapps Inc, License: Freeware, Price: USD $0.00, File Size: 747.5 KB
Platform: Windows

The InnerPeace WebMaster Toolkit is a collection of essensial tools assembeled and made by the Webmasters of InnerPeace.

The InnerPeace WebMaster Toolkit is a collection of essensial tools assembeled and made by the Webmasters of InnerPeace. Some of these essensial tools are not available anywhere else. Includes a fast, easy 4 hexillion color combo picker, PageJumper web page forwarder, EScrambler to scrambler your email addresses and hide them from spamcrawlers, plus some excellent articles. Colors on web pages...

Category: Utilities / Misc. Utilities
Publisher: innerpeace.org, License: Freeware, Price: USD $0.00, File Size: 370.0 KB
Platform: Windows, Linux, Mac, Palm

Cable Player is a Entry Level digital video player for cable TV operators.

Cable Player is a Entry Level digital video player for cable TV operators. With Cable Player you need not worry about faulty VCRs’, VHS tapes, VCD Players or even the staff running your Cable Channel. All you have got to do is load movies, songs, ads, promos for days on the computer, set the sequence and let Cable Player do the rest. Cable Player will play your movies, songs along with...

Category: Multimedia & Design / Video
Publisher: Trinity Technologies, License: Freeware, Price: USD $0.00, File Size: 4.1 MB
Platform: Windows

Blogspreading is a free utility, which automatically appends a link to the latest post in your blog to your e-mail signature. This will easily catch the recipients' interest and convert them to readers of your blog. Spread your blog around the world

Make a web of links to your posts and you will get a lot of new readers. Blogspreading is a small free utility, which automatically appends a link to the latest post in your blog to your e-mail signature. This will easily catch the recipients' interest and convert them to the readers of your blog. All e-mail clients allow automatic adding of a signature to outgoing message. If you use an...

Category: Audio / MP3 Search Tools
Publisher: Softvoile, License: Freeware, Price: USD $0.00, File Size: 578.8 KB
Platform: Windows

Octoparse is a free client-sides Windows web scraping software that turns websites into structured tables of data without coding. It's easy and free! Automatically Extract Web Data from Sites Within Minutes!

Octoparse is a free client-side Windows web scraping software that turns unstructured or semi-structured data from websites into structured data sets, no coding necessary. It's an easy-to-use web scraping tools that collects data from the web. Crawlers run in Octoparse are determined by the extraction rules configured. The extraction rule would tell Octoparse: which website is to...

Category: Internet / Monitoring
Publisher: Octopus Data Inc., License: Freeware, Price: USD $0.00, File Size: 54.0 MB
Platform: Windows