Free Downloads: Web Crawler

License:  All | Free

Freeware
Link To Checker Screenshot
more

Link To Checker is a free web crawler that traverses web connections looking for broken links. .

Link To Checker is a free web crawler that traverses web connections looking for broken links.

Category: Software Development
Publisher: Sand Ark, License: Freeware, Price: USD $0.00, File Size: 7.8 KB
Platform: Unknown



Vietspider Web Data Extractor Screenshot
more

The web crawler is a program that automatically traverses the web by downloading the pages and following the links from page to page.

The Web Crawler is a program that automatically traverses the Web by downloading the pages and following the links from page to page. A general purpose of Web Crawler is to download any Web page that can be accessed through the links.

This process is called Web crawling or spidering. Many sites, in particular search engines, use spidering...

Category: Internet / Misc. Plugins
Publisher: VietSpider, License: Freeware, Price: USD $0.00, File Size: 48.8 MB
Platform: Windows, Linux

more

free web crawler, if use together with Search engine builder -lexst-SEA, you can index 10 billion pages.

free Web Crawler, if use together with Search engine builder -lexst-SEA, you can index 10 billion pages.Multi threads and distributed free Web Crawler, for both internet and interanet.You can control how frequency the spider should crawl your pages, you can save the pages locally or sent to a search-engine applicant.

Category: Internet / Browsers
Publisher: Dustgem Co.,Ltd, License: Freeware, Price: USD $0.00, File Size: 535.0 KB
Platform: Windows

Freeware
more

YaCy is a distributed Web Crawler and Web Search Engine without a central server and no censoring possibility.

YaCy is a distributed Web Crawler and Web Search Engine without a central server and no censoring possibility. It's a P2P-based index exchange network based on distributed hash tables.

Category: Internet / Tools & Utilities
Publisher: yacy.net, License: Freeware, Price: USD $0.00, File Size: 13.8 MB
Platform: Windows, Mac, Linux, Java

Freeware
Djuggler Screenshot
more

Create your own web spider or data crawler and automate data collection, data manipulation and data cleansing. Mashup multiple data sources like the web, text files, data grids like Excel, CSV files, SQL databases, etc. Demo's included in the setup.

Collect data from multiple sources like the Web, databases, text files for manipulation, cleansing or a new data source like MS Excel. Djuggler (short for data juggler) is a hands-on visual scripting tool to mashup and collect data from multiple sources like Web pages, text files, data grids as Microsoft Excel or CSV files. When the data has been collected or extracted it can...

Category: Multimedia & Design / Authoring Tools
Publisher: Digital Architects, License: Freeware, Price: USD $0.00, File Size: 3.0 MB
Platform: Windows

Freeware
XScrape Screenshot
more

XScrape is a free web page spider scraper application that extracts strings based on a regular expression. .

XScrape is a free web page spider scraper application that extracts strings based on a regular expression.

Category: Internet
Publisher: Sand Ark, License: Freeware, Price: USD $0.00, File Size: 8.8 KB
Platform: Unknown

5 Stars5 Stars5 Stars5 Stars5 Stars Freeware
Octoparse Screenshot
more

Octoparse is a free client-sides Windows web scraping software that turns websites into structured tables of data without coding. It's easy and free! Automatically Extract Web Data from Sites Within Minutes!

Octoparse is a free client-side Windows Web scraping software that turns unstructured or semi-structured data from websites into structured data sets, no coding necessary. It's an easy-to-use Web scraping tools that collects data from the Web. Crawlers run in Octoparse are determined by the extraction rules configured. The extraction rule would tell Octoparse: which...

Category: Internet / Monitoring
Publisher: Octopus Data Inc., License: Freeware, Price: USD $0.00, File Size: 54.0 MB
Platform: Windows

Freeware
more

Shetty Search is an extremely fast web search tool that searches web through multiple search engines and shows all of the results in a single HTML file that is created on the fly.

Shetty Search is an extremely fast Web search tool that searches Web through multiple search engines and shows all of the results in a single HTML file that is created on the fly. Very handy for doing mass search on some of the top engines. Shetty search now searches through 14 different search engines like Google, Yahoo, Alta vista, Web Crawler etc. No banner ads...

Category: Internet / Tools & Utilities
Publisher: Shettysoft.com, License: Freeware, Price: USD $0.00, File Size: 675.8 KB
Platform: Windows

Freeware
more

FREE adult browser and media player that keeps your browsing activity private and your files safe from unwanted eyes.

FREE adult browser and media player that keeps your browsing activity private and your files safe from unwanted eyes. WARNING: This software is restricted to adults 18 years and older.Rated #1 by Maxim Magazine as the "best way to hide your adult files". * Surf the Web in complete privacy. Find, download, and view images and videos without leaving a trace. * 128-bit encryption...

Category: Internet / Browsers
Publisher: Sun River Systems, Inc., License: Freeware, Price: USD $0.00, File Size: 1.8 MB
Platform: Windows

Freeware
netifera Screenshot
more

Netifera is a new modular open source platform for creating network security tools.

Netifera is a new modular open source platform for creating network security tools. This project provides many advantages for both security developers and researchers who want to implement new tools as well as the community of users of these tools. * TCP and UDP network scanning and service detection * Operating system identification * Full IPv4 and IPv6 support * DNS name brute-forcing * DNS...

Category: Security & Privacy / Other
Publisher: netifera, License: Freeware, Price: USD $0.00, File Size: 9.8 MB
Platform: Linux, Mac

Crawler Web Security Guard Screenshot
more

Web Security Guard helps you protect your browser security and privacy – FREE! Alerts you to unauthorized changes of your security settings; deletes sensitive information from your computer (e.g. browser history, cookies, etc.) and much more.

Web Security Guard helps you protect your browser security and privacy – FREE! Alerts you to unauthorized changes of your security settings; deletes sensitive information from your computer (e.g. browser history, cookies, etc.); monitors your browser Home Page, and automatically resets it back to the previous page and much more. Includes also FREE 3D Earth, 3D Tropical & Marine...

Category: Internet
Publisher: Crawler, LLC, License: Freeware, Price: USD $0.00, File Size: 1.2 MB
Platform: Windows

Crawler Parental Control Screenshot
more

Free for home and office use, Crawler Parental Control monitors and controls user activity on your computer. Control Web browsing, set access rights to software, hide folder content, schedule time limits and much more. Get control of your computer!

Crawler Parental Control Free for home and office use, Crawler Parental Control monitors and controls user activity on your computer. Easy to use and intuitive, the program lets you control Web browsing, set access rights to software, hide folder content, schedule time limits and much more. Free, optional 100% safe Crawler Toolbar is included and offers a unique...

Category: Internet
Publisher: Crawler, LLC, License: Freeware, Price: USD $0.00, File Size: 7.4 MB
Platform: Windows

Freeware
more

JOC Web Finder (JWF) is a fast and efficienttool to search information on the web.- Enter any word, text or question, click abutton and JWF will check all configuredsearch engines, finding web pages related tothe text entered. Results are returned al...

JOC Web Finder (JWF) is a fast and efficienttool to search information on the Web.- Enter any word, text or question, click abutton and JWF will check all configuredsearch engines, finding Web pages related tothe text entered. Results are returned almostinstantaneously and can be clicked immediatelyto view in a Web browser.- JWF saves you countless time searching...

Category: Internet / Tools & Utilities
Publisher: JOC Software, License: Freeware, Price: USD $0.00, File Size: 560.0 KB
Platform: Unknown

Freeware
Web Weaver EZ Screenshot
more

Create cool Web pages quickly and easily with this WYSIWYG Web page editor! Web Weaver EZ is the easiest way to create a Web page without knowing how to program HTML.

Create cool Web pages quickly and easily with this WYSIWYG Web page editor! Web Weaver EZ is the easiest way to create a Web page without knowing how to program HTML. Add links, images, email links, and other cool elements to your Web pages. Try the trial version of Web Weaver EZ PLUS and be able to add tables, forms and special effects, too!...

Category: Web Authoring / WebSite Promotion Tools
Publisher: McWeb Software, Inc., License: Freeware, Price: USD $0.00, File Size: 6.9 MB
Platform: Windows

Fastream NETFile FTP/Web Server Screenshot
more

Secure, ultra-fast FTP server and robust multi-threaded Web server for Windows 2000/XP/2003/Vista, featuring XML-based GUI remote 2-level administration scheme, separate upload/download speed limits, storage quotas, dynamic DNS, and compression.

Secure, ultra-fast FTP server and robust multi-threaded Web server for Windows 2000/XP/2003/Vista, featuring XML-based GUI remote 2-level administration scheme, CGI/ISAPI, separate upload/download speed limits, storage quotas, dynamic DNS, and compression. The easiest NT-based server! Features of 8.2.5 FTP and HTTP thread design fixed Web server can now open 1000...

Category: Audio
Publisher: Fastream Technologies, License: Freeware, Price: USD $0.00, File Size: 3.5 MB
Platform: Windows

BadBlue Excel Web Spreadsheet Collaboration Server Screenshot
more

Share Excel files, photos, music, videos, and business documents securely. BadBlue is one of the easiest web servers ever created. You can get started in seconds and it is much easier to use than an FTP server or Apache. Get BadBlue today!

Looking for an easy, secure way to share Excel spreadsheets over the Web or even a local area network (LAN)? Using nothing more than a browser, you can now leverage Excel in ways you never thought possible. And you can do it without hiring expensive consultants, without programming, and without any hassle. BadBlue's new Excel Sharing features include: Instantly share spreadsheets over...

Category: Business & Finance
Publisher: BadBlue, License: Freeware, Price: USD $0.00, File Size: 585.9 KB
Platform: Windows

Bulk Web Site Monitor Screenshot
more

Bulk Web Site Monitor 2.1 checks multiple web sites if they are working - By: VsiSoftware.com

Bulk Web Site Monitor 2.1 checks multiple Web sites if they are working - By: VsiSoftware.com

Category: Business & Finance
Publisher: Vsisoftware.com, License: Freeware, Price: USD $0.00, File Size: 1.4 MB
Platform: Windows

HyperPublish - Web CD product catalog Screenshot
more

Professional and comprehensive CD / Web catalog creation software. Catalogs of your goods products services easily. Descriptions, prices, pictures, order form: everything is custom, can build from scratch or database CSV import w auto-categories...

If you need an electronic catalog to keep up with your customer's demands and to stay ahead of competition, you'll like HyperPublish. With this professional, quick and powerful all-in-one environment you can create stunning Web/CD product catalogues, and also multimedia brochures, CDs and Web sites... All with a single productive tool, easy to learn and to use! Everything is...

Category: Business & Finance
Publisher: Visual Vision, License: Freeware, Price: USD $0.00, File Size: 3.8 MB
Platform: Windows

Freeware
CyD WEB Editor Screenshot
more

CyD WEB Editor is an extensible HTML editor with HTML, PHP, Perl, JavaScript, VBScript, SQL and Python syntax highlighting. Create and manage your website with this easy to use editor.

CyD WEB Editor is an extensible HTML editor with HTML, PHP, Perl, JavaScript, VBScript, SQL and Python syntax highlighting. Create and manage your website with this easy to use editor.

Category: Software Development
Publisher: CyD Software Labs, License: Freeware, Price: USD $0.00, File Size: 2.1 MB
Platform: Windows, XP

Freeware
Free Web Buttons Screenshot
more

Free Web Buttons helps you create cool web buttons and menus with ease. FREE!

Free Web Buttons helps you create cool Web buttons and menus with ease. Free! Its very easy to create professional high-quality Web buttons with the help of Free Web Buttons. Once installed you’ll be making buttons for your Web site with no programming or drawing required. Each parameter of a button may be easily changed, allowing you to achieve the required...

Category: Software Development
Publisher: Free-Web-Buttons.com, License: Freeware, Price: USD $0.00, File Size: 609.3 KB
Platform: Windows

more

KLone is a fully-featured, multiplatform embedded web server which allows dynamic pages to be written in C/C++. The pages can then be embedded into a single executable containing also KLone's high-performance web server.

KLone, an open-source (GPL) Embedded Web Server. A fully-featured, multiplatform, Web application development framework,targeted especially for embedded systems and appliances. It is a self-contained solution which includes a Web server and an SDK for creating stand-alone WWW sites with both static and dynamic content. It blends the HTTP/S server application...

Category: Software Development
Publisher: KoanLogic srl, License: Freeware, Price: USD $0.00, File Size: 464.5 KB
Platform: Windows, Mac, Linux, Unix

Likno Web Button Maker Free Screenshot
more

Free Buttons - Create stylish buttons for your website & projects with our free button maker. Through the program's flexible functionality & advanced features you can design truly impressive web buttons & guide your visitors to the desired 'click'.

Free Buttons - Free Web design software with which you can create stylish buttons for your websites and projects, in just a few clicks. This free software is easy to use and allows you to design Web buttons with different styles and effects by customizing their dimensions, text, background, lighting effects, texture and more. Impress your website visitors by adding eye-catching...

Category: Software Development
Publisher: Likno Software, License: Freeware, Price: USD $0.00, File Size: 5.3 MB
Platform: Windows

NetworkActiv Web Server Screenshot
more

Very easy to use, freeware, graphical Windows based Web Server supporting CGI, PHP, and Perl. Share files without the need for your clients to download software, as they can simply use their favorite web browser such as Internet Explorer or Mozilla.

Very easy to use, intuitive, 100% freeware, secure, Windows based Web server (HTTP Daemon) with a multilingual graphical user interface and a real-time on-screen connection log. Has a small footprint of just 608KB (not compressed!) and can be easily configured in just a few minutes. Allows for you to host websites and share files directly from your computer (no need to pay for Web...

Category: Software Development
Publisher: NetworkActiv, License: Freeware, Price: USD $0.00, File Size: 612.0 KB
Platform: Windows, Linux

Web Statistics Montage Screenshot
more

Web Statistics Montage allows you to compile the web statistics from multiple web sites into a single, easy to read e-mail.

Web Statistics Montage is a free tool that compiles Web statistics from multiple Web sites and sends them to you in an easy-to-read, easy-to-compare format without having to log in anywhere! Just set up a simple configuration file, upload the files to your site and you're done. Web Statistics Montage gathers statistics like search engine spider activity, the...

Category: Software Development
Publisher: www.Search-Engine-Optimized.com, License: Freeware, Price: USD $0.00, File Size: 11.9 KB
Platform: Windows, Linux, Unix

Freeware
Crawler Notes Screenshot
more

Don't forget important meetings, things to do, shopping lists, etc. With Crawler Notes you can create your own virtual message board right at your desktop and online to help you remember important tasks. Keep track of all your important things to do!

Don't forget important meetings, things to do, shopping lists, etc. With Crawler Notes you can create your own virtual message board right at your desktop and online to help you remember important tasks. Keep track of all your important things to do. Download Crawler Notes absolutely FREE. You can use also a free customizable Crawler Toolbar that has games, ecards, fun...

Category: Multimedia & Design
Publisher: Crawler, LLC, License: Freeware, Price: USD $0.00, File Size: 1.5 MB
Platform: Windows

blank