Click here to Skip to main content

A simple crawler class

Haim Nachum

Rate me:

3.45/5 (5 votes)

27 Dec 2009CPOL2 min read

31.4K

2.3K

33

A multi-threaded crawler that downloads pages and saves them localy while preserving the site tree structure.

Views

Daily Counts

Downloads

Weekly Counts

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Written By

Haim Nachum

Software Developer

Israel

This member has not yet provided a Biography. Assume it's interesting and varied, and probably something to do with programming.

Comments and Discussions

Go to top