Web Crawler

A simple web spider and crawler software which runs spider and crawler in different threads. Aim of the project was to calculate page rank of the pages. It has been developed as the term project of Information Retrieval (M.Sc.) lecture.

Tested on wikipedia's local copy.

Sample Codes

by zgrw on 2014-05-06 19:35:01