Challenge: How to maintain pages 'fresh?' How does the web ... Comparing Policies. Based on Statistics from experiment. and revisit frequency of every month ...
extract urls. initial urls. to visit urls. visited urls. web pages. 3 ... extract urls. 6. Crawling Issues (3) Scope of crawl. not enough space for 'all' pages ...