I wrote: > try to minimize the size of your active list of URLs to > search and therefore the number of URLs that might suddenly become invalid > by using a Breath First Search algorithm. This is not true. BFS would be awfull for an SmbCrawler. Mike