I have talked about different process of designing web crawler. I have given details about space utilization. I have talked about non-functional requirements such as horizontal scaling and fa ew data structures like hash map, bloom filter.
No download links available.
