Wide17 was seeded with the « Total Domains » list of 256,796,456 URLs provided by Domains Index on June 26th, and crawled with max-hops set to « 3 » and de-duplication set « on ».
Wide17 was seeded with the « Total Domains » list of 256,796,456 URLs provided by Domains Index on June 26th, and crawled with max-hops set to « 3 » and de-duplication set « on ».
