URL Spider Pro - Version 2.5 URL Spider Pro is a free spider designed for crawling the Web indexing documents containing information you're looking for (by specifying keywords). The information collected can be used for research purposes, for creating a niche specific search engine (ie., a search engine for golf only Web pages, or a search engine for music Web pages, etc.), or for anything else where specific information needs to be collected.