• Option to crawl only specific pages as opposed to excluding subdomains.