@crossgolf_rebel As we said in the post, this is not a finished product. The crawler isn't perfect yet. There are many edge cases the crawler has to take care of. Troll instances with fake numbers, robots.txt policies, handling DNS alias/redirects, ...