While we agree that Python is a good language for writing a web crawler, unfortunately we don't have in house expertise in Python. We're very concerned that this would make it difficult for us to ...

A Web Crawling Code of Conduct Unfortunately, and somewhat understandably, it’s easier to focus on the murky underbelly of Web crawling.