Python web scraping resource

If you need to extract data from a web page, then the chances are you looked for their API. Unfortunately this isn't always available and you sometimes have to fall back to web scraping.In this article I'm going to cover a lot of the things that apply to all web scraping projects and how to overcome some common gotchas.PrerequisitesRequestslxmlCrawling / SpideringStoring seen URLsCSS