Getting Started To get us started, you will need to start a new Python3 project with and install Scrapy (a web scraping and web crawling library for Python).

To grab every Hackaday URL ever, [Alex] wrote a small Python script using the Beautiful Soup screen scraping library.