Web scraping describes techniques for automatically downloading and processing web content, or converting online text and other media into structured data that can then be used for various purposes - Scrapism / HN

see also

• How to Crawl the Web with Scrapy
• How to crawl the web politely with Scrapy
• Advanced Web Scraping: Bypassing “403 Forbidden,” captchas, and more / HN
• So you want to Scrape like the Big Boys? (2021)