web scraping
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Feb 28, 2025 by Paul Klein · across every show →
Everything said about web scraping, oldest first
Feb 28, 2025 positive
Klein: Web scraping workflows should use a tiered waterfall architecture
“If you're building web scraping workflows, what you should do is have a waterfall. You should have the first request is a curl to the website. See if you can get it without even using a browser. And then the second request may be like a scraping specific API. …”