I built a tool called Browserflow (https://browserflow.app) that lets you automate any task in the browser, including scraping websites.
People love it for its ease-of-use because you can record actions via click-and-point rather than having to manually come up with CSS selectors. It intelligently handles lists, infinite scrolling, pagination, etc. and can run on both your desktop and in the cloud.
It probably doesn't make sense for Browserflow as a business, but I'd love to find a tool like this that exported a Scrapy spider, similar to the now unmaintained Portia.
People love it for its ease-of-use because you can record actions via click-and-point rather than having to manually come up with CSS selectors. It intelligently handles lists, infinite scrolling, pagination, etc. and can run on both your desktop and in the cloud.
Grateful for how much love it received when it launched on HN 8 months ago: https://news.ycombinator.com/item?id=29254147
Try it out and let me know what you think!