Hmm, I think I'd still choose Scrapy over JS in this case. While it can be a bit convoluted, for real production stuff I don't know any better choices.

I have myself deployed a Scrapy web scraper as AWS Lambda function and it has worked quite nicely. Every day for the last year now I guess, it has been scraping some websites to make my life a little easier.