When I was building the source list for jkl.io noticed at lot of sites no longer offering RSS and even sites like Wordpress seem to be not offering it frequently (is this authors not turning it on, turning it off, or am I missing something?).
Hand scraping all these sites would be an exercise in insanity so now building an intelligent crawler is already something I have to do much earlier than I wanted. RSS really matters for the open web.
Most sites still have a feed even if the UI doesn't surface it. Pull up the source or Inspector and search for feed, atom, or rss. It's usually in the <head>
For niflet.com I skip sites that don't have an RSS / Atom feed. It's maybe 2% of them. For political sites maybe 10%; it seems a lot of those sites predated WordPress et al. You probably know this already, but for WordPress try adding "/feed" to the URL. This works for lots of other non-WP sites too. The blog author might not even know what an RSS feed is.
Yeah I've noticed a few hidden ones, perhaps I need to make a script and go back to check the ones I thought didn't have one. niflet.com looks great, I like the minimalism.
Hand scraping all these sites would be an exercise in insanity so now building an intelligent crawler is already something I have to do much earlier than I wanted. RSS really matters for the open web.