Hacker News new | past | comments | ask | show | jobs | submit login

My wife has her work schedule in a mobile web app, but the app is really bad. Turns out the app is just a wrapper around a web site.

So I made a KVM instance which does one thing - login automatically, start Firefox, login with Selenium, then uses some kind of other Python desktop control contraption to press CTRL-S, tab-tab, save the web page to the Downloads folder.

Then, the python program proceeds to parse the HTML (with BeautifulSoup), extract the schedule times from how they are showed in some <div> or other (super weird ugly text format). Checks for changes over time and emails her what has changed. (So she gets a notice when her schedule changes and she doesn't have to periodically check in with the app.)

Finally converts the schedule to calendar format and publishes on a web site so the schedule can also be seen in the phone calendar.




In similar vein: my local recycling collection is different from week to week (i.e. paper one week, plastic the next, etc). It's supposed to be on a fixed yearly schedule, but during COVID lockdowns the schedule changed dramatically, often day by day. There is a website that will tell you the most recent plan, but you can't just bookmark it - every time you have to specify the address and the date, which is annoying.

So I built a scraping script in python that runs once a day and sends me an email the evening before a collection is due, telling me what I should place outside that day. It's been working great for three years now, with zero maintenance.

I considered turning it into a public service, but i don't want any pressure from neighbors when things eventually break (as they will, inevitably, sooner or later). And really this should be a basic feature offered by the local authority website, so I hope they'll implement it one day on their own.


Maybe you could put a web service anonymously. A dirty paper with a QR code on. You have nothing to do with it, of course.


Ive also done this for similar purposes . Scrape parse map reduce over garbage web apps. Good on ya


That's cool! What library/software did you get the instance to email?


Python has a built-in SMTP client, which I connected to my regular email account. So the emails are "coming from me".




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: