Browser Automation Bot for Scheduled Data Retrieval
Developer tools · Creator, sole engineer · shipped
A scheduled automation that retrieves information from a web service that offers no API, and delivers it to a messaging channel.
The detail
Browser automation is often the only option when a service has no programmatic interface, and the engineering is in making it reliable unattended: handling the authentication flow, persisting the session, running on a schedule, and failing in a way that is visible rather than silent.
Demonstrates the automation and scraping skill set applied to a real recurring task rather than a demo.
Python, Selenium, scheduled execution.
What I did
- Built browser automation to retrieve data from a site with no available API
- Implemented scheduled unattended execution
- Handled authentication flow and session persistence
- Built delivery of the retrieved result to a messaging channel
Stack
Python, Selenium, Browser Automation, Task Scheduling, Web Scraping
Case study: https://www.siddhvasudev.com/projects/browser-automation-bot-for-scheduled-data