Browser Automation Bot for Scheduled Data Retrieval

Developer tools · Creator, sole engineer · shipped

A scheduled automation that retrieves information from a web service that offers no API, and delivers it to a messaging channel.

The detail

Browser automation is often the only option when a service has no programmatic interface, and the engineering is in making it reliable unattended: handling the authentication flow, persisting the session, running on a schedule, and failing in a way that is visible rather than silent.

Demonstrates the automation and scraping skill set applied to a real recurring task rather than a demo.

Python, Selenium, scheduled execution.

What I did

  • Built browser automation to retrieve data from a site with no available API
  • Implemented scheduled unattended execution
  • Handled authentication flow and session persistence
  • Built delivery of the retrieved result to a messaging channel

Stack

Python, Selenium, Browser Automation, Task Scheduling, Web Scraping

Case study: https://www.siddhvasudev.com/projects/browser-automation-bot-for-scheduled-data