FounderFinder: 500,000 Startups, Founders and Open Roles, Ranked

AI products · Creator, sole engineer · in progress

A local dataset and workspace for finding early-stage startups worth working with: 541,695 companies, 570,838 founders and 51,065 open roles, collected only from public, permitted sources.

The detail

A job search aimed at early startups has no single list to search. The companies are spread across accelerator batches, funding news, regulatory filings, company registers in a dozen countries and job boards. This pipeline collects them, merges duplicates, classifies every company with explainable rules and scores each one twice: as a lead, and for fit against a personal profile. Every point in both scores carries its reason.

Classification is deterministic and was measured, not assumed: an independent model graded 240 random companies, and the weakest dimension is reported alongside the strongest. A founder email is marked published only when it appears on the company's own site; anything else is stored as a pattern guess and labelled that way. robots.txt and crawl delays are honoured, and sites whose terms forbid scraping are not used.

A local website turns the data into a daily workflow: a brief in plain sentences, a 28-facet explorer, company sheets, a pipeline board and an outreach desk. Exports include a formula-driven Excel workbook and a shareable copy with all personal data removed.

A model ranks the companies that have enough text for relevance in two passes: a small model screens tens of thousands in batches, and a larger one re-scores the top thousand. Companies that would clash with existing agreements get their own tier instead of being ranked.

Python, SQLite, FastAPI, Pydantic, pytest.

What I did

  • Built 24 collectors over accelerator portfolios, funding news, SEC filings, nine national company registers and public job boards
  • Merged the sources into one company record with founders, open roles and evidence signals: 541,695 companies and 570,838 founders
  • Wrote a deterministic classifier over 25 dimensions and had an independent model grade 240 random companies
  • Built an explained lead score and a personal fit score where every point carries its reason
  • Built the local website: a 28-facet explorer, company sheets, a pipeline board and an outreach desk
  • Kept collection to permitted public sources, labelled every guessed email as a guess, and wrote 267 tests
  • Ranked 60,864 companies for relevance with a two-pass model screen, with a separate tier for conflicts with existing agreements

Stack

Python, SQLite, FastAPI, Web Scraping, Data Pipelines, Data Extraction, Pydantic, pytest, API Integration, Database Design

Case study: https://www.siddhvasudev.com/projects/founderfinder-500-000-startups-founders-and