2scraper
GitHub Browse scrapers
65 open-source scrapers on GitHub

Web data, without rebuilding the plumbing

Open-source scrapers for real-world websites. Turn products, listings, comments, prices and market data into clean JSON or CSV — on your own infrastructure.

Browse scrapers Request a website
  • Free & open source
  • JSON & CSV output
  • Paid services optional
bash
# pick a site, clone its scraper
$ git clone https://github.com/2scraper/amazon-scraper
$ cd amazon-scraper
$ pip install -r requirements.txt -r requirements-playwright.txt

# run it — follow the repo's quick start for exact flags
$ python playwright_scraper.py --url "https://…" --pages 3 --format csv

✓ rows written  →  amazon_products.csv
✓ run metadata  →  amazon_products.meta.json
Why 2scraper

Focused scrapers, one platform per repo

Each repository targets one website and documents the supported pages, captured fields, setup and output — so you spend less time reverse-engineering sites and more time using the data.

Ready to run

Clone a repository, follow its quick start and collect data on your own machines.

Structured by default

Predictable records in JSON or CSV, with documented schemas and sample output.

Multiple execution paths

Playwright, Selenium, Puppeteer, direct APIs or the Scraping Browser API — whatever the target needs.

Built for real websites

Pagination, dynamic content, proxies, fingerprints and CAPTCHA flows where the site requires them.

How it works

Start in three steps

  1. Pick a target

    Find the website you need in the scraper directory.

  2. Open its repository

    Follow the quick-start guide in the repo's README.

  3. Run and extend

    Run locally, then add the optional browser, proxy or CAPTCHA setup documented for that target.

Support differs by repository. The README in each scraper is the source of truth for engines, locales, fields and infrastructure requirements.

Directory

Every public scraper

All public platform scrapers, grouped by their primary use case.

65 scrapers

Food & delivery 1

Ffoodpanda

Publishing & community 5

GGoodreads HHacker News MMedium PPerplexity QQuora

Business data & reviews 4

BBetter Business Bureau FFlippa GG2 GGoogle Play

Jobs & hiring 3

JJust Join IT MMercor WWellfound

Sports 1

TTransfermarkt

Public records 1

RRosreestr

No scraper for that site yet — request it.

View all repositories on GitHub →
Built to fit your workflow

What most repositories include

  • A runnable Python implementation and command-line examples
  • JSON and CSV output with documented fields
  • Sample records for a quick look at the data
  • Pagination and dynamic-content handling tailored to the target
  • Optional integrations for captcha solving, proxies, fingerprints and a remote browser
Captcha solvingreCAPTCHA, Turnstile and more, solved only when a page is really gated.
Scraping Browser APIA managed Chromium over CDP — no browser infrastructure to run.
Residential proxiesRotating exits in the country a site expects, via 2prx.
FingerprintsA consistent, self-consistent device identity per run.

Every scraper runs on your own infrastructure. Paid services from 2Captcha are optional unless a repository explicitly says otherwise — one key covers all four.

Community

Contributing

Found a bug?

Open an issue in the affected scraper's repository and include the URL, the command and the relevant log output.

Want to improve a scraper?

Fork the repository and send a focused pull request.

Missing a platform?

Request it here — new sites are added regularly.

Please use scraped data responsibly and follow the target website's terms and applicable laws.