Back to portfolio
VAPAN // Automations
Copart Parser
copart.com auction parser that bypasses blocking through a proxy pool.
Stack: Node.js / Worker-threads
What we had to solve
The auto dealer picked lots on copart.com manually: opened hundreds of pages every morning, copying photos and specs into a spreadsheet. Generic scripts hit the anti-bot wall and lost data on every run.
What we did
Wrote a Node.js parser on worker threads that queues lots, rotates a proxy pool and saves lots and media to a local database. Added incremental updates so already collected lots are not refetched on each run.
