Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I'm curious if there are opportunities to be a force multiplier here. I see that the Readme says "there's no automated scraper farm" yet. Getting that set up seems crucial. Will jump on the Discord :)


The community has been writing scrapers since the beginning, but it's a huge task. We've also written scraper templates, since many counties use the same systems. https://github.com/Police-Data-Accessibility-Project/PDAP-Sc...


Yep, I see that there are a lot of existing scrapers. Getting those up and running automatically on a backend host will make things a lot smoother.

Also, I recommend using Playwright instead of Selenium. I'm in the Discord now and will be hanging out, so looking forward to chatting more about this and contributing.


Thanks for taking a look! DM me on Discord if you'd like to chat about this.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: