2
1 Comment

ML Web-Crawling

I've built an app which would benefit immensely from integrating ML webcrawling.

But I'd like be able to intelligently navigate of webpages toward an objective. This'd unlock a lot of useful applications. And it's feasible.

Background: I've done a lot of procedural webcrawling (puppeteer, selenium, straight up js - particularly on sites that seek to be crawl-proof). And I've solved captchas autonomously within a webcrawling app using w/ pytesseract. I'm also aquatinted w/ pytorch + brain.js + kaggle.

Any data scientists/devs who'd fit in collaborating to solve this problem (or a subset of it), hit me up. Looking to work with those with a track record of executing/getting things done (rare). :)

-Blake

[email protected]
discord: deepb#4778

posted to Icon for group Looking to Partner Up
Looking to Partner Up
on February 19, 2020
  1. 1

    Not related, but what are you thoughts on scraping linkedin? feasable at scale?

Trending on Indie Hackers
Why Indie Founders Fail: The Uncomfortable Truths Beyond "Build in Public" User Avatar 82 comments I built a tool that turns CSV exports into shareable dashboards User Avatar 82 comments $0 to $10K MRR in 12 Months: 3 Things That Actually Moved the Needle for My Design Agency User Avatar 68 comments The “Open → Do → Close” rule changed how I build tools User Avatar 52 comments I got tired of "opaque" flight pricing →built anonymous group demand →1,000+ users User Avatar 43 comments A tweet about my AI dev tool hit 250K views. I didn't even have a product yet. User Avatar 42 comments