2
1 Comment

ML Web-Crawling

I've built an app which would benefit immensely from integrating ML webcrawling.

But I'd like be able to intelligently navigate of webpages toward an objective. This'd unlock a lot of useful applications. And it's feasible.

Background: I've done a lot of procedural webcrawling (puppeteer, selenium, straight up js - particularly on sites that seek to be crawl-proof). And I've solved captchas autonomously within a webcrawling app using w/ pytesseract. I'm also aquatinted w/ pytorch + brain.js + kaggle.

Any data scientists/devs who'd fit in collaborating to solve this problem (or a subset of it), hit me up. Looking to work with those with a track record of executing/getting things done (rare). :)

-Blake

[email protected]
discord: deepb#4778

posted to Icon for group Looking to Partner Up
Looking to Partner Up
on February 19, 2020
  1. 1

    Not related, but what are you thoughts on scraping linkedin? feasable at scale?

Trending on Indie Hackers
6 weeks solo, 2 rejections, finally live but nobody told me marketing would be this hard User Avatar 139 comments I spent more time setting up cold email than actually selling. Here is what fixed it. User Avatar 35 comments I just wanted to taste AI coding tools. A week passed. User Avatar 24 comments I built a PDF API because every team I know has a haunted corner of their codebase they never want to open User Avatar 17 comments Building LinkCover – Day 3: Payment is live. No more building, time to sell. User Avatar 16 comments I built an AI that ruthlessly roasts your competitors based on their 1-star reviews. User Avatar 11 comments