Web scraping can be extremely tricky. Especially when the pages you are scraping are constantly changing. AI might be able to help!
I used the techniques described in this article to help parse all sorts of job postings on https://magicinterviews.com