Learn More
Resend Email
35
PonySlaystation
4y

Ah yes, write your own fucking website crawler in PHP and deoptimize so hard that it uses some gigabytes of RAM and takes about 1 hour to crawl the very own website it's running on.
Oh and don't forget to download every single image and video file in order to "crawl" it for extremely valuable text content.
What a genius move! I'm really impressed.

rant

cmsofdoom

phptsd
Favorite
Ranter
Comments
  • 3
    4y
    I wrote one, three orders of magnitude faster though.
  • 3
    4y
    Did exactly that - was a pretty profitable business back then...
  • 2
    4y
    As the others said, this _would_ have been a cool project about 10-15 years ago.

    Building one from scratch in 2022? 🚩🚩🚩🚩🚩🚩🚩🚩🚩🚩🚩🚩🚩🚩🚩
  • 3
    4y
    Hmm good challenge, it will go to my todo list
  • 2
    4y
    Fond memories of raspberry farms with 3G modems...

    PHP, curl, regex for HTML parsing.

    Perfectly illegal
  • 1
    4y
    @IntrusionCM but for what? Scraping as a Service?
Related Rants
devRant © 2021 Hexical Labs LLC
Privacy Policy  |  Terms of Service
Add Comment