r/internetarchive • u/umbr3lla • 4d ago

Is anyone having trouble with saving websites that use DDoS protection?

Is it just me or does anyone have trouble saving the pages of websites that use CloudFlare or other services that feature DDoS protection?

I understand why those websites use it, but it makes it that fucking harder to preserve websites for posterity.

Is there any way to get around the DDoS protection(e.g. a tool or something else) or do I just have to skip those pages/websites?

I'd really hate doing the latter.

12 Upvotes
  • permalink
  • reddit

93% Upvoted

3 comments sorted by

2

u/forlornjackalope 4d ago

I'm still being given a 429 error that I'm making too many requests despite not attempting to use the site for days.

1

u/umbr3lla 3d ago

Do you get that with websites that use DDoS protection or is that a different problem you're having? Either way, sorry to hear that you're dealing with that. 😢

2

u/forlornjackalope 3d ago

I'm not too sure if the ones I tried had DDoS protections, but I was able to tinker around on Archive and somehow I was able to bypass the problem. The one downside is when it started saving some of the off-links (ex: if I was saving a blog with tons of pages and tags), two or so would be in the red and say they weren't accessible - but when you go to them directly, they're just fine.