Consistent problem downloading 1k+ mod collections

[CH41NSM0K3R]

Long time user, consistently get error 429 when downloading large collections with over 1k mods. I’m not going to lie, it’s getting very hard to continue paying for a premium membership that doesn’t respect my time, nor money. It’s hard not to see it this way when I’m 69gbs into downloading a 89gb collection for HOURS OF MY TIME then install to stop and have to wait and delete the ENTIRE collection until 24 hours later just because I downloaded a few gbs of mods for Daggerfall Unity before hand. I’m tired of paying for something that ISN’T UNLIMITED AS ADVERTISED. I’ve put up with this for YEARS, it’s time to fix this; or I’ll happily keep my money. I mean all this respectfully, ask for that respect back.

[showler]

Who advertised it as unlimited?

You're likely hitting the API limit.  What I'm wondering is why you're deleting the Collection instead of letting it continue the next day?

[Dark0ne]

I can see from your download history that you have downloaded from 1,700 unique mod pages today. Could you let me know what Collection you were attempting to download please? I'll then get the Community team to run some tests when they're back in the office next week and see if (1) we can replicate it and (2) what is going on, and we'll go from there.

[CH41NSM0K3R]

2 hours ago, Dark0ne said:

I can see from your download history that you have downloaded from 1,700 unique mod pages today. Could you let me know what Collection you were attempting to download please? I'll then get the Community team to run some tests when they're back in the office next week and see if (1) we can replicate it and (2) what is going on, and we'll go from there.

https://next.nexusmods.com/skyrimspecialedition/collections/9zfscf

[CH41NSM0K3R]

3 hours ago, showler said:

Who advertised it as unlimited?

You're likely hitting the API limit.  What I'm wondering is why you're deleting the Collection instead of letting it continue the next day?

I’m not going to entertain an argument over your first question, but to answer the second, it’s because the install stalling out mid with the API 429 error completely breaks the collection install.

[showler]

It shouldn't.  Even if you stop the install, when you try it again the next day it should merely confirm all the existing downloaded files and not attempt to redownload them.  

[CH41NSM0K3R]

1 hour ago, showler said:

It shouldn't.  Even if you stop the install, when you try it again the next day it should merely confirm all the existing downloaded files and not attempt to redownload them.  

I get a bunch of vortex errors, and mod dependency errors when this happens, the collection creator mentions if it correctly installs there shouldn’t be any errors in vortex, any time I’ve attempted this same collection in the past simply resuming instead of fully downloading and installing in one session always results in issues. I’m not an expert on this, and not sure why; but something always screws up when this happens mid install for me.

[Pickysaurus]

As Dark said, we'll do a bit of testing next week. However, it's a common misconception that you have to wipe the entire collection to resume it. It most cases you can just resume the install. Most of the errors are just because the collection hasn't finished installing. In a worst case you can remove all mods (but not the archives) to start over. That way when you do restart the process Vortex will see it already has a bunch of the files and won't redownload them (avoiding the use of more API requests!) 

[Pickysaurus]

We did some testing today and noted that downloading a collection of this size will burn through a big chunk of your daily quota. So doing it multiple times in the same day will cause you to hit the rate limits. 

We're looking at the test data internally and will see if this is expected/if there are any changes we want to make to accommodate this level of downloading. 

As I mentioned before, the best way to avoid this in the short term is not to delete any archives from Vortex so it doesn't have to redownload mods you already have on your PC.