CaptainSparkelz wrote: Why won't you guys upgrade your servers instead of shutting them down as soon as the load gets too high? For over a week now I've been unable to enjoy the convenience of downloading mods via NMM all because you keep shutting the servers down.
If it's a money issue I understand, but since your servers are sort of the most important thing that you currently own when it comes to maintaining your services. Logically that is where your priorities should lie.
Ethreon wrote: Did you really post this nonsense?
Dark0ne wrote: The issue isn't actually with the servers perse, it's with our code. So what we really need is more time, rather than more servers.
CaptainSparkelz wrote: Ahh, alright, I understand. Know that I wasn't trying to be a prick or anything with this, it's just I can get a little impatient sometimes. I appreciate the work you guys all do though, so don't take this post the wrong way.
slbrgt wrote: Let me start by saying that I really appreciate the work done by those who manage these nexus sites. It’s definitely the best thing that happened for modders and mod users of the supported games. I understand that the massive interest for SkyrimSE mods presents some challenges for hardware and software. On the other hand I also understand the OP’s message. It’s frustrating and annoying that still today it’s virtually impossible (for me in any case) to connect to nexus and download SkyrimSE mods. With the exception of hours when most people are either working or sleeping.
Meatster wrote: From what I gathered you can just download the mods manually and add them to nmm. simply add manually then choose the mod rar/zip file. Then when nmm will let you log in again you can update the ID of the mod.
That's how I think it works at least, please correct me if i'm wrong.
Edit: Also totally offtopic but a delete button for comments would be awesome.
Voldearag wrote: If there were deletable comments then nobody could be held accountable for anything they said, posts like CaptainSparkelz's up there would disappear as soon as they started getting negative feedback, and most arguments would vaporize after or before their conclusions, restricting the contenders and readers from learning from them. Short version: Anything we put on the internet becomes the internet's property, posts included. Edit: Then again there's an edit button and that's pretty close.
Castironwolf wrote: @Dark0ne. Beyond us (end users) needing to have patience...ironically this reminds me of the panic on Reddit whenever Fallout updates and FOSE goes down, people go bezerk and quite possibly cry...but I digress. Is there or are there things we can do to help you with the coding/code (stuff even I the IT in the IT Crowd don't comprehend)? I am a bit out of touch with torrenting these days but I do know Blizzard still uses a similar process for downloading. I may be in left field on that, but it could alleviate the overload....no wait I am in left field. sighs, one moment you think you know what's going on and then the internet waves as it goes happily by. Anyway, if we can help, drop us a line. Thanks.
SkyrimPsycho wrote: funny... the code has worked for many years without issues. The errors I have been seeing do not apply to coding. They apply to bandwidth. I can only assume you use some third party for your server hosting. Probably godaddy, cloudflare or some other third party hosting service. I know it is painful Dark0ne, growth usually is. You should check into purchasing your own server instead of using a third party server. Right now NMM is shut down but people are still using the website and downloading, which means your bandwidth is still being used constantly and your server hosting provider will tolerate a little more before they start putting bandwidth limits on your account. I am already seeing it. I have clicked a few links in your website only to be taking to a bandwidth limit page.
Dark0ne wrote:
funny... the code has worked for many years without issues. The errors I have been seeing do not apply to coding. They apply to bandwidth. I can only assume you use some third party for your server hosting. Probably godaddy, cloudflare or some other third party hosting service. I know it is painful Dark0ne, growth usually is. You should check into purchasing your own server instead of using a third party server. Right now NMM is shut down but people are still using the website and downloading, which means your bandwidth is still being used constantly and your server hosting provider will tolerate a little more before they start putting bandwidth limits on your account. I am already seeing it. I have clicked a few links in your website only to be taking to a bandwidth limit page.
The code hasn't worked for many years. We had stability issues until we sorted our database cluster out in 2015, something you wouldn't know as you only joined the site 2 weeks ago. Our code and cluster has never been tested with this much traffic before. We're currently seeing a 50% increase in traffic on our previous highest traffic time (FO4 launch) and a sustained 75% increase on our normal traffic conditions. We're up from 11,000 active users a second to 19,200 active users a second.
We have 13 cloud-based VMs with a total of 104 CPU cores and 320GB of RAM serving the site front-end. A database cluster of 5 dedicated servers with a combined total of 160 CPU cores and 960GB of RAM (yes, 960GB of memory) handling database operations. And almost all our files are served via a global CDN that's currently pushing an average of 15 Gbit a second (and is burstable to 100Git+). That's not even mentioning the multiple firewalls, DDoS protection, load balancers and so on and so forth that we utilise.
So when I say it's a code issue, it's a code issue. Don't try and call me on it when I obviously know a lot more about it.
RE: any bandwidth errors you may or may not have seen, our load balancers were capped at 300mbit/sec on our end, mainly to ensure we don't send more traffic to the VMs and cluster than they could handle. We've since upped that cap to 500mb/sec. That's completely unrelated to our CDN and file serving.
rblood01 wrote: Thank you Dark One and your crew. I was able to log on in NMM and do some basic updates and downloads through the system (the preferred way) tonight. Thank you for the efforts and updates so that we can get the mods we so love easily and quickly.
Castironwolf wrote: @Dark0ne. wow, I mean wow. that's impressive. That was an awesome explanation. One day, I hope to be that smooth. I mostly just sit at my desk and ask them if they have turned it on and off again. Then tell them that they must have broken the internet and to call back tomorrow.
Even if upgrading the server capacity would fix current issues it doesn't mean it makes sense to do so. Skyrim SE just launched, so there is a huge influx of people downloading lots of mods, as they're all starting from scratch. I'm almost 100% that in a month the site traffic/download rate will be much closer to what the servers are used to handling.
Various Nexus related things from the Skyrim SE launch aftermath
in Site Updates
Posted