Community Manager Demorphic Posted March 28 Community Manager Share Posted March 28 On 3/28/2025 at 4:50 PM, Glitchfinder said: It's no longer random, for one. The entire point of a random sample is to eliminate sampling bias, so adding a sample bias back in after randomly selecting users will affect the results. The actual impact on the survey can only be guessed at, because there is no control group we can compare against to see what eliminating the more tech savvy users from survey responses would change in the results. Expand As a premium user / mod author you don't see ads on the site, but I understand many users will have popups blocked by default. Link to comment Share on other sites More sharing options...
kat1004 Posted March 28 Share Posted March 28 On 3/28/2025 at 4:54 PM, Demorphic said: As a premium user / mod author you don't see ads on the site, but I understand many users will have popups blocked by default. Expand The popup search window is unwieldy and unpleasant to use. Please at least consider an option to switch back to the way Quick Search used to function. 4 Link to comment Share on other sites More sharing options...
Community Manager Demorphic Posted March 28 Community Manager Share Posted March 28 On 3/28/2025 at 4:39 PM, showler said: One thing is that if I open the quick search and type "witcher" then the results appear in the overlay window. If I type "witcher" and hit enter, the results appear in a "search results" page. And if I open the quick search and click on my previous search of "witcher" then the results also appear in the "search results" page. There appears to be no way to stay in the quick search overlay while re-using a previous search without re-typing it and avoiding hitting enter. Expand Yep, this is true, hitting a recent search takes you out of the quick search to the search results page. I can further refine it by hitting the "view all" on the right hand side. It is a different approach though, you are right. Link to comment Share on other sites More sharing options...
showler Posted March 28 Share Posted March 28 On 3/28/2025 at 4:50 PM, Glitchfinder said: It's no longer random, for one. The entire point of a random sample is to eliminate sampling bias, so adding a sample bias back in after randomly selecting users will affect the results. The actual impact on the survey can only be guessed at, because there is no control group we can compare against to see what eliminating the more tech savvy users from survey responses would change in the results. Expand All surveys have biases like that. A phone survey only selects people who have a phone and are willing to answer it. An in-person survey at a mall only selects people who are at the mall and willing to answer questions. And a survey that pops up for every person who visits Nexus Mods for a week will only select people who visit during that week and are willing to fill out the survey. The question is whether the selecting factor invalidates the results. And there is no evidence that whether or not someone blocks hotjar has any bearing on whether or not they like the new site. People seem to be objecting to the results of that survey simply because it doesn't agree with their expectations. And those expectations are largely the result of the complaints they see in this thread, on Discord or on Reddit...despite the clear fact that those results are much more biased in a way that definitely skews the results. Link to comment Share on other sites More sharing options...
Glitchfinder Posted March 28 Share Posted March 28 On 3/28/2025 at 5:50 PM, showler said: The question is whether the selecting factor invalidates the results. Expand Yes, probably. We can't actually know without better controlled data, but it would be reasonable to assume that power users (e.g. repeat customers) are more likely to be higher frequency internet users and thus more likely to be excluded from the sample by being unwilling to answer a survey on a site that requires them to disable their adblocker. Edit: Just to be clear about my reasoning here: This is a modding website. Gaming is already a hobby that trends more towards the technologically-inclined, and modding your games trends even harder towards the more technically inclined. There will be a much stronger correlation between "People who frequently mod their games" and "people who use adblockers while browsing the internet" than there will be between "people who regularly browse the internet" and the latter, or "people who frequently use computers" and the latter. By taking survey data that penalizes that correlation, Nexus is likely skewing the data towards casual visitors who visit the site infrequently, and away from users who regularly use the site and are thus more likely to directly contribute via membership subscriptions. If I were to take an uncharitable perspective, this skew could be interpreted as deliberate due to the nature of advertising and how it helps support the site, but I doubt that is something they would have actively chosen to do. 2 8 Link to comment Share on other sites More sharing options...
kat1004 Posted March 28 Share Posted March 28 On 3/28/2025 at 5:50 PM, showler said: All surveys have biases like that. A phone survey only selects people who have a phone and are willing to answer it. An in-person survey at a mall only selects people who are at the mall and willing to answer questions. And a survey that pops up for every person who visits Nexus Mods for a week will only select people who visit during that week and are willing to fill out the survey. The question is whether the selecting factor invalidates the results. And there is no evidence that whether or not someone blocks hotjar has any bearing on whether or not they like the new site. People seem to be objecting to the results of that survey simply because it doesn't agree with their expectations. And those expectations are largely the result of the complaints they see in this thread, on Discord or on Reddit...despite the clear fact that those results are much more biased in a way that definitely skews the results. Expand So then have Nexus run a real poll, one that isn't based on an untrustworthy website that adblockers, not users, have deemed unsafe and blocked. One that everyone, not just a fraction of a percent of users, can answer. Have it locked so only logged in users who have existed for more than... say, a couple days to a couple weeks can fill it out, so there's a guarantee that only real accounts can answer the poll in order to minimize poll fraud (users filing out the poll multiple times. And display the results publicly so that people don't get upset at the utter lack of real transparency - which is a lot of our issues with the HotJar poll outside of it being an untrustworthy site. There seems to be no transparency. If a real poll shows similar results, I'll still be upset at the drastic drop in usability, but I'll shut up and take it (and use Stylish... which really shouldn't be necessary to make a site usable for the majority but here we are) and I'm sure a lot of other people would too. 5 8 Link to comment Share on other sites More sharing options...
craeteeee Posted March 28 Share Posted March 28 It feels hard to give specific feedback when the entire thing is amateurish and poorly thought out, and it seems like a lot of effort is being wasted to bring this back up to the old interfaces functionality. 2 1 Link to comment Share on other sites More sharing options...
DeltaAriadne Posted March 28 Share Posted March 28 Where's the proof the hotjar survey even took place? I found almost nobody, on here, the nexus/skyrim mods/fallout mods subreddits, or the Discord channels, that even knew about it, let alone voted on it. edit: Which begs the question: If Nexus, supposedly, got thousands of votes, positive ones, from the survey, who were they from? Bots? Random people that maybe use the site for a day per month? As Glitchfinder said, modding games trends toward the technologically-inclined, and anyone who is technologically-inclined is going to have an adblocker, and thus be unaware the survey even took place. 2 7 Link to comment Share on other sites More sharing options...
showler Posted March 28 Share Posted March 28 On 3/28/2025 at 6:24 PM, DeltaAriadne said: Where's the proof the hotjar survey even took place? I found almost nobody, on here, the nexus/skyrim mods/fallout mods subreddits, or the Discord channels, that even knew about it, let alone voted on it. Expand If you don't believe them then you'll never believe anything they say. Why bother even interacting? However, there have already been people in this thread who said they saw it. Link to comment Share on other sites More sharing options...
DeltaAriadne Posted March 28 Share Posted March 28 On 3/28/2025 at 6:35 PM, showler said: If you don't believe them then you'll never believe anything they say. Why bother even interacting? However, there have already been people in this thread who said they saw it. Expand Yes, that's why I typed "almost". There have been a couple ppl who have said they saw the survey. A couple people. And who knows, they might have been your alts. You've gained a reputation for defending this UI change at all costs, to the point I'm left wondering if you, secretly, are the actual designer lol. Just kidding. I know it's pointless to respond to you, so this will be my final reply. 2 3 Link to comment Share on other sites More sharing options...
Recommended Posts