It turns out there was a permission error in the C:\Users\<username>\AppData\Roaming\Vortex folder.
I found this out by opening Vortex, removing the extensions, and instead of clicking restart, I exited the app and restarted it as administrator. The extensions did work for a moment and then it failed.
The error showed that the files existed, but permission to some of the files where denied.
So, I made a list of the files that generated the error.
Then, I uninstalled Vortex. Deleted the files in the C:\Users\<username>\AppData\Roaming\Vortex folder, (yes, I made a back up), and then reinstalled it.