I am having the exact same problem. Its fine if im playing with keyboard and mouse, but if the controller is enabled the cursor on the pip boy map stays at the top and will only move left and right. The only way around this that i have found is turning the controller off in settings doing what you need to do on the map with the mouse and keyboard then turning the controller back on. Very frustrating!