I find it weird that you'll get a rank of legate but somehow can't assert authority to those below you. I'm thinking of maybe get a few and basic conversation/action with imperial soldier npc to do like patrol, stay here, guard, report. Something like that, that doesn't require them to be your follower.