Brawls not starting after dialogue says that it should

[DragonLedak]

So I started a new character and am at an orc stronghold. I talked to the chief and chose the brawl option. He took my money but did not start fighting. Any ideas to fix this, same thing happened to the orc that can be your follower, I asked him to brawl he accepted but no brawl commenced.