Oh god, I wish I had that problem. He would be like a nemesis or something. Maybe that would be reason enough to load your file up...? My longest fight... was probably with the Gray Prince. I hesitated really long before fighting him. He wouldn't fight back, and refused to win improperly. Turns out, though, that he'll fight back if you have Deadly Reflexes and punch him in the face.