To expand on this, if you do the quest Pam gives you about securing a cache for them, then talk to Tinker Tom afterwards, he'll show you how to mod lots of clothing to be armoured - think I'm getting something like 110 ballistic and energy damage resistance off my military fatigues, and I've armoured up my charisma boosting clothes too. It can be a bit random what you are and aren't allowed to improve, though.