Well, if you don't take the contract perks, you're still be fine in lategame, just enchant your itens with fortify destruction and use dreamcloth. The description of contract perks are wrong, you still can cast other elements spells, but with 90% nerf to damage and duration. Also, fire(with perks) deals extreme damage in skyre, much more than ice and shock.