SSE How about creating a Gem Merchant?

[Surfrider4u]

You could create a mod that creates a traveling gem merchant and bodyguards. They travel only to the villages, towns, and Inns where the Khajiit caravans do not go.

Of course, you could also have the gem merchant stationary. They could have a small hut-like structure, that makes mobility inside that hut very restrictive. Hence, if the bodyguard were an orc with hand axes or daggers, that has the perk dual weapons, he would be formidable.

Each merchant would be independent of each other, but there would be a lucrative trade network between all of them. Players could handle transactions between other merchants, with bandits and/or creatures ready to waylay them somewhere on their journey.

One could trade or barter for gems of all sorts for some elevated prices, depending on your Speech perk.