PvP Gems are granted for enemy kills in PvP, and from the PvP Chest. You can spend these in the PVP Shop to buy Hero Fragments and items.