Ability to remove charms?

[MaxHaydenChiz]

It seems like once you have used the add all charms feature, you are now stuck with all the charms in the game. Is there a way to add only specific charms or un-add charms after you've used add all?

You are able to do this with items and inventory. So is this a technical limitation or just something without much of a use case?