Allspice is such a winner. The whole plant is a nice thing.
Not a spice, but gin berry has a very nice flavor like an alphonse mango, it's a treat.
Have you tried using the berries from the eastern cedar trees? I found them very appealing in stews. It has a light resin that holds up under long cooking, and late additions give pineapple esque fruityness.