To a medium saucepan, add light brown sugar, white sugar, water, ginger, cardamom, allspice and black peppercorns. Bring the mixture to a boil over medium heat, stirring to dissolve the sugars. Reduce heat to low and simmer for 15 minutes. Take the mixture off of the heat and let sit for 1 hour.