In a small, heavy bottom pot, combine water, sugar, sliced ginger and halved vanilla bean. Bring mixture to a boil, stirring until sugar is dissolved. Drop the heat to medium-low and let simmer until ginger is soft (about 15 minutes). Remove from heat and let cool. Do not strain!
Using a vegetable peeler, cut long strips of orange zest into a large, airtight jar. Be sure to avoid the bitter white pith. Pour in brandy and cooled syrup (with ginger and vanilla bean). Seal the jar then shake to combine. Store in cool, dark spot.
Let the mixture steep for 1 day then remove the vanilla bean. Let steep for another day then remove the ginger and orange zest. Let rest for 1 last day then stir in the orange blossom water.