Bring spices, ginger, and water to a boil. Reduce to a simmer until liquid becomes aromatic, about 15 minutes. Whisk in sugar, then add tea bags; turn off heat and let steep 3 minutes.
While tea is steeping, warm a serving pot by rinsing several times with very hot water. Strain tea mixture through a fine strainer or a coffee filter into pot. Heat milk over medium heat until just simmering. Whisk until frothy. Pour into serving pot, stirring well to combine.