Heat water, sugar, and cinnamon in a saucepan over medium heat. Simmer until sugar is dissolved, whisking occasionally, about 5 minutes. Allow mixture to cool for 10 minutes.
Pour rice milk into a large pitcher.
Stir sugar water into rice milk. Serve chilled or over ice.
