Combine all ingredients in a large pitcher or punch bowl. Stir to mix. Cover and refrigerate at least 2 hours, or up to overnight. If chilling for longer, omit the orange slices until at the latest 24 hours before serving.
Divide the punch into glasses. Garnish with a rosemary sprig, an extra orange slice, and some cranberries, as desired.