It's not clear that shipping the sugar to where the cacao is, then shipping refrigerated chocolate is any better than shipping unrefrigerated cacao mass to the North where it's milled with sugar.
Especially if you look at grid emissions in all those countries. Transport uses energy, but so do milling, tempering and packaging.