Watching "Deadliest Catch", if the water is warmer, they can go deeper if they need it cooler (at least that's what Bering Sea crabs do). If it gets too cold, reef fish would have to adapt to something they can't adjust for by going shallower without running out of water column.
Warmer is better, if you have to choose.