As long as it just a couple degrees gradually, I wouldn't be worried. You definitely don't want it dropping more then a couple degrees though, especially not rapidly.
It's a chart of the water temp, by season, in fiji. It's pretty interesting to see the varying temperatures that coral species we keep endure in the wild.