I want to automatically toggle alarms on/off during specific periods of time so that they do not fire during maintenance windows. I\'m doubting that an easy or direct method
It's not automatic but it can be done:
http://docs.aws.amazon.com/AmazonCloudWatch/latest/APIReference/API_EnableAlarmActions.html
What you want to do is: right before the maintenance window starts you Disable the alarm actions. As the windows ends you Enable the alarm actions.