I want to automatically toggle alarms on/off during specific periods of time so that they do not fire during maintenance windows. I\'m doubting that an easy or direct method
Yeah, just as above you can do it using CLI. Also, you can stop sending data from scripts INCASE of custom metrics so that will automatically stop the alarm.
Another way is you can write a script where you can have defined alarm using put-alarm (CloudWatch CLI ). There could be a function that creates alarms and one that deletes them. Call them when needed.