For those that are interested, Jon Handler posted a nice walk-through for Alerting here: Set an Alert in Open Distro for Elasticsearch | AWS Open Source Blog
There is also some cool sample code referenced that he uses to generate sample data.
Thanks!