That is neat. Just for fun I tried to figure out how to set up Caffe on EC2. I got it to work, but I didn't get CUDA up and it probably would have been faster with Anaconda. But for what it is worth: here are my current notes https://github.com/JohnMount/CaffeECSExample