I'm outside my edit window but I'm surprised at the negative reaction to this.
This experimental process on small NNs us exactly how science is done. You develop and test theories of what will work using small networks because you can do them quickly.
Then you test on large, production size networks based on the lessons from the small ones.