This is cool, especially because its already 6 years old and I think not much has changed. Can anyone here speak to the current SOTA of explaining whats going on inside a neural net?

If we go: problem -> nnet solution -> explanation of nnet -> insight into problem that would still be very significant to the scientific process.