A big help could be sorting files by extension, and sorting by filename. For example, the same file name in many sub-directories is probably going to have similar content. For example:

a/index.txt b/index.txt a/img/index.txt a/img/logo.png a/img/test.css a/foo.css

Edit: this is what mannschott's script does.