Compared to Ext4, I've always found XFS more consistent performance wise. Plus it doesn't require a monthly FSCK which strikes you when you least want it. (Though Ext4 made this way faster than Ext3). XFS also gives you reflink - which is a game changer for some OPs tasks and backups.
It does not require a monthly fsck. I've set mine to once every 6 months. Been running like that since 2006 or so on many systems. Just do: tune2fs -i 6m /dev/path/to/device