I think Uber's biggest problem is the broken relationships it has with so many of it's drivers. Their abuse of their labour force is the reason unions exist.
It is a broken relationship that would be hard to fix. Uber doesn't even try to hide its intention to get rid of the drivers once it has its self driving cars fully deployed