Theres a tiny limit on the amount of off-the-tree ripening that will occur, and they are really difficult to "read" on the tree to know when they are ripe. Each variety is different. The key for good mango is to let them go further than you would think on the tree and hopefully the birds dont beat you to them.

Source: moved into a house with several mango trees and am now pretty good at harvesting.