Hmm every job I have had uses points this way. I find points discussions particularly mind numbing and have no love for them but I also can see the utility. What is the alternative?
When it ceases to be a useful tool to stay organized, and becomes a burden, it's very frustrating. The alternative is to use the tool when it helps you and ignore it when it's not.