Absolutely agree. Patents grant you exclusive rights on public knowledge, much the same way a deed gives you exclusive rights to a piece of property. People are forced to pay property tax equivalent to its value for that exclusive right, patent holders should have to do the same.

Furthermore, valuing patents and taxing them accordingly help create a feedback loop that can help in determining reasonable licensing costs or damages for infringement.