This is a good insight. I don't think Kimmel should be pulled for either meaning, but it does help explain why some people might be talking past each other.
To be fair, even if I'm right, I don't think I'm going to convince anybody who wants to interpret it the other way. The difference is large semantically, but subtle linguistically.
