Well you could make the system(s) themselves report the truth and take the human analyst or supervisor out of the loop completely.
For the rest, there's all sorts of possibilities; 2-man concept, independent review by a supervisor, randomized blind audits by auditors who are themselves double-checked by randomly assigned auditors, periodic audits & surveillances of the analysts themselves to ensure procedural and policy compliance, the list goes on and on. There's not exactly a shortage of government agencies that can be raided for "best practices".
But... I think the reason I have to beg people to not dismiss the idea out of hand is that the conclusion is already mostly formed for many of us. Certainly I would hope that our default reaction to hearing that a massive Internet surveillance program is going on would be WTF??!. But that doesn't stop me from wondering if it can actually be done in a way that does not endanger free society and still protects individual liberties.
And even if it can be done, it would still need to be shown that it's useful to do. But I think many of us have foreclosed on the very idea.
I do want to appreciate your attitude here. I'm sure all those things you mention can and would be gamed, but at least you try to keep fighting instead of giving up. Reading some comments about the PRISM case on HN makes me feel like we should just lay down and die while the world shreds itself apart.
For the rest, there's all sorts of possibilities; 2-man concept, independent review by a supervisor, randomized blind audits by auditors who are themselves double-checked by randomly assigned auditors, periodic audits & surveillances of the analysts themselves to ensure procedural and policy compliance, the list goes on and on. There's not exactly a shortage of government agencies that can be raided for "best practices".
But... I think the reason I have to beg people to not dismiss the idea out of hand is that the conclusion is already mostly formed for many of us. Certainly I would hope that our default reaction to hearing that a massive Internet surveillance program is going on would be WTF??!. But that doesn't stop me from wondering if it can actually be done in a way that does not endanger free society and still protects individual liberties.
And even if it can be done, it would still need to be shown that it's useful to do. But I think many of us have foreclosed on the very idea.