Solutions Accuracy
For most IT solutions, at least the functional benefit, even if not always the business one is clear. An e-mail or accounting system performs according to its spec, give or take a few bugs. For many security solutions, this is far from true as specifying their exact functionality is not trivial. What exactly to they do to protect you? How effective are they in doing so? Those questions are hard to answer and a whole industry of benchmarking has emerged to try to address this gap.
In this section we will seldom touch only accuracy of the solutions, but rather focus on analyzing the techniques for measuring those accuracy, scrutinize the methodology used and the validity of interpretation.