Subscribe to RSS - Solutions Accuracy

Solutions Accuracy

For most IT solutions, at least the functional benefit, even if not always the business one is clear. An e-mail or accounting system performs according to its spec, give or take a few bugs. For many security solutions, this is far from true as specifying their exact functionality is not trivial. What exactly to they do to protect you? How effective are they in doing so? Those questions are hard to answer and a whole industry of benchmarking has emerged to try to address this gap.

In this section we will seldom touch only accuracy of the solutions, but rather focus on analyzing the techniques for measuring those accuracy, scrutinize the methodology used and the validity of interpretation.

Will academic security research provide the answer?

Submitted by Ofer Shezaf on 20 November 2011 - 9:41pm
Share/Save

Industry research such as Larry Suto’s is often superficial and at times driven by external motivations. So where should we derive our research data from? While one answer may be to forgo with research data all together, another option that comes to mind is academic research. An academic paper comparing vulnerability discovery techniques that I encountered is a good test case for that...

Suto strikes again, or getting the desired results regardless of data

Submitted by Ofer Shezaf on 17 November 2011 - 11:37pm
Share/Save

Larry Suto, who brought scanners wars 1 and 2 has published a WAF effectiveness research. As usual, Larry’s work is fun to dissect. While Larry’s research is not worse than your average analyst’s work, he does try to base his conclusion on more concrete and pseudo-scientific research making it much more vulnerable to scrutiny.

How can one evaluate none perfect security solutions?

Submitted by Ofer Shezaf on 16 November 2011 - 7:05pm
Share/Save

Amichai Shulman, Imperva's CTO presented in Source Barcelona today an innovative solution for detecting men-in-the-browser attacks by the web server itself. The interesting aspect of the solution is that it relies on logic that goes unencrypted through the attacker code. As such, there is no way to prevent the attacker from interfering and therefore bypassing detection.

Is any security tool perfect?

Submitted by Ofer Shezaf on 9 February 2010 - 10:48pm
Share/Save

Larry Suto, an application security consultant, publish a sequel to his 2007 best seller research about web application scanners. In the first round Larry managed to ignite quite a controversy and drew a lot of criticism from the loosing vendors. The reason is simple: Larry found out that the scanners do not perform as well as advertised.

The curse of PCI for WAFs

Submitted by Ofer Shezaf on 11 January 2010 - 12:30am
Share/Save

An enlightening case study presented by ArgoWorks, an Armorlogic reseller, highlights the benefit that PCI brings to the WAF market but also the its curse.

When asked why he bought a WAF, the director of application technology at Southern Utah University admitts that the reason was PCI. PCI is a very common reason for implementing a WAF and as such is usually considered as a boon to the WAF market. 

A New Year, a New Acronym

Submitted by Ofer Shezaf on 9 January 2010 - 11:28pm
Share/Save

DragonSoft from Taiwan has introduced what they label a "Personal Web Application Firewall". The new product is essentially a low cost IIS plug-in and the "personal" label refers to the price rather than to some desktop protection. Since the press release itself mentions that the product is signature based, we at Xiom classify it as an IPS and not as a WAF in our product directory.

ModSceurity 2.5.11 fixes an evasion vulnerability

Submitted by Ofer Shezaf on 9 November 2009 - 7:53am
Share/Save

Breach has release a new version of ModSecurity which fixes a vulnerability that may lead to an evasion. As stated in the release announcement sent to the mailing list by Brian Rectanus, by using non-standard (but accepted by some platforms) quoting, ModSecurity may be fooled into thinking some parameters are uploaded files.

The vulnerability was presented by  Stefan Esser at POC 2009 in Seol and not posted online yet.

New WAF bypass method take advantage of comment anti-evasion

Submitted by Ofer Shezaf on 3 November 2009 - 6:07pm
Share/Save

A new blog post by Dmitry Evteev shows how an obscure MySQL syntax can be used to bypass ModSecurity signatures. The interesting thing is that the new technique actually takes advantage of a ModSecurity anti-evasion measure. ModSecurity rule set ignore MySQL comments in order to detect attacks that is split using a comment: