NSS Labs Hits Back at FireEye 'Untruths'

  • Tweet  
  • LinkedIn  
  • Facebook  
  • Google plus  
  • Send to Kindle
  • Send to  

A war of words has erupted between FireEye and an independent testing house that questioned the vendor's ability to catch malware.

fight-pa

A war of words has erupted between FireEye Inc. and an independent testing house that questioned the vendor's ability to catch malware.

NSS Labs handed FireEye (NASDAQ:FEYE) a "caution rating" in its first ever comparative analysis of breach detection systems (BDS) after its box scored a "below average" security effectiveness rating of 94.5.

Related articles

All but one of the other vendors tested scored more than 98, with Fortinet Inc., Sourcefire Inc. and Trend Micro Inc. all scoring 99 or more.

NSS said its findings helps end users cut through the vendor marketing fluff in what is a "rapidly evolving" market.

In a forceful blog, FireEye product boss Manish Gupta moved immediately to discredit NSS Labs' findings, claiming its methodology was "severely flawed." The FireEye product the NSS used wasn't even fully functional, used an old version of its software and did not have access to its threat intelligence, Gupta said.

But this was like a red rag to a bull for NSS Labs, whose founder Bob Walder last night responded with an equally robust blog designed to address "a number of untruths and misdirections" in Gupta's missive.

Walder responded to Gupta's claims one by one, saying many were untrue, including that the product it tested was indeed a fully functional product installed and configured by FireEye engineers.

According to Gupta, FireEye insisted the only way to properly test was to run in a real environment, but that the NSS declined to change its testing methodology.

Walder, however, rejected this version of events. He claimed NSS Labs does use a live environment "with real PCs going to real, live malicious URLs." Walder confirmed FireEye did ask for it to change its methodology, but claimed this happened only after it saw the results, something the NSS "clearly cannot do."

"In the grand scheme of things, FireEye's results were not that bad," Walder said. "The real issue here is that FireEye now has credible competition in the BDS marketplace, and the data from this NSS test shows it."

Walder said it was rare for NSS to respond to criticism from vendors that have performed poorly in its tests, although a similar spat with WatchGuard Technologies Inc. erupted last year over its next-generation firewall report.

For more channel coverage from CRN UK, visit channelweb.co.uk/.

  • Tweet  
  • LinkedIn  
  • Facebook  
  • Google plus  
  • Send to Kindle
  • Send to  
More on Channel Business
Man spending cash

HP: CPGs spending more on IT

Giant examines changing IT needs and CIO roles in CPG market

iceberg-arches-melting-into-freezing-blue-sea

What do global warming, evolution and waning partner loyalty have in common?

Partners won't stick around forever if they're unhappy

Handshake in London

Lenovo reshuffles line-up of top execs

Vendor announces new corporate president amid a management rejig

anonymous

CompTIA Business Model Benchmark in need of more granularity

Partner says use of anonymous participants could hinder initiative

Visitor comments
Add comments
blog comments powered by Disqus
In-depth
technology-doctor-healthcare

Prevention vs. cure: Dealing with security breaches

U.S.Secret Service agent says focus needs to shift from prevention to incident identification

Three shrubs in a row each larger than the other

Microsoft, SkyKick make long-term Office 365 channel play

Microsoft and SkyKick launch a strategy to get — and keep — partners on the cloud-based productivity platform

america-new-york-web

Coming from America: Overseas expansion in vogue

Scality’s new operation in Tokyo draws attention to the ‘going global’ trend

iceberg-arches-melting-into-freezing-blue-sea

What do global warming, evolution and waning partner loyalty have in common?

Partners won't stick around forever if they're unhappy