NSS Labs Hits Back at FireEye 'Untruths'

A war of words has erupted between FireEye and an independent testing house that questioned the vendor's ability to catch malware.

  • Tweet  
  • LinkedIn  
  • Facebook  
  • Google plus  
  • Send to Kindle
  • Send to  
fight-pa

A war of words has erupted between FireEye Inc. and an independent testing house that questioned the vendor's ability to catch malware.

NSS Labs handed FireEye (NASDAQ:FEYE) a "caution rating" in its first ever comparative analysis of breach detection systems (BDS) after its box scored a "below average" security effectiveness rating of 94.5.

Related articles

All but one of the other vendors tested scored more than 98, with Fortinet Inc., Sourcefire Inc. and Trend Micro Inc. all scoring 99 or more.

NSS said its findings helps end users cut through the vendor marketing fluff in what is a "rapidly evolving" market.

In a forceful blog, FireEye product boss Manish Gupta moved immediately to discredit NSS Labs' findings, claiming its methodology was "severely flawed." The FireEye product the NSS used wasn't even fully functional, used an old version of its software and did not have access to its threat intelligence, Gupta said.

But this was like a red rag to a bull for NSS Labs, whose founder Bob Walder last night responded with an equally robust blog designed to address "a number of untruths and misdirections" in Gupta's missive.

Walder responded to Gupta's claims one by one, saying many were untrue, including that the product it tested was indeed a fully functional product installed and configured by FireEye engineers.

According to Gupta, FireEye insisted the only way to properly test was to run in a real environment, but that the NSS declined to change its testing methodology.

Walder, however, rejected this version of events. He claimed NSS Labs does use a live environment "with real PCs going to real, live malicious URLs." Walder confirmed FireEye did ask for it to change its methodology, but claimed this happened only after it saw the results, something the NSS "clearly cannot do."

"In the grand scheme of things, FireEye's results were not that bad," Walder said. "The real issue here is that FireEye now has credible competition in the BDS marketplace, and the data from this NSS test shows it."

Walder said it was rare for NSS to respond to criticism from vendors that have performed poorly in its tests, although a similar spat with WatchGuard Technologies Inc. erupted last year over its next-generation firewall report.

For more channel coverage from CRN UK, visit channelweb.co.uk/.

  • Tweet  
  • LinkedIn  
  • Facebook  
  • Google plus  
  • Send to Kindle
  • Send to  
More on Channel Business
Good to Great

Greatness may be just a few percentage points away

Forget 80/20; there’s a new rule in town, and following this one can mean the difference between just getting by and creating real value

Concept image of a cloud question mark

Cloud calls for new reseller business models - partner

Partner talks important cloud trends for resellers to note

conversation

HP: CIO conversations 'critical'

Avoid "hogwash" and "baloney" and meetings with lieutenants, vendor advises

business-deal-handshake-graphic

NetApp: Trust in the channel is 'everything'

Exec says resellers must be able to trust their vendor

Visitor comments
Add comments
blog comments powered by Disqus
In-depth
suitcase

Flash Forward: A Solid Case for SSDs

A new solid state drive from SanDisk underscores the benefits of SSDs over HDDs for businesses

Good to Great

Greatness may be just a few percentage points away

Forget 80/20; there’s a new rule in town, and following this one can mean the difference between just getting by and creating real value

bob-gault-extreme-networks-proper

Vendor Q&A Series: Bob Gault, Extreme Networks

The latest channel exec to sit in the Channelnomics hotseat is Extreme Network's EVP of worldwide sales, services and channels

newspapers-and-glasses

Channelnomics' top five stories of the week - 22 May 2015

Check out which articles grabbed the most attention this week