NSS Labs Hits Back at FireEye 'Untruths'

A war of words has erupted between FireEye and an independent testing house that questioned the vendor's ability to catch malware.

  • Tweet  
  • LinkedIn  
  • Facebook  
  • Google plus  
  • Send to Kindle
  • Send to  
fight-pa

A war of words has erupted between FireEye Inc. and an independent testing house that questioned the vendor's ability to catch malware.

NSS Labs handed FireEye (NASDAQ:FEYE) a "caution rating" in its first ever comparative analysis of breach detection systems (BDS) after its box scored a "below average" security effectiveness rating of 94.5.

Related articles

All but one of the other vendors tested scored more than 98, with Fortinet Inc., Sourcefire Inc. and Trend Micro Inc. all scoring 99 or more.

NSS said its findings helps end users cut through the vendor marketing fluff in what is a "rapidly evolving" market.

In a forceful blog, FireEye product boss Manish Gupta moved immediately to discredit NSS Labs' findings, claiming its methodology was "severely flawed." The FireEye product the NSS used wasn't even fully functional, used an old version of its software and did not have access to its threat intelligence, Gupta said.

But this was like a red rag to a bull for NSS Labs, whose founder Bob Walder last night responded with an equally robust blog designed to address "a number of untruths and misdirections" in Gupta's missive.

Walder responded to Gupta's claims one by one, saying many were untrue, including that the product it tested was indeed a fully functional product installed and configured by FireEye engineers.

According to Gupta, FireEye insisted the only way to properly test was to run in a real environment, but that the NSS declined to change its testing methodology.

Walder, however, rejected this version of events. He claimed NSS Labs does use a live environment "with real PCs going to real, live malicious URLs." Walder confirmed FireEye did ask for it to change its methodology, but claimed this happened only after it saw the results, something the NSS "clearly cannot do."

"In the grand scheme of things, FireEye's results were not that bad," Walder said. "The real issue here is that FireEye now has credible competition in the BDS marketplace, and the data from this NSS test shows it."

Walder said it was rare for NSS to respond to criticism from vendors that have performed poorly in its tests, although a similar spat with WatchGuard Technologies Inc. erupted last year over its next-generation firewall report.

For more channel coverage from CRN UK, visit channelweb.co.uk/.

  • Tweet  
  • LinkedIn  
  • Facebook  
  • Google plus  
  • Send to Kindle
  • Send to  
More on Channel Business
hired-hire-join-appoint-appointed-rubber-stamp-rubberstamp

IBM's appoints new Global Business Partners VP

Michele Stern tasked with bringing $5bn in revenue

communication1

Communication breakdown: Getting vendor marketing and partner sales on the same page

Channel players talk struggles, consequences and solutions to poor communication among vendor marketing teams and channel sales teams

wires

HP to focus on wired, wireless to take market share from Cisco

Meg Whitman says there is opportunity to capture Cisco-dominated market

failure2

If at first, you don’t succeed...

The road to success is paved with obstacles, potholes and yes, failure. The secret is to learn from our mistakes and keep walking

Visitor comments
Add comments
blog comments powered by Disqus
In-depth
communication1

Communication breakdown: Getting vendor marketing and partner sales on the same page

Channel players talk struggles, consequences and solutions to poor communication among vendor marketing teams and channel sales teams

revitas-michaelkerman2-300dpi

Channel compliance is a bigger issue than you think

It's not only customers that face compliance challenges, says Revitas' Michael Kerman

Web design

Your just-right website: Art, Science and a little je ne sais quoi

Follow these rules for an online presence that’s visually appealing, content-rich and easy to navigate

richard-hutton-samsung

Vendor Q&A Series: Richard Hutton, Samsung

The latest channel exec to sit in the Channelnomics hotseat is Samsung's director of channel marketing for the Enterprise Business Division of Samsung Electronics America