Anti-Virus evaluation and Microsoft’s “OneCrash”

Microsoft’s Windows Live OneCare came in dead last out of a group of 17 anti-virus programs tested against hundreds of thousands of worms, viruses, Trojan horses and other malware, an Austrian anti-virus researcher reported yesterday.

The AV Comparatives Web site, which is maintained by Andreas Cleminti from Innsbruck, Austria, posts quarterly results of tests that pit the top anti-virus products against a dynamic list of nearly half a million individual pieces of malware.

Top dog, according to Cleminti’s tests, was G Data Security’s AntiVirusKit (AVK), which nailed 99.5% of the malicious code. Not far behind were AEC’s TrustPort AV WS, at 99.4%, Avira’s AntiVir PE Premium, at 98.9%, MicroWorld’s eScan Anti-Virus, at 97.9%, F-Secure’s Anti-Virus, at 97.9%, and Kaspersky Labs’ AV, which stopped 97.9% of the malware.

Better known products such as Symantec’s Norton Anti-Virus and McAfee’s VirusScan posted results of 96.8% and 91.6%, respectively.

Holding the bottom spot was Microsoft’s Windows Live OneCare, the consumer security suite that the Redmond, Wash. developer launched last year. OneCare took care of just 82.4% of the malware.
Cleminti also tested the 17 products against polymorphic viruses, those which produce sometimes vast numbers of variants as they try to sneak by scanners. “The results of the polymorphic test are of importance because they how flexible an anti-virus scan engine is and how good the detection quality of complex viruses is,” said Cleminti in his write-up.

Only Symantec’s Norton AntiVirus and ESET’s NOD32 Anti-Virus caught every variant of the 12 polymorphic families, he said. In that test, OneCare placed 15th, detecting every version of only two families, and missing seven of the polymorphic families completely.

This is not the first evaluation to give a Microsoft security program a black eye. Last week, for example, Australian security company PC Tools released research that claimed Windows Defender — Microsoft’s anti-spyware title — detected just 46% to 53% of spyware.

“We are looking closely at the methodology and results of the test to ensure that Windows Live OneCare performs better in future tests,” a Microsoft spokesperson said.


Leave a Reply