Since a few months ago we've started participating in a new AV comparative test from PC Security Labs called Total Protection Testing. It's a pretty kewl test since, as opposed to other AV comparatives out there, PC Security Labs has a very interesting testing methodology that takes into consideration:
- Freshness of malware samples. Only the newest samples from the previous month are tested, not year old samples.
- Static detection using traditional signature files, very similar to what other AV comparative testers are doing.
- Dynamic (behavioral) detection of malicious running processes. Only a handful of professional AV testers are doing this.
- Cloud-based detection such as Panda's Collective Intelligence. As far as I know PCSL is the first AV tester with a methodology that takes this type of technology into account.
- False positive testing. Global scores are lowered on each false positive.
All-in-all a very complete testing methodology that gives a broad view of the global performance of different anti-malware solutions. It's no surprise that PC SecurityLabs has recently joined the AntiMalware Testing Standards Organization (AMTSO).
I'm glad to report that Panda has achieved an "Excellent" score in each of the three tests we've participated in so far.
Total Protection Testing reports from PCSL can be downloaded directly from the following locations:
- PC SecurityLabs Total Protection Testing 2008/11
- PC SecurityLabs Total Protection Testing 2008/12
- PC SecurityLabs Total Protection Testing 2009/01
The tests are performed on a monthly basis, so make sure to visit PC Security Labs every now and then to get the latest results!
8 comments
what about joinig the tests on wwww.av-comparatives.org It would be useful to know how panda is doing in this tests.
very good ï¼PCSL Total Protection Testing very famous in Chinaï¼
Congratulations Panda 🙂
Good job Panda!
To answer Simon, we’d like to participate in as many comparatives as possible. However one of the minimum requirements that we have prior to participating is that the testing methodology and test conclusions reflects all aspects of our products such as signatures, heuristics, cloud-detection, behavioral analysis, etc., only only portions thereof. In the case of AV-Test.org and PCSL we see that they have the most advanced testing methodologies nowadays and that’s why we participate in their tests. Good and thorough AV testing is a very difficult thing to do right. As additional AV testing organizations start implementing more advanced testing methodologies we will for sure participate in them.
very good testing technologies.
Do you now if AV-TEST.org test with Internet connection and testing against unknown threats?
Jonas
Yes Jonas, AV-Test does test with Internet connection as well as dynamic testing (executing of malware which is not detected by traditional signatures). However they are treated as separate, independent tests, so you cannot see a global score which takes into consideration all different tests, such as with PCSL.
AV-Comparatives does in case of in-th-cloud products also test with an active internet connection. We provide (internally) also since last year behavioral and dynamic tests. This year dynamic tests are also one kind of test (beside many others) which will constitute our quarterly public main tests (we announced this already last year). We did not do it already last year because in our opinion using e.g. just 20 samples is way too less to call it a dynamic test.