Duplicates in malicious_pure #1

It occured to me that there are ~ 4.2k files in malicious_pure but they represent only ~ 1.8k distincts hashes. Was it known to you and if so what are the reasons for not getting rid of duplicates?

Thanks!