Unser Material wird unter verschiedenen Creative-Commons-Lizenzen veröffentlicht.Weitere Informationen
Wenn dir die angebotenen Inhalte gefallen, erwäge doch eine Spende.
Menü
For what reason can't duplicates be removed automatically by a script?
it can, i've done one, but it's not as easy as it seems, because we have strong performance (both in time and place) constraint, as I'm sure you don't tatoeba to be slow as hell during even 7 hours.
So we need to do it directly in the database, the script is no long, but it need to update a lot of things, and for a weird reason there's a bug in the script, that i can't easily reproduce as it seems it's a bug in mysql itself, and it happened only when there's concurrency (as I can't stop tatoeba.org to activate the script) so that's why, and I've already spend too much trying to figure out "why" moreover this problem will disapear with the new version, so I will rather spend time trying to finish this new verion asap rather than continue to search how to fix the script.
All right, if it's fixed in the next version anyway, then go ahead. I just thought it is nonsense to find and remove duplicates manually, as some members did.