Verilerimiz muhtelif Creative Commons lisansları altında yayınlanmaktadır.Daha fazla bilgi
Bu içeriği sevdiyseniz lütfen bağışta bulunun.
Menü
Why doesn't the auto-detect recognise Macedonian? Whenever I try to use it for a Macedonian sentence, it classifies it as Bulgarian. Now, how, pray tell, could a sentence containing the љ, њ, ј, ќ, ѓ and/or џ be considered Bulgarian, when those letters are fully absent in Bulgarian? Isn't the basic step of language recognition looking at its alphabet, before going into the words themselves?
This doesn't really matter to me, as I don't use auto-detect - I just select Macedonian manually after logging in, and subsequently, it stays as my default language until I log out, which I generally don't do for entire weeks. However, the fact that the auto-detect feature is endowed with such an absurd imperfection makes me uneasy.
I believe auto-detect is learning from the existing sentences, but it’s not doing that real-time: it needs to re-learn to take the new sentences into account. Probabely when the auto-detect data was generated last time, we had much more Bulgarian sentences than Macedonian.
> Isn't the basic step of language
> recognition looking at its alphabet,
> before going into the words themselves?
Not neccessarily. There are many algorithms available.
> Why doesn't the auto-detect recognise Macedonian?
Because the autodetection algorithm is based on the Tatoeba corpus itself, and we still need to update it manually once in a while so that it takes new sentences into account. Three month ago, there were less than 200 sentences in Macedonian, which was not enough for the algorithm to work. Now you added about 50 000 Macedonian sentences, it will certainly work better once we update it. I’ll let you know when it’s done.
It should work better now.
actually it seems that it uses the language that is used the most by users. I just added #4322143 and #4322166 to test it and it firstly recognized those sentences as Italian
But I've never posted anything in Bulgarian, so that's clearly not the only factor.
Thank you.