menu
Tatoeba
language
Register Log in
language English
menu
Tatoeba

chevron_right Register

chevron_right Log in

Browse

chevron_right Show random sentence

chevron_right Browse by language

chevron_right Browse by list

chevron_right Browse by tag

chevron_right Browse audio

Community

chevron_right Wall

chevron_right List of all members

chevron_right Languages of members

chevron_right Native speakers

search
clear
swap_horiz
search
Lepotdeterre Lepotdeterre July 1, 2015, edited July 1, 2015 July 1, 2015 at 5:59:42 AM UTC, edited July 1, 2015 at 6:00:16 AM UTC link Permalink

Why doesn't the auto-detect recognise Macedonian? Whenever I try to use it for a Macedonian sentence, it classifies it as Bulgarian. Now, how, pray tell, could a sentence containing the љ, њ, ј, ќ, ѓ and/or џ be considered Bulgarian, when those letters are fully absent in Bulgarian? Isn't the basic step of language recognition looking at its alphabet, before going into the words themselves?

This doesn't really matter to me, as I don't use auto-detect - I just select Macedonian manually after logging in, and subsequently, it stays as my default language until I log out, which I generally don't do for entire weeks. However, the fact that the auto-detect feature is endowed with such an absurd imperfection makes me uneasy.

{{vm.hiddenReplies[23304] ? 'expand_more' : 'expand_less'}} hide replies show replies
User55521 User55521 July 1, 2015 July 1, 2015 at 6:26:50 AM UTC link Permalink

I believe auto-detect is learning from the existing sentences, but it’s not doing that real-time: it needs to re-learn to take the new sentences into account. Probabely when the auto-detect data was generated last time, we had much more Bulgarian sentences than Macedonian.

> Isn't the basic step of language
> recognition looking at its alphabet,
> before going into the words themselves?

Not neccessarily. There are many algorithms available.

gillux gillux July 1, 2015, edited July 1, 2015 July 1, 2015 at 6:36:12 AM UTC, edited July 1, 2015 at 6:36:39 AM UTC link Permalink

> Why doesn't the auto-detect recognise Macedonian?

Because the autodetection algorithm is based on the Tatoeba corpus itself, and we still need to update it manually once in a while so that it takes new sentences into account. Three month ago, there were less than 200 sentences in Macedonian, which was not enough for the algorithm to work. Now you added about 50 000 Macedonian sentences, it will certainly work better once we update it. I’ll let you know when it’s done.

gillux gillux July 1, 2015 July 1, 2015 at 7:11:38 AM UTC link Permalink

It should work better now.

{{vm.hiddenReplies[23307] ? 'expand_more' : 'expand_less'}} hide replies show replies
Guybrush88 Guybrush88 July 1, 2015 July 1, 2015 at 7:47:41 AM UTC link Permalink

actually it seems that it uses the language that is used the most by users. I just added #4322143 and #4322166 to test it and it firstly recognized those sentences as Italian

{{vm.hiddenReplies[23308] ? 'expand_more' : 'expand_less'}} hide replies show replies
Lepotdeterre Lepotdeterre July 1, 2015 July 1, 2015 at 9:43:51 AM UTC link Permalink

But I've never posted anything in Bulgarian, so that's clearly not the only factor.

Lepotdeterre Lepotdeterre July 1, 2015 July 1, 2015 at 9:44:01 AM UTC link Permalink

Thank you.