menu
Татоэба
language
Теркәлергә Авторлашу
language Татар
menu
Татоэба

chevron_right Теркәлергә

chevron_right Авторлашу

Карау

chevron_right Очраклы җөмләне күрсәтергә

chevron_right Тел буенча карау

chevron_right Исемлек буенча карау

chevron_right Тег буенча карау

chevron_right Аудионы карау

Җәмгыять

chevron_right Дивар

chevron_right Барлык катнашучылар исемлеге

chevron_right Катнашучылар телләре

chevron_right Тел йөртүчеләр

search
clear
swap_horiz
search
xtofu80 xtofu80 3 июнь, 2010 ел 3 июнь, 2010 ел, 8:12:20 UTC flag Report link Даими сылтама

I am not sure whether this is worth discussing, but there are some sentences which are really redundant, e.g.
162883, 83091, two rather long sentences which only differ in the subject being "my mom" vs. "my dad".
Shouldn't we remove one of such pairs and concentrate on the gist instead of wasting our efforts on translating countless variants?

{{vm.hiddenReplies[1085] ? 'expand_more' : 'expand_less'}} җавапларны яшерергә җаваплар күрсәтү
blay_paul blay_paul 3 июнь, 2010 ел 3 июнь, 2010 ел, 9:24:01 UTC flag Report link Даими сылтама

> Shouldn't we remove one of such pairs and concentrate on
> the gist instead of wasting our efforts on translating
> countless variants?

There is a constant effort to remove near - duplicates. At the current rate we're probably losing a couple of dozen a week, if not more.

However removing duplicates does not produce _new_ content. And new content is what's needed to fill out Tatoeba and make it more appealing.

{{vm.hiddenReplies[1086] ? 'expand_more' : 'expand_less'}} җавапларны яшерергә җаваплар күрсәтү
xtofu80 xtofu80 3 июнь, 2010 ел 3 июнь, 2010 ел, 10:06:29 UTC flag Report link Даими сылтама

Yes, you are right, producing new content is also important, though I as a native German speaker am right now mostly busy with adding German translations to the already existing Jap-Eng. sentence pairs. And that's when I came across these near-duplicates.
Currently I am thinking about how I could involve my Japanese language exchange partner to produce some content. At least, I will check with her some sentences I found dubious.

So how would be the best procedure if I come across such a sentence pair? Make a comment? Add it to the "mark for deletion" list?

sysko sysko 3 июнь, 2010 ел 3 июнь, 2010 ел, 10:34:31 UTC flag Report link Даими сылтама

In an other side I'm working with an other guy on a machine-learning based automated translator, and this kind of "near" duplicate sentences are REALLY usefull

{{vm.hiddenReplies[1092] ? 'expand_more' : 'expand_less'}} җавапларны яшерергә җаваплар күрсәтү
sysko sysko 3 июнь, 2010 ел 3 июнь, 2010 ел, 10:37:24 UTC flag Report link Даими сылтама

in fact as a learner I also like to find sometimes this kind of sentences where only a part change, it's easier to see some grammar point this way (because for example in French sentences changing a "my mom" by "my dad" could change the verbs / adjectiv and so in the sentences, which is always interesting to see this variation on the same sentence)

{{vm.hiddenReplies[1093] ? 'expand_more' : 'expand_less'}} җавапларны яшерергә җаваплар күрсәтү
Swift Swift 3 июнь, 2010 ел 3 июнь, 2010 ел, 17:23:29 UTC flag Report link Даими сылтама

On this point, I've chosen to add these nuances in comments. There are otherwise just going to be way too many similar sentences.

sysko sysko 3 июнь, 2010 ел 3 июнь, 2010 ел, 10:44:48 UTC flag Report link Даими сылтама

moreover I think here the problem is not to have or not this countless variant (for the reasons below I would prefer to keep them), but rather "how to show to contributors only 'usefull' sentences"

TRANG TRANG 11 июнь, 2010 ел 11 июнь, 2010 ел, 19:08:29 UTC flag Report link Даими сылтама

Okay I haven't replied to this yet so I will, to make it clear about "variations" of sentences.

Our position is: people can do whatever they like. If they want to add all the possible variations, they can. If they don't want to, they don't have to.

It doesn't hurt to have "near duplicates". It just make Tatoeba a bit noisy. But that's our job, as engineers, to figure out how to filter and organize data so that it can be used efficiently for language learners.

Meanwhile, as sysko said, variations of sentences can be very useful for language processing, so we shouldn't delete them.

{{vm.hiddenReplies[1237] ? 'expand_more' : 'expand_less'}} җавапларны яшерергә җаваплар күрсәтү
blay_paul blay_paul 11 июнь, 2010 ел 11 июнь, 2010 ел, 19:43:26 UTC flag Report link Даими сылтама

Just to clarify the clarification. Near duplicates will be removed from WWWJDIC - but not by deleting them from Tatoeba. So feel free to point out Japanese sentences and English sentences linked to Japanese sentences that are near duplicates.

{{vm.hiddenReplies[1238] ? 'expand_more' : 'expand_less'}} җавапларны яшерергә җаваплар күрсәтү
xtofu80 xtofu80 19 июнь, 2010 ел 19 июнь, 2010 ел, 13:26:52 UTC flag Report link Даими сылтама

Hi Paul, I saw you always post a comment "Not for WWWJDIC" in each sentence. Shouldn't that be solved by using tags?

{{vm.hiddenReplies[1315] ? 'expand_more' : 'expand_less'}} җавапларны яшерергә җаваплар күрсәтү
blay_paul blay_paul 19 июнь, 2010 ел 19 июнь, 2010 ел, 13:33:44 UTC flag Report link Даими сылтама

I could, but I started doing that before tags existed.

It also gives people a chance to notice what sentences I'm excluding and ask why (or just complain ;-).

{{vm.hiddenReplies[1316] ? 'expand_more' : 'expand_less'}} җавапларны яшерергә җаваплар күрсәтү
xtofu80 xtofu80 19 июнь, 2010 ел 19 июнь, 2010 ел, 13:53:38 UTC flag Report link Даими сылтама

So do you filter the sentences according to your comment, or do you mark them somewhere else AND put a comment in?
I just want to know how we should approach sentences we find should not appear there (e.g. hiragana-kanji variants of exactly the same sentence.)

{{vm.hiddenReplies[1317] ? 'expand_more' : 'expand_less'}} җавапларны яшерергә җаваплар күрсәтү
blay_paul blay_paul 19 июнь, 2010 ел 19 июнь, 2010 ел, 14:08:01 UTC flag Report link Даими сылтама

In the secret sentence annotation page, where the Japanese index can be entered / edited, I put -1 in the meaning field.

No one else can see that so the note is just to let people know what I'm doing (generally excluding near-duplicate sentences from WWWJDIC).

CK CK 12 июнь, 2010 ел, редакцияләнгән 25 октябрь, 2019 ел 12 июнь, 2010 ел, 3:31:00 UTC, редакцияләнгән 25 октябрь, 2019 ел, 8:09:42 UTC flag Report link Даими сылтама

[not needed anymore- removed by CK]

{{vm.hiddenReplies[1239] ? 'expand_more' : 'expand_less'}} җавапларны яшерергә җаваплар күрсәтү
xtofu80 xtofu80 12 июнь, 2010 ел 12 июнь, 2010 ел, 10:43:16 UTC flag Report link Даими сылтама

Hi CK,
I completely agree with your notion of near duplicates versus clutter.
I think that besides "dealing" with clutter that already exists, we should also put some effort into guidelines about creating new content.