> May I ask if "perc" and "total_sentences_minus_top_contributor" take into account that some users have sentences in different languages?

They only take into account the sentences in that language.

So, the very first chart (TOP-25 contributor chart) doesn't take into account the language in which those are contributions were made. So, for example, maaster owns 77,059 sentences in different languages. It's a very simple chart, a more complicated version of it is being posted by CK from time to time - sentence count in native language.

The second chart shows the top contributor in each language, and then the number of sentences in that language only, and the top contributor's share in the total language corpus. So, in case of maaster and Hungrarian, it shows that 71,309 of Hungarian sentences belong to maaster. And the percentage calculation is used based on this number.

The third charts shows what would happen to the corpus if the top contributor of this language hadn't contributed in that language only. So maaster's sentences are not taken into account for the Hungarian corpus numbers, but they are taken into account for the English corpus numbers.

Also, I've been using "contributions" and "sentence owned" interchangeably, I'm aware those terms are not really the same, some people unown their sentences in non-native languages, so while technically they contributed them, they don't own them. The statistics only takes into account sentences owned.

I've translated your message using google translate, so I'm not entirely sure I've got it right, but google translate thinks you talk about "word clouds", which is probably something different from what I meant by "sentence clouds".

Thanks! Good point. I'll review my algorithm.

I've revised the script and it seems to be working properly now. I've also re-run it using the latest downloadables.

The first cloud is indeed a humongous one.

It consists of 405,231 sentences. The runner-up has "only" 2,987 sentences.

Here is the top-50:

https://www.reddit.com/r/tatoeb...clouds_take_2/

The first cloud deserves a special attention.

I wonder whether it exists solely because of the "Chinese whispers" effect (you translate a sentence to different languages, the translations are being translated, etc.) and, because of all kind of linguistic ambiguities, the meaning can change significantly in a few iterations; or, maybe, there are some sentences linked incorrectly. Most probably, both factors play some role in it, but, hopefully, the "Chinese effect" is by far the most influential one.

It contains 29,434 English sentences, and every time I tried to select some random sentences from this cloud they all seemed so random it blows my mind that each one of them is an indirect translation of any other sentence from the list. Here is an example:

https://i.imgur.com/rUNpl04.png

If you are curious how, for example, how "Tom is beautiful" became "You know what I'm saying?", here is a path (there could be a few though):

#7260496 Lang:eng Tom is beautiful. -> #1998311 Lang:deu Tom ist hübsch. -> #2609133 Lang:rus Том симпатичный. -> #2609145 Lang:fra Tom est sympathique. -> #1495932 Lang:deu Tom ist freundlich. -> #5261794 Lang:epo Tomo estas afabla. -> #3187087 Lang:ita Tom è premuroso. -> #6089104 Lang:epo Tomo estas zorgema. -> #2524634 Lang:ita Tom è diligente. -> #2236811 Lang:eng Tom is persevering. -> #4334330 Lang:mkd Том е упорен. -> #2203178 Lang:eng Tom is persistent. -> #5948874 Lang:ukr Том наполегливий. -> #5854379 Lang:eng Tom is pushy. -> #4439850 Lang:por Tom é agressivo. -> #4439655 Lang:swe Tom är aggressiv. -> #2202554 Lang:eng Tom is aggressive. -> #5421164 Lang:heb תום תוקפני. -> #3238507 Lang:eng He is aggressive. -> #3238503 Lang:ita È intraprendente. -> #313128 Lang:eng She is aggressive. -> #90584 Lang:jpn 彼女は気が強い。 -> #1300166 Lang:eng She's strong-willed. -> #865246 Lang:spa Ella es obstinada. -> #1327985 Lang:ita Lei è ostinata. -> #2203130 Lang:eng You're obstinate. -> #2305634 Lang:deu Sie sind starrsinnig. -> #4220362 Lang:fra Vous êtes obstinée. -> #5226243 Lang:epo Vi estas obstina. -> #7316102 Lang:deu Du bist zäh. -> #40603 Lang:eng You're tough. -> #5407208 Lang:heb אתם קשוחים. -> #2202937 Lang:eng You're harsh. -> #2401356 Lang:ita È dura. -> #869099 Lang:fra C'est difficile. -> #2267970 Lang:rus Это сложно. -> #2298741 Lang:toki ni li ike. -> #2111431 Lang:eng That's immoral. -> #8452386 Lang:yid דאָס איז אומגערעכט. -> #2111384 Lang:eng That's wrong. -> #8452389 Lang:yid דאָס איז נישט אמת. -> #796706 Lang:fra C'est pas vrai. -> #240209 Lang:eng You cannot be serious. -> #3443732 Lang:rus Ты это серьёзно? -> #373215 Lang:eng Are you serious? -> #81591 Lang:jpn 本気？ -> #1326 Lang:eng Are you sure? -> #1356753 Lang:eng Are you certain? -> #7312084 Lang:toki sina sona ala sona? -> #455452 Lang:deu Verstanden? -> #461080 Lang:pol Rozumiesz? -> #1360379 Lang:ukr Розумієш? -> #250819 Lang:eng You see what I mean? -> #1261509 Lang:fra Tu vois ce que je veux dire ? -> #3655940 Lang:kor 무슨 말인지 알겠니? -> #3655938 Lang:kor 유남생? -> #1853696 Lang:eng You know what I'm saying?

I don't know many of the languages on the list so I have no idea whether it's a legitimate "Chinese whisper path" or there's some human error there, but at least the transition from a statement to a question is legitimate: Lang:eng You cannot be serious. -> 3443732 Lang:rus Ты это серьёзно?.

I can't understand whether the name Tom was lost legitimately, here is this bit: 2202554 Lang:eng Tom is aggressive. -> 5421164 Lang:heb תום תוקפני. -> 3238507 Lang:eng He is aggressive.

All the sentences from Cloud 1 are here:

https://docs.google.com/spreads...it?usp=sharing

This can be viewed online or downloaded as xls. It has a separate tab for sentences in English only.

If you're curious about how any two sentences from the list are linked with each other, please send me a PM or let me know here, I've got a program for that.