It's possible to automate it, but it would require you to write some custom scripts.

Whether 140,000 sentences is too much depends on what you intend to do with the list. There are bigger lists on Tatoeba already, so storing them is not a problem.

May I ask how did you compile the list of sentence IDs? What’s your purpose?
Just being curious about how people use Tatoeba :-)

Thank you for sharing this issue with the community. I too would like to easily create and update very long lists on Tatoeba. Ideally, a button placed in the list header would allow us to edit its sequence of sentence IDs directly on the site.

The API endpoint for it is actually extremely simple. You need to have cookies from the site so you you can either transfer those to a program like curl or whatever or you can just paste the code into the browser console on any page on the site. This seems to work for me:

async function addToList(list, sente){
await fetch(`/is/sentences_lists/add_sentence_to_list/${sente}/${list}`);
}

addToList("170279", "3329778");

i have a script to add cc0 sentences to a list, and one thing that hasn't been said before is that it's rather slow
there seems to be a rate limit on the server side where you can't add more than 1 sentence per second
so the adding in your case will take almost 2 days

For the random sentence on the homepage, we could change it to select a random user first and then select one of their sentences, effectively giving equal weight to everyone, no matter how many sentences they have. But for the random ordering of search results, this would be a bit harder to implement. Maybe we could add an option to the search page to show at most one sentence per user.

Other options to cope you haven't mentioned yet:
- translate from languages other than English
- write English sentences yourself
- use Tatominer
- sort sentences by creation date and translate mostly sentences added before July 2011

I like the suggestion about adding a feature to display at max one (or however many) sentence(s) per user.

We have an option in the advanced search that allows us to search for sentences by a particular user. I think it would also be useful if there was a feature that allowed us to exclude sentences from certain users. If you could enter multiple usernames into a field, separating them with commas like tags, I think that would be really useful and would clear up problems like Cabo's.

I have another example of a case in which this feature would be useful. Sometimes I search for longer sentences to translate for variety, since the majority of sentences on Tatoeba are fairly short. The easiest way to do this, as far as I can tell, is to perform an advanced search with the "sort by" set to "fewest words first" and then to click the "reverse order" button. This shows all the longest sentences first. The downside I encountered is that some contributors (generally speaking, only a handful per language) upload long texts from classical literature or other public domain works. There's nothing wrong with that, of course, but if I want to just translate original (written by user) sentences, it means I have to go through them individually and sort them, which is a little time consuming.

Speaking of original sentences, it would also be cool if we could implement an "original only" check box in the advanced search, in similar manner to the function on the "sentences" page for each user. That way I could search for original sentences by a user that haven't been translated into a given language. Maybe someone has mentioned one or more of these points before, but that's just what I'm thinking. I don't know how easy/difficult it would be to implement these changes.

> f I don't translate them, and others also not doing the same thing, the percentage will increase in case we are searching for yet not translated ones

@Cabo, I share your concern. If nothing is done, these "shunned sentences" will indeed be more and more visible on Tatoeba.

To solve this issue, perhaps shunned sentences should be detected and unapproved after a few years without any translation. The shunned sentences could be the sentences added by a contributor over a period of time and significantly less translated than their peers from other contributors.

Very potentially, although I wouldn't know of any current projects actively using the data.

Definitely. A search for "tatoeba machine translation" on the arXiv https://search.arxiv.org/?in=&q...%20translation returns 177 papers.

Tatoeba is not an ideal corpus to train machine translation models because it is rather small and not representative of the sentences encountered in real life. However, it is sometimes used to complement other resources.

Besides, as it covers many language pairs and has quite good translations, Tatoeba is often used to evaluate the performance of these machine translation models. The Tatoeba Translation Challenge and the XTREME benchmark are good illustrations of this:
https://github.com/Helsinki-NLP/Tatoeba-Challenge
https://sites.research.google/xtreme

Sounds great, all of them, but how do I know that the sentence has more than one audio recording?
//
I'm just bird brained... I see all of the audio recordings.

Super update! :)

Wow, that's a pretty cool update!

Would it be possible to add some information about "self-identified" accent? At least some high level accent information - (so, for English, it could be American, British, Australian)? And maybe something more detailed ("...born in Newcastle, grew up in Liverpool")

For those interested, you can hear multiple voices from Common Voice on several proverbs.

https://tatoeba.org/en/audio/of/CVAF

83 audio files for the 5 sentences.