NLU Datasets

5.3 million Chinese-German parallel sentence pairs stored in text format, covering multiple domains such as tourism, medical treatment, daily life, news, etc. The data desensitization and quality checking had been done. It can be used for machine translation, NLP research, and bilingual text analysis.

This dataset contains 84,516 English sentences annotated with intent classes, slot labels, and slot values. The intent field includes music, weather, date, schedule, and smart home equipment, etc. It is applied to intent recognition, intent classification, and slot filling tasks.

English and Russian parallel corpus, 1,080,000 groups in total; excluded political, porn, personal information and other sensitive vocabulary; it can be a base corpus for text-based data analysis, used in machine translation and other fields.

English and Korean parallel corpus, 1340,000 groups in total; excluded political, porn, personal information and other sensitive vocabulary; it can be a base corpus for text-based data analysis, used in machine translation and other fields.

This dataset contains 380,000 aligned Japanese-English sentence pairs. Sensitive content such as political, pornographic, and personal information has been excluded. It can be a base corpus for translation systems, cross-lingual information retrieval, and text-based language processing applications.

Annotation of 687,694 sentences generated by users in the mobile phone scene, covering to-do scenes, location scenes, and schedule scenes. The data set can be used for natural language understanding tasks.

This dataset contains 47,811 English sentences annotated with intent classes, slot labels, and slot values. The intent field includes music, weather, date, schedule, smart home equipment, etc. it is applied to intent recognition, intent classification, and slot filling tasks.

This dataset contains 850,000 English-Japanese parallel sentences stored in TXT format. It covers multiple fields such as tourism, medical treatment, daily life, news, etc. average English sentence 23 words. The data desensitization and quality checking had been done. It can be used as a fundamental dataset for machine translation, bilingual NLP tasks, and other text processing applications.

This dataset contains 80 million Chinese-English parallel sentences, covering domains such as travel, medicine, daily conversation, and TV scripts. It is stored in txt format, cleaned, desensitized, and quality-checked. It can be used as a fundamental dataset for machine translation, bilingual NLP tasks, and other text processing applications.