UniDive – Universality, diversity and idiosyncrasy in language technology

Project factsheet

Polish members of the Management Committee

• Monika Czerepowicka
• Alina Wróblewska (Institute of Computer Science, Polish Academy of Sciences), Grant Holder Scientific Representative

Project description

Efficient access to the constantly growing quantities of data, especially of language data, largely relies on advances in data science. This domain includes natural language processing (NLP), which is currently booming, to the benefit of many end users. However, this optimization-based technological progress poses an important challenge: accounting for and fostering language diversity. The UniDive Action takes two original stands on this challenge. Firstly, it aims at embracing both inter- and intra-language diversity, i.e. a diversity understood both in terms of the differences among the existing languages and of the variety of linguistic phenomena exhibited within a language. Secondly, UniDive does not assume that linguistic diversity is to be protected against technological progress but strives for both of these aims jointly, to their mutual benefit. Its approach is to: (i) pursue NLP-applicable universality of terminologies and methodologies, (ii) quantify inter- and intra-linguistic diversity, (iii) boost and coordinate universality- and diversity-driven development of language resources and tools. UniDive builds upon previous experience of European networks and projects which provided a proof of concept for language modelling and processing, unified across many languages but preserving their diversity. The main benefits of the Action will include, on the theoretical side, a better understanding of language universals, and on the practical side, language resources and tools covering, in a unified framework, a bigger variety of language phenomena in a large number of languages, including low-resourced and endangered ones.

Working groups

• WG1: Corpus annotation
• WG2: Lexicon-corpus interface
• WG3: Multilingual and cross-lingual language technology
• WG4: Quantifying and promoting diversity

Role of the Institute

The Institute of Computer Science, Polish Academy of Sciences is the Grant Holder institution of UniDive. The Grant Holder is responsible for managing and coordinating the Action’s scientific activities, producing scientific reports, preparing documentation for meetings, collecting and archiving reimbursement-related documents, archiving Management Committee decisions, and financial reporting.

Results

The Action started with 40 members from 33 countries and ended with over 500 members from 40 countries, working on 24 tasks within its four working groups. Over its four years, UniDive organised 4 general meetings, 4 working group meetings, 9 workshops, 5 shared tasks and 3 training events, funded 92 Short-Term Scientific Missions and started 11 spin-off projects. Publications, language resources, software and other outcomes of the Action are listed on the project website.