PL196x – Polish language of the 1960s

This page is dedicated to the corpus of the Frequency Dictionary of Contemporary Polish. The original purpose of the corpus was to create a general frequency dictionary of contemporary Polish. The work started in 1967. Partial results were published between 1972 and 1977, the completed dictionary in 1990. The corpus was later augmented in various respects, both by manual editing and automated procedures.

Corpus data contain 10,000 samples divided into 5 parts: essays, news, scientific texts, fiction and plays. Every sample is approximately 50 words long, they all come from texts published between 1963 and 1967 and contain bibliographic description of its source. Each word is tagged with its base form and some morphological properties. Sentence boundaries are also marked.

In 2001 corpus authors agreed to publish the data in the Internet under GNU licence. This site presents corpus data in base and extended (enhanced) version as well as additional materials and corpus documentation.

The corpus was manually annotated using the IPI PAN tagset — each sentence by one annotator, there was no superannotation stage.

In 2012, under the ICT-PSP project CESAR, the corpus with IPI PAN tagset annotation was automatically converted to annotation adhering to the NKJP tagset. The data from the automatic conversion into the NKJP tagset was used when simulating the manual annotation of NKJP – it served as data from one of the two annotators. The second annotator was a human annotator, who annotated the sentence from scratch. As in NKJP manual annotation, the human annotator inspected interpretations of segments in a given sentence generated automatically by the morphological analyser – the human annotator could either choose one of these interpretations, or enter a different interpretation manually. If the human annotator selected a different annotation than the one resulting from automatic conversion, the sentence was returned to the human annotator for inspection. Without knowing the result of automatic conversion, the human annotator could either change their earlier annotation or keep it. After this stage, if there were still conflicting interpretations, the superannotator would decide about the correct interpretation.

If you are looking for more recent frequency data, please take a look at NKJP n-grams.

Corpus data

Current version

The current version of the corpus features:

• manually updated annotation,
• TEI P5 data format,
• both annotation and data format compatible with the National Corpus of Polish.

Downloads:

• TEI P5 XML corpus files (77 MB)
• Poliqarp files (7.2 MB) – binary corpus for the Poliqarp search engine

Original version

Auxiliary files for the TEI P4-encoded XML version:

• Master file with TEI header for the corpus
• Feature library (assembles library of feature elements)
• Feature structure library (assembles library of feature structure elements)
• Writing system declaration
• Feature structures representing morphological descriptions for Polish
• TEI P4 DTD

ISO image (50 MB) of the CD-ROM with most of the materials.

Concordances

• Concordances with location (17 MB)
• Concordances without location (24 MB)

Licence

• GNU Free Documentation Licence for corpus documentation.
• GNU GPL / CC-BY for corpus data.

Citing

When using the electronic version of the corpus, please cite:

• Maciej Ogrodniczuk. 2003. Nowa edycja wzbogaconego korpusu słownika frekwencyjnego [New edition of the Enhanced corpus of the Frequency dictionary, in Polish]. In Stanisław Gajda, editor, Językoznawstwo w Polsce. Stan i perspektywy, pages 181–190. Komitet Językoznawstwa PAN and Instytut Filologii Polskiej, Uniwersytet Opolski, Opole. ISBN 83-86881-36-4.

Corpus documentation

• Janusz S. Bień and Marcin Woliński. 2001. Wzbogacony korpus Słownika frekwencyjnego polszczyzny współczesnej [Enhanced corpus of the frequency dictionary of contemporary Polish, in Polish]. December 17th, 2001.
• Janusz S. Bień and Marcin Woliński. 2001. Numeryczne kody gramatyczne we wzbogaconym korpusie Słownika frekwencyjnego polszczyzny współczesnej [Numerical grammatical codes in the enhanced corpus of the frequency dictionary, in Polish]. December 17th, 2001.
• Katarzyna Głowińska. Taksonomia morfologiczna dla Słownika frekwencyjnego [Morphological taxonomy for the frequency dictionary, in Polish].
• Ida Kurcz, Andrzej Lewicki, Jadwiga Sambor, Krzysztof Szafran and Jerzy Woronczak. Polish language in the sixties. Introduction to the printed edition of the frequency dictionary, also available in Polish.
• Maciej Ogrodniczuk. Wzbogacenie korpusu słownika frekwencyjnego o nowe kody gramatyczne [Enhancing the corpus of the frequency dictionary with new grammatical codes, in Polish].

Selected bibliography

• Elżbieta Awramiuk. 2001. Wpływ odstępstw od segmentacji ortograficznej na wyniki statystyczne Słownika frekwencyjnego polszczyzny współczesnej [Influence of deviations from orthographic segmentation on the statistical results in the frequency dictionary of contemporary Polish, in Polish]. Roczniki Humanistyczne Uniwersytetu w Białymstoku 2001–2002, vol. 49–50, no. 6, pages 31–43. Białystok.
• Janusz S. Bień and Marcin Woliński. 2003. Wzbogacony korpus Słownika frekwencyjnego polszczyzny współczesnej [Enhanced corpus of the Frequency dictionary of contemporary Polish, in Polish]. In Jadwiga Linde-Usiekniewicz, editor, Prace lingwistyczne dedykowane prof. Jadwidze Sambor, pages 6–10. Faculty of Polish Philology, Warsaw University, Warsaw.
• Monika Czerepowicka and Zygmunt Saloni. 2004. Co skreślano i co dopisywano w korpusie Słownika frekwencyjnego polszczyzny współczesnej [What was deleted and what was added in the frequency dictionary of contemporary Polish, in Polish]. In I. Kamińska-Szmaj, editor, Od starożytności do współczesności. Język – literatura – kultura. Księga poświęcona pamięci Profesora Jerzego Woronczaka, pages 381–391. Wrocław.
• Ida Kurcz, Andrzej Lewicki, Jadwiga Sambor and Jerzy Woronczak. 1974. Słownictwo współczesnego języka polskiego. Listy frekwencyjne. Tom I. Teksty popularnonaukowe, part I and part II [Vocabulary of contemporary Polish. Frequency lists. Volume I. Scientific texts, in Polish]. Warsaw University, Warsaw.
• Ida Kurcz, Andrzej Lewicki, Jadwiga Sambor and Jerzy Woronczak. 1974. Słownictwo współczesnego języka polskiego. Listy frekwencyjne. Tom II. Drobne wiadomości prasowe, part I [Vocabulary of contemporary Polish. Frequency lists. Volume II. News, in Polish]. Warsaw University, Warsaw.
• Andrzej Lewicki, Władysław Masłowski, Jadwiga Sambor and Jerzy Woronczak. 1975. Słownictwo współczesnego języka polskiego. Listy frekwencyjne. Tom III. Publicystyka, part I and part II [Vocabulary of contemporary Polish. Frequency lists. Volume III. Essays, in Polish]. Warsaw University, Warsaw.
• Ida Kurcz, Andrzej Lewicki, Jadwiga Sambor and Jerzy Woronczak. 1976. Słownictwo współczesnego języka polskiego. Listy frekwencyjne. Tom IV. Proza artystyczna, part I, part II and part III [Vocabulary of contemporary Polish. Frequency lists. Volume IV. Fiction, in Polish]. Warsaw University, Warsaw.
• Ida Kurcz, Andrzej Lewicki, Jadwiga Sambor and Jerzy Woronczak. 1977. Słownictwo współczesnego języka polskiego. Listy frekwencyjne. Tom V. Dramat artystyczny [Vocabulary of contemporary Polish. Frequency lists. Volume V. Plays, in Polish]. Warsaw University, Warsaw.
• Ida Kurcz, Andrzej Lewicki, Jadwiga Sambor, Krzysztof Szafran and Jerzy Woronczak. 1990. Słownik frekwencyjny polszczyzny współczesnej, volume I and volume II [Frequency dictionary of contemporary Polish, in Polish]. Institute of Polish Language, Polish Academy of Sciences, Kraków.
• Marta Nazarczuk. 1997. Wstępne przygotowanie korpusu „Słownika frekwencyjnego polszczyzny współczesnej” do dystrybucji na CD-ROM [Initial preparation of the corpus of the Frequency dictionary of contemporary Polish for CD-ROM distribution, in Polish]. Master’s thesis supervised by prof. Janusz S. Bień. Institute of Polish Philology, Warsaw University, Warsaw. 59 pages, CD-ROM.
• Maciej Ogrodniczuk. 2003. Rozszerzenie opisów morfologicznych w tekstach korpusu Słownika frekwencyjnego polszczyzny współczesnej [Augmenting the morphological description in the corpus of the Frequency dictionary of contemporary Polish, in Polish]. In Jadwiga Linde-Usiekniewicz, editor, Prace lingwistyczne dedykowane prof. Jadwidze Sambor, pages 164–168. Faculty of Polish Philology, Warsaw University, Warsaw.
• Maciej Ogrodniczuk. 2000. Wykorzystanie SGML i TEI do zapisu polskich danych lingwistycznych [Encoding of Polish linguistic data with SGML and TEI, in Polish]. Master’s thesis supervised by prof. Janusz S. Bień. Institute of Informatics, Warsaw University, Warsaw. 83 pages, CD-ROM.
• Zygmunt Saloni. 1991. Słownik frekwencyjny polszczyzny współczesnej [Frequency dictionary of contemporary Polish, in Polish]. ComputerWorld, November 4th, 1991, pages 16–17.