Публікація:
Towards Russian Text Generation Problem Using OpenAI’s GPT-2

dc.contributor.authorShatalov, O.
dc.contributor.authorRyabova, N. V.
dc.date.accessioned2022-01-11T11:27:09Z
dc.date.available2022-01-11T11:27:09Z
dc.date.issued2021
dc.description.abstractThis work is devoted to Natural Language Generation (NLG) problem. The modern approaches in this area based on deep neural networks are considered. The most famous and promising deep neural network architectures that are related to this problem are considered, in particular, the most popular free software solutions for NLG based on Transformers architecture with pre-trained deep neural network models GPT-2 and BERT. The main problem is that the main part of already existing solutions is devoted to the English language. But there are few models that are able to generate text in Russian. Moreover, the text they generate often belongs to a general topic and not about a specific subject area. The object of the study is the generation of a contextually coherent narrow-profile text in Russian. Within the framework of the study, a model was trained for generating coherent articles of a given subject area in Russian, as well as a software application for interacting with it.uk_UA
dc.identifier.citationShatalov O., Ryabova N. Towards Russian Text Generation Problem Using OpenAI’s GPT-2. Proc. 5th Int. Conf. On Computational Linguistics and Intelligent Systems (COLINS), Volume I: Main Conference. CEUR Workshop Proceedings, 2021, 2870, pp.141-153.uk_UA
dc.identifier.uriURN: urn:nbn:de:0074-2870-3
dc.identifier.uriARCHIVE: http://sunsite.informatik.rwth-aachen.de/ftp/pub/publications/CEUR-WS/Vol-2870.zip
dc.identifier.urihttps://openarchive.nure.ua/handle/document/19040
dc.language.isoenuk_UA
dc.publisherCEUR Workshop Proceedingsuk_UA
dc.relation.ispartofseriesVolume 2870;pp.141-153
dc.subjectNatural Language Generationuk_UA
dc.subjectNatural Language Processingчuk_UA
dc.subjectTransformers Architectureuk_UA
dc.subjectDeep Learninguk_UA
dc.subjectTransfer Learninguk_UA
dc.subjectGPT-2uk_UA
dc.titleTowards Russian Text Generation Problem Using OpenAI’s GPT-2uk_UA
dc.title.alternativeProc. 5th Int. Conf. On Computational Linguistics and Intelligent Systems (COLINS), Volume I: Main Conference.uk_UA
dc.typeConference proceedingsuk_UA
dspace.entity.typePublication

Файли

Оригінальний пакет
Зараз показано 1 - 1 з 1
Завантаження...
Зображення мініатюри
Назва:
149_paper.pdf
Розмір:
1004.75 KB
Формат:
Adobe Portable Document Format
Опис:
Towards Russian Text Generation Problem Using OpenAI’s GPT-2
Ліцензійний пакет
Зараз показано 1 - 1 з 1
Немає доступних мініатюр
Назва:
license.txt
Розмір:
9.42 KB
Формат:
Item-specific license agreed upon to submission
Опис: