Evaluation-focused multidimensional score for Turkish abstractive text summarization

Basit Öğe Kaydı
dc.authorid0000-0002-6545-173X
dc.contributor.authorKayalı, Nihal Zuhal
dc.contributor.authorOmurca, Sevinç İlhan
dc.date.accessioned2024-11-13T17:18:12Z
dc.date.available2024-11-13T17:18:12Z
dc.date.issued2024
dc.departmentTAÜ, Mühendislik Fakültesi, Bilgisayar Mühendisliği Bölümüen_US
dc.description.abstractDespite the inherent complexity of Abstractive Text Summarization, which is widely acknowledged as one of the most challenging tasks in the field of natural language processing, transformer-based models have emerged as an effective solution capable of delivering highly accurate and coherent summaries. In this study, the effectiveness of transformer-based text summarization models for Turkish language is investigated. For this purpose, we utilize BERTurk, mT5 and mBART as transformer-based encoder-decoder models. Each of the models was trained separately with MLSUM, TR-News, WikiLingua and Fırat_DS datasets. While obtaining experimental results, various optimizations were made in the summary functions of the models. Our study makes an important contribution to the limited Turkish text summarization literature by comparing the performance of different language models on existing Turkish datasets. We first evaluate ROUGE, BERTScore, FastText-based Cosine Similarity and Novelty Rate metrics separately for each model and dataset, then normalize and combine the scores we obtain to obtain a multidimensional score. We validate our innovative approach by comparing the summaries produced with the human evaluation results.
dc.identifier.citationN. Z. Kayalı ve S. İlhan Omurca (2024). Evaluation-Focused Multidimensional Score for Turkish Abstractive Text Summarization. Sakarya University Journal of Computer and Information Science, 7 (3), 346–360.
dc.identifier.doi10.35377/saucis...1504388
dc.identifier.endpage360en_US
dc.identifier.issn2636-8129
dc.identifier.issue3en_US
dc.identifier.scopus2-s2.0-85214806013
dc.identifier.startpage346en_US
dc.identifier.urihttps://hdl.handle.net/20.500.12846/1396
dc.identifier.volume7en_US
dc.indekslendigikaynakScopus
dc.language.isoen
dc.publisherSakarya University
dc.relation.ispartofSakarya University Journal of Computer and Information Science
dc.relation.publicationcategoryMakale - Ulusal Hakemli Dergi - Kurum Öğretim Elemanı
dc.rightsinfo:eu-repo/semantics/openAccess
dc.subjectNatural language processingen_US
dc.subjectAbstractive summarizationen_US
dc.subjectTransformersen_US
dc.subjectEvaluation metricsen_US
dc.subjectROUGEen_US
dc.titleEvaluation-focused multidimensional score for Turkish abstractive text summarization
dc.typeArticle

Dosyalar

Orijinal paket
Listeleniyor 1 - 1 / 1
[ X ]
İsim:
10.35377-saucis...1504388-4019375.pdf.crdownload
Boyut:
481.53 KB
Biçim:
Unknown data format
Açıklama:
Makale Dosyası
İndir
Lisans paketi
Listeleniyor 1 - 1 / 1
[ X ]
İsim:
license.txt
Boyut:
1.44 KB
Biçim:
Item-specific license agreed upon to submission
Açıklama:
İndir

Koleksiyon

Bilgisayar Mühendisliği Bölümü Koleksiyonu
Scopus İndeksli Yayınlar Koleksiyonu