Please use this identifier to cite or link to this item:
https://www.um.edu.mt/library/oar/handle/123456789/22689
Title: | What is in a text and what does it do : qualitative evaluations of an NLG system – the BT-Nurse – using content analysis and discourse analysis |
Authors: | Sambaraju, Rahul Reiter, Ehud Logie, Robert McKinlay, Andy McVittie, Chris Gatt, Albert Sykes, Cindy |
Keywords: | Natural language processing (Computer science) Corpora (Linguistics) Linguistic analysis (Linguistics) Reference (Linguistics) Word (Linguistics) |
Issue Date: | 2011 |
Publisher: | Association for Computational Linguistics |
Citation: | Sambaraju, R., Reiter, E., Logie, R., McKinlay, A., McVittie, C., Gatt, A., & Sykes, C. (2011). What is in a text and what does it do: qualitative evaluations of an NLG system--the BT-Nurse--using content analysis and discourse analysis. 13th European Workshop on Natural Language Generation, Nancy. 22-31. |
Abstract: | Evaluations of NLG systems generally are quantiative, that is, based on corpus comparison statistics and/or results of experiments with people. Outcomes of such evaluations are important in demonstrating whether or not an NLG system is successful, but leave gaps in understanding why this is the case. Alternatively, qualitative evaluations carried out by experts provide knowledge on where a system needs to be improved. In this paper we describe two such evaluations carried out for the BT-Nurse system, using two different methodologies (content analysis and discourse analysis). The outcomes of such evaluations are discussed in comparison to what was learnt from a quantitiave evaluation of BT-Nurse. Implications for the role of similar evaluations in NLG are also discussed. |
URI: | https://www.um.edu.mt/library/oar//handle/123456789/22689 |
Appears in Collections: | Scholarly Works - InsLin |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
W11-2804.pdf | 354.42 kB | Adobe PDF | View/Open |
Items in OAR@UM are protected by copyright, with all rights reserved, unless otherwise indicated.