A Sentence Generator for Natural Language Evaluators
Date
1994-12
Authors
Gandy, Howard Craig
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
By the tum of the century, it is expected that most computer applications will include a natural language processing component. Both developers and consumers of NLP systems have expressed a need for standard natural language system evaluators. Automated natural language evaluators appear to be the only logical solution to the overwhelming number of NLP systems that have been produced, are being produced, and will be produced.
The system described within is based on the Benchmark Evaluation Tool [7] and is the first step toward fully automating the evaluation process. This effort was accomplished in two phases. In phase one, we identified a subset of the Benchmark Evaluation Tool for each class of NLP systems. And in phase two, we designed and implemented a natural language generation system to generate non-causal semantically meaningful test sentences.
We followed an Object-Oriented Design (OOD) strategy [1]. In this approach all concepts, including semantic and syntactic rules are defined as objects. Each test sentence is generated as a chain of words satisfying a number semantic, syntactic and contextual constraints. The constraints imposed on the generation process increase dynamically while the sentence is being generated. This strategy guarantees semantic cohesiveness while maintaining syntactic integrity.
Description
Keywords
natural language processing, object-oriented programming, computational linguistics
Citation
Gandy, H.C. (1994). A sentence generator for natural language evaluators (Unpublished thesis). Southwest Texas State University, San Marcos, Texas.