Prof. Dr. Walt Detmar Meurers
Publications
CoMeT: Integrating different levels of linguistic modeling for meaning assessment

  

Niels Ott, Ramon Ziai, Michael Hahn, and Detmar Meurers

  

Proceedings of the 7th International Workshop on Semantic Evaluation (SemEval), Atlanta, GA, USA.

  

This paper describes the CoMeT system, our contribution to the SemEval 2013 Task 7 challenge, focusing on the task of automatically assessing student answers to factual questions. CoMeT is based on a meta-classifier that uses the outputs of the sub-systems we developed: CoMiC, CoSeC, and three shallower bag approaches. We sketch the functionality of all sub-systems and evaluate their performance against the official test set of the challenge. CoMeT obtained the best result (73.1% accuracy) for the 3-way unseen answers in Beetle among all challenge participants. We also discuss possible improvements and directions for future research.

  


  

Electronically available file formats:

  


  

Bibtex entry:


@InProceedings{Ott.Ziai.ea-13,
  author    = {Niels Ott and Ramon Ziai and Michael Hahn and Detmar Meurers},
  title     = {CoMeT: Integrating different levels of linguistic modeling 
               for meaning assessment},
  booktitle = {Proceedings of the 7th International Workshop on 
               Semantic Evaluation (SemEval)},
  year      = {2013},
  address   = {Atlanta, GA, USA},
  pages     = {608--616},
  pdf       = {http://aclweb.org/anthology/S13-2102.pdf},
  url       = {http://purl.org/dm/papers/Ott.Ziai.ea-13.html},
}