Pre-gen metrics: Predicting caption quality metrics without generating captions

Marc Tanti, Albert Gatt, Adrian Muscat; Proceedings of the European Conference on Computer Vision (ECCV) Workshops, 2018, pp. 0-0

Abstract


Image caption generation systems are typically evaluated against reference outputs. We show that it is possible to predict output quality without generating the captions, based on the probability assigned by the neural model to the reference captions. Such pre-gen metrics are strongly correlated to standard evaluation metrics.

Related Material


[pdf] [arXiv]
[bibtex]
@InProceedings{Tanti_2018_ECCV_Workshops,
author = {Tanti, Marc and Gatt, Albert and Muscat, Adrian},
title = {Pre-gen metrics: Predicting caption quality metrics without generating captions},
booktitle = {Proceedings of the European Conference on Computer Vision (ECCV) Workshops},
month = {September},
year = {2018}
}