P2L: Predicting Transfer Learning for Images and Semantic Relations

Bishwaranjan Bhattacharjee, John R. Kender, Matthew Hill, Parijat Dube, Siyu Huo, Michael R. Glass, Brian Belgodere, Sharath Pankanti, Noel Codella, Patrick Watson; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2020, pp. 760-761

Abstract


We describe an efficient method to accurately estimate the effectiveness of a previously trained deep learning model for use in a new learning task. We use this method, "Predict To Learn" (P2L), to predict the most likely "source" dataset to produce effective transfer for training on a "target" dataset. We validate our approach extensively across 21 tasks, including image classification tasks and semantic relationship prediction tasks in the linguistic domain. The P2L approach selects the best transfer learning model on 62% of the tasks,compared with a baseline of 48% of cases when using a heuristic of selecting the largest source dataset and 52% of cases when using a distance measure between source and target datasets. Further, our work results in an 8% reduction in error rate. Finally, we also show that a model trained from merging multiple source model datasets does not necessarily result in improved transfer learning. This suggests that performance of the target model depends upon the relative composition of the source dataset as well as their absolute scale, as measured by our novel method we term 'P2L'

Related Material


[pdf]
[bibtex]
@InProceedings{Bhattacharjee_2020_CVPR_Workshops,
author = {Bhattacharjee, Bishwaranjan and Kender, John R. and Hill, Matthew and Dube, Parijat and Huo, Siyu and Glass, Michael R. and Belgodere, Brian and Pankanti, Sharath and Codella, Noel and Watson, Patrick},
title = {P2L: Predicting Transfer Learning for Images and Semantic Relations},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2020}
}