Predicting Protein Content in Grain Using Hyperspectral Deep Learning

Ole-Christian Galbo Engstrøm, Erik Schou Dreier, Kim Steenstrup Pedersen; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, 2021, pp. 1372-1380

Abstract


We assess the possibility of performing regression analysis on hyperspectral images utilizing the entire spatio-spectral data cube in convolutional neural networks using protein regression analysis of bulk wheat grain kernels as a test case. By introducing novel modifications of the well-known convolutional neural network, ResNet-18, we are able to significantly increase its performance on hyperspectral images. Our modifications consist of firstly applying a 3D convolution layer enabling learning of spectral derivatives that 2D spatial convolution is unable to learn, and secondly, the application of a (1 x 1) 2D convolution layer that downsamples the spectral dimension. Analysis of the responses learned by the convolution kernels in our modifications reveals meaningful representations of the input data cube that reduce noise and enable the subsequent ResNet-18 to perform more accurate regression analysis.

Related Material


[pdf]
[bibtex]
@InProceedings{Engstrom_2021_ICCV, author = {Engstr{\o}m, Ole-Christian Galbo and Dreier, Erik Schou and Pedersen, Kim Steenstrup}, title = {Predicting Protein Content in Grain Using Hyperspectral Deep Learning}, booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops}, month = {October}, year = {2021}, pages = {1372-1380} }