Show simple item record

dc.contributor.authorGrigoroiu, Alexandru
dc.contributor.authorYoon, Jonghee
dc.contributor.authorBohndiek, Sarah E
dc.date.accessioned2020-04-05T00:43:15Z
dc.date.available2020-04-05T00:43:15Z
dc.date.issued2020-03-03
dc.identifier.issn2045-2322
dc.identifier.otherPMC7054302
dc.identifier.other32127600
dc.identifier.urihttps://www.repository.cam.ac.uk/handle/1810/304096
dc.description.abstractHyperspectral imaging (HSI) is being explored in endoscopy as a tool to extract biochemical information that may improve contrast for early cancer detection in the gastrointestinal tract. Motion artefacts during medical endoscopy have traditionally limited HSI application, however, recent developments in the field have led to real-time HSI deployments. Unfortunately, traditional HSI analysis methods remain unable to rapidly process the volume of hyperspectral data in order to provide real-time feedback to the operator. Here, a convolutional neural network (CNN) is proposed to enable online classification of data obtained during HSI endoscopy. A five-layered CNN was trained and fine-tuned on a dataset of 300 hyperspectral endoscopy images acquired from a planar Macbeth ColorChecker chart and was able to distinguish between its 18 constituent colors with an average accuracy of 94.3% achieved at 8.8 fps. Performance was then tested on a set of images simulating an endoscopy environment, consisting of color charts warped inside a rigid tube mimicking a lumen. The algorithm proved robust to such variations, with classification accuracies over 90% being obtained despite the variations, with an average drop in accuracy of 2.4% being registered at the points of longest working distance and most inclination. For further validation of the color-based classification system, ex vivo videos of a methylene blue dyed pig esophagus and images of different disease stages in the human esophagus were analyzed, showing spatially distinct color classifications. These results suggest that the CNN has potential to provide color-based classification during real-time HSI in endoscopy.
dc.languageeng
dc.rightsAttribution 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.sourceessn: 2045-2322
dc.sourcenlmid: 101563288
dc.titleDeep learning applied to hyperspectral endoscopy for online spectral classification.
dc.typeArticle
dc.date.updated2020-04-05T00:43:14Z
prism.issueIdentifier1
prism.publicationNameScientific reports
prism.volume10
dc.identifier.doi10.17863/CAM.51179
rioxxterms.versionofrecord10.1038/s41598-020-60574-6
rioxxterms.versionVoR
rioxxterms.licenseref.urihttps://creativecommons.org/licenses/by/4.0/
dc.contributor.orcidBohndiek, Sarah E [0000-0003-0371-8635]
pubs.funder-project-idRCUK | Engineering and Physical Sciences Research Council (EPSRC) (EP/N014588/1, EP/L015889/1, EP/R003599/1)
pubs.funder-project-idCancer Research UK (C47594/A21102, C14303/A17197, C47594/A16267)
pubs.funder-project-idEngineering and Physical Sciences Research Council (1783080)


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record

Attribution 4.0 International
Except where otherwise noted, this item's licence is described as Attribution 4.0 International