Application of deep convolutional and long short-term memory neural networks to red blood cells motion detection and velocity approximation

Abstract

The paper deals with processing data obtained using nailfold high-speed videocapillaroscopy. To detect the red blood cells velocity two approaches are used. The deterministic approach is based on pixel intensities analysis for object detection and calculation of the displacement and velocity of red blood cells in a capillary. The obtained data formulate targets for the second approach. The stochastic approach is based on a sequence of artificial neural networks. The semantic segmentation network UNet is used for capillary detection. Then, the classification network GoogLeNet or ResNet is used as a feature extractor to convert masked video frames to a sequence of feature vectors. And finally, the long short-term memory network is used to approximate the red blood cells velocity. The results demonstrated that the accuracy of the mean velocity approximation in the time range of several seconds is up to 0.96. But the accuracy at each specific time moment is less accurate. So, the proposed algorithm allows the determination of the RBCs mean velocity but it doesn't allow determination of the RBCs pulsations accurate enough.

Publication DOI: https://doi.org/10.1117/12.2626040
Divisions: College of Engineering & Physical Sciences > Aston Institute of Photonics Technology (AIPT)
Funding Information: The is work is funded by the Russian Science Foundation under the grant No 20-79-00332. The authors gratefully acknowledge this support. The authors also express graduate to Dmitry Stavtsev for the help with the experiment results preprocessing.
Additional Information: Copyright 2022 SPIE. One print or electronic copy may be made for personal use only. Systematic reproduction, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited. Funding Information: The is work is funded by the Russian Science Foundation under the grant No 20-79-00332.
Uncontrolled Keywords: approximation,capillary,deep learning,feature extraction,red blood cells,semantic segmentation,transfer learning,videocapillaroscopy,Electronic, Optical and Magnetic Materials,Atomic and Molecular Physics, and Optics,Biomaterials,Radiology Nuclear Medicine and imaging
Publication ISSN: 1605-7422
Last Modified: 27 Mar 2024 08:20
Date Deposited: 29 Jun 2022 10:45
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
https://www.spi ... 6040.full?SSO=1 (Publisher URL)
PURE Output Type: Conference article
Published Date: 2022-04-29
Accepted Date: 2021-09-01
Authors: Kornaev, Alexey V.
Dremin, Viktor V. (ORCID Profile 0000-0001-6974-3505)
Kornaeva, Elena P.
Volkov, Mikhail V.

Download

[img]

Version: Published Version

| Preview

Export / Share Citation


Statistics

Additional statistics for this record