Augmenting Microsurgical Training: Microsurgical Instrument Detection Using Convolutional Neural Networks
![Thumbnail](/bitstream/handle/123456789/6923/15372711431297938319.pdf.jpg?sequence=4&isAllowed=y)
Files
Self archived version
final draftDate
2018Author(s)
Unique identifier
10.1109/CBMS.2018.00044Metadata
Show full item recordMore information
Self-archived item
Citation
Leppänen, Tomi. Vrzakova, Hana. Bednarik, Roman. Kanervisto, Anssi. Elomaa, Antti-Pekka. Huotarinen, Antti. Bartczak, Piotr. Fraunberg, Mikael. Jääskeläinen, Juha E. (2018). Augmenting Microsurgical Training: Microsurgical Instrument Detection Using Convolutional Neural Networks. Proceedings: 31st IEEE International Symposium on Computer-Based Medical Systems - CBMS 2018, 2018, 211-216. 10.1109/CBMS.2018.00044.Rights
Abstract
In video-based training, clinicians practice and advance their skills on surgeries performed by their colleagues and themselves. Although microsurgeries are recorded daily, training centers are lacking the workforce to manually annotate the segments important for practitioners, such as instrument presence and position. In this work, we propose intelligent instrument detection using Convolutional Neural Network (CNN) to augment microsurgical training. The network was trained on real microsurgical practice videos for which human annotators manually gathered a large corpus of instrument positions. Under challenging conditions of highly magnified and often blurred view, the CNN was capable to correctly detect a needle-holder (a dominant tool in suturing practice) with 78.3% accuracy (F-score = 0.84) with recognition speed above 15 FPS. The result is promising in the emerging domain of augmented medical training where instrument recognition presents benefits to the microsurgical training.