Augmenting Microsurgical Training: Microsurgical Instrument Detection Using Convolutional Neural Networks
Self archived versionfinal draft
MetadataShow full item record
CitationLeppänen, Tomi. Vrzakova, Hana. Bednarik, Roman. Kanervisto, Anssi. Elomaa, Antti-Pekka. Huotarinen, Antti. Bartczak, Piotr. Fraunberg, Mikael. Jääskeläinen, Juha E. (2018). Augmenting Microsurgical Training: Microsurgical Instrument Detection Using Convolutional Neural Networks. Proceedings: 31st IEEE International Symposium on Computer-Based Medical Systems - CBMS 2018, 2018, 211-216. 10.1109/CBMS.2018.00044.
In video-based training, clinicians practice and advance their skills on surgeries performed by their colleagues and themselves. Although microsurgeries are recorded daily, training centers are lacking the workforce to manually annotate the segments important for practitioners, such as instrument presence and position. In this work, we propose intelligent instrument detection using Convolutional Neural Network (CNN) to augment microsurgical training. The network was trained on real microsurgical practice videos for which human annotators manually gathered a large corpus of instrument positions. Under challenging conditions of highly magnified and often blurred view, the CNN was capable to correctly detect a needle-holder (a dominant tool in suturing practice) with 78.3% accuracy (F-score = 0.84) with recognition speed above 15 FPS. The result is promising in the emerging domain of augmented medical training where instrument recognition presents benefits to the microsurgical training.