Edge AI-Based Intraoperative Image Segmentation for Robotic-Assisted Orthopedic Surgeries
DOI:
https://doi.org/10.52783/jns.v14.2753Keywords:
Image Segmentation, Robotic Surgery, Orthopedic System, Real-Time Processing, Medical Imaging, Federated Learning, AI Acceleration, Surgical AIAbstract
Robotic-assisted orthopedic surgeries have revolutionized precision in joint replacement and fracture fixation. Intraoperative image segmentation remains a significant challenge due to high computational demands and the need for real-time processing. Traditional cloud-based solutions introduce latency, security concerns, and dependency on high-bandwidth internet, making them unsuitable for time-sensitive surgical procedures. Edge Artificial Intelligence (Edge AI) offers a transformative approach by enabling on-device computation, reducing latency, and improving the efficiency of intraoperative segmentation. This paper explores the integration of Edge AI for real-time intraoperative image segmentation in robotic-assisted orthopedic surgeries. We discuss the advantages of Edge AI in reducing reliance on external servers and ensuring high-speed, accurate segmentation directly at the surgical site. The study evaluates different deep learning architectures, including U-Net, DeepLabV3, and transformer-based models, optimized for edge deployment using techniques such as quantization, pruning, and knowledge distillation. A real-time processing pipeline is proposed, integrating Edge AI hardware such as NVIDIA Jetson Xavier and Google Coral TPU to process surgical images efficiently. Experimental results demonstrate that Edge AI-based segmentation achieves real-time inference with sub-100ms latency while maintaining high accuracy. The study highlights challenges such as hardware constraints, regulatory compliance, and model generalization across different patient anatomies. We discuss future research directions, including federated learning, augmented reality integration, and improved hardware acceleration. Overall, Edge AI has the potential to enhance robotic-assisted orthopedic surgeries by providing fast, accurate, and locally processed image segmentation, improving surgical precision and patient outcomes.
Downloads
Metrics
References
F. Jiang, Y. Jiang, H. Zhi, Y. Dong, H. Li, S. Ma, Y. Wang, Q. Dong, H. Shen, and Y. Wang, ‘‘Artificial intelligence in healthcare: Past, present and future,’’ Stroke Vascular Neurol., vol. 2, no. 4, pp. 1–14, 2017.
A. Panesar, Machine Learning and AI for Healthcare. Cham, Switzerland: Springer, 2019.
M. Y. Shaheen, ‘‘Applications of artificial intelligence (AI) in healthcare: A review,’’ ScienceOpen, Burlington, MA, USA, Tech. Rep. PPVRY8K.v1, 2021.
T. M. Ward, P. Mascagni, Y. Ban, G. Rosman, N. Padoy, O. Meireles, and D. A. Hashimoto, ‘‘Computer vision in surgery,’’ Surgery, vol. 169, no. 5, pp. 1253–1256, May 2021.
M. C. E. Simsekler, C. Rodrigues, A. Qazi, S. Ellahham, and A. Ozonoff, ‘‘A comparative study of patient and staff safety evaluation using treebased machine learning algorithms,’’ Rel. Eng. Syst. Saf., vol. 208, Apr. 2021, Art. no. 107416.
J. L. Fencl, C. Willoughby, and K. Jackson, ‘‘Just culture: The foundation of staff safety in the perioperative environment,’’ AORN J., vol. 113, no. 4, pp. 329–336, Apr. 2021.
A. Rehman, M. A. Butt, and M. Zaman, ‘‘A survey of medical image analysis using deep learning approaches,’’ in Proc. 5th Int. Conf. Comput. Methodologies Commun. (ICCMC), Apr. 2021, pp. 1334–1342.
N. Kumar and M. Raubal, ‘‘Applications of deep learning in congestion detection, prediction and alleviation: A survey,’’ Transp. Res. C, Emerg. Technol., vol. 133, Dec. 2021, Art. no. 103432.
Eng, K.; Eyre-Brook, A.; Shields, D.W. A Systematic Review of the Utility of Intraoperative Navigation During Total Shoulder Arthroplasty. Cureus 2022, 14, e33087.
N. Bandari, J. Dargahi, and M. Packirisamy, ‘‘Tactile sensors for minimally invasive surgery: A review of the state-of-the-art, applications, and perspectives,’’ IEEE Access, vol. 8, pp. 7682–7708, 2020.
S. M. Hussain, A. Brunetti, G. Lucarelli, R. Memeo, V. Bevilacqua, and D. Buongiorno, ‘‘Deep learning based image processing for robot assisted surgery: A systematic literature survey,’’ IEEE Access, vol. 10, pp. 122627–122657, 2022.
M. T. Thai, P. T. Phan, T. T. Hoang, S. Wong, N. H. Lovell, and T. N. Do, ‘‘Advanced intelligent systems for surgical robotics,’’ Adv. Intell. Syst., vol. 2, no. 8, pp. 1–33, Aug. 2020.
Y. Zhong, L. Hu, and Y. Xu, ‘‘Recent advances in design and actuation of continuum robots for medical applications,’’ Actuators, vol. 9, no. 4, p. 142, Dec. 2020
D. C. Birkhoff, A. S. H. V. Dalen, and M. P. Schijven, ‘‘A review on the current applications of artificial intelligence in the operating room,’’ Surgical Innov., vol. 28, no. 5, 2021, Art. no. 1553350621996961.
N. Kumar and M. Raubal, ‘‘Applications of deep learning in congestion detection, prediction and alleviation: A survey,’’ Transp. Res. C, Emerg. Technol., vol. 133, Dec. 2021, Art. no. 103432.
Downloads
Published
How to Cite
Issue
Section
License

This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
Terms:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.