Edge AI-Based Intraoperative Image Segmentation for Robotic-Assisted Orthopedic Surgeries

Authors

  • Sandip Desai
  • Swati Gopal Gawhale
  • Mohammad Sohail Pervez
  • R. B. Kakkeri
  • Prachi Janrao
  • Laxmikant Umate

DOI:

https://doi.org/10.52783/jns.v14.2753

Keywords:

Image Segmentation, Robotic Surgery, Orthopedic System, Real-Time Processing, Medical Imaging, Federated Learning, AI Acceleration, Surgical AI

Abstract

Robotic-assisted orthopedic surgeries have revolutionized precision in joint replacement and fracture fixation. Intraoperative image segmentation remains a significant challenge due to high computational demands and the need for real-time processing. Traditional cloud-based solutions introduce latency, security concerns, and dependency on high-bandwidth internet, making them unsuitable for time-sensitive surgical procedures. Edge Artificial Intelligence (Edge AI) offers a transformative approach by enabling on-device computation, reducing latency, and improving the efficiency of intraoperative segmentation. This paper explores the integration of Edge AI for real-time intraoperative image segmentation in robotic-assisted orthopedic surgeries. We discuss the advantages of Edge AI in reducing reliance on external servers and ensuring high-speed, accurate segmentation directly at the surgical site. The study evaluates different deep learning architectures, including U-Net, DeepLabV3, and transformer-based models, optimized for edge deployment using techniques such as quantization, pruning, and knowledge distillation. A real-time processing pipeline is proposed, integrating Edge AI hardware such as NVIDIA Jetson Xavier and Google Coral TPU to process surgical images efficiently. Experimental results demonstrate that Edge AI-based segmentation achieves real-time inference with sub-100ms latency while maintaining high accuracy. The study highlights challenges such as hardware constraints, regulatory compliance, and model generalization across different patient anatomies. We discuss future research directions, including federated learning, augmented reality integration, and improved hardware acceleration. Overall, Edge AI has the potential to enhance robotic-assisted orthopedic surgeries by providing fast, accurate, and locally processed image segmentation, improving surgical precision and patient outcomes.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

References

F. Jiang, Y. Jiang, H. Zhi, Y. Dong, H. Li, S. Ma, Y. Wang, Q. Dong, H. Shen, and Y. Wang, ‘‘Artificial intelligence in healthcare: Past, present and future,’’ Stroke Vascular Neurol., vol. 2, no. 4, pp. 1–14, 2017.

A. Panesar, Machine Learning and AI for Healthcare. Cham, Switzerland: Springer, 2019.

M. Y. Shaheen, ‘‘Applications of artificial intelligence (AI) in healthcare: A review,’’ ScienceOpen, Burlington, MA, USA, Tech. Rep. PPVRY8K.v1, 2021.

T. M. Ward, P. Mascagni, Y. Ban, G. Rosman, N. Padoy, O. Meireles, and D. A. Hashimoto, ‘‘Computer vision in surgery,’’ Surgery, vol. 169, no. 5, pp. 1253–1256, May 2021.

M. C. E. Simsekler, C. Rodrigues, A. Qazi, S. Ellahham, and A. Ozonoff, ‘‘A comparative study of patient and staff safety evaluation using treebased machine learning algorithms,’’ Rel. Eng. Syst. Saf., vol. 208, Apr. 2021, Art. no. 107416.

J. L. Fencl, C. Willoughby, and K. Jackson, ‘‘Just culture: The foundation of staff safety in the perioperative environment,’’ AORN J., vol. 113, no. 4, pp. 329–336, Apr. 2021.

A. Rehman, M. A. Butt, and M. Zaman, ‘‘A survey of medical image analysis using deep learning approaches,’’ in Proc. 5th Int. Conf. Comput. Methodologies Commun. (ICCMC), Apr. 2021, pp. 1334–1342.

N. Kumar and M. Raubal, ‘‘Applications of deep learning in congestion detection, prediction and alleviation: A survey,’’ Transp. Res. C, Emerg. Technol., vol. 133, Dec. 2021, Art. no. 103432.

Eng, K.; Eyre-Brook, A.; Shields, D.W. A Systematic Review of the Utility of Intraoperative Navigation During Total Shoulder Arthroplasty. Cureus 2022, 14, e33087.

N. Bandari, J. Dargahi, and M. Packirisamy, ‘‘Tactile sensors for minimally invasive surgery: A review of the state-of-the-art, applications, and perspectives,’’ IEEE Access, vol. 8, pp. 7682–7708, 2020.

S. M. Hussain, A. Brunetti, G. Lucarelli, R. Memeo, V. Bevilacqua, and D. Buongiorno, ‘‘Deep learning based image processing for robot assisted surgery: A systematic literature survey,’’ IEEE Access, vol. 10, pp. 122627–122657, 2022.

M. T. Thai, P. T. Phan, T. T. Hoang, S. Wong, N. H. Lovell, and T. N. Do, ‘‘Advanced intelligent systems for surgical robotics,’’ Adv. Intell. Syst., vol. 2, no. 8, pp. 1–33, Aug. 2020.

Y. Zhong, L. Hu, and Y. Xu, ‘‘Recent advances in design and actuation of continuum robots for medical applications,’’ Actuators, vol. 9, no. 4, p. 142, Dec. 2020

D. C. Birkhoff, A. S. H. V. Dalen, and M. P. Schijven, ‘‘A review on the current applications of artificial intelligence in the operating room,’’ Surgical Innov., vol. 28, no. 5, 2021, Art. no. 1553350621996961.

N. Kumar and M. Raubal, ‘‘Applications of deep learning in congestion detection, prediction and alleviation: A survey,’’ Transp. Res. C, Emerg. Technol., vol. 133, Dec. 2021, Art. no. 103432.

Downloads

Published

2025-03-28

How to Cite

1.
Desai S, Gawhale SG, Sohail Pervez M, Kakkeri RB, Janrao P, Umate L. Edge AI-Based Intraoperative Image Segmentation for Robotic-Assisted Orthopedic Surgeries. J Neonatal Surg [Internet]. 2025Mar.28 [cited 2025Oct.5];14(10S):13-2. Available from: https://jneonatalsurg.com/index.php/jns/article/view/2753