publications

2025

  1. surgxbench.png
    SurgXBench: Explainable Vision-Language Model Benchmark for Surgery
    Jiajun Cheng, Xianwu Zhao, Sainan Liu, Xiaofan Yu, Ravi Prakash, Patrick J. Codd, Jonathan Elliott Katz, and Shan Lin
    arXiv preprint arXiv:2505.10764, 2025
    arXiv
  2. twintrack_framework.png
    TwinTrack: Bridging Vision and Contact Physics for Real-Time Tracking of Unknown Dynamic Objects
    Wen Yang, Zhixian Xie, Xuechao Zhang, Heni Ben Amor, Shan Lin, and Wanxin Jin
    arXiv preprint arXiv:2505.22882, 2025
    Website arXiv Video
  3. nerf_cystoscopy.png
    3D Rendering of Cystoscopy Video Footage: A Novel Method Utilizing Neural Radiance Field Processing
    Jonathan E Katz, Jamie Finegan, Pablo F Beutelspacher, Jingpei Lu, Shan Lin, Michael Yip, Roger L Sur, Jamie L Finegan, and Roger Sur
    Cureus, 2025
    PAPER
  4. based.jpg
    BASED: Bundle-Adjusting Surgical Endoscopic Dynamic Video Reconstruction Using Neural Radiance Fields
    Shreya Saha, Zekai Liang, Shan Lin, Jingpei Lu, Michael Yip, and Sainan Liu
    In IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2025
    PAPER Video
  5. ctrnet.png
    CtRNet-X: Camera-to-Robot Pose Estimation in Real-World Conditions Using a Single Camera
    Jingpei Lu, Zekai Liang, Tristin Xie, Florian Ritcher, Shan Lin, Sainan Liu, and Michael C Yip
    IEEE International Conference on Robotics and Automation (ICRA), 2025
    arXiv Video

2024

  1. fig_system_overview.jpg
    Efficient Data-Driven Joint-Level Calibration of Cable-Driven Surgical Robots
    Haonan Peng, Andrew Lewis, Yun-Hsuan Su, Shan Lin, Dun-Tin Chiang, Wenfan Jiang, Helen Lai, and Blake Hannaford
    npj Robotics, 2024
    PAPER
  2. superpm.png
    SuPerPM: A Surgical Perception Framework Based on Deep Point Matching Learned from Physical Constrained Simulation Data
    Shan Lin, Albert J Miao, Ali Alabiad, Fei Liu, Kaiyuan Wang, Jingpei Lu, Florian Richter, and Michael C Yip
    In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
    PAPER Video
  3. reduce_load_haonan_MIA2024.png
    Reducing Annotating Load: Active Learning with Synthetic Images in Surgical Instrument Segmentation
    Haonan Peng, Shan Lin, Daniel King, Yun-Hsuan Su, Waleed M Abuzeid, Randall A Bly, Kris S Moe, and Blake Hannaford
    Medical Image Analysis, 2024
    PAPER
  4. hemoset.png
    HemoSet: The First Blood Segmentation Dataset for Automation of Hemostasis Management
    Albert J Miao, Shan Lin, Jingpei Lu, Florian Richter, Benjamin Ostrander, Emily K Funk, Ryan K Orosco, and Michael C Yip
    In International Symposium on Medical Robotics (ISMR). 🏆 Best Student Paper Award , 2024
    PAPER DATA
  5. openx.png
    Open X-Embodiment: Robotic Learning Datasets and RT-X Models
    Abby O’Neill, Abdul Rehman, Abhiram Maddukuri, Abhishek Gupta, Abhishek Padalkar, Abraham Lee, Acorn Pooley, Agrim Gupta, Ajay Mandlekar, Ajinkya Jain, and others
    In IEEE International Conference on Robotics and Automation (ICRA). 🏆 Best Conference Paper Award , 2024
    Website arXiv
  6. qualitative_lab.png
    Tracking Snake-Like Robots in the Wild Using Only a Single Camera
    Jingpei Lu, Florian Richter, Shan Lin, and Michael C Yip
    In IEEE International Conference on Robotics and Automation (ICRA), 2024
    PAPER Video
  7. one-shot-cover.jpg
    AnyOKP: One-Shot and Instance-Aware Object Keypoint Extraction with Pretrained ViT
    Fangbo Qin, Taogang Hou, Shan Lin, Kaiyuan Wang, Michael C Yip, and Shan Yu
    In IEEE International Conference on Robotics and Automation (ICRA), 2024
    PAPER Video Code
  8. real_to_sim.png
    Real-to-Sim Deformable Object Manipulation: Optimizing Physics Models with Residual Mappings for Robotic Surgery
    Xiao Liang, Fei Liu, Yutong Zhang, Yuelei Li, Shan Lin, and Michael Yip
    In IEEE international conference on robotics and automation (ICRA), 2024
    PAPER Video
  9. droid.png
    DROID: A Large-Scale In-the-Wild Robot Manipulation Dataset
    Alexander Khazatsky, Karl Pertsch, Suraj Nair, Ashwin Balakrishna, Sudeep Dasari, Siddharth Karamcheti, Soroush Nasiriany, Mohan Kumar Srirama, Lawrence Yunliang Chen, Kirsty Ellis, and others
    Robotics: Science and Systems (RSS), 2024
    Website arXiv
  10. baangp.png
    BAA-NGP: Bundle-Adjusting Accelerated Neural Graphics Primitives
    Sainan Liu, Shan Lin, Jingpei Lu, Alexey Supikov, and Michael Yip
    In Workshop on Visual Odometry and Computer Vision Applications Based on Location Clues, 2024
    PAPER Code

2023

  1. orrn.png
    ORRN: An ODE-Based Recursive Registration Network for Deformable Respiratory Motion Estimation with Lung 4DCT Images
    Xiao Liang, Shan Lin, Fei Liu, Dimitri Schreiber, and Michael Yip
    IEEE Transactions on Biomedical Engineering, 2023
    PAPER Video Code
  2. semanticsuper.png
    Semantic-Super: A Semantic-Aware Surgical Perception Framework for Endoscopic Tissue Identification, Reconstruction, and Tracking
    Shan Lin, Albert J Miao, Jingpei Lu, Shunkai Yu, Zih-Yun Chiu, Florian Richter, and Michael C Yip
    In IEEE International Conference on Robotics and Automation (ICRA), 2023
    PAPER Video Code
  3. semanticsuper.png
    Semantic-SuPer: Employing Semantic Perception for Endoscopic Tissue Identification, Reconstruction, and Tracking
    Shan Lin, Jingpei Lu, Florian Richter, and Michael Yip
    In Workshop on Integrated Perception, Planning, and Control for Physically and Contextually-Aware Robot Autonomy, 2023
    PDF

2022

  1. contour.png
    Contour Primitive of Interest Extraction Network Based on Dual-Metric One-Hot Learning for Vision Measurement
    Fangbo Qin, Shan Lin, and De Xu
    IEEE Transactions on Industrial Informatics, 2022
    PAPER
  2. zixin.png
    Endoscope Localization and Dense Surgical Scene Reconstruction for Stereo Endoscopy by Unsupervised Optical Flow and Kanade-Lucas-Tomasi Tracking
    Zixin Yang, Shan Lin, Richard Simon, and Cristian A Linte
    In International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2022
    PAPER Code

2021

  1. MFFA.png
    Multi-Frame Feature Aggregation for Real-Time Instrument Segmentation in Endoscopic Video
    Shan Lin, Fangbo Qin, Haonan Peng, Randall A Bly, Kris S Moe, and Blake Hannaford
    IEEE Robotics and Automation Letters, 2021
    PAPER

2020

  1. LCGAN.png
    LC-GAN: Image-to-Image Translation Based on Generative Adversarial Network for Endoscopic Images
    Shan Lin, Fangbo Qin, Yangming Li, Randall A Bly, Kris S Moe, and Blake Hannaford
    In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020
    PAPER
  2. MAFA.jpg
    Towards Better Surgical Instrument Segmentation in Endoscopic Vision: Multi-Angle Feature Aggregation and Contour Supervision
    Fangbo Qin, Shan Lin, Yangming Li, Randall A Bly, Kris S Moe, and Blake Hannaford
    IEEE Robotics and Automation Letters, 2020
    PAPER
  3. spieskill.png
    Video-Based Automatic and Objective Endoscopic Sinus Surgery Skill Assessment
    Shan Lin, Xinyu Gu, Randall A Bly, Kris S Moe, and Blake Hannaford
    In Medical Imaging 2020: Image-Guided Procedures, Robotic Interventions, and Modeling, 2020
    PAPER PDF

2019

  1. mmmi.png
    Automatic Sinus Surgery Skill Assessment Based on Instrument Segmentation and Tracking in Endoscopic Video
    Shan Lin, Fangbo Qin, Randall A Bly, Kris S Moe, and Blake Hannaford
    In International Workshop on Multiscale Multimodal Medical Imaging, 2019
    PAPER

2017

  1. burn.png
    Don’t Get Burned: Thermal Monitoring of Vessel Sealing Using a Miniature Infrared Camera
    Shan Lin, Loris Fichera, Mitchell J Fulton, and Robert J Webster III
    In Medical Imaging 2017: Image-Guided Procedures, Robotic Interventions, and Modeling, 2017
    PAPER PDF