publications

publications in reversed chronological order.

2025

  1. Frontiers25.png
    Real-time Human Progress Estimation with Online Dynamic Time Warping for Collaborative Robotics
    Davide De Lazzari, Matteo Terreran, Giulio Giacomuzzo, Siddarth Jain, Pietro Falco, Ruggero Carli, Stefano Ghidoni, and Diego Romeres
    Frontiers in Robotics and AI, 2025
    : Human Progress Estimation | Temporal Alignment | Dynamic Time Warping | Collaborative Robotics
  2. llm_human.png
    Interactive Robot Action Replanning using Multimodal LLM Trained from Human Demonstration Videos
    Chiori Hori, Motonari Kambara, Komei Sugiura, Kei Ota, Sameer Khurana, Siddarth Jain, Radu Corcodel, Devesh Jha, Diego Romeres, and Jonathan Le Roux
    In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2025
    : Large Language Models | Human Demonstrations | Action Replanning | HRI
  3. ASRU25.png
    Robot Confirmation Generation and Action Planning Using Long-context Q-Former Integrated with Multimodal LLM
    Chiori Hori, Yoshiki Masuyama, Siddarth Jain, Radu Corcodel, Devesh K Jha, Diego Romeres, and Jonathan Le Roux
    In IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), 2025
    : Large Language Models | Action Planning | Interactive Planning
  4. pace.gif
    PACE: Proactive Assistance in Human-Robot Collaboration Through Action-Completion Estimation
    Davide De Lazzari, Matteo Terreran, Giulio Giacomuzzo, Siddarth Jain, Pietro Falco, Ruggero Carli, and Diego Romeres
    In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2025
    : Proactive Assistance | Action-Completion Estimation | Collaborative Robotics | HRI
  5. pace2.png
    Human Monitoring with Correlation-based Dynamic Time Warping for Collaborative Assembly
    Davide De Lazzari, Matteo Terreran, Giulio Giacomuzzo, Siddarth Jain, Pietro Falco, Ruggero Carli, and Diego Romeres
    In ICRA Workshop on The Future of Intelligent Manufacturing: From innovation to implementation, 2025

2024

  1. ione.gif
    Insert-One: One-shot Robust Visual-Force Servoing for Novel Object Insertion with 6-DoF Tracking
    Haonan Chang, Abdeslam Boularias, and Siddarth Jain
    In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
    : Assembly | Robotic Insertion | Visual-Force Servoing | Robust Manipulation | Visual Tracking
  2. llmphy.gif
    Llmphy: Complex Physical Reasoning using Large Language Models and World Models
    Anoop Cherian, Radu Corcodel, Siddarth Jain, and Diego Romeres
    arXiv preprint arXiv:2411.08027, 2024
    : Physical Reasoning | World Models | Large Language Models | Simulation-Based Inference
  3. decaf.png
    Decaf: A Discrete-Event based Collaborative Human-Robot Framework for Furniture Assembly
    Giulio Giacomuzzo, Matteo Terreran, Siddarth Jain, and Diego Romeres
    In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
    : Task Allocation | Furniture Assembly | Collaborative Robotics
  4. assembly.gif
    Autonomous Robotic Assembly: From Part Singulation to Precise Assembly
    Kei Ota, Devesh K Jha, Siddarth Jain, Bill Yerazunis, Radu Corcodel, Yash Shukla, Antonia Bronars, and Diego Romeres
    In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
    : Assembly | Part Singulation | Force-Controlled Manipulation | Pose Estimation
  5. avblip.png
    Human Action Understanding-Based Robot Planning using Multimodal LLM
    Motonari Kambara, Chiori Hori, Komei Sugiura, Kei Ota, Devesh K Jha, Sameer Khurana, Siddarth Jain, Radu Corcodel, Diego Romeres, and Jonathan Le Roux
    In IEEE ICRA 2024 Workshop on Cooking Robotics: Perception and motion planning, 2024
  6. llm.png
    Interactive Planning using Large Language Models for Partially Observable Robotic Tasks
    Lingfeng Sun, Devesh K Jha, Chiori Hori, Siddarth Jain, Radu Corcodel, Xinghao Zhu, Masayoshi Tomizuka, and Diego Romeres
    In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2024
  7. ohrcs2.png
    Open Human-Robot Collaboration Systems (OHRCS): A Research Perspective
    Prasanth Sengadu Suresh, Diego Romeres, Prashant Doshi, and Siddarth Jain
    In Proceedings of the IEEE 6th International Conference on Cognitive Machine Intelligence (CogMI), 2024
    : Inverse Reinforcement Learning | Multi-Agent Systems | HRI
  8. ohrcs.gif
    Open Human-Robot Collaboration using Decentralized Inverse Reinforcement Learning
    Prasanth Sengadu Suresh, Siddarth Jain, Prashant Doshi, and Diego Romeres
    In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
    : Inverse Reinforcement Learning | Multi-Agent Systems | Collaborative Assembly | HRI
  9. transparent.png
    Few-shot Transparent Instance Segmentation for Bin Picking
    Anoop Cherian, Siddarth Jain, and Tim K Marks
    In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
    : Transparent Object Segmentation | Instance Segmentation | Bin Picking | Computer Vision

2023

  1. earl.gif
    EARL: Eye-on-hand Reinforcement Learner for Dynamic Grasping with Active Pose Estimation
    Baichuan Huang, Jingjin Yu, and Siddarth Jain
    In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023
    : Dynamic Grasping | Reinforcement Learning | Pose Estimation | Closed-Loop Control | Visual Servoing
  2. tactilepose.png
    Tactile Pose Feedback for Closed-Loop Manipulation Tasks
    Kei Ota, Siddarth Jain, Mengchao Zhang, and Devesh K Jha
    In Robotics: Science and Systems 2023 Workshop on Learning Dexterous Manipulation, 2023
  3. LLM-NeurIPS.png
    Interactive Planning Using Large Language Models for Partially Observable Robotics Tasks
    Lingfeng Sun, Devesh K. Jha, Chiori Hori, Siddarth Jain, Radu Corcodel, Xinghao Zhu, Masayoshi Tomizuka, and Diego Romeres
    In Advances in Neural Information Processing Systems (NeurIPS) Workshop on Instruction Tuning and Instruction Following, 2023
  4. adaptive.png
    Design of Adaptive Compliance Controllers for Safe Robotic Assembly
    Devesh K Jha, Diego Romeres, Siddarth Jain, William Yerazunis, and Daniel Nikovski
    In Proceedings of the European Control Conference (ECC), 2023
  5. 4hdemo.gif
    Generalizable Human-Robot Collaborative Assembly using Imitation Learning and Force Control
    Devesh K Jha, Siddarth Jain, Diego Romeres, William Yerazunis, and Daniel Nikovski
    In Proceedings of the European Control Conference (ECC), 2023
    : Imitation Learning | Collaborative Assembly | Compliant Control | Computer Vision
  6. strug.gif
    Task-Directed Exploration in Continuous POMDPs for Robotic Manipulation of Articulated Objects
    Aidan Curtis, Leslie Kaelbling, and Siddarth Jain
    In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2023
    : Articulated Object Manipulation | POMDPs | Task Uncertainty | TAMP
  7. pivoting.png
    Learning Generalizable Pivoting Skills
    Xiang Zhang, Siddarth Jain, Baichuan Huang, Masayoshi Tomizuka, and Diego Romeres
    In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2023
    : Pivoting Manipulation | Reinforcement Learning | Skill Learning
  8. food.png
    Vision Guided Food Assembly by Robot Teaching from Target Composition
    Siddarth Jain, Radu Corcodel, Devesh K Jha, and Diego Romeres
    In ICRA Workshop on Task Informed Grasping From Farm to Fork, 2023
    : Food Assembly | Food Manipulation | Computer Vision | Learning from Demonstration
  9. instaseg.png
    Discriminative 3D Shape Modeling for Few-Shot Instance Segmentation
    Anoop Cherian, Siddarth Jain, Tim K Marks, and Alan Sullivan
    In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2023
    : Instance Segmentation | Shape Modeling | Few-Shot Learning | Computer Vision
  10. pivoting2.png
    Learning Generalizable Pivoting Skills with Object Feature Based State/Action Projections
    Xiang Zhang, Siddarth Jain, Baichuan Huang, Masayoshi Tomizuka, and Diego Romeres
    In ICRA Workshop on Effective Representations, Abstractions, and Priors for Robot Learning (RAP4Robots), 2023
    : Pivoting Manipulation | Reinforcement Learning | Skill Learning

2022

  1. imprints.png
    Learning to Synthesize Volumetric Meshes from Vision-Based Tactile Imprints
    Xinghao Zhu, Siddarth Jain, Masayoshi Tomizuka, and Jeroen Van Baar
    In Proceedings of the International Conference on Robotics and Automation (ICRA), 2022
    : Tactile Perception | Volumetric Meshes | Reconstruction | Representation Learning

2021

  1. InSeGAN.png
    InSeGAN: A Generative Approach to Segmenting Identical Instances in Depth Images
    Anoop Cherian, Gonçalo Dias Pais, Siddarth Jain, Tim K Marks, and Alan Sullivan
    In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021
    : Instance Segmentation | Generative Models | Bin Picking | Sim-to-Real | Computer Vision
  2. tactile_data.png
    Visual 3D Perception for Interactive Robotic Tactile Data Acquisition
    Siddarth Jain, Radu Corcodel, and Jeroen Baar
    In Proceedings of the IEEE International Conference on Automation Science and Engineering (CASE), 2021
    : Object Exploration | Interactive Robotics | Visual–Tactile | Tactile Perception

2020

  1. interactivetactile.png
    Interactive Tactile Perception for Classification of Novel Object Instances
    Radu Corcodel, Siddarth Jain, and Jeroen Baar
    In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020

2019

  1. THRI.gif
    Probabilistic Human Intent Recognition for Shared Autonomy in Assistive Robotics
    Siddarth Jain and Brenna Argall
    ACM Transactions on Human-Robot Interaction (THRI), 2019
    : Shared Autonomy | Human Intent Recognition | Bayesian Inference | Assistive Robotics | HRI

2018

  1. RBII.png
    Recursive Bayesian Human Intent Recognition in Shared-Control Robotics
    Siddarth Jain and Brenna Argall
    In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018
    : Human Intent Recognition | Bayesian Filtering | Shared Autonomy | HRI

2017

  1. surfacegeom.png
    Estimation of Surface Geometries in Point Clouds for the Manipulation of Novel Household Objects
    Siddarth Jain and Brenna Argall
    In RSS Workshop on Spatial-Semantic Representations in Robotics, Cambridge, MA, USA, 2017
    : Surface Geometry | Point Clouds | Shape Reconstruction | Representation Learning

2016

  1. ralhri.jpg
    Human-in-the-Loop Optimization of Shared Autonomy in Assistive Robotics
    Deepak Gopinath, Siddarth Jain, and Brenna D Argall
    IEEE Robotics and Automation letters (RA-L), 2016
    : Shared Autonomy | Online Optimization | User-Centered Design | Assistive Robotics | HRI
  2. grasp.png
    Grasp Detection for Assistive Robotic Manipulation
    Siddarth Jain and Brenna Argall
    In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2016
    : Grasping | Shape Primitives | Point Clouds | Grasp Detection
  3. wave-mechanics.gif
    Robot Learning to Switch Control Modes for Assistive Teleoperation
    Siddarth Jain and Brenna Argall
    In RSS Workshop on Planning for Human-Robot Interaction: Shared Autonomy and Collaborative Robotics, 2016
  4. arbitration.png
    An Approach for Online User Customization of Shared Autonomy for Intelligent Assistive Devices
    Siddarth Jain and Brenna Argall
    In ICRA Workshop, 2016

2015

  1. dicta.gif
    Automated and Objective Assessment of Surgical Training: Detection of Procedural Steps on Videotaped Performances
    Siddarth Jain, Katherine A Barsness, and Brenna Argall
    In Proceedings of the International Conference on Digital Image Computing: Techniques and Applications (DICTA), 2015
    : Video-Based Assessment | Skill Assessment | Computer Vision
  2. bmi.png
    Assistive Robotic Manipulation through Shared Autonomy and a Body-Machine Interface
    Siddarth Jain, Ali Farshchiansadegh, Alexander Broad, Farnaz Abdollahi, Ferdinando Mussa-Ivaldi, and Brenna Argall
    In Proceedings of the IEEE International Conference on Rehabilitation Robotics (ICORR), 2015
    : Body-Machine Interface | Shared Control | Assistive Robotics

2014

  1. docking.gif
    Automated Perception of Safe Docking Locations with Alignment Information for Assistive Wheelchairs
    Siddarth Jain and Brenna Argall
    In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2014
    : Docking Detection | Point Clouds | Computer Vision | Assistive Robotics