Sanket Salunkhe

Robotics researcher working on autonomous aerial and multi-robot systems, with interests in perception, planning, learning, and control.

Sanket Salunkhe's Picture
NYU Agile Robotics & Perception Lab

Robotics Research Scientist

NYU Agile Robotics & Perception Lab

The fundamental and applied research in the area of robotics autonomy aim to create agile autonomous machines.

Focus: ROS, ROS2, OpenVINS, VIO, UAV, C++, Photogrammetry, Jetson, Path Planning, Trajectory Planning

Robotics Lab

NYU Agile Robotics & Perception Lab

Robotics Research Scientist

The fundamental and applied research in the area of robotics autonomy aim to create agile autonomous machines.

Period
August 2022
Focus
ROS, ROS2, OpenVINS, VIO, UAV, C++, Photogrammetry, Jetson, Path Planning, Trajectory Planning

As a Robotics Research Scientist at the NYU ARPL, my role involves being a key contributor to the UAV Autonomy pipeline, especially in Perception, Planning and SLAM. The lab’s primary focus is on developing autonomous and agile UAVs.

Responsibilities and Accomplishments:

  1. Autonomous UAV Pipeline Development in ROS2:
    • Collaborated with a team of PhD researchers to develop a UAV Autonomy pipeline in ROS2 C++.
    • Implemented quadrotor geometric controller, RVIZ-based simulation, trajectory generation module, and trajectory tracking algorithm.
    • Developed a ROS2-based VICON tracking and localizing package.
  2. Modification & Deployment of OpenVINS VIO on UAV platform:
    • Customized the open-source VIO algorithm, OpenVINS, to handle platform vibrations and feature loss effectively.
    • Optimized the VIO algorithm for our specific use case on the UAV RACE platform.
    • Deployed the modified algorithm on NVIDIA Jetson boards, utilizing approximately 70% of the computation power for reliable UAV performance.
  3. UAV Autonomy Pipeline for NIST UAS First Responder Challenge:
    • Engineered a customized UAV autonomy pipeline for the NIST UAS First Responder Challenge.
    • Addressed competition-specific requirements, including localization, mapping, control, GUI, and navigation.
    • Contributed to NYU’s participation in the prestigious NIST UAV First Responder Challenge, showcasing an advanced autonomous stack and achieving recognition in the competition.
COAST Autonomous

Robotics Engineer Intern

COAST Autonomous

A self-driving technology company providing mobility solutions to move people and goods at appropriate speeds in urban, industrial, and campus environments

Focus: Deep Learning, C++, ROS, Computer Vision, Ubuntu, Git

Autonomous Vehicle

COAST Autonomous

Robotics Engineer Intern

A self-driving technology company providing mobility solutions to move people and goods at appropriate speeds in urban, industrial, and campus environments

Period
May 2022 – August 2022
Focus
Deep Learning, C++, ROS, Computer Vision, Ubuntu, Git

At COAST Autonomous, I worked as a Robotics Engineer Intern, contributing my skills and knowledge to the development of cutting-edge technologies in the field of autonomous vehicles.

Key Responsibilities and Achievements:

  1. Trajectory Prediction of Surrounding Traffic Agents: Developed a novel RNN-LSTM seq-to-seq model for predicting the motion of traffic agents in urban and high-traffic environments, achieving an impressive 80% accuracy.

  2. Semantic Segmentation for Driving Space Detection: Utilized DeepLabV3 segmentation model on Cityscape dataset to accurately identify drivable spaces and obstacles in rural and construction areas.

  3. Dynamic Environment Perception: Addressed challenges in AV navigation by developing solutions for navigating urban and densely populated areas.

  4. Autonomous Vehicle Development: Played a role in the advancement of autonomous vehicle technology, contributing to the development of vehicles.

  5. Industry Exposure: Gained practical insights into real-world autonomous vehicle projects, enhancing skills and knowledge in robotics engineering.

Robolab Technologies

Associate Robotics Engineer

Robolab Technologies

National award winning eduTech startup focused on delivering cutting edge knowledge about Robotics, Artificial Intelligence, and IoT

Focus: AutoCAD, Fusion360, 3D Printing (FDM & SLA), Python, IoT

Robotics

Robolab Technologies

Associate Robotics Engineer

National award winning eduTech startup focused on delivering cutting edge knowledge about Robotics, Artificial Intelligence, and IoT

Period
June 2019 – June 2021
Focus
AutoCAD, Fusion360, 3D Printing (FDM & SLA), Python, IoT

The career starting role at Robolab helps me to accelerate my research and product development skills in the areas of IoT, AI, and Robotics.

Key Responsibilities and Achievements:

  1. Mechanical Design: Applied my experties in CAD, DFMA and CAE to create high-quality and reliable mechanical robotic systems adhering to industry-level standards..

  2. Seamless Integration: Developed a comprehensive product from inception, encompassing mechanical design, electronics setup, and advanced programming for seamless integration.

  3. Robotics Research Platform: Spearheaded the development of a cutting-edge Turtlebot robotic platform, seamlessly integrating a 2D LiDAR based G-mapping SLAM algorithm for mapping and localization.

  4. Product Development: Designed 3 robotics-based educational kits catering to diverse age groups, fostering practical learning experiences.

  5. Collaboration and Teamwork: Brainstormed and implemented innovative project ideas, designing hardware, programming software and control systems.

  6. Collaborated effectively with a multidisciplinary team of engineers, educators, and designers.

  7. Hands-on Workshops & Talks: Conducted engaging workshops on robotics arm and training sessions for students, teachers, and industry professionals.

Visual Inertial SLAM
SLAM

Visual Inertial SLAM

Stereo-IMU-based VI-SLAM algorithm based on reference from ORB, OpenVINS, and VINSMono.

SLAM

Visual Inertial SLAM

Stereo-IMU-based VI-SLAM algorithm based on reference from ORB, OpenVINS, and VINSMono.

Period
November 2023

More Description about project in few days once implementation is done.

Q-Learning Controller
Reinforcement Learning

Q-Learning Controller

Pendulum swing-Up controller based on Q-Learning method.

Reinforcement Learning

Q-Learning Controller

Pendulum swing-Up controller based on Q-Learning method.

Period
November 2023

Developed a Q-learning controller for a multi-variate system, and tested on torque-controlled inverted pendulum. Improved learning efficiency by 73% & reduced learning time by 15% via integration of ϵ-greedy policy.

LQR/iLQR Controller
Reinforcement Learning

LQR/iLQR Controller

A LQR and iLQR controller for performing acrobatic action of 2D Quadrotor.

Reinforcement Learning

LQR/iLQR Controller

A LQR and iLQR controller for performing acrobatic action of 2D Quadrotor.

Period
November 2023

Developed & implemented an LQR and iLQR controller for precise position & trajectory tracking of a quadrotor in disturbance-prone environments with 0.01m accuracy. It is designed with line search optimization for acrobatic maneuvers & local minima avoidance

Semantic Segmentation
Deep Learning

Semantic Segmentation

Semantic segmentation to find drivable space using DeepLabV3 model.

Deep Learning

Semantic Segmentation

Semantic segmentation to find drivable space using DeepLabV3 model.

Period
November 2023

More Description about project in few days once implementation is done.

RNN-LSTM Trajectory Predictore
Neural Network

RNN-LSTM Trajectory Predictore

Trajectory prediction of surrounding traffic agents using RNN-LSTM algorithm.

Neural Network

RNN-LSTM Trajectory Predictore

Trajectory prediction of surrounding traffic agents using RNN-LSTM algorithm.

Period
November 2023

An RNN-LSTM Seq-2Seq model which was trained on the Apollo dataset for better autonomous motion. It is able to predict future 5 positions of surrounding traffic agents based on the past 10 position sequence. It was integrated with vehicle MPC control algorithm for smooth autonomous motion.

Kalman Filter Localization
Localization

Kalman Filter Localization

UAV Localization using EKF, UKF, and Optical Flow

Localization

Kalman Filter Localization

UAV Localization using EKF, UKF, and Optical Flow

Period
November 2023

Localize a quadrotor based on EKF and UKF by Sensor fusion of IMU and Vicon data. Developed an optical flow algorithm to localize the quadrotor and establish its velocity. Integrated visual Optical flow and IMU data to localize a quadrotor & compare with Vicon ground truth.