xLAB for Safe Autonomous Systems
xLAB for Safe Autonomous Systems
  • 422
  • 424 705
Dinesh Manocha MAD Games Workshop at ICRA 2024
MAD Games workshop on Multi-Agent Dynamic Games at ICRA 2024 was organized by Rahul Mangharam, Hongrui Zheng, Shuo Yang, Johannes Betz and Venkat Krovi. icra2024-madgames.f1tenth.org/
In decentralized multi-robot navigation, ensuring safe and efficient movement with limited environmental awareness remains a challenge. Traditional navigation, based on local observations, often falters in complex environments. A potential solution is to enhance the understanding of the world through inter-agent communication; however, mere information broadcasting lacks efficiency. This work addresses the challenge by simultaneously learning decentralized multi-robot collision avoidance and selective inter-agent communication. Our method leverages a visual transformer and self-attention mechanism to encode local occupancy maps and the state information of neighboring agents into fixed-length encodings, facilitating the handling of an arbitrary number of neighbors for collision-free navigation. We focus on improving navigation performance through selective communication, casting the communication selection as a link prediction problem. The network determines the necessity of establishing a communication link with specific neighbors based on observable state information. We consider communicating the agent's goal information with their relevant neighbors. Additionally, we also explore what to communicate by encoding the agent’s state and observation information into a fixed-length message vector, communicated in lieu of only goal information. The communicated information enhances the neighbor's observation and aids in selecting an appropriate navigation plan. By training the network end-to-end, we concurrently learn the optimal weights for the observation encoder, communication selection, and navigation components. Our approach demonstrates significant benefits by achieving safe and efficient navigation among multiple robots in dense and challenging environments. Comparative evaluations against various learning-based and model-based baselines demonstrate our superior navigation performance, resulting in an impressive improvement of up to 24% in success rates within complex evaluation scenarios. Additionally, we evaluate our method against state-of-the-art baselines in complex scenarios, including narrow corridors and environments with multiple agents, observing considerable improvements in navigation performance. This includes up to approximately a 2x improvement in navigation success rates and a reduction of up to approximately 20% in path length.
Dinesh Manocha is Paul Chrisman-Iribe Chair in Computer Science & ECE and Distinguished University Professor at University of Maryland College Park. His research interests include virtual environments, physically-based modeling, and robotics. His group has developed a number of software packages that are standard and licensed to 60+ commercial vendors. He has published more than 750 papers & supervised 50 PhD dissertations. He is a Fellow of AAAI, AAAS, ACM, IEEE, and NAI and member of ACM SIGGRAPH and IEEE VR Academies, and Bézier Award from Solid Modeling Association. He received the Distinguished Alumni Award from IIT Delhi the Distinguished Career in Computer Science Award from Washington Academy of Sciences. He was a co-founder of Impulsonic, a developer of physics-based audio simulation technologies, which was acquired by Valve Inc in November 2016.
Переглядів: 85

Відео

Georgios Fainekos MAD Games Workshop at ICRA 2024
Переглядів 49Місяць тому
MAD Games workshop on Multi-Agent Dynamic Games at ICRA 2024 was organized by Rahul Mangharam, Hongrui Zheng, Shuo Yang, Johannes Betz and Venkat Krovi. icra2024-madgames.f1tenth.org/ Multi-robot systems have improved efficiency of operations in warehouses, factories, and now also in medical facilities. Despite their success, operational challenges persist in unstructured environments, confined...
Morteza Lahijanian MAD Games Workshop at ICRA 2024
Переглядів 50Місяць тому
MAD Games workshop on Multi-Agent Dynamic Games at ICRA 2024 was organized by Rahul Mangharam, Hongrui Zheng, Shuo Yang, Johannes Betz and Venkat Krovi. icra2024-madgames.f1tenth.org/ As robots gain capabilities to enter our human-centric world, they require formalism and algorithms that enable smart and efficient interactions. This is challenging especially for robotic manipulators with comple...
Javier Alonso Mora MAD Games Workshop at ICRA 2024
Переглядів 43Місяць тому
MAD Games workshop on Multi-Agent Dynamic Games at ICRA 2024 was organized by Rahul Mangharam, Hongrui Zheng, Shuo Yang, Johannes Betz and Venkat Krovi. icra2024-madgames.f1tenth.org/ This talk explores the evolution and future direction of perception systems for autonomous vehicles and my own work in this context. I argue that the first generation of perception systems consisted of manually la...
Sabine Hauert MAD Games Workshop at ICRA 2024
Переглядів 38Місяць тому
MAD Games workshop on Multi-Agent Dynamic Games at ICRA 2024 was organized by Rahul Mangharam, Hongrui Zheng, Shuo Yang, Johannes Betz and Venkat Krovi. icra2024-madgames.f1tenth.org/ Sabine Hauert is Associate Professor (Reader) of Swarm Engineering at the University of Bristol in the UK. Her research focuses on making swarms for people, and across scales, from nanorobots for cancer treatment,...
Eugene Vinitsky MAD Games Workshop at ICRA 2024
Переглядів 20Місяць тому
MAD Games workshop on Multi-Agent Dynamic Games at ICRA 2024 was organized by Rahul Mangharam, Hongrui Zheng, Shuo Yang, Johannes Betz and Venkat Krovi. icra2024-madgames.f1tenth.org/ Various types of KL-regularization towards human data have started to demonstrate the ability to empirically resolve challenges of equilibrium selection in many-player games. Unfortunately, very few domains have l...
Quanyan Zhu MAD Games Workshop at ICRA 2024
Переглядів 23Місяць тому
MAD Games workshop on Multi-Agent Dynamic Games at ICRA 2024 was organized by Rahul Mangharam, Hongrui Zheng, Shuo Yang, Johannes Betz and Venkat Krovi. icra2024-madgames.f1tenth.org/ Multiple robots are often required to collectively complete complex tasks in smart manufacturing, transportation systems, and human-robot collaborations. Teaming and coordination are essential to enable collective...
Holger Caesar MAD Games Workshop at ICRA 2024
Переглядів 58Місяць тому
MAD Games workshop on Multi-Agent Dynamic Games at ICRA 2024 was organized by Rahul Mangharam, Hongrui Zheng, Shuo Yang, Johannes Betz and Venkat Krovi. icra2024-madgames.f1tenth.org/ This talk explores the evolution and future direction of perception systems for autonomous vehicles and my own work in this context. I argue that the first generation of perception systems consisted of manually la...
Ardalan Tajbakhsh MAD Games Workshop at ICRA 2024
Переглядів 162Місяць тому
MAD Games workshop on Multi-Agent Dynamic Games at ICRA 2024 was organized by Rahul Mangharam, Hongrui Zheng, Shuo Yang, Johannes Betz and Venkat Krovi. icra2024-madgames.f1tenth.org/ This talk focuses on two key aspects of the multi-agent motion planning problem in mixed environments. First, the majority of the traditional multi-agent planning algorithms rely on simplifying assumptions about t...
State Estimation and Bayes Filter
Переглядів 173Місяць тому
State Estimation and Bayes Filter
Autoware CoE University of Pennsylvania team wins Autonomous Karting Series 2024
Переглядів 2292 місяці тому
🏎️ The Autoware CoE team at University of Pennsylvania participated in the Autonomous Karting Series National Grand Prix at Purdue University on May 20-24 and celebrated the victory 🏆 in both open and reactive categories. 🏁 The Autoware CoE team has been using the fully open-sourced AV4EV Go-Kart*. 📢 Results from the AKS National Grand Prix: Reactive Category 🥇Autoware CoE at the University of ...
Autoware Center of Excellence - April 23 Members Meeting
Переглядів 1063 місяці тому
Today we invite our newest CoE Member, Prof. Holger Caesar from TU Delft. 0. Holger was the lead for NuPlan, which has led to many exciting papers in the last year. He will talk about his research in autonomous driving and safety evaluation at scale. Following this, we will have updates from members, including: 1. Autoware Workshop at IEEE IV [Alex] 2. Summary of visit to China to recruit new C...
F1Tenth Intro Orange
Переглядів 604 місяці тому
F1Tenth Intro Orange
F1Tenth Intro Pink
Переглядів 264 місяці тому
F1Tenth Intro Pink
Autoware CoE Steering Committee - March 26, 2024
Переглядів 484 місяці тому
Autoware CoE Steering Committee - March 26, 2024
Autoware Safe Autonomy Seminar - Junfeng Zhao
Переглядів 694 місяці тому
Autoware Safe Autonomy Seminar - Junfeng Zhao
F1Tenth Intro Blue
Переглядів 444 місяці тому
F1Tenth Intro Blue
Autoware Center of Excellence - Feb 27 Steering Committee Meeting
Переглядів 725 місяців тому
Autoware Center of Excellence - Feb 27 Steering Committee Meeting
Yash Pant - Autoware Safe Autonomy Seminar
Переглядів 2605 місяців тому
Yash Pant - Autoware Safe Autonomy Seminar
Autonomous Material Transportation Product Market Fit
Переглядів 2078 місяців тому
Autonomous Material Transportation Product Market Fit
xlAB UPenn Safe Autonomy Seminar - Cillian Brewitt
Переглядів 1298 місяців тому
xlAB UPenn Safe Autonomy Seminar - Cillian Brewitt
Lei Ma - Autoware Safe Autonomy Seminar
Переглядів 1848 місяців тому
Lei Ma - Autoware Safe Autonomy Seminar
CyberCardia: Patient-specific Electrophysiological heart mode - Jiyue He's PhD defense Q&A
Переглядів 378 місяців тому
CyberCardia: Patient-specific Electrophysiological heart mode - Jiyue He's PhD defense Q&A
CyberCardia: Patient-specific heart model - Jiyue He, PhD defense
Переглядів 888 місяців тому
CyberCardia: Patient-specific heart model - Jiyue He, PhD defense
Safety21 Update - Rahul Mangharam October 2023
Переглядів 1549 місяців тому
Safety21 Update - Rahul Mangharam October 2023
TinyML Course at UPenn - Revolutionizing Bee Keeping
Переглядів 4059 місяців тому
TinyML Course at UPenn - Revolutionizing Bee Keeping
Moral Decision Making for Autonomous Systems - Rahul Mangharam
Переглядів 2259 місяців тому
Moral Decision Making for Autonomous Systems - Rahul Mangharam
IROS'24 MAD Games: Multi-Agent Dynamic Games Workshop - Contributed Session 2
Переглядів 1339 місяців тому
IROS'24 MAD Games: Multi-Agent Dynamic Games Workshop - Contributed Session 2
IROS'24 MAD Games: Multi-Agent Dynamic Games Workshop - Contributed Session 1
Переглядів 929 місяців тому
IROS'24 MAD Games: Multi-Agent Dynamic Games Workshop - Contributed Session 1
Manxi Wu - Multi-Agent Reinforcement Learning in Markov Potential Games and Beyond
Переглядів 2169 місяців тому
Manxi Wu - Multi-Agent Reinforcement Learning in Markov Potential Games and Beyond