A Safer Vision-based Autonomous Planning System for Quadrotor UAVs with Dynamic Obstacle Trajectory Prediction and Its Application with LLMs
2024 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW)(2023)
摘要
For intelligent quadcopter UAVs, a robust and reliable autonomous planning
system is crucial. Most current trajectory planning methods for UAVs are
suitable for static environments but struggle to handle dynamic obstacles,
which can pose challenges and even dangers to flight. To address this issue,
this paper proposes a vision-based planning system that combines tracking and
trajectory prediction of dynamic obstacles to achieve efficient and reliable
autonomous flight. We use a lightweight object detection algorithm to identify
dynamic obstacles and then use Kalman Filtering to track and estimate their
motion states. During the planning phase, we not only consider static obstacles
but also account for the potential movements of dynamic obstacles. For
trajectory generation, we use a B-spline-based trajectory search algorithm,
which is further optimized with various constraints to enhance safety and
alignment with the UAV's motion characteristics. We conduct experiments in both
simulation and real-world environments, and the results indicate that our
approach can successfully detect and avoid obstacles in dynamic environments in
real-time, offering greater reliability compared to existing approaches.
Furthermore, with the advancements in Natural Language Processing (NLP)
technology demonstrating exceptional zero-shot generalization capabilities,
more user-friendly human-machine interactions have become feasible, and this
study also explores the integration of autonomous planning systems with Large
Language Models (LLMs).
更多查看译文
关键词
Unmanned Aerial Vehicles,Trajectory Prediction,Dynamic Obstacles,Large Language Models,Natural Language,Autonomic System,Simulation Experiments,Dynamic Environment,Object Detection,Simulation Environment,Kalman Filter,Autonomous Vehicles,Experimental Environment,Motion State,Real-world Environments,Static Environment,Human-machine Interaction,Trajectory Planning,Trajectory Generation,Static Obstacles,Trajectory Optimization,Obstacle Avoidance,Simultaneous Localization And Mapping,Unmanned Aerial Vehicle Flight,Local Map,Control Points,Occupancy Map,Point Cloud Data,Convex Hull,Point Cloud
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要