Skip to content

Implement vision-lidar track creation policy

Description

Track creation inside of the tracker is a tricky task. The naive way of just creating a track from any single input is complicated for a variety of reasons:

  • creating tracks from clusters is hard as there are a lot of clusters that we don't want to track
  • creating tracks from images is hard as there is no 3D information

So we need to create tracks with a combination of these inputs. A good synergy I am aware of is 3D LiDAR clusters + camera detections, but there might be more. This issue is to track the design and creation of such a module.

Desired Behavior

There is a module (a node or a library) that is able to get different inputs and reliably create tracks from it within the bigger context of the whole tracker and sensor fusion pipeline.

Definition of Done

  • There is a configurable track creation procedure
  • Track creation procedure that uses vision and lidar is implemented
  • Efficiency considerations are taken into account
  • Synchronize lidar-vision messages before association
Edited by Gowtham Ranganathan