Freespace Optical Flow Modeling for Intelligent Vehicles
Yi Feng
Ruge Zhang
Jiayuan Du
Qijun Chen
Rui Fan
[Paper]
[GitHub]
The code can be found in this repository.

Abstract

Optical flow and disparity are two informative visual features for autonomous driving perception. They have been used for a variety of applications, such as obstacle and lane detection. The concept of "U-V-Disparity" has been widely explored in the literature, while its counterpart in optical flow has received relatively little attention. Traditional motion analysis algorithms estimate optical flow by matching correspondences between two successive video frames, which limits the full utilization of environmental information and geometric constraints. Therefore, we propose a novel strategy for modeling optical flow in the collision-free space (also referred to as drivable area or simply freespace) for intelligent vehicles with the full utilization of geometry information in a 3D driving environment. We provide explicit representations of optical flow and deduce the quadratic relationship between the optical flow component and the vertical coordinate. Through extensive experiments on several public datasets, we demonstrate the high accuracy and robustness of our model. Additionally, our proposed freespace optical flow model has a wide range of autonomous driving applications, providing a geometric constraint in freespace detection, vehicle localization, and more. We have made our source code and demo video publicly available at https://mias.group/fsof/.


Acknowledgements

This work was supported by the National Key R&D Program of China under Grant 2020AAA0108100, the National Natural Science Foundation of China under Grant 62233013, the Science and Technology Commission of Shanghai Municipal under Grant 22511104500, and the Fundamental Research Funds for the Central Universities.