Active Obstacle Detection System Based on Video Recognition and Lidar Information Fusion
Keywords:Obstacle detection, Convolutional neural network, Autonomous driving, Rail transit
In terms of the requirements for obstacle detection in the rail transit application field, an architecture and implementation method for active obstacle detection system based on the fusion of video recognition and lidar information is proposed. The studies on the video recognition algorithms based on deep learning neural network and lidar for orbit area recognition, pedestrian vehicle recognition, and small foreign object recognition are analyzed, and the necessity of the fusion of video recognition and lidar data and the related key technical points are discussed. Through the tests on domestic metro and tram lines, the feasibility of the scheme is verified, and the technical parameters are optimized, which can effectively reduce the probability of accidents caused by foreign object intrusion.
Gowtham, R. (2016). Obstacle Detection and Avoidance Methods for Autonomous Mobile Robot. International Journal of Science & Research, 5(1), 1245-1249.
He, K., Gkioxari G, Dollar P, et al. (2020). Mask R-CNN. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42(2), 386-397.
Hua, C. (2019). Tensorflow and convolutional neural network: from algorithm introduction to project practice. Beijing: Publishing House of Electronics Industry.
Kim, J., & Cho, J. (2019). YOLO-based real-time object detection scheme combining RGB image with LiDAR point cloud. Journal of Korean Institute of Information Technology, 17(8), 93-105.
Lin, G., Liu, F., Milan, A., Shen, C., & Reid, I. (2019). Refinenet: Multi-path refinement networks for dense prediction. IEEE transactions on pattern analysis and machine intelligence, 42(5), 1228-1242. https://doi.org/10.1109/TPAMI.2019.2893630
Ople, J. J. M., Yeh, P. Y., Sun, S. W., Tsai, I. T., & Hua, K. L. (2020). Multi-Scale Neural Network with Dilated Convolutions for Image Deblurring. IEEE Access, 8, 53942-53952. https://doi.org/10.1109/ACCESS.2020.2980996
Ren, S., He, K., Girshick, R., & Sun, J. (2017). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE transactions on pattern analysis and machine intelligence, 39(6), 1137-1149. https://doi.org/10.1109/tpami.2016.2577031
How to Cite
Copyright (c) 2020 Jiang Yaodong
This work is licensed under a Creative Commons Attribution 4.0 International License.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.