{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,18]],"date-time":"2026-07-18T11:10:52Z","timestamp":1784373052942,"version":"3.55.0"},"reference-count":79,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2022,2,13]],"date-time":"2022-02-13T00:00:00Z","timestamp":1644710400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"This research was funded by the AGH University of Science and Technology","award":["16.16.120.773"],"award-info":[{"award-number":["16.16.120.773"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The ability of artificial intelligence to drive toward an intended destination is a key component of an autonomous vehicle. Different paradigms are now being employed to address artificial intelligence advancement. On the one hand, modular pipelines break down the driving model into submodels, such as perception, maneuver planning and control. On the other hand, we used the end-to-end driving method to assign raw sensor data directly to vehicle control signals. The latter is less well-studied but is becoming more popular since it is easier to use. This article focuses on end-to-end autonomous driving, using RGB pictures as the primary sensor input data. The autonomous vehicle is equipped with a camera and active sensors, such as LiDAR and Radar, for safe navigation. Active sensors (e.g., LiDAR) provide more accurate depth information than passive sensors. As a result, this paper examines whether combining the RGB from the camera and active depth information from LiDAR has better results in end-to-end artificial driving than using only a single modality. This paper focuses on the early fusion of multi-modality and demonstrates how it outperforms a single modality using the CARLA simulator.<\/jats:p>","DOI":"10.3390\/s22041425","type":"journal-article","created":{"date-parts":[[2022,2,13]],"date-time":"2022-02-13T20:34:45Z","timestamp":1644784485000},"page":"1425","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["Navigating an Automated Driving Vehicle via the Early Fusion of Multi-Modality"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6450-1715","authenticated-orcid":false,"given":"Malik","family":"Haris","sequence":"first","affiliation":[{"name":"School of Information Science and Technology, Xipu Campus, Southwest Jiaotong University, Chengdu 611756, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0546-7083","authenticated-orcid":false,"given":"Adam","family":"Glowacz","sequence":"additional","affiliation":[{"name":"Department of Automatic Control and Robotics, Faculty of Electrical Engineering, Automatics, Computer Science and Biomedical Engineering, AGH University of Science and Technology, Al. A. Mickiewicza 30, 30-059 Krakow, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Garcia-Bedoya, O., Hirota, S., and Ferreira, J.V. (2019, January 19\u201320). Control system design for an automatic emergency braking system in a sedan vehicle. Proceedings of the 2019 2nd Latin American Conference on Intelligent Transportation Systems (ITS LATAM), Bogota, Colombia.","DOI":"10.1109\/ITSLATAM.2019.8721353"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1007\/s10111-021-00673-0","article-title":"User-centred design evaluation of symbols for adaptive cruise control (ACC) and lane-keeping assistance (LKA)","volume":"23","author":"Perrier","year":"2021","journal-title":"Cogn. Technol. Work"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Haris, M., and Hou, J. (2020). Obstacle Detection and Safely Navigate the Autonomous Vehicle from Unexpected Obstacles on the Driving Lane. Sensors, 20.","DOI":"10.3390\/s20174719"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"7246","DOI":"10.1109\/TII.2021.3058948","article-title":"Integrated Crash Avoidance and Mitigation Algorithm for Autonomous Vehicles","volume":"17","author":"Qin","year":"2021","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1115\/1.3140633","article-title":"Optimum Vehicle Suspensions Minimizing RMS Rattlespace, Sprung-Mass Acceleration and Jerk","volume":"103","author":"Hrovat","year":"1981","journal-title":"J. Dyn. Syst. Meas. Control"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Huang, Q., and Wang, H. (2004). Fundamental Study of Jerk: Evaluation of Shift Quality and Ride Comfort, State Key Laboratory of Automotive Safety and Energy Tsinghua University. SAE Technical Paper.","DOI":"10.4271\/2004-01-2065"},{"key":"ref_7","unstructured":"Lv, Q., Sun, X., Chen, C., Dong, J., and Zhou, H. (2021). Parallel Complement Network for Real-Time Semantic Segmentation of Road Scenes. IEEE Trans. Intell. Transp. Syst., 1\u201313."},{"key":"ref_8","unstructured":"Hamian, M.H., Beikmohammadi, A., Ahmadi, A., and Nasersharif, B. (2021, January 3\u20134). Semantic Segmentation of Autonomous Driving Images by the combination of Deep Learning and Classical Segmentation. Proceedings of the 2021 26th International Computer Conference, Computer Society of Iran (CSICC), Tehran, Iran."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhou, K., Zhan, Y., and Fu, D. (2021). Learning Region-Based Attention Network for Traffic Sign Recognition. Sensors, 21.","DOI":"10.3390\/s21030686"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Yang, B., Luo, W., and Urtasun, R. (2018, January 18\u201322). Pixor: Real-time 3d object detection from point clouds. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00798"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Qi, C.R., Liu, W., Wu, C., Su, H., and Guibas, L.J. (2018, January 18\u201323). Frustum pointnets for 3d object detection from rgb-d data. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00102"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Haris, M., and Glowacz, A. (2021). Road object detection: A comparative study of deep learning-based algorithms. Electronics, 10.","DOI":"10.3390\/electronics10161932"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Haris, M., and Glowacz, A. (2021). Lane Line Detection Based on Object Feature Distillation. Electronics, 10.","DOI":"10.3390\/electronics10091102"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"116413","DOI":"10.1016\/j.image.2021.116413","article-title":"Multi-scale spatial convolution algorithm for lane line detection and lane offset estimation in complex road conditions","volume":"99","author":"Haris","year":"2021","journal-title":"Signal Process. Image Commun."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Haris, M., Hou, J., and Wang, X. (2021). Lane Lines Detection under Complex Environment by Fusion of Detection and Prediction Models. Transp. Res. Rec., 03611981211051334.","DOI":"10.1177\/03611981211051334"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Haris, M., Hou, J., and Wang, X. (2022). Lane line detection and departure estimation in a complex environment by using an asymmetric kernel convolution algorithm. Vis. Comput., 1\u201320.","DOI":"10.1007\/s00371-021-02353-6"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Gurram, A., Urfalioglu, O., Halfaoui, I., Bouzaraa, F., and L\u00f3pez, A.M. (2018, January 26\u201330). Monocular depth estimation by learning from heterogeneous datasets. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Suzhou, China.","DOI":"10.1109\/IVS.2018.8500683"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Gan, Y., Xu, X., Sun, W., and Lin, L. (2018, January 8\u201314). Monocular depth estimation with affinity, vertical pooling, and label enhancement. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01219-9_14"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Fu, H., Gong, M., Wang, C., Batmanghelich, K., and Tao, D. (2018, January 18\u201322). Deep ordinal regression network for monocular depth estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00214"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Shin, Y.-S., Park, Y.S., and Kim, A. (2018, January 21\u201325). Direct visual slam using sparse depth for camera-lidar system. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8461102"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Qiu, K., Ai, Y., Tian, B., Wang, B., and Cao, D. (2018, January 26\u201330). Siamese-ResNet: Implementing loop closure detection based on Siamese network. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Suzhou, China.","DOI":"10.1109\/IVS.2018.8500465"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Yin, H., Tang, L., Ding, X., Wang, Y., and Xiong, R. (2018, January 26\u201330). Locnet: Global localization in 3d point clouds for mobile vehicles. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Suzhou, China.","DOI":"10.1109\/IVS.2018.8500682"},{"key":"ref_24","unstructured":"Pomerleau, D.A. (2021, December 28). Alvinn: An Autonomous Land Vehicle in a Neural Network. Available online: https:\/\/proceedings.neurips.cc\/paper\/1988\/file\/812b4ba287f5ee0bc9d43bbf5bbe87fb-Paper.pdf."},{"key":"ref_25","unstructured":"Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L.D., Monfort, M., Muller, U., and Zhang, J. (2016). End to End Learning for Self-Driving Cars. arXiv."},{"key":"ref_26","unstructured":"Muller, U., Ben, J., Cosatto, E., Flepp, B., and Cun, Y.L. (2021, December 28). Off-Road Obstacle Avoidance Through End-to-End Learning. Available online: https:\/\/proceedings.neurips.cc\/paper\/2005\/file\/fdf1bc5669e8ff5ba45d02fded729feb-Paper.pdf."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Codevilla, F., Miiller, M., Lopez, A., Koltun, V., and Dosovitskiy, A. (2018, January 21\u201325). End-to-End Driving Via Conditional Imitation Learning. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8460487"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Xu, H., Gao, Y., Yu, F., and Darrell, T. (2017, January 21\u201326). End-to-end learning of driving models from large-scale video datasets. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.376"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_31","unstructured":"Eraqi, H.M., Moustafa, M.N., and Honer, J. (2017). End-to-end deep learning for steering autonomous vehicles considering temporal dependencies. arXiv."},{"key":"ref_32","unstructured":"Hou, Y., Hornauer, S., and Zipser, K. (2017). Fast recurrent fully convolutional networks for direct perception in autonomous driving. arXiv."},{"key":"ref_33","unstructured":"Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., and Koltun, V. (2017, January 13\u201315). CARLA: An open urban driving simulator. Proceedings of the Conference on Robot Learning, PMLR, Mountain View, CA, USA."},{"key":"ref_34","unstructured":"Wang, Q., Chen, L., and Tian, W. (2018). End-to-end driving simulation via angle branched network. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Liang, X., Wang, T., Yang, L., and Xing, E. (2018, January 8\u201314). Cirl: Controllable imitative reinforcement learning for vision-based self-driving. Proceedings of the The European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_36"},{"key":"ref_36","unstructured":"Li, Z., Motoyoshi, T., Sasaki, K., Ogata, T., and Sugano, S. (2018). Rethinking self-driving: Multi-task knowledge for better generalization and accident explanation ability. arXiv."},{"key":"ref_37","unstructured":"Sauer, A., Savinov, N., and Geiger, A. (2018, January 29\u201331). Conditional affordance learning for driving in urban environments. Proceedings of the Conference on Robot Learning, PMLR, Z\u00fcrich, Switzerland."},{"key":"ref_38","unstructured":"M\u00fcller, M., Dosovitskiy, A., Ghanem, B., and Koltun, V. (2018). Driving policy transfer via modularity and abstraction. arXiv."},{"key":"ref_39","unstructured":"Rhinehart, N., McAllister, R., and Levine, S. (2018). Deep imitative models for flexible inference, planning, and control. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1002\/rob.20147","article-title":"Stanley: The robot that won the DARPA Grand Challenge","volume":"23","author":"Thrun","year":"2006","journal-title":"J. Field Robot."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MITS.2014.2306552","article-title":"Making Bertha Drive\u2014An Autonomous Journey on a Historic Route","volume":"6","author":"Ziegler","year":"2014","journal-title":"IEEE Intell. Transp. Syst. Mag."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Li, Y., Qi, H., Dai, J., Ji, X., and Wei, Y. (2017, January 21\u201326). Fully convolutional instance-aware semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.472"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Sun, D., Yang, X., Liu, M.-Y., and Kautz, J. (2018, January 18\u201323). Pwc-net: Cnns for optical flow using pyramid, warping, and cost volume. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00931"},{"key":"ref_46","unstructured":"G\u00fcney, F., and Geiger, A. (2006, January 13\u201316). Deep discrete flow. Proceedings of the Asian Conference on Computer Vision, Hyderabad, India."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision meets robotics: The KITTI dataset","volume":"32","author":"Geiger","year":"2016","journal-title":"Int. J. Rob. Res."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Zhang, H., Geiger, A., and Urtasun, R. (2013, January 1\u20138). Understanding high-level semantics by modeling traffic patterns. Proceedings of the IEEE International Conference on Computer Vision, Sydney, NSW, Australia.","DOI":"10.1109\/ICCV.2013.379"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1012","DOI":"10.1109\/TPAMI.2013.185","article-title":"3D Traffic Scene Understanding From Movable Platforms","volume":"36","author":"Geiger","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1146\/annurev-control-060117-105157","article-title":"Planning and Decision-Making for Autonomous Vehicles","volume":"1","author":"Schwarting","year":"2018","journal-title":"Annu. Rev. Control Robot. Auton. Syst."},{"key":"ref_51","unstructured":"Bojarski, M., Yeres, P., Choromanska, A., Choromanski, K., Firner, B., Jackel, L., and Muller, U. (2017). Explaining how a deep neural network trained with end-to-end learning steers a car. arXiv."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Hubschneider, C., Bauer, A., Weber, M., and Z\u00f6llner, J.M. (2017, January 16\u201319). Adding navigation to the equation: Turning decisions for end-to-end vehicle control. Proceedings of the 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), Yokohama, Japan.","DOI":"10.1109\/ITSC.2017.8317923"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Amini, A., Rosman, G., Karaman, S., and Rus, D. (2019, January 20\u201324). Variational end-to-end navigation and localization. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793579"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1023\/A:1022140919877","article-title":"Recent Advances in Hierarchical Reinforcement Learning","volume":"13","author":"Barto","year":"2003","journal-title":"Discret. Event Dyn. Syst."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/S0004-3702(99)00052-1","article-title":"Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning","volume":"112","author":"Sutton","year":"1999","journal-title":"Artif. Intell."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1177\/0278364911428653","article-title":"Robot learning from demonstration by constructing skill trees","volume":"31","author":"Konidaris","year":"2011","journal-title":"Int. J. Robot. Res."},{"key":"ref_57","unstructured":"Kulkarni, T.D., Narasimhan, K.R., Saeedi, A., and Tenenbaum, J.B. (2016). Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation. arXiv."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1238","DOI":"10.1177\/0278364913495721","article-title":"Reinforcement learning in robotics: A survey","volume":"32","author":"Kober","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Pastor, P., Hoffmann, H., Asfour, T., and Schaal, S. (2009, January 12\u201317). Learning and generalization of motor skills by learning from demonstration. Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan.","DOI":"10.1109\/ROBOT.2009.5152385"},{"key":"ref_60","unstructured":"Da Silva, B., Konidaris, G., and Barto, A. (2012). Learning parameterized skills. arXiv."},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Deisenroth, M.P., Englert, P., Peters, J., and Fox, D. (June, January 31). Multi-task policy search for robotics. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907421"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1007\/s10514-012-9290-3","article-title":"Reinforcement learning to adjust parametrized motor primitives to new situations","volume":"33","author":"Kober","year":"2012","journal-title":"Auton. Robot."},{"key":"ref_63","unstructured":"Schaul, T., Horgan, D., Gregor, K., and Silver, D. (2015, January 7\u20139). Universal value function approximators. Proceedings of the International Conference on Machine Learning, PMLR, Lille, France."},{"key":"ref_64","unstructured":"Dosovitskiy, A., and Koltun, V. (2016). Learning to act by predicting the future. arXiv."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Javdani, S., Srinivasa, S.S., and Bagnell, J.A. (2015). Shared autonomy via hindsight optimization. Robot. Sci. Syst.","DOI":"10.15607\/RSS.2015.XI.032"},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Chen, C., Seff, A., Kornhauser, A., and Xiao, J. (2015, January 7\u201313). Deep Driving: Learning Affordance for Direct Perception in Autonomous Driving. Proceedings of the 2015 IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.312"},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Al-Qizwini, M., Barjasteh, I., Al-Qassab, H., and Radha, H. (2017, January 11\u201314). Deep learning algorithm for autonomous driving using googlenet. Proceedings of the 2017 IEEE Intelligent Vehicles Symposium (IV), Redondo Beach, CA, USA.","DOI":"10.1109\/IVS.2017.7995703"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Huang, J., Tanev, I., and Shimohara, K. (2015\u20131, January 31). Evolving a general electronic stability program for car simulated in TORCS. Proceedings of the 2015 IEEE Conference on Computational Intelligence and Games (CIG), Tainan, Taiwan.","DOI":"10.1109\/CIG.2015.7317955"},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Richter, S.R., Vineet, V., Roth, S., and Koltun, V. (2016, January 8\u201316). Playing for data: Ground truth from computer games. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46475-6_7"},{"key":"ref_70","unstructured":"Ebrahimi, S., Rohrbach, A., and Darrell, T. (2017, January 13\u201315). Gradient-free policy architecture search and adaptation. Proceedings of the Conference on Robot Learning, PMLR, Mountain View, CA, USA."},{"key":"ref_71","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. arXiv."},{"key":"ref_72","unstructured":"Chetlur, S., Woolley, C., Vandermersch, P., Cohen, J., Tran, J., Catanzaro, B., and Shelhamer, E. (2014). cuDNN: Efficient Primitives for Deep Learning. arXiv."},{"key":"ref_73","unstructured":"Wymann, B., Espi\u00e9, E., Guionneau, C., Dimitrakakis, C., Coulom, R., and Sumner, A. (2021, March 06). Torcs, the Open Racing Car Simulator. Available online: http\/\/torcs.sourceforge.net."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Codevilla, F., L\u00f3pez, A.M., Koltun, V., and Dosovitskiy, A. (2018, January 8\u201314). On Offline Evaluation of Vision-Based Driving Models. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01267-0_15"},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Premebida, C., Carreira, J., Batista, J., and Nunes, U. (2014, January 14\u201318). Pedestrian detection combining RGB and dense LIDAR data. Proceedings of the 2014 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA.","DOI":"10.1109\/IROS.2014.6943141"},{"key":"ref_76","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for autonomous driving? the KITTI vision benchmark suite. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_77","unstructured":"Kingma, D.P., and Ba, J.L. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_79","doi-asserted-by":"crossref","unstructured":"Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., and Darrell, T. (2020, January 13\u201319). Bdd100k: A diverse driving dataset for heterogeneous multi-task learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00271"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/4\/1425\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:18:34Z","timestamp":1760134714000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/4\/1425"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,13]]},"references-count":79,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["s22041425"],"URL":"https:\/\/doi.org\/10.3390\/s22041425","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,13]]}}}