{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,11]],"date-time":"2025-09-11T11:55:23Z","timestamp":1757591723290,"version":"3.41.0"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,3,4]],"date-time":"2022-03-04T00:00:00Z","timestamp":1646352000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61973235 and 61936014"],"award-info":[{"award-number":["61973235 and 61936014"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100007219","name":"Natural Science Foundation of Shanghai","doi-asserted-by":"crossref","award":["19ZR1461300"],"award-info":[{"award-number":["19ZR1461300"]}],"id":[{"id":"10.13039\/100007219","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Shanghai Science and Technology Innovation Plan","award":["20510760400"],"award-info":[{"award-number":["20510760400"]}]},{"name":"Dawn Program of Shanghai Municipal Education Commission","award":["21SG23"],"award-info":[{"award-number":["21SG23"]}]},{"name":"Shanghai Municipal Science and Technology Major Project","award":["2021SHZDZX0100"],"award-info":[{"award-number":["2021SHZDZX0100"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2022,11,30]]},"abstract":"<jats:p>\n            The surround-view module is an indispensable component of a modern advanced driving assistance system. By calibrating the intrinsics and extrinsics of the surround-view cameras accurately, a top-down surround-view can be generated from raw fisheye images. However, poses of these cameras sometimes may change. At present, how to correct poses of cameras in a surround-view system online without re-calibration is still an open issue. To settle this problem, we introduce the sparse direct framework and propose a novel optimization scheme of a cascade structure. This scheme is actually composed of two levels of optimization and two corresponding photometric error based models are proposed. The model for the first-level optimization is called the ground model, as its photometric errors are measured on the ground plane. For the second level of the optimization, it\u2019s based on the so-called ground-camera model, in which photometric errors are computed on the imaging planes. With these models, the pose correction task is formulated as a nonlinear least-squares problem to minimize photometric errors in overlapping regions of adjacent bird\u2019s-eye-view images. With a cascade structure of these two levels of optimization, an appropriate balance between the speed and the accuracy can be achieved. Experiments show that our method can effectively eliminate the misalignment caused by cameras\u2019 moderate pose changes in the surround-view system. Source code and test cases are available online at\n            <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/cslinzhang.github.io\/CamPoseCorrection\/\">https:\/\/cslinzhang.github.io\/CamPoseCorrection\/<\/jats:ext-link>\n            .\n          <\/jats:p>","DOI":"10.1145\/3505252","type":"journal-article","created":{"date-parts":[[2022,3,4]],"date-time":"2022-03-04T10:31:58Z","timestamp":1646389918000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Online Correction of Camera Poses for the Surround-view System: A Sparse Direct Approach"],"prefix":"10.1145","volume":"18","author":[{"given":"Tianjun","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Software Engineering, Tongji University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hao","family":"Deng","sequence":"additional","affiliation":[{"name":"School of Software Engineering, Tongji University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4360-5523","authenticated-orcid":false,"given":"Lin","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Software Engineering, Tongji University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shengjie","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Software Engineering, Tongji University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiao","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Information and Computer Sciences, University of Massachusetts Amherst, Commonwealth Ave, Amherst, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4487-6384","authenticated-orcid":false,"given":"Yicong","family":"Zhou","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Science, University of Macau, Taipa, Macau, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,3,4]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1992.4.2.141"},{"key":"e_1_3_2_3_2","first-page":"404","volume-title":"Proc. European Conf. Comput. Vis.","author":"Bay H.","year":"2006","unstructured":"H. Bay, T. Tuytelaars, and L. V. Gool. 2006. SURF: Speeded up robust features. In Proc. European Conf. Comput. Vis.404\u2013417."},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.3390\/s18092956"},{"key":"e_1_3_2_5_2","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1109\/IVS.2006.1689621","volume-title":"Proc. Int\u2019l IEEE Conf. Intell. Vehicles Symposium","author":"Collado J.","year":"2006","unstructured":"J. Collado, C. Hilario, A. Escalera, and J. Armingol. 2006. Self-calibration of an on-board stereo-vision system for driver assistance systems. In Proc. Int\u2019l IEEE Conf. Intell. Vehicles Symposium. 156\u2013162."},{"key":"e_1_3_2_6_2","first-page":"627-636","volume-title":"Joint DAGM Symposium","author":"Dang T.","year":"2006","unstructured":"T. Dang and C. Hoffmann. 2006. Tracking camera parameters of an active stereo rig. In Joint DAGM Symposium. 627-636."},{"issue":"3","key":"e_1_3_2_7_2","first-page":"417","article-title":"Numerical methods for unconstrained optimization and nonlinear equations","volume":"28","author":"Dennis J. E.","year":"1983","unstructured":"J. E. Dennis and R. B. Schnabel. 1983. Numerical methods for unconstrained optimization and nonlinear equations. Prentice Hall, Inc. 28, 3 (1983), 417\u2013419.","journal-title":"Prentice Hall, Inc."},{"key":"e_1_3_2_8_2","first-page":"477","volume-title":"Proc. IEEE Int\u2019l Conf. Comput. Vis. Pattern Recognit.","author":"Du F.","year":"1993","unstructured":"F. Du and M. Brady. 1993. Self-calibration of the intrinsic parameters of cameras for active vision systems. In Proc. IEEE Int\u2019l Conf. Comput. Vis. Pattern Recognit.477\u2013482."},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2658577"},{"key":"e_1_3_2_10_2","first-page":"834","volume-title":"Proc. European Conf. Comput. Vis.","author":"Engel J.","year":"2014","unstructured":"J. Engel, T. Sch\u00f6ps, and D. Cremers. 2014. LSD-SLAM: Large-scale direct monocular SLAM. In Proc. European Conf. Comput. Vis.834\u2013849."},{"key":"e_1_3_2_11_2","first-page":"15","volume-title":"Proc. IEEE Int\u2019l Conf. Robotics and Automation","author":"Forster C.","year":"2014","unstructured":"C. Forster, M. Pizzoli, and D. Scaramuzza. 2014. SVO: Fast semi-direct monocular visual odometry. In Proc. IEEE Int\u2019l Conf. Robotics and Automation. 15\u201322."},{"key":"e_1_3_2_12_2","first-page":"1317","volume-title":"Proc. Int\u2019l IEEE Conf. Intell. Transportation Systems","author":"Gressmann M.","year":"2011","unstructured":"M. Gressmann, G. Palm, and O. L\u00f6hlein. 2011. Surround view pedestrian detection using heterogeneous classifier cascades. In Proc. Int\u2019l IEEE Conf. Intell. Transportation Systems. 1317\u20131324."},{"key":"e_1_3_2_13_2","first-page":"1059","volume-title":"Proc. IEEE Int\u2019l Conf. Comput. Vis. Pattern Recognit.","author":"Hansen P.","year":"2012","unstructured":"P. Hansen, H. Alismail, P. Rander, and B. Browning. 2012. Online continuous stereo extrinsic parameter estimation. In Proc. IEEE Int\u2019l Conf. Comput. Vis. Pattern Recognit.1059\u20131066."},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.5555\/861369"},{"key":"e_1_3_2_15_2","first-page":"4912","volume-title":"Proc. IEEE Int\u2019l Conf. Robotics and Automation","author":"Heng L.","year":"2014","unstructured":"L. Heng, M. B\u00fcrki, G. H. Lee, P. Furgale, R. Siegwart, and M. Pollefeys. 2014. Infrastructure-based calibration of a multi-camera rig. In Proc. IEEE Int\u2019l Conf. Robotics and Automation. 4912\u20134919."},{"key":"e_1_3_2_16_2","first-page":"1793","volume-title":"Proc. IEEE\/RSJ Int\u2019l Conf. Intell. Robots and Systems","author":"Heng L.","year":"2013","unstructured":"L. Heng, B. Li, and M. Pollefeys. 2013. CamOdoCal: Automatic intrinsic and extrinsic calibration of a rig with multiple generic cameras and odometry. In Proc. IEEE\/RSJ Int\u2019l Conf. Intell. Robots and Systems. 1793\u20131800."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/0022-2496(66)90005-8"},{"key":"e_1_3_2_18_2","first-page":"420","volume-title":"Proc. Int\u2019l IEEE Conf. Intell. Transportation Systems","author":"Hold S.","year":"2009","unstructured":"S. Hold, S. G\u00f6rmer, A. Kummert, M. Meuter, and S. Muller-Schneiders. 2009. A novel approach for the online initial calibration of extrinsic parameters for a car-mounted camera. In Proc. Int\u2019l IEEE Conf. Intell. Transportation Systems. 420\u2013425."},{"key":"e_1_3_2_19_2","first-page":"18","volume-title":"Proc. Asian Conf. Comput. Vis.","author":"Hou C.","year":"2007","unstructured":"C. Hou, H. Ai, and S. Lao. 2007. Multiview pedestrian detection based on vector boosting. In Proc. Asian Conf. Comput. Vis.18\u201322."},{"key":"e_1_3_2_20_2","first-page":"267","volume-title":"Proc. Int\u2019l Workshop on Vis. Algorithms","author":"Irani M.","year":"1999","unstructured":"M. Irani and P. Anandan. 1999. About direct methods. In Proc. Int\u2019l Workshop on Vis. Algorithms. 267\u2013277."},{"key":"e_1_3_2_21_2","volume-title":"Computer Vision: Three-dimensional Data from Images","author":"Klette R.","year":"1998","unstructured":"R. Klette, A. Koschan, and K. Schluns. 1998. Computer Vision: Three-dimensional Data from Images. Springer, Singapore."},{"key":"e_1_3_2_22_2","first-page":"236","volume-title":"Proc. IEEE Intell. Vehicles Symposium","author":"Knorr M.","year":"2013","unstructured":"M. Knorr, W. Niehsen, and C. Stiller. 2013. Online extrinsic multi-camera calibration using ground plane induced homographies. In Proc. IEEE Intell. Vehicles Symposium. 236\u2013241."},{"key":"e_1_3_2_23_2","first-page":"221","volume-title":"Proc. IEEE Int\u2019l Conf. Robotics and Automation","author":"L\u00e9braly Pierre","year":"2011","unstructured":"Pierre L\u00e9braly, Eric Royer, Omar Ait-Aider, Cl\u00e9ment Deymier, and Michel Dhome. 2011. Fast calibration of embedded non-overlapping cameras. In Proc. IEEE Int\u2019l Conf. Robotics and Automation. 221\u2013227."},{"key":"e_1_3_2_24_2","first-page":"649","volume-title":"Proc. IEEE Int\u2019l Conf. Multimedia and Expo","author":"Li L.","year":"2017","unstructured":"L. Li, L. Zhang, X. Li, X. Liu, Y. Shen, and L. Xiong. 2017. Vision-based parking-slot detection: A benchmark and a learning-based approach. In Proc. IEEE Int\u2019l Conf. Multimedia and Expo. 649\u2013654."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.3390\/s120404431"},{"key":"e_1_3_2_26_2","first-page":"1771","volume-title":"Proc. IEEE\/RSJ Int\u2019l Conf. Intell. Robots and Systems","author":"Ling Y.","year":"2016","unstructured":"Y. Ling and S. Shen. 2016. High-precision online markerless stereo extrinsic calibration. In Proc. IEEE\/RSJ Int\u2019l Conf. Intell. Robots and Systems. 1771\u20131778."},{"key":"e_1_3_2_27_2","first-page":"383","volume-title":"Proc. ACM Int\u2019l Conf. Multimedia","author":"Liu X.","year":"2019","unstructured":"X. Liu, L. Zhang, Y. Shen, S. Zhang, and S. Zhao. 2019. Online camera pose optimization for the surround-view system. In Proc. ACM Int\u2019l Conf. Multimedia. 383\u2013391."},{"key":"e_1_3_2_28_2","first-page":"43","volume-title":"Proc. European Conf. Comput. Vis.","author":"Lourakis M. I. A.","year":"2019","unstructured":"M. I. A. Lourakis. 2019. Sparse non-linear least squares optimization for geometric vision. In Proc. European Conf. Comput. Vis.43\u201356."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"key":"e_1_3_2_30_2","first-page":"674","volume-title":"Proc. Int\u2019l Joint Conf. Artificial Intell.","author":"Lucas B. D.","year":"1981","unstructured":"B. D. Lucas and T. Kanade. 1981. An iterative image registration technique with an application to stereo vision. In Proc. Int\u2019l Joint Conf. Artificial Intell.674\u2013679."},{"key":"e_1_3_2_31_2","volume-title":"Numerical Analysis","author":"Mor\u00e9 J. J.","year":"1978","unstructured":"J. J. Mor\u00e9. 1978. The Levenberg-Marquardt algorithm: Implementation and theory. In Numerical Analysis."},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2017.2705103"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2007.908576"},{"key":"e_1_3_2_34_2","first-page":"2320","volume-title":"Proc. IEEE Int\u2019l Conf. Comput. Vis.","author":"Newcombe R. A.","year":"2011","unstructured":"R. A. Newcombe, S. J. Lovegrove, and A. J. Davison. 2011. DTAM: Dense tracking and mapping in real-time. In Proc. IEEE Int\u2019l Conf. Comput. Vis.2320\u20132327."},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-004-0273-z"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0962492900002270"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2015.2463671"},{"key":"e_1_3_2_38_2","first-page":"2564","article-title":"ORB: An efficient alternative to SIFT or SURF","author":"Rublee E.","year":"2011","unstructured":"E. Rublee, V. Rabaud, K. Konolige, and G. Bradski. 2011. ORB: An efficient alternative to SIFT or SURF. Proc. IEEE Int\u2019l Conf. Comput. Vis. (2011), 2564\u20132571.","journal-title":"Proc. IEEE Int\u2019l Conf. Comput. Vis."},{"key":"e_1_3_2_39_2","first-page":"1287","volume-title":"Proc. IEEE\/RSJ Int\u2019l Conf. Intell. Robots and Systems","author":"Schneider S.","year":"2013","unstructured":"S. Schneider, T. Luettel, and H. Wuensche. 2013. Odometry-based online extrinsic sensor calibration. In Proc. IEEE\/RSJ Int\u2019l Conf. Intell. Robots and Systems. 1287\u20131292."},{"key":"e_1_3_2_40_2","first-page":"1486","volume-title":"Proc. IEEE Int\u2019l Conf. Multimedia and Expo","author":"Shao X.","year":"2019","unstructured":"X. Shao, X. Liu, L. Zhang, S. Zhao, Y. Shen, and Y. Yang. 2019. Revisit surround-view camera system calibration. In Proc. IEEE Int\u2019l Conf. Multimedia and Expo. 1486\u20131491."},{"issue":"3","key":"e_1_3_2_41_2","first-page":"439","article-title":"Quasi-likelihood functions, generalized linear models, and the Gauss-Newton method","volume":"61","author":"Wedderburn R. W. M.","year":"1974","unstructured":"R. W. M. Wedderburn. 1974. Quasi-likelihood functions, generalized linear models, and the Gauss-Newton method. Biometrika 61, 3 (1974), 439\u2013447.","journal-title":"Biometrika"},{"key":"e_1_3_2_42_2","first-page":"725","volume-title":"Proc. IEEE Intell. Vehicles Symposium","author":"Xu J.","year":"2000","unstructured":"J. Xu, G. Chen, and M. Xie. 2000. Vision-guided automatic parking for smart car. In Proc. IEEE Intell. Vehicles Symposium. 725\u2013730."},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2857407"},{"key":"e_1_3_2_44_2","first-page":"666","volume-title":"Proc. IEEE Int\u2019l Conf. Comput. Vis.","author":"Zhang Z.","year":"1999","unstructured":"Z. Zhang. 1999. Flexible camera calibration by viewing a plane from unknown orientations. In Proc. IEEE Int\u2019l Conf. Comput. Vis.666\u2013673."},{"key":"e_1_3_2_45_2","first-page":"1490","volume-title":"Proc. Int\u2019l IEEE Conf. Intell. Transportation Systems","author":"Zhao K.","year":"2014","unstructured":"K. Zhao, U. Iurgel, M. Meuter, and J. Pauli. 2014. An automatic online camera calibration system for vehicular applications. In Proc. Int\u2019l IEEE Conf. Intell. Transportation Systems. 1490\u20131492."},{"key":"e_1_3_2_46_2","first-page":"321","volume-title":"Proc. Int\u2019l Conf. Inf. Tech. Comput. Sci.","author":"Zhu H.","year":"2009","unstructured":"H. Zhu, J. Yang, and Z. Liu. 2009. Fisheye camera calibration with two pairs of vanishing points. In Proc. Int\u2019l Conf. Inf. Tech. Comput. Sci.321\u2013324."}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3505252","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3505252","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:26Z","timestamp":1750188686000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3505252"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,4]]},"references-count":45,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,11,30]]}},"alternative-id":["10.1145\/3505252"],"URL":"https:\/\/doi.org\/10.1145\/3505252","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2022,3,4]]},"assertion":[{"value":"2021-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}