{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T16:31:34Z","timestamp":1783701094266,"version":"3.55.0"},"reference-count":88,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2023,7,7]],"date-time":"2023-07-07T00:00:00Z","timestamp":1688688000000},"content-version":"vor","delay-in-days":368,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CNS-1553273"],"award-info":[{"award-number":["CNS-1553273"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2022,7,4]]},"abstract":"<jats:p>As cameras and Wi-Fi access points are widely deployed in public places, new mobile applications and services can be developed by connecting live video analytics to the mobile Wi-Fi-enabled devices of the relevant users. To achieve this, a critical challenge is to identify the person who carries a device in the video with the mobile device's network ID, e.g., MAC address. To address this issue, we propose RFCam, a system for human identification with a fusion of Wi-Fi and camera data. RFCam uses a multi-antenna Wi-Fi radio to collect CSI of Wi-Fi packets sent by mobile devices, and a camera to monitor users in the area. With low sampling rate CSI data, RFCam derives heterogeneous embedding features on location, motion, and user activity for each device over time, and fuses them with visual user features generated from video analytics to find the best matches. To mitigate the impacts of multi-user environments on wireless sensing, we develop video-assisted learning models for different features and quantify their uncertainties, and incorporate them with video analytics to rank moments and features for robust and efficient fusion. RFCam is implemented and tested in indoor environments for over 800 minutes with 25 volunteers, and extensive evaluation results demonstrate that RFCam achieves real-time identification average accuracy of 97.01% in all experiments with up to ten users, significantly outperforming existing solutions.<\/jats:p>","DOI":"10.1145\/3534588","type":"journal-article","created":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T18:50:18Z","timestamp":1657219818000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["RFCam"],"prefix":"10.1145","volume":"6","author":[{"given":"Hongkai","family":"Chen","sequence":"first","affiliation":[{"name":"Stony Brook University, Stony Brook, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sirajum","family":"Munir","sequence":"additional","affiliation":[{"name":"Bosch Research and Technology Center, Pittsburgh, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shan","family":"Lin","sequence":"additional","affiliation":[{"name":"Stony Brook University, Stony Brook, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,7,7]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2015.7218525"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.376"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/IADCC.2018.8692114"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3281411.3281428"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2500423.2504572"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3214266"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2019.2929257"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380091"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2016.7524459"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/DCOSS49796.2020.00022"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/IWCMC.2014.6906364"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2010.5627688"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDSC.2008.4635689"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/938985.938995"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2994374.2994377"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264925"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comcom.2019.09.016"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2014.6848052"},{"key":"e_1_2_2_19_1","unstructured":"Agent Video Intelligence. 2021. innoVi\u00d7. https:\/\/www.agentvi.com\/product\/innovi\/."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/DCOSS49796.2020.00019"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3286978.3286989"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPSN.2018.00053"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2020.2996078"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2994551.2994570"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2016.2624800"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3300061.3345437"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2785956.2787487"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2021.03.022"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348543.2348581"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3210240.3210342"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2020.2974682"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/11426646_7"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313398"},{"key":"e_1_2_2_34_1","volume-title":"Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI '81)","volume":"2","author":"Bruce","unstructured":"Bruce D. Lucas and Takeo Kanade. 1981. An Iterative Image Registration Technique with an Application to Stereo Vision. In Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI '81)- Volume 2 (Vancouver, Canada) (IJCAI'81, Vol. 2). IJCAI, San Francisco, CA, USA, 674--679."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2737095.2737726"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939918.2939930"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/RTAS.2017.8"},{"key":"e_1_2_2_38_1","unstructured":"New York Times. 2021. San Francisco Banned Facial Recognition. Will California follow? https:\/\/www.nytimes.com\/2019\/07\/01\/us\/facial-recognition-san-francisco.html."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2015.08.027"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOMW.2016.7457054"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2636072"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3325421.3329766"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1287853.1287866"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2809695.2809712"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12607-9_25"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070942.2070962"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348543.2348580"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/MASS.2016.036"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/IoTDI49375.2020.00012"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/3451271.3451291"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2021.3120036"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2015.2500121"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAP.1986.1143830"},{"key":"e_1_2_2_54_1","volume-title":"Proceedings of the 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI '15)","author":"Shangguan Longfei","year":"2015","unstructured":"Longfei Shangguan, Zheng Yang, Alex X Liu, Zimu Zhou, and Yunhao Liu. 2015. Relative Localization of RFID Tags using Spatial-Temporal Phase Profiling. In Proceedings of the 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI '15). USENIX Association, Oakland, USA, 251--263."},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2015.2430274"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2935755.2935762"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3210240.3210347"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3307334.3326103"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2942358.2942393"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/1864349.1864367"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2013.2274283"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00607"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3214287"},{"key":"e_1_2_2_64_1","volume-title":"Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI '16)","author":"Vasisht Deepak","year":"2016","unstructured":"Deepak Vasisht, Swarun Kumar, and Dina Katabi. 2016. Decimeter-level localization with a single WiFi access point. In Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI '16). USENIX Association, Santa Clara, USA, 165--178."},{"key":"e_1_2_2_65_1","unstructured":"Intelligent Integrated Video. 2021. i2V VMS. http:\/\/www.i2vsys.com\/video-analytic.html."},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209659"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2973750.2973776"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971670"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2012.2203731"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2012.214"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/GLOCOM.2016.7841847"},{"key":"e_1_2_2_72_1","volume-title":"Proceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13)","author":"Xiong Jie","year":"2013","unstructured":"Jie Xiong and Kyle Jamieson. 2013. ArrayTrack: A Fine-Grained Indoor Location System. In Proceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13). USENIX Association, Lombard, USA, 71--84."},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPSN.2012.6920958"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/2426656.2426697"},{"key":"e_1_2_2_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351272"},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458864.3467675"},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/GLOCOM.2009.5425237"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2019.8737569"},{"key":"e_1_2_2_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/2543581.2543592"},{"key":"e_1_2_2_80_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01249-6_29"},{"key":"e_1_2_2_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2016.7472194"},{"key":"e_1_2_2_82_1","doi-asserted-by":"publisher","DOI":"10.1109\/DCOSS.2016.30"},{"key":"e_1_2_2_83_1","doi-asserted-by":"publisher","unstructured":"Qingxue Zhang Dian Zhou and Xuan Zeng. 2017. HeartID: A Multiresolution Convolutional Neural Network for ECG-Based Biometric Human Identification in Smart Health Applications. IEEE Access 5 (May 2017) 11805--11816. https:\/\/doi.org\/10.1109\/ACCESS.2017.2707460","DOI":"10.1109\/ACCESS.2017.2707460"},{"key":"e_1_2_2_84_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM41043.2020.9155463"},{"key":"e_1_2_2_85_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3114309"},{"key":"e_1_2_2_86_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.888718"},{"key":"e_1_2_2_87_1","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2015.2487963"},{"key":"e_1_2_2_88_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA.2017.0-148"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3534588","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3534588","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3534588","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T04:32:54Z","timestamp":1752467574000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3534588"}},"subtitle":["Uncertainty-aware Fusion of Camera and Wi-Fi for Real-time Human Identification with Mobile Devices"],"short-title":[],"issued":{"date-parts":[[2022,7,4]]},"references-count":88,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,7,4]]}},"alternative-id":["10.1145\/3534588"],"URL":"https:\/\/doi.org\/10.1145\/3534588","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,4]]},"assertion":[{"value":"2022-07-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}