{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T22:41:12Z","timestamp":1764715272261,"version":"3.44.0"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2024,11,21]],"date-time":"2024-11-21T00:00:00Z","timestamp":1732147200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100006374","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2022YFB3303900"],"award-info":[{"award-number":["2022YFB3303900"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006374","name":"Natural Science Foundation of Jiangsu Province","doi-asserted-by":"publisher","award":["BK20243040"],"award-info":[{"award-number":["BK20243040"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006374","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62272216, 62372224"],"award-info":[{"award-number":["62272216, 62372224"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Collaborative Innovation Center of Novel Software Technology and Industrialization"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2024,11,21]]},"abstract":"<jats:p>Facial landmark has become one of the most widely-used and intuitive feature of the face. Traditional methods for Facial Landmark Detection (FLD) are primarily based on cameras, which are limited by their sensitivity to light conditions, inability to penetrate obstructions, and potential privacy leaks. In this paper, we propose mmFLD to estimate the facial landmark positions using millimeter-wave (mmWave) radar with mm-level accuracy. By simultaneously applying the range estimation capability and angle estimation capability of mmWave radar, we are able to spatially sample face reflection signals with high resolution. In particular, we propose a velocity-based method for head detection and tracking, and then we build two generalized models to extract effective facial motion features from different facial regions. Moreover, we design an end-to-end neural network to extract the face structure and the motion coherence implicit in mmWave data. Experiment results show that mmFLD can estimate the facial landmark positions with high accuracy, e.g., the average Mean Absolute Error (MAE) is 2.81 mm with eight kinds of different facial expressions, and extended experiment also demonstrates the generalizability and robustness of mmFLD for different experiment conditions.<\/jats:p>","DOI":"10.1145\/3699739","type":"journal-article","created":{"date-parts":[[2024,11,21]],"date-time":"2024-11-21T12:23:32Z","timestamp":1732191812000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Facial Landmark Detection Based on High Precision Spatial Sampling via Millimeter-wave Radar"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9312-5317","authenticated-orcid":false,"given":"Yi","family":"Li","sequence":"first","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1479-9023","authenticated-orcid":false,"given":"Chuyu","family":"Wang","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2994-6743","authenticated-orcid":false,"given":"Lei","family":"Xie","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-6584-4939","authenticated-orcid":false,"given":"Qiancheng","family":"Jin","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5184-2900","authenticated-orcid":false,"given":"Long","family":"Fan","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5075-8512","authenticated-orcid":false,"given":"Jingyi","family":"Ning","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1467-4519","authenticated-orcid":false,"given":"Sanglu","family":"Lu","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}]}],"member":"320","published-online":{"date-parts":[[2024,11,21]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00676"},{"key":"e_1_2_1_2_1","first-page":"27599","article-title":"An introduction to the kalman filter","volume":"8","author":"Bishop Gary","year":"2001","unstructured":"Gary Bishop, Greg Welch, et al. 2001. An introduction to the kalman filter. Proc of SIGGRAPH, Course 8, 27599--23175 (2001), 41.","journal-title":"Proc of SIGGRAPH, Course"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2003.1227983"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.humov.2005.07.006"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.143"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1155\/2021\/5383573"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610902"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2020.3001989"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.927467"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2008.01.024"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5244\/C.20.95"},{"key":"e_1_2_1_12_1","first-page":"2","article-title":"Overview of the RANSAC Algorithm","volume":"4","author":"Derpanis Konstantinos G","year":"2010","unstructured":"Konstantinos G Derpanis. 2010. Overview of the RANSAC Algorithm. Image Rochester NY 4, 1 (2010), 2--3.","journal-title":"Image Rochester NY"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3580861"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00045"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1037\/t27734-000"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.53.4.712"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM53939.2023.10229085"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3659619"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00238"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3494988"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASRU.2013.6707742"},{"key":"e_1_2_1_22_1","volume-title":"Li","author":"Guo Jianzhu","year":"2020","unstructured":"Jianzhu Guo, Xiangyu Zhu, Yang Yang, Fan Yang, Zhen Lei, and Stan Z. Li. 2020. Towards Fast, Accurate and Stable 3D Dense Face Alignment. In Computer Vision - ECCV 2020, Andrea Vedaldi, Horst Bischof, Thomas Brox, and Jan-Michael Frahm (Eds.). Springer International Publishing, Cham, 152--168."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00307"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2006.03.001"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-39862-4_20"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.241"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00826"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130813"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3137387"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3517231"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432235"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3463521"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICTC52510.2021.9620798"},{"key":"e_1_2_1_34_1","volume-title":"Shape Preserving Facial Landmarks with Graph Attention Networks. In 33rd British Machine Vision Conference 2022, BMVC 2022","author":"Prados-Torreblanca Andr\u00e9s","year":"2022","unstructured":"Andr\u00e9s Prados-Torreblanca, Jos\u00e9 M Buenaposada, and Luis Baumela. 2022. Shape Preserving Facial Landmarks with Graph Attention Networks. In 33rd British Machine Vision Conference 2022, BMVC 2022, London, UK, November 21-24, 2022. BMVA Press. https:\/\/bmvc2022.mpi-inf.mpg.de\/0155.pdf"},{"key":"e_1_2_1_35_1","first-page":"2433","article-title":"Cell Averaging-Constant False Alarm Rate Detection in Radar","volume":"7","author":"Shrivathsa VS","year":"2018","unstructured":"VS Shrivathsa. 2018. Cell Averaging-Constant False Alarm Rate Detection in Radar. International Research Journal of Engineering and Technology (IRJET) 7, 2018 (2018), 2433--2438.","journal-title":"International Research Journal of Engineering and Technology (IRJET)"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2018.00246"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3534592"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00227"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447993.3483252"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581791.3596839"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478127"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM42981.2021.9488737"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3495243.3560515"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM48880.2022.9796912"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478089"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSAI48974.2019.9010478"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3614438"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3570361.3592515"},{"key":"e_1_2_1_49_1","volume-title":"Chen Change Loy, and Xiaoou Tang","author":"Zhang Zhanpeng","year":"2014","unstructured":"Zhanpeng Zhang, Ping Luo, Chen Change Loy, and Xiaoou Tang. 2014. Facial landmark detection by deep multi-task learning. In Computer Vision-ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part VI 13. Springer, 94--108."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2013.58"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01485"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICVRV51359.2020.00070"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3699739","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3699739","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T16:27:48Z","timestamp":1758817668000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3699739"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,21]]},"references-count":52,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,11,21]]}},"alternative-id":["10.1145\/3699739"],"URL":"https:\/\/doi.org\/10.1145\/3699739","relation":{},"ISSN":["2474-9567"],"issn-type":[{"type":"electronic","value":"2474-9567"}],"subject":[],"published":{"date-parts":[[2024,11,21]]},"assertion":[{"value":"2024-11-21","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}