{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T08:18:43Z","timestamp":1774685923961,"version":"3.50.1"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["1900927, 2105806"],"award-info":[{"award-number":["1900927, 2105806"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007065","name":"Nvidia","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100007065","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:p>The continued advancements of time-of-flight imaging devices have enabled new imaging pipelines with numerous applications. Consequently, several forward rendering techniques capable of accurately and efficiently simulating these devices have been introduced. However, general-purpose differentiable rendering techniques that estimate derivatives of time-of-flight images are still lacking. In this paper, we introduce a new theory of differentiable time-gated rendering that enjoys the generality of differentiating with respect to arbitrary scene parameters. Our theory also allows the design of advanced Monte Carlo estimators capable of handling cameras with near-delta or discontinuous time gates.<\/jats:p>\n          <jats:p>We validate our theory by comparing derivatives generated with our technique and finite differences. Further, we demonstrate the usefulness of our technique using a few proof-of-concept inverse-rendering examples that simulate several time-of-flight imaging scenarios.<\/jats:p>","DOI":"10.1145\/3478513.3480489","type":"journal-article","created":{"date-parts":[[2021,12,10]],"date-time":"2021-12-10T18:28:45Z","timestamp":1639160925000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Differentiable time-gated rendering"],"prefix":"10.1145","volume":"40","author":[{"given":"Lifan","family":"Wu","sequence":"first","affiliation":[{"name":"NVIDIA"}]},{"given":"Guangyan","family":"Cai","sequence":"additional","affiliation":[{"name":"University of California"}]},{"given":"Ravi","family":"Ramamoorthi","sequence":"additional","affiliation":[{"name":"University of California"}]},{"given":"Shuang","family":"Zhao","sequence":"additional","affiliation":[{"name":"University of California"}]}],"member":"320","published-online":{"date-parts":[[2021,12,10]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417833"},{"key":"e_1_2_2_2_1","volume-title":"Radiative transfer","author":"Chandrasekhar Subrahmanyan","unstructured":"Subrahmanyan Chandrasekhar . 1960. Radiative transfer . Courier Corporation . Subrahmanyan Chandrasekhar. 1960. Radiative transfer. Courier Corporation."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417825"},{"key":"e_1_2_2_4_1","volume-title":"Ultrafast time-gated imaging in thick tissues: a step toward optical mammography. Optics letters 18, 13","author":"Das BB","year":"1993","unstructured":"BB Das , KM Yoo , and RR Alfano . 1993. Ultrafast time-gated imaging in thick tissues: a step toward optical mammography. Optics letters 18, 13 ( 1993 ), 1092--1094. BB Das, KM Yoo, and RR Alfano. 1993. Ultrafast time-gated imaging in thick tissues: a step toward optical mammography. Optics letters 18, 13 (1993), 1092--1094."},{"key":"e_1_2_2_5_1","volume-title":"Range gated active night vision system for automobiles. Applied optics 45, 28","author":"David Ofer","year":"2006","unstructured":"Ofer David , Norman S Kopeika , and Boaz Weizer . 2006. Range gated active night vision system for automobiles. Applied optics 45, 28 ( 2006 ), 7248--7254. Ofer David, Norman S Kopeika, and Boaz Weizer. 2006. Range gated active night vision system for automobiles. Applied optics 45, 28 (2006), 7248--7254."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46487-9_42"},{"key":"e_1_2_2_7_1","volume-title":"Video Surveillance and Transportation Imaging Applications","author":"Grauer Yoav","year":"2015","unstructured":"Yoav Grauer and Ezri Sonn . 2015. Active gated imaging for automotive safety applications . In Video Surveillance and Transportation Imaging Applications 2015 , Vol. 9407 . International Society for Optics and Photonics , 94070F. Yoav Grauer and Ezri Sonn. 2015. Active gated imaging for automotive safety applications. In Video Surveillance and Transportation Imaging Applications 2015, Vol. 9407. International Society for Optics and Photonics, 94070F."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00159"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269977"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.418"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368314"},{"key":"e_1_2_2_12_1","volume-title":"Femto-photography: Visualizing light in motion. Universidad de Zaragoza","author":"Jarabo Adrian","year":"2012","unstructured":"Adrian Jarabo . 2012 . Femto-photography: Visualizing light in motion. Universidad de Zaragoza (2012). Adrian Jarabo. 2012. Femto-photography: Visualizing light in motion. Universidad de Zaragoza (2012)."},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/3056989.3056994"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661251"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.visinf.2017.01.008"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/15922.15902"},{"key":"e_1_2_2_17_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2009.5459160"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-011-0470-y"},{"key":"e_1_2_2_20_1","volume-title":"Fluorescence lifetime imaging. Analytical biochemistry 202, 2","author":"Lakowicz Joseph R","year":"1992","unstructured":"Joseph R Lakowicz , Henryk Szmacinski , Kazimierz Nowaczyk , Klaus W Berndt , and Michael Johnson . 1992. Fluorescence lifetime imaging. Analytical biochemistry 202, 2 ( 1992 ), 316--330. Joseph R Lakowicz, Henryk Szmacinski, Kazimierz Nowaczyk, Klaus W Berndt, and Michael Johnson. 1992. Fluorescence lifetime imaging. Analytical biochemistry 202, 2 (1992), 316--330."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1117\/1.OE.53.2.023102"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275109"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322937"},{"key":"e_1_2_2_24_1","first-page":"1","article-title":"Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems","volume":"11","author":"Liu Xiaochun","year":"2020","unstructured":"Xiaochun Liu , Sebastian Bauer , and Andreas Velten . 2020 . Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems . Nature Communications 11 , 1 (2020), 1 -- 13 . Xiaochun Liu, Sebastian Bauer, and Andreas Velten. 2020. Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems. Nature Communications 11, 1 (2020), 1--13.","journal-title":"Nature Communications"},{"key":"e_1_2_2_25_1","volume-title":"Ji Hyun Nam, Syed Azer Reza, Toan Huu Le, Adrian Jarabo, Diego Gutierrez, and Andreas Velten.","author":"Liu Xiaochun","year":"2019","unstructured":"Xiaochun Liu , Ib\u00f3n Guill\u00e9n , Marco La Manna , Ji Hyun Nam, Syed Azer Reza, Toan Huu Le, Adrian Jarabo, Diego Gutierrez, and Andreas Velten. 2019 . Non-line-of-sight imaging using phasor-field virtual wave optics. Nature 572, 7771 (2019), 620--623. Xiaochun Liu, Ib\u00f3n Guill\u00e9n, Marco La Manna, Ji Hyun Nam, Syed Azer Reza, Toan Huu Le, Adrian Jarabo, Diego Gutierrez, and Andreas Velten. 2019. Non-line-of-sight imaging using phasor-field virtual wave optics. Nature 572, 7771 (2019), 620--623."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356510"},{"key":"e_1_2_2_27_1","volume-title":"Computer Graphics Forum","author":"Marco Julio","unstructured":"Julio Marco , Ib\u00f3n Guill\u00e9n , Wojciech Jarosz , Diego Gutierrez , and Adrian Jarabo . 2019. Progressive transient photon beams . In Computer Graphics Forum , Vol. 38 . Wiley Online Library , 19--30. Julio Marco, Ib\u00f3n Guill\u00e9n, Wojciech Jarosz, Diego Gutierrez, and Adrian Jarabo. 2019. Progressive transient photon beams. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 19--30."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024205"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392406"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356498"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601103"},{"key":"e_1_2_2_32_1","volume-title":"Confocal non-line-of-sight imaging based on the light-cone transform. Nature 555, 7696","author":"O'Toole Matthew","year":"2018","unstructured":"Matthew O'Toole , David B Lindell , and Gordon Wetzstein . 2018. Confocal non-line-of-sight imaging based on the light-cone transform. Nature 555, 7696 ( 2018 ), 338--341. Matthew O'Toole, David B Lindell, and Gordon Wetzstein. 2018. Confocal non-line-of-sight imaging based on the light-cone transform. Nature 555, 7696 (2018), 338--341."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2019.07.009"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/647652.732117"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPHOT.2019.8747336"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323016"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPHOT.2017.7951478"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3388769.3407534"},{"key":"e_1_2_2_39_1","volume-title":"Papers on mechanical and physical subjects: the sub-mechanics of the universe","author":"Reynolds Osborne","unstructured":"Osborne Reynolds . 1903. Papers on mechanical and physical subjects: the sub-mechanics of the universe . Vol. 3 . The University Press . Osborne Reynolds. 1903. Papers on mechanical and physical subjects: the sub-mechanics of the universe. Vol. 3. The University Press."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPHOT.2018.8368463"},{"key":"e_1_2_2_41_1","volume-title":"Computational periscopy with an ordinary digital camera. Nature 565, 7740","author":"Saunders Charles","year":"2019","unstructured":"Charles Saunders , John Murray-Bruce , and Vivek K Goyal . 2019. Computational periscopy with an ordinary digital camera. Nature 565, 7740 ( 2019 ), 472--475. Charles Saunders, John Murray-Bruce, and Vivek K Goyal. 2019. Computational periscopy with an ordinary digital camera. Nature 565, 7740 (2019), 472--475."},{"key":"e_1_2_2_42_1","unstructured":"Adam Smith James Skorupski and James Davis. 2008. Transient rendering. (2008).  Adam Smith James Skorupski and James Davis. 2008. Transient rendering. (2008)."},{"key":"e_1_2_2_43_1","unstructured":"Simon Telezhkin. 2021. Low poly tree 3D model. https:\/\/done3d.com\/low-poly-tree\/  Simon Telezhkin. 2021. Low poly tree 3D model. https:\/\/done3d.com\/low-poly-tree\/"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCI.2018.2829599"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.251"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00164"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/927297"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459804"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00696"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00148"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459807"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459783"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459782"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356522"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459782"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478513.3480489","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478513.3480489","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478513.3480489","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:11:48Z","timestamp":1750191108000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478513.3480489"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12]]},"references-count":55,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["10.1145\/3478513.3480489"],"URL":"https:\/\/doi.org\/10.1145\/3478513.3480489","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12]]},"assertion":[{"value":"2021-12-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}