
{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T13:38:27Z","timestamp":1782913107962,"version":"3.54.5"},"reference-count":70,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2023,6,27]],"date-time":"2023-06-27T00:00:00Z","timestamp":1687824000000},"content-version":"vor","delay-in-days":26,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Computer Graphics Forum"],"published-print":{"date-parts":[[2023,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The distribution of visual attention can be evaluated using eye tracking, providing valuable insights into usability issues and interaction patterns. However, when used in real, augmented, and collaborative environments, new challenges arise that go beyond desktop scenarios and purely virtual environments. Toward addressing these challenges, we present a visualization technique that provides complementary views on the movement and eye tracking data recorded from multiple people in real\u2010world environments. Our method is based on a space\u2010time cube visualization and a linked 3D replay of recorded data. We showcase our approach with an experiment that examines how people investigate an artwork collection. The visualization provides insights into how people moved and inspected individual pictures in their spatial context over time. In contrast to existing methods, this analysis is possible for multiple participants without extensive annotation of areas of interest. Our technique was evaluated with a think\u2010aloud experiment to investigate analysis strategies and an interview with domain experts to examine the applicability in other research fields.<\/jats:p>","DOI":"10.1111\/cgf.14838","type":"journal-article","created":{"date-parts":[[2023,6,27]],"date-time":"2023-06-27T16:13:07Z","timestamp":1687882387000},"page":"385-396","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Been There, Seen That: Visualization of Movement and 3D Eye Tracking Data from Real\u2010World Environments"],"prefix":"10.1111","volume":"42","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6848-8554","authenticated-orcid":false,"given":"N.","family":"Pathmanathan","sequence":"first","affiliation":[{"name":"VISUS University of Stuttgart Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5785-6788","authenticated-orcid":false,"given":"S.","family":"\u00d6ney","sequence":"additional","affiliation":[{"name":"VISUS University of Stuttgart Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0072-1655","authenticated-orcid":false,"given":"M.","family":"Becher","sequence":"additional","affiliation":[{"name":"VISUS University of Stuttgart Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7048-9292","authenticated-orcid":false,"given":"M.","family":"Sedlmair","sequence":"additional","affiliation":[{"name":"VISUS University of Stuttgart Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1174-1026","authenticated-orcid":false,"given":"D.","family":"Weiskopf","sequence":"additional","affiliation":[{"name":"VISUS University of Stuttgart Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4919-4582","authenticated-orcid":false,"given":"K.","family":"Kurzhals","sequence":"additional","affiliation":[{"name":"VISUS University of Stuttgart Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2023,6,27]]},"reference":[{"key":"e_1_2_9_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/1345448.1345455"},{"key":"e_1_2_9_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2018.04.039"},{"key":"e_1_2_9_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2004.08.001"},{"key":"e_1_2_9_5_2","doi-asserted-by":"crossref","unstructured":"BuscherG. CutrellE. MorrisM. R.: What do you see when you're surfing? using eye tracking to predict salient regions of web pages. InProceedings of the CHI Conference on Human Factors in Computing Systems(2009) pp.21\u201330. 2","DOI":"10.1145\/1518701.1518705"},{"key":"e_1_2_9_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2022.3157961"},{"key":"e_1_2_9_7_2","doi-asserted-by":"crossref","unstructured":"BruderV. KurzhalsK. FreyS. WeiskopfD. ErtlT.: Space\u2010time volume visualization of gaze and stimulus. InProceedings of the Symposium on Eye Tracking Research & Applications(2019) pp.1\u20139. 3","DOI":"10.1145\/3314111.3319812"},{"issue":"3","key":"e_1_2_9_8_2","first-page":"114","article-title":"Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale","volume":"4","author":"Bangor A.","year":"2009","journal-title":"J. Usability Studies"},{"key":"e_1_2_9_9_2","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13079"},{"key":"e_1_2_9_10_2","doi-asserted-by":"crossref","unstructured":"B\u00fcschelW. LehmannA. DachseltR.: MIRIA: A mixed reality toolkit for the in\u2010situ visualization and analysis of spatio\u2010temporal interaction data. InProceedings of the CHI Conference on Human Factors in Computing Systems(2021) pp.470:1\u201315. 3","DOI":"10.1145\/3411764.3445651"},{"key":"e_1_2_9_11_2","doi-asserted-by":"crossref","unstructured":"BlignautP.: Visual span and other parameters for the generation of heatmaps. InProceedings of the 2010 Symposium on Eye\u2010Tracking Research & Applications(2010) p.125\u2013128. 6","DOI":"10.1145\/1743666.1743697"},{"key":"e_1_2_9_12_2","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1007\/978-3-642-02574-7_4","volume-title":"Human\u2010Computer Interaction. New Trends","author":"Bojko A.","year":"2009"},{"key":"e_1_2_9_13_2","doi-asserted-by":"publisher","DOI":"10.4018\/978-1-4666-4490-8.ch027"},{"key":"e_1_2_9_14_2","doi-asserted-by":"crossref","unstructured":"BaiH. SasikumarP. YangJ. BillinghurstM.: A user study on mixed reality remote collaboration with eye gaze and hand gesture sharing. InProceedings of the CHI Conference on Human Factors in Computing Systems(2020) pp.423:1\u201313. 10","DOI":"10.1145\/3313831.3376550"},{"key":"e_1_2_9_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2006.194"},{"key":"e_1_2_9_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2016.2624754"},{"key":"e_1_2_9_17_2","doi-asserted-by":"crossref","unstructured":"CutrellE. GuanZ.: What are you looking for? An eye\u2010tracking study of information usage in web search. InProceedings of the CHI Conference on Human Factors in Computing Systems(2007) pp.407\u2013416. 2","DOI":"10.1145\/1240624.1240690"},{"key":"e_1_2_9_18_2","doi-asserted-by":"crossref","unstructured":"ChittaroL. SerafiniM.: Visualization of user's behavior in indoor virtual environments through interactive heatmaps. InINTERACT(2021) pp.600\u2013609. 10","DOI":"10.1007\/978-3-030-85613-7_38"},{"key":"e_1_2_9_19_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-0064-6_13"},{"key":"e_1_2_9_20_2","doi-asserted-by":"crossref","unstructured":"DuchowskiA. T. PriceM. M. MeyerM. OreroP.: Aggregate gaze visualization with real\u2010time heatmaps. InProceedings of the Symposium on Eye\u2010Tracking Research & Applications(2012) pp.13\u201320. 2","DOI":"10.1145\/2168556.2168558"},{"key":"e_1_2_9_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2018.04.002"},{"key":"e_1_2_9_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2019.2929033"},{"key":"e_1_2_9_23_2","doi-asserted-by":"crossref","unstructured":"GatalskyP. AndrienkoN. AndrienkoG.: Interactive analysis of event data using space\u2010time cube. InProceedings of International Conference on Information Visualization(2004) pp.145\u2013152. 3","DOI":"10.1109\/IV.2004.1320137"},{"key":"e_1_2_9_24_2","unstructured":"GamesE.:RealityCapture. Last accessed 13.03.2023. URL:https:\/\/www.capturingreality.com\/. 5"},{"key":"e_1_2_9_25_2","doi-asserted-by":"crossref","unstructured":"GoldbergJ. H. HelfmanJ. I.: Scanpath clustering and aggregation. InProceedings of the Symposium on Eye\u2010Tracking Research & Applications(2010) pp.227\u2013234. 2","DOI":"10.1145\/1743666.1743721"},{"key":"e_1_2_9_26_2","doi-asserted-by":"crossref","unstructured":"GoldbergJ. H. HelfmanJ. I.: Visual scanpath representation. InProceedings of the Symposium on Eye\u2010Tracking Research & Applications(2010) pp.203\u2013210. 3","DOI":"10.1145\/1743666.1743717"},{"key":"e_1_2_9_27_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1435-5597.1970.tb01464.x"},{"key":"e_1_2_9_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.246"},{"key":"e_1_2_9_29_2","doi-asserted-by":"crossref","unstructured":"H\u00f6ferlinM. H\u00f6ferlinB. WeiskopfD. HeidemannG.: Interactive schematic summaries for exploration of surveillance video. InProceedings of the 1st ACM International Conference on Multimedia Retrieval(2011) Association for Computing Machinery pp.1\u20138. 10","DOI":"10.1145\/1991996.1992005"},{"key":"e_1_2_9_30_2","unstructured":"HeH. LiR. WangR. BaoJ. ZhengY. LiT.: Efficient suspected infected crowds detection based on spatio\u2010temporal trajectories.ArXiv abs\/2004.06653(2020) 1\u201312. 3"},{"key":"e_1_2_9_31_2","volume-title":"The development of spatial cognition: A review","author":"Hart R. A.","year":"1973"},{"key":"e_1_2_9_32_2","volume-title":"Eye tracking: A comprehensive guide to methods and measures","author":"Holmqvist K.","year":"2011"},{"key":"e_1_2_9_33_2","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/S0166-4115(08)62386-9","volume-title":"Human Mental Workload","author":"Hart S. G.","year":"1988"},{"key":"e_1_2_9_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-044451020-4\/50031-1"},{"key":"e_1_2_9_35_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-47024-5_1"},{"key":"e_1_2_9_36_2","unstructured":"KappS. BarzM. MukhametovS. SonntagD. KuhnJ.:ARETT R Package: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays 18.11.2021. Last accessed 13.03.2023. URL:https:\/\/github.com\/AR-Eye-Tracking-Toolkit\/ARETT-R-Package. 4"},{"key":"e_1_2_9_37_2","doi-asserted-by":"publisher","DOI":"10.3390\/s21062234"},{"key":"e_1_2_9_38_2","unstructured":"KurzhalsK. BecherM. PathmanathanN. ReinaG.: Evaluating Situated Visualization in AR with Eye Tracking. InProceedings of the Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization(2022) pp.1\u20138. 2 3 10"},{"key":"e_1_2_9_39_2","doi-asserted-by":"crossref","unstructured":"KurzhalsK. CetinkayaE. HuY. WangW. WeiskopfD.: Close to the action: Eye-tracking evaluation of speaker-following subtitles. InProceedings of the CHI Conference on Human Factors in Computing Systems(2017) pp.6559\u20136568. 2","DOI":"10.1145\/3025453.3025772"},{"key":"e_1_2_9_40_2","doi-asserted-by":"publisher","DOI":"10.1177\/1473871615609787"},{"key":"e_1_2_9_41_2","doi-asserted-by":"crossref","unstructured":"KurzhalsK. G\u00f6belF. AngerbauerK. SedlmairM. RaubalM.: A view on the viewer: Gaze-adaptive captions for videos. InProceedings of the CHI Conference on Human Factors in Computing Systems(2020) pp.139:1\u201312. 2","DOI":"10.1145\/3313831.3376266"},{"key":"e_1_2_9_42_2","doi-asserted-by":"crossref","unstructured":"KurzhalsK. HeimerlF. WeiskopfD.: ISeeCube: Visual analysis of gaze data for video. InProceedings of the Symposium on Eye-Tracking Research & Applications(2014) pp.43\u201350. 3","DOI":"10.1145\/2578153.2628812"},{"key":"e_1_2_9_43_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-15300-6_21"},{"key":"e_1_2_9_44_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-6392-3_3"},{"key":"e_1_2_9_45_2","doi-asserted-by":"publisher","DOI":"10.1080\/10630732.2012.698065"},{"key":"e_1_2_9_46_2","doi-asserted-by":"publisher","DOI":"10.3390\/buildings12020140"},{"key":"e_1_2_9_47_2","doi-asserted-by":"crossref","unstructured":"M\u00fcllerJ. R\u00e4dleR. ReitererH.: Remote collaboration with mixed reality displays: How shared virtual landmarks facilitate spatial referencing. InProceedings of the CHI Conference on Human Factors in Computing Systems(2017) pp.6481\u20136486. 5","DOI":"10.1145\/3025453.3025717"},{"key":"e_1_2_9_48_2","doi-asserted-by":"crossref","unstructured":"MerinoL. SchwarzlM. KrausM. SedlmairM. SchmalstiegD. WeiskopfD.: Evaluating Mixed and Augmented Reality: A Systematic Literature Review (2009-2019). InInternational Symposium on Mixed and Augmented Reality (ISMAR)(2020) pp.438\u2013451. 2 3","DOI":"10.1109\/ISMAR50242.2020.00069"},{"key":"e_1_2_9_49_2","first-page":"173","article-title":"Augmented Reality for Experience-centered Spatial Design: A quantitative assessment method for architectural space","volume":"1","author":"Muchen Y.","year":"2021","journal-title":"Towards a new, configurable architecture: Proceedings of the eCAADe Conference-Volume"},{"key":"e_1_2_9_50_2","doi-asserted-by":"publisher","DOI":"10.3390\/s19010157"},{"key":"e_1_2_9_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2021.3097274"},{"key":"e_1_2_9_52_2","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13968"},{"key":"e_1_2_9_53_2","doi-asserted-by":"crossref","unstructured":"PfeifferT.: Measuring and visualizing attention in space with 3d attention volumes. InProceedings of the Symposium on Eye Tracking Research & Applications(2012) pp.29\u201336. 3","DOI":"10.1145\/2168556.2168560"},{"key":"e_1_2_9_54_2","doi-asserted-by":"crossref","unstructured":"PietroszekK.: \u201cVera\u201d\u2013Crossing the Fourth Wall. InExtended Abstracts of the CHI Conference on Human Factors in Computing Systems(2020) pp.1\u20134. 4","DOI":"10.1145\/3334480.3383178"},{"key":"e_1_2_9_55_2","doi-asserted-by":"crossref","unstructured":"PfeufferK. MayerB. MardanbegiD. GellersenH.: Gaze+ pinch interaction in virtual reality. InProceedings of the Symposium on Spatial User Interaction(2017) pp.99\u2013108. 2","DOI":"10.1145\/3131277.3132180"},{"key":"e_1_2_9_56_2","doi-asserted-by":"crossref","unstructured":"PathmanathanN. \u00d6neyS. BecherM. SedlmairM. WeiskopfD. KurzhalsK.:Source Code for: Been There Seen That: Visualization of Movement and 3D Eye Tracking Data from Real-World Environments 2023. doi:10.18419\/darus-3383. 2","DOI":"10.1111\/cgf.14838"},{"key":"e_1_2_9_57_2","doi-asserted-by":"crossref","unstructured":"PalettaL. SantnerK. FritzG. MayerH. SchrammelJ.: 3D Attention: Measurement of Visual Saliency Using Eye Tracking Glasses. InExtended Abstracts of the CHI Conference on Human Factors in Computing Systems(2013) pp.199\u2013204. 3","DOI":"10.1145\/2468356.2468393"},{"key":"e_1_2_9_58_2","doi-asserted-by":"crossref","unstructured":"Reipschl\u00e4gerP. BrudyF. DachseltR. MatejkaJ. FitzmauriceG. AndersonF.: AvatAR: An immersive analysis environment for human motion data combining interactive 3d avatars and trajectories. InProceedings of the CHI Conference on Human Factors in Computing Systems(2022) pp.23:1\u201315. 3","DOI":"10.1145\/3491102.3517676"},{"key":"e_1_2_9_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2008.125"},{"key":"e_1_2_9_60_2","doi-asserted-by":"crossref","unstructured":"RomeroM. VialardA. PeponisJ. StaskoJ. AbowdG.: Evaluating video visualizations of human behavior. InProceedings of the CHI Conference on Human Factors in Computing Systems(2011) pp.1441\u20131450. 3","DOI":"10.1145\/1978942.1979155"},{"key":"e_1_2_9_61_2","doi-asserted-by":"crossref","unstructured":"SalvucciD. D. GoldbergJ. H.: Identifying fixations and saccades in eye-tracking protocols. InProceedings of the Symposium on Eye Tracking Research & Applications(2000) pp.71\u201378. 4","DOI":"10.1145\/355017.355028"},{"key":"e_1_2_9_62_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnrgo.2022.910019"},{"key":"e_1_2_9_63_2","unstructured":"ShneidermanB.: The eyes have it: a task by data type taxonomy for information visualizations. InProceedings 1996 IEEE Symposium on Visual Languages(1996) pp.336\u2013343. 8"},{"key":"e_1_2_9_64_2","doi-asserted-by":"crossref","unstructured":"StellmachS. NackeL. DachseltR.: 3d attentional maps: Aggregated gaze visualizations in three-dimensional virtual environments. InProceedings of the International Conference on Advanced Visual Interfaces(2010) pp.345\u2013348. 3","DOI":"10.1145\/1842993.1843058"},{"key":"e_1_2_9_65_2","doi-asserted-by":"crossref","unstructured":"StellmachS. NackeL. DachseltR.: Advanced gaze visualizations for three-dimensional virtual environments. InProceedings of the Symposium on Eye-Tracking Research & Applications(2010) pp.109\u2013112. 3","DOI":"10.1145\/1743666.1743693"},{"key":"e_1_2_9_66_2","doi-asserted-by":"crossref","unstructured":"SidenmarkL. PottsD. BapischB. GellersenH.: Radi-Eye: Hands-free radial interfaces for 3D interaction using gaze-activated head-crossing. InProceedings of the CHI Conference on Human Factors in Computing Systems(2021) pp.1\u201311. 2","DOI":"10.1145\/3411764.3445697"},{"key":"e_1_2_9_67_2","doi-asserted-by":"crossref","unstructured":"TianP. WangY. LuY. ZhangY. WangX. WangY.: Behavior analysis of indoor escape route-finding based on head-mounted VR and eye tracking. InInternational Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData)(2019) pp.422\u2013427. 10","DOI":"10.1109\/iThings\/GreenCom\/CPSCom\/SmartData.2019.00090"},{"key":"e_1_2_9_68_2","doi-asserted-by":"publisher","DOI":"10.3390\/app12031027"},{"key":"e_1_2_9_69_2","unstructured":"ValveCorporation:SteamVR. Last accessed 13.03.2023. URL:https:\/\/www.steamvr.com. 6"},{"key":"e_1_2_9_70_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2011.01884.x"},{"key":"e_1_2_9_71_2","doi-asserted-by":"crossref","unstructured":"WangZ. NguyenC. AsenteP. DorseyJ.: DistanciAR: Authoring site-specific augmented reality experiences for remote environments. InProceedings of the CHI Conference on Human Factors in Computing Systems(2021) pp.411:1\u201312. 4","DOI":"10.1145\/3411764.3445552"}],"container-title":["Computer Graphics Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cgf.14838","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,23]],"date-time":"2024-10-23T04:47:50Z","timestamp":1729658870000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/cgf.14838"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6]]},"references-count":70,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["10.1111\/cgf.14838"],"URL":"https:\/\/doi.org\/10.1111\/cgf.14838","archive":["Portico"],"relation":{},"ISSN":["0167-7055","1467-8659"],"issn-type":[{"value":"0167-7055","type":"print"},{"value":"1467-8659","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6]]},"assertion":[{"value":"2023-06-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}