Project

Back to overview

EMOtive: Affective and effective visual analytics displays

English title EMOtive: Affective and effective visual analytics displays
Applicant Fabrikant Sara Irina
Number 156072
Funding scheme Project funding (Div. I-III)
Research institution Geographisches Institut Universität Zürich
Institution of higher education University of Zurich - ZH
Main discipline Other disciplines of Environmental Sciences
Start/End 01.01.2015 - 30.09.2017
Approved amount 186'394.00
Show all

All Disciplines (4)

Discipline
Other disciplines of Environmental Sciences
Other disciplines of Engineering Sciences
Information Technology
Psychology

Keywords (6)

spatial cognition; geographic information science; geovisual analytics; empirical research; psycho-physiological sensing; eye tracking

Lay Summary (German)

Lead
Wie extrahieren wir Raum-Zeit Informationen aus Kartenapplikationen auf digitalen Assistenten während der Navigation, besonders wenn die Entscheidungszeit knapp und möglicherweise auch noch emotional aufgeladen ist. Unklar ist, wie unsere begrenzten visuellen und kognitiven Wahrnehmungsressourcen sowie unsere autonome Nervenaktivität beeinflussen können, wie die dargestellte Rauminformation aufgenommen und verarbeitet wird. Dies bestimmt letztlich wie effizient und effektiv wir Raum-Zeit relevante Entscheidungen in zeitkritischen Situationen unter Unsicherheit treffen können.
Lay summary

Inhalt und Ziel des Forschungsprojekts

Täglich treffen wir raum-relevante Entscheidungen die mit Unsicherheit behaftet sind und unter Zeitdruck geschehen (z.B. Wegfindung). Viele solcher Entscheidungen werden mit interaktiven, graphischen Darstellungen getroffen wie z.B. mit mobilen, Karten-basierten Navigationssystemen, die geographische Informationen beinhalten. Dieses Forschungsprojekt zielt zunächst auf ein tieferes Verständnis, wie Nutzer in zeitkritischen Entscheidungskontexten und unter Unsicherheit geographische Informationen aus interaktiven graphischen Schnittstellen extrahieren und für die Entscheidungsfindung nutzen. Zweitens, sollen mittels Probandenstudien empirisch basierte Design-Richtlinien abgeleitet werden für die Entwicklung von kognitiv inspirierten, visuell expressiven und affektiv ansprechende interaktiven graphischen Nutzerschnittstellen zu Geodaten, um die raum-zeitliche Entscheidungsfindung effizient und effektiv zu unterstützen. Wir zielen auf Richtlinien, die generisch genug für ein breites Spektrum von emotional aufgeladenen, raum-relevanten Entscheidungen, die mit Geodaten unter Zeitdruck und Unsicherheit geschehen: z.B. bei der Navigation in komplexem Gelände, bei Schutz und Rettung, etc. 

Wissenschaftliche und Gesellschaftliche Relevanz

Ein tieferes Verständnis der raum-relevanten Entscheidungsfindung mit graphischen Nutzerschnittstellen ermöglicht auch die effektive Gestaltung von Bildmaterial für den Unterricht, in Schule und Ausbildung, sowie für die kognitiv-adäquate Entwicklung von leistungstarken graphischen Nutzerschnittstellen, die von ExpertInnen in Wissenschaft, Industrie und Verwaltung zur Erkundung von grossen, komplexen Raum-Zeit Datenbanken für die Entscheidungsfindung verwendet werden (z.B. Klimamodellierungen). Resultate dieser empirischen Forschung wird auch die Nutzbarkeit von Geodaten mittels IT-Systeme erhöhen, ein unverzichtbarer Aspekt für eine erfolgreiche, immer mobiler werdende Informationgesellschaft.

Direct link to Lay Summary Last update: 24.07.2017

Responsible applicant and co-applicants

Employees

Publications

Publication
Do Skyscrapers Facilitate Spatial Learning Under Stress? On the Cognitive Processing of Global Landmarks.
Credé S. Fabrikant S.I. Thrash T. Hölscher C. (2018), Do Skyscrapers Facilitate Spatial Learning Under Stress? On the Cognitive Processing of Global Landmarks., in Lecture Notes in Geoinformation and Cartography, Cham.
An empirical evaluation of three elevation change symbolization methods along routes in bicycle maps
Bruegger Annina, Fabrikant Sara Irina, Coltekin Arzu (2017), An empirical evaluation of three elevation change symbolization methods along routes in bicycle maps, in Cartography and Geographic Information Science, 1-16.
Crowdsourcing for Information Visualization: Promises and Pitfalls.
Borgo R. Lee B. Bach B. Fabrikant S. Jianu R. Kerren A. Kobourov S. McGee F. Micalle (2017), Crowdsourcing for Information Visualization: Promises and Pitfalls., in LNCS 10264, Dagstuhl Seminar 15481, Revised Contributions,, Berlin.
Designing across map use contexts: A research Agenda. International Journal of Cartography,
Griffin A.L. White T. Fish C. Tomio B. Huang H. Robbi Sluter C. Meza Bravo J.V. Fabri (2017), Designing across map use contexts: A research Agenda. International Journal of Cartography,, in International Journal of Cartography, *.
Fabrikant, S.I., Christen, M,. Brugger, P. (2017). What color is your brain? Proceedings, 28th International Cartographic Conference, International Cartographic Association, Jul. 2-7, 2017, Washingto
Fabrikant S.I. Christen M. Brugger P. (2017), Fabrikant, S.I., Christen, M,. Brugger, P. (2017). What color is your brain? Proceedings, 28th International Cartographic Conference, International Cartographic Association, Jul. 2-7, 2017, Washingto, in International Cartographic Conference, International Cartographic Association, Washington, D.C..
The effects of visual realism, spatial abilities, and competition on performance in map-based route learning in men
Coltekin Arzu, Francelet Rebecca, Richter Kai-Florian, Thoresen John, Fabrikant Sara Irina (2017), The effects of visual realism, spatial abilities, and competition on performance in map-based route learning in men, in Cartography and Geographic Information Science, 1-15.
Towards a stress resistant pedestrian navigation system for spatial knowledge acquisition
Credé S. (2017), Towards a stress resistant pedestrian navigation system for spatial knowledge acquisition, in Models and representations in Spatial Cognition, Tuebingen.
Stress Supports Spatial Knowledge Acquisition during Wayfinding with Mobile Maps.
Frei PatriceRichter Kai-FlorianFabrikant Sara Irina (2016), Stress Supports Spatial Knowledge Acquisition during Wayfinding with Mobile Maps., in Proceedings (short papers), 9th International Conference on Geographic Information Science, Montreal.
Assessing geographic relevance for mobile search: A computational model and its validation via crowdsourcing
Reichenbacher T., De Sabbata S., Purves R.S., Fabrikant S.I. (2016), Assessing geographic relevance for mobile search: A computational model and its validation via crowdsourcing, in Journal of the Association for Information Science and Technology, 67(11), 2620-2634.
How do display design and user characteristics matter in animations? An empirical study with air traffic control displays
Maggi S., Fabrikant S.I., Imbert J.-P., Hurter C. (2016), How do display design and user characteristics matter in animations? An empirical study with air traffic control displays, in Cartographica, 51(1), 25-37.
Not all anxious individuals get lost: Trait anxiety and mental rotation ability interact to explain performance in map-based route learning in men
Thoresen J.C., Francelet R., Coltekin A., Richter K.-F., Fabrikant S.I., Sandi C. (2016), Not all anxious individuals get lost: Trait anxiety and mental rotation ability interact to explain performance in map-based route learning in men, in Neurobiology of Learning and Memory, 132, 1-8.
Walk and Learn: An Empirical Framework for Assessing Spatial Knowledge Acquisition during Mobile Map Use
Bruegger A. Richter K.-F. Fabrikant S. I., A. Bruegger K.-F. Richter S. I. Fabrikant (2016), Walk and Learn: An Empirical Framework for Assessing Spatial Knowledge Acquisition during Mobile Map Use, in Proceedings (short papers), 9th International Conference on Geographic Information Science,, Montreal, Canada.
Cognitive Perspectives on Cartography and Other Geographic Information Visualizations (Chapter 10).
Montello D. Fabrikant S.I. Davies C., Cognitive Perspectives on Cartography and Other Geographic Information Visualizations (Chapter 10)., in Montello D. (ed.), *.

Collaboration

Group / person Country
Types of collaboration
University of California Santa Barbara (USCB) United States of America (North America)
- in-depth/constructive exchanges on approaches, methods or results
- Publication
ETH Zürich, D-GESS Switzerland (Europe)
- in-depth/constructive exchanges on approaches, methods or results
- Research Infrastructure
UZH Digital Society Initiative Switzerland (Europe)
- in-depth/constructive exchanges on approaches, methods or results
- Publication
- Research Infrastructure
- Exchange of personnel
Department of Computing Science, Umeå University, Sweden Sweden (Europe)
- in-depth/constructive exchanges on approaches, methods or results
- Publication
- Exchange of personnel
University of Zurich (UZH) Switzerland (Europe)
- in-depth/constructive exchanges on approaches, methods or results
- Publication
- Research Infrastructure

Scientific events

Active participation

Title Type of contribution Title of article or contribution Date Place Persons involved
International Conference on Spatial Information Theory (COSIT 2017) Poster Do Skyscrapers Facilitate Spatial Learning Under Stress? On the Cognitive Processing of Global Landmarks 27.09.2017 L'Aquila, Italy Credé Sascha; Fabrikant Sara Irina;
International Conference on Spatial Information Theory (COSIT 2017) Talk given at a conference . Distributing attention between environment and navigation system to increase spatial knowledge acquisition during assisted wayfinding 04.09.2017 L'Acquila, Italy Fabrikant Sara Irina;
28th International Cartographic Conference, International Cartographic Association (ICC 2017) Talk given at a conference What color is your brain? 02.07.2017 Washington, D.C., United States of America Fabrikant Sara Irina;
28th International Cartographic Conference, International Cartographic Association (ICC 2017) Talk given at a conference Visualization of risk and uncertainty to communicate avalanche hazard: An Empirical Study. 02.07.2017 Washington, D.C., United States of America Fabrikant Sara Irina;
Int. Workshop on Visual Analytics, EuroVA 2016 Talk given at a conference Moving Visual Analytics of Movement. Keynote. 06.06.2017 Groningen, Netherlands Fabrikant Sara Irina;
Colloquium Visual Attention Lab, Brigham and Women’s Hospital, Harvard University, Boston Individual talk Towards Human-Responsive Geographic Information Displays. 12.04.2017 Cambridge, United States of America Fabrikant Sara Irina;
Culture Analytics and User Experience Design Workshop, Institute for Pure & Applied Mathematics, NSF Math Institute at the University of California Los Angeles Talk given at a conference Towards Responsive Visual Analytics Designs. 12.04.2017 Los Angeles, United States of America Fabrikant Sara Irina;
Collquium Department of Geography, Diego State University Individual talk Decision Making with Visual Displays to Guide Movement. 08.04.2017 San Diego, United States of America Fabrikant Sara Irina;
Second International Workshop on Models and Representations in Spatial Cognition Poster Towards a stress resistant pedestrian navigation system for spatial knowledge acquisition 06.04.2017 Tuebingen, Germany Fabrikant Sara Irina; Credé Sascha;
International Workshop: Communicating Climate Change. Connecting Cognitive Science and Climate Science Talk given at a conference Geographic Information Displays for Effective and Efficient Reasoning and Decision Making. Keynote. 10.11.2016 London, Great Britain and Northern Ireland Fabrikant Sara Irina;
9th International Conference on Geographic Information Science (GIScience 2016) Talk given at a conference An Empirical Framework for Assessing Spatial Knowledge Acquisition during Mobile Map Use 27.09.2016 Montreal, Canada Fabrikant Sara Irina;
9th International Conference on Geographic Information Science (GIScience 2016) Talk given at a conference Stress Supports Spatial Knowledge Acquisition during Wayfinding with Mobile Maps. 27.09.2016 Montreal, Canada Fabrikant Sara Irina;
Invited talk at The Cartographic Summit. The Future of Mapping. Hosted by the International Cartographic Association (ICA) and Esri Inc., Talk given at a conference Evidence-based Design. 09.02.2016 Redlands, CA, United States of America Fabrikant Sara Irina;
Dagstuhl Seminar 15481: Evaluation in the Crowd: Crowdsourcing and Human-Centred Experiments International Conference and Research Center for Computer Science Talk given at a conference Emotive Visual Display: Design through indoor & outdoor citizen science. 23.11.2015 Wadern, Germany Fabrikant Sara Irina;
Colloquium talk at The Pennsylvania State University, Department of Geography Individual talk Emotion in Motion: Visuo-spatial Decision Making with Dynamic Maps. 27.03.2015 State College, PA, United States of America Fabrikant Sara Irina;
Invited talk at GeoViz Hamburg 2015. Expert Workshop on supporting decision making through geovisualization: A view from different perspectives. Talk given at a conference Visuo-spatial Decision Making with Well Designed Displays. 20.01.2015 Hamburg, Germany Fabrikant Sara Irina;


Self-organised

Title Date Place
Int. Conference on Spatial Information Theory (COSIT2015) 12.10.2016 Santa Fe, United States of America

Knowledge transfer events



Self-organised

Title Date Place

Communication with the public

Communication Title Media Place Year
New media (web, blogs, podcasts, news feeds etc.) Digital Pathfinders UZH News International 2017
Media relations: print media, online media Digitale Pfadfinder UZH Magazin Western Switzerland International 2017
Media relations: print media, online media Der Richtige Weg im Digitalen Zeitalter NZZ, und diverse andere German-speaking Switzerland International 2016
New media (web, blogs, podcasts, news feeds etc.) EMOtive UZH Web: Digital Society Initiative International German-speaking Switzerland 2016
Media relations: print media, online media Uni Zürich startet Digital-Society-Initiative Tagi German-speaking Switzerland International 2016

Awards

Title Year
Emotive is one of the Flagship Projects of the newly established UZH Digital Society Initiative (DSI), see category outreach. PI Sara Fabrikant was co-intitiator of the initiative. She is elected Member of the DSI Directorate by the University Board, and elected Fellow of the DSI for 2018. 2017
Recipient of 3rd Best Poster Presentation Award at COSIT 2017. 2017
Recipient of Best Poster Presentation Award at COSIT 2017. 2017
Recipient of Best Short Paper Presentation Award at GIScience 2016 2016

Associated projects

Number Title Start Funding scheme
126657 POPEye II: Visual Analytic of spatio-temporal gaze Point Patterns Eye movements 01.10.2009 Project funding (Div. I-III)
175977 EMOtive II: Affective and effective visual analytics displays 01.10.2017 Project funding (Div. I-III)
134646 AniMOVE: animated visual analytics of movement 01.01.2012 Project funding (Div. I-III)
134646 AniMOVE: animated visual analytics of movement 01.01.2012 Project funding (Div. I-III)
113745 POPEye: Visual Analytics of spatio-temporal gaze Point Patterns in Eye movements 01.03.2007 Project funding (Div. I-III)

Abstract

Synopsis: This new proposal builds upon prior work by not only focusing on creating perceptually salient, cognitively supportive, but additionally also on affectively responsive visual displays, for decision making in time-critical contexts, and under uncertainty.Motivation: As visuo-spatial displays are increasingly used in mobile and dynamically evolving situations, it will be important to consider research on the kind of information that users can get from displays when used in time and attention critical, and potentially also emotionally charged spatio-temporal decision-making situations. Limited perceptual and cognitive resources of display users-also often overlooked, autonomic nervous activity-most likely will influence how the depicted information is apprehended, and this will ultimately determine how effective users will be in detecting and reasoning about spatio-temporal phenomena, and make effective and efficient decisions in time critical situations under uncertainty. Research objective: The proposed research firstly aims at better understanding of how users explore and extract knowledge from visual displays in time critical contexts, under varying affective states, to make space-time decisions under uncertainty, and secondly, at deriving empirically based design guidelines for the construction of cognitively inspired, perceptually salient, and affectively responsive displays for effective and efficient spatio-temporal decisions-making in time critical, and in uncertainty situations. We aim at guidelines that are generic enough to be useful for a broad range of decisions-making scenarios and uncertainty conditions, including various geographically relevant application domains (e.g., disaster response, navigation, search and rescue, etc.).An international team of researchers at the University of Zurich, the University of California Santa Barbara (USA), and at the Department of Humanities, Social and Political Sciences of the ETH Zurich are involved in the project. Resources are requested for two PhD students, and to enable collaborative visits by the students and the external collaborators, including conference and workshop attendance support to disseminate research findings. The project is organized in two empirical research tracks: Subproject A emphasizes the development and evaluation of immersive display methods in a virtual reality lab, while Subproject B focuses on the development and evaluation of mobile display methods in the real world. The main goals leading the two tracks are as follows: • to identify the characteristics of how users make space-time decisions with visual displays under to various affective states due to time critical situations and uncertainty (in the VR lab and mobile, in the world), and • to develop empirically based design guidelines for the construction of perceptually salient, cognitively inspired, and affectively responsive visual displays for more effective and efficient spatio-temporal inference and decision-making in time critical contexts and under uncertainty. Key outputs are expected along three cyclic work phases. First, knowledge integration across complementary research fields is carried out at the theoretical level (uncertainty visualization, decision-making under stress and uncertainty, affect and arousal). Second, an experimental visual display platform is implemented, to be tested in the VR lab and mobile in the world, and thirdly, visual displays are evaluated with users (i.e., empirical evaluation of usefulness and usability).
-