Project

Back to overview

From Multimodality to Multisensoriality: Language, Body, and Sensoriality in Social Interaction (intSenses)

English title From Multimodality to Multisensoriality: Language, Body, and Sensoriality in Social Interaction (intSenses)
Applicant Mondada Lorenza
Number 175969
Funding scheme Project funding (Div. I-III)
Research institution Institut für Französische Sprach- und Literaturwissenschaft Universität Basel
Institution of higher education University of Basel - BS
Main discipline Romance languages and literature
Start/End 01.10.2018 - 30.09.2022
Approved amount 879'704.00
Show all

All Disciplines (2)

Discipline
Romance languages and literature
German and English languages and literature

Keywords (8)

Social Interaction; Conversation Analysis; Interactional linguistics; 5 senses; Video Analysis; Sensoriality; Embodiment; Multimodality

Lay Summary (French)

Lead
La sensorialité en action: le langage et le corps dans l'interaction sociale(projet intSenses)
Lay summary

Les cinq sens ont attiré depuis longtemps l'attention de nombreuses disciplines, que ce soit dans les sciences humaines et sociales, les sciences cognitives et les sciences de la vie. Les sens jouent en effet un rôle fondamental dans la manière dont les humains agissent et entretiennent un rapport avec le monde. Le projet porte sur les pratiques par lesquelles les personnes organisent leur engagement et leur action dans le monde matériel, en utilisant leur corps et leur langage. Alors que de nombreux modèles ont insisté sur la dimension individuelle et privée de la perception sensorielle, ce projet montre son importance sociale, culturelle et linguistique, manifestée par l'organisation intersubjective des pratiques sensorielles dans l'interaction sociale. 

Le projet intSenses vise à offrir une approche conceptuelle et empirique de la sensorialité qui repose sur un modèle intégré du langage et du corps dans l'interaction sociale. Fondé sur l'analyse conversationnelle, la linguistique interactionnelle et l'analyse vidéo, le projet vise à développer l'approche de la multimodalitéen interaction - c'est-à-dire de l'imbrication du langage, des gestes, du regard, des postures du corps, des mouvements - dans le sens d'une approche de la multisensorialitéen interaction - c'est-à-dire de la manière dont les participants à une action s'engagent avec leur langage et leur corps dans des pratiques sensorielles. Plus particulièrement, le projet développe des analyses empiriques de la manière dont les gens sentent, goûtent et touchent la nourriture au sein d'activités collectives telles que rechercher et produire des aliments, cuisiner ensemble, participer à des séances de dégustation, manger en famille ou entre amis, etc. Ces situations seront étudiées en détail grâce à une méthodologie vidéo innovante, basée sur des enregistrements audio-visuels d'activités documentées in situ et telles qu'elles se déroulent de manière ordinaire dans leur contexte social. Le projet vise en particulier la manière dont le langage et le corps sont mobilisés dans des pratiques sensorielles auxquelles ils confèrent une dimension intersubjective et communicative qui dépasse l'expérience individuelle. Le projet entend ainsi développer des analyses empiriques qui nourriront une nouvelle approche conceptuelle insistant sur le lien entre sensorialité, intersubjectivité et interaction sociale. 


Direct link to Lay Summary Last update: 25.09.2018

Responsible applicant and co-applicants

Employees

Project partner

Abstract

Sensoriality is a fundamental dimension of the human experience in and of the world - since people engage in the material world using their entire body, their senses and their language. However, despite a growing interest in language and embodiment in various disciplines the role of sensoriality is still neglected. Moreover, sensoriality is often considered as relying primarily on individual and private perceptions. Although some research on the senses exists in cognitive linguistic and historical-anthropological fields, sensoriality remains largely ignored from an interactional perspective.The intSenses project aims at filling these gaps, by recognizing sensoriality a central theoretical and empirical role within an integrated model of language and body in social interaction. Rooted in conversation analysis, the project aims at developing current research on multimodality in social interaction - that is, the way participants mobilize together language, gesture, gaze, body postures and movements in order to act and communicate - on the new territory of multisensoriality - that is, the way participants collectively engage in sensorial practices involving all of the senses.More particularly, the project will develop empirical analyses of how people smell, taste, and touch food within joint activities such as cooking together, how their body and their language feature in these practices in specific and complementary ways, how they manifest publicly and communicate intersubjectively what they sense within social interaction. These empirical analyses will inspire conceptual advances, reflecting on the role of sensoriality in the multimodal organization of social interaction. Thus, the project’s general aim is to propose a new approach to multisensoriality based on a multimodal approach of social interaction. • The focus of the study are sensory practices - that is, meaningful social acts of sensing - carried out via movements of the hand and the body. These sensory practices are embedded within specific courses of action and broader activities in talk and social interaction. • The focus will be on the more neglected sensory practices - tasting, touching, and smelling - and their interrelationships. Gazing and hearing will also be considered as they are crucial for establishing the intersubjectivity of sensory practices. • Multisensoriality will be studied using an innovative methodology involving video recordings of sensory practices and detailed multimodal transcription and analysis of these recordings. The data will document how people in authentic social settings, speaking different languages, experience their senses during ordinary activities.• The analytical focus will be on the multimodal resources (language, gesture, gaze, facial expressions, body postures, movements, etc.) that organize these practices in a publicly intelligible way. This also entails the study of how language and the body, i.e. audible (verbal and vocal) and visible resources, achieve the intersubjectivity of sensory practices in social interaction.• An empirical focus will be given to tasting, touching, and smelling in food activities as an exemplary domain for empirical investigations of sensoriality in action. Instances of sensory practices in selecting, preparing, and discovering food will be studied in detail.On the one hand, the project aims at analyzing how people collectively engage in sensory practices - such as tasting food, for example - by mobilizing different aspects of their body and their language in a way that is publicly and intersubjectively intelligible. One the other hand, the project aims at showing how sensoriality features in the multimodal organization of interaction, by showing how not only visual and audible but also haptic, aromatic, and tasty features are oriented to by participants in building the accountability of their mutual and coordinated activities.
-