TALK by professor Iiro P Jääskeläinen Brain and Mind Lab Aalto Uni

 

Invited lecture and a collaboration meeting with professor Iiro P Jääskeläinen and Enactive Virtuality Lab May 21-22, 2019.

Image: Pia Tikka, Iiro P Jääskeläinen, Jelena Rosic, and Ilkka Kosunen at MEDIT meeting space.

May 21 at 3-4 pm Dr Iiro P. Jääskeläinen, Associate Professor of the Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Finland,
gave an open neurocinematic talk on “Using movies as real-life like stimuli during neuroimaging to study the neural basis of social cognition” (room M-134).

Abstract:
Movies and narratives are increasingly used as stimuli in neuroimaging studies. This in many ways helps bridge the gaps between neuroscience, psychology, and even social sciences by allowing stimulation of, and thus also measurement of neural activity underlying, phenomena that have been less amenable to study with more traditional neuroimaging stimulus-task designs. Observation of signature patterns underlying discrete emotions across largely shared brain structures have suggested that both basic and dimensional emotion theories are partly correct. Robust differences in brain activity when viewing genetic vs. adopted sisters going through a moral dilemma in a movie clip have shown that knowledge of shared genes shapes perception of social interactions, thus demonstrating how neuroimaging can offer important measures for social sciences that complement the traditional behavioral ones. Furter, more idiosyncratic brain activity has been observed in high-functioning autistic than neurotypical subjects specifically in putative social brain regions when watching a drama movie. Development of data analysis algorithms holds keys to rapid advances in this relatively new area of research. Modeling the stimulus and recording brain activity is significantly complemented by behavioral measures on how the subjects experienced the movie stimulus.

Image: Jelena Rosic and Ilkka Kosunen engaged in  discussing correlations between ‘pheno’-dynamics and ‘neuro’-dynamics for our micro-phenomenological Memento study, a follow-up for Kauttonen et al 2018.

Visit to Department of Paediatrics Tartu University Hospital

Department of Digital Learning Games, professor Martin Sillaots organised a visit hosted by Professor Anneli Kolk (image) and her team  at the Department of Paediatrics at the Tartu University Hospital.  Among other things they focus on developing the social perception and cognitive abilities of children with neurological damage, using touch screen and VR technologies.

Program
  12:30 – 13:00 Anneli Kolk, Marianne Saard et al – Welcome and Visit to training lab
            13:10 – 13:20 Liina Reinart (image below)- Modern Experimental Training of Socio-Cognitive Deficit in Children with Acquired Brain Injury
            13:20 – 13:30 Anneli Kolk – Interactive Virtual Reality Metaphors for Social Deficit and Anxiety Remediation
            13:30 – 13:40 Kirsi Sepp – Cooperation and development plans
            13:40 – 13:50 Martin Sillaots – DLG intro (http://dlg.tlu.ee/)
            13:50 – 14:00 Katrin Sigijane – MEDIT intro (http://medit.tlu.ee/)
            14:00 – 14:10 Pia Tikka – NeuroCine and Enactive Virtuality Lab (http://www.neurocine.net/)
            14:10 – 14:30 Summary

 

Talk @ Hong Kong Baptist University

Pia Tikka:

Public lecture

Enactive Virtuality – Conceptualizing the dynamics of narrative cognition

Date:  21 March, 2019

Time:  4:30 – 5:45 pm

Venue: AAB 905, Academic and Adminstration Building, Baptist University Road Campus,  Hong Kong Baptist University, March 21, 2019.

https://talent100.hkbu.edu.hk/

Abstract

I will introduce my concept of enactive virtuality, associated with the idea of narratives as fundamental constructs of human mind. Inspired by the approach to enactive mind by Fransisco Varela and colleagues, the concept of enactive virtuality describes the experiencing mind as a dynamical system of body, brain, and the world. The epistemic triangulation is suggested as a means of translating the concept to practice.

While audiovisual narratives have been shown to elicit very similar physiological responses in different viewers, however, individual life experiences define how the story is interpreted by each. The approach of triadic epistemology, a combination of methods from arts, social sciences, and psychophysiology allows generating integrated knowledge about how different viewers experience particular narratives. The method builds on the fundamentally pragmatist idea that no two domains of knowledge are enough to explain each other, but a third is always required to provide the interpretative angle. Therefore, understanding narrative content needs to be analyzed not only based on subjective reports of the viewers, because that is not anchored to any overall understanding, but they also need to be related to a neurophysiological repertoire of experiences. Similarly, being able to describe the neural activity data collected during the viewing of a film, it is not enough to relate it only to subjective reports of the viewers, but the observations also need to be interpreted to conventions of narrative dramaturgy and filmmaking. A selection of cases are described to clarify the concept of enactive virtuality and the proposed triadic method.

 

 

And a great aftermath of the Talk at the HKBU campus Cafe with Roger Carcia, Chianly Sze, Samantha Goh, Mette Hjort, and Eugene Birman.

Against loneliness – Enactive Avatar

Against Loneliness: Sharing with Enactive Virtual Agent

The very nature of the human species is social. Loneliness correlates with mental and physical ill-being within, for instance, the elderly, or people with disabilities, or other conditions causing reduced life-environment. Simultaneously, an increasing trend in the European lifestyle is to outsource taking care of such members of family, or in a broader scale, the society, into the hands of professional social and medical care. In the light of recent studies, loneliness can be considered a fatal condition. Loneliness reduces the ability to improve one’s life-conditions, motivation of taking care of one’s health, and affects negatively the functions of society, thereby indirectly also the European economy. As an indication of the urgency of the matter, UK has even appointed a Minister of Loneliness.
The issue dictates the need to figure out all plausible ways to fight loneliness. While human company must be the primary solution, other solutions must be considered to provide socio-emotional comfort to those who suffer of the lack of human accompaniment. An intriguing suggestion is whether technology in some form might contribute to relieve this sore issue.

Work-in-progress: Enactive Virtuality Lab, BFM, TLU (MOBTT90) in collaboration with University of Tartu (UTARTU) Estonia, University of Barcelona (UB) Spain, Interdisciplinary Center Herzliya (IDC)Israel, Fraunhofer Heinrich Hertz Institute (HHI) Germany, Sense of Space Oy (SoS) Finland, Trotzkind GmbH (TRO) Germany and Tartu Linna Pensionäride Organisatsioon “Kodukotus” (TLPO) Estonia.

Image below: Skype group session during the project in development.

Video image: A conceptual 3D sketch of the shared experience between a bed-bound elderly and an enactive virtual accompaniment in VR immersive environment. The video depicts a first-person perspective to the co-presence when addressing loneliness by means of artificial accompaniment and virtual reality technologies. Against Loneliness: Sharing with Enactive Virtual Agent, MOBTT90. The 3D art work Eeva R Tikka, 2019.

Workshop on Enactive Mind in Design @ Imagis lab Politecnico di Milano

ENACTIVE MIND IN DESIGN

Dr Ilkka Kosunen on affective computing, at the Enactive Mind in Design workshop, the 2nd workshop week organised by Enactive Virtuality Lab at Department of Design, Politecnico di Milano, invited by Prof. Francesca Piredda.
In this workshop we familiarise ourselves with the concept of enactive mind and learn by practical work how enactive narrative systems can be applied to designing media projects.
The concepts of enactive cinema (Tikka 2008) and enactive media (Tikka 2010) are discussed, against the theoretical foundations of enactive cognitive sciences (Varela et al. 1991). Accordingly, a holistic first-person experience can be understood as being and playing a part in the world. The approach suggest going beyond the conventional concept of human–computer interaction by emphasising unconscious interaction between the experiencing participant and narrative systems. Instead of directly manipulating the narrative, the unfolding of the story is affected by the participant’s enactive emotional participation, tracked, for instance, by biosensors.
LEARNING MODES:
Lectures with video screenings, reading articles, and discussing on enactive mind and narratives; instructed/tutored hands-on enactive design exercises in small teams, analysing and reviewing created projects, demos and/or concepts.
LEARNING OUTCOMES:
Basic understanding on enactive mind and enactive narrative systems
Basic understanding of the use of biofeedback in enactive media design
Hands-on designing and producing enactive narrative systems (proof-of-concept)
Collaborative team work and presentation skills
TEACHERS:
Prof. Dr Pia Tikka, Dr. Ilkka Kosunen, School of Film, media, art and communication & Center of Excellence MEDIT, Tallinn University; Several visiting lecturers (t.b.a.)

2 TALKS on EMOTIVE VR Film by Marie-Laure Cazin

Freud’s last Hypnosis, a neuro-interactive 360 movie for EMOTIVE VR

Presentation of the ongoing project Emotive VR prototype, an innovative form combining VR and EEG headsets. A neuro-interactive omnidirectional movie has been realized, visualized in Virtual Reality (VR) Head-Mounted Display (HMD). During the visualization, the EEG signals are recorded and analyzed in real time. Some visual effects and an interactive music vary according to the emotional state of the viewer.

Marie-Laure Cazin is a Fine Arts teacher in the High school of Arts and Design ESAD-TALM (France) and in Paris 1 Panthéon-Sorbonne. Part of the Enactive Virtuality Research Group, in BFM, University of Talinn, she is currently completing a PhD in Aix-Marseille University (France) on Cinema and Neurosciences. As an artist and a filmmaker, she has developed many experimental cinematic prototypes, using digital tools to create a live interaction between the film and performers or spectators. She collaborated with scientists for art-science projects, working with brains’ datas of emotions in her last interactive projects.

See projects on line (Fr)

Sound designer Matias Harju webpages (Eng

EMOTIVE VR documentation online (Fr)

2 TALKS on EMOTIVE VR by Marie-Laure Cazin (ESAD-TALM, France)

Visiting lecture at Aalto University, Aalto Studios, organised by Virtual Cinema Lab & Enactive Virtuality Lab, January 30, at 14-15

January 30, at 14-15 Place: N-416, BFM, Narva Mnt 27, Nova Building, Tallinn University.

 

Visit at Medialab-Prado Madrid

Enactive Virtuality Lab on excursion at the Medialab-Prado AVLab, a space for creative experimentation involving sound art, visual art and performance art based on open and collaborative processes. Its areas of activity are: experimental music, live audio and video processing, video games, media facades, performance art and live performances.

And participating in AVFLOSS meeting for project initiatives (above).

Awarded the 2018 Oscar G. Brockett Book Prize for The Oxford Handbook of Screendance Studies

The chief editor Douglas Rosenberg is very excited to share the news:

The Oxford Handbook of Screendance Studies has been awarded the 2018 Oscar G. Brockett Book Prize for Dance Research by The Dance Studies Association.

The following is the citation offered by the selection committee about the book:

The Oxford Handbook of Screendance Studies, which is skillfully edited by Douglas Rosenberg, features a gracefully comprehensive introduction and thirty-six impactful chapters from leading scholars who expand our understanding of screen technologies as creative, collaborative tools for dance. Both foundational and insightful, the essays focus on pioneering figures like Loie Fuller, Maya Deren, and Norman McLaren; on histories from Harlem and Hollywood to Brazil and Bollywood; and on themes that productively intertwine virtual bodies, framing, editing, space, race, gender, and politics. Authors from Dance Studies and related fields turn their gazes toward the way screendance can provide a liberating or controlled space, an ever-changing canvas, a democratic frontier, a site for social justice, new aesthetic pleasure, or a viral phenomenon with many meanings. Readable, rigorous, and thought-provoking, The Oxford Handbook of Screendance Studies engages popular, contemporary, traditional, and historical dance, offering wide-ranging new ways of understanding how ideas travel and can transform our lives through the “stage” of the screen.

The award will be conferred at the annual Dance Studies Association Conference at Northwestern University, August 8 – 11, 2019.

The Oxford Handbook of Screendance Studies is the first publication to offer a scholarly overview of the histories, practices, and critical and theoretical foundations of the rapidly changing landscape of screendance.

Pia Tikka & Mauri Kaipainen contributed with the chapter on “Screendance as Enactment in Maya Deren’s At Land: Enactive, Embodied, and Neurocinematic Considerations”