Round table at Moscow Neurotechnology and Freedom -conference

Pia Tikka, Panelist at Moscow Neurotechnology and Freedom -conference march 18. 2021,  19-20:30 (GMT+3)

Image: Panelists

Program

Neuroscience & Art

Will be held on March 18, 2021 16:00-22:00 (Moscow Standard Time: GMT+3)

International оnline сonference «Neurotechnology and Freedom».

Organized by the Centre for Cognition & Decision Making, HSE University

Scientists, philosophers, and artists will discuss ethical, social, and legal issues related to the development of neurotechnologies.

Preliminary оnline program сonference:

16:00 — 16:15 Vasily Klucharev, Director of Institute for Cognitive Neuroscience, HSE University, PhD in Biology

16:15 — 16:45 Video presentation (opinions of experts on neuroscience and freedom)

16:45 — 17:00 Break

17:00 — 19:00 Talks:

17:00 — 17:25 Prof. Danil Raseev, Saint Petersburg University, Russia, expert of the Russian Science Foundation

17:25 — 17:50 Dr. Suzanne Dikker, NYU Max Planck Center for Language, Music, and Emotion, USA

17:50 — 18:15 Prof. Dr. Gabriel Curio, Charité – Universitätsmedizin Berlin, Germany

18:15 — 18:40 Prof. Risto Ilmoniemi, Aalto University, Finland

18:40 — 19:00 Dr. Ksenia Fedorova Leiden University, the Netherlands

19:00 — 20:30 Round table:

Prof. Dr. Gabriel Curio, Charité – Universitätsmedizin Berlin, Germany, Dr. Suzanne Dikker, NYU Max Planck Center for Language, Music, and Emotion, USA; Prof. Risto Ilmoniemi, Aalto University, Finland, Prof. Mikhail Lebedev, HSE University, Russia and Skoltech Center for Neuroscience and Neurorehabilitation, Russia; Dr. Ippolit Markelov, ITMO University, «18 Apples», Russia, Dr. Maria Nazarova, HSE University, Russia and Centre for Brain Research and Neurotechnologies, FMBA, Russia; Dr. Vadim Nikulin, Max Planck Institute for Human Cognitive and Brain Sciences, Germany, and HSE University, Russia; Prof. Danil Raseev, Saint Petersburg University, Russia; Dr. Prof. Pia Tikka, Enactive Virtuality Lab, Baltic Film, Media and Arts School (BFM) and Centre of Excellence in Media Innovation and Digital Culture (MEDIT), Tallinn University

20:30-21:00 Report: Prof. Patrick Haggard, University College London, UK

moderators: Prof. Vasily Klucharev, Institute for Cognitive Neuroscience, HSE University, Russia; media art theorist, Dr. Ksenia Fedorova Leiden University, the Netherlands

21:00 -—21:15 Break

21:15 — 22:00 Presentation of art projects: Ippolit Markelov artist, researcher, PhD in Biology, ITMO, «18 Apples»

Enactive Virtuality Lab presents Dec 1, 2020 

Welcome. Please join us!

Enactive Virtuality Lab presents the on-going work in online seminar.

Date: Tuesday Dec 1, 2020 
Time: 09:30 -12:00 Helsinki
Zoom Meeting

VIDEO recording (not edited) Passcode: &%10sVN$

Program

9:30

Pia Tikka (Enactive Virtuality Team leader, MOBTT90)
Introduction

9:45

Mehmet Burak Yılmaz (doctoral student @BFM)
Emotional impacts of camera movements
Exploring the emotional effects of different camera movement techniques (dolly, Steadicam, handheld) and the direction of the movement. Conducting psychophysiological experiments where the viewers watch cinematographic scenes.

10:00

Robert McNamara (doctor in law; doctoral student @BFM)
The creative potential of cinematic game narratives for evoking empathy for asylum seekers.
Exploring machine learning in the asylum seeker narratives in the “Refugee Status Determinations”. Measuring types of empathy response in depicting child separation by immigration enforcement officers in game engine-based cinematic narratives.

10:15

Debora Conceição Firmino De Souza (MA Thesis @DTI)
Humanizing interactions at the Border Control 
Drawing upon topics of HCI and game development, the study investigates the emotional states elicited by interactions with anthropomorphic Virtual Agents at the Border Control.

10:30

Ats Kurvet (computer graphics specialist)
Creating digital humans on a budget
The challenges and options when creating the visual component for avatars/digital humans.

10:45  

Valentin Siltsenko (research assistant)
Real-time text to speech synthesis 
Synthesizing natural sounding human speech with ability to set the emotion of the speaker.

11:00  

Abdallah Sham (doctoral student @DTI)
Machine learning in dyadic human – artificial agent interaction
Exploring the implementation of machine learning to training virtual human behaviour.

 11:15

Ermo Säks (doctoral student @BFM)
Storytelling in Cinematic Virtual Reality: The role of cinematographic techniques in evoking immersion in virtual environments
Using practical research methods this doctoral project seeks the cinematic techniques feasible to increase the perceived immersion in Cinematic Virtual Reality (CVR) where the user’s main agency is to look around in a narrative story-based CVR drama experience that features a beginning, middle, and end.

11:30-12:00

Discussion
 

Open for public!

A talk at the Forum on Arts & Social Robotics in Hong Kong

Invited talk by Pia Tikka at the Hong Kong Forum Nov 2, 2019.

Hong Kong Baptist University will be partnering with the Consul General of France and the Alliance Francaise to mount an exhibition and a forum, October 31 – November 2, 2019.

The exhibition will focus on the work of the French artist Yves Gellie, specifically his photographs and films related to social robotics and artificial empathy. (t.b.c.)

Hong Kong offers possibilities to play with Sophia from Hanson Robotics.

 

Affective Computing ACII 2019 conference Cambridge

 

The 8th International Conference on. Affective Computing & Intelligent Interaction ( ACII 2019). 3rd-6th September, 2019. Cambridge, United Kingdom.

Enactive Virtuality team has two abstracts accepted for multidisciplinary Special Tracks :

(1) Neural and Psychological Models of Affect and (2) Technological and Biological Bodies in Dialogue: Multidisciplinary Perspectives on Multisensory Embodied Emotion and Cognition.

Image: Jelena Rosic in action during an TLU ‘s internal pre-presentation of the  ACII conference talk “Phenomenology of the Artificial” by Kosunen,  Rosic, Kaipainen and Tikka,

TALK by professor Iiro P Jääskeläinen Brain and Mind Lab Aalto Uni

 

Invited lecture and a collaboration meeting with professor Iiro P Jääskeläinen and Enactive Virtuality Lab May 21-22, 2019.

Image: Pia Tikka, Iiro P Jääskeläinen, Jelena Rosic, and Ilkka Kosunen at MEDIT meeting space.

May 21 at 3-4 pm Dr Iiro P. Jääskeläinen, Associate Professor of the Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Finland,
gave an open neurocinematic talk on “Using movies as real-life like stimuli during neuroimaging to study the neural basis of social cognition” (room M-134).

Abstract:
Movies and narratives are increasingly used as stimuli in neuroimaging studies. This in many ways helps bridge the gaps between neuroscience, psychology, and even social sciences by allowing stimulation of, and thus also measurement of neural activity underlying, phenomena that have been less amenable to study with more traditional neuroimaging stimulus-task designs. Observation of signature patterns underlying discrete emotions across largely shared brain structures have suggested that both basic and dimensional emotion theories are partly correct. Robust differences in brain activity when viewing genetic vs. adopted sisters going through a moral dilemma in a movie clip have shown that knowledge of shared genes shapes perception of social interactions, thus demonstrating how neuroimaging can offer important measures for social sciences that complement the traditional behavioral ones. Furter, more idiosyncratic brain activity has been observed in high-functioning autistic than neurotypical subjects specifically in putative social brain regions when watching a drama movie. Development of data analysis algorithms holds keys to rapid advances in this relatively new area of research. Modeling the stimulus and recording brain activity is significantly complemented by behavioral measures on how the subjects experienced the movie stimulus.

Image: Jelena Rosic and Ilkka Kosunen engaged in  discussing correlations between ‘pheno’-dynamics and ‘neuro’-dynamics for our micro-phenomenological Memento study, a follow-up for Kauttonen et al 2018.

Workshop on Enactive Mind in Design @ Imagis lab Politecnico di Milano

ENACTIVE MIND IN DESIGN

Dr Ilkka Kosunen on affective computing, at the Enactive Mind in Design workshop, the 2nd workshop week organised by Enactive Virtuality Lab at Department of Design, Politecnico di Milano, invited by Prof. Francesca Piredda.
In this workshop we familiarise ourselves with the concept of enactive mind and learn by practical work how enactive narrative systems can be applied to designing media projects.
The concepts of enactive cinema (Tikka 2008) and enactive media (Tikka 2010) are discussed, against the theoretical foundations of enactive cognitive sciences (Varela et al. 1991). Accordingly, a holistic first-person experience can be understood as being and playing a part in the world. The approach suggest going beyond the conventional concept of human–computer interaction by emphasising unconscious interaction between the experiencing participant and narrative systems. Instead of directly manipulating the narrative, the unfolding of the story is affected by the participant’s enactive emotional participation, tracked, for instance, by biosensors.
LEARNING MODES:
Lectures with video screenings, reading articles, and discussing on enactive mind and narratives; instructed/tutored hands-on enactive design exercises in small teams, analysing and reviewing created projects, demos and/or concepts.
LEARNING OUTCOMES:
Basic understanding on enactive mind and enactive narrative systems
Basic understanding of the use of biofeedback in enactive media design
Hands-on designing and producing enactive narrative systems (proof-of-concept)
Collaborative team work and presentation skills
TEACHERS:
Prof. Dr Pia Tikka, Dr. Ilkka Kosunen, School of Film, media, art and communication & Center of Excellence MEDIT, Tallinn University; Several visiting lecturers (t.b.a.)

Meeting @EmpaticaXR and eRMLab/UAM Madrid

 

EmpaticaXR is a Transformative Technology and Evolutionary company translating cutting-edge neuropsychological knowledge into experiential narrative XR experiences aimed towards human flourishing. The researchers at EmpaticaXR are encoding concepts from the cognitive sciences, in combination with the emotional power of the cinematic narrative storytelling arts, to create the audiovisual transformative experience of wonder and awe that can only be massively spread through the power of XR, AI & Biometric Technologies.

Meeting with Alejandro Sacristán, EmpaticaXR Business Development & Operations, Madrid and Jorge Esteban Blein, VR Creative Director, and immersive storytelling consultant (in image).

***

Followed by a visit to the reactive professor Jose Maria de Poveda at empathic Reactive Media Lab (eRMLab)”, Universidad Autónoma de Madrid, UAM.

(In image at left Profesor Jesús Poveda de Agustin, in the middle professor Jose Maria de Poveda)

 

Neuroadaptive dance project “Trisolde”

TRISOLDE – Neuroadaptive Gesamtkunstwerk: The Biocybernetic Symbiosis of Tristan and Isolde”

Exploring the final frontier of human-computer interaction with a neuroadaptive opera…performed by the audience, dancers and computational creativity .

Team of “TRISOLDE” (Tiina Ollesk, Simo Kruusement, Renee Nõmmik, Ilkka Kosunen, Hans-Günther Lock, Giovanni Albini) performed in Festival “IndepenDance” in Göteborg, nov 29 and Dec 2, 2019.

A symbiotic dance version of Wagner´s “Tristan and Isolde” where dancers are controlling the music via body movements and implicit psychophysiological signals. This work explores the next step in this coming-together of man and machine: the symbiotic interaction paradigm where the computer can automatically sense the cognitive and affective state of the user and adapt appropriately in real-time. It brings together many exciting fields of research from computational creativity to physiological computing. To measure audience and to use the audience’s reactions to module the orchestra is new way of doing “participatory theatre” where audience becomes part of the performance.

“Tristan and Isolde” is widely considered both as one of the greatest operas of all time as well as beginning of modernism in music, introducing techniques such as chromaticism dissonance and even atonality. It has sometimes been described as a “symphony with words”; the opera lacks major stage action, large choruses or wide range of characters. Most of the “action” in the opera happens inside the heads of Tristan and Isolde. This provides amazing possibilities for a biocybernetic system: I this case, Tristan and Isolde will communicate both explicitly (through movement of the dancers) but also implicitly via the measured psychophysiological signals.

Dance artists: Tiina Ollesk, Simo Kruusement

Choreographer-director: Renee Nõmmik

Dramaturgy and science of biocybernetic symbiosis: Ilkka Kosunen

Composers for interactive audio media: Giovanni Albini, Hans-Gunter Lock

Video interaction: Valentin Siltsenko

Duration: 40’

This performance is supported by: The Cultural Endowment of Estonia, and Enactive Virtuality Lab and Digital Technology Insitute (biosensors), Tallinn University.

Presentation of project: November 29th-30th and December 1st, 2018 at 3:e Våningen Göteborg (Sweden) at festival Independance. The event is dedicated to the centenary of the Republic of Estonia and supported by program “Estonia100-EV100”.

PREMIER IN TALLINN FEBRUARY 2019 (see more Fine 5 Theater)

 

The Booth @ Worlding the Brain conference in Aarhus Uni

The Booth

Due to on-going experiments more details added about this art/science project only after the experimental data collection has been completed. Our presentation in Aarhus University Worlding the Brain Conference, 27–29 Nov, 2018, showed initial findings.

Team: Pia Tikka, Ilkka Kosunen, Lynda Joy Gerry, Eeva R Tikka, Victor Pardinho, Can Uzer, Angela Kondinska, Michael Becken & Ben Ighoyota Ajenaghughrure, with others.

Finnish Cultural Foundation Huhtamäki Fund; Virtual Cinema Lab Aalto University School of ARTS; BioLab by Digital Technology Insitute, Tallinn University; Tikka & Kosunen: EU Mobilitas Pluss Top Researcher Grant (2017-2022), Estonian Research Council in association with Tallinn University.