As part of the Frontiers du Vivant, Lynda Joy Gerry presented and defended her project “Compassion Cultivation Training in Bio-Adaptive Virtual Environments” at the Centre for Research and Interdisciplinarity (CRI) in Paris. This project involves using perspective-taking in virtual environments using biofeedback relating to emotion regulation (heart rate variability) to manage the recovery from empathic distress. Empathic distress is conceived as a step in the empathic process towards the understanding of another person’s affective, bodily, and psychological state, but one that can lead to withdrawal and personal distress for the empathizer. Thus, this project implements instruction techniques adopted from Compassion Cultivation Training guided meditation practices cued by biofeedback to entrain better self-other boundaries and distinctions, as well as emotion regulation.
Lynda also participated in a workshop on VR and Empathy led by Philippe Bertrand from BeAnother Lab (BAL, The Machine to Be Another). See Philippe Bertrand TEDx talk “Standing in the shoes of the others with VR”
In collaboration with BeAnotherLab (The Machine to Be Another), Lynda Joy Gerry taught a workshop, “Embodying Creative Expertise in Virtual Reality” to Masters in Interaction Design students at Zürcher Hochschule der Künste (ZhDK), as part of a course, “Ecological perception, embodiment, and behavioral change in immersive design” led by BAL members.
Image: Poster for the students’ final project presentation and exhibition.
Lynda specifically taught students design approaches using a semi-transparent video overlay of another person’s first-person, embodied experience, as in First-Person Squared. The focus of the workshop was on Leap Motion data tracking and measurements, specifically how to calculate compatibility and interpersonal motor coordination through a match score between the two participants, and how to send this data over a network. The system provides motor feedback regarding imitative gestures that are similar in form and position, and also for gestures that occur synchronously (at the same time), ideally trying to support both types of interpersonal motor coordination. Lynda taught students the equations used and data input necessary to calculate this algorithm for the different match scores, and also how to add interaction effects to this data. Lynda showed students how to implement Leap motion hand tracking on top of stereoscopic point-of-view video and how to record user hand movements. On the 31st, students premiered their final projects at an event entitled “Scattered Senses.”
On March 30th, Lynda Joy Gerry visited the Innovation Lab at Zürcher Hochschule der Künste (ZhDK) for a workshop entitled “Mimic Yourself.”
This workshop involved collaborations between psychologists, motion-tracking and capture experts, and theater performers. The performers wore the Perception Neuron motion capture suit within an opti-track system. The data from the performer’s motion was tracked onto virtual avatars in real-time. Specifically, the team had used the Structure Sensor depth-field camera to create photogrammetry scans of members of the lab. These scans were then used as the avatar “characters” put into the virtual environment to have the mocap actors’ movements tracked onto. A screen was also programmed into the Unity environment, such that the screen could move around the real world in different angles and three-dimensional planes and show different views and perspectives of the virtual avatar being tracked relative to the human actor’s movements. Two actors playfully danced and moved about while impacting virtual effects with their tracked motion – specifically, animating virtual avatars but also cueing different sound effects and experiences.
Image above: Motion capture body suit worn by human actor and tracked onto a virtual avatar. Multiple avatar “snap shots” can be taken to create visual effects and pictures. Images below: Creating a many-arm shakti pose with avatar screen captures created through mocap.
Image above shows examples of photogrammetry scans taken with the Structure Sensor.
Our Enactive Avatar team Victor Pardinho, Lynda Joy Gerry, Eeva R Tikka, Tanja Bastamow, and Maija Paavola planning the volumetric video capture of a screen character with a collaborator in Berlin. The team’s work is supported by the Finnish Cultural Foundation, Huhtamäki Fund, and Virtual Cinema Lab (VCL), School of Film, Television and Scenography, Aalto University, and by Pia Tikka’s EU Mobilitas Top Researcher Grant.
Image: Ilkka Kosunen presenting as the Invited Young Lecturer at the Tohoku Universal Acoustical Communication Month 2018 October 20.
Seminar on music, sound, speech and artificial intelligence
TOKYO ELECTRON House of Creativity 3F, Lecture Theater, Katahira Campus, Tohoku University [Access]
Tekoäly viestin luotettavuuden arvioitsijana
(Seminar in Finnish language)
Keväällä 2017 Helsingin Sanomain Säätiö järjesti suunnatun haun teemana Totuudenjälkeinen aika. Säätiön hallitus myönsi yli puoli miljoonaa euroa kymmenelle hankkeelle. Mitä hankkeille kuuluu nyt? Mitä ilmiöstä on saatu selville? Miten tästä eteenpäin?
Totuudenjälkeinen aika – nyt -seminaariin maanantaina 19.3. klo 16–18 Päivälehden museoon (Ludviginkatu 2–4).
Politiikka ja distruptio. Toimitusjohtaja Taru Tujunen, Ellun Kanat
Poliittiset kuplat ja media. Dosentti, yliopisto-opettaja Arttu Saarinen, Turun yliopisto
Tekoäly viestin luotettavuuden arvioijana. Dosentti, yliopettaja Jyrki Suomala, Laurea-ammattikorkeakoulu*
Miten media selviää polarisaation ja paskapuheen aikana? Dosentti, vanhempi tutkija Antto Vihma, Ulkopoliittinen instituutti
Alustusten jälkeen paneelikeskustelu, jota vetää toimittaja Johanna Vehkoo.
Lisää hankkeista: www.totuudenjälkeinen.fi
Helsingin Sanomain Säätiö on yksityinen, yleishyödyllinen säätiö. Sen tehtävänä on suomalaisen median ja laatujournalismin tulevaisuuden turvaaminen ja sananvapauden tukeminen. Säätiö jakaa apurahoja viestintäalan tutkimukseen ja koulutukseen sekä alan kilpailuihin. Helsingin Sanomain Säätiö ylläpitää Päivälehden museota ja Päivälehden arkistoa.
Janne Kauttonen, FT, researcher, NeuroLab, Laurea-ammattikorkeakoulu
Jenni Hannukainen, FM, researcher, NeuroLab, Laurea-ammattikorkeakoulu
Jyrki Suomala, KT (dosentti), Lecturer, NeuroLab, Laurea-ammattikorkeakoulu
Pia Tikka, TaT (dosentti), EU Mobilitas Pluss research professor, University of Tallinn
Brain Awareness Week 2018
Tallinn University is celebrating Brain Awareness Week (BAW) for the second year in a row! This year we have an open seminar
“Meet the Researchers”
Monday, March 12 from 2PM to 6 PM “Meet the Researchers”, University of Tallinn (Narva mnt. 29), room A-325.
Take part of a seminar where experts from the field take the floor and discuss brain, promote the benefits of brain research and inform the public about what we do as neuroscientist and brain researchers.
- Professor Talis Bachmann – Professor of Cognitive and Legal Psychology (University of Tartu)
- Dr Toomas Toomsoo – Neurologist (East-Tallinn Central Hospital)
- Pia Tikka, PhD – Finnish film director and leading research scientist (Tallinn University)
- Erika Comasco, PhD – Neuropsychopharmacologist (Uppsala University)
At the Politecnico Milano, School of Design, professor Pia Tikka (MEDIT/BFM) and Ilkka Kosunen (MEDIT/DTI – in image on the right) are running their workshop week with a group of 40 students of Communication Design.
The topic is as challenging as thrilling: “Enactive Mind and Media”.
In addition to providing the students at Polimi new insights to Enactive media and biosensor-driven interaction design, the workshop also contributes to the international dissemination strategy of the EU Mobilitas Pluss Top Research project by Dr. Pia Tikka. Ilkka Kosunen’s travel is funded by Erasmus Mobility, TLU. The workshop utilizes (DTI) Digital Technology Institute’s biosensor technology and expertise. During the workshop also contacts with the local hi-tech researchers and industry are created.
A great news is that the bilateral agreement of Erasmus Mobility for Staff Exchange has been established between Tallinn University BFM and Politecnico Milano School of Design starting 2018 January. The agreement was initiated at TLUby Enactive Virtuality Lab.
Ilkka Kosunen with his 6 student teams exhibiting their EEG neurofeedback projects developed during the DTI workshop in fall 2017.
Lighting the neural scene of storytelling – A neurocinematic approach
at the International research-to-practice conference Lighting Design in St Petersburg, h
osted by CLD ITMO University
The main goal of the conference is to connect Science with Business through Art and Innovative technology to develop a competitive market of lighting design and produce new ideas and trends. Over 500 architects, lighting designers, engineers, IT and multimedia specialists, scientists, representatives of Russian government, top-managers, set designers, producers and artists are expected to attend this year’s conference and discuss the main theme “Identity”. The two-day event features four general panel discussions, more than 20 presentations, workshops and lectures given by key Russian and international experts. In addition to the main program, there will also be cultural and social events arranged, as well as open lectures for the city to promote the development of lighting culture and to increase awareness and knowledge amongst the local citizens in the field of science and light.