Julia Ayache
ABSTRACT
Social interactions are multi-modal, and their translation into virtuous and smooth interactions in digital, hybrid reality spaces constitute a technological challenge with profound but often dismissed ethical considerations (such as harmful consequences). In particular, the increasing reliance on algorithms (i.e., artificial intelligence) to emulate “seamless” communication patterns between human and artificial agents calls for caution in designing such systems. This short paper reviews current trends in rendering hyper-realistic human bodies and motor behaviors, focusing on the ethical issues of manipulating kinematics in human-to-human and human-to-artificial agent interactions.
- Julia Ayache, Kouloud Abichou, Valentina La Corte, Pascale Piolino, and Marco Sperduti. 2022. Mindfulness and false memories: state and dispositional mindfulness does not increase false memories for naturalistic scenes presented in a virtual environment. Psychological Research 86, 2 (2022), 571–584.Google Scholar
Cross Ref
- Julia Ayache, Andy Connor, Stefan Marks, Daria J Kuss, Darren Rhodes, Alexander Sumich, and Nadja Heym. 2021. Exploring the “dark matter” of social interaction: Systematic review of a decade of research in spontaneous interpersonal coordination. Frontiers in Psychology 12 (2021), 718237.Google ScholarCross Ref
- Jeremy N Bailenson and Nick Yee. 2005. Digital chameleons: Automatic assimilation of nonverbal gestures in immersive virtual environments. Psychological science 16, 10 (2005), 814–819.Google ScholarCross Ref
- Domna Banakou, Parasuram D Hanumanthu, and Mel Slater. 2016. Virtual embodiment of white people in a black virtual body leads to a sustained reduction in their implicit racial bias. Frontiers in human neuroscience (2016), 601.Google Scholar
- Roy F Baumeister and Mark R Leary. 2017. The need to belong: Desire for interpersonal attachments as a fundamental human motivation. Interpersonal development (2017), 57–89.Google Scholar
- Cristina Becchio, Luisa Sartori, and Umberto Castiello. 2010. Toward you: The social side of actions. Current Directions in Psychological Science 19, 3 (2010), 183–188.Google ScholarCross Ref
- Emily M Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021. On the dangers of stochastic parrots: Can language models be too big?. In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency. 610–623.Google ScholarDigital Library
- Bruno Berberian, Bertille Somon, Aïsha Sahaï, and Jonas Gouraud. 2017. The out-of-the-loop Brain: A neuroergonomic approach of the human automation interaction. Annual Reviews in Control 44 (2017), 303–315.Google ScholarCross Ref
- Marta MN Bieńkiewicz, Andrii P Smykovskyi, Temitayo Olugbade, Stefan Janaqi, Antonio Camurri, Nadia Bianchi-Berthouze, Mårten Björkman, and Benoît G Bardy. 2021. Bridging the gap between emotion and joint action. Neuroscience & Biobehavioral Reviews 131 (2021), 806–833.Google ScholarCross Ref
- Mark Billinghurst and Andreas Duenser. 2012. Augmented reality in the classroom. Computer 45, 7 (2012), 56–63.Google ScholarDigital Library
- Mark Billinghurst and Hirokazu Kato. 2002. Collaborative augmented reality. Commun. ACM 45, 7 (2002), 64–70.Google ScholarDigital Library
- Jens F Binder. 2023. Establishing conversational engagement and being effective: The role of body movement in mediated communication. Acta Psychologica 233 (2023), 103840.Google ScholarCross Ref
- Abeba Birhane. 2021. Algorithmic injustice: a relational ethics approach. Patterns 2, 2 (2021).Google Scholar
- Rishi Bommasani, Kevin Klyman, Daniel Zhang, and Percy Liang. 2023. Do Foundation Model Providers Comply with the EU AI Act?https://crfm.stanford.edu/2023/06/15/eu-ai-act.htmlGoogle Scholar
- Francesca Capozzi, Andrew P Bayliss, Marco R Elena, and Cristina Becchio. 2015. One is not enough: Group size modulates social gaze-induced object desirability effects. Psychonomic Bulletin & Review 22 (2015), 850–855.Google ScholarCross Ref
- Alexandre Coste, Benoît G Bardy, Stefan Janaqi, Piotr Słowiński, Krasimira Tsaneva-Atanasova, Juliette Lozano Goupil, and Ludovic Marin. 2021. Decoding identity from motion: how motor similarities colour our perception of self and others. Psychological research 85 (2021), 509–519.Google Scholar
- Simon Davis, Keith Nesbitt, and Eugene Nalivaiko. 2014. A systematic review of cybersickness. In Proceedings of the 2014 conference on interactive entertainment. 1–9.Google ScholarDigital Library
- Dian A De Vries and Jochen Peter. 2013. Women on display: The effect of portraying the self online on women’s self-objectification. Computers in Human Behavior 29, 4 (2013), 1483–1489.Google ScholarDigital Library
- Andrew Dilanchian, Michael Prevratil, and Walter R Boot. 2023. Motion as a Determinant of Presence in Immersive Virtual Reality. In International Conference on Human-Computer Interaction. Springer, 169–175.Google ScholarCross Ref
- Harry Farmer. 2023. Reducing dehumanisation through virtual reality: prospects and pitfalls. Current Opinion in Behavioral Sciences 52 (2023), 101283.Google ScholarCross Ref
- Thomas Fuchs. 2021. In defence of the human being: Foundational questions of an embodied anthropology. Oxford University Press.Google Scholar
- Shaun Gallagher. 2000. Philosophical conceptions of the self: implications for cognitive science. Trends in cognitive sciences 4, 1 (2000), 14–21.Google Scholar
- Kurt Gray and Daniel M Wegner. 2012. Feeling robots and human zombies: Mind perception and the uncanny valley. Cognition 125, 1 (2012), 125–130.Google ScholarCross Ref
- Patrick Haggard, Sam Clark, and Jeri Kalogeras. 2002. Voluntary action and conscious awareness. Nature neuroscience 5, 4 (2002), 382–385.Google Scholar
- Jeffrey T Hancock and Jeremy N Bailenson. 2021. The social impact of deepfakes., 149–152 pages.Google Scholar
- Béatrice S Hasler, Gilad Hirschberger, Tal Shani-Sherman, and Doron A Friedman. 2014. Virtual peacemakers: Mimicry increases empathy in simulated contact with virtual outgroup members. Cyberpsychology, Behavior, and Social Networking 17, 12 (2014), 766–771.Google ScholarCross Ref
- Rebecca Hood, Juliana Zabatiero, Stephen R Zubrick, Desiree Silva, and Leon Straker. 2021. The association of mobile touch screen device use with parent-child attachment: A systematic review. Ergonomics 64, 12 (2021), 1606–1622.Google ScholarCross Ref
- Martin Lang, Vladimír Bahna, John H Shaver, Paul Reddish, and Dimitris Xygalatas. 2017. Sync to link: Endorphin-mediated synchrony effects on cooperation. Biological Psychology 127 (2017), 191–197.Google ScholarCross Ref
- Juliette Lozano-Goupil, Stéphane Raffard, Delphine Capdevielle, Emilie Aigoin, and Ludovic Marin. 2022. Gesture-speech synchrony in schizophrenia: A pilot study using a kinematic-acoustic analysis. Neuropsychologia 174 (2022), 108347.Google ScholarCross Ref
- Lara Maister, Mel Slater, Maria V Sanchez-Vives, and Manos Tsakiris. 2015. Changing bodies changes minds: owning another body affects social cognition. Trends in cognitive sciences 19, 1 (2015), 6–12.Google Scholar
- David Manheim. 2023. Building a Culture of Safety for AI: Perspectives and Challenges. Available at SSRN (2023).Google Scholar
- Paul Milgram and Fumio Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems 77, 12 (1994), 1321–1329.Google Scholar
- Masahiro Mori. 1970. The uncanny valley: the original essay by Masahiro Mori. IEEE Spectrum 6 (1970).Google Scholar
- Ghiles Mostafaoui, RC Schmidt, Syed Khursheed Hasnain, Robin Salesse, and Ludovic Marin. 2022. Human unintentional and intentional interpersonal coordination in interaction with a humanoid robot. Plos one 17, 1 (2022), e0261174.Google ScholarCross Ref
- Paul Nemitz. 2018. Constitutional democracy and technology in the age of artificial intelligence. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 376, 2133 (2018), 20180089.Google ScholarCross Ref
- Don Norman. 2014. Things that make us smart: Defending human attributes in the age of the machine. Diversion Books.Google ScholarDigital Library
- Donald A Norman. 2023. Design for a better world: Meaningful, sustainable, humanity centered. MIT Press.Google Scholar
- Mariano Pugliese and Cordula Vesper. 2022. Digital joint action: Avatar-mediated social interaction in digital spaces. Acta Psychologica 230 (2022), 103758.Google ScholarCross Ref
- Kathleen Richardson. 2023. The End of Sex Robots: Porn Robots and Representational Technologies of Women and Girls. In Man-Made Women: The Sexual Politics of Sex Dolls and Sex Robots. Springer, 171–192.Google Scholar
- Theodore Roszak. 1995. The cult of information: a neo-luddite treatise on high-tech, artificial intelligence and the true art of thinking//Review. Canadian Journal of Sociology 20, 4 (1995), 571.Google ScholarCross Ref
- Francesca C Ryding and Daria J Kuss. 2020. The use of social networking sites, body image dissatisfaction, and body dysmorphic disorder: A systematic review of psychological research.Psychology of Popular Media 9, 4 (2020), 412.Google Scholar
- Alessandra Sciutti, Caterina Ansuini, Cristina Becchio, and Giulio Sandini. 2015. Investigating the ability to read others’ intentions using humanoid robots. Frontiers in psychology 6 (2015), 1362.Google Scholar
- Natalie Sebanz, Harold Bekkering, and Günther Knoblich. 2006. Joint action: bodies and minds moving together. Trends in cognitive sciences 10, 2 (2006), 70–76.Google Scholar
- Leslie Regan Shade. 2003. Weborexics: The ethical issues surrounding pro-ana websites. Acm Sigcas Computers and Society 33, 4 (2003), 2.Google ScholarDigital Library
- Pawankumar Sharma and Bibhu Dash. 2022. The digital carbon footprint: Threat to an environmentally sustainable future. International Journal of Computer Science & Information Technology (IJCSIT) Vol 14 (2022).Google ScholarCross Ref
- Adalberto L Simeone, Ifigeneia Mavridou, and Wendy Powell. 2017. Altering user movement behaviour in virtual environments. IEEE transactions on visualization and computer graphics 23, 4 (2017), 1312–1321.Google ScholarDigital Library
- Mel Slater. 2009. Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical Transactions of the Royal Society B: Biological Sciences 364, 1535 (2009), 3549–3557.Google ScholarCross Ref
- Mel Slater, Cristina Gonzalez-Liencres, Patrick Haggard, Charlotte Vinkers, Rebecca Gregory-Clarke, Steve Jelley, Zillah Watson, Graham Breen, Raz Schwarz, William Steptoe, 2020. The ethics of realism in virtual and augmented reality. Frontiers in Virtual Reality 1 (2020), 1.Google ScholarCross Ref
- James P Trujillo, Irina Simanova, Harold Bekkering, and Asli Özyürek. 2020. The communicative advantage: How kinematic signaling supports semantic comprehension. Psychological research 84 (2020), 1897–1911.Google Scholar
- Sherry Turkle. 1996. Virtuality and its discontents searching for community in cyberspace. The wired homestead: An MIT press sourcebook on the internet and the family (1996), 385–402.Google Scholar
- Robrecht PRD van der Wel, Cristina Becchio, Arianna Curioni, and Thomas Wolf. 2021. Understanding joint action: Current theoretical and empirical approaches., 103285 pages.Google Scholar
- Ishabel M Vicaria and Leah Dickens. 2016. Meta-analyses of the intra-and interpersonal outcomes of interpersonal coordination. Journal of Nonverbal Behavior 40 (2016), 335–361.Google ScholarCross Ref
- Nick Yee and Jeremy Bailenson. 2007. The Proteus effect: The effect of transformed self-representation on behavior. Human communication research 33, 3 (2007), 271–290.Google Scholar
- Shoshana Zuboff. 2019. The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power. Profile Books.Google Scholar
Index Terms
- eXtended Reality of socio-motor interactions: Current Trends and Ethical Considerations for Mixed Reality Environments Design
Recommendations
The ethical and privacy implications of mixed reality
SIGGRAPH '19: ACM SIGGRAPH 2019 PanelsThe spatial computing affordances of virtual and augmented reality introduce new ethical and privacy dilemmas. This panel will explore the many implications of biometric data (eye tracking, facial tracking, gait detection, emotional sentiment analysis, ...
Ethical responsibilities: the smart card engineer
ETHICS '14: Proceedings of the IEEE 2014 International Symposium on Ethics in Engineering, Science, and TechnologyAlbert Einstein in one of his philosophical notes stated: "I do not believe in immortality of the individual, and I consider ethics to be an exclusively human concern with no superhuman authority behind it". Arguably, ethics does not necessarily mean ...
GeomEthics: Ethical Considerations About Using Artificial Intelligence in Geomatics
Image Analysis and Processing - ICIAP 2023 WorkshopsAbstractArtificial intelligence (AI) has made significant advancements in the field of geomatics, revolutionizing the way geospatial data is processed, analyzed, and interpreted. While these advancements have brought numerous benefits, they also raise ...
Comments