Affective Mimetics, Emotional Information Space, and Metaverse

Document Type : Original Article

Authors

Faculty of Information Technology, University of Jyväskylä, Finland.

Abstract

Current technology design pursues applying human-like features to AI technologies. These attempts have faced many challenges due to the essential complexities of the human mind. Cognitive mimetics is a design approach to mimic human information processes in designing intelligent technologies. The focus is on mimicking cognition, human knowledge structures, and represented mental information contents which addresses a fundamental issue in technology design. However, cognition is one aspect of information processing in the human mind. Affective information processing also plays an essential role in addressing the meaningfulness of cognitive processes. This paper discusses affective mimetics (extended from cognitive mimetics with conceptual engineering) as a design approach to designing intelligent and human-like entities for AI technologies. Natural framework sources for affective mimetics are emotional information spaces referring to emotionally meaningful objects around a person. The potential of affective mimetics and emotional information spaces in directing the design of metaverse is utilised as an illustrative example.

Keywords


Arstechnica. (2021). Retrieved in 3 November 2021. https://arstechnica.com/gaming/2021/11/everyone-pitching-the-metaverse-has-a-different-idea-of-what-it-is/
Bar-Cohen, Y. (2006). Biomimetics - Using nature to inspire human innovation. Bioinspiration and Biomimetics. 1(1), p. 1. https://doi.org/10.1088/1748-3182/1/1/P01
Bartl, M., & Füller, J. (2020). The rise of emotion AI: Decoding flow experiences in sports. In 21st Century Sports. Springer, Cham. p. 219-229.
Breakwell, G. M., Hammond, S., & Fife-Shaw, C. (1995). Research methods in psychology. Sage Publication. London.
Chakriswaran, P., Vincent, D. R., Srinivasan, K., Sharma, V., Chang, C. Y., & Reina, D. G. (2019). Emotion AI-driven sentiment analysis: A survey, future research directions, and open issues. Applied Sciences. 9(24), p. 54–62.
Chalmers, D. J. (2020). What is conceptual engineering and what should it be? Inquiry. p. 1–18.
Coyne, R. (2016). Mood and mobility: Navigating the emotional spaces of digital social networks. MIT Press.
Cry, D. (2013). Website design, trust and culture: An eight country investigation. Electronic Commerce Research and Applications. 12(6), p. 373-385. https://doi.org/10.1016/j.elerap.2013.03.007
Denzin, N. K., & Lincoln, Y. S. (2011). The Sage handbook of qualitative research. Sage Publication. London.
Dindar, M., Jarvela, S., Ahola, S., Huang, X., & Zhao, G. (2020). Leaders and followers identified by emotional mimicry during collaborative learning: A facial expression recognition study on emotional valence. IEEE Transactions on Affective Computing. https://doi.org/10.1109/TAFFC.2020.3003243
Duan, H., Li, J., Fan, S., Lin, Z., Wu, X., & Cai, W. (2021). Metaverse for social good: A university campus prototype. Proceedings of the 29th ACM International Conference on Multimedia. ACM Press. New York. p. 153–161. https://doi.org/10.1145/3474085.3479238
Dym, C. L., & Brown, D. C. (2012). Engineering design: Representation and reasoning. Cambridge University Press.
Dörrenbächer, J., Löffler, D., & Hassenzahl, M. (2020). Becoming a robot-overcoming anthropomorphism with techno-mimesis. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. p. 1-12. https://doi.org/10.1145/3313831.3376507
Eklund, M. (2015). Intuitions, conceptual engineering, and conceptual fixed points. In The Palgrave handbook of philosophical methods. Palgrave Macmillan. p. 363–385.
Eklund, M. (2021). Conceptual Engineering in Philosophy. In The Routledge Handbook of Social and Political Philosophy of Language. Routledge. p. 15–30.
Ekman, P. (1999). Basic emotions. In Dalgleish, T., & Power, M. (Eds.), Handbook of cognition and emotion. John Wiley & Sons. p. 45–60.
Ericsson, K., & Simon, H. (1984). Protocol analysis. MIT Press. Cambridge.
Eysenck, M. W., & Keane, M. T. (2015). Cognitive psychology: A student’handbook. Psychology Press.
Floridi, L. (2020). AI and its new winter: From myths to realities. Philosophy & Technology. 33(1), p.1-3.
Fokkinga, S., & Desmet, P. (2013). Ten ways to design for disgust, sadness, and other enjoyments: A design approach to enrich product experiences with negative emotions. International Journal of Design. 7(1).
Frijda, N. H. (1986). The emotions. Cambridge University Press.
Frijda, N. H., Kuipers, P., & Ter Schure, E. (1989). Relations among emotion, appraisal, and emotional action readiness. Journal of personality and social psychology. 57(2), p. 212.
Gebrian, M., Florián, M., & Eloy, S. (2021). Designing the bodily Metaverse of Lisbon. In Virtual Aesthetics in Architecture. Routledge. p. 133–141.
Grahn, H., Kujala, T., Silvennoinen, J., Leppänen, A., Saariluoma, P. (2020). Expert drivers’ prospective thinking-aloud to enhance automated driving technologies–Investigating uncertainty and anticipation in traffic. Accident Analysis & Prevention. 146, 105717. https://doi.org/10.1016/j.aap.2020.105717
Heylighen, A., & Dong, A. (2019). To empathise or not to empathise? Empathy and its limits in design. Design Studies. 65, p. 107–124. https://doi.org/10.1016/j.destud.2019.10.007
Holmquist, L. E. (2017). Intelligence on tap: Artificial intelligence as a new design material. Interactions. 24(4), p. 28–33.
Höök, K. (2012). Affective computing. The Encyclopedia of Human-Computer Interaction, 2nd Ed. The Interaction Design Foundation. http://www.interactiondesign.org/encyclopedia/affective_computing.html
Jokinen, J., & Silvennoinen, J. (2020). The appraisal theory of emotion in human–computer interaction. In Rousi, R., Leikas, J., & Saariluoma, P. (Eds.), Emotions in Technology Design: From Experience to Ethics, Human-Computer Interaction Series. Springer International Publishing. p. 27–39. https://doi.org/10.1007/978-3-030-53483-7_3
Jumisko-Pyykkö, S., Viita-aho, T., Tiilikainen, E., Saarinen, E. (2021). Towards systems intelligent approach in empathic design. Proceedings of Academic Mindtrek 2021. ACM Press. p. 197–209. https://doi.org/10.1145/3464327.3464370
Kahneman, D. (2011). Thinking, fast and slow. Macmillan.
Kerruish, E. (2021). Assembling human empathy towards care robots: The human labor of robot sociality. Emotion, Space and Society. 41, 100840. https://doi.org/10.1016/j.emospa.2021.100840
Kret, M. E., & Bocanegra, B. R. (2016). Adaptive hot cognition: How emotion drives information processing and cognition steers affective processing. Frontiers in psychology. 7, 1920. https://doi.org/10.3389/fpsyg.2016.01920
Kujala, T., & Saariluoma, P. (2018). Cognitive mimetics for designing intelligent technologies. Advances in Human-Computer Interaction. https://doi.org/10.1155/2018/9215863
Lazarus, R. S., & Lazarus, B. N. (1994). Passion and reason: Making sense of our emotions. Oxford University Press.
Madni, A. M., & Sievers, M. (2018). Model‐based systems engineering: Motivation, current status, and research opportunities. Systems Engineering. 21(3), p. 172–190. https://doi.org/10.1002/sys.21438
Marechal, C., Mikolajewski, D., Tyburek, K., Prokopowicz, P., Bougueroua, L., Ancourt, C., & Wegrzyn-Wolska, K. (2019). Survey on AI-based multimodal methods for emotion detection. In Kołodziej J., & González-Vélez, H. (Eds), High-Performance Modelling and Simulation for Big Data Applications. Lecture Notes in Computer Science. Springer. 11400. https://doi.org/10.1007/978-3-030-16272-6_11
Affective Mimetics, Emotional Information Space, and Metaverse JDT, Vol. 2, No. 2, December 2021 11
Mattelmäki, T., Vaajakallio, K., & Koskinen, I. (2014). What happened to empathic design? Design Issues. 30(1), p. 67–77. https://doi.org/10.1162/DESI_a_00249
Myllylä, M. T., & Saariluoma, P. (2022). Expertise and becoming conscious of something. New Ideas in Psychology. 64, 100916. https://doi.org/10.1016/j.newideapsych.2021.100916
Newell, A., & Simon, H. A. (1972). Human problem solving. Englewood Cliffs. Prentice-Hall.
Norman, D. A. (2004). Emotional design: Why we love (or hate) everyday things. Basic Books.
Paschen, J., Kietzmann, J., & Kietzmann, T. C. (2019). Artificial intelligence (AI) and its implications for market knowledge in B2B marketing. Journal of Business & Industrial Marketing. 34(7).
Picard, R. (1997). Affective computing. MIT Press.
Posner, M. I. (1980). Orienting of attention. Quarterly Journal of Experimental Psychology. 32(1), p. 3–25. https://doi.org/10.1080/00335558008248231
Power, M. J., & Dalgleish, T. (1997). Cognition and emotion: From order to disorder. Hove, Psychology Press.
Saariluoma, P. (1995). Chess players’ thinking. Routledge. London.
Saariluoma, P. (1997). Foundational analysis. Presuppositions in Experimental Psychology. Routledge. London.
Saariluoma, P. (2020). Hume’s guillotine resolved. In Proceedings of the Culture and Computing, Held as Part of the 22nd International Conference on Human-Computer Interaction. Springer. p. 123–132. https://doi.org/10.1007/978-3-030-50267-6_10
Saariluoma, P. Cañas, J., & Karvonen, A. (2020). Human digital twins and cognitive mimetic. In Proceedings of the 3rd International Conference on Human Interaction and Emerging Technologies: Future Applications: Advances in Intelligent Systems and Computing. Springer. 1253. https://doi.org/10.1007/978-3-030-55307-4_15
Saariluoma, P., Cañas, J. J., & Leikas, J. (2016). Designing for life: A human perspective on technology development. Springer.
Saariluoma, P., Kujala, T., Karvonen, A., & Ahonen, M. (2018). Cognitive mimetics: Main ideas. In Proceedings of the 2018 International Conference on Artificial Intelligence. CSREA Press. p. 202–206.
Saariluoma, P., Karvonen, A., & Kujala, T. (2021). Conceptual basis of cognitive mimetics for information engineering. Journal of Physics: Conference Series. IOP Publishing. 1828, 1, p. 012004. https://doi.org/10.1088/1742-6596/1828/1/012004
Saariluoma, P., Karvonen, A., Wahlstrom, M., Happonen, K., Puustinen, R., & Kujala, T. (2019). Challenge of tacit knowledge in acquiring information in cognitive mimetics. In Proceedings of International Conference on Intelligent Human Systems Integration. Springer. p. 228–233. https://doi.org/10.1007/978-3-030-11051-2_35
Saariluoma, P., & Rousi, R. (2020). Emotions and technoethics. In Rousi, R., Leikas, J., & Saariluoma, P. (Eds.), Emotions in Technology Design: From Experience to Ethics, Human-Computer Interaction Series. Springer International Publishing. p. 167–189.
Sander, D. E., & Scherer, K. R. (2009). The oxford companion to emotion and the affective sciences. Oxford University Press.
Scherer, K. R. (2009). The dynamic architecture of emotion: Evidence for the component process model. Cognition and emotion. 23(7), p. 1307-1351. https://doi.org/10.1080/02699930902928969
Affective Mimetics, Emotional Information Space, and Metaverse JDT, Vol. 2, No. 2, December 2021 12
Seidel, S., Yepes, G, Berente, N, & Nickerson, J. V. (2022). Designing the Metaverse. In Proceedings of the 55th Hawaii International Conference on System Sciences.
Seok, J. M., Kim, D. J., Lim, Y. K., Nam, T. J., Lee, M. H., Lee, Y., Row, Y-K., Sohn, B., Zimmerman, J., Forlizzi, J., Odom, W., López Higuera, A., Marchitto, M., Cañas, J., & Moore, H. A. (2013). Understanding the curation activities of creating personal and social meanings for virtual possessions. In 5th International Congress of International Association of Societies of Design Research. IASDR.
Silvennoinen, J., & Saariluoma, P. (2022). Emotional information space in designing future AI technologies. In Proceedings of the 5th International Conference on Intelligent Human Systems Integration (IHSI 2022): Integrating People and Intelligent Systems, AHFE International, Technology & Engineering. 22, p. 1410. https://doi.org/10.54941/ahfe1001057
Simon, H. A. (1967). Motivational and emotional controls of cognition. Psychological Review. 74(1), p. 29–39. https://doi.org/10.1037/h0024127
Simon, H. A. (1969). The sciences of the artificial. Cambridge, MA.
Simon, H. A. (1987). Making management decisions: The role of intuition and emotion. Academy of Management Perspectives. 1(1), p. 57–64. https://doi.org/10.5465/ame.1987.4275905
Smith, C. A., & Kirby, L. D. (2001). Toward delivering on the promise of appraisal theory. In Scherer, K. R., Schorr, A., & Johnstone, T. (Eds.), Appraisal Processes in Emotion: Theory, Methods, Research. Oxford University Press. p. 121–138.
Tegmark, M. (2017). Life 3.0: Being human in the age of artificial intelligence. Vintage.
Turing, A. M. (1936). On computable numbers, with an application to the entscheidungsproblem. In Proceedings of the London Mathematical Society. 42, p. 230–65.
Turing, A. M. (1950). Computing machinery and intelligence. Mind. 59, p. 433–460.
Vincent, J. F., Bogatyreva, O. A., Bogatyrev, N. R., Bowyer, A., & Pahl, A. K. (2006). Biomimetics: Its practice and theory. Journal of the Royal Society Interface. 3(9), p. 471–482. https://doi-org.ezproxy.jyu.fi/10.1098/rsif.2006.0127
Wang, Q., Li, R., Wang, Q., & Chen, S. (2021). Non-fungible token (NFT): Overview, evaluation, opportunities and challenges. arXiv preprint arXiv:2105.07447.