Emotieherkenning bij autisme middels FACS (Facial Action Coding System)
Geplaatst op 7 juni 2020 door Marjon Kuipers
Onlangs deed ik voor mijn studie Communication, Behaviour and Credibility Analysis aan The Emotional Intelligence Academy | Manchester Metropolian University in Engeland een klein onderzoek naar de toepassingsmogelijkheden van FACS bij emotieherkenning en autisme. In het veld van emotieherkenning, stress en de werking van het brein is FACS een zeer feitelijk instrument. Dit in tegenstelling tot “ik denk, of ik voel” dat ik een bepaalde emotie waarneem. Binnen de Autismeacademie en FEMProfiling zien wij een breed scala aan toepassingen en leiden wij daar ook in op. Onze collega Ingrid de Jong is een van de weinige officiële FACS coders en daarmee hebben wij deze unieke kennis in huis.
Facial Action Coding System (FACS)
The main purpose of this paper is to outline a theoretical framework in which to describe the origin and the history of the Facial Action Coding System (FACS) and how it can be beneficial to people with autism spectrum disorder. In this article a description of the basis of the Facial Action Coding System is given and furthermore the relationship with the basic human emotions is highlighted. Subsequently, the significance of the field of emotion recognition in people with autism spectrum disorder will be addressed. The opposing scientists and the ones who advocate Facial Action Coding System are also being acknowledged by means of comparing different theories. Finally, a recommendation is made for additional research into emotion recognition and to develop a method for emotion recognition that would benefit people with autism spectrum disorder.
Elaborating on the work of Charles Darwin (Darwin, 1872), Paul Ekman conducted research on emotions worldwide in 1955. Ekman linked universal facial expressions to the basic emotions (Ekman, 1975; Ekman, 2004). Darwin’s The Expression of the Emotions in Man and Animals continues to form the basis for research into facial expressions and the emotional lives of humans and animals (Darwin & Lakmaker, 2009). Darwin stated that facial expressions for specific emotions are both universally and biologically determined. Darwin was the first to state that the facial expressions not only display emotions but also serve to protect the individual. According to Darwin, emotions are directly related to survival; an emotion can arise quickly and then only last for a few seconds. Three laws apply for the survival of any species, including humans; Will it eat me? Can I eat it? Can I use it for reproduction? Ekman found that regardless of language or culture, facial expressions of emotions remain constant (Ekman & Friesen, 1986; Ekman et al., 1969). According to Ekman, facial expressions are not taught but rather generated by the neurobiological systems, where there is a hereditary transfer of what was essential for survival in the past (Capel, 2018). Ekman proved that all emotions always appear in facial expressions to a greater or lesser extent (Ekman et al., 1987).
The Facial Action Coding System (FACS)
Ekman and Friesen, elaborating on the work of Swedish researcher Hjortsjö (1969), described 43 facial muscles that together form a large number of facial expressions. Ekman and colleagues identified as many as 10,000 combinations of facial expressions, with about 3,000 combinations associated with an emotion. Ekman and Friesen labelled the combinations of cooperating facial muscles Action Units and developed a coding system. They called it the Facial Action Coding System (FACS; Ekman, 2003b, 2003a; Ekman and Rosenberg, 2005; Ekman & Friesen, 1986). The Action Units represent expressions based on the seven universal emotions: anger, disgust, fear, sadness, surprise, contempt and joy (Ekman, 1992; Ekman, 2004). According to Ekman and colleagues, emotions are unconsciously; therefore, FACS is a reliable instrument for coding and analysis individual facial muscle movements and facial expressions. Ekman and Friesen found that macro and micro expressions, as well as their intensity levels, are visible in the face. The intensity level is coded using the letters A, B, C, D and E, where A denotes the lowest intensity and E denotes the highest intensity. It is also possible to analyse when an emotion starts (onset), when it is at its strongest (apex) and when it weakens again (offset). The letters L (left) and R (right) are used to indicate the side of the face that a one-sided expression is observed on (Ekman & Friesen, 1986; Ekman et al., 2002; Jia et al., 2018).
Analysis of the FACS system
The face is a valuable source of information. The face can give observable information about gender, race and age. Research shows that the face provides even more reliable information than speech (Posamentier & Abdi, 2003; Matsumoto et al., 2008; Freitas-Magalhães, 2013). Facial expressions play a vital role in communication between people, especially regarding emotional states (Darwin, 1872; Kohler et al., 2004). Researchers have shown that facial expressions are important for human survival and reproduction. This demonstrates that facial expressions are innate and, thus, have a biological origin (Öhman & Dimberg; 1984; Fridlund, 2014). Unlike the muscles of the body, which are attached to bones and joints, the facial muscles are attached to skin and move facial skin tissue by tightening or relaxing. These movements are largely automatic and related to the experience of emotions (Fridlund, 2014). Ekman and colleagues also found that many facial expressions are not culture-, gender- or age-dependent (Ekman & Friesen, 1986; Ekman, 1975, 1992, 2004; Ekman & Rosenberg, 1998). FACS is based on the assumptions that emotions and the associated muscle contractions are universal and can be perceived by the senses. Therefore, the coding system can be regarded as a reliable instrument. Later research showed that people can also exercise control over their facial muscles to simulate expressions of emotions that they do not feel (DePaulo, 1992; Ekman, 1992). The researchers Tassinary and Cacioppo (1992) found that people can also feel emotions without showing facial expressions. However, this outcome was contested by Ekman (1992, 2003), who argued that the signal value of emotions is vital for survival from an evolutionary point of view. Ekman then argued that emotional expressions are the result of spontaneous muscle contractions driven by unconscious brain responses to emotional stimuli (Ekman, 2002, 2006). Although there are people who can exercise control over their facial muscles, according to Ekman most people are unable to do this with all of the muscles needed to show the combinations associated with the various emotions simultaneously (Ekman, 1993, 2002, 2006). An example of this is the difference between a Duchenne and non-Duchenne smile (Mattson, 2013). A Duchenne smile puts stress on the cartilage muscle (zygomaticus major; Praba & Venkatramaniah, 2015) and the orbicular muscle of the eye (orbicularis oculi muscle; Moerer et al., 2005). The cartilage muscle can be contracted voluntarily, but the eye circuit muscle cannot (Ekman et al., 1980; Ekman & Friesen, 1982; Ekman, 1993, 2003b; Fox & Davidson, 1987).
Further research shows that forced facial expressions are more often asymmetrical and last longer than real, spontaneous expressions (Ekman et al., 2002; Skinner & Mullen, 1991). Some studies argue against the universal expression of emotions (Frijda, 1953, 2005, 2017). Frijda states that the face shows a ‘state of action readiness’ in interaction. Frijda assumes a particular affinity with specific emotions in a certain context (Frijda & Tcherkassof, 1997; Frijda & Sundararajan, 2007; Ridderinkhof, 2017). Russel (1997) is sceptical of the theory of Ekman. In his bi-dimensional model, Russel shows that people refer to each other’s faces based on the dimensions of arousal and valence, instead of emotions (Russell, 1997; Russell et al., 2013). The Dutch professor Agneta Fischer states that the relationship between the Action Units and emotions is weak. She also disputes Fridlund’s idea that emotions have a social function. Research by Fischer and colleagues shows that emotions are inextricably linked to specific contexts (Fischer et al., 1999; Fischer & Roseman, 2007; Hess & Philippot, 2007). As an example, Fischer cites that the winners of Olympic medals had facial expressions that Ekman categorises as anger or fear, even though the athletes indicated that they were cheering and experiencing joy and did not recognise any other emotion in themselves at the time. Furthermore, Fischer states that emotion recognition and interpretation are a combination of factors that determine what is visible in the face, whereby the rest of the body also provides essential information to come to an excellent analysis (Philippot et al., 1999; Hess et al., 1998).
Emotion recognition and the brain
In addition to the muscle contractions, which occur in specific combinations and certain emotions, neurological research has shown unmistakable brain activity in the amygdala when someone produces facial expressions. The amygdala shows activity for expressions generated by emotions but not for forced expressions. As a result, not only can emotional expressions be recognised perceptually but they are also measurable (Ekman, 2000, 2003a; Kahn, 1966; Dolan & Vuilleumier, 2006; Tassinary & Cacioppo, 1992; Etkin et al., 2006). The amygdala is the part of the brain where the emotions are generated. The amygdala is situated in the area referred to as the emotional sentinel. In case of danger, the limbic system of the brain directs survival behaviours through emotions that make us act by fighting, fleeing or freezing (Dispenza, 2014, 2019; Kolk, van der, 2016; Levine & Majoor, 2015; Ogden & Fisher, 2015).
Emotion recognition and autism
Autism is a developmental disorder that affects social functioning, behaviour and cognition (Delfos, 2003; Frith & Mira, 1992; Vermeulen, 1999). People with autism perceive the world differently, compared to people without autism, and teach themselves various coping strategies (Horwitz, 2004; Kern et al., 2007; Vermeulen, 1999). People with autism tend to perceive information sharply and factually (Bogdashina, 2006; Vermeulen, 2009).People with autism experience difficulties in recognising emotions in themselves and others. These difficulties affect social interactions in relationship and work contexts (Harms et al., 2010; Frith, 2009; Golan et al., 2006). Because of the abilities of people with autism to perceive sharply and factually, they can sense a diversity of facial expressions in their conversation partners. Not knowing how to respond to this visual information often results in clumsy and inappropriate behaviour (Buitelaar et al., 1999; Vermeulen, 2009; Bogdashina, 2004). In socio-emotional development programs, children and adults with autism learn about emotions through trainings and role-playing. These training courses often take place in clinical settings; as a result, participants do not acquire sufficient skills to apply what they have learned outside of these training contexts (Boeve Sleeuwen, 2008; Dekker et al., 2014). Underneath the generation of emotions and the associated expressions lies a biological basis, which can be encoded using the FACS system. The FACS system, therefore, offers opportunities for people with autism to recognise emotions based on accurate perceptions and to apply them independently of a particular context.
The actual perception of expressions using observable emotions, which can be displayed in Action Units, offers people with autism a method of emotion recognition. The FACS system offers opportunities for people with autism to recognise emotions based on actual perception and to apply them independently of context. The pure perception of facial expressions, the link to one or more of the seven universal emotions and the clarity of intensity gives people with autism insights into the process of emotion recognition in themselves and others. The idea is that an emotion recognition methodology, with explanations of the functions of emotions and a suitable set of questions, will at least enable more understanding and better social relationships for people with autism with regular to high levels of intelligence. A challenge here is the limited number (approximately 500) of FACS practitioners worldwide who can potentially transfer this knowledge. Another challenge is that emotion recognition and interpretation using FACS has little or no prominence in the field of mental health. Further research regarding emotion recognition through accurate perceptions, the applications of the Facial Action Coding System and the benefits of this system for people with autism are recommended.
Bogdashina, O. (2004). Waarneming en zintuiglijke ervaringen bij mensen met autisme en aspergersyndroom. Verschillende ervaringen, verschillende werelden (Fontys-OSO-reeks, nr. 11). Antwerpen, België: Garant.
Bogdashina, O. (2006). Communicatiekwesties bij autisme en syndroom van asperger (1ste editie). Antwerpen, België: Garant
Buitelaar, J. K., Van der Wees, M., Swaab, H., & Van der Gaag , R. (1999). Theory of mind and emotion-recognitionfunctioning in autistic spectrum disorders and in psychiatric control and normal children. Development and Psychopathology, 11(1), 39–58. https://doi.org/10.1017/s0954579499001947
Capel, P. (2018). Het Emotionele DNA (10de editie). Bussum , The Netherlands: K.Pl Education.
Darwin, C. (1872). The Expression of the Emotions in Man and Animals. London, UK: John Murray.
Darwin, C., & Lakmaker, F. (2009). Het uitdrukken van emoties bij mens en dier. Amsterdam, Nederland: Nieuwezijds.
Darwin, C. R. (2000). Over het ontstaan van soorten / druk 1. Amsterdam, Nederland: Nieuwezijds.
Dekker, V., Nauta, M. H., Mulder, E. J., Timmerman, M. E., & de Bildt, A. (2014). A randomised controlled study of a social skills training for preadolescent children with autism spectrum disorders: generalization of skills by training parents and teachers? BMC Psychiatry, 14(1), 189–210. https://doi.org/10.1186/1471-244x-14-189
Delfos, M. F. (2003). Een Vreemde Wereld (1ste editie). Amsterdam, Nederland: SWP.
DePaulo, B. M. (1992). Nonverbal behavior and self-presentation. Psychological Bulletin, 111(2), 203–243. https://doi.org/10.1037/0033-2909.111.2.203
Dimberg, U., & Öhman, A. (1996). Behold the wrath: Psychophysiological responses to facial stimuli. Motivation and Emotion, 20(2), 149–182. https://doi.org/10.1007/bf02253869
Dispenza, D. (2014). You Are the Placebo. New York, Verenigde Staten: Penguin Random House.
Dispenza, J. (2019). Becoming Supernatural: How Common People Are Doing the Uncommon (2de editie). Carlsbad, US: Hay House Inc.
Dolan, R. J., & Vuilleumier, P. (2006). Amygdala Automaticity in Emotional Processing. Annals of the New York Academy of Sciences, 985(1), 348–355. https://doi.org/10.1111/j.1749-6632.2003.tb07093.x
Ekman , P., & Friesen, W. (1986). Universals-And-Cultural-Differences-In-The-Judgment-Of-Facia. Geraadpleegd van https://www.paulekman.com/wp-content/uploads/2013/07/Universals-And-Cultural-Differences-In-The-Judgment-Of-Facia.pdf
Ekman, P. (1975). Unmasking the Face: A Guide to Recognizing Emotions from Facial Clues. (A Spectrum book) (4th Printing druk). Upper Sadle River New Jersey, US: Prentice Hall Direct.
Ekman, P. (1992). An argument for basic emotions. Cognition and Emotion, 6(3–4), 169–200. https://doi.org/10.1080/02699939208411068
Ekman, P. (2003). Gegrepen Door Emoties (1ste editie). Amsterdam, Nederland: Nieuwezijds.
Ekman, P. (2004). Emotions Revealed (New ed). Zaltbommel, Nederland: Van Harem Publishing.
Ekman, P. (2006). Darwin, Deception, and Facial Expression. Annals of the New York Academy of Sciences, 1000(1), 205–221. https://doi.org/10.1196/annals.1280.010
Ekman, P., Ekman, O., Davidson, W., & Davidson, R. (1994). The Nature of Emotion. Oxford, Verenigd Koninkrijk: Oxford University Press.
Ekman, P., & Friesen, W. V. (1975). Unmasking the Face. Upper Saddle River, NJ, Verenigde Staten: Prentice Hall.
Ekman, P., Friesen, W. V., & Hager, J. C. (2002). The Manual of Facial Action Coding System . Salt Lake City, US: Research Nexus division of Network Information Research Corporation.
Ekman, P., Friesen, W. V., O’Sullivan, M., Chan, A., Diacoyanni-Tarlatzis, I., Heider, K., … Tzavaras, A. (1987). Universals and cultural differences in the judgments of facial expressions of emotion. Journal of Personality and Social Psychology, 53(4), 712–717. https://doi.org/10.1037/0022-35126.96.36.1992
Ekman, P., Roper, G., & Hager , K. C. (1980). Deliberate facial movement. Child Development, 51, 886-891. Child Development, 51, 886–891. Geraadpleegd van https://www.paulekman.com/wp-content/uploads/2013/07/Deliberate-Facial-Movement.pdf
Ekman, P., & Rosenberg, E. L. (1998). What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS) (Series in Affective Science) (1ste editie). Oxford, UK: Oxford University Press.
Ekman, P., Sorenson, E. R., & Friesen, W. V. (1969). Pan-Cultural Elements in Facial Displays of Emotion. Science, 164(3875), 86–88. https://doi.org/10.1126/science.164.3875.86
Etkin, A., Egner, T., Peraza, D. M., Kandel, E. R., & Hirsch, J. (2006). Resolving Emotional Conflict: A Role for the Rostral Anterior Cingulate Cortex in Modulating Activity in the Amygdala. Neuron, 51(6), 871–882. https://doi.org/10.1016/j.neuron.2006.07.029
Fischer, A. H., & Roseman, I. J. (2007). Beat them or ban them: The characteristics and social functions of anger and contempt. Journal of Personality and Social Psychology, 93(1), 103–115. https://doi.org/10.1037/0022-35188.8.131.52
Fischer, A., Manstead, A., & Jacobs, C. (1999). Social Motives, Emotional Feelings, and Smiling. Cognition & Emotion, 13(4), 321–345. https://doi.org/10.1080/026999399379212
Fox, N. A., & Davidson, R. J. (1987). Electroencephalogram asymmetry in response to the approach of a stranger and maternal separation in 10-month-old infants. Developmental Psychology, 23(2), 233–240. https://doi.org/10.1037/0012-16184.108.40.206
Freitas-Magalhães, A. (2013). Facial Expression of Emotion: From Theory to Application. Lissabon, Portugal: Escrytosed. Autor.
Fridlund, A. J. (2014). Human Facial Expression (1ste editie). Amsterdam, Nederland: Amsterdam University Press.
Frijda, N. H. (1953). The understanding of facial expression of emotion. Acta Psychologica, 9, 294–362. https://doi.org/10.1016/0001-6918(53)90021-3
Frijda, N. H. (2005). De Emoties (6de editie). Amsterdam, Nederland: Bert Bakker.
Frijda, N. H. (2017). The Laws of Emotion. Abingdon, Verenigd Koninkrijk: Taylor & Francis.
Frijda, N. H., & Sundararajan, L. (2007). Emotion Refinement: A Theory Inspired by Chinese Poetics. Perspectives on Psychological Science, 2(3), 227–241. https://doi.org/10.1111/j.1745-6916.2007.00042.x
Frijda, N. H., & Tcherkassof, A. (1997). Facial expressions as modes of action readiness. The Psychology of Facial Expression, 78–102. https://doi.org/10.1017/cbo9780511659911.006
Frith, C. (2009). Role of facial expressions in social interactions. Philosophical Transactions of the Royal Society B: Biological Sciences, 364(1535), 3453–3458. https://doi.org/10.1098/rstb.2009.0142
Frith, U., & Mira, M. (1992). Autism and Asperger Syndrome. Focus on Autistic Behavior, 7(3), 13–15. https://doi.org/10.1177/108835769200700302
Golan, O., Baron-Cohen, S., Hill, J. J., & Rutherford, M. D. (2006). The ‘Reading the Mind in the Voice’ Test-Revised: A Study of Complex Emotion Recognition in Adults with and Without Autism Spectrum Conditions. Journal of Autism and Developmental Disorders, 37(6), 1096–1106. https://doi.org/10.1007/s10803-006-0252-5
Harms, M. B., Martin, A., & Wallace, G. L. (2010). Facial Emotion Recognition in Autism Spectrum Disorders: A Review of Behavioral and Neuroimaging Studies. Neuropsychology Review, 20(3), 290–322. https://doi.org/10.1007/s11065-010-9138-6
Hess, U., & Philippot, P. (2007). Group Dynamics and Emotional Expression. Cambridge, Verenigd Koninkrijk: Cambridge University Press.
Hess, U., Philippot, P., & Blairy, S. (1998). Facial Reactions to Emotional Facial Expressions: Affect or Cognition? Cognition & Emotion, 12(4), 509–531. https://doi.org/10.1080/026999398379547
Hjortsjö, C. H. (1969). Man’s face and mimic language (Vol. 1969). Lund, Sweden: Studentlitteratur.
Horwitz, E. (2004). Autisme spectrum stoornissen bij normaal begaafde volwassenen (3de editie). Assen, Nederland: Koninklijke Van Gorcum.
Jia, X., Ben, X., Yuan, H., Kpalma, K., & Meng, W. (2018). Macro-to-micro transformation model for micro-expression recognition. Journal of Computational Science, 25, 289–297. https://doi.org/10.1016/j.jocs.2017.03.016
Kahn, E. A. (1966). On Facial Expression. Neurosurgery, 12(CN_suppl_1), 9–22. https://doi.org/10.1093/neurosurgery/12.cn_suppl_1.9
Kern, J. K., Trivedi, M. H., Grannemann, B. D., Garver, C. R., & Johnson, D. G. (2007). Sensory correlations in autism. Autism, 11(2), 123–134. https://doi.org/10.1177/1362361307075702
Kohler, C. G., Turner, T. H., Gur, R. E., & Gur, R. C. (2004). Recognition of Facial Emotions in Neuropsychiatric Disorders. CNS Spectrums, 9(4), 267–274. https://doi.org/10.1017/s1092852900009202
Levine, P., & Majoor, H. (2015). De tijger ontwaakt. Haarlem, Nederland: Gottmer.
Liekens, P. (2010). Emoties en angsten. Culemborg, Nederland: Van Duuren Media.
Matsumoto, D., Seung Hee Yoo, A., & Fontaine, J. (2008). Mapping Expressive Differences Around the World. Journal of Cross-Cultural Psychology, 39(1), 55–74. https://doi.org/10.1177/0022022107311854
Mattson, W. (2013). Darwin’s Duchenne: Eye Constriction during Infant Joy and Distress. PLoS ONE, 8(11), 1–100. https://doi.org/10.1371/journal.pone.0080161
McAndrew, F. T. (1986). A Cross-Cultural Study of Recognition Thresholds for Facial Expressions of Emotion. Journal of Cross-Cultural Psychology, 17(2), 211–224. https://doi.org/10.1177/0022002186017002005
Moerer, O., Bittner, J., Hinz, J., & Sydow, M. (2005). Neuromuskuläre Wirkzeiten von Rocuronium am Diaphragma, Musculus adductor pollicis und orbicularis oculi in zwei Altersgruppen. ains · Anästhesiologie · Intensivmedizin · Notfallmedizin · Schmerztherapie, 40(4), 217–224. https://doi.org/10.1055/s-2005-861037
Ogden, P., & Fisher, J. (2015). Sensorimotor Psychotherapy: Interventions for Trauma and Attachment (Norton Series on Interpersonal Neurobiology). New York, US: W. W. Norton.
Philippot, P., Feldman, R. S., Coats, E. J., Manstead, A., & Oatley, K. (1999). The Social Context of Nonverbal Behavior. Cambridge, Verenigd Koninkrijk: Cambridge University Press.
Posamentier, M. T., & Abdi, H. (2003). Processing Faces and Facial Expressions. Neuropsychology Review, 13(3), 113–143. https://doi.org/10.1023/a:1025519712569
Praba, M. A., & Venkatramaniah, C. (2015). STUDY ON THE OCCURRENCE OF DOUBLE OR BIFID ZYGOMATICUS MAJOR: A MUSCLE OF FACIAL EXPRESSION. International Journal of Anatomy and Research, 3(3), 1351–1353. https://doi.org/10.16965/ijar.2015.234
Ridderinkhof, K. R. (2017). Emotion in Action: A Predictive Processing Perspective and Theoretical Synthesis. Emotion Review, 9(4), 319–325. https://doi.org/10.1177/1754073916661765
Russell, J. A. (1994). Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychological Bulletin, 115(1), 102–141. https://doi.org/10.1037/0033-2909.115.1.102
Russell, J. A., Fernández-Dols, J., Manstead, A., Sr, & Wellenkamp, J. C. (2013). Everyday Conceptions of Emotion: An Introduction to the Psychology, Anthropology and Linguistics of Emotion (Nato Science Series D: Book 81) (1995ste editie). Houten , The Netherlands: Springer.
Skinner, Ma., & Mullen, B. (1991). Facial asymmetry in emotional expression: A meta-analysis of research. British Journal of Social Psychology, 30(2), 113–124. https://doi.org/10.1111/j.2044-8309.1991.tb00929.x
Tassinary, L. G., & Cacioppo, J. T. (1992). Unobservable Facial Actions and Emotion. Psychological Science, 3(1), 28–33. https://doi.org/10.1111/j.1467-9280.1992.tb00252.x
van Boeve Sleeuwen, L. (2008). Begeleiding van kinderen en jongeren met autisme – van onderzoek naar praktijk. Kind & Adolescent Praktijk, 7(4), 192–193. https://doi.org/10.1007/bf03076727
van der Kolk, B. (2016). Traumasporen (1ste editie). Amsterdam , The Netherlands: Uitgeverij Mens!
Vermeulen, P. (1999). Buiten reeks – Brein bedriegt (2de editie). Berchem, Belgie: Epo, Uitgeverij.
Vermeulen, P. (2009). Autisme als contextblindheid (1ste editie). Leuven, België: Acco.