Facial Expressions Addendum

So there I was, preparing last Friday’s blog post, Horse Facial Expressions. When I saw that the Equine Facial Action Coding System was based on the Facial Action Coding System (FACS) for human expressions, developed and modified by Paul Ekman and colleagues, it hit me: I had seen that name before. 

Examples of Action Units (AU) from the Facial Action Coding System for human expressions. (what-when-how.com/face-recognition/facial-expression-recognition-face-recognition-techniques-part-1/)

Well over a year ago, I came across two studies that almost had me blogging about facial expressions. As I got into the studies, I found both referring to Ekman’s FACS. Digging further, I discovered that Ekman was the inspiration and scientific consultant for Lie to Me, a television show my wife and I were streaming and actually liked. (There aren’t many of those.)

Here’s where human facial expressions get way more interesting than equine facial expressions. Ekman and colleagues had taken the next step. They went beyond developing the FACS catalog of facial expressions to interpreting the emotions behind the expressions. 

Examples of emotions interpreted from facial expressions--
Tim Roth, lead actor in the TV show Lie to Me. (Multiple websites)

If that weren’t enough, they also showed that very brief, fraction-of-a-second displays of the facial expressions can be spotted. These micro-expressions offer singular insight because they usually occur when a person is deliberately or unconsciously concealing a feeling--they might be lying.

Paul Ekman and Lie to Me

If you’re not aware, Ekman is an emeritus professor in psychology at the University of California-San Francisco who is recognized as a pioneer in linking facial expressions and other nonverbal behavior to emotions. The American Psychological Association named him one of the most influential psychologists of the 20th century, and in 2009, he was one of TIME Magazine’s 100 most influential people.

After retiring from UCSF in 2004, he formed the Paul Ekman Group, which offers tools and training to “read” and respond to human facial expressions and micro-expressions--or, quoting from the company’s mission statement, to build competency in evaluating truthfulness, improving emotional life and compassionate connection.

Micro-expressions training video (7:47 min video from 2012: www.youtube.com/watch?v=e2EAD-b7zIM)

Lie to Me, which aired 2009-2011, featured a deception-detection expert and team based loosely on Ekman and the Paul Ekman Group. It’s all about helping individuals, corporations and government agencies get to the truth by way of facial expressions, speech and involuntary body language. I didn’t know it when we were streaming the show, but Ekman has critiqued each episode on his website, separating fact from entertainment fiction.

Research Studies

If you’re curious about the two studies I almost blogged about, one was from Scotland’s University of Glasgow. The investigators examined whether facial expressions transmit diagnostic signals simultaneously, to optimize categorization of the basic emotions, or sequentially, to support a more complex communication system of successive categorizations. Their analysis supported the latter.

The other study was from Ohio State University. Those investigators conducted a FACS analysis of 230 facial images, arriving at 21 distinct emotion categories which are different from though consistent with the basic categories (e.g., a happily surprised emotion combines muscle movements observed in the basic happiness and surprised emotions). They then used a computational model to demonstrate that most of these categories are also visually discriminable from one another.

There’s probably more recent research if you’d like to pursue the topic further.

P.S.

Paul Ekman Group website: www.paulekman.com/
Interview with Ekman on catching a liar. 5:55 min video from 2012: www.youtube.com/watch?v=wq-poN6sLF8
University of Glasgow study in Current Biology journal:
www.sciencedirect.com/science/article/pii/S0960982213015194
Ohio State University study in Proceedings of the National Academy of Sciences: www.pnas.org/content/111/15/E1454.full