Visual Personality Typing: Techniques and Practices

Visual Personality Typing

From peering into the distinct lumps of people’s heads (phrenology), facial expressions, or the lines on a palm (palmistry)—visual typing has been largely debunked as a pseudoscience. It principally draws upon the Barnum or Forer effect—by which any description is general enough to be thought of as accurate to most experiences. This gives off a believable illusion of accuracy upon first glance.

Ever wonder why horoscopes always seem eerily accurate? Add a dash of confirmation bias, and it’s a recipe for a self-fulfilling prophecy, or perhaps fate? Superstitions such as broken mirrors also entail illogical reasoning. If a belief is mentally rehearsed repeatedly over time, the brain may eventually accept it as truth and hence, the expected actions may result.

Great news: There has been some ongoing and promising research in the areas of eye-tracking and automatic responses to stimuli (e.g. salivating levels of one’s tongue to sour foods to differentiate between introversion and extraversion). These experiments rely on physical reactions, which is far more quantifiable and replicable than visual data alone.

What are some of these outdated methodologies for visual typing?

Let’s dive right into personality, through sight:


The ancient study of skull structure shapes, established by German doctor Franz Joseph Gall in 1796 and popular in early to mid 1800s, came to be known as phrenology. Alternative medicine and practices such as detoxification diets, acupuncture, or crystal healing all fall under the same umbrella.

Palmistry, the pseudo-study of the meanings behind lines on palms, is the older relative of the discipline. Johann Kaspar Lavater, a Swiss pastor and philosopher, founded the field of physiognomy—the practice of deciphering a person’s traits and character from their outer appearance, particularly with the face.

Franz Joseph Gall, German neuroanatomist and physician, proposed the idea of physiognomy (i.e. assessment of personality from outer appearance) in relation to the localization of mental functions in the brain. He believed certain brain areas were responsible for different activities, such as regulating emotions or planning for the future.

Scottish lawyer George Combe wrote national bestseller On the Constitution of Man and its Relationship to External Objects in 1828, with one of the most radical views on phrenology and its significance in deciphering the various conditions an individual could undergo due to their skull structure.

Body Structures (Somatotypes)

The basic three body structures (known technically as somatotypes) are:

  • Ectomorph
  • Endomorph
  • Mesomorph

Ectomorphs have smaller frames and thinner physiques; endomorphs have larger, stockier frames with heavier bones; and mesomorphs fall in the middle, with hourglass shapes comprised of mostly muscle (~80%). Comparable to astrology at best, there have been no significant correlations between body structures and personality traits.

Facial Profiling

Subject to the halo effect, facial profiling relies on ratios between different compartments of the visage. Lombroso, an Italian criminologist, believed people who were socially deviant or “born criminals” had certain features, such as larger ears. However, his experiments suffered from sampling bias, whereby faces of the general population were omitted from his analysis altogether.

Many ethical issues arise from his results as well, for instance, in the case of digital hiring tools. If computer algorithms erroneously rule out an individual’s candidacy due to mere facial structure before even given a chance to access job-based skills, then the technological bias is highlighted.

This could lead to false positives—perceiving a causation where there is none. On the flip side of the same coin, false negatives arise when candidates who turn out to possess strong traits of criminality were deemed by the machines as innocent, perhaps even trustworthy.

How about people who have undergone various cosmetic surgeries?

Makeup can also alter the perceptions of facial symmetry (e.g. higher cheekbones or larger eyes), which makes the task of decoding behavior all the more difficult. In the case of forensics profiling, it may pose challenges for accurate screening procedures.

Would these algorithms be able to catch and decipher these augmented and modified appearances?

Eye Movement Tracking

To end on a high note, eye movement tracking technology has drastically proliferated in the past decade to detect certain behaviors, such as lying and stress. Cybersecurity and forensics implement the four basic types of movements:

  • Saccades
  • Smooth pursuit
  • Vergence
  • Vestibulo-ocular

As depicted in the science fiction noir film Minority Report (2002), advanced scanning technologies may be able to predict crime before it happens, and create safer communities on the whole. The technological expenditures to successfully implement such a system would go over the roof, however.

Many eye movement tracking studies have been conducted on children who have learning challenges such as dyslexia or socialization struggles with autism. When shown clips of characters conversing, for example, children on the spectrum tend to avoid zooming into faces, and focus instead on inanimate objects.

Marketers and business intelligence experts also use eye movement tracking technologies to predict customer churn rates to successful and profitable email campaigns. With digital media and big data at play with every click and scroll, personality remains tantamount in understanding users’ behavior.

Click-through rate analyses, F-shaped eye scanning patterns, and blink frequencies all provide invaluable information to better understand customers’ needs and wants. The user experience, or UX for short, implements the psychology behind the human-and-computer (HCI) relationship.

Summing Up: Visual Personality Typing

  • Phrenology
  • Body Structure
  • Facial Profiling
  • Eye Movement Tracking

Visual personality typing continues to attract the attention of behaviorists, forensic scientists, and psychiatrists. With big data movement gaining momentum by each click, the future qualitative study of personality psychology will under major transformations and adjustments.


Purves, D., Augustine, G. J., Fitzpatrick, D., et al. Neuroscience. 2nd edition. Sunderland (MA): Sinauer Associates; 2001. Types of Eye Movements and Their Functions.

Hansotia, P. (2003). A neurologist looks at mind and brain: The enchanted loom. Clinical medicine & research1(4), 327–332.

Hoppe, S., Loetscher, T., Morey, A. S., Bulling, A. (2018). Eye Movements During Everyday Behavior Predict Personality Traits. Frontiers in Human Neuroscience.

Jensen, Mikael. (2016). Personality Traits and Nonverbal Communication Patterns. International Journal of Social Science Studies. 4. 57-70.

Khan, Iftikhar & Brinkman, Willem-Paul & Fine, Nick & Hierons, Robert. (2008). Measuring personality from keyboard and mouse use. ACM International Conference Proceeding Series. 369. 38.

Mazzarello P. (2011). Cesare Lombroso: an anthropologist between evolution and degeneration. Functional neurology26(2), 97–101.

Munthe, C., & Radovic, S. (2015). The Return of Lombroso? Ethical Aspects of (Visions of) Preventive Forensic Screening. Public health ethics8(3), 270–283.