The human body in VR and mixed reality: perception, latency and comfort

A headset is a device for fooling your senses, and your senses are demanding. They compare what your eyes see with what your inner ear feels, how your body is moving and how fast the picture follows your head. When these agree, you feel present in another place. When they disagree, you feel strange, dizzy or ill. Many of the most important rules in VR and mixed reality design are not about technology at all. They are about human physiology.

This article explains the main ideas in plain language, so that you can design experiences that people enjoy and finish, rather than abandon.

How we see in three dimensions

Humans judge depth in several ways. Some work with one eye: things that are smaller look farther away, parallel lines converge, nearer objects block farther ones and shadows give shape. Others need two eyes. Each eye sees a slightly different view, and the brain compares them. This is stereoscopic vision, and a headset reproduces it by showing a slightly different image to each eye.

• The distance between the eyes, the interpupillary distance or IPD, is usually around 63 millimetres on average, and varies from person to person roughly between 54 and 74. Headsets let users adjust for it, and an incorrect setting causes strain and wrong sense of scale.
• Depth cues must agree. If shadows, size and stereo disagree, the scene feels wrong.

The focus problem

In real life, when your eyes turn inward to look at something near, they also focus on it. In most headsets, the screen is a fixed distance away, so your eyes focus there, whatever the scene shows, while turning inward to look at virtual objects that seem nearer or farther. This mismatch is called the vergence-accommodation conflict, and it is a known cause of eye strain. Designers reduce it by keeping important content at a comfortable distance, roughly from half a metre to a few metres, and avoiding objects very close to the face.

Balance and the inner ear

Your inner ear senses acceleration and the direction of gravity. When you walk, your eyes and inner ear report the same motion. In VR, if you push a joystick and the world glides forward, your eyes say that you are moving and your inner ear says that you are sitting still. A leading explanation for motion sickness is this conflict between the senses.

• Smooth, artificial movement, especially acceleration and turning, is the most common trigger.
• Movement that the body actually performs, such as walking in a tracked room space, rarely causes problems.
• Sensitivity varies. Some people are fine for hours, and others feel unwell within minutes.

Timing: frame rate and latency

When you turn your head, the image must follow almost instantly. The delay from head movement to the corresponding update on the screen is called motion-to-photon latency. If it is long, the world seems to swim, and discomfort rises. A commonly cited target is below about 20 milliseconds, and headsets typically run at 72 hertz or more, with many at 90 to 120.

• Low frame rates make movement look jerky, and strain the eyes.
• Unstable frame rates are worse than steadily lower ones.
• Performance budgets matter. A scene too heavy for the hardware will cause discomfort, however beautiful it is.

Sharpness and legibility

The eye can resolve much finer detail than headsets show. The human eye reaches roughly 60 pixels per degree at the centre of vision, and many headsets provide around 20 to 30. Small text, fine lines and distant details can therefore be blurry. Keep text large and high in contrast, and keep important information near the centre of view.

Design that respects the body

• Offer teleportation or fade-to-black movement as an alternative to smooth walking.
• Add comfort options, such as a vignette that narrows the view during movement.
• Keep the horizon stable, and avoid sudden or forced camera movement and rotation.
• Keep sessions short, perhaps ten to twenty minutes at first, and let people stop at any time.
• Let people sit or stand, and make sure that content is reachable.
• Provide a non-headset alternative for those who cannot or prefer not to use one.

Presence, scale and sound

• Eye height matters. If the virtual floor is not at the right distance, the scale of the whole world feels wrong.
• Hands and body. Seeing your hands move correctly increases the sense of presence.
• Spatial audio. Sounds that come from the correct direction and distance anchor the scene, and help people find things.
• Consistency. Objects that behave according to the rules of the real world are more convincing than beautiful ones that do not.

Mixed reality adds its own challenges

• Registration: virtual objects must stay locked to real places, and small tracking drift is noticeable.
• Occlusion: virtual objects should be hidden by real ones in front of them, otherwise depth looks wrong.
• Lighting: virtual objects look fake if their lighting does not match the room.
• Brightness: outdoors, bright sunlight washes out many displays.
• Safety: users still move in a real space, so keep them aware of obstacles and other people.

Frequently asked questions

Why do some people get motion sick in VR and others do not?

Sensitivity to sensory conflict varies between people, and with experience. Many people adapt with practice, and shorter, gentler sessions help.

Is a higher frame rate always better?

Higher is generally more comfortable, up to the limits of the display. But a stable frame rate matters more than a high one that frequently drops.

Is VR safe for children?

Many manufacturers set a minimum age, often around 13, because children’s visual systems are still developing. Follow the manufacturer’s guidance and keep sessions short.

How do I test comfort?

Test with people who have never used VR, at different times, and ask them how they feel during and after. Keep a record of what they were doing when they felt uncomfortable.

The best immersive experiences are built by teams who respect the body that will wear the headset. Understand how people see, balance and respond, and your designs will be comfortable, convincing and far more likely to deliver what you hoped.