​How does head tracking work? A complete guide

Every head tracking setup has the same four parts, whatever hardware it uses.

 

1. A sensor watches your head

The sensor is usually a camera that sits on top of your monitor. Depending on the type of tracker, it looks for infrared lights or reflectors on a clip, or it recognises your face directly. Infrared sensors work by lighting the scene with light you can't see, so they are not affected by the lights in your room.

 

2. Software works out your head's position

Tracking software turns what the sensor sees into numbers: how far your head has turned, tilted and moved. Most head trackers use opentrack, a free and open-source program, or a version of it. TrackHat's own software, TrackHat opentrack, is free.

 

3. Curves turn small movements into big ones

You can't turn your head 180 degrees and still see your screen, so the software amplifies your movement. A small turn of your head, perhaps 20 to 30 degrees, can become a full look over your shoulder in the game. You set these "curves" yourself, so the response can be gentle in the centre for steady aiming and faster towards the edges.

 

4. The game receives the data

The software passes your head position to the game using a standard protocol. Most games that support head tracking read the FreeTrack or TrackIR protocols, so one head tracker works across hundreds of titles without special drivers.

 

What is 6DoF head tracking?

DoF stands for degrees of freedom: the different ways your head can move. A 3DoF head tracker follows only rotation. A 6DoF head tracker follows rotation and position.

• Yaw: turning your head left and right.

• Pitch: looking up and down.

• Roll: tilting your head towards your shoulder.

• X: moving your head left and right, for example to look around a cockpit frame.

• Y: moving your head up and down, for example to see over the dashboard.

• Z: leaning towards or away from the screen, for example to read small instruments.

6DoF tracking feels much more natural, especially in flight sims, because you can lean in to read a gauge or lean sideways to look past a pillar. The TrackHat Sensor V2 tracks all six.

 

Types of head tracker

There are several ways to track a head, and they differ in accuracy, comfort and price.

 

Infrared point tracking (clips and hats)

This is the classic approach. You wear a clip on your headset or cap with three infrared LEDs or reflectors, and an infrared camera tracks those points. NaturalPoint's TrackIR and the Delanclip both work this way. Point tracking is accurate and fast, but you have to wear the clip, keep it charged or plugged in, and keep it in view of the camera.

 

Infrared face tracking with machine learning

This newer approach removes the clip altogether. An infrared sensor lights your face with invisible light and a machine learning model recognises your head's shape and position. The TrackHat Sensor V2 uses this method at 60Hz, so there is nothing to wear, and it works in any lighting, with headsets and with glasses. It also includes a point tracking mode if you already own a clip.

 

Webcam face tracking

Free software such as opentrack's neural network tracker or AITrack can track your face with an ordinary webcam. It costs nothing to try, but results depend heavily on your room's lighting, and many players find it less smooth and less steady than a dedicated sensor, especially in the dark.

 

Phone apps

Apps such as SmoothTrack use your phone's camera and send head data to your PC. They are cheap and convenient, but you need somewhere stable to mount the phone, and the phone is tied up while you play.

 

Eye and head tracking cameras

Products such as the Tobii Eye Tracker 5 and the Beam Eye Tracker combine head tracking with eye tracking. They are useful if you want both, though some sim players find eye-driven camera movement less predictable than pure head tracking. You can read more in our guide to eye tracking vs head tracking.

 

VR headsets

Virtual reality tracks your head inside the headset itself. It is the most immersive option, but it costs far more, needs a powerful PC, and some players get motion sickness or find headsets uncomfortable for long sessions.

 

What do you need for head tracking?

• A head tracker: an infrared sensor, a camera with a clip, a webcam or a phone.

• Tracking software: usually opentrack, which is free. The TrackHat Sensor V2 comes with free TrackHat opentrack.

• A game that supports head tracking: most flight, racing, truck and space sims do.

• A screen: any monitor works, from a laptop screen to an ultrawide or a triple-monitor rig.

Setup usually takes a few minutes: mount the sensor on top of your monitor, install the software, sit in your normal position and press "centre" to set your neutral view. The TrackHat manual walks through each step.

 

Which games support head tracking?

Hundreds of PC games support head tracking through the FreeTrack or TrackIR protocols. Popular titles include:

• Microsoft Flight Simulator 2024 and Microsoft Flight Simulator X

• DCS World

• X-Plane

• IL-2 Sturmovik

• War Thunder (simulator battles)

• Elite Dangerous and Star Citizen

• Arma 3

• Euro Truck Simulator 2 and American Truck Simulator

• F1 24 and Project CARS

• Farming Simulator

See our list of games that support head tracking for setup guides for each one. If your game isn't listed, check its settings or website for TrackIR or FreeTrack support.

 

Is head tracking worth it?

For anyone who plays sims on a monitor, head tracking is one of the biggest upgrades you can make. Here is what changes:

• Situational awareness: you can check your six in a dogfight, look into a corner apex or glance at your mirrors without letting go of the controls.

• Hands stay on the controls: no more hat-switch panning or holding a mouse button to look around.

• Easier landings and parking: leaning and looking out of the side window makes it far easier to judge distance.

• Immersion without a headset: you get much of the feeling of being in the cockpit while keeping your desk, keyboard and drink in view.

• Comfort for long sessions: there is nothing heavy on your face, and with a clip-free tracker, nothing on your head at all.

 

Head tracking vs VR

VR is more immersive, but head tracking is cheaper, works with the screen you already have, and lets you see your physical controls, notes and charts. Head tracking also avoids the motion sickness some players feel in VR, because your eyes still see a stable screen and room. Many sim players use head tracking for everyday flying and driving, and VR only occasionally.

 

Head tracking with the TrackHat Sensor V2

The TrackHat Sensor V2 is a head tracker for PC games and sims with nothing to wear. It sits on top of your monitor and tracks your head in 6DoF at 60Hz using infrared light and machine learning.

• No clips, hats, wires or reflectors on your head

• Works with headsets and glasses, in daylight or darkness

• Tracks best at 1 to 3 feet, and up to about 8 feet away

• Free TrackHat opentrack software, with all processing done locally

• Works with 300+ games out of the box

• Includes a point tracking mode if you already own a clip

 

Head tracking FAQ

 

Do I need VR for head tracking?

No. Head tracking works with a normal monitor, an ultrawide, triple screens or a TV.

 

Can I use a webcam for head tracking?

Yes, with free software such as opentrack's neural network tracker or AITrack. Webcam tracking is a good way to try head tracking, but it relies on good room lighting and is usually less smooth than an infrared head tracker.

 

Is TrackIR a camera?

Yes. TrackIR is an infrared camera that tracks a clip with reflectors or LEDs that you wear on your headset or cap. The TrackHat Sensor V2 is also an infrared sensor, but it tracks your face directly, so you don't need the clip.

 

How do I use opentrack?

Install opentrack, choose your tracker as the input and "freetrack 2.0 Enhanced" as the output, then press Start before launching your game. Set your curves and centre your view with a hotkey. TrackHat opentrack comes preconfigured for the Sensor V2.

 

Does head tracking work in the dark?

Infrared head trackers, including the TrackHat Sensor V2 and clip-based systems, work in the dark because they provide their own invisible light. Webcam tracking usually struggles in low light.

 

Does head tracking work with glasses or headphones?

Yes. Clip-based trackers mount on your headset or cap, and the TrackHat Sensor V2 is designed to track you with headsets and glasses on.

 

How far do I have to turn my head?

Only a little. The software amplifies your movement, so a small turn can give you a full look to the side while you keep your eyes on the screen.

 

What is the difference between head tracking and eye tracking?

Head tracking follows the position and angle of your head. Eye tracking follows where your eyes are looking on the screen. Some devices do both; for flying and driving, many players prefer the predictability of head tracking.

 

Is head tracking worth it for flight sims?

Yes. Being able to look around the cockpit naturally is one of the biggest improvements you can make to flight simulation on a monitor, especially for landings, formation flying and dogfighting.

Discover the TrackHat Sensor V2 head tracker