🦴
Lesson 04·8 min read

How SLS Tracking Works

Skeleton-tracking origins, what it really detects, and how to read the overlay critically.

Where SLS came from

Structured Light Sensor cameras (originally the Microsoft Kinect) project a pattern of infrared dots into a room and read how that pattern deforms to build a depth map. They were trained to find human shapes so a game could detect a player. SpiritMesh uses pose-detection neural networks that work on regular video, but the principle is similar: the model is trying to fit a skeleton to anything that looks vaguely person-shaped.

What it actually detects

Joints — head, shoulders, elbows, hips, knees, ankles. The model emits a confidence score for each joint. A fully-formed humanoid figure usually requires 8+ joints with average confidence >30%. Fewer joints, lower confidence, or rapidly flickering joints generally mean something humanoid-shaped, not a person.

Common false-figures

Coat racks. Chairs with throws on them. Tall plants. Curtains catching air. Your own reflection in a dark window. The model will happily 'see' a person in any of these — that's why depth stability and motion coherence matter as much as joint count.

Reading the three numbers

Pose confidence = how sure the model is of joint positions. Depth stability = how consistent the figure is in space across frames. Motion coherence = whether the figure moves like a coordinated body or like noise. A clip with high pose but low depth/motion is almost always a static object being misread.

Do

  • ●Watch for 8+ stable joints across multiple seconds
  • ●Compare baseline scan (room empty) to active scan
  • ●Note nearby coat racks, chairs, plants, mirrors
  • ●Trust depth stability over single-frame snapshots

Don't

  • ●Treat a single flickering joint as a 'figure'
  • ●Skip baseline — you'll mistake furniture for entities
  • ●Forget that reflective windows act like a second room
  • ●Crop screenshots to hide the obvious chair behind it
Knowledge Check

Pass 2/3 to earn the badge.

1. An SLS / pose model is fundamentally trying to…
2. Which combination is the strongest figure detection?
3. A skeleton appearing on a coat rack is most likely…
🦴
Reward
SLS Analyst
Completed Lesson 4 — How SLS tracking works · +200 XP