T-13 Province IV · The Moving Image The Surveyor's Theodolite 5 min 13 of 21 New

Spatial World Models I: Geometry & 3D Representations

How a model can hold a scene as real three-dimensional structure, so that it stays consistent from every angle.

View

A ring of glass lenses floating around a brass instrument on a table, one lens tinted cobalt.

In one sentence Store the world as shapes in space, not flat pictures, and every viewpoint agrees with every other.

Sonu, 10

Close one eye and hold out a finger. Ask someone to hold up a pencil. Try to touch its tip with your finger. It is harder than you think.

Now open both eyes and try again. Easy.

Your two eyes see two flat pictures that are a tiny bit different. Your brain mixes them into depth. Depth is your sense of how far away things are.

Moving your head helps too. That is how you know the cup is in front of the jug.

Spatial world models do something similar. A camera takes many flat photos of a place from different spots. The computer rebuilds the place as shapes in space.

It works out where each surface is. It works out how far away each one sits. It even works out the colour from each side.

Here is why that matters. Suppose the computer kept only a stack of photos. Its guess from the left might put the chair in one spot. Its guess from the right might put it somewhere else.

A 3D model keeps one chair in one spot. So every view agrees with every other view.

Some of these models are made of millions of tiny soft blobs. Think of coloured cotton balls floating in the air. From far away, the blobs blend into walls and trees and floors. Computers can now draw them fast enough to walk around inside.

Try this at home. Put a toy on the table. Walk around it and take eight photos from different sides.

Lay the photos out in a circle on the floor. Can you point to where you stood for each one? Which photo was hardest to place?

Senior AI Architect

Representations trade fidelity against memory and editability. Depth maps and point clouds are explicit and cheap, but sparse. Occupancy grids answer one question per voxel, filled or empty. They suit robot planning.

NeRF (Mildenhall et al., 2020) stores a scene inside a network. The network maps a 5D coordinate to density and colour. That coordinate is position plus view direction.

It renders by volume integration along camera rays. The results are photorealistic and slow to render.

3D Gaussian Splatting (Kerbl et al., 2023) represents the scene as anisotropic 3D Gaussians. A real scene uses millions of them. The method rasterizes them instead of marching rays.

It reached real-time rendering at 30 frames per second or more at 1080p. That made photoreal 3D interactive for the first time.

Every representation needs a consistent coordinate frame and camera poses. Structure-from-motion usually supplies them. NeRF takes known poses as input.

DUSt3R (Wang et al., 2023) regresses pointmaps from image pairs with no calibration or poses. It recovers the cameras as a by-product. That removes a fragile step from field capture.

Pose errors are a quiet failure. A few wrong cameras bend the whole reconstruction. Check reprojection error before anyone looks at the pretty render. A clean render can hide a bent yard.

For world models, explicit 3D gives what video models lack by default. Multi-view consistency holds by construction. Memory has a place to live, in coordinates. A revisit reads the same geometry it wrote.

That is why several interactive video systems now add a 3D scaffold underneath. The previous territory covers that pattern.

Take a distribution substation. A technician walks the yard with a phone and captures a few minutes of video. A splat reconstruction gives a walkable model for planning a transformer swap.

Before trusting it for clearances, check it against surveyed points. Splats optimise for how the scene looks. Geometry can drift where texture is plain, such as a bare concrete pad.

Three failure modes matter in a utility yard:

Floaters, which are blobs of density hanging in empty air. - Thin structures such as conductors and guy wires, which few views capture well. - Reflective and transparent surfaces, which confuse both depth and colour.

Measure geometry and image quality separately. Use geometric error against surveyed control points for the first. Use quality on held-out views for the second.

Then track the capture date of each region. A correct model of last year's yard is still wrong today.

My CIO

Spatial models matter wherever physical layout drives decisions. Sites, facilities, warehouses and field assets all qualify. For a utility that covers substations, yards and the equipment inside them.

Capturing a space once and querying it from any angle is already practical. Phone video and Gaussian splatting do it today. A planner can walk a yard on a laptop before a crew rolls a truck.

The money case is field time. Every site visit avoided or shortened saves crew hours and drive time. A shared model also cuts the back-and-forth between planners and crews. Contractors can see the site before they bid, which tightens estimates.

The open question for most organisations is staying current. Capture quality is rarely the problem.

The real place changes. Equipment gets replaced. Fences move. Trees grow toward the lines every season.

A model that was right last spring can mislead today. So plan for refresh cycles from the start. A one-off scan is a photo album with depth.

Each model needs a capture date and an owner. It also needs a trigger for recapture, such as a completed work order.

The second risk is precision. A model that looks right is not always measured right. Clearances and safety distances need a check against survey before anyone relies on them.

The decision is the refresh cadence and who owns it. I would recommend to tie recapture to work orders. Then the model updates as part of normal work, with no separate program to fund.

Ask the team one question. Who owns keeping each site model current after the place changes?

Quick check

Key terms