Beyond Object Detection: The Geometry Decisions Behind LiDAR Annotation
Beyond Object Detection: The Geometry Decisions Behind LiDAR Annotation A LiDAR point cloud can look surprisingly clear on first open. The road is obvious, vehicles stand out, and a building outline runs off into the distance. Then you try to select one structure and nothing else, and it gets harder. Some points overlap with neighboring objects. Parts of the structure vanish behind occlusions. Something that looks continuous from one angle looks broken from another. Even a selection that seems clean can pull in background points you never meant to include. That is the real work of LiDAR annotation. Recognizing what’s in the scene is the easy part. The harder part is deciding exactly which points belong to an object, how its geometry should be read, and what the final annotation has to represent. These decisions shape the data behind autonomous driving, infrastructure mapping, robotics, and geospatial analysis, and they rarely get the attention they deserve. 1. Not Everything in a Point Cloud Fits Inside a Box Most conversations about LiDAR data annotation start with 3D bounding boxes. For vehicles, pedestrians, and machinery, that makes sense, because a cuboid captures position, size, and orientation well. Road barriers, curved structures, poles, fences, and vegetation are a different story. A roadside barrier that bends through several curves and elevation changes would need one box full of empty space, or many boxes that localize it but lose its real shape. The method has to match both the object and what the data will be used for. Method What it does Best for 3D bounding box Localizes an object with a cuboid Vehicles, pedestrians, machinery Semantic segmentation Assigns a class to every point Roads, buildings, vegetation Instance segmentation Separates individual objects within a class Counting or tracking distinct objects Polyline / geometric annotation Traces linear features Road edges, lane markings, barriers These aren’t interchangeable. A cuboid may be plenty for a vehicle detection model and still be useless for a mapping team that needs an accurate road boundary. The useful question is how much geometric detail the downstream system actually needs, and the most advanced-sounding technique may not be the answer. 2. The Boundary Problem: Where Does One Structure End? In a 2D image, color, texture, and contrast help mark where objects end. A point cloud has none of that. Annotators work from position, height, shape, density, and how points relate to each other. Picture a vertical pole next to a tree. From one angle they separate cleanly. From another, their points overlap, and a selection meant for the pole quietly collects some branches. The error looks fine from where you made it. Rotate the scene 90 degrees and it’s suddenly obvious. That’s why multi-angle inspection belongs to the quality process. Annotators rotate the scene, isolate small regions, check height differences, and compare neighboring clusters before committing to a selection. Some situations need rules rather than judgment. Fences run through vegetation. Supports join larger surfaces. Should intersection points go to one class or the other? Does a connected support count as part of the main structure? What happens when the visible evidence isn’t enough to say? Those answers can’t change from one annotator to the next, so we settle them before production starts. Class definitions, boundary rules, and a procedure for ambiguous regions go into the guidelines, and difficult examples get reviewed together and written back into them. Without that, a project can end up with thousands of technically valid labels that describe the same structure in different ways, and the model learns the inconsistency. 3. The Structure Is Continuous. The Points Are Not. A point cloud is a set of sensor observations. It isn’t a complete copy of the physical world. Take a metal railing along a road. In reality it’s one unbroken line. In the scan, some stretches are dense, others are scattered fragments, and some are missing. Parts were hidden behind other surfaces, returns thinned out with distance, and scanning angle and surface reflectivity changed what came back. So what should the annotation follow: the points that were observed, or the structure that’s expected to be there? It depends on the task. Both directions carry a risk. Bridge every gap automatically and separate structures can merge into one. Treat every gap as a physical break and the result turns into fragments. We look at neighboring geometry, check the structure from several viewpoints, and rely on adjacent observations only when they give enough evidence. When doubt remains, the area is flagged for review instead of settled by assumption. The goal is a representation the data can support, even when it isn’t the neatest-looking one. 4. Why More Points Don’t Always Make Annotation Easier You’d expect a denser scan to be easier to work with. Often it is, but density brings its own problems. In a dense scan with road, vegetation, power lines, and overlapping structures, individual objects are easier to recognize and harder to select cleanly. There are more neighboring points to exclude and more surfaces to catch by accident. On thin, elongated structures, a small error repeated over many sections can bend the final shape. Sparse scans flip the problem. A small structure might be a handful of points, a distant object may barely register, and there may be too little information to define a full boundary. Dense clouds demand effort on separation, and sparse clouds demand effort on interpretation. Working faster fixes neither. Tools like CloudCompare and dedicated 3D labeling platforms make it possible to inspect data, isolate regions, and handle complex selections. They don’t replace judgment, though. Automated and semi-automated segmentation still need a human check for stray points, missing regions, and wrong class boundaries. The efficient approach is to spend attention where geometric mistakes are most likely instead of inspecting every point equally. 5. Scale Changes the Problem: Annotating Long Corridors Everything above gets harder when the scene isn’t a single intersection but many kilometers of road. A corridor that long can’t be handled as one point cloud.
Beyond Object Detection: The Geometry Decisions Behind LiDAR Annotation Read Post »