HD Vision Systems

Technology

Depth from many viewpoints

A light-field camera records a scene from several slightly offset perspectives at once. From the shift between these views, the LumiScan software computes the depth of every pixel – in a single shot, with no pattern projection and no moving parts.

How depth is created

1Every view sees the same point at a slightly different position in the image. This shift is called disparity.

2Stack the image rows of all views on top of each other and a point forms a straight line – the epipolar plane image. Near points make a shallow line, distant points a steep one.

3The slope gives the distance: Z = f · b / d, with focal length f, view spacing b and disparity d. Because many views contribute to the same line, the estimate is robust against noise and occlusions.

Scene from above
1 2 3 4 5 6 7 Background
Epipolar plane image (EPI)
Disparity
– px per view
Computed depth
– mm

Drag the yellow point or use the slider. Example values: 7 views, spacing b = 80 mm, focal length f = 200 px.

From depth map to a clean point cloud

Every depth measurement contains noise. Before a robot grasps, the software removes outliers and smooths surfaces without blurring edges. Drag the slider to compare a point cloud before and after filtering.

Point cloud of an aeroplane model before and after noise removal – Filtered
Point cloud of an aeroplane model before and after noise removal – Noisy
Noisy Filtered

More in the blog post: Precise and Safe: How Noise Reduction is Revolutionizing Robotics

More about light field in the blog

All posts on this topic →

Is light-field 3D right for your application?

In a few steps the solution finder shows which LumiScan apps fit your task and prepares your enquiry.

Start the solution finder

YOUR ENQUIRY

Let’s talk about your application.

A few details are enough – we get back to you within one business day. Prefer to talk? +49 6221 6721900

Up to 3 files, 10 MB in total · JPG, PNG, PDF, STEP

We use your details to answer your enquiry. See the privacy notice.