Products & Services

Stereo camera system RoboVision®2s Object detection package

Upper left: Actual image and detection result.The detected object is displayed in red frame.
Bottom left: Stereo camera displays image converted from image data taken with RoboVision®2s to height information from the ground.
You can also display the image converted to the information on the distance from the camera by setting in the GUI.
Right: A view in which the result of object detection is displayed at the coordinates (camera position is the origin) viewed from above. Height information of the detected object is displayed in color.

Overview

In addition to the distance information calculated from the parallax image in the stereo camera system RoboVision®2s,
it visualize the size (width, height, depth) of the detected object and the position coordinates of the object from the camera in real time.
Setting of the object detection range and setting of the size to be detected can also be easily set on the GUI.

Detection video

Detection result integration screen
By using this system, it is also possible to detect objects with a height of about 10 cm, and it is possible to accurately detect the small objects on the road and the steps.
As for the object detection result, it is possible to output position and size information as well as the ID of the object.
Distance measurement achieves an accuracy of 1% or less at a distance of 130m if conditions are met. (Our measurement)
The object can be detected with high accuracy
From point cloud data obtained by parallax image of RoboVision®2s made by ZMP,
detection of overlapping in the depth direction can also detect objects when objects move in an overlapping manner.
Ability to detect objects accurately
The above is the captured image of object detection.
Pedestrians start to overlap from image 2, and in images 3 to 5, pedestrian behind the other pedestrian starts to appear, the detection area increases little by little.
Since the object detection state is maintained from the point cloud data obtained from the gap of the bicycle, only the foot of the pedestrian hidden in the image 4 is detected.
In this way, since distance and height can be accurately measured for each image frame, it can be seen that good detection accuracy is obtained for object overlap.
It is possible to detect from the height of an object of about 10 cm
Since it can measure from a height of about 10 cm, if you move the mouse cursor to the data view that also acquired small objects on the road surface and small step measurements such as curb stones, the height and distance information of that point will be displayed on the GUI.
An example in which a small object of about 10 cm to 15 cm square was placed on the road and measured. Recognition as object, height information from road surface is displayed visually.
The road surface of 0 m is displayed in white, and the color changes as it increases. It is understood that the height information and the object detection are accurate.
An example of photographing a step, such as a curb, and measuring its height. The level difference of the curb of about 10 cm is clearly measured.
Realize highly accurate distance detection result
Under specific conditions, measure the distance of the object that is about 130 m away with an error about 1%. It is possible to measure the distance of the object ahead 100 m or more.
Image taken with RoboVision®2. The red spot is the distance from each point of about 40 m to 135 m measured by the laser range finder
An image in which the distance information is calculated by extracting the edge portion of the building having a large change with the background
Plot the distance measured with the laser range finder and the measured distance in RoboVision®2
Difference between actual distance and measurement of RoboVision®2. Even in the vicinity of 140 m, measurement error of 0.5 m or less was obtained.
※ Measurement results may vary depending on shooting environment and conditions.
 Object detection software is only available on Linux OS.

Camera specifications

Camera module
Image sensor

1/3 type effective for Sony cameras Effective 1,270,000 pixels
CMOS image sensor IMX 224 × 2

Resolution 1280 × 960 pixels (30 fps), 640 × 480 pixels (120 fps)
Horizontal view angle 45°
Interface USB 3.0
Baseline length 210 mm
Function Synchronization, distortion correction, stereo collimation, wide dynamic range, etc.

For details of the specifications of the ultra-sensitive stereo camera system RoboVision®2s please check​ ​here.

Price

RoboVision®2s Object detection package 1.8 million JPY (excluding tax)
(RoboVision®2s, object detection option, set of PC)

RoboVision® series option products

Stereo camera system
RoboVision®2s
ADAS / Autonomous Driving development camera equipped with Sony high sensitivity CMOS sensor
RoboVision®2s
Package CarTrack
With tracking function, it can be used for inter-vehicle distance measurement and ACC control of a leading car
The latest stereo camera system
RoboVision®3
Stereo camera capable of sensing distance and field of view up to 150 m, horizontal 110 °

Video

Object detection result
Distance measurement result
Height measurement result


For inquiries

To TOP
03-5844-6210