Stereo camera system RoboVision®2s Object detection package
Upper left: Actual image and detection result.The detected object is displayed in red frame.
Bottom left: Stereo camera displays image converted from image data taken with RoboVision®2s to height information from the ground.
You can also display the image converted to the information on the distance from the camera by setting in the GUI.
Right: A view in which the result of object detection is displayed at the coordinates (camera position is the origin) viewed from above. Height information of the detected object is displayed in color.
Overview
In addition to the distance information calculated from the parallax image in the stereo camera system RoboVision®2s,
it visualize the size (width, height, depth) of the detected object and the position coordinates of the object from the camera in real time.
Setting of the object detection range and setting of the size to be detected can also be easily set on the GUI.
Detection video
Detection result integration screen
By using this system, it is also possible to detect objects with a height of about 10 cm, and it is possible to accurately detect the small objects on the road and the steps.
As for the object detection result, it is possible to output position and size information as well as the ID of the object.
Distance measurement achieves an accuracy of 1% or less at a distance of 130m if conditions are met. (Our measurement)
The object can be detected with high accuracy
From point cloud data obtained by parallax image of RoboVision®2s made by ZMP,
detection of overlapping in the depth direction can also detect objects when objects move in an overlapping manner.
Ability to detect objects accurately
The above is the captured image of object detection.
Pedestrians start to overlap from image 2, and in images 3 to 5, pedestrian behind the other pedestrian starts to appear, the detection area increases little by little.
Since the object detection state is maintained from the point cloud data obtained from the gap of the bicycle, only the foot of the pedestrian hidden in the image 4 is detected.
In this way, since distance and height can be accurately measured for each image frame, it can be seen that good detection accuracy is obtained for object overlap.