With two stereo cameras, RoboVision 3 is a stereo camera that can sense with a distance and field of view that has a maximum measuring distance of 150 m and a horizontal viewing angle of 100 °.
It can be used for the detection of oncoming vehicles from a distance when turning right at the intersection which was difficult in the past and for wide detection of pedestrians and vehicles at the intersection right turn.
The image sensor adopts the newest Sony made high-sensitivity CMOS image sensor IMX390 for automotive use.
Simultaneous processing of HDR and flicker suppression of LED signal is possible, and we can expect significant improvement of recognition and judgment function important for ADAS/autonomous operation.
The output corresponds to the parallax image and the point cloud. You can also use it for self-location estimation and motion detection, point recognition, detection of machine learning and deep learning detection results, etc. using point cloud.
About high-sensitivity CMOS image sensor IMX390 for in-vehicle camera
This image sensor has a function of suppressing LED flicker which occurs at the time of photographing LED indicator, traffic light, etc., and HDR function realizing shooting with a wide dynamic range of 120 dB. Commercialization of an image sensor that enabled simultaneous use of LED flicker suppression function and HDR function was the first in the industry, realized by Sony's unique pixel structure and exposure method.
Moreover, due to the high sensitivity characteristics, it is possible to shoot high quality color images even under the environment of low illuminance of 0.1 lux corresponding to the moonlight.
A wide range of image measurement is possible with two lenses
RoboVision 3 measurement range image
RoboVision 3 integrates a wide range nearby and two stereo cameras using a telephoto lens and a wide angle lens in order to detect a far object ahead, the maximum measurement distance is 150 m, the horizontal viewing angle is 100 ° It is a stereo camera with detection range not until. Sensing is possible over a wider range than RoboVision 2s. (The solid line in the upper figure is the sensing area image of RoboVision 3)
Imaging with wide dynamic range of 120 dB
Difference between same images
HDR (120 dB) and super multiple tone (24 bit) output are realized to cope with environments with large contrast difference. It is possible to generate bright images and dark images from one image and to recognize objects even in environments where brightness changes greatly. By doing this, it is possible to recognize the object outside the tunnel while staying in the tunnel.
A rich software development environment, SDK is also included
The figure obtained image (upper), the parallax image (lower left), the result of distance conversion (lower right)
Viewer, image conversion, distance measurement software and software development environment (SDK) are included as applications for image measurement, and correspond to parallax images and point cloud output.
For explanation of stereo camera, see Autonomous Driving and ADAS "About stereo camera", please refer to the following page.