Products & Services

ADAS / Stereo camera for autonomous operation RoboVision 3

RoboVision 3 (with exterior)
RoboVision 3 (no exterior)

Overview

With two stereo cameras, RoboVision 3 is a stereo camera capable of sensing with a distance and field of view that is far away, with a maximum measuring distance of 150 m and a horizontal viewing angle of 110 °.
It can be used for the detection of oncoming vehicles from a distance when turning right at the intersection which was difficult in the past and for wide detection of pedestrians and vehicles at the intersection right turn.
The image sensor adopts the newest Sony made high-sensitivity CMOS image sensor IMX390 for automotive use.
Simultaneous processing of HDR and flicker suppression of LED signal is possible, and we can expect significant improvement of recognition and judgment function important for ADAS/autonomous operation.
The output corresponds to the parallax image and the point cloud. You can also use it for self-location estimation and motion detection, point recognition, detection of machine learning and deep learning detection results, etc. using point cloud.


About high-sensitivity CMOS image sensor IMX390 for in-vehicle camera

This image sensor has a function of suppressing LED flicker which occurs at the time of photographing LED indicator, traffic light, etc., and HDR function realizing shooting with a wide dynamic range of 120 dB. Commercialization of an image sensor that enabled simultaneous use of LED flicker suppression function and HDR function was the first in the industry, realized by Sony's unique pixel structure and exposure method.
Moreover, due to the high sensitivity characteristics, it is possible to shoot high quality color images even under the environment of low illuminance of 0.1 lux corresponding to the moonlight.

※引用 LEDフリッカー抑制とHDR撮影を同時実現 車載カメラ向けCMOSイメージセンサー業界初の商品化  https://www.sony.co.jp/SonyInfo/News/Press/201704/17-034/index.html (2018年4月10日)

Functions

A wide range of image measurement is possible with 1.2 lenses

RoboVision 3 measurement range image
RoboVision 3 integrates a wide range of nearby objects and two stereo cameras using a telephoto lens and a wide angle lens in order to detect a far object ahead, the maximum measurement distance is 150 m, the horizontal viewing angle is 110 ° It is a stereo camera with detection range not until. Sensing is possible over a wider range than RoboVision 2s. (The solid line in the upper figure is the sensing area image of RoboVision 3)

The image of the measurement scene and the distance measurement image are shown below. Scenes assumed for autonomous driving etc. can be handled by using two stereo cameras properly.

· For distance measurement of distant vehicles assumed when turning right

· For more extensive measurements assumed at the time of left turn

2.120 dB shooting in wide dynamic range

Difference between same images
HDR (120 dB) and super multiple tone (24 bit) output are realized to cope with environments with large contrast difference. It is possible to generate bright images and dark images from one image and to recognize objects even in environments where brightness changes greatly. By doing this, it is possible to recognize the object outside the tunnel while staying in the tunnel.

Below are the images with the brightness of the measured image data changed and the videos shot of the LED traffic light while running.
In scenes with a large contrast difference, image processing is performed with image information whose brightness has been changed, so it is possible to comprehensively recognize dark areas in the tunnel and bright areas of the exit. In addition, signals and indicators using LEDs have traditionally caused flickering (flashing) phenomena, but flicker suppressed measurements are possible.
RoboVision3 計測動画(明るさを変更時イメージ)
RoboVision3 LEDフリッカー抑制機能

3. A rich software development environment, SDK is also included

The figure obtained image (upper), the parallax image (lower left), the result of distance conversion (lower right)
Viewer, image conversion, distance measurement software and software development environment (SDK) are included as applications for image measurement, and correspond to parallax images and point cloud output.

For explanation of stereo camera, see Autonomous Driving and ADAS "About stereo camera", please refer to the following page.

Image

RoboVision 3 measurement image
RoboVision 3 camera section (left: telephoto lens right: wide angle lens)

Applications

· Detection of an oncoming vehicle from a distance when turning right at an intersection where it was difficult before
· Extensive detection of pedestrians and vehicles at the intersection right / left turn
· Self position estimation and moving body detection using point cloud
· LED signal detection

Specification

The camera module
Image sensor 1 / 2.7 type effective for Sony made in-vehicle camera 2,450,000 pixel CMOS image sensor IMX390CQV *
Resolution 1920 × 1080 pixels (30 fps)
Horizontal view angle Wide angle part: 110 ° / telephoto part: 40 °
Baseline length Wide angle part: 150 mm / Telephoto part: 230 mm
Frame grabber unit
Function Synchronous imaging, distortion correction, stereo collimation, HDR mode, etc.
Interface USB 3.0 (x2)
Software development environment (SDK)
Library Camera I / F, parallax image generation, point cloud generation
Application

RAW output, parallax image output, point cloud (PCL compatible) output

Operating environment Windows 10 (Core i 7 · AVX 2 equipped)
· Product specifications are subject to change without notice due to technical improvement etc.
Each image is under development.
 *研究開発用途に限った製品です。

Price

Stereo camera for automatic operation RoboVision 3 2.2 million yen (excluding tax)
 
(Camera unit, mounting parts (for wedge mount), front glass reflection prevention plate, frame grabber unit, connection cable,
 ソフトウェア開発環境(SDK)CD-ROM、XMC変換ボード)
※ Exterior is optional. Please consult us separately.

PC for RoboVision® 3 set (PC type for incorporation) 600,000 yen (excluding tax)
* Built-in computer compatible with XMC (PCI Express x4)

RoboVision series option products

Stereo camera system
RoboVision 2s
Library with object detection function using point cloud data
RoboVision 2s
Object detection library
Library with object detection function using point cloud data
RoboVision 2s
Package CarTrack
With tracking function, it can be used for inter-vehicle distance measurement and ACC control of a leading car
Surround RoboVision
Acquire 360 ​​° full circumference images at maximum color depth of 24 bits at 30 fps

For inquiries

To TOP
03-5844-6210