Products & Services

Super high sensitivity stereo camera system RoboVision®2s​ ​

RoboVision®2s​ ​
In-car image
Automotive stereo camera system for ADAS / Autonomous Driving development.
RoboVision®2s realizes accurate distance measurement and contributes to the development and research using cameras!

Stereo camera (stereo vision) system RoboVision®2s has been introduced to more than 100 companies and universities and has been adopted as a tool for R & D of Autonomous Driving and ADAS.

Four features of stereo camera RoboVision®2s utilized in development of products

RoboVision 2s was developed as a robot eye, and operates with USB power supply in a characteristic compact housing like a hero's glasses, connecting a cable to a PC, this is a stereo camera that can easily acquire images using a dedicated application.
We will also develop software environment (sample software, software development kit) and contribute to development using stereo camera.

Supports USB3.0 and easily captures long-time images at 30fps

As a compatible interface, it is compatible with USB 3.0 and connected to a PC, and images can be easily measured with the attached application. It corresponds to continuous image measurement of 4 hours or more at a maximum of 30 fps with image acquisition with SSD specified.

A rich software development environment, SDK is also included

Application program interface (API) for stereo camera connection, image acquisition and storage, etc. is prepared, and the measured images can be easily incorporated into user software.

Compact and easy-to-handle housing
 

Body size is W270.8mm × D109mm × H50mm, With a compact housing of 730g, it can be easily mounted on the mirror of the vehicle with a dedicated mount. It can also be fixed using a 1/4 inch screw hole on the top surface.

物体検出・画像連続計測機能に対応したオプションも用意

カメラ前方の画像計測結果より、物体の検出処理を行い、物体の幅、高さ、奥行きの情報を出力。最大1280×960ピクセルで30fpsのカラー映像を連続して10時間以上もの計測

What is a stereo camera?

A stereo camera is similar to the principle that people see objects, by using two cameras (two-lens cameras) to photograph an object from multiple different directions at the same time. It is a camera that can measure depth information from camera pixel position information. In ADAS (advanced driving assistance system), the stereo camera (stereo vision) is a device that is used for driving assistance such as automatic braking and white line recognition using the distance between the front and the acquired image.
In recent years it has been installed in mass-produced vehicles and has come to play a sensor function for directly controlling cars.

For more details of stereo camera, please refer to Autonomous Driving and ADAS "About stereo camera".

Main functions of stereo vision RoboVision®2s

ZMP is consistently designing and manufacturing from hardware to software. With the function of the attached application, measure the distance from a photograph (image) taken with the camera to a specific object for a short time (high frame rate). Because it recognizes the distance in three dimensions (3D) with disparity information by the image processing of the stereo camera, we can also perform object detection and tracking in space with image processing software in real time and with high precision.

Image acquisition from stereo camera

Specify the image size of the two cameras and measure the image. Acquisition of color image of 30 fps at maximum 1280 × 960 pixels. In addition, continuous measurement over 4 hours can be done by utilizing SSD.

Distance recognition and measurement of highly accurate objects

特定の条件下においては、約130m離れた対象物の距離を約1%以内の誤差で計測。100m以上先の対象物の距離の計測が可能です。
RoboVision2で撮影した生画像。赤点はレーザ測距装置で計測した約40m~135mの各ポイント
背景と大きな変化がある建物のエッジ部を抽出して距離情報を算出した画像
レーザー測距装置で計測した距離とRoboVision2での計測距離をプロット
実際の距離とRoboVision2の計測の差。140m近辺でも0.5m以下の計測誤差となった。

Object detection by point group (matching data)

Acquires three-dimensional point cloud information from parallax and distance measurement data, and outputs the presence or absence of an object, its position, and its width and height (size).
※本機能はオプションソフトの物体検出ソフトウェアにて対応しております。

Usage of stereo camera

Currently, the stereo camera system (stereo vision) is utilized in various places, but here we will introduce the use applications of RoboVision 2s.

Automobile advanced driving support system (ADAS)

Stereo cameras are applied to automobile advanced driving systems (ADAS) such as eye site etc., such as automatic brake support that detects and predicts forward obstacles with a camera and prevents collision.

Autonomous Driving development

For Autonomous Driving development working on ZMP, stereo cameras are used for detecting obstacles in the surroundings, Image Recognition such as white line detection and signal detection, and self-location estimation using point cloud map (point cloud information).

Image processing technology development

By using stereo cameras, we can apply image recognition algorithms such as road surface condition detection and image recognition algorithms in conjunction with forward obstacle recognition and distance measurement, and apply them to more accurate object recognition control is possible.

Security measures

Stereo cameras are installed for security and preventive safety measures, covering places where people can not see, and they are used to detect people using object detection and Image Recognition technologies.

About image processing of stereo camera

In the image processing of stereo cameras, images (measurement images) taken with two cameras aligned on the left and right are captured as left and right from the camera, as well as depth measure in a target. We also calibrate the image, it is possible to measure the distance with higher precision than the disparity information, detect the object and track it by correcting the distortion of the photo by the lens and parallelization processing.

Adoption of unique calibration method

In order to improve accuracy and robustness, we adopted our own calibration method. Adopting a dedicated calibration board to improve working accuracy, converting image conversion to Canonical Image, and adopting a method to accurately extract the lattice point position of the image surely. Also improve optical filters and lenses to reduce the effects of moire and false colors.

WDR (Wide Dynamic Range) function

WDR (Wide Dynamic Range) is a function that produces images with moderate brightness by processing dark images and bright images to brighten dark areas and darken bright areas. By using the wide dynamic range function, by combining a bright image and a dark image, clear images can be acquired both in the bright and dark areas of the image.

Object detection algorithm

The object detection algorithm calculates the ground surface (road surface height) in the measurement image by specifying the mounting orientation of the camera. It is judged that there is an object in the area where the height of the road surface is high and point clouds (matched points) are gathered, and the width, height, and position from the camera are output.

Front-following feature

Developed an algorithm equipped with the following function of the front vehicle by improving the accuracy of the height of the road surface estimation and detecting the object from the relative height from the road surface. The detection result is equipped with a device that can output with CAN and can be used as a reference sensor for the sensor under development.

Description video of stereo camera RoboVision®2s

Below is a description video of the stereo camera unit RoboVision®2 for reference.

Price of stereo camera RoboVision®2s

■RoboVision®2s 900,000 JPY(excluding tax)
(RoboVision®2s main unit, car mount, USB cable, CD-ROM (manual, SDK))

■RoboVision®2s PC set 1.3 million JPY(excluding tax)
(Set of RoboVision®2s and processing PC set)

■RoboVision®2s SSD package 1.4 million JPY(excluding tax)
(Set of RoboVision®2s, processing PC, image recording SSD (2TB))

Stereo camera RoboVision®2s option products

RoboVision® 2s
Object detection library
Library with object detection function using point cloud data
RoboVision® 2s
Package CarTrack
With tracking function, it can be used for inter-vehicle distance measurement and ACC control of a leading car
RoboVision®2
SSD package
Package that can save images to an external SSD and can continuously measure up to 4 hours
The latest stereo camera system
RoboVision® 3
Stereo camera capable of sensing distance and field of view up to 150 m, horizontal 110 °

RoboVision®2s Product Description Menu

To TOP

For inquiries