Automotive

Multiplatform Turn-Key Solutions
Accelerated Development For Automotive
Cameras

AUTOMOTIVE COMPETENCE ARIAS

Using our rich experience in development of camera solutions as a stepping stone, we at MM Solutions JSC created a specialized
Automotive Imaging framework in 2015.

We developed memory efficient, fast and accurate solutions for AE, AWB and WDR according to automotive industry standards, support for leading HW ISP – Texas Instruments, Renesas, NXP, Qualcomm, ARM, adaptation for various sensor and ISP drivers and designed for automotive use cases such as SRV, CMS and machine vision.

The already existing MMS algorithms were upgraded and were further optimized and improved. These include support of LFM, adaptive LFM, AE and AWB harmonization for Surround View and multicamera use cases.

With the development and help of a PC based Tuning tool to the framework were added new features, allowing Image Quality real time adjustment and improving for any light and road conditions.

Learn more about MMS Automotive products:

AUTOMOTIVE
CAMERA DEVELOPMENT KIT

CAMERA DEVELOPMENT KIT

Provides all hooks to achieve outstanding video quality at low cost

Production quality pre-integrated imaging framework and algorithms (AEC, AWB, Wide Dynamic Range management, Color management)

Automated PC Tuning Tool with real live tuning support

No deep ISP expertise needed to achieve good image quality

Long term solution, 10 years support

Already in production and ongoing projects with several Tier 1

Flexible and feature rich, incorporating all ISP control functions, mandatory image quality algorithms, support for profiling, logging, debug, etc.

Applicable for all automotive camera use cases, including but not limited to surround view (SRV), camera monitor and mirror (CMS), front or rear camera, multiple cameras stitching, machine and human vision

Single source solution, providing full camera stack and tools for high quality automotive camera

Easy to customize and port on new ISP platforms, operating systems and image sensor modules

Low support overhead, straightforward integration with ECU control software, no hardware dependencies, easy to deploy on new ECU

Easy to integrate customer imaging algorithms

IMAGING AUTOMOTIVE GRADE ALGORITHMS

Designed for automotive use cases – SRV, CMS, machine vision

Provisions to cope with corner cases as HDR and LDR scenes, high speed changing scenes, tunnel entry/exit, dual pixel color and sensitivity mismatch, internal sensor limitations, etc.

Robust operation with broad range of automotive image sensors – HDR sensors (2 and 3 frames), linear and compressed image data, RCCB, RGB IR, RCCC, RGGB sensors

AEC/WDR algorithms incorporates advanced tone mapping and wide dynamic range control algorithms and provides settings for local/global brightness enhancement, gamma and merger modules in addition to analog/digital gain and exposure for 1, 2, or 3 sensor frames

AWB algorithm incorporates color management algorithm to provide settings for CCM and RGB2YUV processing and 3D LUT if a corresponding HW is available

AWB has no limitations in respect to lights type and color temperatures handle

AWB algorithm incorporates color management algorithm to provide settings for CCM and RGB2YUV processing and 3D LUT if a corresponding HW is available

Both algorithms support:

Multiple ROI and weights support
Manual and automatic mode
No factory line camera module calibration needed for both AEC/WDR and AWB

AEC/WDR and AWB provide special modes to facilitate multi-camera harmonization and stitching, WYSIWYG mode, etc.

FLEXIBLE INTEGRATION FOR DIFFERENT SW AND HW PLATFORMS

Integrated with many automotive custom and off-the-shelf operating systems (OS)

Different HW ISP supported

Most popular image sensor vendors supported

Baseline solution for

TI TDI2Px/3x, TDA4, Renesas V3M and V3H

APPLICATION SCENARIOS

MMS CAMERA MIRROR

The Camera Mirror System is used to replace conventional side view mirrors with compact cameras providing live HDR images to the dedicated screens inside the vehicle.

HDR images increases the visibility of the surroundings and gives a better view to the driver.

MM Solutions imaging algorithms and camera tuning approaches are already integrated in various vehicle brands and models providing the best driving experience to the end customer.

MMS SURROUND VIEW

No cameras splitting lines (seamless stitching)

Uses GPU for fast and low-power stitching
Runtime ground plane estimation and adaptation (GPE)
Adaptive stitching seam
Adaptive color and brightness correction (ACC)
Maintains various views and a few views in the output window
Draws 3D car model, animations for doors and lights, parking guide lines, sonar distance info, 3D walls, showing text and icons
Maintains Transparent Car Chassis on top view and 3D views
Adaptive quality for system load Inline Factory calibration

A common problem of SVM algorithms is the large distance between the cameras, hence the objects look very differently. Stitching such different objects inevitably leads artifacts. To mitigate the problem MMS SVM solution uses adaptive seam, which can walk around the objects.

When a pedestrian stands exactly on the seam line between two cameras, starting from a car corner, only her/his shoes are visible in the stitched image. Given side-by-side comparison of fixed seam vs. adaptive seam illustrates the problem when an object passes by the car corners:

MACHINE VISION

Machine vision technology is used in automatic driver assistance systems, including sensors and cameras installed in vehicles. MMS Machine vision can detect whether the car is well positioned on the road, whether there are obstacles ahead or whether other vehicles are crossing the car’s direction of movement.

The detection capabilities use 3D image data to prevent traffic accidents and increase safety. Furthermore, Machine vision technology will help in the development of autonomous vehicles.

If you are considering introducing our technology or products, or if you are interested in co-creation with us, please feel free to contact us from here.

TUNING TOOL

The MM Solutions Tuning Tool application is a quick and efficient way to accomplish amazing camera tuning. With simple, minimalistic and straight to the point UI, you can accomplish the most desired tuning options on the market with ease. We’ve arranged its blocks and options to be best suited for our clients’ needs, and for the technology they’ll be using it on.

MMS Tuning tool is flexible and efficient image quality tuning system for achieving an excellent image quality in short deadline. It allows to delink the software development from image tuning process and produces tuning database in human readable form (XML) and in binary form (to be linked with or run-time loaded to Auto CDK). The tool has extendable architecture – new image pipe components and algorithms can be added as plugins to it.

PRODUCTION LEVEL IMAGE QUALITY TUNING

Production level tuning is the final stage of every Automotive project before it reaches its clients. Such tuning includes coverage of TUV requirements for different system classes as well as customized system look based on client preferences.

In order to achieve excellent Image Quality we test under multiple weather, light and scene conditions such as tunnels, multilevel and underground parking lots, rural and city areas, highway/multi-lane roads and more from sunny day to rainy night.