CN111711798A

CN111711798A - Super multichannel video vehicle-mounted system

Info

Publication number: CN111711798A
Application number: CN202010577141.5A
Authority: CN
Inventors: 黄福胜; 王登为
Original assignee: Zhongge Intelligent Technology Shanghai Co ltd
Current assignee: Zhongge Intelligent Technology Shanghai Co ltd
Priority date: 2020-06-23
Filing date: 2020-06-23
Publication date: 2020-09-25

Abstract

The invention discloses an ultra-multi-channel video vehicle-mounted system which comprises a front high-definition camera, an AHD-2-MIPI conversion chip, an SoC system on chip, a CVBS-2-MIPI conversion chip and a backing camera, wherein the front high-definition camera acquires image information and transmits the image information to the AHD-2-MIPI conversion chip, the AHD-2-MIPI conversion chip converts the image and transmits the image information to the SoC system on chip, the backing camera acquires the image information and transmits the image information to the CVBS-2-MIPI conversion chip, and the CVBS-2-MIPI conversion chip converts the image and transmits the image to the SoC system on chip; according to the invention, 8 paths of cameras and one path of reversing camera are connected to the vehicle-mounted module under the android system by optimizing the hardware frame and the software frame, the coverage range of the vehicle-mounted camera is increased in a large range, and simultaneously, the image scaling processing algorithm for rapidly starting the reversing camera during starting is optimized, so that the stability and the driving safety of the vehicle-mounted system are improved.

Description

Super multichannel video vehicle-mounted system

Technical Field

The invention relates to the technical field of automobiles, in particular to a super multi-channel video vehicle-mounted system.

Background

The intelligent automobile is a modern vehicle, along with the continuous development of the intelligent automobile technology and the popularization of the Internet of vehicles, the requirements of people on the driving safety and the stability of an intelligent vehicle-mounted system are continuously improved, the vehicle-mounted camera serves as a key part of the vehicle-mounted system, an omnibearing visual field can be provided for a driver, an image is provided for the intelligent vehicle-mounted system to accurately judge the driving state, and the driving safety is greatly improved.

The driver is when backing a car, and the camera of backing a car in the on-vehicle system provides convenient, clear image of backing a car for the driver, and the driver can rely on the image of backing a car to assist backing a car, has reduced the field of vision blind area, and the position of the better judgement car of help car owner has improved the security of driving.

The vehicle-mounted system in the traditional automobile is usually provided with a small number of cameras and is not widely applied, wherein the most cameras are front-view cameras and rear-view cameras which are respectively used for driving recording and backing images, the number of the cameras used for matching a single automobile is about 2-4 generally, and the cameras are mostly used for high-matching models; for a large automobile (such as a truck), a large-scale view dead angle exists, the number of cameras assembled on a vehicle-mounted system is often not enough to cover all views around the truck, so that a driver cannot know the real conditions around the vehicle, and great potential safety hazards exist.

In addition, on some basic vehicle-mounted modules, due to hardware design reasons and performance limitations, connection of ultra-multi-path (more than 8-path) cameras is often not supported, and a high price is required for customizing a high-performance ultra-multi-path camera vehicle-mounted system, or an overlarge space in an automobile is required to be occupied.

Many times the driver just need back a car immediately after starting the car, and vehicle-mounted system need can use the camera of backing a car to look over the image of backing a car after the system starts completely, and this often needs the driver to wait for longer a period, influences the use and experiences, still has certain potential safety hazard simultaneously.

Disclosure of Invention

The invention aims to provide a super-multi-channel video vehicle-mounted system to solve the problems in the background technology.

In order to achieve the purpose, the invention provides the following technical scheme:

the front high-definition camera collects image information and transmits the image information to the AHD-2-MIPI conversion chip, the AHD-2-MIPI conversion chip transmits the image information to the SoC system-on-chip after the image conversion is processed, the backing camera collects the image information and transmits the image information to the CVBS-2-MIPI conversion chip and the CVBS-2-MIPI conversion chip, and the image information are transmitted to the SoC system-on-chip after the image conversion is processed.

As a further technical scheme of the invention: the SoC system on chip comprises a CCI control bus, an ISP interface and a memory.

As a further technical scheme of the invention: the front high-definition cameras are AHD cameras, the number of the front high-definition cameras is 8, and every four front high-definition cameras correspond to one AHD-2-MIPI conversion chip.

As a further technical scheme of the invention: the system also comprises an external memory, and the external memory is connected with the SoC system on chip.

As a further technical scheme of the invention: the system further comprises a display screen, and the display screen is connected with the SoC system on chip.

As a further technical scheme of the invention: the AHD-2-MIPI conversion chip is connected with the SoC system on chip through an MIPI interface.

As a further technical scheme of the invention: the SoC system on chip and the CVBS-2-MIPI conversion chip are connected through an MIPI interface.

Compared with the prior art, the invention has the beneficial effects that: according to the invention, 8 paths of cameras and one path of reversing camera are connected to the vehicle-mounted module under the android system by optimizing the hardware frame and the software frame, the coverage range of the vehicle-mounted camera is increased in a large range, and simultaneously, the image scaling processing algorithm for rapidly starting the reversing camera during starting is optimized, so that the stability and the driving safety of the vehicle-mounted system are improved.

Drawings

FIG. 1 is a diagram of a hardware connection framework of the present invention;

FIG. 2 is a hardware flow diagram of an 8+1 channel camera showing in detail the camera video data stream;

fig. 3 is a data flow diagram.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Referring to fig. 1-3, example 1: the front high-definition camera collects image information and transmits the image information to the AHD-2-MIPI conversion chip, the AHD-2-MIPI conversion chip transmits the image information to the SoC system-on-chip after the image conversion is processed, the backing camera collects the image information and transmits the image information to the CVBS-2-MIPI conversion chip and the CVBS-2-MIPI conversion chip, and the image information are transmitted to the SoC system-on-chip after the image conversion is processed.

As shown in fig. 3, the present invention realizes direct access of RAW Data through a virtual channel, the AHD camera starts to work after being powered on, and generates a continuous high-definition analog video signal immediately, the analog video signal input by the camera is converted into a digital signal through an AHD-2-MIPI chip, the output digital signal enters a CSI physical layer (CSIPHY) of an MSM8953 platform, a Data stream enters a CSID, and the RAW Data (RAW Data) stream directly enters a memory through an RDI channel without passing through a VFE.

The operation process of the internal system is as follows: the APK calls an API of a Cameraservice layer in an AIDL mode to realize the operations of collecting, encoding and the like of the data of the multi-channel AHD camera; the Cameraservice layer is a C/C + + language-based multi-camera functional service program used in an android vehicle-mounted system; the android application program can replace an original camera service program of android and provide functional service for the upper-layer app through an AIDL interface for the application program; in the interaction mode of the user space and the kernel space, the method and the device bypass the framework of high-pass native Camera data acquisition by realizing the virtual channel. And by calling a V4L2 video acquisition interface, directly performing read-write operation on a V4L2 Subdev equipment node to configure hardware and stream, and acquiring the data stream.

The process of the rapid starting of the reversing camera is as follows: in the starting process of a vehicle-mounted system, an additional CPU is initialized in an lk stage and used for data processing of a reversing camera, the CPU needs to perform image reduction processing after receiving input YUV video signals in the stage, for a general image reduction algorithm, the synthesis of pixel points needs to perform floating point operation in the calculation process, for a single-core CPU, the floating point operation is much slower than the shaping operation speed, so that the drawing is slow, and if only a decimal value is directly converted into an integer value for processing, the numerical value of a calculation result is inaccurate, and the image distortion is caused; the method optimizes the algorithm of zooming image processing, avoids using floating point type digital operation through bit operation and interpolation processing, and simultaneously obtains accurate image color values without causing image distortion. Finally, the reversing camera is turned on left and right after being electrified for 1s, and a picture is formed.

The invention adopts 8-path AHD cameras and 1-path reversing cameras, can provide a vehicle-mounted system of a large vehicle for use, can cover a wide visual field range by using a super-multipath camera, can be applied to an intelligent vehicle by combining a vehicle networking technology, an image processing technology and the like, and improves the driving safety; the method can also be applied to the automatic driving technology and provides sufficient data for an automatic driving system; and a large amount of video data can be used for later synthesis to obtain a finer and wider-angle picture (such as a 360-degree panoramic function); the 8-path AHD cameras can be used as redundancy, and even if a small number of cameras cannot work normally, the completeness of the formed image and the normal working and operation of the system can be still ensured; the 8-path AHD camera and the 1-path reversing camera are both connected to one main board, so that the integration level is high, and the space in the automobile chassis is greatly saved; the cameras have fast and clear image forming and low delay, the ultra-multipath cameras provide more choices for customers, and the customers can select the specifications and the number of the cameras according to the needs; the configuration of a hardware framework and data flow is optimized, the load of a CPU is reduced, the heat dissipation condition is better, the selection of the vehicle-mounted core board has better cost performance, and the cost is saved for customers. When a driver needs to reverse when starting the automobile, the vehicle-mounted system can quickly start a reverse image (about 1s after power-on) when the vehicle-mounted system is not completely started, the system does not need to be waited for complete start, the image is quickly reduced through an optimization algorithm, the imaging time is further shortened, the time is saved, and the driving experience of a client is improved; and the reversing area is displayed on the reversing image, and the reversing track is displayed according to the steering wheel, so that the client is helped to more accurately reverse.

Embodiment 2, on the basis of embodiment 1, a high-pass MSM8953 platform is selected as the SoC system-on-chip, and the operating system is Android 7.1; in addition, the module selects two N4 as AHD-2-MIPI conversion chips, each N4 chip can be connected with 4 cameras, the hardware design of connecting 8 AHD cameras is achieved, an independent CVBS camera is selected for the reversing image camera, and the reversing image camera is connected to the mainboard through the CVBS-2-MIPI conversion chips and used for displaying reversing images. The camera can support cameras with different specifications according to resolution, frame rate and scanning mode, and the use case of the invention supports the use of 4-path 1080P 25fps + 4-path 720P30fps + 1-path 1080P 25fps camera.

It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.

Furthermore, it should be understood that although the present description refers to embodiments, not every embodiment may contain only a single embodiment, and such description is for clarity only, and those skilled in the art should integrate the description, and the embodiments may be combined as appropriate to form other embodiments understood by those skilled in the art.

Claims

1. The vehicle-mounted system is characterized in that the front high-definition camera acquires image information and transmits the image information to the AHD-2-MIPI conversion chip, the AHD-2-MIPI conversion chip transmits the image information to the SoC system-on-chip after the image conversion is processed, the backing camera acquires the image information and transmits the image information to the CVBS-2-MIPI conversion chip and the CVBS-2-MIPI conversion chip, and the CVBS-2-MIPI conversion chip transmits the image information and the image information to the SoC system-on-chip after the image conversion is processed.

2. The on-board system for vehicle with ultra-multi-channel video of claim 1, wherein the SoC system on chip comprises CCI control bus, ISP interface and memory.

3. The on-board system of claim 2, wherein the front-facing high-definition cameras are AHD cameras, and the number of the front-facing high-definition cameras is 8, and every four front-facing high-definition cameras correspond to one AHD-2-MIPI conversion chip.

4. The on-board system for super multi-channel video according to claim 1, further comprising an external memory, wherein the external memory is connected to the SoC system-on-chip.

5. The on-board system for super multi-channel video according to claim 1, further comprising a display screen, wherein the display screen is connected to the SoC system-on-chip.

6. The on-board system for super multi-channel videos of claim 1, wherein the AHD-2-MIPI conversion chip is connected to the SoC system-on-chip through a MIPI interface.

7. The on-board system for super multi-channel videos of claim 3, wherein the SoC system-on-chip is connected to the CVBS-2-MIPI conversion chip through an MIPI interface.