CN114205530B - Self-adaptive control method and system for vehicle-mounted camera module - Google Patents
Self-adaptive control method and system for vehicle-mounted camera module Download PDFInfo
- Publication number
- CN114205530B CN114205530B CN202111592033.6A CN202111592033A CN114205530B CN 114205530 B CN114205530 B CN 114205530B CN 202111592033 A CN202111592033 A CN 202111592033A CN 114205530 B CN114205530 B CN 114205530B
- Authority
- CN
- China
- Prior art keywords
- module
- vehicle
- signal
- image
- deserializer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 238000012545 processing Methods 0.000 claims abstract description 80
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 claims abstract description 31
- 238000012795 verification Methods 0.000 claims abstract description 20
- 230000005540 biological transmission Effects 0.000 claims abstract description 12
- 230000002457 bidirectional effect Effects 0.000 claims abstract description 8
- 230000003044 adaptive effect Effects 0.000 claims description 18
- 230000006854 communication Effects 0.000 claims description 15
- 238000004891 communication Methods 0.000 claims description 15
- 230000007175 bidirectional communication Effects 0.000 claims description 14
- 238000003780 insertion Methods 0.000 claims description 3
- 230000037431 insertion Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 8
- 230000006872 improvement Effects 0.000 description 8
- 238000013461 design Methods 0.000 description 5
- 230000015654 memory Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 102100034112 Alkyldihydroxyacetonephosphate synthase, peroxisomal Human genes 0.000 description 1
- 101000799143 Homo sapiens Alkyldihydroxyacetonephosphate synthase, peroxisomal Proteins 0.000 description 1
- 238000000848 angular dependent Auger electron spectroscopy Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 210000001503 joint Anatomy 0.000 description 1
- 230000010534 mechanism of action Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
- H04N7/0806—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division the signals being two or more video signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Studio Devices (AREA)
Abstract
The invention relates to the field of automobile video transmission, in particular to a self-adaptive control method and system for a vehicle-mounted camera module. The method comprises the following steps: s1, a vehicle-mounted camera transmits a serial video signal to an image signal deserializer through an interface, the image signal deserializer converts the received serial video signal into image video data, a control channel is constructed through a bidirectional control signal, an uplink control signal from the camera is demodulated, and the control signal is input to a control signal generation module; s2, the control signal is accessed to a control signal generation module, the control signal generation module confirms that a control channel between the control signal generation module and the vehicle-mounted camera works normally, and reads characteristic information of the vehicle-mounted camera and writes the characteristic information into a characteristic register; s3, a video processing and checking module connected with the image video stream signals, wherein the video processing and checking module calls the feature register information to check the image video stream signals, and the processed image video stream signals are output after the verification. The invention can adapt to cameras of different models.
Description
Technical Field
The invention relates to the field of automobile video transmission, in particular to a self-adaptive control method and system for a vehicle-mounted camera module.
Background
Currently, automobiles have become the most commonly used vehicle for people. With the system of the informatization degree in the automobile, video images are transmitted in the system in the automobile, and there is a strong demand from a lower-level streaming rearview mirror, AEB, LKA of ADAS application, domain controller of automatic driving level and the like.
In order to meet the high noise and complex environment in vehicles, high definition images are digitized and digitally transmitted (based on high-speed LVDS, MIPI a-PHY or other level standards), increasingly in vehicle applications. Because of the sensors (sensors) in different cameras, an image processing chip (ISP) and other modules (such as an auxiliary light source) all need to be configured, different cameras may be configured on the same platform, and manufacturers may also be different, how to adaptively identify the cameras and configure the cameras becomes a requirement.
As generally shown in fig. 1, the optical signal is converted into a digital signal by a sensor, and then converted into a high-speed serial signal (LVDS, MIPI a-PHY or other level standard) by an ISP or a serializer, and transmitted on an in-vehicle cable. After receiving the image signal, the camera module control system firstly deserializes the serial signal, restores the serial signal to a common image signal and processes the common image signal. Meanwhile, on an image channel (such as LVDS), the current common practice is to virtually output a two-way control signal (generally IIC), obtain the current situation of the camera, and send out an instruction to control each part in the camera module.
Conventionally, in order to perform adaptive configuration on different cameras, a plurality of methods for adaptive configuration of cameras are proposed, such as a system and a method for automatically matching a vehicle camera with a processing unit in application number 201310737372.8. A similar approach is limited to configuration by physical wiring with each camera, resulting in: if a plurality of cameras are required to be configured, a physical cable is added to the controller every time one camera is added.
Meanwhile, the mode is generally suitable for only one camera combination mode, such as one camera or four camera combinations. However, in modern automobile design, a plurality of coordination modes can be provided for one automobile, for example, one camera is used in a lower configuration, so that a reversing image function is realized; while the higher configuration may be to use four cameras to achieve 360-degree looking around functionality. Conventional approaches may require two controllers to be designed for both modes, which adds complexity to the design and production.
If the control system of the cameras can adaptively support 1 to a plurality of cameras and can adaptively configure a plurality of camera combinations, flexible product configuration can be correspondingly realized, and the design and production of automobile product models are accelerated.
Disclosure of Invention
The invention provides a serial differential (such as LVDS) vehicle-mounted camera module-oriented self-adaptive control system, which aims to solve the problem of how to flexibly configure different types of cameras and camera combinations.
The invention provides a self-adaptive control method for a vehicle-mounted camera module, which comprises the following steps:
S1, a vehicle-mounted camera transmits a serial video signal to an image signal deserializer through an interface, the image signal deserializer converts the received serial video signal into image video data in a format which can be processed by a main control module, a control channel is constructed through a bidirectional control signal carried on the serial video signal, an uplink control signal from the vehicle-mounted camera in the control channel is demodulated by the image signal deserializer, and the uplink control signal is input to a control signal generation module in a deserializer control module;
S2, the control signal is connected to a control signal generation module in the deserializer control module, the control signal generation module confirms that a control channel between the control signal generation module and the vehicle-mounted camera works normally, and the characteristic information of the vehicle-mounted camera is read and written into a characteristic register;
S3, the image video stream signal is accessed to a video processing and checking module in the deserializer control module, the video processing and checking module calls the characteristic register information of the control signal generating module to check the image video stream signal, and the processed image video stream signal is output after the checking.
As a further improvement of the present invention, the step S2 specifically includes the steps of:
s21, after the insertion of the camera is confirmed, whether the operation of the configuration channel is normal is confirmed, if so, the step S22 is executed, and if not, the operation is terminated;
S22, reading a specific address ID of the vehicle-mounted camera, if the reading is successful, writing a feature register which is required to be configured by the system, and executing a step S3; if the reading is unsuccessful, executing step S23;
S23, confirming whether parameter sets in the feature register combination module are exhausted, if not, replacing the configuration parameter sets, and re-executing the step S22; if the parameters are exhausted, the feature register combination updating module is informed to update the parameters.
As a further improvement of the present invention, the step S3 includes:
S31, after receiving the image video stream signals, the video processing and checking module calls register information of the control signal generating module to check the video stream, and if the check is successful, the processed image video stream signals are output; if the verification fails, step S23 is performed.
As a further improvement of the present invention, the configuration path in the step S21 includes a virtual IIC channel between the vehicle-mounted camera interface and the image signal deserializer based on a control channel, and a real IIC channel for data transmission between the image signal deserializer and the deserializer control module.
As a further improvement of the present invention, in the step S23, if the parameter set is exhausted, the step of notifying the feature register combination update module to update the parameters includes:
S231, the feature register combination updating module informs the image processing main control module of requesting to update the ID value of the feature register combination, and the image processing main control module acquires data matched with the ID of the vehicle-mounted camera to be read in an external database through a network;
S232, the image processing main control module acquires update data and then directly transmits the update data to the characteristic register combination update module, or transmits the update data to the characteristic register combination update module through the deserializer control module;
S233, the characteristic register combination updating module writes the updating data into the characteristic register combination module, and the deserializer control module reads the updating data from the characteristic register combination module.
The invention provides a self-adaptive control system for a vehicle-mounted camera module, which comprises the following components:
vehicle-mounted camera interface: the device is used for connecting the vehicle-mounted camera and transmitting data;
An image signal deserializer: converting the received serial video signal video data into an image video data stream signal in a processable format of the main control module; meanwhile, a control channel is constructed through a bidirectional control signal carried on the serial video signal;
An image processing main control module: the system is used for processing the image and establishing network connection with an external database;
feature register combination module: a plurality of groups of characteristic register information are stored;
The image processing main control module comprises a deserializer control module, wherein the deserializer control module comprises a video processing verification module and a control signal generation module;
and a video processing and checking module: receiving an image video stream signal;
control signal generation module: receiving an uplink control signal from the vehicle-mounted camera and generating a downlink control signal sent to the vehicle-mounted camera;
One or more vehicle-mounted camera interfaces are in bidirectional communication connection with an image signal deserializer, the image signal deserializer is in bidirectional communication connection with a video processing verification module and a control signal generation module respectively, the video processing verification module is in bidirectional communication connection with the control signal generation module, and the control signal generation module is in bidirectional communication connection with a characteristic register combination module.
As a further improvement of the present invention, the system further includes a feature register combination update module: the method is used for informing the image processing main control module to request to update the characteristic information value of the characteristic register combination; one end of the characteristic register combination updating module is connected with the characteristic register combination module in a two-way communication way, and the other end of the characteristic register combination updating module is connected with the image processing main control module or the deserializer control module in a two-way communication way.
As a further improvement of the invention, the image video stream signal between the vehicle-mounted camera interface and the image signal deserializer establishes communication transmission through an image signal channel, and the control signal between the vehicle-mounted camera interface and the image signal deserializer establishes communication transmission through a virtual IIC channel in a control channel carried on the image signal.
As a further improvement of the invention, the image signal deserializer and the video processing verification module are connected in communication through a related video stream signal channel including MIPI, and the image signal deserializer and the control signal generation module are connected in communication through a real IIC channel.
As a further improvement of the invention, the system also comprises a power supply-control signal interface for externally connecting a power supply or a control signal, the image processing main control module is connected with the power supply-control signal interface, and the image signal deserializer is connected with one or more vehicle-mounted camera interfaces through LVDS or other serial signal systems.
The beneficial effects of the invention are as follows: through designing and introducing the characteristic register combination module, the register combination and the characteristics thereof can be updated, and the novel camera is adapted. When cameras of different types are accessed, the corresponding camera types can be identified in a self-adaptive mode, and corresponding configuration is carried out. Meanwhile, as the register information can be updated, new camera information can be added or old camera information which is not used any more can be deleted, and the flexibility and the economy are both considered. The camera configuration mode is based on an IIC bus or other similar protocols, one or more cameras can be configured at the same time, and different camera combinations, such as single-camera reversing auxiliary images based on the same vehicle type or 4-camera 360-degree looking-around combinations, are configured in a self-adaptive mode.
Drawings
FIG. 1 is a general block diagram of a prior art camera control system of the present invention;
FIG. 2 is an external architecture diagram of an adaptive control system for a vehicle camera module according to the present invention;
FIG. 3 is a general block diagram of an adaptive control system for a vehicle camera module of the present invention;
FIG. 4 is a schematic of a data structure stored in a register set;
fig. 5 is a schematic diagram of a configuration flow of a camera module according to the present invention;
FIG. 6 is a hardware frame diagram of the camera module-oriented adaptive control system according to the present invention;
FIG. 7 is a schematic diagram of a feature register combination and a feature register combination update module in a system hardware framework according to the present invention;
FIG. 8 is a block diagram of an adaptive control system for multiple camera modules according to the present invention;
Fig. 9 is a schematic diagram of a data structure stored in a register combination in an adaptive control system for a plurality of camera modules.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent.
Embodiment one:
As shown in fig. 2,3, 6-8, the adaptive control system for a vehicle-mounted camera module of the present invention includes:
Vehicle-mounted camera interface 1: the device is used for connecting the vehicle-mounted camera and transmitting data;
the image signal deserializer 3: converting the received serial video signal video data into an image video data stream signal in a processable format of the main control module; meanwhile, a control channel is constructed through a bidirectional control signal carried on the serial video signal;
the image processing main control module 4: the system is used for processing the image and establishing network connection with an external database;
feature register combination module 8: a plurality of groups of characteristic register information are stored;
the image processing main control module 4 comprises a deserializer control module 5, and the deserializer control module 5 comprises a video processing verification module 6 and a control signal generation module 7;
video processing verification module 6: receiving an image video stream signal;
control signal generation module 7: receiving an uplink control signal from the vehicle-mounted camera and generating a downlink control signal sent to the vehicle-mounted camera;
One or more of the vehicle-mounted camera interfaces 1 are in bidirectional communication connection with the image signal deserializer 3, the image signal deserializer 3 is in bidirectional communication connection with the video processing and checking module 6 and the control signal generating module 7 respectively, the video processing and checking module 6 is in bidirectional communication connection with the control signal generating module 7, and the control signal generating module 7 is in bidirectional communication connection with the characteristic register combining module 8.
The feature register combination module 8 mainly comprises a memory for reading camera parameters, a memory for storing preset parameters, and an MCU, soC or FPGA of the embedded judging circuit. Specifically, the mechanism of action for the feature register combination module 8 is as follows:
The deserializer control module 5 controls and reads the information of the connected camera through the deserializer; the deserializer control module 5 automatically judges the signal of the connected camera by comparing the information in the characteristic register combination module 8; and after comparison and confirmation, carrying out corresponding configuration and operation, and obtaining the graphic information and carrying out subsequent processing by the graphic processing main control module.
For the register combination in the feature register combination module 8, a mode of judging a mode of butt joint of the cameras is shown in fig. 4, for example, the data structure of the camera 1 is shown as a, the ID of the camera is a, the resolution of the camera is 1280x1280, the isp is K, and a certain series of specific address registers are L, M, N; the ID of the camera 2 is B, the resolution of the camera is 1920x1080, the ISP is O, and a certain series of specific address registers are P, Q, R; the partial data, such as ID, resolution A, resolution B, etc., in the data combination of "A,1280, K, L, M, N", "B,1920, 1080, O, P, Q, R" can be read out to quickly judge which camera is accessed.
The system further comprises a feature register combination update module 9: the method is used for informing the image processing main control module 4 of requesting to update the characteristic information value of the characteristic register combination; one end of the feature register combination updating module 9 is in bidirectional communication connection with the feature register combination module 8, and the other end of the feature register combination updating module is in bidirectional communication connection with the image processing main control module 4 or the deserializer control module 5.
The feature register combination updating module 9 mainly comprises a memory for storing preset parameters, and an MCU, soC or FPGA embedded with a writing circuit. The memory for storing preset parameters is generally EEPROM/Flash, and is updated by a write circuit, namely the EEPROM/Flash can be written in by MCU, soC or FPGA.
The video processing and checking module 6 and the control signal generating module 7 in the deserializer control module 5 are composed of an MCU, a SoC or an FPGA with image and video signal processing capability, and the subsequent characteristic register combination module 8 and the characteristic register combination updating module 9 can be composed of different elements or can be the same chip with stronger functions.
As shown in fig. 6 and 7, the image video stream signal between the vehicle-mounted camera interface 1 and the image signal deserializer 3 establishes communication transmission through the image signal channel, and the control signal between the vehicle-mounted camera interface 1 and the image signal deserializer 3 establishes communication transmission through the virtual IIC channel of the image signal channel. The image signal deserializer 3 and the video processing and checking module 6 are connected in communication through MIPI or video stream signal channels, and the image signal deserializer 3 and the control signal generating module 7 are connected in communication through a real IIC channel.
As shown in fig. 3, the system further comprises a power supply-control signal interface 2 for externally connecting a power supply or a control signal, the image processing main control module 4 is connected with the power supply-control signal interface 2, and the image signal deserializer 3 is connected with one or more vehicle-mounted camera interfaces 1 through an IIC or CAN bus.
The feature register combination update module 9 updates as follows:
The upper vehicle body main controller initiates updating through the power supply-control signal interface 2, and invokes the feature register combination updating module 9 through the image processing main control module 4 to update the features of the feature register combination module 8.
Embodiment two:
as shown in fig. 8 and 9, on the basis of the first embodiment, the system is based on an IIC or CAN bus instead of a hardware connection, and the bus has the advantage that a plurality of slave devices CAN be accessed at one node, and here, a four-camera is taken as an embodiment.
And after power-on, if only one camera is detected to be accessed, trying or updating configuration parameters from a characteristic register combination with a single camera mode in a data structure, and if all four cameras are accessed, reading the parameters of each camera of the four-camera combination and configuring. The verification is performed and the parameter updating process is similar to the embodiment.
The embodiment can support single camera or multiple camera combinations on the same vehicle model by the same control system, can correspond to flexible product configuration, and accelerates the design and production of the vehicle product model.
Embodiment III:
as shown in fig. 2 to 9, based on the systems of the first and second embodiments, the adaptive control method for the vehicle-mounted camera module of the present invention includes the following steps:
S1, a vehicle-mounted camera transmits a serial video signal to an image signal deserializer 3 through an interface, the image signal deserializer 3 converts the received serial video signal into image video data in a format which can be processed by an image processing main control module 4, a control channel is constructed through a bidirectional control signal carried on the serial video signal, and an uplink control signal from the vehicle-mounted camera in the control channel is demodulated by the image signal deserializer and is input to a deserializer control module 5;
S2, a control signal is connected to a control signal generation module 7 in the deserializer control module 5, the control signal generation module 7 confirms that a control channel between the control signal generation module 7 and the vehicle-mounted camera works normally, and characteristic information of the vehicle-mounted camera is read and written into a characteristic register;
S3, the image video stream signal is accessed to a video processing and checking module 6 in the deserializer control module 5, the video processing and checking module 6 calls the characteristic register information of the control signal generating module 7 to check the image video stream signal, and the processed image video stream signal is output after the checking.
The step S2 specifically includes the following steps:
s21, after the insertion of the camera is confirmed, whether the operation of the configuration channel is normal is confirmed, if so, the step S22 is executed, and if not, the operation is terminated;
S22, reading a specific address ID of the vehicle-mounted camera, if the reading is successful, writing a feature register which is required to be configured by the system, and executing a step S3; if the reading is unsuccessful, executing step S23;
S23, confirming whether the parameter set in the characteristic register combination module 8 is exhausted, if not, replacing the configuration parameter set, and re-executing the step S22; if it is exhausted, the feature register combination updating module 9 is informed to update parameters.
The step S3 comprises the following steps:
S31, after receiving the image video stream signal, the video processing and checking module 6 calls the register information of the control signal generating module 7 to check the video stream, and if the check is successful, the processed image video stream signal is output; if the verification fails, step S23 is performed.
The configuration path in step S21 includes a virtual IIC channel between the vehicle-mounted camera interface 1 and the image signal deserializer 3 based on the control channel, and a real IIC channel for data transmission between the image signal deserializer 3 and the deserializer control module 5.
In step S23, if the parameter set is exhausted, the step of notifying the feature register combination updating module 9 to update the parameters includes:
S231, the feature register combination updating module 9 informs the image processing main control module 4 of requesting to update the ID value of the feature register combination, and the image processing main control module 4 acquires data matched with the ID of the vehicle-mounted camera to be read in an external database through a network;
S232, the image processing main control module 4 acquires update data and then directly transmits the update data to the characteristic register combination update module 9, or transmits the update data to the characteristic register combination update module 9 through the deserializer control module 5;
s233, the characteristic register combination updating module 9 writes the updating data into the characteristic register combination module 8, and the deserializer control module 5 reads the updating data from the characteristic register combination module 8
The execution of the deserializer control module 5 is explained as follows:
As shown in fig. 6, the deserializer control module 5 mainly comprises a video processing verification module 6 and a control signal generation module 7. In general, when the video data is transmitted by the vehicle-mounted camera and the cable in the vehicle, the LVDS or other level signals simultaneously carry the image signal and the bidirectional control signal between the camera, the control signal is a virtual IIC channel in fig. 6, after passing through the corresponding image signal deserializer 3, the LVDS signal is converted into an image video stream signal (such as MIPI) and a control signal (IIC) in a format which can be processed by the main control module, and the image video stream signal and the control signal are respectively connected to the deserializer control module 5. The image video stream signal is connected to the video processing verification module 6 in the deserializer control module 5, and the control signal is connected to the control signal generation module 7 in the deserializer control module 5.
After receiving the video signal, the video processing and checking module 6 uses the relevant register information (such as resolution) of the control signal generating module 7 to check the video stream, and after the checking process configures one resolution, for example, the video processing and checking module 6 uses the line synchronization signal and the field synchronization signal in the video signal to confirm that the configured camera outputs each line of effective pixels and each field line number of the image, and to confirm whether the camera register has been successfully configured; and after verification, the processed video stream is flowed to a display screen or other modules or devices to be used for the video stream.
The verification process of the video stream can be exemplified as follows:
The control signal generating module generates 7 a control signal, the video processing and checking module 6 receives the video stream information to generate a processed video stream, and judges whether the video stream accords with the configuration information of the control signal generating module 7: for example, the control signal generating module 7 configures the corresponding 720P image output by the camera, the video processing and checking module 6 checks whether the image output by the camera and converted by the image signal deserializer is the correct 720P image, if the camera outputs 360P, 1080P or other resolution images inconsistent with the configuration information after configuration, the image is misplaced and confused, and the video processing and checking module alarms, that is, the video signal is not checked successfully, and then the related processing flow is entered.
The control signal generating module 7 is connected to the image signal deserializer 3 with the relevant control signal and to the feature register combining module 8, and the processing flow thereof is as shown in fig. 5: after confirming that the camera is inserted, firstly confirming whether the configuration passage works normally, then reading the specific address ID, writing the specific address ID into a feature register which needs to be configured by the system after successful reading, and checking whether the video is correct or not by the video processing and checking module 6 after configuration. If the matching is confirmed to be successful, the camera is successfully configured. The configuration path refers to a real IIC channel between the image processing main control module 4 and the image signal deserializer 3, namely an actual two-wire IIC bus on the circuit board, and a virtual IIC channel between the image signal deserializer 3 and the vehicle-mounted camera interface 1, namely a virtual IIC channel in a control channel carried on the LVDS signal.
If the ID reading is unsuccessful, or the video signal verification is unsuccessful after the feature register writing, firstly confirming whether the parameter set in the feature register combination module 8 is exhausted, if not, replacing the configuration parameter set, and resetting as shown in FIG. 5; if it has been exhausted, the feature register combination update module 9 is notified to perform parameter update. For example, as in fig. 4, parameter a has failed to try parameter B, C, if parameters A, B, C are all used, then a new set of parameters is updated from outside.
The following describes the feature register combination module 8 and the feature register combination update module 9 through a specific embodiment, where the deserializer control module 5 is an FPGA/SoC (e.g. Xilinx Zynq series SoC) that has both an MIPI interface/IIC interface and related processing capabilities. The deserializer control module 5 is connected to the aforementioned image signal deserializer 3.
For the connection of the feature register combination module 8, as shown in fig. 7, the connection of the feature register combination module 8 updating module is an EEPROM write signal/bus, and can update EEPROM data; connected to the deserializer control module 5 is a read signal/bus of EEPROM, which can read data.
In this embodiment, the feature register combination module 8 is an EEPROM and related circuits, and the feature register combination update module 9 is an MCU (e.g. STM32 series products).
When the camera is plugged in, the ID is first tried to be read in (for example, IIC address is 0x 00), and when the read-in ID value is a, the relevant feature register combination data is read from the EEPROM of the feature register combination module 8, for example, in a column of ID a in fig. 4, the resolution, ISP value and specific register are configured. If the configuration is successful, the related image (such as the image for correction for comparison) is successfully acquired.
If the read value cannot match the ID (e.g., the read value is E and is not in the current A, B, C), as shown in fig. 5, the combination of the register values stored in the eercom is tried first, if the combination is exhausted, but none of the combinations can be configured to successfully transmit the image, the deserializer control module 5 notifies the image processing main control module 4 to request updating of the value of the feature register combination, the image processing main control module 4 may acquire the data matching the read ID in the database through the in-vehicle network or other wired or wireless communication modes (e.g., ID E, resolution 3840X2160, isp is U, and the specific register is V, W, X, i.e., "E,3840, 2160, U, V, W, X"), the feature register combination updating module 9 writes the data into the feature register combination module 8 after the deserializer control module 5 receives the data, and the deserializer control module 5 re-reads the data from the feature register combination module 8 and configures the data after confirming the writing.
Since the deserializer control module 5 and the deserializer control module 5 access the read and write buses of the feature register combination module 8, respectively, 2 modules do not read and write the EEPROM at the same time.
After the feature register combination updating module 9 requests the image processing main control module 4 to update the value, the image processing main control module 4 downloads a group of IDs from the cloud, for example, after the ID E is downloaded, the image processing main control module 4 directly transmits the ID to the feature register combination updating module 9, or transmits the ID E to the feature register combination updating module 9 through the deserializer control module 5, the image processing main control module 4 and the deserializer control module 5 are flash memories, after the shutdown, the information is cleared, the feature register combination updating module 9 writes the ID E into the feature register combination module 8, the feature register combination module 8 is a fixed storage EERPOM, after the next startup, the deserializer control module 5 directly reads the ID from the feature register combination module 8, and the image processing main control module 4 and the deserializer control module 5 serve as a transition module for ID transmission between the cloud and the feature register combination updating module 9.
If the new data combination cannot successfully complete the configuration of the camera, the above process is repeated.
The automobile front-loading camera is generally fixed, and once the model or manufacturer is changed, the automobile can not work normally, so that the automobile can support multiple manufacturers and multiple models of cameras, and the automobile front-loading camera is helpful for the compatibility and flexibility of the rear-loading market and the configuration change of the front-loading manufacturer in the later stage of the product.
When the camera type is replaced, the range of the set values and the information to be specifically set are different from each other due to the meaning of each camera configuration method, such as each location register, and it is necessary to set in advance at the time of shipment or to specify the currently connected type in the program.
The invention designs and introduces the characteristic register combination, the register combination and the characteristics thereof can be updated, and the invention is suitable for a new camera. When cameras of different types are inserted, the corresponding camera types can be identified in a self-adaptive mode, and corresponding configuration is carried out. Meanwhile, as the register signals can be updated, new camera information can be added or old camera information which is not used any more can be deleted, and the flexibility and the economy are both considered.
The foregoing is a further detailed description of the invention in connection with the preferred embodiments, and it is not intended that the invention be limited to the specific embodiments described. It will be apparent to those skilled in the art that several simple deductions or substitutions may be made without departing from the spirit of the invention, and these should be considered to be within the scope of the invention.
Claims (10)
1. The self-adaptive control method for the vehicle-mounted camera module is characterized by comprising the following steps of:
S1, a vehicle-mounted camera transmits a serial video signal to an image signal deserializer through an interface, the image signal deserializer converts the received serial video signal into image video data in a format which can be processed by a main control module, a control channel is constructed through a bidirectional control signal carried on the serial video signal, an uplink control signal from the vehicle-mounted camera in the control channel is demodulated by the image signal deserializer, and the uplink control signal is input to a control signal generation module in a deserializer control module;
S2, the control signal is connected to a control signal generation module in the deserializer control module, the control signal generation module confirms that a control channel between the control signal generation module and the vehicle-mounted camera works normally, and the characteristic information of the vehicle-mounted camera is read and written into a characteristic register;
S3, the image video stream signal is accessed to a video processing and checking module in the deserializer control module, the video processing and checking module calls the characteristic register information of the control signal generating module to check the image video stream signal, and the processed image video stream signal is output after the checking.
2. The adaptive control method for the vehicle-mounted camera module according to claim 1, wherein the step S2 specifically includes the following steps:
s21, after the insertion of the camera is confirmed, whether the operation of the configuration channel is normal is confirmed, if so, the step S22 is executed, and if not, the operation is terminated;
S22, reading a specific address ID of the vehicle-mounted camera, if the reading is successful, writing a feature register which is required to be configured by the system, and executing a step S3; if the reading is unsuccessful, executing step S23;
S23, confirming whether parameter sets in the feature register combination module are exhausted, if not, replacing the configuration parameter sets, and re-executing the step S22; if the parameters are exhausted, the feature register combination updating module is informed to update the parameters.
3. The adaptive control method for an on-vehicle camera module according to claim 2, wherein the step S3 includes:
S31, after receiving the image video stream signals, the video processing and checking module calls register information of the control signal generating module to check the video stream, and if the check is successful, the processed image video stream signals are output; if the verification fails, step S23 is performed.
4. The adaptive control method for the vehicle-mounted camera module according to claim 2, wherein the configuration path in the step S21 includes a virtual IIC channel between the vehicle-mounted camera interface and the image signal deserializer based on a control channel, and a real IIC channel for data transmission between the image signal deserializer and the deserializer control module.
5. The adaptive control method for an on-vehicle camera module according to claim 2, wherein in step S23, if the parameter set is exhausted, the step of notifying the feature register combination update module to update the parameter includes:
S231, the feature register combination updating module informs the image processing main control module of requesting to update the ID value of the feature register combination, and the image processing main control module acquires data matched with the ID of the vehicle-mounted camera to be read in an external database through a network;
S232, the image processing main control module acquires update data and then directly transmits the update data to the characteristic register combination update module, or transmits the update data to the characteristic register combination update module through the deserializer control module;
S233, the characteristic register combination updating module writes the updating data into the characteristic register combination module, and the deserializer control module reads the updating data from the characteristic register combination module.
6. An adaptive control system for a vehicle-mounted camera module, comprising:
vehicle-mounted camera interface: the device is used for connecting the vehicle-mounted camera and transmitting data;
An image signal deserializer: converting the received serial video signal video data into an image video data stream signal in a processable format of the main control module; meanwhile, a control channel is constructed through a bidirectional control signal carried on the serial video signal;
An image processing main control module: the system is used for processing the image and establishing network connection with an external database;
feature register combination module: a plurality of groups of characteristic register information are stored;
The image processing main control module comprises a deserializer control module, wherein the deserializer control module comprises a video processing verification module and a control signal generation module;
and a video processing and checking module: receiving an image video stream signal;
control signal generation module: receiving an uplink control signal from the vehicle-mounted camera and generating a downlink control signal sent to the vehicle-mounted camera;
One or more vehicle-mounted camera interfaces are in bidirectional communication connection with an image signal deserializer, the image signal deserializer is in bidirectional communication connection with a video processing verification module and a control signal generation module respectively, the video processing verification module is in bidirectional communication connection with the control signal generation module, and the control signal generation module is in bidirectional communication connection with a characteristic register combination module.
7. The adaptive control system for an in-vehicle camera module of claim 6, further comprising a feature register combination update module: the method is used for informing the image processing main control module to request to update the characteristic information value of the characteristic register combination; one end of the characteristic register combination updating module is connected with the characteristic register combination module in a two-way communication way, and the other end of the characteristic register combination updating module is connected with the image processing main control module or the deserializer control module in a two-way communication way.
8. The adaptive control system for an on-vehicle camera module of claim 6, wherein an image video stream signal between the on-vehicle camera interface and the image signal deserializer establishes communication transmission through an image signal channel, and a control signal between the on-vehicle camera interface and the image signal deserializer establishes communication transmission through a virtual IIC channel in a control channel carried on the image signal.
9. The adaptive control system for an on-vehicle camera module according to claim 6, wherein the image signal deserializer and the video processing verification module are connected by a related video stream signal channel including MIPI, and the image signal deserializer and the control signal generation module are connected by a real IIC channel.
10. The adaptive control system for an on-vehicle camera module according to claim 6, further comprising a power-control signal interface for externally connecting a power source or a control signal, wherein the image processing main control module is connected to the power-control signal interface, and wherein the image signal deserializer is connected to one or more on-vehicle camera interfaces through LVDS or other serial signal systems.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111592033.6A CN114205530B (en) | 2021-12-23 | 2021-12-23 | Self-adaptive control method and system for vehicle-mounted camera module |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111592033.6A CN114205530B (en) | 2021-12-23 | 2021-12-23 | Self-adaptive control method and system for vehicle-mounted camera module |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114205530A CN114205530A (en) | 2022-03-18 |
| CN114205530B true CN114205530B (en) | 2024-05-03 |
Family
ID=80656291
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111592033.6A Active CN114205530B (en) | 2021-12-23 | 2021-12-23 | Self-adaptive control method and system for vehicle-mounted camera module |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114205530B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114968875B (en) * | 2022-05-31 | 2023-08-25 | 重庆长安汽车股份有限公司 | Self-adaptive system supporting vehicle-mounted serial deserializing link and automatic driving automobile |
| CN118411713A (en) * | 2024-06-25 | 2024-07-30 | 中国第一汽车股份有限公司 | Vehicle fault checking method and device, storage medium and vehicle |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20110110500A (en) * | 2010-04-01 | 2011-10-07 | 주식회사 에이디아이엠 | Car video interface system |
| CN103747167A (en) * | 2013-12-26 | 2014-04-23 | 惠州华阳通用电子有限公司 | System and method for automatically matching vehicle camera with processing unit |
| CN206629194U (en) * | 2017-03-19 | 2017-11-10 | 常州市新科汽车电子有限公司 | Vehicular display control device |
| CN207399382U (en) * | 2017-10-31 | 2018-05-22 | 北京图森未来科技有限公司 | A kind of vehicle-mounted long range image delivering system |
| CN208971624U (en) * | 2018-10-31 | 2019-06-11 | 深圳市易成自动驾驶技术有限公司 | Automotive camera system |
| CN112954272A (en) * | 2021-01-29 | 2021-06-11 | 上海商汤临港智能科技有限公司 | Camera module, data transmission method and device, storage medium and vehicle |
-
2021
- 2021-12-23 CN CN202111592033.6A patent/CN114205530B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20110110500A (en) * | 2010-04-01 | 2011-10-07 | 주식회사 에이디아이엠 | Car video interface system |
| CN103747167A (en) * | 2013-12-26 | 2014-04-23 | 惠州华阳通用电子有限公司 | System and method for automatically matching vehicle camera with processing unit |
| CN206629194U (en) * | 2017-03-19 | 2017-11-10 | 常州市新科汽车电子有限公司 | Vehicular display control device |
| CN207399382U (en) * | 2017-10-31 | 2018-05-22 | 北京图森未来科技有限公司 | A kind of vehicle-mounted long range image delivering system |
| CN208971624U (en) * | 2018-10-31 | 2019-06-11 | 深圳市易成自动驾驶技术有限公司 | Automotive camera system |
| CN112954272A (en) * | 2021-01-29 | 2021-06-11 | 上海商汤临港智能科技有限公司 | Camera module, data transmission method and device, storage medium and vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114205530A (en) | 2022-03-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114205530B (en) | Self-adaptive control method and system for vehicle-mounted camera module | |
| US20140368609A1 (en) | Systems And Methods For Generating A Panoramic Image | |
| JP7494126B2 (en) | COMMUNICATION DEVICE, COMMUNICATION METHOD, AND PROGRAM | |
| CN111641765B (en) | Camera module, vehicle-mounted camera system and remote photographing method | |
| EP3926911A1 (en) | Communication device, communication method, and program | |
| CN113434168A (en) | Vehicle-mounted network architecture self-adaptive upgrading method based on intelligent hardware computing power | |
| JP6330873B2 (en) | Imaging device | |
| WO2021215269A1 (en) | Transmitter, receiver, and communication system | |
| US10343606B2 (en) | Using parallel data lines for GPIO purposes | |
| US11176907B2 (en) | Video data displaying device | |
| CN110719408B (en) | Vehicle-mounted high-definition camera communication method | |
| CN110336992B (en) | Electronic equipment, calibration method and computer storage medium | |
| CN112689991B (en) | Initialization synchronization device, initialization synchronization method, and camera | |
| WO2020067298A1 (en) | Image processing device and image display system | |
| JP2011082633A (en) | Electronic apparatus and method of controlling the same | |
| CN114049859B (en) | Display device, display method and vehicle | |
| CN118842995A (en) | Data acquisition method, data acquisition device, vehicle and computer readable storage medium | |
| US11485277B2 (en) | Method and system for deducing a reduced image refresh frequency in high definition headlights | |
| CN116097235B (en) | Communication method and device based on internal integrated circuit | |
| CN110024372B (en) | Arrangement to prevent false image orientation for rear view camera | |
| CN103841039B (en) | The method and apparatus of network streaming | |
| JP7570930B2 (en) | COMMUNICATION DEVICE, COMMUNICATION METHOD, AND PROGRAM | |
| CN114363475A (en) | Video processing device and equipment, and video simulation system | |
| CN118264888A (en) | Image processing system, computing device, and storage medium | |
| CN114285987A (en) | Multi-path camera access system and method and operation machine |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |