CN117956048A

CN117956048A - MIPI mode controller and data transmission control system

Info

Publication number: CN117956048A
Application number: CN202410346821.4A
Authority: CN
Inventors: 赵旺; 常子奇; 曾祥祥
Original assignee: Zhuhai Amicro Semiconductor Co Ltd
Current assignee: Zhuhai Amicro Semiconductor Co Ltd
Priority date: 2024-03-26
Filing date: 2024-03-26
Publication date: 2024-04-30

Abstract

The application discloses an MIPI mode controller and a data transmission control system; the MIPI mode controller is used for packaging data to be transmitted according to the data type of the data packet specified by the DSI protocol when the display serial interface is configured to be in a first packet mode; the display serial interface is further used for packaging data to be transmitted according to the data type of the data packet specified by the CSI-2 protocol when the display serial interface is configured to be in a second packaging mode; the camera serial interface is further used for unpacking the received data packet according to the data type of the data packet specified by the CSI-2 protocol when the camera serial interface is configured to be in a first unpacking mode; and is further configured to unpack the received data packet according to a data type of the data packet specified by the DSI protocol when the camera serial interface is configured in the second unpacking mode. The problem that the camera serial interface and the display serial interface cannot communicate is solved.

Description

MIPI mode controller and data transmission control system

Technical Field

The application relates to the technical field of MIPI interface communication, in particular to a MIPI mode controller and a data transmission control system.

Background

The serial interface between the processor and the display module comprises a display serial interface (DISPLAY SERIAL INTERFACE, DSI) which can be used as a DSI transmitting end and also can be named as an MIPI DSI interface; the DSI transmitting end is used for driving the display module based on the DSI protocol by using the output image data and can be displayed on the display screen. The serial interface between the processor and the camera module comprises a camera serial interface (CAMERA SERIAL INTERFACE-2, CSI-2) which can be used as a CSI-2 receiving end and can be named as an MIPI CSI-2 interface; the CSI-2 receiving end is used for being connected with the camera module and receiving image signals acquired by the camera.

The DSI protocol adopted by the DSI transmitting end and the CSI-2 protocol adopted by the CSI-2 receiving end both belong to a mobile industry processor interface (Mobile Industry Processor Interface, MIPI) protocol, and the DSI transmitting end and the CSI-2 receiving end both belong to an MIPI interface and serve as standard universal interfaces of the mobile industry processor interface. The physical layer (PHYSICAL LAYER, D-PHY) standard adopted by the DSI transmitting end is the same as the physical layer (PHYSICAL LAYER, D-PHY) standard adopted by the CSI-2 receiving end. However, the DSI protocol adopted by the DSI transmitting end and the CSI-2 protocol adopted by the CSI-2 receiving end have compatibility problems, and the definition of command data types comprising data packets is different, so that data transmission or communication cannot be performed between the CSI-2 receiving end and the DSI transmitting end, the interconnection expansion among a plurality of chip modules with the CSI-2 receiving end or the DSI transmitting end is restricted, and the display module and the camera module are influenced to be applied in different scenes.

Disclosure of Invention

The application discloses an MIPI mode controller and a data transmission control system, which concretely adopts the following technical scheme:

A MIPI mode controller, the MIPI mode controller setting a display serial interface and a camera serial interface; the MIPI mode controller receives the data packet through the camera serial interface and sends the data packet through the display serial interface; the camera serial interface and the display serial interface both belong to MIPI interfaces of the MIPI mode controller; the MIPI mode controller is used for packaging data to be transmitted according to the data type of the data packet specified by the DSI protocol when the display serial interface is configured to be in a first packet mode, so as to form the data packet conforming to the DSI protocol; the MIPI mode controller is used for packing data to be transmitted according to the data type of the data packet specified by the CSI-2 protocol when the display serial interface is configured to be in a second packing mode to form the data packet conforming to the CSI-2 protocol, so that the data packet transmitted by the display serial interface is identified by the camera serial interface; a MIPI mode controller for unpacking the received data packet according to the data type of the data packet specified by the CSI-2 protocol when the camera serial interface is configured to be in a first unpacking mode; and the MIPI mode controller is used for unpacking the received data packet according to the data type of the data packet specified by the DSI protocol when the camera serial interface is configured to be in the second unpacking mode, so that the camera serial interface identifies the data packet sent by the display serial interface.

In summary, different working modes are configured for the camera serial interface and the display serial interface through the MIPI mode controller, and the communication between the camera serial interface and the display serial interface is realized according to the unpacking or packing data of the corresponding interface protocol, so that the data sent by the display serial interface of the MIPI mode controller can be correctly identified by the camera serial interface, and the camera serial interface of the MIPI mode controller can correctly identify the data sent by the display serial interface, therefore, the MIPI mode controller provides an application foundation for the camera serial interface and the display serial interface for realizing the interconnection communication of a plurality of MIPI mode controllers on the premise that the MIPI mode controller is used as an interface control circuit device or an interface control chip for integrating the camera serial interface and the display serial interface, and the problem that the camera serial interface and the display serial interface cannot communicate is solved.

And by configuring the first unpacking mode, the second unpacking mode, the first packing mode and the second packing mode, the MIPI interface compatible with the DSI protocol and the CSI-2 protocol is updated and manufactured in the MIPI mode controller, so that bus data load and signal processing with strong compatibility and correct format are provided, a high-speed communication interface or an interface conversion chip is not required to be additionally connected, the overall hardware complexity is reduced, and the cost and the technical advantage are improved.

A data transmission control system comprising at least two of the MIPI mode controllers, wherein a camera serial interface of one MIPI mode controller is connected with a display serial interface of the other MIPI mode controller; when the camera serial interface of one MIPI mode controller is in a first unpacking mode, the display serial interface of the other MIPI mode controller is in a second packing mode; when the camera serial interface of one MIPI mode controller is in the second unpacking mode, the display serial interface of the other MIPI mode controller is in the first packing mode.

In summary, the data transmission control system configures different packaging modes or unpacking modes for the camera serial interfaces and the display serial interfaces of at least two MIPI mode controllers so as to unpack or pack data according to corresponding interface protocols, and is compatible with communication between the camera serial interfaces and the display serial interfaces of different MIPI mode controllers.

The camera serial interface of one MIPI mode controller is connected with the display serial interface of the other MIPI mode controller, and data communication between the camera serial interface of one MIPI mode controller and the display serial interface of the other MIPI mode controller is established by correspondingly configuring the first unpacking mode, the second packing mode and the first packing mode disclosed in the previous embodiment, so that the camera serial interface of one MIPI mode controller correctly recognizes a data packet sent by the display serial interface of the other MIPI mode controller or the display serial interface of the other MIPI mode controller sends out a data packet which can be recognized by the camera serial interface of one MIPI mode controller, and therefore the interconnection communication of a plurality of MIPI mode controllers in the data transmission control system provides an application basis of the camera serial interface and the display serial interface, and the problem that the camera serial interface and the display serial interface cannot communicate is solved.

A data transmission control system, said data transmission control system comprising a plurality of said MIPI mode controllers connected in cascade; among the MIPI mode controllers connected in cascade, two MIPI mode controllers connected directly are a current-stage MIPI mode controller and a next-stage MIPI mode controller respectively, or two MIPI mode controllers connected directly are a previous-stage MIPI mode controller and a current-stage MIPI mode controller respectively so as to form two adjacent MIPI mode controllers; among the cascade-connected MIPI mode controllers, when the current MIPI mode controller is not the last MIPI mode controller, the current MIPI mode controller is provided with a display serial interface connected with the corresponding camera serial interface of the next MIPI mode controller, and the current MIPI mode controller is provided with a camera serial interface connected with the corresponding display serial interface of the next MIPI mode controller; and/or, in the case that the current-stage MIPI mode controller is not the first-stage MIPI mode controller, among the plurality of MIPI mode controllers connected in cascade, the current-stage MIPI mode controller has a display serial interface connected with a corresponding camera serial interface of the previous-stage MIPI mode controller, and the current-stage MIPI mode controller has a camera serial interface connected with a corresponding display serial interface of the previous-stage MIPI mode controller; the camera serial interface used for receiving the data packet transmitted by the camera in the first-stage MIPI mode controller is in a first unpacking mode, and the display serial interface used for transmitting the data packet to the display in the first-stage MIPI mode controller is in a first packing mode; among the adjacent two-stage MIPI mode controllers, in the case where the current-stage MIPI mode controller is not the last-stage MIPI mode controller, there is: when the current MIPI mode controller has a display serial interface in a first packet mode, a camera serial interface connected with the display serial interface in the first packet mode in the next MIPI mode controller is in a second packet unpacking mode; when the current MIPI mode controller has a display serial interface in a second packaging mode, a camera serial interface connected with the display serial interface in the second packaging mode is in a first unpacking mode in the next MIPI mode controller; and/or, in the case that the current-stage MIPI mode controller is not the first-stage MIPI mode controller among the adjacent two-stage MIPI mode controllers, there is: when a camera serial interface exists in the current-stage MIPI mode controller and is in a first unpacking mode, a display serial interface connected with the camera serial interface currently in the first unpacking mode in the previous-stage MIPI mode controller is in a second packing mode; when the prior-stage MIPI mode controller has a camera serial interface in a second unpacking mode, a display serial interface connected with the camera serial interface in the second unpacking mode is in a first packing mode in the prior-stage MIPI mode controller. Therefore, the data transmission control system establishes data transmission communication between the camera serial interfaces and the display serial interfaces of different MIPI mode controllers through the MIPI mode controllers connected in a cascade manner, solves the problem of data communication compatibility between the camera serial interface of one MIPI mode controller and the display serial interface of the other MIPI mode controller, expands batch processing of data in the MIPI mode controllers, and enriches application of the display module and the camera module in different scenes.

Drawings

Fig. 1 is a schematic diagram of a Data packet format uniformly specified by a DSI protocol and a CSI-2 protocol, wherein Data type definitions of Data IDs in short packet packets under the DSI protocol and the CSI-2 protocol are different; the Data type definition of the Data ID in the long packet is different in DSI protocol and CSI-2 protocol.

Fig. 2 is a schematic diagram of an interconnection test of a camera serial interface and a display serial interface of an MIPI mode controller according to the present application.

Fig. 3 is a schematic diagram of a data transmission system formed by interconnecting three MIPI mode controllers according to the present application, wherein the three MIPI mode controllers are cascaded three MIPI mode controllers, and a first stage MIPI mode controller, a second stage MIPI mode controller, and a third stage MIPI mode controller are sequentially arranged from top to bottom.

Detailed Description

The following describes the embodiments of the present application further with reference to the drawings. In the present application, unless explicitly specified and limited otherwise, the terms "mounted," "connected," "secured," and the like are to be construed broadly and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art according to the specific circumstances. The term "and/or" as used herein includes any and all combinations of one or more of the associated listed items.

Default MIPI (Mobile Industry Processor Interface ) is the most prevalent video transmission interface specification in the mobile world, MIPI CSI-2 (Mobile Industry Processor INTERFACE CAMERA SERIAL INTERFACE, MIPI alliance second generation camera serial interface, abbreviated CSI-2), MIPI DSI (Mobile Industry Processor INTERFACE DISPLAY SERIAL INTERFACE, MIPI alliance display serial interface, abbreviated DSI), where CSI-2 is mainly used for image access (typically camera sensor) and DSI is mainly used for image output (typically output to display screen).

Both DSI and CSI-2 have two modes of operation, low Power mode (LP) and high speed mode (HS, HIGH SPEED), to enable transmission of data and commands in the MIPI interface protocol layer. The initial state of DSI and CSI-2 are both the suspended transmission state in LP mode, and bulk data transmission is typically performed in HS mode. The DSI and the CSI-2 enter or exit the HS mode in the same control mode, and the transmission suspension state of the LP mode can be returned after the HS mode is exited. Under the prior art condition, although the physical layer standards adopted by the DSI and the CSI-2 are the same, the DSI protocol adopted by the DSI transmitting end and the CSI-2 protocol adopted by the CSI-2 receiving end are different to a certain extent, so that the CSI-2 receiving end cannot receive the high-speed data transmitted by the DSI transmitting end, namely the DSI transmitting end cannot transmit the data which is identified and received by the CSI-2 receiving end.

The data transmission of DSI and CSI-2 in HS mode adopts data packet format, and is divided into long data packet and short data packet. When the DSI sends data, the data is packed according to the information type and the content, so that the generation of the ECC code and the addition of the CRC code are completed. When the CSI-2 receives the data packet, the whole data packet is checked and corrected according to the ECC code and the CRC code, and decoding of a packet head (also called a data packet head) and data content is completed and is transmitted to an application layer. It should be noted that, once the receiver where CSI-2 is located reads the data payload, the end check code (ECC code and CRC code) of the data packet is read for checking.

As shown in fig. 1, there are two types of DSI and CSI-2 defined packets: short packets (short packets) and long packets (long packets) may also be understood as packets of both formats defined by the DSI protocol and the CSI-2 protocol. Both DSI and CSI-2 have 2 packet formats for transmitting short and long packets in HS mode. The data packet contains the following elements:

data ID: consists of a virtual channel identifier and a data type.

Word Count (WC): 2byte, representing a data length of 2 bytes, does not contain a checksum Check Sum.

Data: command or Data, data 0 and Data 1 in the short packet of fig. 1 are included when the command is represented, data 0, data 1, data WC-2 and Data WC-1 in the long packet of fig. 1 are included when the Data is represented.

ECC error correction code; error correction codes may be provided between Data 1 and EoT in the short packet of FIG. 1; error correction codes may also be provided between Word Count and Data 0 in the long packet of FIG. 1.

Check Sum: checking and correcting the checksum by matching with an error correction code; the Check Sum is arranged in the Packet trailer (PF) part of the long Packet of fig. 1, and occupies 16 bits wide in fig. 1.

LPS: the operation state in the low power mode is arranged at the first and last of a short packet (short packet) and a long packet (long packet).

SoT: the start signal is arranged behind the LPS at the first bit of the data packet and is adjacent to the LPS.

EoT: an end signal disposed before and adjacent to the LPS at the end of the data packet; in the long data packet, a packet head, valid data content and a packet tail are sequentially arranged between SoT and EoT; in short packets, only the header is set between SoT and EoT.

LPS, soT, and EoT represent different circuit timing states, respectively, when data is transferred.

The short packet is mainly used for transmitting commands and reading and writing register address information.

Long packets are mainly used for transmitting large amounts of image data or part of control commands.

Typically, long packets have a data length of 6 to 65541 bytes and include a 4byte header, 0 to 65535 bytes of valid data, and a 2byte trailer. The data length of the short data packet is 4byte, and only the data packet head is provided; where byte is a byte, 1 byte=8bit, and bit is a bit.

Comparing the data packet transmitted by DSI with the data packet transmitted by CSI-2, wherein the data packet is checked by ECC (error correction code) by adopting the same check algorithm, the data packet is checked by CRC (cyclic redundancy check) by adopting the same check algorithm, the definition of command codes of SoT is consistent, and the definition of command codes of EoT is consistent; the Data fields each represent the valid Data content of the transmission, with WC being accumulated in the long packet of fig. 1 and 2 being accumulated in the short packet of fig. 1; the Word Count fields each represent data length information and also represent a payload.

For Data ID, DSI and CSI-2 are defined differently for Data type ID_DT, which includes Data type ID_DT_DSI_ S, DSI of header command transmitted by DSI, data type ID_DT_DSI_ L, CSI-2 of header command transmitted by DSI_DT_CSI-2_S and Data type ID_DT_CSI-2_L of header command transmitted by CSI-2, the specific differences are as follows:

First, the header commands of the short data packets are different.

Illustratively, the data type ID_DT_DSI_S definition for the header command in the DSI transmitted short packet includes FRAME START:0x01; frame End 0x11; LINE START:0x21; line End 0x31; wherein FRAME START is a start command of a field sync header, frame End is an End command of the field sync header, LINE START is a start command of a Line sync header, and Line End is an End command of the Line sync header; the field sync header and the line sync header both belong to the header.

The definition of the data type ID_DT_CSI-2_S for the packet header command in the short data transmitted by the CSI-2 comprises FRAME START:0x00; frame End 0x01; LINE START:0x02; line End 0x03; wherein FRAME START is a start command of a field sync header, frame End is an End command of the field sync header, LINE START is a start command of a Line sync header, and Line End is an End command of the Line sync header; the field sync header and the line sync header both belong to the header.

Therefore, header commands in short packets that are supported for transmission by DSI and CSI-2 are mutually incompatible.

Secondly, the definition of the data type of the effective data content in the long data packet is different.

For example, the data type ID_DT_DSI_L definition for valid data content in a DSI transmitted long data packet includes YUV422 8-bit 0x1c; RGB565, 0x0e; the definition of the data type ID_DT_CSI-2_L of the effective data content in the long data packet transmitted by the CSI-2 comprises YUV422 8-bit and 0x1e; RGB565: 0x22.

A DATA type definition for the valid DATA content is recorded in the DATA ID; in long packets, the DATA ID is set in the header (PACKET HEADER, PH) portion of fig. 1, the valid DATA content represents the PACKET DATA (PayLoad) portion of fig. 1, and the valid DATA content may be represented by some or all of DATA 0, DATA 1, DATA WC-2, and DATA WC-1 of fig. 1, which is specifically determined according to the DATA encoding format.

Wherein YUV422 is an image encoding format; the Y component represents brightness for specifying the brightness perceived by the pixel; the U component and the V component respectively represent chromaticity and concentration, and are used for describing the colors and saturation of the image and specifying the colors of corresponding pixels; the image format is defined by using YUV422, which means that for 4 pixels, Y components need to be sampled 4 times, U components need to be sampled 2 times, and V components need to be sampled 2 times, on the basis, taking YUV422 8-bit as an example, each pixel point comprises 8bit Y components, 4bit U components and 4bit V components, so that each pixel point occupies 16bit space; the data type of the image data of the YUV422 8-bit format in the long data packet transmitted by the DSI is defined as 0x1c, and the data type of the image data of the YUV422 8-bit format in the long data packet transmitted by the CSI-2 is defined as 0x1e.

RGB565 represents an image color format, the first 5 bits of the low byte in the image data in RGB565 format are used to represent B (BLUE), the last three bits of the low byte + the first three bits of the high byte are used to represent G (Green), and the last 5 bits of the high byte are used to represent R (RED); the data type of RGB565 format image data in DSI transmitted long packets is defined as 0x0e, and the data type of YUV422 8-bit format image data in CSI-2 transmitted long packets is defined as 0x22.

Therefore, the DSI and CSI-2 support the data types of the valid data content in the transmitted long data packet, and the later data cannot be received and identified whenever the DSI or CSI-2 detects that the packet header of the long data packet is not compatible. Therefore, to realize the interconnection communication between DSI and CSI-2, the incompatibility problem between the 2 data packet types needs to be solved, so as to expand the interconnection application between the chip modules with CSI-2 receiving end or DSI transmitting end.

Aiming at the technical problems, the application discloses an MIPI mode controller, which is provided with a display serial interface and a camera serial interface, wherein the MIPI mode controller receives a data packet through the camera serial interface and also sends the data packet through the display serial interface; in the data transmission stage, the display serial interface and the camera serial interface are respectively used for packaging and unpacking the data to be processed acquired by the sensor, and the packaging and unpacking of the whole data packet, or the data type (the data type or the command type of valid data) of the packet header of the data packet is processed, or the format specification of the data packet is packaged or unpacked according to the DSI protocol, or the format specification of the data packet is packaged or unpacked by adopting the CSI-2 protocol, and the like, so as to overcome the compatibility problem, wherein the packaging of the data comprises the packaging of long data packets and short data packets, and the unpacking of the data packets comprises the unpacking of the long data packets and the short data packets; the application can also set a plurality of display serial interfaces and a plurality of camera serial interfaces according to the actual data processing requirement, and the number of the display serial interfaces and the number of the camera serial interfaces are not limited; in practical applications, the MIPI mode controller may be packaged into a chip, or separately used as an interface chip to externally draw out the display serial interface and the camera serial interface, or separately constitute a circuit device. The camera serial interface and the display serial interface both belong to the MIPI interface, and it can be understood that when the camera serial interface is the MIPI receiving port, the display serial interface is the MIPI transmitting port.

It should be noted that, the camera serial interface is a data receiving port of the MIPI mode controller, that is, the CSI receiving end, the original interface protocol that the camera serial interface follows is the CSI-2 protocol, which supports receiving and identifying the data packet under the CSI-2 protocol specification, and in the present application, the camera serial interface needs to accept the mode conversion to obtain compatibility with DSI. The display serial interface is a data transmitting port of the MIPI mode controller, namely the DSI transmitting end, the original interface protocol followed by the display serial interface is the DSI protocol, and the display serial interface supports to receive and identify the data packet under the DSI protocol specification, and in the application, the display serial interface needs to accept mode conversion to obtain the compatibility of CSI-2.

In the application, at least two unpacking modes and at least two packing modes are configured for the MIPI interface, wherein the unpacking modes and the packing modes are regarded as working modes of the MIPI interface, which are simply called MIPI modes, can be configured by a processor unit in an MIPI mode controller, can trigger the MIPI interface to enter the corresponding working modes by digital signals, and perform data processing according to a data transmission protocol corresponding to the working mode in the period corresponding to the working mode. In the present application, it is directly expressed that the MIPI mode controller configures various unpacking modes and various packing modes for the MIPI interface. The MIPI mode controller is configured with at least two packaging modes for the display serial interface, wherein the at least two packaging modes comprise a first packaging mode and a second packaging mode; the MIPI mode controller is configured with at least two unpacking modes for its camera serial interface, including a first unpacking mode and a second unpacking mode.

And the MIPI mode controller is used for configuring the camera serial interface of the MIPI mode controller to be in a first unpacking mode or a second unpacking mode so as to unpack the data packet received by the camera serial interface, wherein an interface protocol according to which the camera serial interface of the MIPI mode controller unpacks in the first unpacking mode is different from an interface protocol according to which the camera serial interface of the MIPI mode controller unpacks in the second unpacking mode.

The MIPI mode controller is further used for configuring the display serial interface of the MIPI mode controller to be in a first packing mode or a second packing mode so as to pack data to be sent in the display serial interface; the data to be transmitted is the data which is required to be transmitted by the display serial interface, and particularly the data which is required to be transmitted before data packaging is not carried out; the data to be transmitted can exist in the form of discrete data frames, and can also consist of long data packets and/or short data packets; the interface protocol according to which the display serial interface of the MIPI mode controller is packed in accordance with the first packing mode is different from the interface protocol according to which the display serial interface of the MIPI mode controller is packed in accordance with the second packing mode.

There are implementations for various packetization modes and various depacketization modes:

And the MIPI mode controller is used for packaging data to be transmitted according to the data type of the data packet specified by the DSI protocol when the display serial interface is configured to be in the first packaging mode to form the data packet conforming to the DSI protocol, so that the data to be transmitted in the display serial interface forms the data packet conforming to the DSI protocol, and the data packet is transmitted at least when the data type of the packet head is consistent with the data type specified by the DSI protocol and can be correctly identified by the display serial interface or the camera serial interface for unpacking according to the data type of the data packet specified by the DSI protocol.

It should be noted that, when the display serial interface is configured to be in the first packet mode, the MIPI mode controller is also considered to be in the first packet mode; the first packet mode is regarded as a conventional mode adopted by the display serial interface, and the Data to be transmitted can be a Data packet, and the Data ID of the Data packet respectively packs a short Data packet and a long Data packet according to the Data type of the DSI protocol specification. Specifically, the interface protocol according to which the display serial interface of the MIPI mode controller performs packaging in the first packet mode is the DSI protocol (which is the original interface protocol followed by the display serial interface), so as to package the data required to be transmitted by the display serial interface according to the data packet format specified by the DSI protocol, and may be to package the long data packet and/or the short data packet required to be transmitted by the display serial interface based on the command data type or the valid data type (valid data content, such as PACKET DATA part of the long data packet in fig. 1) of the packet header specified by the DSI protocol, so as to be identified by the display serial interface or the display module.

The MIPI mode controller is used for packing data to be transmitted according to the data type of the data packet specified by the CSI-2 protocol when the display serial interface is configured to be in the second packing mode, forming the data packet conforming to the CSI-2 protocol, enabling the data packet transmitted by the display serial interface to be identified by the camera serial interface, and enabling the data packet transmitted by the display serial interface to be consistent with the data type specified by the CSI-2 protocol at least in the data type of the packet header; if the data to be transmitted is not packed according to the data type of the data packet specified by the CSI-2 protocol and is regulated by the DSI protocol, the packing and transmitting operation performed in the second packing mode is equivalent to that performed by a data packet reorganizing circuit in the MIPI mode controller, the data to be transmitted is processed, the data to be transmitted is converted into a format which can be received and processed by a camera serial interface according to the CSI-2 protocol, and the data is reorganized and transmitted.

It should be noted that, when the display serial interface is configured to be in the second packaging mode, the MIPI mode controller is also considered to be in the second packaging mode; when in the second packing mode, the Data to be sent may be a Data packet, where the Data ID of the Data packet packs the short Data packet and the long Data packet according to the Data type of the CSI-2 protocol specification, respectively. The interface protocol according to which the display serial interface of the MIPI mode controller performs packaging in the second packaging mode is a CSI-2 protocol, so as to package data to be transmitted in the display serial interface according to a data packet format specified by the CSI-2 protocol, which may be a command data type based on a packet header specified by the CSI-2 protocol or a data type based on valid data (valid data content in the data packet, such as PACKET DATA part of content in a long data packet in fig. 1) of the data to be transmitted, so that the display serial interface may package the data to be transmitted according to the data type of the packet header specified by the CSI-2 protocol, so as to form a data packet capable of being recognized by the camera serial interface, and which conforms to the data type of the packet header specified by the CSI-2 protocol; the MIPI mode controller thus establishes communication between its own display serial interface and the camera serial interface based on the data type of the header specified by the CSI-2 protocol.

Schematically, when the display serial interface is used for packaging in the second packaging mode, the short data packet required to be sent by the DSI is packaged by adopting a predefined data type ID_DT_CSI-2_S, and the specific packaged data type is defined as FRAME START:0x00,Frame End:0x01,Line Start:0x02,Line End:0x03; rather than FRAME START: 0x01,Frame End:0x11,Line Start:0x21,Line End:0x31, which is unpacked based on the predefined data type id_dt_dsi_s. In addition, the long data packet required to be sent by the DSI is packed by adopting a predefined data type ID_DT_CSI-2_L, and the specific packed data type is defined as YUV422 8-bit, 0x1e, RGB565, 0x22; rather than the YUV422 8-bit to 0x1c, rgbg565 to 0x0e packed based on the predefined data type id_dt_dsi_l. Therefore, short data packets required to be sent by the DSI can be correctly identified by the CSI-2 after being packed by using the ID_DT_CSI-2_S, and long data packets required to be sent by the DSI can be correctly identified by the CSI-2 after being packed by using the ID_DT_CSI-2_L.

And the MIPI mode controller is used for unpacking the received data packet according to the data type of the data packet specified by the CSI-2 protocol when the camera serial interface is configured to be in the first unpacking mode, so that the unpacked data ID accords with the specification of the CSI-2 protocol on the identifier in the packet header, and the unpacked effective data and/or command accord with the specification of the CSI-2 protocol on the data packet.

It should be noted that, when the camera serial interface is configured to be in the first unpacking mode, the MIPI mode controller is also considered to be in the first unpacking mode; the first unpacking mode is regarded as a conventional mode adopted by the camera serial interface, and the Data ID of the received Data packet unpacks the short Data packet and the long Data packet according to the Data type of the CSI-2 protocol specification. Specifically, the interface protocol according to which the camera serial interface of the MIPI mode controller unpacks in the first unpacking mode is the CSI-2 protocol (which is the original interface protocol followed by the camera serial interface), so as to unpack the data packet received by the camera serial interface according to the data packet format specified by the CSI-2 protocol, which may be based on the command data type of the packet header specified by the CSI-2 protocol or the data type of the valid data (such as PACKET DATA part of the content in the long data packet in fig. 1) in the data packet, so as to unpack the data packet received by the camera serial interface, and then unpack the data packet received by the camera serial interface of the MIPI mode controller according to the data type of the packet header specified by the CSI-2 protocol transmitted by the external camera serial interface or the display serial interface, so as to facilitate identification of the camera serial interface of the MIPI mode controller.

The MIPI mode controller is used for unpacking the received data packets according to the data types of the data packets specified by the DSI protocol when the camera serial interface is configured to be in the second unpacking mode, so that the camera serial interface identifies the data packets sent by the display serial interface, and at least the data types of the data packets received by the camera serial interface are consistent with the data types specified by the DSI protocol in the data types of the packet heads; if the data type of the received data packet is in accordance with the specification of the CSI-2 protocol, the unpacking operation performed in the second unpacking mode is equivalent to the unpacking operation performed by the data packet reorganizing circuit in the MIPI mode controller, converting the received data packet into a format which can be processed by the display serial interface according to the DIS protocol requirement, and then determining that the camera serial interface can identify the data content and the command information in the received data packet according to the format of the display serial interface receiving process or the data type of the data packet specified by the DIS protocol.

It should be noted that, when the camera serial interface is configured to be in the second unpacking mode, the MIPI mode controller is also considered to be in the second unpacking mode; and when the second unpacking mode is adopted, the Data ID of the received Data packet unpacks the short Data packet and the long Data packet according to the Data type specified by the DIS protocol. The interface protocol according to which the camera serial interface of the MIPI mode controller unpacks according to the second unpacking mode is a DSI protocol, so that the unpacking of the data packet received by the camera serial interface is performed according to a data packet format specified by the DSI protocol, and the unpacking of the data packet received by the camera serial interface may be performed based on a command data type or a valid data type (valid data content in the data packet, such as PACKET DATA part of content in a long data packet in fig. 1) of a packet header specified by the DSI protocol, so that the camera serial interface may unpack the data packet under the DSI protocol specification transmitted by the display serial interface according to the data type of the packet header specified by the DSI protocol, so that the MIPI mode controller establishes communication between the camera serial interface and the display serial interface of itself based on the data type of the packet header specified by the DSI protocol.

Illustratively, when unpacking is performed in the second unpacking mode through the camera serial interface, the short data packet received by the CSI-2 is unpacked by adopting a predefined data type ID_DT_DSI_S, and the specific unpacked data type is defined as FRAME START: 0x01,Frame End:0x11,Line Start:0x21,Line End:0x31; rather than the FRAME START:0x00, frame end:0x01, line Start:0x02, line end:0x03 unpacked based on the predefined data type ID_DT_CSI-2_S. In addition, the long data packet received by the CSI-2 is unpacked by adopting a predefined data type ID_DT_DSI_L, and the specific unpacked data type is defined as YUV422 8-bit, 0x1c, RGB565, 0x0e; rather than the YUV422 8-bit to 0x1e, rgb565 to 0x22 unpacked based on the predefined data type id_dt_csi-2_l. Thereby enabling CSI-2 of the MIPI mode controller to correctly identify the data packets sent by the DSI. Therefore, the short data packet sent by the DSI can be correctly identified after the CSI-2 is unpacked by using the ID_DT_DSI_S, and the long data packet sent by the DSI can be correctly identified after the CSI-2 is unpacked by using the ID_DT_DSI_L.

Therefore, the data type obtained by the MIPI interface in the first packing mode or the first unpacking mode is the same as the data type corresponding to the original data transmission protocol followed by the MIPI interface, and the data type obtained by the MIPI interface in the second packing mode or the second unpacking mode is different from the data type corresponding to the original data transmission protocol followed by the MIPI interface; furthermore, the type of data obtained by the camera serial interface in the first unpacking mode is different from the type of data obtained by the camera serial interface in the second unpacking mode, and the type of data obtained by the display serial interface in the first packing mode is different from the type of data obtained by the display serial interface in the second packing mode.

In the foregoing embodiment, the MIPI mode controller is configured to determine, when the data ID in the data to be sent is configured as the type identifier of the header of the data packet specified by the CSI-2 protocol in the process of packaging the data to be sent, that the data to be sent is packaged into the data packet conforming to the CSI-2 protocol according to the data type of the data packet specified by the CSI-2 protocol, so as to be recognized by the camera serial interface; in fact, the Data to be transmitted may be regarded as a Data packet to be transmitted with a Data ID, and when the display serial interface of the MIPI mode controller converts the Data ID in the Data packet to be transmitted into a value conforming to the identifier specified by the CSI-2 protocol in the header in the second packaging mode, it is determined to package the Data to be transmitted into the Data packet conforming to the format specified by the CSI-2 protocol so as to be recognized by the camera serial interface.

The MIPI mode controller is used for determining the data type of the data packet regulated according to the DSI protocol to pack the data to be transmitted into the data packet conforming to the DSI protocol when the data ID in the data to be transmitted is configured as the type identifier of the packet head of the data packet regulated by the DSI protocol in the process of packing the data to be transmitted; in practice, the Data to be transmitted may be regarded as a Data packet to be transmitted with a Data ID, and when the display serial interface of the MIPI mode controller keeps the Data ID in the Data packet to be transmitted to a value conforming to the DSI protocol and specified by the identifier in the header in the first packet transmission mode, it is determined to package the Data to be transmitted into the Data packet conforming to the format specified by the DSI protocol. The Data to be sent carries a Data ID, namely a Data ID in the Data packet.

The MIPI mode controller is used for determining that the received data packet is completely unpacked according to the data type of the data packet regulated by the CSI-2 protocol when the unpacked data ID is configured as the type identifier of the packet head of the data packet regulated by the CSI-2 protocol in the unpacking process of the received data packet, and the camera serial interface identifies that the received data packet conforms to the CSI-2 protocol; in practice, when the data ID unpacked from the received data packet in the first unpacking mode by the camera serial interface of the MIPI mode controller is a value conforming to the CSI-2 protocol and specified by the identifier in the data packet header, it is determined that the camera serial interface correctly identifies the externally transmitted data packet conforming to the CSI-2 protocol.

The MIPI mode controller is used for determining that the received data packet is completely unpacked according to the data type of the data packet regulated by the DSI protocol when the unpacked data ID is configured as the type identifier of the packet head of the data packet regulated by the DSI protocol in the unpacking process of the received data packet, and the camera serial interface identifies that the received data packet conforms to the DSI protocol; in practice, when the data ID unpacked from the received data packet in the second unpacking mode by the camera serial interface of the MIPI mode controller is a value conforming to the DSI protocol and specified by the identifier in the data packet header, it is determined that the camera serial interface correctly recognizes the data packet conforming to the DSI protocol sent by the display serial interface. The received Data packet also carries a Data ID, namely, the Data ID in the Data packet.

In summary, the MIPI mode controller provides a packetizing or depacketizing mode for the camera serial interface and the display serial interface, respectively, to external interconnect communications, thereby being compatible with communications between DSI and CSI-2.

As an embodiment, the MIPI mode controller is provided with a first display serial interface, a second display serial interface, a first camera serial interface, and a second camera serial interface, although the MIPI mode controller may be provided with other display serial interfaces, camera serial interfaces, and bus interfaces. As shown in fig. 2, the first display serial interface uses a 1_dsi representation of the MIPI mode controller and the second display serial interface uses a 2_dsi representation of the MIPI mode controller. Among the at least two camera serial interfaces provided, there are a first camera serial interface using 1_csi-2 representation of the MIPI mode controller and a second camera serial interface using 2_csi-2 representation of the MIPI mode controller, as shown in fig. 2.

The first display serial interface of the MIPI mode controller is connected with the first camera serial interface of the MIPI mode controller, the second display serial interface of the MIPI mode controller is connected with the second camera serial interface of the MIPI mode controller, as shown in figure 2, in one MIPI mode controller, the first display serial interface 1_DSI is connected with the first camera serial interface 1_CSI-2, and the second display serial interface 2_DSI is connected with the second camera serial interface 2_CSI-2, so that an interconnection loop of different types of MIPI interfaces of the MIPI mode controller is formed, automatic testing of the interconnected first display serial interface and the first camera serial interface is supported, and automatic testing of the interconnected second display serial interface and the second camera serial interface is also supported. As can be seen from fig. 2, the first display serial interface is configured in the second packing mode to support packing the first test data into data packets conforming to the CSI-2 protocol, and the first camera serial interface is configured in the first unpacking mode to support unpacking the data packets according to the CSI-2 protocol, so that the first camera serial interface recognizes the data packets sent by the first display serial interface according to the data types of the data packets specified by the CSI-2 protocol, and also can be understood that the first display serial interface sends the data packets which can be correctly recognized by the first camera serial interface in the first unpacking mode in the second packing mode.

The first display serial interface is configured in a first packet mode to support the packaging of the first test data into data packets conforming to the DSI protocol, the first camera serial interface is configured in a second packet mode to support the unpacking of the data packets according to the DSI protocol, the first camera serial interface is enabled to identify the data packets sent by the first display serial interface according to the data types of the data packets specified by the DSI protocol, and the first display serial interface can also be understood as sending out the data packets which can be correctly identified by the first camera serial interface in the second packet mode in the first packet mode.

The second display serial interface is configured to be in a first packet-unpacking mode to support packing second test data into data packets conforming to the DSI protocol, and the second camera serial interface is configured to be in a second packet-unpacking mode to support unpacking the data packets according to the DSI protocol, so that the second camera serial interface identifies the data packets sent by the second display serial interface in the first packet-unpacking mode according to the data types of the data packets specified by the DSI protocol in the second packet-unpacking mode.

The second display serial interface is configured to be in a second packaging mode to support packaging second test data into data packets conforming to the CSI-2 protocol, and the second camera serial interface is configured to be in a first unpacking mode to support unpacking the data packets according to the CSI-2 protocol, so that the second camera serial interface can identify the data packets sent by the second display serial interface in the second packaging mode according to the data types of the data packets specified by the CSI-2 protocol in the first unpacking mode.

It should be noted that the first test data and the second test data may be the same, and each of the first test data and the second test data may be a data packet or a discrete data packet.

Or not shown in fig. 2, the first display serial interface of the MIPI mode controller is connected with the second camera serial interface of the MIPI mode controller, and the second display serial interface of the MIPI mode controller is connected with the first camera serial interface of the MIPI mode controller, so as to form another interconnection loop of different types of MIPI interfaces of the MIPI mode controller, support automatic testing of the interconnected first display serial interface and second camera serial interface, and also support automatic testing of the interconnected second display serial interface and first camera serial interface.

The first display serial interface is configured to be in a second packing mode to support packing the first test data into data packets conforming to the CSI-2 protocol, the second camera serial interface is configured to be in a first unpacking mode to support unpacking the data packets according to the CSI-2 protocol, and the second camera serial interface can be used for identifying the data packets sent by the first display serial interface according to the data types of the data packets specified by the CSI-2 protocol, and can also be understood as enabling the first display serial interface to send out the data packets which can be correctly identified by the second camera serial interface.

The first display serial interface is configured in a first packet mode to support the packaging of the first test data into data packets conforming to the DSI protocol, the second camera serial interface is configured in a second packet mode to support the unpacking of the data packets according to the DSI protocol, and the second camera serial interface recognizes the data packets sent by the first display serial interface according to the data types of the data packets specified by the DSI protocol, which can also be understood as having the first display serial interface send out the data packets that enable the second camera serial interface to recognize correctly.

The second display serial interface is configured to be in a first packet mode to support the packaging of the second test data into data packets conforming to the DSI protocol, the first camera serial interface is configured to be in a second packet unpacking mode to support the unpacking of the data packets according to the DSI protocol, the first camera serial interface is enabled to identify the data packets sent by the second display serial interface according to the data types of the data packets specified by the DSI protocol, and the second display serial interface is also enabled to send out the data packets which enable the first camera serial interface to identify correctly.

The second display serial interface is configured to be in a second packing mode to support packing second test data into data packets conforming to the CSI-2 protocol, the first camera serial interface is configured to be in a first unpacking mode to support unpacking the data packets according to the CSI-2 protocol, the first camera serial interface can recognize the data packets sent by the second display serial interface according to the data types of the data packets specified by the CSI-2 protocol, and the second display serial interface can also be understood as sending out the data packets which can be correctly recognized by the first camera serial interface.

Therefore, in the same MIPI mode controller, the data package transmission function test is carried out on the first display serial interface and the second display serial interface in the first package mode and the second package mode, and the data package transmission function test is carried out on the first camera serial interface and the second camera serial interface in the first package mode and the second package mode.

In addition, through the interconnection of the camera serial interface and the display serial interface, various interconnection loops of different types of MIPI interfaces are formed, and the function test can be carried out on the camera serial interface and the display serial interface without an external conversion chip circuit, including the packaging and unpacking of data packets in corresponding modes; the test mode of each MIPI interface of a single MIPI mode controller is flexible and low in cost, the influence of the hardware limitation of a processor chip on the data transmission capacity can be reduced, and the design difficulty of hardware is reduced.

Under the condition that a first display serial interface of the MIPI mode controller is connected with a first camera serial interface of the MIPI mode controller, the MIPI mode controller is used for configuring the first display serial interface to enter a second packaging mode to package first test data according to a CSI-2 protocol, namely the first display serial interface adopts a data type of a packet header specified by the CSI-2 protocol to reorganize and package the first test data in the second packaging mode, packages the data according to the information type and the content, adds Check information such as an ECC code, a CRC code, a Check Sum and the like, and the Check information is preset until the configuration of the Check information is completed, forms a first data packet to be verified, and sends the first data packet to the first camera serial interface of the same MIPI mode controller through the first display serial interface; the MIPI mode controller is further configured to configure the first camera serial interface to enter a first unpacking mode to unpack the first data packet to be verified according to the CSI-2 protocol, namely, the first camera serial interface receives the first data packet to be verified in the first unpacking mode and unpacks the first data packet to be verified according to the data type of the data packet specified by the CSI-2 protocol, unpacks the first data packet to be verified by adopting the data type of the packet header specified by the CSI-2 protocol in the unpacking process until the first data packet to be verified is successfully verified by using the verification information, and after unpacking of the first data packet to be verified is completed, the first camera serial interface of the same MIPI mode controller is determined to correctly identify the first data packet to be verified, and the function verification success of the second packing mode and the first unpacking mode is determined, and the function test success of the interconnected first display serial interface and the first camera serial interface is determined.

It should be noted that, the process of unpacking the data packet is also equivalent to the decoding or decoding process, once the camera serial interface reads the valid data content in the data packet, it reads the verification information of the packet tail of the data packet, and can use the verification information to verify the data packet, including error detection and error correction, to complete decoding of the packet header and valid data content of the data packet and reasonably transmit the decoded data content to the application layer.

Under the condition that a second display serial interface of the MIPI mode controller is connected with a second camera serial interface of the MIPI mode controller, the MIPI mode controller is used for configuring the second display serial interface to enter a first packet-forming mode to form second test data according to a DSI protocol, namely the second display serial interface adopts a data type of a packet head specified by the DSI protocol to reorganize and form the second test data in the first packet-forming mode, the data is packaged according to the information type and the content, and Check information such as an ECC code, a CRC code, a Check Sum and the like is added, and is preset until the configuration of the Check information is completed, a second data packet to be verified is formed, and the second test data is sent to a second camera serial interface of the same MIPI mode controller through the second display serial interface; the MIPI mode controller is further configured to configure the second camera serial interface to enter a second unpacking mode to unpack the second data packet to be verified according to the DSI protocol, that is, the second camera serial interface receives the second data packet to be verified in the second unpacking mode and unpacks the second data packet to be verified according to the data type of the data packet specified by the DSI protocol until the second data packet to be verified is successfully verified by using the verification information, and the unpacking of the second data packet to be verified is completed, then it is determined that the second camera serial interface correctly identifies the second data packet to be verified, and it is determined that the function verification of the first unpacking mode and the second unpacking mode is successful, and it is determined that the function test of the interconnected second display serial interface and the second camera serial interface is successful.

In summary, in the process of testing each camera serial interface and each display serial interface of the MIPI mode controller, first test data is sent to the first camera serial interface through the first display serial interface, wherein the first display serial interface enters a second packaging mode to package a first data packet to be verified, the first camera serial interface enters a first unpacking mode to unpack and check based on preset check information, and when the check is successful, the first camera serial interface is determined to correctly identify the data packet sent by the first display serial interface. And the second test data are sent to the second camera serial interface through the second display serial interface, wherein the second display serial interface enters a first packing mode to pack a second data packet to be verified, the second camera serial interface enters a second unpacking mode to unpack and check based on preset check information, and when the check is successful, the second camera serial interface is determined to correctly identify the data packet sent by the second display serial interface. Therefore, the MIPI mode controller configures two display serial interfaces to enter a first packing mode and a second packing mode respectively, configures two camera serial interfaces to enter a second packing mode and a first packing mode respectively, respectively verifies packing functions of the MIPI interfaces of the display serial interfaces in the first packing mode and the second packing mode and unpacking functions of the MIPI interfaces of the camera serial interfaces in the second packing mode and the first packing mode, and achieves self-testing capability of the MIPI mode controller on data transmission functions of the MIPI interfaces of the camera serial interfaces.

In addition, under the condition that a first display serial interface of the MIPI mode controller is connected with a second camera serial interface of the MIPI mode controller, the MIPI mode controller is used for configuring the first display serial interface to enter a second packaging mode to package first test data according to a CSI-2 protocol, namely, the first display serial interface adopts a data type of a packet head specified by the CSI-2 protocol to reorganize and package the first test data in the second packaging mode, packages the data according to the information type and the content, adds Check information such as an ECC code, a CRC code, a Check Sum and the like, and the Check information is preset until the configuration of the Check information is completed, forms a first data packet to be verified, and sends the first data packet to a second camera serial interface of the same MIPI mode controller through the first display serial interface; the MIPI mode controller is further configured to configure the second camera serial interface to enter a first unpacking mode to unpack the first data packet to be verified according to the CSI-2 protocol, namely, the second camera serial interface receives the first data packet to be verified in the first unpacking mode and unpacks the first data packet to be verified according to the data type of the data packet specified by the CSI-2 protocol, unpacks the first data packet to be verified by adopting the data type of the packet header specified by the CSI-2 protocol in the unpacking process until the first data packet to be verified is successfully verified by using the verification information, and after unpacking of the first data packet to be verified is completed, the second camera serial interface of the same MIPI mode controller is determined to correctly identify the first data packet to be verified, and the function verification success of the second packing mode and the first unpacking mode is determined, and the function test success of the first display serial interface and the second camera serial interface which are interconnected is determined.

Under the condition that a second display serial interface of the MIPI mode controller is connected with a first camera serial interface of the MIPI mode controller, the MIPI mode controller is used for configuring the second display serial interface to enter a first packet mode to pack second test data according to a DSI protocol, namely, the second display serial interface packs the second test data in a reorganization mode by adopting a data type of a packet head specified by the DSI protocol in the first packet mode, packs the data according to the information type and the content, adds Check information such as an ECC code, a CRC code, a Check Sum and the like, and the Check information is preset until the configuration of the Check information is completed, forms a second data packet to be verified, and sends the second data packet to the first camera serial interface of the same MIPI mode controller through the second display serial interface; the MIPI mode controller is further configured to configure the first camera serial interface to enter a second unpacking mode to unpack the second data packet to be verified according to the DSI protocol, that is, the first camera serial interface receives the second data packet to be verified in the second unpacking mode and unpacks the second data packet to be verified according to the data type of the data packet specified by the DSI protocol until the second data packet to be verified is successfully verified by using the verification information, unpacking the second data packet to be verified is completed, then it is determined that the first camera serial interface correctly identifies the second data packet to be verified, and it is determined that the functional verification of the first unpacking mode and the second unpacking mode is successful, and it is determined that the functional test of the interconnected second display serial interface and the first camera serial interface is successful.

In the process of testing each camera serial interface and each display serial interface of the MIPI mode controller, first test data are sent to a second camera serial interface through the first display serial interface, wherein the first display serial interface enters a second packaging mode to package a first data packet to be verified, the second camera serial interface enters a first unpacking mode to unpack and check based on preset check information, and when the check is successful, the second camera serial interface is determined to correctly identify the data packet sent by the first display serial interface. And the first camera serial interface enters a second unpacking mode to unpack and performs verification based on preset verification information, and when the verification is successful, the first camera serial interface is determined to correctly identify the data packet sent by the second display serial interface. In summary, the MIPI mode controller configures two display serial interfaces to enter a second packing mode and a first packing mode respectively, and configures two camera serial interfaces to enter a first unpacking mode and a second unpacking mode respectively, so as to verify the packing function of the MIPI interfaces such as the display serial interfaces in the first packing mode and the second packing mode and the unpacking function of the MIPI interfaces such as the camera serial interfaces in the second unpacking mode and the first unpacking mode respectively, thereby realizing the self-testing capability of the MIPI mode controller on the data transmission function of the MIPI interfaces.

Based on the foregoing embodiments, the present application also discloses a data transmission control system, where the data transmission control system includes at least two MIPI mode controllers disclosed in the foregoing embodiments, and a camera serial interface of one MIPI mode controller is connected to a display serial interface of another MIPI mode controller; each MIPI mode controller may be provided with a plurality of camera serial interfaces and a plurality of display serial interfaces. On this basis, the camera serial interface of the other MIPI mode controller may be connected to the display serial interface of one of the MIPI mode controllers.

In practical applications, each MIPI mode controller may be packaged in a chip, or may be used as an interface chip to externally lead out a display serial interface and a camera serial interface, or may all constitute a circuit device. The camera serial interface and the display serial interface belong to MIPI interfaces, wherein each MIPI mode controller receives data packets through the camera serial interface and also sends the data packets through the display serial interface.

When the camera serial interface of one MIPI mode controller is in a first unpacking mode, the display serial interface of the other MIPI mode controller is in a second packing mode, so that the display serial interface of the other MIPI mode controller packs data to be transmitted according to a CSI-2 protocol and transmits the data packets to the camera serial interface of the one MIPI mode controller, the camera serial interface of the one MIPI mode controller receives the data packets transmitted by the display serial interface and unpacks the received data packets according to the CSI-2 protocol, and the camera serial interface of the one MIPI mode controller correctly recognizes the data packets transmitted by the display serial interface of the other MIPI mode controller or the display serial interface of the other MIPI mode controller transmits the data packets which can be recognized by the camera serial interface of the one MIPI mode controller.

When the camera serial interface of one MIPI mode controller is in a second unpacking mode, the display serial interface of the other MIPI mode controller is in a first packing mode, so that the display serial interface of the other MIPI mode controller packs data to be transmitted according to a DSI protocol and sends the data packets to the camera serial interface of the one MIPI mode controller, the camera serial interface of the one MIPI mode controller receives the data packets sent by the display serial interface and unpacks the received data packets according to the DSI protocol, and the purpose that the camera serial interface of the one MIPI mode controller correctly recognizes the data packets sent by the display serial interface of the other MIPI mode controller is achieved, or the display serial interface of the other MIPI mode controller sends the data packets which can be recognized by the camera serial interface of the one MIPI mode controller is achieved.

One of the MIPI mode controllers may be referred to as a first MIPI mode controller and the other MIPI mode controller may be referred to as a first MIPI mode controller and a second MIPI mode controller.

Specifically, the interface protocol according to which the camera serial interface of the first MIPI mode controller unpacks in the first unpacking mode is a CSI-2 protocol (which is an original interface protocol followed by the camera serial interface), so that the data packet received by the camera serial interface is unpacked according to a data packet format specified by the CSI-2 protocol, which may be a command data type of a packet header specified by the CSI-2 protocol or a data type of valid data (valid data content in the data packet, such as PACKET DATA part of the long data packet in fig. 1) to unpack the data packet received by the camera serial interface of the first MIPI mode controller, and then the first MIPI mode controller may unpack the data packet under the CSI-2 protocol specification, which is transmitted by the display serial interface of the second MIPI mode controller in a packed manner, according to the data type of the packet header specified by the CSI-2 protocol, so as to form data that the camera serial interface of the MIPI mode controller can recognize in the first unpacking mode.

The interface protocol according to which the camera serial interface of the first MIPI mode controller unpacks according to the second unpacking mode is a DSI protocol, so that the data packet received by the camera serial interface of the first MIPI mode controller is unpacked according to a data packet format specified by the DSI protocol, and the data packet received by the camera serial interface may be unpacked based on a command data type of a packet header specified by the DSI protocol or a data type of valid data (valid data content in the data packet, such as PACKET DATA part of content in a long data packet in fig. 1), so that the first MIPI mode controller can unpack the data packet under the DSI protocol specification transmitted by the display serial interface of the second MIPI mode controller according to the data type of the packet header specified by the DSI protocol, and the camera serial interface of the first MIPI mode controller and the display serial interface of the second MIPI mode controller establish data communication based on the data type of the packet header specified by the DSI protocol.

Specifically, the interface protocol according to which the display serial interface of the second MIPI mode controller performs packaging in the first packet mode is a DSI protocol (which is an original interface protocol followed by the display serial interface), so as to package data to be transmitted by the display serial interface according to a data packet format specified by the DSI protocol, and may be that long data packets and/or short data packets to be transmitted by the display serial interface are packaged based on a command data type or a valid data type (a valid data content in a data packet, such as a PACKET DATA part of a long data packet in fig. 1) of a packet header specified by the DSI protocol, so that the second MIPI mode controller may package data to be transmitted by the display serial interface according to the data type of the packet header specified by the DSI protocol and transmit the packaged data to the camera serial interface of the first MIPI mode controller, so as to be recognized by the camera serial interface of the first MIPI mode controller to perform unpacking in the second unpacking mode.

The interface protocol according to which the display serial interface of the second MIPI mode controller performs packaging in the second packaging mode is a CSI-2 protocol, so as to package data to be transmitted in the display serial interface according to a data packet format specified by the CSI-2 protocol, which may be a command data type of a packet header specified by the CSI-2 protocol or a data type of valid data (valid data content in the data packet, such as PACKET DATA part of content in a long data packet in fig. 1) to package the data to be transmitted, so that the second MIPI mode controller may package the data to be transmitted according to the data type of the packet header specified by the CSI-2 protocol, so as to form a data packet that can be recognized by the camera serial interface of the first MIPI mode controller and send the data packet to the camera serial interface of the first MIPI mode controller; the camera serial interface of the first MIPI mode controller thereby establishes data communication with the display serial interface of the second MIPI mode controller based on the data type of the header specified by the CSI-2 protocol.

As an embodiment, the application also discloses a data transmission control system, which comprises a plurality of MIPI mode controllers disclosed in the previous embodiment; in the data transmission control system, a plurality of MIPI mode controllers are connected in cascade, and at least three MIPI mode controllers exist among the MIPI mode controllers connected in cascade in the present application to form an interconnection structure among the MIPI mode controllers, for example, after the first stage MIPI mode controller in fig. 3 receives an image to be processed provided by a camera through a 1_csi-2 interface, the data transmission control system may divide the image to be processed into 3 blocks, each stage MIPI mode controller processes 1 block of image data, and the second stage MIPI mode controller and the third stage MIPI mode controller process the corresponding allocated 1 block of image data respectively. The space for distributed storage of the data to be processed is expanded, the data processing capacity is increased, and the data processing scale of the system is further improved.

In the disclosed data transmission control system of this embodiment, among a plurality of MIPI mode controllers that are cascade-connected, two MIPI mode controllers that are directly connected are a current-stage MIPI mode controller and a next-stage MIPI mode controller, respectively, and/or two MIPI mode controllers that are directly connected are a previous-stage MIPI mode controller and a current-stage MIPI mode controller, respectively, to constitute two adjacent-stage MIPI mode controllers, corresponding to fig. 3, a first-stage MIPI mode controller and a second-stage MIPI mode controller are a previous-stage MIPI mode controller and a current-stage MIPI mode controller, respectively, and a second-stage MIPI mode controller and a third-stage MIPI mode controller are a current-stage MIPI mode controller and a next-stage MIPI mode controller, respectively; wherein, the upper MIPI mode controller, the current MIPI mode controller and the lower MIPI mode controller are interconnected from small to large according to the number of stages, which corresponds to the connection sequence from top to bottom in FIG. 3.

Among a plurality of MIPI mode controllers connected in cascade, each MIPI mode controller is provided with a display serial interface and a camera serial interface; and under the condition that the current-stage MIPI mode controller is not the last-stage MIPI mode controller, the current-stage MIPI mode controller is provided with a display serial interface connected with a corresponding camera serial interface of the next-stage MIPI mode controller, and the current-stage MIPI mode controller is provided with a camera serial interface connected with a corresponding display serial interface of the next-stage MIPI mode controller. And/or, in the case that the current-stage MIPI mode controller is not the first-stage MIPI mode controller among the cascade-connected MIPI mode controllers, the current-stage MIPI mode controller has a display serial interface connected with the corresponding camera serial interface of the previous-stage MIPI mode controller, and the current-stage MIPI mode controller has a camera serial interface connected with the corresponding display serial interface of the previous-stage MIPI mode controller.

And under the condition that the current-stage MIPI mode controller is not the first-stage MIPI mode controller and the current-stage MIPI mode controller is not the last-stage MIPI mode controller, one display serial interface of the current-stage MIPI mode controller is connected with one camera serial interface of the next-stage MIPI mode controller, the other display serial interface of the current-stage MIPI mode controller is connected with one camera serial interface of the previous-stage MIPI mode controller, one camera serial interface of the current-stage MIPI mode controller is connected with one display serial interface of the next-stage MIPI mode controller, and the other camera serial interface of the current-stage MIPI mode controller is connected with one display serial interface of the previous-stage MIPI mode controller.

The first-stage MIPI mode controller is provided with a camera serial interface which is connected with an external camera; the first-stage MIPI mode controller is used for receiving a current batch of data packets through a camera serial interface of the first-stage MIPI mode controller, and at the moment, unpacking the current batch of data packets in a first unpacking mode to obtain effective image data; the current data packets come from an external camera and also represent data packets of single-frame image signals or multi-frame image signals. The first-stage MIPI mode controller is provided with a display serial interface which is connected with an external display screen; and the first-stage MIPI mode controller is used for sending data packets to the display screen through the display serial interface of the first-stage MIPI mode controller, and at the moment, the first-stage MIPI mode controller is used for selectively entering a first packing mode to pack data to be sent. Therefore, the camera serial interface in the first stage MIPI mode controller for receiving the data packets transmitted by the camera is in the first unpacking mode, and the display serial interface in the first stage MIPI mode controller for sending the data packets to the display is in the first packing mode.

In an actual data transmission scene, the data transmission control system is positioned at a high-speed serial interface between the camera module and the display module (such as a liquid crystal display screen); in general, the display module is connected with the display serial interface but not directly communicated with the camera serial interface, and the camera is communicated with the camera serial interface; the image signals acquired by the camera are received through the camera serial interface and then displayed on the display screen through the display serial interface.

Among the MIPI mode controllers, the interface protocol according to which the camera serial interface is in the first unpacking mode for unpacking is the same as the interface protocol according to which the display serial interface of the same MIPI mode controller is in the second packing mode for packing; the type of data obtained when the camera serial interface is in the first unpacking mode is the same as the type of data obtained when the display serial interface is in the second packing mode. The interface protocol according to which the camera serial interface is in the second unpacking mode for unpacking is the same as the interface protocol according to which the display serial interface of the same MIPI mode controller is in the first packing mode, and the data type obtained when the camera serial interface is in the second unpacking mode is the same as the data type obtained when the display serial interface is in the first packing mode.

It should be noted that, when the MIPI interface is in the first unpacking mode or the first packing mode, the obtained data type is the same as the data type specified corresponding to the original data transmission protocol followed by the MIPI interface itself; the data type obtained when the MIPI interface is in the second unpacking mode or the second packing mode is different from the data type specified corresponding to the original data transmission protocol followed by the MIPI interface; the MIPI interface is a camera serial interface or a display serial interface; the type of data obtained when the camera serial interface is in the first unpacking mode is different from the type of data obtained when the camera serial interface is in the second unpacking mode, and the type of data obtained when the display serial interface is in the first packing mode is different from the type of data obtained when the display serial interface is in the second packing mode.

Among the adjacent two-stage MIPI mode controllers, in the case where the current-stage MIPI mode controller is not the last-stage MIPI mode controller, there is:

when the current MIPI mode controller has a display serial interface in a first packet mode, a camera serial interface connected with the display serial interface in the first packet mode in the next MIPI mode controller is in a second packet unpacking mode;

The first-stage MIPI mode controller is used for receiving and unpacking a current data packet from the camera serial interface when the camera serial interface is in a first unpacking mode, packing a next data packet when the display serial interface is in the first unpacking mode, and sending the next data packet to the camera serial interface of the next-stage MIPI mode controller through the display serial interface, so that the next-stage MIPI mode controller can conveniently identify the next data packet by configuring a second unpacking mode. When the current MIPI mode controller is not the first MIPI mode controller and the current MIPI mode controller is not the last MIPI mode controller, the current MIPI mode controller is used for receiving and unpacking the current data packet from the camera serial interface when the camera serial interface is in the second unpacking mode, packing the next data packet when the display serial interface is in the first unpacking mode and sending the next data packet to the camera serial interface of the next MIPI mode controller through the display serial interface, so that the next data packet is updated to the current data packet in the next MIPI mode controller, and the next MIPI mode controller can also be updated to the current MIPI mode controller, so that the next MIPI mode controller can identify the next data packet by configuring the second unpacking mode to the camera serial interface; wherein, the next data packet is derived from the original current data packet, and the data volume of the original current data packet is larger than the data volume of the next data packet; the original current data packet is processed by separating partial data in the current MIPI mode controller, and the rest data packet is packed into the next data packet to be sent to the next MIPI mode controller for processing, so that the data processing capacity of the current MIPI mode controller is shared, and the overall processing efficiency of the system is improved.

Schematically, when the CSI-2 interface of the next-stage MIPI mode controller needs to identify image data which is transmitted by the DSI interface of the current-stage MIPI mode controller and meets the DSI protocol specification, the DSI interface of the current-stage MIPI mode controller is configured to be in a first packet mode, and then the current-stage MIPI mode controller packets according to the DSI protocol; the CSI-2 interface of the next stage MIPI mode controller needs to be configured into a second unpacking mode, and unpacking is carried out on the received data according to a DSI protocol, so that the identification of the image data meeting the DSI protocol specification in the CSI-2 interface is realized. Thus, the current MIPI mode controller is allocated and correctly recognizes the current data packet, and the next MIPI mode controller is allocated and correctly recognizes the next data packet.

When one display serial interface exists in the current MIPI mode controller and is in the second packaging mode, a camera serial interface connected with the display serial interface currently in the second packaging mode in the next MIPI mode controller is in the first unpacking mode.

The first-stage MIPI mode controller is used for receiving and unpacking a current data packet from the camera serial interface when the camera serial interface is in a first unpacking mode, packing a next data packet when the display serial interface is in a second packing mode, and sending the next data packet to the camera serial interface of the next-stage MIPI mode controller through the display serial interface, so that the next-stage MIPI mode controller can conveniently identify the next data packet by configuring the first unpacking mode. When the current MIPI mode controller is not the last MIPI mode controller and the current MIPI mode controller is not the first MIPI mode controller, the current MIPI mode controller is used for receiving and unpacking a current data packet from the camera serial interface when the camera serial interface is in a first unpacking mode, packing a next data packet when the display serial interface is in a second packing mode, and sending the next data packet to the camera serial interface of the next MIPI mode controller through the display serial interface, so that the next data packet is updated to the current data packet in the next MIPI mode controller, and the next MIPI mode controller can also be updated to the current MIPI mode controller, so that the next MIPI mode controller can identify the next data packet by configuring the first unpacking mode for the camera serial interface; wherein, the next data packet is derived from the original current data packet, and the data volume of the original current data packet is larger than the data volume of the next data packet; the original current data packet is processed by separating partial data in the current MIPI mode controller, and the rest data packet is packed into the next data packet to be sent to the next MIPI mode controller for processing, so that the data processing capacity of the current MIPI mode controller is shared, and the overall processing efficiency of the system is improved.

Schematically, when the DSI interface of the current-stage MIPI mode controller needs to package and transmit the image data of the CSI-2 protocol specification to the CSI-2 interface of the next-stage MIPI mode controller, the DSI interface of the current-stage MIPI mode controller is configured to be in the second package mode, and then the current-stage MIPI mode controller packages according to the CSI-2 protocol; when the CSI-2 interface of the next-stage MIPI mode controller needs to receive image data, the CSI-2 interface of the next-stage MIPI mode controller is configured into a first unpacking mode to receive data packets conforming to a CSI-2 protocol. Thus, the current MIPI mode controller is allocated and correctly recognizes the current data packet, and the next MIPI mode controller is allocated and correctly recognizes the next data packet.

And/or, in the case that the current-stage MIPI mode controller is not the first-stage MIPI mode controller among the adjacent two-stage MIPI mode controllers, there is:

when the prior-stage MIPI mode controller has a camera serial interface in a first unpacking mode, a display serial interface connected with the camera serial interface in the first unpacking mode is in a second packing mode in the prior-stage MIPI mode controller.

The last-stage MIPI mode controller is used for receiving and unpacking a current batch of data packets from the camera serial interface when the camera serial interface is in a first unpacking mode, packing a batch of result information packets when the display serial interface is in a second packing mode, and sending the result information packets to the camera serial interface of the last-stage MIPI mode controller through the display serial interface, so that the last-stage MIPI mode controller can identify the result information packets by configuring a first unpacking mode for the camera serial interface; it will be appreciated that a batch of result packets is updated to the current batch of packets, although the previous stage MIPI mode controller may also be updated to the current stage MIPI mode controller to facilitate identifying the batch of result packets by configuring the first unpacking mode. The batch of result packets may be identified by the upper MIPI mode controller and packaged with the results of its processing to continue to the camera serial interface of the upper MIPI mode controller until sent by the first MIPI mode controller to the display screen.

When the prior-stage MIPI mode controller has a camera serial interface in a second unpacking mode, a display serial interface connected with the camera serial interface in the second unpacking mode is in a first packing mode in the prior-stage MIPI mode controller.

The last-stage MIPI mode controller is used for receiving and unpacking a current batch of data packets from the camera serial interface when the camera serial interface is in the second unpacking mode, packing a batch of result information packets when the display serial interface is in the first unpacking mode, and sending the result information packets to the camera serial interface of the last-stage MIPI mode controller through the display serial interface, so that the last-stage MIPI mode controller can identify the result information packets by configuring the second unpacking mode for the camera serial interface; it will be appreciated that a batch of result packets may be updated to the current batch of packets, although the previous stage MIPI mode controller may also be updated to the current stage MIPI mode controller to facilitate identifying the batch of result packets by configuring the second unpacking mode. The batch of result packets may be identified by the upper MIPI mode controller and packaged with the results of its processing to continue to the camera serial interface of the upper MIPI mode controller until sent by the first MIPI mode controller to the display screen.

In summary, the data transmission control system disclosed in this embodiment establishes data transmission communication between the camera serial interfaces and the display serial interfaces of different MIPI mode controllers through a plurality of MIPI mode controllers connected in cascade, overcomes the problem of compatibility of data communication between the camera serial interface of one MIPI mode controller and the display serial interface of another MIPI mode controller, expands batch processing of data in the plurality of MIPI mode controllers, and enriches application of the display module and the camera module in different scenes.

On the basis of the embodiment, a MIPI interface connection mode between different MIPI mode controllers is also disclosed. Among the cascade-connected MIPI mode controllers, the MIPI mode controllers except the last stage MIPI mode controller are provided with at least two display serial interfaces and at least two camera serial interfaces; for the same MIPI mode controller, a first display serial interface and a second display serial interface exist in at least two display serial interfaces, and as shown in FIG. 3, the first-stage MIPI mode controller, the second-stage MIPI mode controller and the third-stage MIPI mode controller are provided with a first display serial interface 1_DSI and a second display serial interface 2_DSI; for the same MIPI mode controller, a first camera serial interface and a second camera serial interface exist in at least two camera serial interfaces, and as shown in FIG. 3, the first-stage MIPI mode controller, the second-stage MIPI mode controller and the third-stage MIPI mode controller are provided with a first camera serial interface 1_CSI-2 and a second camera serial interface 2_CSI-2.

As can be seen from fig. 3, when the current-stage MIPI mode controller is the first-stage MIPI mode controller, the first camera serial interface 1_csi-2 of the first-stage MIPI mode controller is connected with the camera outside the data transmission control system, and the first-stage MIPI mode controller receives and unpacks the data packet transmitted by the camera from the first camera serial interface thereof in the first unpacking mode; the first display serial interface 1_DSI of the first-stage MIPI mode controller is connected with a display screen outside the data transmission control system, and the first-stage MIPI mode controller packages data to be transmitted in the first display serial interface in a first packet mode and transmits the data to the display screen through the first display serial interface.

The final stage MIPI mode controller sets at least one display serial interface and at least one camera serial interface, a first display serial interface exists in the at least one display serial interface set by the final stage MIPI mode controller, a first camera serial interface exists in the at least one camera serial interface set by the final stage MIPI mode controller, the final stage MIPI mode controller corresponds to the third stage MIPI mode controller in fig. 3, the third stage MIPI mode controller shown in fig. 3 sets the first display serial interface 1_dsi and the first camera serial interface 1_csi-2, and as for the types and the number of other interfaces of the third stage MIPI mode controller, there are no restrictions.

And under the condition that the current-stage MIPI mode controller is not the last-stage MIPI mode controller, the second display serial interface of the current-stage MIPI mode controller is connected with the first camera serial interface of the next-stage MIPI mode controller, so that the second display serial interface of the current-stage MIPI mode controller can send a data packet to the first camera serial interface of the next-stage MIPI mode controller, and the data packet enables the first camera serial interface of the next-stage MIPI mode controller to correctly identify.

The second camera serial interface of the current-stage MIPI mode controller is connected with the first display serial interface of the next-stage MIPI mode controller, so that the second camera serial interface of the current-stage MIPI mode controller can receive a data packet sent by the first display serial interface of the next-stage MIPI mode controller, and the data packet enables the second camera serial interface of the current-stage MIPI mode controller to be correctly identified.

Schematically, as can be seen from fig. 3, the second display serial interface 2_dsi of the first stage MIPI mode controller is connected to the first camera serial interface 1_csi-2 of the second stage MIPI mode controller, the second camera serial interface 2_csi-2 of the first stage MIPI mode controller is connected to the first display serial interface 1_dsi of the second stage MIPI mode controller, the second display serial interface 2_dsi of the second stage MIPI mode controller is connected to the first camera serial interface 1_csi-2 of the third stage MIPI mode controller, and the second camera serial interface 2_csi-2 of the second stage MIPI mode controller is connected to the first display serial interface 1_dsi of the third stage MIPI mode controller. Wherein the current stage MIPI mode controller is not the third stage MIPI mode controller, but when the current stage MIPI mode controller is the second stage MIPI mode controller, the next stage MIPI mode controller is the third stage MIPI mode controller.

And under the condition that the current-stage MIPI mode controller is not the first-stage MIPI mode controller, the first display serial interface of the current-stage MIPI mode controller is connected with the second camera serial interface of the previous-stage MIPI mode controller, so that the first display serial interface of the current-stage MIPI mode controller can send a data packet to the second camera serial interface of the previous-stage MIPI mode controller, and the data packet enables the second camera serial interface of the previous-stage MIPI mode controller to be correctly identified.

The first camera serial interface of the current-stage MIPI mode controller is connected with the second display serial interface of the previous-stage MIPI mode controller, so that the first camera serial interface of the current-stage MIPI mode controller can receive a data packet sent by the second display serial interface of the previous-stage MIPI mode controller, and the data packet enables the first camera serial interface of the current-stage MIPI mode controller to be correctly identified.

Schematically, as can be seen from fig. 3, the first display serial interface 1_dsi of the second stage MIPI mode controller is connected to the second camera serial interface 2_csi-2 of the first stage MIPI mode controller, the first camera serial interface 1_csi-2 of the second stage MIPI mode controller is connected to the second display serial interface 2_dsi of the first stage MIPI mode controller, the first display serial interface 1_dsi of the third stage MIPI mode controller is connected to the second camera serial interface 2_csi-2 of the second stage MIPI mode controller, and the first camera serial interface 1_csi-2 of the third stage MIPI mode controller is connected to the second display serial interface 2_dsi of the second stage MIPI mode controller. Wherein, the current stage MIPI mode controller is not the first stage MIPI mode controller, but when the current stage MIPI mode controller is the second stage MIPI mode controller, the last stage MIPI mode controller is the first stage MIPI mode controller.

As a first working mode embodiment, when the current-stage MIPI mode controller is not the last-stage MIPI mode controller, the current-stage MIPI mode controller is configured to receive and unpack a current previous batch of data packets from its first camera serial interface when the first camera serial interface is in a first unpacking mode, then allocate a preset proportion of data in the unpacked current previous batch of data packets to perform an operation to obtain an operation result, equivalently use the preset proportion of data in the current previous batch of data packets to perform an operation, allocate the remaining data as data to be sent, and use the remaining data as data to be sent in the second display serial interface, and pack the data to be sent as a next batch of data packets and send the next batch of data packets to the first camera serial interface of the next-stage MIPI mode controller through the second display serial interface when the second display serial interface is in a second packing mode, so that the first camera serial interface of the next-stage MIPI mode controller correctly identifies the next batch of data packets in the first unpacking mode, and updates the next batch of data packets as the current batch of data packets.

It should be added that the first stage MIPI mode controller is configured to receive a current batch of data packets via its first camera serial interface, where the current batch of data packets originates from an external camera. The operation of the data of the preset proportion in the MIPI mode controller is image operation, and visual operations such as image morphological processing and graying are involved.

Schematically, as can be seen from fig. 3, after the first-stage MIPI mode controller receives the image data provided by the camera through the first camera serial interface 1_csi-2, 1/3 of the unpacked image data can be sent to the operation unit inside the first-stage MIPI mode controller, and the remaining 2/3 image data is packed into the next batch of data packets through the second display serial interface 2_dsi interface and sent to the first camera serial interface 1_csi-2 of the second-stage MIPI mode controller.

After receiving the next data packet through the first camera serial interface 1_CSI-2, the second-stage MIPI mode controller sends 1/3 of the unpacked next data packet to an operation unit in the second-stage MIPI mode controller, and the rest 1/3 data is sent to the first camera serial interface 1_CSI-2 of the third-stage MIPI mode controller through the second display serial interface 2_DSI package.

And the last stage MIPI mode controller is used for receiving and unpacking a current first batch of data packets from the first camera serial interface when the first camera serial interface is in a first unpacking mode, controlling the unpacked current first batch of data packets to operate to obtain an operation result, and when the first display serial interface is in a second packing mode, taking the operation result as data to be transmitted in the first display serial interface, packing the obtained operation result to be the current first batch of result data packets and transmitting the current first batch of result data packets to the second camera serial interface of the last stage MIPI mode controller through the first display serial interface.

Preferably, the data of the internal reference operation of each stage of MIPI mode controller is a preset proportion of the current batch of data packets received by the first camera serial interface of the first stage of MIPI mode controller.

Schematically, as can be seen from fig. 3, after receiving the data packet sent by the second display serial interface 2_dsi of the second stage MIPI mode controller through the first camera serial interface 1_csi-2, the third stage MIPI mode controller unpacks the data packet and sends the unpacked data to the operation unit inside the third stage MIPI mode controller to perform operation, so as to obtain an operation result, and then, the operation result is packed into the current result packet and sent to the second camera serial interface 2_csi-2 of the second stage MIPI mode controller through the second display serial interface 1_dsi.

And when the first display serial interface is in the second packaging mode, respectively packaging the operation result originally obtained by the current MIPI mode controller and the unpacked current result information packet to obtain a next result information packet, taking the next result information packet as data to be sent in the first display serial interface, sending the next result information packet to the second camera serial interface of the previous MIPI mode controller through the first display serial interface, updating the next result information packet to the current result information packet, enabling the previous MIPI mode controller to be updated to the current MIPI mode controller, and enabling the second camera serial interface supporting the previous MIPI mode controller to recognize the next result information packet in the first unpacking mode.

Schematically, the second-stage MIPI mode controller packages the next batch of result information packets transmitted by the second display serial interface 1_dsi of the third-stage MIPI mode controller and the result obtained by the operation of the operation unit inside the second-stage MIPI mode controller, so as to obtain the next batch of result information packets, and sends the next batch of result information packets to the second camera serial interface 2_csi-2 of the first-stage MIPI mode controller through the first display serial interface 1_dsi of the second-stage MIPI mode controller.

And the first-stage MIPI mode controller is used for receiving and unpacking a current first batch of result information packets from the second camera serial interface when the second camera serial interface is in a first unpacking mode, and if the current first batch of result information packets are obtained by packing operation results obtained by the other MIPI mode controllers, the unpacked current first batch of result information packets and the operation results originally obtained by the first-stage MIPI mode controller form a complete processing result of the data packets provided by the first camera serial interface of which the camera is the first-stage MIPI mode controller. Optionally, the first stage MIPI mode controller is further configured to, when the first display serial interface is in the first packet mode, package the operation result originally obtained by the first stage MIPI mode controller and the current packet of result information after unpacking, obtain a next packet of result information, package the operation result of each stage MIPI mode controller on the data packet, respectively, as data to be sent in the first display serial interface of the first stage MIPI mode controller, and send the next packet of result information to an external display screen through the first display serial interface.

Illustratively, the first-stage MIPI mode controller receives an operation result of an operation unit inside the second-stage MIPI mode controller and an operation result of an operation unit inside the third-stage MIPI mode controller through the second camera serial interface 2_csi-2; and in the first packet mode, respectively packing operation results obtained by the operation units in the first-stage MIPI mode controller to the operation units in the third-stage MIPI mode controller, and transmitting the operation results to the display module as data to be transmitted in a first display serial interface of the first-stage MIPI mode controller to transmit complete image processing results to the display module.

In summary, through the interconnection communication between the camera serial interfaces and the display serial interfaces among a plurality of MIPI mode controllers which are connected in cascade, the data transmission and data processing modes of a single MIPI mode controller are expanded; compared with a single MIPI mode controller, the data processing efficiency and the data processing capacity of the data transmission control system are improved, and the application requirements of various data volumes between the camera and the display screen can be met.

As a second working mode embodiment, the first-stage MIPI mode controller is configured to receive and unpack a current first batch of data packets from the first camera serial interface thereof when the first camera serial interface thereof is in a first unpacking mode, then allocate a preset proportion of data in the unpacked current first batch of data packets to perform operation to obtain an operation result, equivalently use the preset proportion of data in the current first batch of data packets to perform operation, allocate the remaining data as data to be transmitted, and pack the data to be transmitted as a next batch of data packets when the second display serial interface thereof is in a first unpacking mode, and send the next batch of data packets to the first camera serial interface of the second-stage MIPI mode controller through the second display serial interface so that the first camera serial interface of the next-stage MIPI mode controller correctly identifies the next batch of data packets in the first unpacking mode, and updates the next batch of data packets as the current first batch of data packets; the current batch of data packets received by the first camera serial interface of the first-stage MIPI mode controller are sourced from an external camera. The operation performed by the MIPI mode controller on the predetermined proportion of data (the predetermined proportion of image data in the current batch of data packets from the external camera) is an image operation, and involves visual operations such as morphological processing and graying.

And when the current MIPI mode controller is not the last MIPI mode controller and the current MIPI mode controller is not the first MIPI mode controller, the current MIPI mode controller is used for receiving and unpacking a current data packet from the first camera serial interface of the current MIPI mode controller when the first camera serial interface is in a second unpacking mode, distributing data with a preset proportion in the unpacked current data packet to operate to obtain an operation result, distributing the rest data to be transmitted, packing the data to be transmitted to be the next data packet when the second display serial interface of the current MIPI mode controller is in the first unpacking mode, transmitting the next data packet to the first camera serial interface of the next MIPI mode controller through the second display serial interface, enabling the first camera serial interface of the next MIPI mode controller to correctly identify the next data packet in the second unpacking mode, and updating the next data packet to be the current data packet.

And the last stage MIPI mode controller is used for receiving and unpacking the current first batch of data packets from the first camera serial interface when the first camera serial interface is in the second unpacking mode, controlling the unpacked current first batch of data packets to operate to obtain an operation result, and when the first display serial interface is in the first unpacking mode, only the operation result of the last stage MIPI mode controller is used as data to be sent in the first display serial interface, packing the obtained operation result to be the current first batch of result information packets and sending the current first batch of result information packets to the second camera serial interface of the upper stage MIPI mode controller through the first display serial interface, so that the second camera serial interface of the upper stage MIPI mode controller correctly identifies the packed current first batch of result information packets in the second unpacking mode.

And when the first display serial interface is in the first packet unpacking mode, the operation results originally obtained by the current MIPI mode controller are respectively packed to form the current first packet of result information to be sent and unpacked, the next packet of result information is obtained, the next packet of result information is sent to the second camera serial interface of the previous MIPI mode controller through the first display serial interface, the next packet of result information is updated to the current first packet of result information, the previous MIPI mode controller is updated to the current MIPI mode controller, and the next packet of result information is correctly identified by the second camera serial interface supporting the previous MIPI mode controller in the second packet unpacking mode.

And the first-stage MIPI mode controller is used for receiving and unpacking a current first batch of result information packets from the second camera serial interface when the second camera serial interface is in the second unpacking mode, and if the current first batch of result information packets are obtained by packing operation results obtained by the other MIPI mode controllers, the unpacked current first batch of result information packets and the operation results originally obtained by the first-stage MIPI mode controller form a complete processing result of the data packets provided by the first camera serial interface of which the camera is the first-stage MIPI mode controller. Optionally, the first stage MIPI mode controller is further configured to, when the first display serial interface is in the first packet mode, package an operation result originally obtained by the first stage MIPI mode controller and a current previous batch of result information packets after unpacking, respectively, to obtain a next batch of result information packets, thereby respectively packaging operation results of each stage MIPI mode controller (each MIPI mode controller) on data with a preset proportion, as data to be sent in the first display serial interface of the first stage MIPI mode controller, and send the next batch of result information packets to an external display screen through the first display serial interface.

After receiving the data packet sent by the second display serial interface 2_dsi of the second-stage MIPI mode controller through the first camera serial interface 1_csi-2, the third-stage MIPI mode controller unpacks the data packet and sends the unpacked data to an operation unit in the third-stage MIPI mode controller to operate, so as to obtain an operation result, packages the operation result into the current result information packet, and sends the operation result to the second camera serial interface 2_csi-2 of the second-stage MIPI mode controller through the second display serial interface 1_dsi.

The second-stage MIPI mode controller respectively packs the next batch of result information packets transmitted by the second display serial interface 1_DSI of the third-stage MIPI mode controller and the result obtained by operation of an operation unit in the second-stage MIPI mode controller to obtain the next batch of result information packets, and sends the next batch of result information packets to the second camera serial interface 2_CSI-2 of the first-stage MIPI mode controller through the first display serial interface 1_DSI of the second-stage MIPI mode controller.

The first-stage MIPI mode controller receives the operation result of the operation unit in the second-stage MIPI mode controller and the operation result of the operation unit in the third-stage MIPI mode controller through the second camera serial interface 2_CSI-2; and in the first packet mode, respectively packing operation results obtained by the operation units in the first-stage MIPI mode controller to the operation units in the third-stage MIPI mode controller, and transmitting the operation results to the display module as data to be transmitted in a first display serial interface of the first-stage MIPI mode controller to transmit complete image processing results to the display module.

In summary, the MIPI mode controllers with the camera serial interfaces and the display serial interfaces are connected in a cascade manner to distribute the same batch of data packets transmitted by the external cameras and calculate the distributed data, so that the computing capacity of a single MIPI mode controller is expanded, and the requirements of different data volumes and data computing power of multiple application scenes are met.

In the foregoing embodiment, the valid data carried in the previous batch of data packets and the valid data carried in the next batch of data packets are both derived from the data to be processed provided by the external camera; the data to be processed provided by the external camera comprises image data, and the image data is single-frame or multi-frame image data formed by encoding; the effective data in the data packet received by the camera serial interface is effective data content in the data packet, such as PACKET DATA part of content in the long data packet in fig. 1, and PACKET DATA part of content is used for representing image information collected by the camera, wherein the image information collected by the camera comprises certain characteristic points and characteristic lines in an image, and can also be road signs.

It should be noted that, the data amount provided by the external camera to the first camera serial interface of the first stage MIPI mode controller is actually the data amount of the current batch of data packets received by the first camera serial interface of the first stage MIPI mode controller, which may be smaller than or equal to the data amount of the data to be processed provided by the external camera. The amount of data here may be represented using a unit space memory amount of bits, bytes, or the like.

The difference between the data volume of the previous batch of data packets and the data volume of the next batch of data packets is equal to the ratio between the data volume provided by the external camera for the first camera serial interface of the first stage MIPI mode controller and the number of all MIPI mode controllers connected in cascade, so that: all MIPI mode controllers connected in cascade equally distribute data packets received by a first camera serial interface of a first stage MIPI mode controller, specifically, starting from the first stage MIPI mode controller, in the case that the first camera serial interface of a current stage MIPI mode controller receives the current data packet in the first batch among the adjacent two stage MIPI mode controllers, the first camera serial interface of the next stage MIPI mode controller receives the next data packet transmitted by a second display serial interface of the current stage MIPI mode controller, wherein the difference value between the data volume of the current data packet and the data volume of the next data packet is the data volume of the data participating in operation inside the current stage MIPI mode controller, and in order to realize average distribution, the data volume of the data participating in operation inside a single MIPI mode controller is defined as the ratio between the data volume provided by the first camera serial interface of the first stage MIPI mode controller and the number of all MIPI mode controllers connected in cascade, and the data of the first camera serial interface of the first stage MIPI mode controller can be provided as the data packet of the first stage MIPI mode controller in the preset ratio; so that each MIPI mode controller obtains the same amount of data for operation.

In the scenario that each MIPI mode controller is regarded as a chip, if the calculation power of a single chip is 100Tops and the total calculation power required for processing the image data collected by the camera is 270Tops, the application provides the data transmission control system shown in fig. 3, and 3 MIPI mode controllers are connected in cascade to form the data transmission control system, and the total calculation power achieved by the data transmission control system is 300Tops, so that the processing requirement of the image data collected by the camera can be met. Note that tips is "Tera Operations Per Second", i.e., one trillion operations per second, which is a unit of calculation force, and in the present application, tips is used to measure the calculation capability of the MIPI mode controller.

Based on the description of the functional characteristics and the result characteristics of the first-stage MIPI mode controller, the adjacent two-stage MIPI mode controllers and the last-stage MIPI mode controller in the foregoing embodiments, after the first-stage MIPI mode controller receives an image to be processed transmitted by a camera through the first camera serial interface 1_csi-2, the image can be divided into 3 blocks (a frame of image can be divided into 3 blocks, or each MIPI mode controller can process different image frames), a block is reserved for an operation unit built in the first-stage MIPI mode controller, and the remaining two blocks are transmitted to the second-stage MIPI mode controller through the second display serial interface 2_dsi of the first-stage MIPI mode controller, then one of the blocks is reserved for an operation unit built in the second-stage MIPI mode controller, and then the remaining block is transmitted to the third-stage MIPI mode controller through the second display serial interface 2_dsi of the second-stage MIPI mode controller, and the operation unit built in the third-stage MIPI mode controller processes the remaining blocks, thereby letting each stage MIPI mode controller (i mode controller) process data like the block 1); after the second-stage MIPI mode controller and the second-stage MIPI mode controller process the corresponding 1-block image data, respective operation results are fed back to the first-stage MIPI mode controller, and the operation results of the first-stage MIPI mode controller and the second-stage MIPI mode controller form a complete processing result of the data transmission control system on the image to be processed transmitted by the camera.

Based on the foregoing first working mode embodiment, it is necessary to configure each MIPI interface of the first-stage MIPI mode controller simultaneously, so that the configuration of the packing or unpacking modes of each MIPI interface can be completed at one time.

The configuration mode of each MIPI interface of the first-stage MIPI mode controller is as follows:

the first-stage MIPI mode controller configures the first camera serial interface to be in a first unpacking mode so as to unpack the data packet received by the first camera serial interface according to the CSI-2 protocol; therefore, the first-stage MIPI mode controller configures the first camera serial interface according to the first unpacking mode, so that the first camera serial interface can identify the data packet which is transmitted by the external camera module and is compliant with the CSI-2 protocol, and the data packet which is compliant with the CSI-2 protocol can be kept to be received and unpacked.

The first-stage MIPI mode controller configures the first display serial interface to be in a first packing mode so as to pack data to be sent in the first display serial interface according to a DSI protocol, and the first display serial interface can keep sending data packets conforming to the DSI protocol; therefore, the first-stage MIPI mode controller configures the first display serial interface according to the first packet mode, so that the first display serial interface transmits a data packet conforming to the DSI protocol to an external display module.

The first-stage MIPI mode controller configures the second camera serial interface to be in a first unpacking mode so as to unpack data packets received by the second camera serial interface according to a CSI-2 protocol; therefore, the first-stage MIPI mode controller configures the second camera serial interface according to the first unpacking mode, so that the second camera serial interface can identify the data packet conforming to the CSI-2 protocol, and the data packet conforming to the CSI-2 protocol can be kept to be received and unpacked.

The first-stage MIPI mode controller configures the second display serial interface to be in a second packaging mode so as to package data to be sent in the second display serial interface according to a CSI-2 protocol; therefore, the first-stage MIPI mode controller configures the second display serial interface according to the second packaging mode, so that data to be sent in the second display serial interface is allowed to be packaged into data conforming to the CSI-2 protocol, and the first camera serial interface of the second-stage MIPI mode controller recognizes the data packet conforming to the CSI-2 protocol. The problem that the camera serial interface and the display serial interface between different MIPI mode controllers cannot communicate is solved based on the second packaging mode.

When the current-stage MIPI mode controller is not the last-stage MIPI mode controller and the current-stage MIPI mode controller is not the first-stage MIPI mode controller, the configuration mode of each MIPI interface of the current-stage MIPI mode controller is as follows:

The current-stage MIPI mode controller configures the first camera serial interface to be in a first unpacking mode so as to unpack the data packet received by the first camera serial interface according to the CSI-2 protocol; therefore, the current-stage MIPI mode controller configures the first camera serial interface according to the first unpacking mode, so that the first camera serial interface identifies the data packet conforming to the CSI-2 protocol, and the data packet conforming to the CSI-2 protocol can be kept to be received and unpacked.

The current-stage MIPI mode controller configures the first display serial interface to be in a second packaging mode so as to package data to be sent in the first display serial interface according to a CSI-2 protocol; therefore, the current-stage MIPI mode controller realizes that the first display serial interface is configured according to the second packaging mode, rather than the packaging format configuration according to the data type of the DSI protocol originally followed by the display serial interface, so that the first display serial interface allows to send out the data packet conforming to the CSI-2 protocol, and further the second camera serial interface of the previous-stage MIPI mode controller recognizes the data packet conforming to the CSI-2 protocol. The problem that the camera serial interface and the display serial interface between different MIPI mode controllers cannot communicate is solved based on the second packaging mode.

The current-stage MIPI mode controller configures the second camera serial interface to be in a first unpacking mode so as to unpack the data packet received by the second camera serial interface according to the CSI-2 protocol; thus, the current-stage MIPI mode controller implements configuring the second camera serial interface in accordance with the first unpacking mode such that the second camera serial interface recognizes data packets conforming to the CSI-2 protocol, and may maintain receiving and unpacking data packets conforming to the CSI-2 protocol.

The current-stage MIPI mode controller configures the second display serial interface to be in a second packaging mode so as to package data to be sent in the second display serial interface according to the CSI-2 protocol; therefore, the current-stage MIPI mode controller realizes that the second display serial interface is configured according to the second packaging mode, rather than the packaging format configuration according to the data type of the DSI protocol originally followed by the display serial interface, so that the second display serial interface allows sending out the data packet conforming to the CSI-2 protocol, and further the first camera serial interface of the next-stage MIPI mode controller recognizes the data packet conforming to the CSI-2 protocol. The problem that the camera serial interface and the display serial interface between different MIPI mode controllers cannot communicate is solved based on the second packaging mode.

The configuration mode of each MIPI interface of the MIPI mode controller of the last stage is as follows:

The final-stage MIPI mode controller configures the first camera serial interface to be in a first unpacking mode so as to unpack the data packet received by the first camera serial interface according to the CSI-2 protocol; therefore, the final-stage MIPI mode controller configures the first camera serial interface according to the first unpacking mode, so that the first camera serial interface of the final-stage MIPI mode controller can recognize the data packet conforming to the CSI-2 protocol, and the data packet conforming to the CSI-2 protocol can be kept to be received and unpacked.

The final-stage MIPI mode controller configures the first display serial interface to be in a second packaging mode so as to package data to be sent in the first display serial interface according to a CSI-2 protocol; therefore, the last-stage MIPI mode controller realizes that the first display serial interface is configured according to the second packaging mode, rather than the packaging format configuration according to the data type of the DSI protocol originally followed by the display serial interface, so that the first display serial interface allows to send out the data packet conforming to the CSI-2 protocol, and further the second camera serial interface of the last-stage MIPI mode controller recognizes the data packet conforming to the CSI-2 protocol. The problem that the camera serial interface and the display serial interface between different MIPI mode controllers cannot communicate is solved based on the second packaging mode.

Based on the foregoing second working mode embodiment, the MIPI interfaces of the first-stage MIPI mode controller need to be configured simultaneously, so that the configuration of the packing or unpacking modes of the MIPI interfaces can be completed at one time.

The first-stage MIPI mode controller configures the second camera serial interface to be in a second unpacking mode so as to unpack the data packet received by the second camera serial interface according to a DSI protocol; therefore, the first-stage MIPI mode controller realizes that the second camera serial interface is configured according to the second unpacking mode, rather than the packing format configuration according to the data type of the DSI protocol originally followed by the camera serial interface, so that the second camera serial interface allows to identify the data packet conforming to the DSI protocol, namely the data packet conforming to the DSI protocol transmitted by the first display serial interface of the next-stage MIPI mode controller can be identified. The problem that the camera serial interface and the display serial interface between different MIPI mode controllers cannot communicate is solved based on the second unpacking mode.

The first-stage MIPI mode controller configures the second display serial interface to be in a first packing mode so as to pack data to be sent in the second display serial interface according to a DSI protocol; therefore, the first-stage MIPI mode controller configures the second display serial interface according to the first packet mode, so that data to be sent in the second display serial interface is allowed to be packed into data conforming to the DSI protocol, and the first camera serial interface of the second-stage MIPI mode controller enters the second packet-unpacking mode to identify data packets conforming to the DSI protocol.

The current-stage MIPI mode controller configures the first camera serial interface to be in a second unpacking mode so as to unpack the data packet received by the first camera serial interface according to a DSI protocol; therefore, the current-stage MIPI mode controller realizes that the first camera serial interface is configured according to the second unpacking mode, but not the packing format configuration is performed according to the data type of the CSI-2 protocol originally followed by the camera serial interface, so that the first camera serial interface identifies the data packet conforming to the DSI protocol, and the second display serial interface identified to the previous-stage MIPI mode controller can keep the data packet transmitted according to the DSI protocol. The problem that the camera serial interface and the display serial interface between different MIPI mode controllers cannot communicate is solved based on the second unpacking mode.

The current-stage MIPI mode controller configures the first display serial interface to be in a first packing mode so as to pack data to be sent in the first display serial interface according to a DSI protocol; therefore, the current-stage MIPI mode controller configures the first display serial interface according to the first packet mode, namely, configures the packaging format according to the data type of the DSI protocol originally followed by the first display serial interface, so that the first display serial interface allows sending out the data packet conforming to the DSI protocol, and further, the second camera serial interface of the previous-stage MIPI mode controller enters the second packet-unpacking mode to identify the data packet conforming to the DSI protocol.

The current-stage MIPI mode controller configures the second camera serial interface to be in a second unpacking mode so as to unpack the data packet received by the second camera serial interface according to a DSI protocol; therefore, the current-stage MIPI mode controller realizes that the second camera serial interface is configured according to the second unpacking mode, but not according to the data type of the CSI-2 protocol originally followed by the camera serial interface, so that the second camera serial interface identifies the data packet conforming to the DSI protocol, and the first display serial interface of the next-stage MIPI mode controller can identify the data packet transmitted by the first display serial interface according to the DSI protocol. The problem that the camera serial interface and the display serial interface between different MIPI mode controllers cannot communicate is solved based on the second unpacking mode.

The current-stage MIPI mode controller configures the second display serial interface to be in a first packing mode so as to pack data to be sent in the second display serial interface according to a DSI protocol; therefore, the current-stage MIPI mode controller configures the second display serial interface according to the first packet mode, which is equivalent to configuring the packaging format according to the data type of the DSI protocol originally followed by the display serial interface, so that the second display serial interface keeps sending out the data packet which follows the DSI protocol, and the first camera serial interface of the next-stage MIPI mode controller enters the second packet-unpacking mode to identify the data packet which follows the DSI protocol.

The final-stage MIPI mode controller configures the first camera serial interface to be in a second unpacking mode so as to unpack the data packet received by the first camera serial interface according to a DSI protocol; therefore, the last-stage MIPI mode controller configures the first camera serial interface according to the second unpacking mode instead of configuring the packing format according to the data type of the CSI-2 protocol originally followed by the camera serial interface, so that the first camera serial interface of the last-stage MIPI mode controller identifies the data packet which is in accordance with the DSI protocol, and then the second display serial interface of the last-stage MIPI mode controller can identify the data packet which is transmitted by the second display serial interface of the last-stage MIPI mode controller according to the DSI protocol. The problem that the camera serial interface and the display serial interface between different MIPI mode controllers cannot communicate is solved based on the second unpacking mode.

The final-stage MIPI mode controller configures the first display serial interface to be in a first packing mode so as to pack data to be sent in the first display serial interface according to a DSI protocol; therefore, the last-stage MIPI mode controller configures the first display serial interface according to the first packet mode, namely, configures the packaging format according to the data type of the DSI protocol originally followed by the display serial interface, so that the first display serial interface sends out the data packet which follows the DSI protocol, and then the second camera serial interface of the last-stage MIPI mode controller enters the second packet-unpacking mode to identify the data packet which follows the DSI protocol.

The terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present application, the meaning of "a plurality" is two or more, unless explicitly defined otherwise. While embodiments of the present application have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the application, and that variations, modifications, alternatives and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the application.

Claims

1. A MIPI mode controller, wherein the MIPI mode controller sets a display serial interface and a camera serial interface; the MIPI mode controller receives the data packet through the camera serial interface and sends the data packet through the display serial interface; the camera serial interface and the display serial interface both belong to MIPI interfaces of the MIPI mode controller;

The MIPI mode controller is used for packaging data to be transmitted according to the data type of the data packet specified by the DSI protocol when the display serial interface is configured to be in a first packet mode, so as to form the data packet conforming to the DSI protocol;

The MIPI mode controller is used for packing data to be transmitted according to the data type of the data packet specified by the CSI-2 protocol when the display serial interface is configured to be in a second packing mode to form the data packet conforming to the CSI-2 protocol, so that the data packet transmitted by the display serial interface is identified by the camera serial interface;

A MIPI mode controller for unpacking the received data packet according to the data type of the data packet specified by the CSI-2 protocol when the camera serial interface is configured to be in a first unpacking mode;

And the MIPI mode controller is used for unpacking the received data packet according to the data type of the data packet specified by the DSI protocol when the camera serial interface is configured to be in the second unpacking mode, so that the camera serial interface identifies the data packet sent by the display serial interface.

2. The MIPI mode controller of claim 1, wherein the MIPI mode controller is configured to determine, when a data ID in data to be transmitted is configured as a type identifier of a header of a data packet specified by the CSI-2 protocol in a process of packaging the data to be transmitted, to package the data to be transmitted into a data packet conforming to the CSI-2 protocol according to a data type of the data packet specified by the CSI-2 protocol so as to be recognized by the camera serial interface;

The MIPI mode controller is used for determining the data type of the data packet regulated according to the DSI protocol to pack the data to be transmitted into the data packet conforming to the DSI protocol when the data ID in the data to be transmitted is configured as the type identifier of the packet head of the data packet regulated by the DSI protocol in the process of packing the data to be transmitted;

Wherein, the data to be sent carries a data ID;

The MIPI mode controller is used for determining that the received data packet is completely unpacked according to the data type of the data packet regulated by the CSI-2 protocol when the unpacked data ID is configured as the type identifier of the packet head of the data packet regulated by the CSI-2 protocol in the unpacking process of the received data packet, and the camera serial interface identifies that the received data packet conforms to the CSI-2 protocol;

The MIPI mode controller is used for determining that the received data packet is completely unpacked according to the data type of the data packet regulated by the DSI protocol when the unpacked data ID is configured as the type identifier of the packet head of the data packet regulated by the DSI protocol in the unpacking process of the received data packet, and the camera serial interface identifies that the received data packet conforms to the DSI protocol;

wherein the received data packet also carries a data ID.

3. The MIPI mode controller of claim 1, wherein the MIPI mode controller is configured with a first display serial interface, a second display serial interface, a first camera serial interface, and a second camera serial interface;

The first display serial interface of the MIPI mode controller is connected with the first camera serial interface of the MIPI mode controller, and the second display serial interface of the MIPI mode controller is connected with the second camera serial interface of the MIPI mode controller; wherein the first display serial interface is configured in a second packaging mode to support packaging the first test data into data packets conforming to the CSI-2 protocol, and the first camera serial interface is configured in a first unpacking mode to support unpacking the data packets in accordance with the CSI-2 protocol; the first display serial interface is configured in a first packetizing mode to support packetizing the first test data into data packets conforming to the DSI protocol, and the first camera serial interface is configured in a second depacketizing mode to support depacketizing the data packets in accordance with the DSI protocol; the second display serial interface is configured in a first packetizing mode to support packetizing the second test data into data packets conforming to the DSI protocol, and the second camera serial interface is configured in a second depacketizing mode to support depacketizing the data packets in accordance with the DSI protocol; the second display serial interface is configured in a second packing mode to support packing second test data into data packets conforming to the CSI-2 protocol, and the second camera serial interface is configured in a first unpacking mode to support unpacking data packets according to the CSI-2 protocol;

Or the first display serial interface of the MIPI mode controller is connected with the second camera serial interface of the MIPI mode controller, the second display serial interface of the MIPI mode controller is connected with the first camera serial interface of the MIPI mode controller, wherein the first display serial interface is configured to be in a second packing mode to support packing first test data into data packets conforming to the CSI-2 protocol, and the second camera serial interface is configured to be in a first unpacking mode to support unpacking the data packets according to the CSI-2 protocol; the first display serial interface is configured in a first packetizing mode to support packetizing first test data into data packets conforming to the DSI protocol, and the second camera serial interface is configured in a second depacketizing mode to support depacketizing the data packets in accordance with the DSI protocol; the second display serial interface is configured in a first packetizing mode to support packetizing the second test data into data packets conforming to the DSI protocol, and the first camera serial interface is configured in a second depacketizing mode to support depacketizing the data packets in accordance with the DSI protocol; the second display serial interface is configured in a second packetizing mode to support packetizing the second test data into data packets compliant with the CSI-2 protocol, and the first camera serial interface is configured in a first depacketizing mode to support depacketizing the data packets in accordance with the CSI-2 protocol.

4. The MIPI mode controller of claim 3, wherein when the first display serial interface of the MIPI mode controller is connected to the first camera serial interface of the MIPI mode controller, the MIPI mode controller is configured to configure the first display serial interface to enter a second packaging mode to package the first test data according to the CSI-2 protocol until the configuration of the verification information is completed, to form a first data packet to be verified, and to send the first data packet to the first camera serial interface of the same MIPI mode controller through the first display serial interface; the MIPI mode controller is further configured to configure the first camera serial interface to enter a first unpacking mode to unpack the first data packet to be verified according to the CSI-2 protocol until the first data packet to be verified is successfully verified by using the verification information, determine that the first camera serial interface correctly identifies the first data packet to be verified, and determine that the function test of the interconnected first display serial interface and first camera serial interface is successful;

under the condition that a second display serial interface of the MIPI mode controller is connected with a second camera serial interface of the MIPI mode controller, the MIPI mode controller is used for configuring the second display serial interface to enter a first packing mode to pack second test data according to a DSI protocol until the configuration of verification information is completed, forming a second data packet to be verified, and sending the second data packet to the second camera serial interface of the same MIPI mode controller through the second display serial interface; and the MIPI mode controller is further used for configuring the second camera serial interface to enter a second unpacking mode to unpack the second data packet to be verified according to the DSI protocol until the second data packet to be verified is successfully verified by using the verification information, determining that the second camera serial interface correctly identifies the second data packet to be verified, and determining that the function test of the interconnected second display serial interface and second camera serial interface is successful.

5. The MIPI mode controller of claim 3, wherein when the first display serial interface of the MIPI mode controller is connected to the second camera serial interface of the MIPI mode controller, the MIPI mode controller is configured to configure the first display serial interface to enter a second packaging mode to package the first test data according to the CSI-2 protocol until the configuration of the verification information is completed, to form a first data packet to be verified, and to send the first data packet to the second camera serial interface of the same MIPI mode controller through the first display serial interface; the MIPI mode controller is further used for configuring the second camera serial interface to enter a first unpacking mode to unpack the first data packet to be verified according to the CSI-2 protocol until the first data packet to be verified is successfully verified by using the verification information, determining that the second camera serial interface correctly recognizes the first data packet to be verified, and determining that the function test of the interconnected first display serial interface and second camera serial interface is successful;

Under the condition that a second display serial interface of the MIPI mode controller is connected with a first camera serial interface of the MIPI mode controller, the MIPI mode controller is used for configuring the second display serial interface to enter a first packing mode to pack second test data according to a DSI protocol until the configuration of verification information is completed, forming a second data packet to be verified, and sending the second data packet to the first camera serial interface of the same MIPI mode controller through the second display serial interface; the MIPI mode controller is further configured to configure the first camera serial interface to enter a second unpacking mode to unpack the second data packet to be verified according to the DSI protocol until the second data packet to be verified is successfully verified by using the verification information, determine that the first camera serial interface correctly identifies the second data packet to be verified, and determine that the function test of the interconnected second display serial interface and first camera serial interface is successful.

6. A data transmission control system comprising at least two MIPI mode controllers as claimed in any one of claims 1-2, wherein the camera serial interface of one MIPI mode controller is connected to the display serial interface of the other MIPI mode controller;

When the camera serial interface of one MIPI mode controller is in a first unpacking mode, the display serial interface of the other MIPI mode controller is in a second packing mode;

when the camera serial interface of one MIPI mode controller is in the second unpacking mode, the display serial interface of the other MIPI mode controller is in the first packing mode.

7. A data transmission control system, characterized in that the data transmission control system comprises a plurality of MIPI mode controllers according to any one of claims 1 to 2 connected in cascade;

among the MIPI mode controllers connected in cascade, two MIPI mode controllers connected directly are a current-stage MIPI mode controller and a next-stage MIPI mode controller respectively, or two MIPI mode controllers connected directly are a previous-stage MIPI mode controller and a current-stage MIPI mode controller respectively so as to form two adjacent MIPI mode controllers;

Among the cascade-connected MIPI mode controllers, when the current MIPI mode controller is not the last MIPI mode controller, the current MIPI mode controller is provided with a display serial interface connected with the corresponding camera serial interface of the next MIPI mode controller, and the current MIPI mode controller is provided with a camera serial interface connected with the corresponding display serial interface of the next MIPI mode controller; and/or, in the case that the current-stage MIPI mode controller is not the first-stage MIPI mode controller, among the plurality of MIPI mode controllers connected in cascade, the current-stage MIPI mode controller has a display serial interface connected with a corresponding camera serial interface of the previous-stage MIPI mode controller, and the current-stage MIPI mode controller has a camera serial interface connected with a corresponding display serial interface of the previous-stage MIPI mode controller;

the camera serial interface used for receiving the data packet transmitted by the camera in the first-stage MIPI mode controller is in a first unpacking mode, and the display serial interface used for transmitting the data packet to the display in the first-stage MIPI mode controller is in a first packing mode;

when the current MIPI mode controller has a display serial interface in a second packaging mode, a camera serial interface connected with the display serial interface in the second packaging mode is in a first unpacking mode in the next MIPI mode controller;

when a camera serial interface exists in the current-stage MIPI mode controller and is in a first unpacking mode, a display serial interface connected with the camera serial interface currently in the first unpacking mode in the previous-stage MIPI mode controller is in a second packing mode;

8. The data transmission control system of claim 7, wherein among the MIPI mode controllers connected in cascade, the remaining MIPI mode controllers except for the last stage MIPI mode controller are each provided with at least two display serial interfaces and at least two camera serial interfaces, and for the same MIPI mode controller, a first display serial interface and a second display serial interface are present in the at least two display serial interfaces provided, and a first camera serial interface and a second camera serial interface are present in the at least two camera serial interfaces provided;

when the current-stage MIPI mode controller is a first-stage MIPI mode controller, a first camera serial interface of the first-stage MIPI mode controller is connected with an external camera, and a first display serial interface of the first-stage MIPI mode controller is connected with an external display screen;

the final stage MIPI mode controller is provided with at least one display serial interface and at least one camera serial interface, a first display serial interface exists in the at least one display serial interface arranged by the final stage MIPI mode controller, and a first camera serial interface exists in the at least one camera serial interface arranged by the final stage MIPI mode controller;

under the condition that the current-stage MIPI mode controller is not the last-stage MIPI mode controller, the second display serial interface of the current-stage MIPI mode controller is connected with the first camera serial interface of the next-stage MIPI mode controller, and the second camera serial interface of the current-stage MIPI mode controller is connected with the first display serial interface of the next-stage MIPI mode controller;

And under the condition that the current-stage MIPI mode controller is not the first-stage MIPI mode controller, the first display serial interface of the current-stage MIPI mode controller is connected with the second camera serial interface of the previous-stage MIPI mode controller, and the first camera serial interface of the current-stage MIPI mode controller is connected with the second display serial interface of the previous-stage MIPI mode controller.

9. The data transmission control system according to claim 8, wherein when the current-stage MIPI mode controller is not the last-stage MIPI mode controller, the current-stage MIPI mode controller is configured to receive and unpack a current packet from its first camera serial interface when the first camera serial interface is in the first unpacking mode, then allocate a predetermined proportion of data in the unpacked current packet to perform an operation to obtain an operation result, allocate remaining data as data to be transmitted, and pack the data to be transmitted as a next packet and send the next packet to the first camera serial interface of the next-stage MIPI mode controller through the second display serial interface when the second display serial interface is in the second packing mode, and update the next packet as the current packet; the first-stage MIPI mode controller is used for receiving a current batch of data packets through a first camera serial interface of the first-stage MIPI mode controller, wherein the current batch of data packets are sourced from an external camera;

The last-stage MIPI mode controller is used for receiving and unpacking a current first batch of data packets from the first camera serial interface when the first camera serial interface is in a first unpacking mode, controlling the unpacked current first batch of data packets to operate to obtain an operation result, packing the obtained operation result to be the current first batch of result information packets when the first display serial interface is in a second packing mode, and sending the current first batch of result information packets to the second camera serial interface of the last-stage MIPI mode controller through the first display serial interface;

the current MIPI mode controller is not the last MIPI mode controller, and when the current MIPI mode controller is not the first MIPI mode controller, the current MIPI mode controller is further used for receiving and unpacking a current first batch of result information packets from the second camera serial interface when the second camera serial interface is in a first unpacking mode, respectively packing operation results originally obtained by the current MIPI mode controller and the unpacked current first batch of result information packets when the first display serial interface is in a second packing mode, obtaining a next batch of result information packets, sending the next batch of result information packets to the second camera serial interface of the last MIPI mode controller through the first display serial interface, and updating the next batch of result information packets into the current first batch of result information packets;

And the first-stage MIPI mode controller is used for receiving and unpacking a current first batch of result information packets from the second camera serial interface when the second camera serial interface is in a first unpacking mode, and if the current first batch of result information packets are obtained by packing operation results obtained by the other MIPI mode controllers, the unpacked current first batch of result information packets and the operation results originally obtained by the first-stage MIPI mode controller form a complete processing result of the data packets provided by the first camera serial interface of which the camera is the first-stage MIPI mode controller.

10. The data transmission control system according to claim 8, wherein the first-stage MIPI mode controller is configured to receive and unpack a current packet from the first camera serial interface thereof when the first camera serial interface thereof is in the first unpacking mode, then allocate a predetermined proportion of data in the unpacked current packet to perform an operation to obtain an operation result, allocate the remaining data as data to be transmitted, and pack the data to be transmitted as a next packet and transmit the next packet to the first camera serial interface of the second-stage MIPI mode controller through the second display serial interface when the second display serial interface thereof is in the first unpacking mode, and update the next packet as the current packet; the first camera serial interface of the first-stage MIPI mode controller receives a current batch of data packets from an external camera;

The method comprises the steps that when a current MIPI mode controller is not a last MIPI mode controller and the current MIPI mode controller is not a first MIPI mode controller, the current MIPI mode controller is used for receiving and unpacking a current first batch of data packets from a first camera serial interface of the current MIPI mode controller when the first camera serial interface is in a second unpacking mode, distributing data with a preset proportion in the unpacked current first batch of data packets to operate so as to obtain an operation result, distributing the rest data to be transmitted, and packing the data to be transmitted to be a next batch of data packets and transmitting the next batch of data packets to the first camera serial interface of the next MIPI mode controller through a second display serial interface when the second display serial interface is in the first unpacking mode;

the last-stage MIPI mode controller is used for receiving and unpacking a current first batch of data packets from the first camera serial interface when the first camera serial interface is in a second unpacking mode, controlling the unpacked current first batch of data packets to operate to obtain an operation result, packing the obtained operation result to be the current first batch of result information packets when the first display serial interface is in the first unpacking mode, and sending the current first batch of result information packets to the second camera serial interface of the last-stage MIPI mode controller through the first display serial interface;

The current MIPI mode controller is not the last MIPI mode controller, and when the current MIPI mode controller is not the first MIPI mode controller, the current MIPI mode controller is also used for receiving and unpacking a current first batch of result information packets from the second camera serial interface when the second camera serial interface is in a second unpacking mode, respectively packing an operation result originally obtained by the current MIPI mode controller and the unpacked current first batch of result information packets when the first display serial interface is in a first packing mode, obtaining a next batch of result information packets, transmitting the next batch of result information packets to the second camera serial interface of the last MIPI mode controller through the first display serial interface, and updating the next batch of result information packets into the current first batch of result information packets;

And the first-stage MIPI mode controller is used for receiving and unpacking a current first batch of result information packets from the second camera serial interface when the second camera serial interface is in the second unpacking mode, and if the current first batch of result information packets are obtained by packing operation results obtained by the other MIPI mode controllers, the unpacked current first batch of result information packets and the operation results originally obtained by the first-stage MIPI mode controller form a complete processing result of the data packets provided by the first camera serial interface of which the camera is the first-stage MIPI mode controller.

11. The data transmission control system according to claim 9 or 10, wherein the valid data carried in the current batch of data packets and the valid data carried in the next batch of data packets are both derived from data to be processed provided by an external camera; the difference value between the data volume of the previous batch of data packets and the data volume of the next batch of data packets is equal to the ratio of the data volume provided by the external camera for the first camera serial interface of the first-stage MIPI mode controller to the number of all MIPI mode controllers connected in a cascade manner;

The ratio of the number of all MIPI mode controllers connected in cascade to the data amount provided by an external camera for a first camera serial interface of the first-stage MIPI mode controller is the preset ratio.

12. The data transmission control system of claim 9 wherein each MIPI interface of the first-stage MIPI mode controller is configured in a manner such that:

the first-stage MIPI mode controller configures the first camera serial interface to be in a first unpacking mode so as to unpack the data packet received by the first camera serial interface according to the CSI-2 protocol;

The first-stage MIPI mode controller configures the first display serial interface to be in a first packing mode so as to pack data to be sent in the first display serial interface according to a DSI protocol;

the first-stage MIPI mode controller configures the second camera serial interface to be in a first unpacking mode so as to unpack data packets received by the second camera serial interface according to a CSI-2 protocol;

the first-stage MIPI mode controller configures the second display serial interface to be in a second packaging mode so as to package data to be sent in the second display serial interface according to a CSI-2 protocol;

the current-stage MIPI mode controller configures the first camera serial interface to be in a first unpacking mode so as to unpack the data packet received by the first camera serial interface according to the CSI-2 protocol;

The current-stage MIPI mode controller configures the first display serial interface to be in a second packaging mode so as to package data to be sent in the first display serial interface according to a CSI-2 protocol;

the current-stage MIPI mode controller configures the second camera serial interface to be in a first unpacking mode so as to unpack the data packet received by the second camera serial interface according to the CSI-2 protocol;

The current-stage MIPI mode controller configures the second display serial interface to be in a second packaging mode so as to package data to be sent in the second display serial interface according to the CSI-2 protocol;

The final-stage MIPI mode controller configures the first camera serial interface to be in a first unpacking mode so as to unpack the data packet received by the first camera serial interface according to the CSI-2 protocol;

The last stage MIPI mode controller configures the first display serial interface in a second packaging mode to package data to be sent in the first display serial interface according to the CSI-2 protocol.

13. The data transmission control system of claim 10 wherein each MIPI interface of the first-stage MIPI mode controller is configured in a manner such that:

the first-stage MIPI mode controller configures the second camera serial interface to be in a second unpacking mode so as to unpack the data packet received by the second camera serial interface according to a DSI protocol;

the first-stage MIPI mode controller configures the second display serial interface to be in a first packing mode so as to pack data to be sent in the second display serial interface according to a DSI protocol;

the current-stage MIPI mode controller configures the first camera serial interface to be in a second unpacking mode so as to unpack the data packet received by the first camera serial interface according to a DSI protocol;

the current-stage MIPI mode controller configures the first display serial interface to be in a first packing mode so as to pack data to be sent in the first display serial interface according to a DSI protocol;

the current-stage MIPI mode controller configures the second camera serial interface to be in a second unpacking mode so as to unpack the data packet received by the second camera serial interface according to a DSI protocol;

the current-stage MIPI mode controller configures the second display serial interface to be in a first packing mode so as to pack data to be sent in the second display serial interface according to a DSI protocol;

the final-stage MIPI mode controller configures the first camera serial interface to be in a second unpacking mode so as to unpack the data packet received by the first camera serial interface according to a DSI protocol;

The last-stage MIPI mode controller configures the first display serial interface in a first packing mode to pack data to be sent in the first display serial interface according to a DSI protocol.