WO2021109827A1

WO2021109827A1 - Method and apparatus for outputting multi-channel image data, and computer device

Info

Publication number: WO2021109827A1
Application number: PCT/CN2020/128411
Authority: WO
Inventors: 白炳磊; 王辉耀
Original assignee: 深圳市沃特沃德股份有限公司
Priority date: 2019-12-03
Filing date: 2020-11-12
Publication date: 2021-06-10
Also published as: CN110855852B; CN110855852A

Abstract

Disclosed are a method and apparatus for outputting multi-channel image data, and a computer device. The method comprises: sequentially acquiring target data; when a target frame synchronization signal is detected, respectively acquiring valid data of each channel from the target data; and respectively outputting the valid data of each channel in the form of outputting a complete frame of image each time. The target data is identified, and image data of each channel is restored from the target data, such that the output of multi-channel image data on hardware having a low-level configuration is realized.

Description

Multi-channel image data output method, device and computer equipment

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on December 3, 2019, the application number is 201911222224.6, and the invention title is "Multi-channel image data output method, device and computer equipment", the entire content of which is incorporated by reference Incorporated in this application.

Technical field

This application relates to the field of data transmission technology, and in particular to a method, device, storage medium, and computer equipment for outputting multi-channel image data.

Background technique

Real-time monitoring refers to the real-time output and display of the image data captured by the camera. Real-time monitoring can be applied to various scenarios, such as providing safety guarantee for vehicle driving and facilitating drivers and passengers to view the situation in the car. Drivers and passengers can use the on-board camera Monitor the environment inside and outside the compartment. Currently, there are single-channel vehicle-mounted cameras and multiple-channel vehicle-mounted cameras on the market.

For a multi-channel vehicle camera, the working process is: first output the analog signal of the camera through AHD (Analog High Definition), then convert it into a digital signal through a conversion IC, and pack it into MIPI-CSI2 format, and then do virtual channel interleaving for multiple channels of data Then send the MIPI interface (Mobile Industry Processor Interface, mobile industry processor interface) to the SOC (System on Chip), and the SOC receives the MIPI interleaved signal, and then deinterleaves the data to obtain the image data of each camera. Then output the display.

However, in practice, SOC is divided into high-end SOC or low-end SOC. In order to reduce production cost, low-end SOC does not add corresponding hardware equipment, so MIPI data de-interleaving is generally not supported, and MIPI multi-channel data cannot be realized. (Virtual channel) support, so after adopting low-end SOC in order to save costs, it is impossible to realize the image display of multiple cameras.

technical problem

The main purpose of this application is to provide a method, device and computer equipment for outputting multi-channel image data, aiming to solve the technical problem that the image display of multiple cameras cannot be realized after the low-end SOC is adopted in the prior art.

Technical solutions

Based on the above-mentioned purpose of the invention, an embodiment of the present application proposes a method for outputting multi-channel image data, including:

Acquire target data in sequence, each of the target data includes valid data collected by multiple-channel cameras and a target frame synchronization signal;

When the target frame synchronization signal is detected, the effective data of each channel is obtained from the target data respectively;

The effective data of each channel are respectively output in the form of outputting a complete frame of image each time.

The embodiment of the present application also proposes a device for outputting multi-channel image data, including:

An acquiring target unit for acquiring target data in sequence, each of the target data includes valid data collected by multiple channel cameras and a target frame synchronization signal;

The detection signal unit is configured to obtain the effective data of each channel from the target data when the target frame synchronization signal is detected;

The output data unit is used to output the effective data of each channel in the form of outputting a complete frame of image each time.

The embodiment of the present application also proposes a storage medium, which is a computer-readable storage medium on which a computer program is stored, and when the computer program is executed, the method for outputting multi-channel image data according to any one of the above is realized .

The embodiment of the present application also proposes a computer device, which includes a processor, a memory, and a computer program stored on the memory and capable of running on the processor. The processor implements the above Any one of the output methods of multi-channel image data.

Beneficial effect

This application proposes a method, device, and readable storage medium for outputting multi-channel image data. In this method, since the received target data includes valid data collected by multiple-channel cameras and a target frame synchronization signal, even if the The low-end SOC does not have corresponding hardware facilities, it can still identify the target data, and then restore the image data of each channel from the target data, so that the image data collected by the multi-channel camera can also be output on the basis of low cost.

Description of the drawings

FIG. 1 is a schematic flowchart of a method for outputting multi-channel image data according to an embodiment of the present application;

Figure 2 is a schematic diagram of a target data structure in an embodiment of the present application;

FIG. 3 is a schematic diagram of the target data structure in another embodiment of the present application;

4 is a schematic block diagram of the structure of a device for outputting multi-channel image data according to an embodiment of the present application;

FIG. 5 is a schematic block diagram of the structure of an embodiment of the storage medium of the present application;

Fig. 6 is a schematic structural block diagram of an embodiment of a computer device of the present application.

The realization, functional characteristics, and advantages of the purpose of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

The best mode of the present invention

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.

1, the present application provides a schematic flow chart of a method for outputting multi-channel image data. The method can be executed by an output device for multi-channel image data. The output device for multi-channel image data can specifically be in the form of software or hardware. achieve. Generally applied to low-end SOC where the hardware equipment does not support multi-channel camera image data input and single output, the embodiment of the application provides a multi-channel image data output method, including:

Step S1: Acquire target data in sequence, each of the target data includes valid data collected by multiple channel cameras and a target frame synchronization signal;

Step S2: when the target frame synchronization signal is detected, the effective data of each of the channels is obtained from the target data;

Step S3: Output the effective data of each channel in the form of outputting a complete frame of image each time.

As mentioned in the above step S1, the above target data is the converted data collected and output from the camera. First, the image data of the multiple-channel camera is output through AHD, and then converted from analog signal to digital signal through the conversion IC, and then packaged When delivered to the aforementioned SOC, the target data includes valid data from multiple channel cameras. The valid data can be data of a complete frame of image, data of a field image, or partial data of a frame of image. Among them, the obtained target data is presented in a single-channel camera data output method. In this embodiment, the single-channel camera data output method is to add a frame synchronization signal and a line synchronization signal to the effective data of the image. Signal, and the layout mode obtained by integrating the above-mentioned valid data, frame synchronization signal, and line synchronization signal in a preset manner. In this embodiment, the target data are acquired in sequence, and each target data includes valid data collected by cameras of multiple channels, a target frame synchronization signal, and a line synchronization signal. At this time, the valid data and target frame synchronization in the target data The signal and the line synchronization signal have been combined in the manner of the aforementioned single-channel camera data output. The target frame synchronization signal is used by the SOC in the process of receiving data to determine that the data can be processed. The line synchronization signal includes the line head of the image. The line header includes channel information, line information of the image frame data to which it belongs, and frame number information of the image frame to which it belongs in the frame sequence.

As mentioned in the above steps S2-S3, when the target frame synchronization signal of the target data is detected, it means that the SOC can process the target data. The valid data of each channel is independent of the valid data of the other channels. The above-mentioned target frame synchronization signal can obtain the effective data of each channel separately from the target data, and then output the effective data of each channel in the form of a complete frame of image each time, and further display the image data, looping the above Steps and display to complete the video display of each camera.

In this way, because the received target data contains valid data collected by multiple channels of cameras and a target frame synchronization signal, even if the low-end SOC does not have corresponding hardware facilities, the target data can still be identified, and then each channel can be restored from the target data. In order to realize that the image data collected by the multi-channel camera can also be output on the basis of low cost.

In an embodiment, the valid data of each of the channels carries identification information corresponding to each of the channels, and the above step S2 includes:

Step S20: According to the identification information, the effective data of each of the channels corresponding to the identification information is obtained from the target data respectively.

In this embodiment, the above-mentioned identification information is information used to identify channels. When image data is converted from an analog signal to a digital signal to form the above-mentioned target data, the identification information corresponding to each channel is added to the above-mentioned valid data. When restoring the images of each channel subsequently, the effective data of each channel can be obtained according to the identification information. Specifically, the identification information of the effective data of each channel is first identified to identify the corresponding to each effective data. Channels, and then obtain the valid data corresponding to each channel from the target data.

In an embodiment, the above step S3 includes:

Step S31: Determine whether the current valid data from each of the channels is the image data of a complete frame of image;

Step S32: If the current valid data is image data of a complete frame of image, output the current valid data;

Step S33: If the current valid data is not a complete image data of one frame of image, it is determined whether the current valid data is related to the subsequent valid data, and the subsequent valid data is the target received next time. The effective data of the channel obtained in the data, and the association relationship is used to indicate that the two effective data belong to the same frame of image;

Step S34: If there is an association relationship, merge the current valid data with the subsequent valid data to update the current valid data, and return to execute the judgment whether the current valid data of each channel is a complete frame of image Of the image data.

As mentioned in the above steps S31-S32, when acquiring the image data of the current frame of each channel, you can specify the priority to process the data of one of the channels, or process the data of all channels at the same time, or process the data of some channels at the same time, or press the preset Process the data of each channel in the order of priority. First, obtain the current valid data of the channel from the target data, and then determine whether the current valid data is the image data of a complete frame of image. It should be noted that the currently acquired target data may contain data from multiple channels, and the amount of data in each channel may be the same or different. For example, the effective data of channel A is the data of a complete frame of image, while the data of channel B is only It is the data of the field picture, the field of the C channel is the data of the field of the previous frame and the field of the current frame, or the data of the field of the current frame and the field of the next frame; therefore, first determine whether the current valid data is It is the complete image data of the same frame of image. Specifically, it can be judged by the line header of the target data whether the data of each channel is the data of a complete frame of image. For example, the line header includes the relative frame information and the real line information. , Where the frame information is the frame number of the frame where the line is located. For example, the frame number of a continuous frame picture of a video can be cycled from 0-7; the line information is the line number of the line in a real and complete frame picture, usually one complete The start line number of the line number of the frame image is 1, and the end line number is the line height n of the frame image (n is an integer greater than 1). When it is determined that the frame number of each line in the current valid data is consistent, and the line information is The row number of is arranged from sequence number 1 to sequence number n, it can be determined that the current valid data is the data of a complete frame of image. In this embodiment, the number of rows of target data is greater than the number of rows of each frame of image output by the camera Therefore, generally, the data of the same frame of image is distributed at most in two consecutive target data. If in the current valid data with the same frame sequence number, the only row sequence number is from sequence number 1 to sequence number nm (where m<n, m is an integer greater than zero), then the current valid data is the image corresponding to the frame number In the first half of the frame, these data can be buffered at this time; if the row sequence numbers of the current valid data with the same frame number are arranged from the sequence number nm (among them, m<n) to the sequence number n, it means the current valid data It may be the second half of the image frame corresponding to the frame number. At this time, the current valid data is merged with the buffered data.

As described in the above steps S33-S34, when it is determined that the current valid data is not the image data of a complete frame of image, then it is determined whether the current valid data is related to the subsequent valid data, and the subsequent valid data is the next time received For the effective data of the channel acquired in the target data, the above-mentioned association relationship is the relationship between the two effective data being data belonging to the same frame image, for example, when the two effective data are data belonging to the same frame image, and If the two pieces of data are complementary, the two valid data are combined to obtain the image data of a complete frame of image, which can be judged by the line information of the line header and the sequence number information of the frame in the frame sequence. When it is judged that the current valid data and the following If the valid data has an association relationship, the current valid data is merged with the subsequent valid data, thereby updating the current valid data in the cache, and returning to step S31, that is, it is judged again whether the merged current valid data is the image data of a complete frame of image If yes, output the image data.

When the above-mentioned current valid data and subsequent valid data are not combined into the image data of a complete frame of image, it means that the remaining data of the frame of image needs to be supplemented. At this time, the above steps S33-S34 are repeated, that is, the target data is received again. Then obtain the valid data from the corresponding channel. In order to facilitate the distinction, it is named the third valid data here, and then it is judged whether the third valid data is related to the previously merged data. If so, the third valid data Merged with the valid data after the previous two merges, and then judge whether the merged valid data is the image data of a complete frame of image, if so, output the image data, and so on, until the channel's data is obtained multiple times The valid data can be combined into image data of one frame of image, and then the image data is output.

For example, the aforementioned target data includes the valid data of the A channel and the B channel, and a target frame synchronization signal and a line synchronization signal. When the target frame synchronization signal is detected, the valid data of the A channel and the B channel are obtained through the identification information, respectively. Then it is judged whether the data of the A channel and the B channel are the image data of a complete frame of image respectively. In this embodiment, the A channel is used as a reference, and the effective data of the A channel is the image data of a complete frame of image. At this time, it can be directly output The current valid data of the A channel and the current valid data of the B channel are half-frame image data. At this time, it is determined that the current valid data of the B channel is not the image data of a complete frame of image, and then the current valid data is buffered and received When the next target data is detected and the frame synchronization signal of the target data is detected, the subsequent valid data of channel A and B are obtained again, and then the subsequent valid data of channel A is determined to be the data of a complete frame of image When outputting it and judging that the current valid data of the B channel is related to the subsequent valid data, it means that the subsequent valid data of the B channel is also the image data of the half-frame image. At this time, the current valid data of the B channel can be combined with the subsequent valid data. After the effective data is merged, the image data of a complete frame of image is obtained, and then it is output.

In another embodiment, the above-mentioned target data further includes a C channel. Assuming that the effective data of the C channel in each target data is the image data of one-third frame of image, the above steps need to be repeated. Until the effective data of the C channel acquired three times are combined, the image data of a complete frame of image is obtained, and then output.

It is worth noting that the amount of valid data for each channel is not limited here. It may be a complete frame of image data, or it may be data such as a half frame, one third or one quarter frame, or Repeat the above steps for the half-frame image data of the current frame and the one-third frame image data of the previous frame. If it is an incomplete frame, it will be buffered. If it is a complete frame or merged into a complete frame, then Output, that is, all the valid data at the end are output in the form of a complete frame of image data.

In another embodiment, if it is determined that there is no correlation between the current valid data of the channel and the later valid data, it means that there may be data loss or disorder in the process of data processing, and the current valid data can be cached. In the subsequent processing, when the effective data associated with it is obtained, the two are merged; or, the current effective data is deleted.

In an embodiment, the above step S1 includes:

Step S01: Acquire the image data of each channel in sequence;

Step S02: sequentially converting the image data acquired by each channel each time from an analog signal to a digital signal, and the digital signal includes the effective data of the image;

Step S03: Obtain the target frame synchronization signal, and pack the acquired valid data in the digital signal of each channel each time with the target frame synchronization signal to form the target data.

In this embodiment, the above-mentioned target data is obtained from a multi-channel camera. First, the image data of the multi-channel camera is output through AHD, and the image data corresponding to each channel can be obtained from multiple channels through AHD. In the process of signal conversion into digital signal, the image data is packaged in the way of single-channel camera data output to obtain the target data, that is, the effective data in the digital signal of each channel is first obtained, and then the effective data of each channel obtained each time is obtained. The data is packed with the line header and the acquired target frame synchronization signal to form the target data.

In another embodiment, the valid data in the digital signal of each channel and the corresponding frame synchronization signal of each channel are acquired. At this time, the frame synchronization signal of each channel can be defaulted as the additional valid data of the channel. Process together with the above valid data, and then pack the acquired valid data of each channel and the corresponding frame synchronization signal of each channel with the line header and the acquired target frame synchronization signal to form the target data. For example, as shown in Figure 2 is a target data that has been packaged and processed, where LH is the line header of the target data, big-FB is the target frame synchronization signal, ch0-FB, ch1-FB, ch2-FB, ch3 -FB is the frame synchronization signal of channel 0, channel 1, channel 2, and channel 3, ch0-cur, ch1-cur, ch2-cur, and ch3-cur are the current of channel 0, channel 1, channel 2, and channel 3 respectively. The valid data of the frame image, ch1-pre, ch2-pre, and ch3-pre are the valid data of the previous frame image of channel 1, channel 2, and channel 3, respectively. The specific formation process is as follows: among the data obtained from the camera through each channel, the data of each channel includes the effective data of the image, the frame synchronization signal and the line synchronization signal. In this embodiment, the effective data of the image of each channel, The frame synchronization signal is acquired together, that is, the current valid data of the image of channel 0, channel 1, channel 2, and channel 3 (ch0-cur, ch1-cur and ch1-pre, ch2-cur and ch2-pre, ch3) -cur and ch3-pre) and the frame synchronization signal corresponding to each channel (ch0-FB, ch1-FB, ch2-FB, ch3-FB), and then use the frame synchronization information of each channel as additional valid data corresponding to it The image effective data collection process of the image, and then packaged with the line header (LH) and the target frame synchronization signal (big-FB), at this time, because the frame synchronization information of each channel defaults to additional valid data, when the target data is sent to the SOC , No need to detect the frame synchronization signal of each channel, only need to detect the target frame synchronization signal, you can enter the program to obtain valid data.

In an embodiment, the above step S03 includes:

Step S031: Generate the target frame synchronization signal according to the frame synchronization signal of the digital signal of any one of the channels.

In this embodiment, each image data is converted from an analog signal to a digital signal through a conversion IC, where the digital signal includes the effective data of the image, the frame synchronization signal, and the line synchronization signal. In this embodiment, the image data of one channel is The frame synchronization signal is used as the target frame synchronization signal of the target data. Specifically, the frame synchronization signal of the image data of any channel is obtained, and then the frame synchronization signal is transformed to obtain the target frame synchronization signal, for example, the image data of channel A The frame synchronization signal has 45 lines. Only one line is used to generate the above-mentioned target frame synchronization signal, so that the capacity occupied by the target frame synchronization signal is as small as possible, and more space is reserved for the effective data of each channel. The remaining 44 lines are regarded as additional effective The data and the image effective data in the A channel are combined, and then the line synchronization signals are combined to obtain the line head of the target data, and then the target frame synchronization signal is used as the common frame synchronization signal of the image data of each channel, and the line head and the effective data of each image data Packing is performed to obtain the target data. At this time, the target data includes a set of data, a common target frame synchronization signal, and a line header formed by a collection of valid data of each channel. It is worth noting that in the process of forming the above-mentioned target data, while adding the above-mentioned target frame synchronization signal, since it needs to receive the effective data of the real image transmitted by each channel, in order not to lose data, the conversion IC needs to synchronize the above-mentioned target frame. Signal buffer, and in order to save space and avoid wasting resources, the buffer should be as small as possible. In addition, usually low-end SOC due to the limitation of hardware facilities, its processing capacity has certain requirements, and the frame synchronization signal needs to be identified within 1 line. Therefore, the target frame synchronization signal is set to 1 line. In another embodiment, the target frame synchronization signal is used as the common frame synchronization signal of the image data of each channel, and the line header, the valid data of each image data and the frame synchronization signal of the corresponding channel are packed to obtain the target data, that is, The time target data includes a set of data formed by the effective data set of each channel and its frame synchronization signal, a common target frame synchronization signal, and a line header.

In another embodiment, the above-mentioned common frame synchronization signal can also be preset. First, each image data is converted from an analog signal to a digital signal through a conversion IC, and then the corresponding valid data is obtained from each image data, and the The preset target frame synchronization signal is used as the common frame synchronization signal of the image data of each channel, and the effective data of each image data and the line header are packed to obtain the target data. Or, obtain the corresponding effective data and its corresponding frame synchronization signal from each image data, use the preset target frame synchronization signal as the common frame synchronization signal of the image data of each channel, and compare the effective data of each image data and its corresponding frame synchronization signal. Corresponding to the frame synchronization signal of each channel, and the line header packing process to obtain the above-mentioned target data.

In an embodiment, the above step S03 includes:

Step S031: Obtain the target frame synchronization signal;

Step S032: Parallel the effective data in each of the digital signals or sequentially cyclically sort the row data in the effective data of each channel;

Step S033: cyclically sort the row data in the effective data of each channel in parallel or in sequence, and pack each effective data with the target frame synchronization signal to obtain the target data.

In this embodiment, in the process of obtaining the above-mentioned target data, it can be carried out in a horizontal layout or a vertical layout, that is, each valid data is parallelized or sorted, and then processed with the target frame synchronization signal and the line header, such as Figure 2 shows that the effective data of the multi-channel camera image is assembled in a horizontal layout, that is, the effective data is juxtaposed, where LH is the line head of the target data, big-FB is the target frame synchronization signal, and ch0- FB, ch1-FB, ch2-FB, and ch3-FB are the frame synchronization signals of channel 0, channel 1, channel 2, and channel 3 respectively, and ch0-cur, ch1-cur, ch2-cur, and ch3-cur are respectively channel 0 , Channel 1, Channel 2 and Channel 3 are valid data of the current frame image, ch1-pre, ch2-pre, and ch3-pre are the valid data of the previous frame image of Channel 1, Channel 2 and Channel 3 respectively. The set of the valid data of the current frame of image and the valid data of the previous frame of image is the current valid data of the channel of the target data. In this embodiment, when the target data is acquired, the channels 0 and 0 can be obtained respectively according to the identification information. The valid data of channel 1, channel 2 and channel 3, and then the valid data of the previous frame in each channel and the valid data of the corresponding channel that have been buffered are spliced to obtain a complete frame of image and then output, and the current frame of the valid data Valid data cache, for example, for channel 1, combine the ch1-pre of the previous frame in the current valid data and the cached and associated effective data of channel 1 to obtain a complete frame of image data, and then output it The ch1-cur of the current frame in the current valid data is buffered to wait for the ch1-pre of channel 1 to be obtained from the target data received next time.

As shown in Figure 3, the effective data is assembled in a vertical layout to form the above-mentioned target data, that is, the above-mentioned target data is formed by cyclically sorting the row data of each channel, where chx line nx is the x-th line data of channel x, for example, ch1 line n1, ch2 line n2, ch3 line n3 are the first row of data of channel 1, the second row of data of channel 2, and the third row of data of channel 3. The row data in the data is cyclically sorted, and then collectively processed with the common frame synchronization signal and the line header. In this embodiment, the target data is acquired, and the frame number and the frame number of the valid data of each channel are determined according to the line header of the target data. Line number, and then successively splice the valid data of each line to restore the image data of a complete frame of image, and then output it. If it is determined that it is not a complete frame of image, the valid data will be buffered to wait for the next received target data Obtain the effective data of each channel in, repeat the above steps until the data of a complete frame of image is spliced and output.

This application also proposes a multi-channel image data output device, which is used to implement the above-mentioned multi-channel image data output method. The multi-channel image data output device can be implemented in the form of software or hardware, and is usually used in hardware equipment. Support multi-channel camera image data input single output low-end SOC. 4, the above-mentioned multi-channel image data output device includes:

The acquiring target unit 100 is configured to sequentially acquire target data, each of the target data includes valid data collected by multiple channel cameras and a target frame synchronization signal;

The detection signal unit 200 is configured to obtain the effective data of each channel from the target data when the target frame synchronization signal is detected;

The output data unit 300 is configured to output the effective data of each channel in the form of outputting a complete frame of image each time.

As described in the acquisition target unit 100, the target data is the converted data collected and output from the camera. First, the image data of the multiple-channel camera is output through the AHD, and then the analog signal is converted into the digital signal through the conversion IC, and then After being packaged and transported to the aforementioned SOC, the target data includes valid data from multiple channel cameras. These valid data can be data of a complete frame of image, data of a field image, or partial data of a frame of image. Among them, the obtained target data is presented in a single-channel camera data output method. In this embodiment, the single-channel camera data output method is to add a frame synchronization signal and a line synchronization signal to the effective data of the image. Signal, and the layout mode obtained by integrating the above-mentioned valid data, frame synchronization signal, and line synchronization signal in a preset manner. In this embodiment, the target data are acquired in sequence, and each target data includes valid data collected by cameras of multiple channels, a target frame synchronization signal, and a line synchronization signal. At this time, the valid data and target frame synchronization in the target data The signal and the line synchronization signal have been combined in the manner of the aforementioned single-channel camera data output. The target frame synchronization signal is used by the SOC in the process of receiving data to determine that the data can be processed. The line synchronization signal includes the line head of the image. The line header includes channel information, line information of the image frame data to which it belongs, and frame number information of the image frame to which it belongs in the frame sequence.

As described in the detection signal unit 200 and the output data unit 300, when the target frame synchronization signal of the target data is detected, it means that the SOC can process the target data. The valid data of each channel is mutually related to the valid data of the other channels. Independent, when the above-mentioned target frame synchronization signal is detected, the effective data of each channel can be obtained from the target data, and then the effective data of each channel is output in the form of a complete frame of image each time, and the image data can be further Perform the display, loop the above steps and perform the display to complete the video display of each camera.

In an embodiment, the valid data of each channel carries identification information corresponding to each channel, and the above-mentioned detection signal unit 200 includes:

The data obtaining subunit is configured to obtain the effective data of each of the channels corresponding to the identification information from the target data according to the identification information.

In an embodiment, the aforementioned output data unit 300 includes:

The first judging subunit is used to judge whether the current valid data from each of the channels is a complete image data of one frame of image;

The output data subunit is configured to output the current valid data if the current valid data is image data of a complete frame of image;

The second judging subunit is used for judging whether the current valid data is related to subsequent valid data if the current valid data is not a complete image data of one frame of image, and the subsequent valid data is the next valid data. The valid data of the channel acquired in the target data received at one time, and the association relationship is used to indicate that the two valid data belong to the same frame of image;

The first merging subunit is used to merge the current valid data with the subsequent valid data if there is an association relationship to update the current valid data, and return to execute the judgment whether the current valid data of each channel is Complete the image data of one frame of image.

As described in the above-mentioned first judgment subunit and output data subunit, when acquiring the image data of the current frame of each channel, you can specify to process the data of one of the channels first, or process the data of all channels at the same time, or process the data of some channels at the same time. Data, or process the data of each channel according to the preset priority order. First, obtain the current valid data of the channel from the target data, and then determine whether the current valid data is the image data of a complete frame of image. It should be noted that the currently acquired target data may contain data from multiple channels, and the amount of data in each channel may be the same or different. For example, the effective data of channel A is the data of a complete frame of image, while the data of channel B is only It is the data of the field picture, the field of the C channel is the data of the field of the previous frame and the field of the current frame, or the data of the field of the current frame and the field of the next frame; therefore, first determine whether the current valid data is It is the complete image data of the same frame of image. Specifically, it can be judged by the line header of the target data whether the data of each channel is the data of a complete frame of image. For example, the line header includes the relative frame information and the real line information. , Where the frame information is the frame number of the frame where the line is located. For example, the frame number of a continuous frame picture of a video can be cycled from 0-7; the line information is the line number of the line in a real and complete frame picture, usually one complete The start line number of the line number of the frame picture is 1, and the end line number is the line height n of the frame picture. When it is determined that the frame number of each line in the current valid data is the same, and the line numbers in the line information are arranged from the sequence number 1 to number n (n is an integer greater than 1), it can be determined that the current valid data is the data of a complete frame of image. In this embodiment, the number of rows of target data is larger than the number of rows of each frame of image output by the camera Therefore, generally, the data of the same frame of image is distributed at most in two consecutive target data. If in the current valid data with the same frame sequence number, the only row sequence number is from sequence number 1 to sequence number nm (where m<n, m is an integer greater than zero), then the current valid data is the image corresponding to the frame number In the first half of the frame, these data can be buffered at this time; if the row sequence numbers of the current valid data with the same frame number are only from the sequence number nm (among them, m<n) to the sequence number n, it means the current valid data It may be the second half of the image frame corresponding to the frame number. At this time, the current valid data is merged with the buffered data.

As described in the second judging subunit and the first merging subunit, when it is judged that the current valid data is not the image data of a complete frame of image, it is judged whether the current valid data is related to the subsequent valid data. The latter valid data is the valid data of the channel acquired in the target data received next time. The above-mentioned association relationship is the relationship between the two valid data being the data belonging to the same frame picture. For example, when the two valid data belong to the same frame. Frame image data, and they are two complementary parts of the data, then the two valid data are combined to obtain the image data of a complete frame of image, which can be judged by the line information of the line header and the sequence number information of the frame in the frame sequence. If it is determined that the current valid data has an association relationship with the later valid data, the current valid data and the later valid data are merged, thereby updating the current valid data in the cache, and returning to execute the above-mentioned first determination subunit, that is, determining the merged data again Whether the current valid data is the image data of a complete frame of image, if so, the image data is output.

When the above-mentioned current valid data and subsequent valid data are not merged into the image data of a complete frame of image, it means that the remaining data of the frame of image needs to be supplemented. At this time, repeat the above steps, namely receive the target data again, and then download the corresponding Obtain valid data from the channel. In order to facilitate the distinction, it is named the third valid data here, and then it is judged whether the third valid data is related to the previous two merged data. If so, the third valid data is compared with the first two After the merged valid data is merged, then it is judged whether the merged valid data is the image data of a complete frame of image, if it is, the image data is output, and so on, until the valid data of the channel is obtained multiple times. Combine the image data into one frame of image, and then output the image data.

It is worth noting that the amount of valid data for each channel is not limited here. It may be the data of a complete frame of image, or it may be data such as half frame or one-third or one-quarter frame, or Repeat the above steps for the half-frame image data of the current frame and the one-third frame image data of the previous frame. If it is an incomplete frame, it will be buffered. If it is a complete frame or merged into a complete frame, then Output, that is, all the valid data at the end are output in the form of a complete frame of image data.

In an embodiment, the foregoing acquisition target unit 100 includes:

The acquiring subunit is used to acquire the image data of each channel in turn;

The data conversion subunit is configured to sequentially convert the image data acquired by each channel each time from an analog signal to a digital signal, and the digital signal includes the effective data of the image;

The signal acquisition subunit is used to acquire the target frame synchronization signal, and pack the acquired valid data in the digital signal of each channel each time with the target frame synchronization signal to form the target data.

In another embodiment, the valid data in the digital signal of each channel and the corresponding frame synchronization signal of each channel are obtained. At this time, the frame synchronization signal of each channel can be defaulted as the additional valid data of the channel. Process together with the above valid data, and then pack the acquired valid data of each channel and the corresponding frame synchronization signal of each channel with the line header and the acquired target frame synchronization signal to form the target data. For example, as shown in Figure 2 is a target data that has been packaged and processed, where LH is the line header of the target data, big-FB is the target frame synchronization signal, ch0-FB, ch1-FB, ch2-FB, ch3 -FB is the frame synchronization signal of channel 0, channel 1, channel 2, and channel 3, ch0-cur, ch1-cur, ch2-cur, and ch3-cur are the current of channel 0, channel 1, channel 2, and channel 3 respectively. The valid data of the frame image, ch1-pre, ch2-pre, and ch3-pre are the valid data of the previous frame image of channel 1, channel 2, and channel 3, respectively. The specific formation process is as follows: among the data obtained from the camera through each channel, the data of each channel includes the effective data of the image, the frame synchronization signal and the line synchronization signal. In this embodiment, the effective data of the image of each channel, The frame synchronization signal is acquired together, that is, the current valid data of the image of channel 0, channel 1, channel 2, and channel 3 (ch0-cur, ch1-cur and ch1-pre, ch2-cur and ch2-pre, ch3) -cur and ch3-pre) and the frame synchronization signal corresponding to each channel (ch0-FB, ch1-FB, ch2-FB, ch3-FB), and then use the frame synchronization information of each channel as additional valid data corresponding to it The image effective data collection process of the image, and then packaged with the line header (LH) and the target frame synchronization signal (big-FB), at this time, because the frame synchronization information of each channel defaults to additional valid data, when the target data is sent to the SOC , No need to detect the frame synchronization signal of each channel, only need to detect the target frame synchronization signal, you can enter the program to obtain valid data.

In an embodiment, the foregoing signal acquisition subunit includes:

The signal generating subunit is used to generate the target frame synchronization signal according to the frame synchronization signal of the digital signal of any one of the channels.

In an embodiment, the foregoing signal acquisition subunit includes:

An acquiring target module for acquiring the target frame synchronization signal;

The sorting data module is used to parallel the effective data in each of the digital signals or sequentially cyclically sort the row data in the effective data of each channel;

The packed data module is used to pack each of the effective data and the target frame synchronization signal after parallel or sequential row data in the effective data of each channel is cyclically sorted to obtain the target data.

With reference to FIG. 5, the present application also provides a computer-readable storage medium 21. The storage medium 21 stores a computer program 22, which when running on a computer, causes the computer to execute the multi-channel image data described in the above embodiments. The output method.

6, the present application also provides a computer device 34 containing instructions. The computer device includes a memory 31 and a processor 33. The memory 31 stores a computer program 22. When the processor 33 executes the computer program 22, the description in the above embodiment is implemented. The output method of multi-channel image data.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented by software, it can be implemented in the form of a computer program product in whole or in part.

The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website, computer, server, or data center. Transmission to another website, computer, server or data center via wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be stored by a computer or a data storage device such as a server or a data center integrated with one or more available media. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)).

The above are only the preferred embodiments of this application, and do not limit the scope of this application. Any equivalent structure or equivalent process transformation made using the content of the specification and drawings of this application, or directly or indirectly applied to other related The technical field is equally included in the scope of patent protection of this application.

Claims

A method for outputting multi-channel image data, which is characterized in that it includes:

Acquire target data in sequence, each of the target data includes valid data collected by multiple-channel cameras and a target frame synchronization signal;

When the target frame synchronization signal is detected, the effective data of each of the channels is obtained from the target data;

The effective data of each channel are respectively output in the form of outputting a complete frame of image each time.
The method for outputting multi-channel image data according to claim 1, wherein the effective data of each channel carries identification information corresponding to each of the channels, and the target data is obtained separately from the target data. The steps of the valid data of each of the channels include:

According to the identification information, the valid data of each of the channels corresponding to the identification information is obtained from the target data respectively.
The method for outputting multi-channel image data according to claim 1, wherein the step of outputting the effective data of each channel in the form of outputting a complete frame of image each time comprises:

Judging whether the current valid data of each channel is a complete image data of one frame of image;

If the current valid data is image data of a complete frame of image, output the current valid data;

If the current valid data is not a complete image data of one frame of image, it is determined whether the current valid data is related to the subsequent valid data, and the subsequent valid data is obtained from the target data received next time The effective data of the channel obtained, the association relationship is used to indicate that the two effective data belong to the same frame of image;

If there is an association relationship, merge the current valid data with the subsequent valid data to update the current valid data, and return to execute the image data for judging whether the current valid data of each channel is a complete frame of image A step of.
The method for outputting multi-channel image data according to claim 1, wherein the step of sequentially acquiring target data comprises:

Sequentially acquiring the image data of each of the channels;

Sequentially converting the image data acquired from each of the channels each time from an analog signal to a digital signal, the digital signal including the effective data of the image;

Acquire the target frame synchronization signal, and pack the acquired valid data in the digital signal of each channel each time with the target frame synchronization signal to form the target data.
The method for outputting multi-channel image data according to claim 4, wherein said acquiring said target frame synchronization signal, and each acquired effective data in the digital signal of each said channel, and The step of packing the target frame synchronization signal to form the target data includes:

Acquiring the target frame synchronization signal;

Paralleling the effective data in each of the digital signals or sequentially cyclically sorting the row data in the effective data of each of the channels;

The target data is obtained by packing each of the valid data and the target frame synchronization signal after the row data in the valid data of each channel is cyclically sorted in parallel or in sequence.
The method for outputting multi-channel image data according to claim 4, wherein the digital signal of each of the channels further includes a frame synchronization signal corresponding to each of the channels; and the acquisition of the target frame synchronization signal The steps include:

The target frame synchronization signal is generated according to the frame synchronization signal of the digital signal of any one of the channels.
5. The method for outputting multi-channel image data according to claim 4, wherein the target frame synchronization signal is a preset frame synchronization signal.
A device for outputting multi-channel image data, which is characterized in that it comprises:

An acquiring target unit for acquiring target data in sequence, each of the target data includes valid data collected by multiple channel cameras and a target frame synchronization signal;

The detection signal unit is configured to obtain the effective data of each channel from the target data when the target frame synchronization signal is detected;

The output data unit is used to output the effective data of each channel in the form of outputting a complete frame of image each time.
8. The multi-channel data output device according to claim 8, wherein the valid data of each of the channels carries identification information corresponding to each of the channels, and the detection signal unit includes:

The data obtaining subunit is configured to obtain the valid data of each of the channels corresponding to the identification information from the target data according to the identification information.
8. The multi-channel data output device of claim 8, wherein the output data unit comprises:

The first judging subunit is used for judging whether the current valid data of each channel is image data for completing one frame of image;

The output data subunit is configured to output the current valid data if the current valid data is image data of a complete frame of image;

The second judging subunit is used for judging whether the current valid data is related to subsequent valid data if the current valid data is not the complete image data of one frame of image, and the subsequent valid data is the next valid data. The valid data of the channel acquired in the target data received at one time, and the association relationship is used to indicate that the two valid data belong to the same frame of image;

The first merging subunit is used to merge the current valid data with the subsequent valid data if there is an association relationship to update the current valid data, and return to execute the judgment whether the current valid data of each channel is Complete the image data of one frame of image.
8. The multi-channel data output device according to claim 8, wherein the acquisition target unit comprises:

The acquiring subunit is used to acquire the image data of each channel in turn;

The data conversion subunit is used to sequentially convert the image data acquired from each channel each time from an analog signal to a digital signal, and the digital signal includes the effective data of the image;

The signal acquisition subunit is used to acquire the target frame synchronization signal, and pack the acquired valid data in the digital signal of each channel each time with the target frame synchronization signal to form the target data.
The multi-channel data output device according to claim 11, wherein the signal acquisition sub-unit comprises:

An acquiring target module for acquiring the target frame synchronization signal;

The sorting data module is used to parallel the effective data in each of the digital signals or sequentially cyclically sort the row data in the effective data of each channel;

The packed data module is used to pack each of the effective data and the target frame synchronization signal after parallel or sequential row data in the effective data of each channel is cyclically sorted to obtain the target data.
The multi-channel data output device according to claim 11, wherein the digital signal of each of the channels further includes a frame synchronization signal corresponding to each of the channels; the signal acquisition subunit includes:

The signal generating subunit is used to generate the target frame synchronization signal according to the frame synchronization signal of the digital signal of any one of the channels.
The multi-channel data output device of claim 11, wherein:

The target frame synchronization signal acquired by the acquisition target unit is a preset frame synchronization signal.
A computer device, characterized in that it includes a processor, a memory, and a computer program stored on the memory and capable of running on the processor. The processor executes the computer program as claimed in claim 1. The output method of multi-channel image data according to any one of ~7.