CN116055680A - Video transmission system - Google Patents

Abstract

The application relates to a video transmission system, including control module, a plurality of receiving module and a plurality of storage module, receiving module with the quantity of storage module and the quantity phase-match of the input channel of waiting to transmit the video, wherein: the receiving module is used for receiving video data corresponding to the input channel and sending the video data to the storage module; the storage module is used for storing the video data and sending a transmission request to the control module; the control module is used for receiving the transmission request of the storage module, determining a target storage module based on a preset rule, and sending video data corresponding to the target storage module to receiving equipment. By utilizing the video transmission system provided by the implementation of the application to transmit the multi-channel video data, the transmission efficiency of the video data can be improved, and the splicing and splitting work of images are carried out without consuming extra resources.

Description

Video transmission system

Technical Field

The present disclosure relates to the field of image transmission technologies, and in particular, to a video transmission system.

Background

With the development of multimedia technology and the increasing demand for communication of various types of information, the demand for processing massive video information, such as mixed processing of multiple different video input sources, is required to be present in various high-end engineering fields in numerous fields such as large-screen spliced display walls, security video monitoring, video conferences, digital television equipment, education and training, business demonstration, game entertainment and the like. Therefore, how to efficiently read and write multiple paths of video data is important.

In the prior art, multiple paths of video analog signals can be converted by a multiple-path video decoding unit, and multiple paths of digital video streams can be output. And then, the FPGA can process, such as buffer and splicing and merging, the multiple paths of digital video streams to form one path of synthesized video data, so that the sampling of multiple paths of input videos by utilizing one path of video interfaces is realized. But the multi-path digital video streams are spliced and combined, so that the consumption of extra processing resources and storage resources is caused, and the expandability and the compatibility are poor.

Accordingly, there is a need in the related art for a video transmission system capable of efficiently reading multiple video data.

Disclosure of Invention

Based on the above, the present application provides a video transmission system, which can solve the problems of the related art that extra processing resources and consumption of storage resources are easily caused in the process of collecting multiple paths of video data, and scalability and compatibility are poor.

In a first aspect, an embodiment of the present application provides a video transmission system, including a control module, a plurality of receiving modules and a plurality of storage modules, the receiving modules and the number of storage modules are matched with the number of input channels of a video to be transmitted, where:

The receiving module is used for receiving video data corresponding to the input channel and sending the video data to the storage module;

the storage module is used for storing the video data and sending a transmission request to the control module;

the control module is used for receiving the transmission request of the storage module, determining a target storage module based on a preset rule, and sending video data corresponding to the target storage module to receiving equipment.

The video transmission system provided by the embodiment of the application comprises a control module, a plurality of receiving modules and a plurality of storage modules, wherein the number of the receiving modules is matched with that of input channels of video to be transmitted, and the receiving modules are as follows: the receiving module is used for receiving video data corresponding to the input channel and sending the video data to the storage module; the storage module is used for storing the video data and sending a transmission request to the control module; the control module is used for receiving the transmission request of the storage module, determining a target storage module based on a preset rule, and sending video data corresponding to the target storage module to receiving equipment. Because the video data is stored through the receiving modules and the storage modules which are in one-to-one correspondence with the input channels in the transmission process, all paths of video data do not need to be spliced, so that the video data transmission efficiency can be improved on the premise of meeting the requirement of receiving multiple paths of video data, and additional resources are not required to be consumed for splitting the image data. In addition, the resolution of the image data corresponding to the input channel and the type of the video data are not required to be unified by the receiving module, so that the compatibility of the video transmission system is higher and the application range is wider.

Optionally, in an embodiment of the present application, the receiving module is further configured to:

acquiring a frame effective signal corresponding to the video data;

analyzing the video data according to the frame effective signal, and determining each frame of image data contained in the video data;

and transmitting the channel identification information of the corresponding channel, the frame effective signal and the image data of each frame to the storage module.

Optionally, in an embodiment of the present application, the video data further includes a line valid signal, and the storage module includes a first buffer unit and a second buffer unit, specifically configured to:

according to the line effective signal and the frame effective signal, alternately storing each frame of image data line by line to a first buffer memory unit and a second buffer memory unit of the storage module, and determining storage information of each line of image data;

when the storage capacity of the first buffer unit or the second buffer unit is larger than a preset storage capacity threshold, the channel identification information, the storage information and the frame effective signal form a transmission request;

and sending the transmission request to the control module.

Optionally, in an embodiment of the present application, the storage information includes identification information of a cache unit.

Optionally, in an embodiment of the present application, the line valid signal includes an odd line valid signal and an even line valid signal, and the storing, according to the line valid signal and the frame valid signal, the image data of each frame alternately line by line into a first buffer unit and a second buffer unit of the storage module includes:

determining target frame image data to be stored according to the frame effective signal;

and storing the pixel data corresponding to the odd-numbered line effective signals of the target frame image data into the first buffer memory unit and storing the pixel data corresponding to the even-numbered line effective signals of the target frame image data into the second buffer memory unit.

Optionally, in an embodiment of the present application, the preset rule is determined according to a priority order of input channels corresponding to a plurality of storage modules.

Optionally, in an embodiment of the present application, the control module is further configured to generate a corresponding receiving request in response to a transmission request of the target storage module; sending the receiving request to the target storage module;

Correspondingly, the target storage module is further used for responding to the receiving request and sending the video data to the control module.

Optionally, in an embodiment of the present application, the control module is further configured to generate a transmission completion signal after transmitting the video data, and send the transmission completion signal to the target storage module;

correspondingly, the target storage module is further used for stopping sending the transmission request in response to the sending completion signal.

In a second aspect, an embodiment of the present application provides a data processing method, where the method is applied to the video transmission system described in the foregoing embodiments, and the method includes:

receiving a transmission request sent by the storage module; the transmission request is generated by the storage module under the condition of storing the video data sent by the receiving module;

determining a target storage module from the storage modules based on preset rules;

and receiving the video data sent by the target storage module and sending the video data to the receiving equipment.

Optionally, in one embodiment of the present application, before the receiving the transmission request sent by the storage module, the method further includes:

Acquiring a frame effective signal corresponding to the video data;

analyzing the video data according to the frame effective signal, and determining each frame of image data contained in the video data;

and transmitting the channel identification information of the corresponding channel, the frame effective signal and the image data of each frame to the storage module.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required for the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic block diagram of a video transmission system according to an embodiment of the present application;

fig. 2 is a schematic block diagram of a memory module according to an embodiment of the present application;

FIG. 3 is a schematic block diagram of a memory module according to another embodiment of the present disclosure;

FIG. 4 is a schematic diagram of a control module determining a sequence of multiple transmission request responses according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a control module determining a sequence of multiple transmission request responses according to another embodiment of the present application;

fig. 6 is a schematic diagram of a video data transmission flow of a video transmission system according to an embodiment of the present application;

fig. 7 is a method flowchart of a data processing method according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described and illustrated below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden on the person of ordinary skill in the art based on the embodiments provided herein, are intended to be within the scope of the present application. Moreover, it should be appreciated that while such a development effort might be complex and lengthy, it would nevertheless be a routine undertaking of design, fabrication, or manufacture for those of ordinary skill having the benefit of this disclosure, and thus should not be construed as having the benefit of this disclosure.

Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is to be expressly and implicitly understood by those of ordinary skill in the art that the embodiments described herein can be combined with other embodiments without conflict.

Unless defined otherwise, technical or scientific terms used herein should be given the ordinary meaning as understood by one of ordinary skill in the art to which this application belongs. Reference to "a," "an," "the," and similar terms herein do not denote a limitation of quantity, but rather denote the singular or plural. The terms "comprising," "including," "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to only those steps or elements but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. The terms "connected," "coupled," and the like in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The term "plurality" as used herein means greater than or equal to two. The terms "first," "second," "third," and the like, as used herein, are merely distinguishing between similar objects and not representing a particular ordering of objects.

In addition, numerous specific details are set forth in the following detailed description in order to provide a better understanding of the present application. It will be understood by those skilled in the art that the present application may be practiced without some of these specific details. In some instances, devices, means, elements, and circuits well known to those skilled in the art have not been described in detail in order not to obscure the subject matter of the present application.

The technical environment of the technical scheme of the application is described below. Currently, a typical video transmission system employs an additional coprocessor or circuitry when acquiring multiple video data. Therefore, before the multi-path video data is accessed to the main processor, the multi-path video data is processed (collected, buffered, combined and the like) in advance, and the multi-path video is combined into one-path video data in a mode of image splicing and progressive output, so that the function that the main processor accesses the multi-path video stream through one-path video interface is realized. However, since the image data of each frame included in the video data needs to be spliced in the process of transmitting the video data, if the user does not want to receive the combined image, the main processor is required to consume extra resources to split the image, which clearly increases extra processing work, and the video data transmission efficiency is correspondingly reduced. In addition, in the case of the optical fiber,

Based on the above technical requirements, the video transmission system provided by the application comprises a control module, a plurality of receiving modules and a plurality of storage modules, wherein the number of the receiving modules is matched with the number of input channels of video to be transmitted, and the receiving modules are as follows: the receiving module is used for receiving video data corresponding to the input channel and sending the video data to the storage module; the storage module is used for storing the video data and sending a transmission request to the control module; the control module is used for receiving the transmission request of the storage module, determining a target storage module based on a preset rule, and sending video data corresponding to the target storage module to receiving equipment. Because the video data is stored through the receiving modules and the storage modules which are in one-to-one correspondence with the input channels in the transmission process, all paths of video data do not need to be spliced, so that the video data transmission efficiency can be improved on the premise of meeting the requirement of receiving multiple paths of video data, and additional resources are not required to be consumed for splitting the image data. In addition, the resolution of the image data corresponding to the input channel and the type of the video data are not required to be unified by the receiving module, so that the compatibility of the video transmission system is higher and the application range is wider.

Referring to fig. 1, fig. 1 is a schematic structural diagram of a video transmission system 100 according to an embodiment of the present application. Illustratively, the video transmission system 100 may include a control module 30, a plurality of receiving modules 10, and a plurality of storage modules 20, the number of the receiving modules 10 and the storage modules 20 being matched to the number of input channels of video to be transmitted, wherein:

the receiving module 10 is configured to receive video data corresponding to an input channel, and send the video data to the storage module 20;

the storage module 20 is configured to store the video data and send a transmission request to the control module 30;

the control module 30 is configured to receive a transmission request from the storage module 20, determine a target storage module 20 based on a preset rule, and send video data corresponding to the target storage module 20 to a receiving device.

In this embodiment of the present application, the video to be transmitted may include video stream data acquired by an acquisition module for an area to be acquired. The area to be collected can be a road area, a park, a district and other places. The acquisition module may be an electronic device having image acquisition and data transmission capabilities. For example, the receiving module 10 may include a camera, a lidar, etc. The camera can include gun type camera, cloud platform camera, infrared camera, binocular camera, degree of depth camera etc. the laser radar can include single line radar, multi-line radar etc. this application is right the type of collection module is not restricted. The format of the video to be transmitted can be one of AVI, RMVB, MKV, WMV, flv and other arbitrary formats. In an embodiment of the present application, the number of videos to be transmitted may be multiple, and the multiple videos to be transmitted may be transmitted through multiple input channels. It can be understood that the video to be transmitted acquired by one acquisition module is transmitted only through the corresponding input channel, that is, the video to be transmitted corresponds to the input channel one by one. For example, in one example, the input channel of video a to be transmitted is input channel a, and the input channel of video B to be transmitted is input channel B. Namely, the video A to be transmitted and the input channel A are in one-to-one correspondence, and the video B to be transmitted and the input channel B are in one-to-one correspondence. The input channel may be a channel in the form of a hardware interface such as a video interface. For example, the video interface may include, but is not limited to, a low voltage differential signaling (Low Voltage Differential Signaling, LVDS) interface, a mobile industry processor interface (Mobile Industry Processor Interface, MIPI), a digital video interface (Digital Video Port, DVP), and the like. It will be appreciated that the plurality of input channels may be the same type of video interface or different types of video interfaces, and it is only necessary to ensure that the ports provided by the receiving module 10 support the video interface. In other embodiments of the present application, the input channel may also be a communication channel constructed based on a communication protocol. The communication protocol may include, for example, TCP/IP protocol, UDP protocol, HTTP protocol, FTP protocol, etc., and the form of the communication protocol is not particularly limited herein. Furthermore, the user can set channel identification information for the input channels according to actual application scenes and specific application requirements, and the channel identification information can be unique identifications capable of determining and distinguishing different input channels. For example, the channel identification information may be input channel a, input channel B, and so on. In one embodiment of the present application, the receiving modules 10 are in one-to-one correspondence with the input channels, that is, the number of receiving modules 10 is matched with the number of input channels, where the matching may include that the number of receiving modules 10 is the same as the number of input channels. Of course, the number of the receiving modules 10 may be greater than the number of the input channels, and the number difference between the two is greater than a preset number threshold, so that it is ensured that the remaining receiving modules 10 can perform receiving operation when new video data needs to be transmitted subsequently. The preset number threshold value can be determined by a user according to an actual application scene. In one embodiment of the present application, the receiving module 10 may send the video data to the storage module 20 after receiving the video data of the corresponding input channel. The receiving modules 10 are in one-to-one correspondence with the storage modules 20, that is, one storage module 20 is connected to one receiving module 10, and is used for storing video data received by the receiving module 10. The Memory module 20 may include at least one type of storage medium, which may include, for example, flash Memory, a hard disk, random access Memory (RAM, random Access Memory), static random access Memory (SRAM, static Random Access Memory), read Only Memory (ROM), electrically erasable programmable Read Only Memory (EEPROM, electrically Erasable Programmable Read Only Memory), programmable Read Only Memory (PROM, programmable Read Only Memory), magnetic Memory, magnetic disk, optical disk, and the like. In one embodiment of the present application, as shown in fig. 2, the storage module 20 may include not only a first storage unit 101, such as a RAM, for storing video data, but also a second storage unit 103, such as a first-in first-out memory (First In First Out, FIFO), for storing storage information of video data. The stored information may include, for example, a source of video data such as identification information of a corresponding input channel, a frame valid signal, a line valid signal, and the like.

In this embodiment, the storage module 20 may store the video data when receiving the video data. Specifically, the received video data may be sequentially stored according to the transmission sequence. Further, in order to prevent the video data transmitted later from overlapping the video data stored earlier, the storage module 20 may be allocated with a plurality of buffer areas, and different buffer areas may sequentially store different frame image data included in the video data according to a capture frame rate, where the capture frame rate may be 1fps, 2fps, 5fps, and so on. In one embodiment of the present application, in order to enable a receiving device to receive the video data timely and efficiently, the storage module 20 sends a transmission request when storing the video data, so as to serve as a notification to the control module 30 that the storage module 20 has performed a storage operation. For example, the transmission request may be sent at the beginning of the storage of the video data by the storage module 20 or for a period of time. The data transmission request may include information about the video data, such as an input channel corresponding to the video data, a storage address of the video data, and so on.

In addition, in practical application, since the video data may include multiple frames of image data, in order to distinguish different frames of image data and facilitate subsequent storage of video data, frame valid signals of the video data may be sent together in the process of sending the video data. Specifically, in one embodiment of the present application, the receiving module 10 is further configured to:

s101: acquiring a frame effective signal corresponding to the video data;

s103: analyzing the video data according to the frame effective signal, and determining each frame of image data contained in the video data;

s105: the channel identification information of the corresponding channel, the frame valid signal, and the respective frame image data are transmitted to the storage module 20.

In this embodiment of the present application, the video data not only includes multi-frame image data, but also includes image enabling signals such as a frame valid signal, a line valid signal, a data output valid signal, a standby signal, and the like. The line valid signal is used for the start and end of one line of image data, and the frame valid signal is used for indicating the start and end of one frame of image data. On this basis, the video data may be parsed according to the frame valid signal, and each frame of image data included in the video data may be determined. For example, in one example, a frame of image data may be acquired when the frame valid signal is on a rising edge, and the acquisition of the frame of image data may be ended when the frame valid signal is on a falling edge, i.e., a frame of image data may be determined. Of course, in the example of the present application, it is also possible to determine the start flag of one frame of image data according to the frame valid signal, and determine the end flag of the one frame of image according to the length of the one frame of image data when the start flag of the current frame of image is found. And then determining each frame of image data contained in the video data according to the start mark and the end mark of each frame of image. After determining each frame of image data, the identification information of the corresponding channel, the frame valid signal and the frame of image data may be sent to the storage module 20, and the storage module 20 performs subsequent storage operations.

In practical applications, the image data is made up of a row of pixel data. That is, one frame of image data may be stored to the storage module 20 in units of lines in the application scene. In one embodiment of the present application, in order to prevent the pixel data of the next line from overlapping the pixel data of the previous line, two buffer units, such as the first storage unit 101 and the second storage unit 103, may be divided for the storage module 20 to alternately store the pixel data corresponding to different lines of the image data of one frame. As shown in fig. 3, the first storage unit 101 in the storage module 20 may include a first buffer unit 1031 and a second buffer unit 1033. Since the buffer unit, such as the first buffer unit 1031, is used for storing each line of pixel data of one frame of image data, the minimum storage space of the buffer unit needs to be equal to or greater than the storage space occupied by the line of pixel data, so as to ensure that the buffer unit can finish storing one line of pixel data. Specifically, the video data further includes a line valid signal, and the storage module 20 includes a first buffer unit 1031 and a second buffer unit 1033, specifically configured to:

s201: according to the line valid signal and the frame valid signal, the image data of each frame is alternately stored line by line in the first buffer unit 1031 and the second buffer unit 1033 of the storage module 20, and storage information of each line of image data is determined;

S203: when the storage capacity of the first buffer unit 1031 or the second buffer unit 1033 reaches a preset storage capacity threshold, forming a transmission request by the channel identification information, the storage information and the frame valid signal;

s205: the transmission request is sent to the control module 30.

In this embodiment, after each frame of image data included in video data is determined according to the above embodiment, identification information may be set for each frame of image data according to the acquisition order or the reception order for determining and distinguishing different frames of image data, for example, may be set as image frame 1, image frame 2, image frame 3, image frame 4, and so on. Thereafter, the different frames of image data may be sequentially stored in the acquisition order or the reception order. For example, the storage operation of the image frame 1 may be performed first, and then the storage operation of the image frame 2 may be performed. In one embodiment of the present application, the storage operation of the storage module 20 is described by taking the image frame 1 as an example. The image frame 1 may be composed of a plurality of lines of pixel data, and each line of pixel data contained in the image frame 1 may be determined based on the line valid signal. In one embodiment of the present application, in order to prevent the pixel data of the next row, such as the second row, from overlapping the pixel data of the previous row, such as the first row, during the storage process, the pixel data of different rows may be alternately stored in the first buffer unit 1031 and the second buffer unit 1033 according to the acquisition order or the receiving order of each row of pixels. Specifically, in one embodiment of the present application, the line valid signal may include an odd line valid signal and an even line valid signal, and the storing the frame image data alternately line by line into the first buffer unit 1031 and the second buffer unit 1033 of the storage module 20 according to the line valid signal and the frame valid signal includes:

S301: determining target frame image data to be stored according to the frame effective signal;

s303: the pixel data corresponding to the odd-numbered line effective signals of the target frame image data are stored in the first buffer unit 1031 and the pixel data corresponding to the even-numbered line effective signals of the target frame image data are stored in the second buffer unit 1033.

In the embodiment of the application, the pixels are basic units of an image, and each pixel forms a frame of image data. One frame of image data is typically composed of a plurality of lines of pixel data. For example, a frame of image data has 1800X1000 pixels, meaning that the frame of image data has 1800 pixels per line, for a total of 1000 lines. On this basis, the line valid signals may include odd line valid signals such as line 1 valid signal, line 3 valid signal, line 5 valid signal … … line 999 valid signal, and so on. The row valid signals also include even row valid signals such as row 2 valid signals, row 4 valid signals, row 6 valid signals … …, row 1000 valid signals, and so forth. For example, in one example, after determining that the target frame image data that the storage module 20 needs to store currently is the 5 th frame image data in the video data, the first line of pixel data corresponding to the 1 st line valid signal of the 5 th frame image data may be stored to the first buffer unit 1031. And then, the second line of pixel data corresponding to the 2 nd line of effective signal of the 5 th frame of image data may be stored in the second buffer unit 1033, and the third line of pixel data corresponding to the 3 rd line of effective signal of the 5 th frame of image data may be stored in the first buffer unit 1031, so as to store in a cyclic manner, until the storage of the 5 th frame of image data is completed. It can be appreciated that the buffering workflow of the second buffering unit 1033 is the same as that of the first buffering unit 1031, and will not be described herein.

With the above-described embodiments, when storing each frame of image data included in video data, the entire image can be stored in different buffer units in units of lines without storing the entire image in the same storage space. Thus, the problem of time delay in the unit of 'frame' in video data transmission data can be avoided, and the video data transmission efficiency can be improved.

In this embodiment, the first buffer unit 1031 and the second buffer unit 1033 may be provided with identification information, for example, the identification information of the first buffer unit 1031 may be "buffer unit a", and the identification information of the second buffer unit 1033 may be "buffer unit B". In the case where the first buffer unit 1031 stores the first line of pixel data, the storage information of the first line of pixel data may be determined according to the identification information of the first buffer unit 1031 and the line valid signal corresponding to the first line of pixel data, for example, the storage information of the first line of pixel data is determined to be the buffer unit a-1 st line valid signal. In one embodiment of the present application, the storage information, the channel identification information, and the frame valid signal may be stored in the FIFO memory. In one embodiment of the present application, the frame valid signal may be used not only to determine the start and end of a frame of image data, but also as identification information of the frame of image data, to indicate that each line of pixel data in the frame of image data is derived from the frame of image data. In an embodiment of the present application, in a case where the storage capacity of the first buffer unit 1031 is greater than a preset storage capacity threshold, the storage module 20 may send a transmission request to the control module 30, as in the FIFO memory, where the transmission request may be composed of the channel identification information, the storage information, and the frame valid signal. It will be appreciated that the preset storage capacity may be determined by a user according to the image width of the image data and the read/write efficiency of the storage module 20. The image width may be the number of one line of pixel data, and if the pixels of one frame of image data are 1800X1000, the image width is 1800. Of course, in other embodiments of the present application, the transmission request may also be sent to the control module 30 when it is determined that the empty-full flag of the FIFO memory is not the empty flag. The empty-full flag may include an empty flag, a full flag, etc. The full flag may be a signal sent by a status circuit of the FIFO memory when the FIFO memory is full or about to be full. The empty flag may be a signal sent by a status circuit of the FIFO memory when the FIFO memory is empty or is about to empty. Because the FIFO memory is a first-in first-out read-write rule, the related information of the first row of pixel data written first can be read first, so that the transmission request of the first row of pixel data can be sent first. Therefore, the video data stored first can be read first and cannot be covered by the subsequent video data, and the transmission efficiency of the video data is further improved.

In this embodiment, the control module 30 may be an electronic device having data processing capability and data transceiving capability, for example, the control module 30 may be a central processing unit (Central Processing Unit, CPU), a general purpose processor, a data signal processor (Digital Signal Processor, DSP), an application specific integrated circuit module (Application Specific Integrated Circuit, ASIC), a Field-programmable gate array module (Field-Programmable Gate Array, FPGA) or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. The control module 30 may be connected to a plurality of memory modules 20, i.e. the control module 30 may receive a plurality of memory sent corresponding transmission requests. That is, the control module 30 may receive multiple transmission requests at the same time. In one embodiment of the present application, to prevent the simultaneous reception of video data sent by a plurality of storage modules 20, the control module 30 arbitrates a plurality of transmission requests to determine a target transmission request that can be responded to, so as to receive video data sent by a storage module 20 corresponding to the transmission request. For example, the control module 30 may determine the target storage module 20 from the plurality of storage modules 20 based on a preset rule to receive the video data transmitted from the target storage module 20. In one embodiment of the present application, the preset rule may be determined according to the priority order of the input channels corresponding to the plurality of storage modules 20. Specifically, the importance level or the transmission emergency level of different video data may be different due to other factors such as the importance level of the region to be acquired or the acquisition time. For example, in an autonomous vehicle, the video data a is video data collected by the collection module a of the autonomous vehicle for a front road, and the video data B is video data collected by the collection module B of the autonomous vehicle for a rear road. In this application scenario, the importance of the video data a is higher than that of the video data B. That is, the input channel a transmitting the video data a is more important than the input channel B transmitting the video data B. Thus, the priority order of the different input channels is different. Therefore, when the control module 30 receives the transmission requests sent by the storage modules 20 corresponding to different input channels at the same time, the transmission requests that are preferentially responded can be determined according to the priority orders of the input channels corresponding to the storage modules 20, and the corresponding target storage modules 20 can be determined accordingly. For example, in one example, the priority order of the N input channels is from high to low, input channel 1 to input channel N, respectively. I.e. input channel 1 has the highest priority and input channel N has the lowest priority. When the storage module 20 corresponding to a plurality of N input channels initiates a transmission request, the control module 30 may determine a response transmission request based on the priority order of the N input channels. Specifically, as shown in fig. 4, in the case that it is determined that the storage module 20 corresponding to the input channel 1 sends a transmission request, a next round of judgment step may be performed after responding to the transmission request sent by the storage module 20 corresponding to the input channel 1; in the case that it is determined that the memory module 20 corresponding to the input channel 1 does not transmit the transmission request, it is determined whether the memory module 20 corresponding to the input channel 2 transmits the transmission request, and it is determined whether the memory module 20 corresponding to the input channel 2 transmits the transmission request or whether the next determination step needs to be ended according to the determination result. And sequentially judging according to the priority order until finishing the judgment of whether the N input channels correspond to the storage modules 20 to send the transmission requests. By determining the target transmission request (the target storage module 20) according to the preset rule, the video data transmitted by the input channel with high priority can be transmitted preferentially, so that the video data meets the actual application scene requirement better.

Of course, in other application scenarios, if the multiple input channels do not have an obvious priority order or the collected multiple video data do not need to be transmitted in sequence, it may also be sequentially determined whether the storage modules 20 corresponding to the multiple input channels send the transmission request according to the natural arrangement sequence of the multiple input channels. For example, in one example, as shown in fig. 5, in a case where it is determined that the memory module 20 corresponding to the input channel 1 transmits a transmission request, a determination operation of whether the memory module 20 corresponding to the input channel 2 transmits the transmission request may be performed in response to the transmission request; in addition, when it is determined that the memory module 20 corresponding to the input channel 1 does not transmit the transmission request, a determination is made as to whether the memory module 20 corresponding to the input channel 2 transmits the transmission request. In this way, in one judging process, the data transmission efficiency can be improved in response to the transmission requests sent by the storage modules 20 corresponding to the plurality of input channels.

In this embodiment, after determining the target storage module 20, the control module 30 may receive the video data sent by the storage module 20. In this process, the target storage module 20 and the control module 30 may implement a handshake interaction. Specifically, in one embodiment of the present application, the control module 30 is further configured to: generating a corresponding reception request in response to the transmission request of the target storage module 20; sending the reception request to the target storage module 20;

Correspondingly, the target storage module 20 is further configured to: in response to the reception request, the video data is transmitted to the control module 30.

In this embodiment, the control module 30 may respond to the transmission request of the target storage module 20, generate a corresponding receiving request, and send the receiving request to the target storage module 20, so as to play a role of informing the target storage module 20 that the stored video data can be sent to the control module 30. The target storage module 20 may respond to the reception request by storing video data and related information such as channel identification information, frame valid signal after receiving the reception request. Stored information, etc. is sent to the control module 30. Thus, handshake interaction between the target storage module 20 and the control module 30 can be completed, and video data transmission can be realized. Furthermore, the target storage module 20 may also send the channel identification information, the storage information, the frame valid signal, and other information together during the process of sending the video data, so that the subsequent receiving device may quickly and accurately determine which line of pixel data in which frame of image data in the video data the received data belongs to when receiving the video data, thereby quickly completing the task under the condition of having an image stitching requirement.

In this embodiment, after receiving the video data sent by the target storage module 20, the control module 30 may send the video data to the receiving device. The receiving device may be a host processor or other electronic device having data transmission and data processing. It should be noted that, in one embodiment of the present application, in order to avoid overlapping between one line of pixel data, the control module 30 needs to have a capability of transmitting, to the receiving device, all one line of pixel data stored by each receiving module that sends a transmission request within one line of pixel data storage time, that is, the control module 30 needs to have a certain processing efficiency and a certain transmitting efficiency. In one embodiment of the present application, the control module 30 is further configured to generate a transmission completion signal after transmitting the video data, and generate the transmission completion signal to the storage module 20; correspondingly, the target storage module 20 is further configured to stop sending the transmission request in response to the sending completion signal. In this way, the transmission completion information can be fed back to the target storage module 20 in time, so that the target storage module 20 performs subsequent video data transmission work, and the video data transmission efficiency is improved.

The video data transmission process of the video transmission system is described below with a specific example. As shown in fig. 6, the memory modules may include a first memory cell or a second memory cell write control module 105, a first memory cell 101, a second memory cell 103, a first memory cell or a second memory cell read control module 107. The second storage unit 103 may further include a first buffer unit 1031 and a second buffer unit 1033. The first storage unit or the second storage unit writing control module is connected with the access module and used for receiving each frame of image data, channel identification information, row effective signals and frame effective signals sent by the access module. The first storage unit or the second storage unit write control module may alternately store each line of data of one frame of image data in the first buffer unit 1031 or the second buffer unit 1033. For example, the first storage unit or the second storage unit write control module 105 may store the first row of pixel data corresponding to the 1 st row valid signal of the 5 th frame of image data to the first buffer unit 1031, and store the channel identification information, the frame valid signal, and the identification information of the first buffer unit 1031 to the first storage unit 101, such as a FIFO memory, in a case where the depth of writing the first row of pixels into the first buffer unit 1031 is greater than a preset threshold. In case the empty-full flag of the FIFO memory is not empty, the FIFO memory may send a transfer request to the control module 30 via the first storage unit or the second storage unit read control module 107. In the case where the control module responds to the transmission request, a data reception request may be generated and transmitted to the first storage unit or the second storage unit read control module 107. The first storage unit or the second storage unit read control module 107 may, in response to the data receiving request, retrieve a set of data from the FIFO memory, determine storage information in the set of data, and determine a corresponding cache unit, such as the first cache unit 1031, according to the storage information. After that, one line of pixel data of the first buffer unit 1031 may be read and output onto the image data signal while enabling the data valid flag. It will be appreciated that the frame valid information read out from the FIFO memory and the channel identification information need to be output to the control module 30 together at the same time as the image data is output. Finally, after the control module is further configured to generate a transmission completion signal after the video data is transmitted, and send the transmission completion signal to the first storage unit or the second storage unit read control module 107, the storage module 10 ends the transmission of the transmission request, so as to complete the transmission of the video data (transmission of a line of pixel data).

The video transmission system 100 provided in the embodiment of the present application includes a control module 30, a plurality of receiving modules 10 and a plurality of storage modules 20, where the number of the receiving modules 10 and the storage modules 20 is matched with the number of input channels of a video to be transmitted, and the video transmission system includes: the receiving module 10 is configured to receive video data corresponding to an input channel, and send the video data to the storage module 20; the storage module 20 is configured to store the video data and send a transmission request to the control module 30; the control module 30 is configured to receive a transmission request from the storage module 20, determine a target storage module 20 based on a preset rule, and send video data corresponding to the target storage module 20 to a receiving device. Because the video data is stored through the receiving module 10 and the storage module 20 which are in one-to-one correspondence with the input channels in the transmission process, all paths of video data do not need to be spliced, so that the video data transmission efficiency can be improved on the premise of meeting the requirement of receiving multiple paths of video data, and the image data splitting is performed without consuming additional resources. In addition, the resolution of the image data corresponding to the input channel and the type of the video data are not required to be uniform by the receiving module 10, so that the compatibility of the video transmission system 100 is higher and the application range is wider.

In another aspect, the present application further provides a data processing method, where the method is applied to the video transmission system described in the foregoing embodiments, as shown in fig. 7, and the method may include:

s401: receiving a transmission request sent by the storage module; the transmission request is generated by the storage module under the condition of storing the video data sent by the receiving module;

s403: determining a target storage module from the storage modules based on preset rules;

s405: and receiving the video data sent by the target storage module and sending the video data to the receiving equipment.

Optionally, in one embodiment of the present application, before the receiving the transmission request sent by the storage module, the method further includes:

s501: acquiring a frame effective signal corresponding to the video data;

s503: analyzing the video data according to the frame effective signal, and determining each frame of image data contained in the video data;

s505: and transmitting the channel identification information of the corresponding channel, the frame effective signal and the image data of each frame to the storage module.

Specific method flow steps may refer to specific functions and operations of the control module or other modules in the foregoing embodiments, which are not described herein.

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of devices, systems, methods according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.

The above examples merely represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the invention. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application is to be determined by the claims appended hereto.

Claims (10)

1. The utility model provides a video transmission system which characterized in that, includes control module, a plurality of receiving module and a plurality of storage module, the receiving module with the quantity of storage module matches with the quantity of the input channel of waiting to transmit the video, wherein:

the receiving module is used for receiving video data corresponding to the input channel and sending the video data to the storage module;

the storage module is used for storing the video data and sending a transmission request to the control module;

the control module is used for receiving the transmission request of the storage module, determining a target storage module based on a preset rule, and sending video data corresponding to the target storage module to receiving equipment.

2. The system of claim 1, wherein the receiving module is further configured to:

acquiring a frame effective signal corresponding to the video data;

analyzing the video data according to the frame effective signal, and determining each frame of image data contained in the video data;

and transmitting the channel identification information of the corresponding channel, the frame effective signal and the image data of each frame to the storage module.

3. The system according to claim 2, wherein the video data further comprises a line valid signal, and the storage module comprises a first buffer unit and a second buffer unit, specifically configured to:

according to the line effective signal and the frame effective signal, alternately storing each frame of image data line by line to a first buffer memory unit and a second buffer memory unit of the storage module, and determining storage information of each line of image data;

when the storage capacity of the first buffer unit or the second buffer unit is larger than a preset storage capacity threshold, the channel identification information, the storage information and the frame effective signal form a transmission request;

and sending the transmission request to the control module.

4. A system according to claim 3, wherein the stored information comprises identification information of the cache unit.

5. A system according to claim 3, wherein the line valid signals include an odd line valid signal and an even line valid signal, and the storing of the frame image data alternately line by line into the first buffer unit and the second buffer unit of the memory module according to the line valid signal and the frame valid signal comprises:

Determining target frame image data to be stored according to the frame effective signal;

and storing the pixel data corresponding to the odd-numbered line effective signals of the target frame image data into the first buffer memory unit and storing the pixel data corresponding to the even-numbered line effective signals of the target frame image data into the second buffer memory unit.

6. The system of claim 1, wherein the predetermined rule is determined according to a priority order of the input channels corresponding to the plurality of memory modules.

7. The system of claim 1, wherein the control module is further configured to generate a corresponding receive request in response to a transmission request from the target storage module; sending the receiving request to the target storage module;

correspondingly, the target storage module is further used for responding to the receiving request and sending the video data to the control module.

8. The system of claim 1, wherein the control module is further configured to generate a transmission completion signal after transmitting the video data, and transmit the transmission completion signal to the target storage module;

correspondingly, the target storage module is further used for stopping sending the transmission request in response to the sending completion signal.

9. A data processing method, characterized in that the method is applied to a video transmission system according to any one of claims 1-8, the method comprising:

receiving a transmission request sent by the storage module; the transmission request is generated by the storage module under the condition of storing the video data sent by the receiving module;

determining a target storage module from the storage modules based on preset rules;

and receiving the video data sent by the target storage module and sending the video data to the receiving equipment.

10. The method of claim 9, further comprising, prior to said receiving the transmission request sent by the storage module:

acquiring a frame effective signal corresponding to the video data;

analyzing the video data according to the frame effective signal, and determining each frame of image data contained in the video data;

and transmitting the channel identification information of the corresponding channel, the frame effective signal and the image data of each frame to the storage module.

Images