CN110233985B - Data transmission method and network video monitoring device - Google Patents

Data transmission method and network video monitoring device Download PDF

Info

Publication number
CN110233985B
CN110233985B CN201810182386.0A CN201810182386A CN110233985B CN 110233985 B CN110233985 B CN 110233985B CN 201810182386 A CN201810182386 A CN 201810182386A CN 110233985 B CN110233985 B CN 110233985B
Authority
CN
China
Prior art keywords
data
frame
definition video
tag
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810182386.0A
Other languages
Chinese (zh)
Other versions
CN110233985A (en
Inventor
罗洪
马翔
贾夕阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xilinx Inc
Original Assignee
Xilinx Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xilinx Inc filed Critical Xilinx Inc
Priority to CN201810182386.0A priority Critical patent/CN110233985B/en
Publication of CN110233985A publication Critical patent/CN110233985A/en
Application granted granted Critical
Publication of CN110233985B publication Critical patent/CN110233985B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor
    • H04N5/92Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N5/9201Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving the multiplexing of an additional signal and the video signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A data transmission method and a network video monitoring device are provided. The data transmission method of the invention comprises the following steps: packaging the data into a data frame; transmitting the data frames frame by using a high-definition video interface; receiving data frames frame by using a high-definition video interface; the data in the data frame is parsed. The data includes both high definition video and other types of data other than high definition video. The data frame is a high-definition video frame suitable for being sent and received by the high-definition video interface. The data frame includes a tag, placed at the beginning of the data frame, for indicating information about the data encapsulated in the data frame. According to the invention, the high-definition video interface can be used for transmitting not only high-definition videos but also non-high-definition videos and more common data, and an additional interface is not required to be prepared for other data transmission besides the high-definition videos, so that the cost and complexity of the whole system are reduced, and the stability of the whole system is facilitated.

Description

Data transmission method and network video monitoring device
Technical Field
The present invention relates to data communication, and more particularly, to a data transmission method and a network video monitoring apparatus.
Background
An internet protocol camera (IP camera, abbreviated as IPC) is a widely used monitoring device, and usually has a built-in digital compression controller and a WEB-based operating system in addition to the image capturing function of a general conventional camera, so that video data can be transmitted to a terminal user through an internet after being compressed and encrypted. Part of IPC also provides alarm input and output interface, supports UPnP (Universal Plug and Play), mobile detection, mail alarm and other additional functions.
At present, with the development of Artificial Intelligence (AI) technology, the AI technology is also applied in the field of security monitoring, and more intelligent IPCs with AI functions appear in the market. These AI functions include, for example, automatic face capture and recognition functions. In the intelligent IPC, video data acquired by an image sensor is required to be sent to a network like the traditional IPC, and the video is required to be transmitted to a corresponding intelligent processing module. One of the standard ways that IPC can be used for video transmission is the BT1120 interface.
BT1120 is a widely used high definition video transmission interface, and can be used for point-to-point unidirectional transmission 1080p full high definition format (HDTV) video, and the video resolution thereof is 1920 × 1080. BT1120 is based on the YCbCr 4:2:2 data format and can transmit 1080p @60Hz video, which is equivalent to 240MB/s bandwidth and is higher than the peak bandwidth of gigabit Ethernet. Thus, a number of current video solutions provide the video output interface of BT 1120.
BT1120 is a recommendation of the International Union of Electrical communications (ITU), and the latest standard is ITU-R BT.1120-8 (see ITU-R BT.1120 standard, http:// www.itu.int/REC/R-REC-BT.1120/en). The data structure it employs depends on the proposed standard of BT709 (see ITU-R BT.709 standard, https:// www.itu.int/REC/R-REC-BT.709/en).
BT709 specifies the pixel size, format, color conversion formula, encoding format, and level synchronization specification for High Definition Television (HDTV) systems.
BT1120 specifies the bit serial interface for HDTV signals based on the image format described by BT 709. The BT1120 interface is a unidirectional data interface, and includes image data, timing reference and identification code, and auxiliary data, etc., wherein the image data uses 10-bit words by default, and for 8-bit video data, 0 will be supplemented and extended to 10-bit.
BT1120 adopts YCbCr 4:2:2 data format, namely, (Cb0Y0) (Cr0Y1) (Cb1Y2) (Cr1Y3), where each 2 luminance signals Y corresponds to a group of chrominance signals Cb, Cr, which can effectively save data amount. In addition, the BT1120 recommendation specifies coding parameters, sampling frequencies, etc. for different video transmission systems (e.g. 60 frame progressive, 60 frame interlaced, etc.).
In practice, however, there are many occasions when various types of data need to be transmitted, including not only high-definition video but also non-high-definition video, and even non-video data (such as still pictures or other data). In this case, it is generally necessary to use another interface for transmission. That is, the BT1120 interface itself already occupies a high bandwidth to transmit high definition video, but in order to transmit other data, other interfaces, such as an ethernet transmission interface, a USB interface, etc., need to be used. Such multi-interface transmission increases the cost and complexity of the overall system, and is not favorable for the stability of the system.
Disclosure of Invention
The embodiment of the invention provides a data transmission method and a network video monitoring device, which are used for solving the problem that other interfaces are required to transmit non-high-definition videos or other types of data while high-definition videos are transmitted by using a high-definition video interface in the prior art, and realizing the purpose that all types of data are transmitted by using a high-bandwidth interface, so that the cost and complexity of a system are reduced and the stability of the system is improved.
To achieve the object of the present invention, according to a first aspect of the present invention, there is provided a data transmission method. The method comprises the following steps: packaging the data into a data frame; transmitting the data frames frame by using a high-definition video interface; receiving data frames frame by using a high-definition video interface; the data in the data frame is parsed. The data comprises high-definition video and other types of data except the high-definition video; the data frame is a high-definition video frame suitable for being sent and received by the high-definition video interface; the data frame includes a tag, which is placed at the beginning of the data frame, for indicating information about the data encapsulated in the data frame.
Preferably, the high-definition video interface is a BT1120 interface, and the high-definition video is a 1080p video. When non-standard BT1120 data is transmitted, the data is packed only on the luminance component position of the high definition video frame.
Preferably, when the transmitted data is high definition video, the tag may be placed at a position occupying the first several pixel data of the high definition video frame.
Preferably, the tag may include at least one of the following information: a sequence number of the current frame; a time stamp; the type of data within the current frame.
Preferably, when multiple sets of data are transmitted on one data frame, the tag may further include concatenation information between the multiple sets of data, and the multiple sets of data are parsed at the receiving end according to the information on the tag.
On the other hand, when a set of data is transmitted on more than one data frame, the tag may further include frame combining information for combining the data in each data frame into a complete set of data, and the data is parsed at the receiving end according to the information of the tag on more than one data frame.
Preferably, when the data is not high definition video, the data may be encoded before being encapsulated, so that the encoded data avoids occurrence of the same sequence as the timing reference code; after parsing the data, the data is correspondingly decoded to recover the original data.
Preferably, the step of receiving the data frames frame by using the high definition video interface, and parsing the data in the data frames may further include: and comparing the labels of the data frames, and if the labels of the next frame and the previous frame are the same, not storing and processing the next frame data.
In order to achieve the object of the present invention, according to a second aspect of the present invention, a network video monitoring apparatus is provided. The apparatus may include: the video acquisition unit is used for acquiring an original video; the video transmission unit is used for compressing the original video through coding and then transmitting the original video through a network; a video decoding unit for decoding the transmitted video into a decompressed video; a data packing unit for packing data including the decompressed video into a data frame; a data transmitting unit for transmitting the data frames frame by using a high-definition video interface; a high-definition video interface; the data receiving unit is used for receiving the data frames frame by using a high-definition video interface; the data analysis unit is used for analyzing the data in the data frame; and the data processing unit is used for carrying out artificial intelligence processing on the received video. The data encapsulation unit further comprises a tag adding subunit for adding a tag at the beginning of the data frame, the tag being used to indicate information about the data encapsulated in the data frame. The data parsing unit further comprises a tag reading subunit for reading a tag from the beginning of the data frame. The data includes both high definition video and other types of data other than high definition video. The data frame is a high-definition video frame suitable for being sent and received by a high-definition video interface.
Preferably, the high-definition video interface is a BT1120 interface, and the high-definition video is a 1080p video. When the data transmission unit transmits non-standard BT1120 data, the data encapsulation unit is further configured to encapsulate the data only at a luminance component position of a high definition video frame.
Preferably, when the data transmitted by the data transmitting unit is a high definition video, the tag adding subunit is further configured to add the tag at a position occupying the first several pixel data of the high definition video frame.
Preferably, the tag comprises at least one of the following information: a sequence number of the current frame; a time stamp; the type of data within the current frame.
Preferably, when the data sending unit sends multiple sets of data on one data frame, the tag further includes concatenation information between the multiple sets of data, and the data parsing unit is configured to parse the multiple sets of data according to the information on the tag.
On the other hand, when the data sending unit sends a set of data on more than one data frame, the tag further includes frame combining information for combining the data in each data frame into a set of complete data, and the data parsing unit is configured to parse the set of data according to the information of the tag on more than one data frame.
Preferably, when the data is not high definition video, the apparatus further comprises a data encoding unit for encoding the data before the data is encapsulated by the data encapsulating unit, so that the encoded data avoids the same sequence as the timing reference code; and the device further comprises a data decoding unit for performing corresponding decoding on the data after the data parsing unit parses the data to recover the original data.
Preferably, the data parsing unit further includes a deduplication subunit, configured to compare tags of the data frames, and if a tag of a subsequent frame is the same as a tag of a previous frame, no longer save and process the data of the subsequent frame.
The invention has the advantages that the high bandwidth of a high-speed video interface (such as BT 1120) is utilized to transmit non-1080 p video data (including non-video data), and no additional interface is required to be prepared for other data transmission, such as an Ethernet transmission interface, a USB interface and the like, so that the cost of the whole system can be reduced, the complexity of the system can be reduced, and the stability of the whole system is facilitated.
Drawings
The invention is described below with reference to the embodiments with reference to the drawings.
Fig. 1 shows a flow chart of a data transmission method according to a first embodiment of the invention.
Fig. 2 shows the application of the BT1120 interface in a second embodiment of the invention.
Fig. 3 shows a high definition video frame structure comprising tags according to a second embodiment of the present invention.
Fig. 4 shows a schematic diagram of transmitting multiple images according to a third embodiment of the present invention.
Fig. 5 is a diagram illustrating the transmission of one large file using multiple frames according to a fourth embodiment of the present invention.
Fig. 6 is a diagram illustrating a fifth embodiment of the present invention in which a plurality of small files are transmitted using one frame.
Fig. 7 shows a schematic block diagram of a network video monitoring apparatus according to a sixth embodiment of the present invention.
Detailed Description
The drawings are only for purposes of illustration and are not to be construed as limiting the invention. The technical solution of the present invention is further described below with reference to the accompanying drawings and examples.
Fig. 1 shows a flow chart of a data transmission method according to a first embodiment of the invention.
As shown in fig. 1, a data transmission method 100 is described according to a first embodiment of the present invention. The method 100 begins at step S110, where data is encapsulated into data frames.
Then, in step S120, the data frame is transmitted frame by frame using a high definition video interface.
Steps S110 and S120 are both performed at the transmitting end; accordingly, the following steps S130 and S140 are performed at the receiving end.
Specifically, in step S130, the data frame is received frame by frame using a high definition video interface.
Then, in step S140, the data in the data frame is parsed.
In the data transmission method 100 according to the first embodiment, the data may include both high definition video and other types of data other than high definition video. That is, although a high-definition video interface is used to transmit data, the data is not necessarily high-definition video, and may be other types of data other than high-definition video.
Further, the data frames referred to in method 100 may be high definition video frames suitable for transmission and reception by the high definition video interface. That is, although data of non-high definition video may be transmitted and received, a video frame structure is used to transmit and receive such data.
According to a first embodiment of the invention, tags are added to data frames, i.e. high definition video frames. A tag is placed at the beginning of a data frame to indicate information about the data encapsulated in the data frame.
In parsing the data frame, the tag is first parsed. And further analyzing the data in the data frame through the information obtained after the label is analyzed.
According to the data transmission method of the first embodiment, transmission of non-high-definition video data (including non-video data as well) is performed using a high bandwidth of a high-definition video interface. In this way, it is not necessary to prepare an additional interface, such as an ethernet transmission interface, a USB interface, or the like, for data transmission other than high definition video. The cost of the whole system can be reduced, the complexity of the system can be reduced, and the stability of the whole system is facilitated.
The first embodiment is merely the most basic embodiment of the present invention. Embodiments of the present invention are described in more detail below by way of further specific examples.
In a second embodiment, the addition of an extra tag to a standard 1080p video will be described. Fig. 2 shows the application of the BT1120 interface in a second embodiment of the invention. In intelligent IPC, BT1120 is typically used to transfer video from the decoder module to the processor module.
In the second embodiment, the tag is mainly used for describing some structured information, including a timestamp corresponding to the video, and the type of the information, etc., which is beneficial for subsequent expansion.
In the intelligent IPC, video data transmitted from BT1120 needs to be processed and the processing result needs to be returned, and in order to effectively identify the video corresponding to the processing result, tag information needs to be added to the transmitted video data to record the timestamp or sequence number of each frame of video. Thus, the video data sent by the decoder is in YUV422 video format with a time stamp.
And when the transmitted data is the high-definition video, the tag is placed at the position of the first pixel data of the high-definition video frame. More specifically, in picture data transmission, to avoid chroma component expansion that may occur at the time of BT1120 transmission, valid data is all saved on the Y component. Starting from the first byte of the first line of the luminance component (Y component of YUV data), its original value is modified to custom data, i.e. a tag, and the remaining luminance component and chrominance component data are both data of the original video.
Fig. 3 shows a high definition video frame structure comprising tags according to a second embodiment of the present invention.
The tag can be encapsulated in a coding mode defined by a user, and the tag is decoded according to a corresponding rule after being received by the processing module, so that the required data is extracted. Such as: the sequence number of the current frame, the timestamp of the image when being sent, the length and width of the effective image of the current frame, the type of the transmission data and the like. The tag can be data filled according to the actual needs of the user.
Since the data of the tag does not occupy too many bytes, the data can be placed in the head of the image, i.e. the first line of pixels at the top, and the data does not affect the display effect when displayed. That is, when the received data is a high definition video, the pixel data at the first several pixel data positions of the high definition video frame occupied by the tag is lost, and the tag is replaced with the pixel data. However, since the amount of tag data is small, the display of the video is not greatly affected.
In addition, in order to avoid receiving a repeated frame, we add a tag deduplication function in the receiving BT 1120. The decoding module transmits pictures through BT1120 at a certain rate, typically set to 30fps, however, the rate of actual valid data may not reach 30fps, and the decoding module may retransmit the same picture to satisfy 30fps when outputting the picture. If the processing module stores the pictures received from the BT1120 interface without distinction, a certain memory bandwidth may be occupied, which results in a waste of bandwidth. Therefore, the BT1120 receiving module implemented by us provides a function of removing the repeated frame, that is, whether the current frame is the repeated frame is judged according to the tag data carried by the picture, and if the current frame is the repeated frame, the receiving process is not performed. That is, when data is received, the tags of the respective data frames are compared, and if the tag of the subsequent frame is the same as that of the previous frame, the subsequent frame data is not saved and processed.
The following third, fourth, and fifth embodiments are specific embodiments described for the case of transmitting non-high definition video.
The third embodiment is an embodiment of transmitting a non-1080 p image as well as a multiplex image using the BT1120 interface.
Video with 1920 x 1080 resolution is generally received in the BT1120 standard, however, the user does not need such high resolution in some scenes, and the BT1120 can use the invention to realize different resolutions, such as 1280 x 1024, 1280 x 960, 1280 x 720, 640 x 480 and the like. And the size of the actually transmitted image can be indicated and transmitted through the label information so as to be received by the processing module. That is, the tag may include the type of data within the current frame in addition to the sequence number and/or timestamp of the current frame. In this embodiment, the type of data may be embodied as the resolution of the image. In the fifth and sixth embodiments below, the type of data may also be a still image (e.g., a JPG image) or a more general data file (e.g., an upgrade file, etc.). Accordingly, these tags are transmitted with the data frame to the processing module, i.e. the receiving end. And the receiving end performs parsing operation on the data content according to the content in the label, such as at least one of the information of the sequence number of the current frame, the time stamp and the type of the data in the current frame.
The invention also supports the transmission of multi-path images, namely, a plurality of images are spliced into a large image at the decoder end and then transmitted through the BT1120, the large image is analyzed into the multi-path images by the receiving end, and each image (frame) is provided with a label corresponding to the image, thereby realizing the transmission of the multi-path images.
Fig. 4 shows a schematic diagram of transmitting multiple images according to a third embodiment of the present invention.
The multi-path image can be 4-path, 9-path (the example of fig. 5), 12-path, 16-path or other, and the size after splicing can not exceed 1920 x 1080 at most.
The fourth and fifth embodiments are both examples of transmitting normal data (non-video data) using the BT1120 interface.
Because the label is added in the transmission process of the BT1120, a receiving end and a transmitting end can package and analyze data of types such as a 1080p video, other videos, static pictures such as jpeg pictures, common data (for example, compressed packets) and the like according to the defined label, so that various types of data can be transmitted only by using the BT1120, thereby simplifying the design of an embedded system and reducing the cost of products.
When non-standard BT1120 data is transmitted using the BT1120 interface, the data is saved only on the luminance component. That is, when non-standard BT1120 data is transmitted, the data is packed only on the luminance component position of the high definition video frame; on the other hand, when non-standard BT1120 data is received, only data at the luminance component position of the high definition video frame is received. This design has two benefits: firstly, the encapsulation of the sending end to the data and the analysis of the receiving end to the data are simplified; and the second is compatible with YUV storage formats such as YUV444, YUV422 and YUV 420. Although some bandwidth of BT1120 is lost when data is transmitted only on the luminance component, the transmission bandwidth of BT1120 can reach 118MB/s in 1920 x 1080@60Hz working mode, which can meet most applications.
Furthermore, it is sometimes necessary to process the non-standard BT1120 data before it is transmitted, since the same sequence as the timing reference code (FF 0000) may exist in the data, interfering with the BT1120 reception timing. In order to avoid the situation that a reference code occurs in the transmitted data, the base64 is performed on the data before the transmission by the transmitting end, and the range of the 16-ary value of each byte after the data is encoded is 0-0 x3F, so that the reference code does not occur to influence the receiving timing of the BT 1120. Accordingly, the receiving end needs to perform base64 decoding on the received BT1120 data to restore the original data. It will be appreciated by those skilled in the art that the base64 codec described herein is only for the data itself, and has the effect of preventing the encoded data from appearing in the same sequence as the timing reference code. Other kinds of codecs may be used to perform similar operations on the data.
Thus, more generally, at the transmitting end, when the data is not high definition video, the data may be encoded before being encapsulated so that the encoded data avoids the occurrence of the same sequence as the timing reference code. Accordingly, at the receiving end, when the received data is not a high definition video, the data may be decoded to restore the original data after parsing the data.
In order to increase the flexibility and efficiency of BT1120 data transmission, special designs are made for the transmission of large files and small files, respectively. The above design is illustrated below in two exemplary application scenarios.
Fig. 5 is a diagram illustrating the transmission of one large file using multiple frames according to a fourth embodiment of the present invention.
The fourth embodiment relates to the case of large file transfer. An example application scenario is an online upgrade package of process modules. BT1120 transmits the upgrade file with the data per frame distribution as shown in fig. 5. Because systems and algorithms on the processing modules are constantly improving and updating in intelligent IPCs, there is a need to support online upgrade functionality. The upgrade package is typically around 100MB in size. Considering the cost and volume of IPC, the interface of the processing module and the outside is only BT1120 and a serial port. The serial port speed is slow and is not suitable for transmitting large files, and BT1120 can only transmit about 2MB of one frame and cannot meet the transmission requirement of 100M upgrading files. In order to support the transmission of the upgrade file, the following special design is adopted: the sending end carries out fragmentation operation on the upgrade file before data transmission, each piece of information is filled in an UpdateInfo structure body in a label, and the receiving end analyzes each piece of data according to the UpdateInfo structure body information and assembles the data into a complete upgrade file. The tag (UpgradeInfo structure) for each piece of data in the current design includes the following three parts: a sequence number of the data, a length of the data, and check information (e.g., MD5 value). When the receiving end upgrades, any error of the upgrade file can cause the system to crash, and the MD5 value is added for checking to ensure the correctness of the transmission of the upgrade file.
In other words, at the transmitting end, when a set of data is transmitted over more than one data frame, the tag may further include framing information for combining the data in the respective data frames into a complete set of data. Correspondingly, at the receiving end, when the received tag further includes frame combination information for combining data in more than one data frame into a set of complete data, a set of data can be parsed according to information of the tag on more than one data frame. Here, it should be understood that the framing information may include, for example, a sequence number, a data length, and check information.
Fig. 6 is a diagram illustrating a fifth embodiment of the present invention in which a plurality of small files are transmitted using one frame.
The fifth embodiment relates to the case of small file transfer. An example application scenario is the transmission of multiple jpeg pictures. BT1120 transmits jpg pictures with data per frame distributed as shown in fig. 6. In some intelligent IPC requirements, the transmitted data is not video data, but jpeg encoded picture data. Each picture is only dozens of KB, if BT1120 transmits only one picture per frame of data, BT1120 bandwidth is wasted greatly. In order to improve the bandwidth utilization rate of the BT1120, the following special design is adopted: the sending end packs a plurality of jpeg pictures into one frame of data for transmission (somewhat similar to the condition of multi-path image transmission), the information of each picture is filled in a jpgInfo structure body in the label, and the receiving end analyzes the plurality of pictures from one frame of data according to the jpgInfo structure and then processes the pictures. The jpgInfo structure in the current design includes the following three pieces of information: the number of jpeg pictures, the ID of each picture and the length of each picture. The length of the tag information plus the total length of all pictures should not be greater than the maximum amount of data that can be transmitted by BT1120 one frame.
Preferably, this case can be combined with the case of transmitting multiple images of the third embodiment described earlier, and at the transmitting end, when transmitting multiple sets of data on one data frame, the tag may further include concatenation information between the multiple sets of data. Correspondingly, at the receiving end, when the tag further includes the splicing information between the multiple sets of data in the current frame, the multiple sets of data can be parsed according to the information on the tag. Here, it should be understood that the stitching information may include, for example, the type of the plurality of sets of data (jpeg or multi-path image with smaller resolution), the size of each set of data (picture length, image resolution, etc.), and the relationship between each set of data (picture ID, number, how pictures or images are stitched, etc.).
Fig. 7 shows a schematic block diagram of a network video monitoring apparatus according to a sixth embodiment of the present invention.
As shown in fig. 7, a sixth embodiment of the present invention is a network video monitoring apparatus 700, which is a further detailed description of the IPC monitoring apparatus shown in fig. 2. The network video monitoring apparatus 700 includes: a video acquisition unit 710 for acquiring an original video; a video transmission unit 720, configured to compress an original video by encoding and transmit the compressed original video through a network 730; a video decoding unit 740 for decoding the transmitted video into a decompressed video; a data packing unit 750 for packing data including the decompressed video into a data frame; a data transmitting unit 760 for transmitting the data frames frame by frame using a high definition video interface 770; a high definition video interface 770; a data receiving unit 780 configured to receive data frames frame by frame using the high definition video interface 770; a data parsing unit 790 for parsing data in the data frame; and the data processing unit 800 is configured to perform artificial intelligence processing on the received video. The data encapsulation unit 750 further comprises a tag adding sub-unit 751 for adding a tag at the beginning of a data frame, the tag indicating information about the data encapsulated in the data frame. The data parsing unit 790 further comprises a tag reading subunit 791 for reading a tag from the beginning of the data frame. The data includes both high definition video and other types of data other than high definition video. The data frame is a high definition video frame suitable for transmission and reception by the high definition video interface 770.
Specifically, the high-definition video interface 770 is a BT1120 interface, and the high-definition video is 1080p video. When the data transmission unit 760 transmits non-standard BT1120 data, the data encapsulation unit 750 is further configured to encapsulate the data only at the luminance component position of the high definition video frame.
Specifically, when the data transmitted by the data transmitting unit 760 is a high definition video, the tag adding subunit 751 is further configured to add the tag occupying the position of the first several pixel data of the high definition video frame.
Specifically, the tag includes at least one of the following information: a sequence number of the current frame; a time stamp; the type of data within the current frame.
Specifically, when the data transmission unit 760 transmits a plurality of sets of data on one data frame, the tag further includes concatenation information between the plurality of sets of data. For example, reference may be made to the cases of the third and fifth embodiments of the present invention. Accordingly, the data parsing unit 790 is used to parse a plurality of sets of data according to the information on the tag.
On the other hand, when the data transmitting unit 760 transmits a set of data over more than one data frame, the tag further includes framing information for combining the data in the respective data frames into a set of complete data. For example, reference may be made to the case of the fourth embodiment of the present invention. Accordingly, the data parsing unit 790 is used to parse a set of data according to the information of the tag on more than one data frame.
Specifically, when the data is not high definition video, the apparatus 700 further includes a data encoding unit (not shown) for encoding the data before the data is encapsulated by the data encapsulating unit 750, so that the encoded data avoids occurrence of the same sequence as the timing reference code. Accordingly, at the receiving end, the apparatus 700 further includes a data decoding unit (not shown) for decoding the data after the data parsing unit 790 parses the data, so as to recover the original data.
In addition, the apparatus 700 further includes a deduplication subunit (not shown) in the data parsing unit 790, for comparing the tags of the respective data frames, and if the tag of the next frame is the same as the tag of the previous frame, not saving and processing the next frame data.
Various embodiments and implementations of the present invention have been described above. However, the spirit and scope of the present invention is not limited thereto. Those skilled in the art will be able to devise many more applications in accordance with the teachings of the present invention which are within the scope of the present invention.
That is, the above examples of the present invention are only examples for clearly illustrating the present invention, and do not limit the embodiments of the present invention. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. Any modification, replacement or improvement made within the spirit and principle of the present invention should be included in the scope of the claims of the present invention.

Claims (14)

1. A method of data transmission, comprising:
packaging the data into a data frame;
transmitting the data frames frame by using a high-definition video interface;
receiving data frames frame by using a high-definition video interface;
the data in the data frame is parsed,
it is characterized in that the preparation method is characterized in that,
the data comprises high-definition video and other types of data except the high-definition video;
the data frame is a high-definition video frame suitable for being sent and received by the high-definition video interface;
the data frame includes a tag, disposed at a beginning of the data frame, for indicating information about data encapsulated in the data frame;
the high-definition video interface is a BT1120 interface, and the high-definition video is a 1080p video;
when non-standard BT1120 data is transmitted, the data is packed only on the luminance component position of the high definition video frame.
2. The method of claim 1, wherein when the transmitted data is high definition video, the tag is placed occupying a position of a first number of pixels of data of the high definition video frame.
3. The method of claim 1, wherein the tag comprises at least one of the following information:
a sequence number of the current frame;
a time stamp;
the type of data within the current frame.
4. The method of claim 1, wherein when multiple sets of data are transmitted on one data frame, the tag further includes concatenation information between the multiple sets of data, and the multiple sets of data are parsed at a receiving end according to the information on the tag.
5. The method of claim 1, wherein when a set of data is transmitted over more than one data frame, the tag further includes framing information for combining the data in each data frame into a complete set of data, and the set of data is parsed at a receiving end according to the information of the tag on the more than one data frame.
6. The method of claim 1, wherein when the data is not high definition video, the data is encoded prior to encapsulating the data such that the encoded data avoids occurrence of a same sequence as a timing reference code; after parsing the data, the data is correspondingly decoded to recover the original data.
7. The method of claim 1, wherein the step of receiving the data frames on a frame-by-frame basis using a high definition video interface, the step of parsing the data in the data frames further comprising: and comparing the labels of the data frames, and if the labels of the next frame and the previous frame are the same, not storing and processing the next frame data.
8. A network video monitoring apparatus, comprising:
the video acquisition unit is used for acquiring an original video;
the video transmission unit is used for compressing the original video through coding and then transmitting the original video through a network;
a video decoding unit for decoding the transmitted video into a decompressed video;
a data packing unit for packing data including the decompressed video into a data frame;
a data transmitting unit for transmitting the data frames frame by using a high-definition video interface;
a high-definition video interface;
the data receiving unit is used for receiving the data frames frame by using a high-definition video interface;
the data analysis unit is used for analyzing the data in the data frame;
a data processing unit for performing artificial intelligence processing on the received video,
it is characterized in that the preparation method is characterized in that,
the data encapsulation unit further comprises a tag adding subunit for adding a tag at the beginning of the data frame, the tag being used to indicate information about the data encapsulated in the data frame;
the data parsing unit further comprises a tag reading subunit for reading a tag from the beginning of the data frame,
the data comprises high-definition video and other types of data except the high-definition video;
the data frame is a high-definition video frame suitable for being sent and received by a high-definition video interface;
the high-definition video interface is a BT1120 interface, and the high-definition video is a 1080p video;
when the data transmission unit transmits non-standard BT1120 data, the data encapsulation unit is further configured to encapsulate the data only at a luminance component position of a high definition video frame.
9. The apparatus of claim 8, wherein when the data transmitted by the data transmitting unit is high definition video, the tag adding subunit is further configured to add the tag occupying a position of a first number of pixel data of the high definition video frame.
10. The apparatus of claim 8, wherein the tag comprises at least one of the following information:
a sequence number of the current frame;
a time stamp;
the type of data within the current frame.
11. The apparatus of claim 8, wherein when the data transmission unit transmits a plurality of sets of data on one data frame, the tag further includes concatenation information between the plurality of sets of data, and the data parsing unit is configured to parse the plurality of sets of data according to the information on the tag.
12. The apparatus of claim 8, wherein when the data transmission unit transmits a set of data over more than one data frame, the tag further includes framing information for combining data in each data frame into a complete set of data, and the data parsing unit is configured to parse the set of data according to information of the tag over more than one data frame.
13. The apparatus of claim 8, wherein when the data is not high definition video, the apparatus further comprises a data encoding unit to encode the data before the data encapsulation unit encapsulates the data such that the encoded data avoids occurrence of a same sequence as a timing reference code; and the device further comprises a data decoding unit for performing corresponding decoding on the data after the data parsing unit parses the data to recover the original data.
14. The apparatus of claim 8, wherein the data parsing unit further comprises a deduplication subunit to compare tags of respective data frames, and if a subsequent frame is identical to a previous frame in tag, to not save and process the subsequent frame data.
CN201810182386.0A 2018-03-06 2018-03-06 Data transmission method and network video monitoring device Active CN110233985B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810182386.0A CN110233985B (en) 2018-03-06 2018-03-06 Data transmission method and network video monitoring device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810182386.0A CN110233985B (en) 2018-03-06 2018-03-06 Data transmission method and network video monitoring device

Publications (2)

Publication Number Publication Date
CN110233985A CN110233985A (en) 2019-09-13
CN110233985B true CN110233985B (en) 2020-12-08

Family

ID=67861773

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810182386.0A Active CN110233985B (en) 2018-03-06 2018-03-06 Data transmission method and network video monitoring device

Country Status (1)

Country Link
CN (1) CN110233985B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101102506A (en) * 2007-08-01 2008-01-09 北京创毅视讯科技有限公司 A multi-media broadcast data transmission method, device and system
CN101217658A (en) * 2008-01-09 2008-07-09 杭州华三通信技术有限公司 A media transmission method, system and device
CN102231808A (en) * 2011-07-05 2011-11-02 北京汉邦高科数字技术有限公司 Device and method for converting high-definition video data into eight paths of standard-definition video data
CN103118257A (en) * 2013-02-05 2013-05-22 广东威创视讯科技股份有限公司 Data transmission integrated interface in high-definition video format
CN103139550A (en) * 2013-03-28 2013-06-05 杭州中威电子股份有限公司 Video camera with output high definition three code stream and video code stream combined method
CN103686314A (en) * 2012-09-04 2014-03-26 深圳中兴力维技术有限公司 Demultiplex device and method adopting HD (high definition) video channel to transmit SD (standard definition) videos
CN103686033A (en) * 2012-08-31 2014-03-26 瑞轩科技股份有限公司 Signal input control system and method as well as video device of signal input control system
CN205160696U (en) * 2015-12-10 2016-04-13 北京国基科技股份有限公司 Show accuse equipment with multichannel video concatenation function

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7284191B2 (en) * 2001-08-13 2007-10-16 Xerox Corporation Meta-document management system with document identifiers
KR100631556B1 (en) * 2004-04-06 2006-10-09 삼성전자주식회사 Image processing system and method for processing image

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101102506A (en) * 2007-08-01 2008-01-09 北京创毅视讯科技有限公司 A multi-media broadcast data transmission method, device and system
CN101217658A (en) * 2008-01-09 2008-07-09 杭州华三通信技术有限公司 A media transmission method, system and device
CN102231808A (en) * 2011-07-05 2011-11-02 北京汉邦高科数字技术有限公司 Device and method for converting high-definition video data into eight paths of standard-definition video data
CN103686033A (en) * 2012-08-31 2014-03-26 瑞轩科技股份有限公司 Signal input control system and method as well as video device of signal input control system
CN103686314A (en) * 2012-09-04 2014-03-26 深圳中兴力维技术有限公司 Demultiplex device and method adopting HD (high definition) video channel to transmit SD (standard definition) videos
CN103118257A (en) * 2013-02-05 2013-05-22 广东威创视讯科技股份有限公司 Data transmission integrated interface in high-definition video format
CN103139550A (en) * 2013-03-28 2013-06-05 杭州中威电子股份有限公司 Video camera with output high definition three code stream and video code stream combined method
CN205160696U (en) * 2015-12-10 2016-04-13 北京国基科技股份有限公司 Show accuse equipment with multichannel video concatenation function

Also Published As

Publication number Publication date
CN110233985A (en) 2019-09-13

Similar Documents

Publication Publication Date Title
CN111372097B (en) Receiving apparatus, display device, and receiving method
US10459674B2 (en) Apparatus and methods for packing and transporting raw data
CN107147942B (en) Video signal transmission method, device, apparatus and storage medium
US20210377542A1 (en) Video encoding and decoding method, device, and system, and storage medium
US11012716B2 (en) Image file processing method, system and storage medium
CN109831668B (en) Data compression method and device, data coding/decoding method and device
CN105637849A (en) Data processing apparatus and method for compressed pixel data groups
CN110022297A (en) A kind of HD video live broadcast system
CN105025347B (en) A kind of method of sending and receiving of GOP images group
US20130272619A1 (en) Devices for identifying a leading picture
WO2014183478A1 (en) Video encoding method and apparatus
CN112788431A (en) Video playing method, device, system, medium and browser based on HTML5
CN108924502A (en) A kind of portable image transmission system and its figure transmission method
CN109391839B (en) Self-adaptive HDMI (high-definition multimedia interface) video transmission device
CN105874784B (en) Numerical data method of sending and receiving and device based on composite video signal
US9936266B2 (en) Video encoding method and apparatus
KR101171389B1 (en) System and method for compressed video data transmission using sdi
US9392214B2 (en) High definition video recorder/player
CN110233985B (en) Data transmission method and network video monitoring device
CN111010593A (en) Method and device for packaging H.265 video data based on FLV format
US20160142461A1 (en) Method and device for transmission of multimedia data
CN201409194Y (en) Video network monitoring system
CN100586179C (en) Intelligent domestic gateway presentation video control method and system thereof
CN111083510A (en) Method and device for pushing HEVC (high efficiency video coding) video
CN105163169A (en) Data package format method and system suitable for transmission

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20190926

Address after: 2100 San Jose Rojack Avenue, California, USA

Applicant after: XILINX INC

Address before: 100083, 17 floor, 4 Building 4, 1 Wang Zhuang Road, Haidian District, Beijing.

Applicant before: Beijing Shenjian Intelligent Technology Co., Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant