CN109644290B

CN109644290B - Data switching device, data acquisition device, system and method

Info

Publication number: CN109644290B
Application number: CN201880002425.2A
Authority: CN
Inventors: 钮旋; 朱璐; 周新生; 阮俊瑾; 朱怀安; 焦炳豪; 高阳; 陈垄
Original assignee: Shanghai Uhdvision Technology Co ltd
Current assignee: Shanghai Uhdvision Technology Co ltd
Priority date: 2018-11-02
Filing date: 2018-11-21
Publication date: 2022-03-08
Anticipated expiration: 2038-11-21
Also published as: CN109644290A

Abstract

The application provides a data switching device, a data acquisition device, a system and a method. The data switching device is used for transmitting the multimedia playing data provided by the data acquisition device. The data acquisition device includes: an acquisition unit configured to acquire multimedia data; a clock signal generating unit for generating and outputting a clock signal; the encoding unit is used for encoding the acquired multimedia data into multimedia playing data and synchronous control information under the control of a clock signal; and the data sending unit is used for sending the clock signal and sending the multimedia playing data and the synchronization control information which are determined to be transmitted based on the clock signal. The data switching device comprises: the data receiving unit is used for acquiring a clock signal, synchronous control information and multimedia playing data from the data acquisition device; and the data processing unit is used for forwarding the multimedia playing data based on the synchronous control information under the control of the clock signal. The application realizes real-time playing and remote storage of lossless images.

Description

Data switching device, data acquisition device, system and method

Technical Field

The present application relates to the field of multimedia data communication technologies, and in particular, to a data transfer device, a data acquisition system, and a data acquisition method.

Background

With the help of the continuous development of data transmission media and network transmission technologies, the definition of images and sounds is continuously improved when users watch network broadcasts directly. For example, in the scenes of watching football games or monitoring security and the like, users can watch and listen to real-time audio and video.

However, limited by the network transmission capability between the front-end data collection device and the back-end data receiving device, the data collection device usually compresses the acquired multimedia playing data, and transmits the compressed multimedia playing data through the transmission network. On one hand, the data loss generated by compression cannot be recovered during playing, so that a user cannot obtain the information content of the audio and video data collected by the front end when watching and listening to the audio and video; on the other hand, in order to reduce the effects of loss, delay and the like of multimedia playing data during network transmission, a verification process (such as a response mechanism) needs to be added during transmission, which increases the delay of multimedia playing. Under some scenes needing high-definition video and lossless audio, the prior technical scheme cannot meet the requirement.

Disclosure of Invention

In view of the above drawbacks of the prior art, the present application aims to provide a data forwarding device, a data acquisition device, a system and a method for data forwarding, which are used to solve the problem of the prior art that multimedia playing data has large loss and delay during transmission.

To achieve the above and other related objects, a first aspect of the present application provides a data switching device for transmitting multimedia playing data provided by a data acquisition device, including: the data receiving unit is used for acquiring a clock signal, synchronous control information and multimedia playing data from the data acquisition device; and the data processing unit is connected with the data receiving unit and used for forwarding the multimedia playing data based on the synchronous control information under the control of the clock signal so as to store or display the multimedia playing data.

In certain embodiments of the first aspect, the synchronization control information comprises a line-field synchronization signal; correspondingly, the data processing unit forwards the image frames in the multimedia playing data based on the line-field synchronization signal under the control of the clock signal.

In some embodiments of the first aspect, the synchronization control information includes a control code, and the data processing unit performs forwarding processing on data of a corresponding type in the multimedia playing data based on a type indicated by the control code.

In certain embodiments of the first aspect, the data processing unit is further configured to decode the clock signal, the synchronization control information, and the multimedia playing data according to a preset decoding format; and under the control of the decoded clock signal, forwarding at least the decoded multimedia playing data based on the decoded synchronization control information.

In certain embodiments of the first aspect, the data processing unit is configured to decode a data packet including at least one of the clock signal, the synchronization control information, and the multimedia playing data according to a preset decoding format.

In certain embodiments of the first aspect, the data forwarding device further comprises: and the playing interface unit is connected with the data processing unit and used for outputting the multimedia playing data according to the forwarding processing of the data processing unit so as to be played by the playing terminal.

In certain embodiments of the first aspect, the play interface unit comprises: at least one path of playing interface; and the data processing unit divides the image frames in the acquired multimedia playing data under the control of the horizontal-field synchronizing signal in the synchronizing control information and outputs the image frames to each path of playing interface in a shunting way.

In certain embodiments of the first aspect, the data forwarding device further includes an external cache unit connected to the data processing unit; the data processing unit stores the multimedia playing data to the external cache unit based on the synchronous control information; and the video playing interface unit is used for extracting the image frames in the cached multimedia playing data from the external caching unit based on a preconfigured playing frequency and outputting the extracted image frames to the playing interface unit according to the line-field synchronizing signals of the extracted image frames.

In certain embodiments of the first aspect, the data processing unit extracts corresponding multimedia playing data from the cached multimedia playing data based on the obtained playing instruction, and outputs the corresponding multimedia playing data according to the synchronization control information of the extracted multimedia playing data, so as to play the corresponding multimedia playing data.

In certain embodiments of the first aspect, the data forwarding device further comprises: an external cache unit and a non-volatile storage unit; the data processing unit is respectively connected with the external cache unit and the nonvolatile storage unit; the data processing unit is further configured to store the multimedia playing data in the external cache unit based on the synchronization control information, and extract the cached multimedia playing data from the external cache unit and transfer the multimedia playing data to the nonvolatile storage unit.

In certain embodiments of the first aspect, the non-volatile storage unit comprises a storage array connected in parallel with the data processing unit; and the data processing unit divides the multimedia playing data according to the storage array and stores the divided multimedia playing data into the storage array.

In certain embodiments of the first aspect, the data forwarding device further includes a power-off protection unit, configured to provide power supply when the data forwarding device is abnormally powered off, and forward the multimedia playing data cached in the external caching unit to the nonvolatile storage unit.

In certain embodiments of the first aspect, the data processing unit extracts corresponding multimedia playing data from the stored multimedia playing data based on the acquired playing instruction, and outputs the corresponding multimedia playing data according to the synchronization control information of the extracted multimedia playing data, so as to display the corresponding multimedia playing data.

In certain embodiments of the first aspect, the data receiving unit comprises a fiber optic interface.

In certain embodiments of the first aspect, the multimedia playback data includes at least one or more of the following in combination: image frames, audio data, and status information associated with the data acquisition device.

In certain embodiments of the first aspect, the synchronization control information comprises at least one or more of the following in combination: line field synchronizing signal, control code, audio and video synchronizing signal.

A second aspect of the present application provides a data acquisition apparatus comprising: an acquisition unit configured to acquire multimedia data; a clock signal generating unit for generating and outputting a clock signal; the encoding unit is connected with the acquisition unit and is used for encoding the acquired multimedia data into multimedia playing data and synchronous control information under the control of the clock signal; and the data sending unit is connected with the clock signal generating unit and the acquiring unit and used for sending the clock signal and sending the multimedia playing data and the synchronous control information which are determined to be transmitted based on the clock signal.

In certain embodiments of the second aspect, the data transmission unit comprises a fiber optic interface.

In some implementations of the second aspect, the transmitted multimedia playback data includes 8K image frames.

In some embodiments of the second aspect, the encoding unit is further configured to perform at least one encoding process on the clock signal, and the multimedia playing data and the synchronization control information processed in the time period corresponding to the clock signal; correspondingly, the data sending unit is used for sending the encoded clock signal, the multimedia playing data and the synchronization control information.

A third aspect of the present application provides a data transmission system, including: a data acquisition apparatus as claimed in any one of the preceding first aspects, and a data transfer apparatus as claimed in any one of the preceding second aspects.

A fourth aspect of the present application provides a data transfer method for transmitting multimedia playing data provided by a data acquisition device, comprising: acquiring a clock signal, synchronous control information and multimedia playing data from the data acquisition device; and under the control of the clock signal, forwarding the multimedia playing data based on the synchronous control information so as to store or display the multimedia playing data.

In certain embodiments of the fourth aspect, the synchronization control information comprises a line-field synchronization signal; correspondingly, the step of forwarding at least the multimedia playing data based on the synchronization control information under the control of the clock signal includes: and under the control of the clock signal, forwarding the image frames in the multimedia playing data based on the line-field synchronous signal.

In some embodiments of the fourth aspect, the synchronization control information includes a control code, and correspondingly, the step of forwarding at least the multimedia playing data based on the synchronization control information includes: and forwarding the data of the corresponding type in the multimedia playing data based on the type represented by the control code.

In certain embodiments of the fourth aspect, the method further comprises: decoding the clock signal, the synchronous control information and the multimedia playing data according to a preset decoding format; so as to forward at least the decoded multimedia playing data based on the decoded synchronization control information under the control of the decoded clock signal.

In some embodiments of the fourth aspect, the decoding the clock signal, the synchronization control information, and the multimedia playing data according to a preset decoding format includes: and decoding the data packet containing at least one of the clock signal, the synchronous control information and the multimedia playing data according to a preset decoding format.

In some embodiments of the fourth aspect, the step of forwarding at least the multimedia playing data based on the synchronization control information under the control of the clock signal includes: and outputting the multimedia playing data to a playing terminal according to the synchronous control information.

In certain embodiments of the fourth aspect, the method further comprises at least one of: recovering the synchronous control information of the extracted multimedia playing data by transferring through an external cache unit, and outputting the obtained multimedia playing data to a playing terminal according to the recovered synchronous control information; and recovering the synchronization control information of the extracted multimedia playing data through the transfer of an external cache unit, and storing the multimedia playing data into a nonvolatile storage unit according to the recovered synchronization control information.

In certain embodiments of the fourth aspect, the method further comprises: and extracting corresponding multimedia playing data from the stored multimedia playing data based on the acquired playing instruction and outputting the corresponding multimedia playing data so as to play the corresponding multimedia playing data.

In certain embodiments of the fourth aspect, the multimedia playback data includes at least one or more of the following in combination: image frames, audio data, and status information associated with the data acquisition device.

In certain embodiments of the fourth aspect, the synchronization control information comprises at least one or more of the following in combination: line field synchronizing signal, control code, audio and video synchronizing signal.

A fifth aspect of the present application provides a data acquisition method, including: encoding the acquired multimedia playing data into multimedia playing data and synchronous control information based on a clock signal; and sending the clock signal, the multimedia playing data and the synchronous control information.

In certain embodiments of the fifth aspect, the method further comprises: carrying out at least one coding process on the clock signal and multimedia playing data and synchronous control information processed in a time period corresponding to the clock signal; correspondingly, the encoded clock signal, multimedia playing data and synchronous control information are sent.

In some implementations of the fourth aspect, the transmitted multimedia playback data includes 8K image frames.

A sixth aspect of the present application provides a computer-readable storage medium, in which at least one program is stored; the at least one program, when invoked, performs the data forwarding method of any of the fourth aspects; alternatively, the at least one program, when invoked, performs the data acquisition method of any of the fifth aspects.

As described above, the data transfer device, the data acquisition device, the system and the method of the present application have the following beneficial effects: the data acquisition device and the data switching device provided by the application adopt the homologous clock signals to carry out data synchronization processing, so that multimedia playing data, especially lossless images, can be played in real time and stored in different places. The transmission scheme of the multimedia playing data is provided in the fields of city security, traffic monitoring and the like which need high-definition image monitoring. Particularly, multimedia playing data, synchronous control information and the like on the image acquisition device side are acquired by using the optical fiber interface in the scheme of the application, and 8K images can be transmitted in a network at a speed of 120 frames/second, so that the purpose of transmitting ultrahigh-definition images of videos acquired in multiple fields such as city security, traffic monitoring, medical treatment and the like in real time is achieved.

Drawings

Fig. 1 is a schematic structural diagram of a data acquisition device according to an embodiment of the present invention.

Fig. 2 is a schematic structural diagram of a data forwarding device according to an embodiment of the present invention.

Fig. 3 is a schematic structural diagram of a data transfer device according to another embodiment of the present invention.

Fig. 4 is a schematic structural diagram of a data transfer device according to another embodiment of the present invention.

Fig. 5 is a schematic diagram of a network architecture of the data transmission system according to an embodiment of the present invention.

Fig. 6 is a schematic diagram of a network architecture of a data transmission system according to another embodiment of the present invention.

Fig. 7 is a schematic diagram of a network architecture of the data transmission system according to another embodiment of the present invention.

Fig. 8 is a flow chart of the data acquisition method of the present application.

Fig. 9 is a flowchart illustrating a data forwarding method according to the present application.

Detailed Description

The following description of the embodiments of the present application is provided for illustrative purposes, and other advantages and capabilities of the present application will become apparent to those skilled in the art from the present disclosure.

As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, species, and/or groups thereof. The terms "or" and/or "as used herein are to be construed as inclusive or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: a; b; c; a and B; a and C; b and C; A. b and C ". An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some way.

In the existing network transmission of multimedia playing data, some embodiments may utilize transmission technologies such as a streaming media transmission protocol or a breakpoint resume to implement point-to-point transmission or multipoint transmission of multimedia playing data. The method is mostly suitable for scenes with low real-time requirements, such as video on demand, watching delayed live broadcast and the like. However, for some scenes with both real-time performance and audio and video playing quality, such as application fields of high-definition monitoring systems in cities, playback systems in court, even multimedia teaching systems for medical operations, and the like, a special multimedia transmission network needs to be established, so that the playing terminal can play high-definition images and/or high-quality audio in real time. For this reason, in other embodiments, the existing method uses a synchronized clock signal to solve the matching problem of multimedia playing data transmission and display rhythm at the transceiving end, which requires continuously calibrating the clock signal at the transceiving end to synchronize the signals; wherein the synchronization process of the clock signal reduces the real-time performance of the transceiving end.

With the increasing requirements of users on the definition and real-time performance of watched and listened audio and video, for example, in the fields of medical treatment, industrial detection, micro-nano detection of television signal transmission and the like, technicians need to transmit multimedia playing data with lower compression rate and higher real-time performance. To this end, the present application provides a data acquisition device. The data acquisition device can be arranged at a position such as a street for acquiring front-end multimedia playing data. The data acquisition device is connected with the data switching device through a transmission line which is specially constructed for transmitting multimedia playing data or a public transmission line which can transmit the multimedia playing data. In order to ensure that the data acquisition device and the data switching device can efficiently transmit multimedia playing data with low compression rate and even lossless compression, the data volume transmitted by the selected transmission line in a unit clock period needs to be far larger than the data volume synchronously processed by the transmitting and receiving end in the same clock period. For example, according to the rate of synchronously processing data in a unit clock cycle, the transmission rate of the correspondingly selected transmission line is ten times, tens of times or hundreds of times. Therefore, by means of the data transmission capability of the selected transmission line, the synchronous processing of the multimedia playing data can be realized between the data acquisition device and the data switching device by adopting a single-source clock signal as a reference clock signal of the synchronous processing. For example, by using a transmission line of an optical fiber medium, the data switching device can perform data processing by using a clock signal generated by the data acquisition device side, so as to realize efficient transmission of multimedia playing data.

Please refer to fig. 1, which illustrates a data acquisition apparatus according to the present application. The data acquisition apparatus 1 includes an acquisition unit 11, a clock signal generation unit 14, an encoding unit 12, and a data transmission unit 13.

The acquiring unit 11 is used for acquiring multimedia data. Here, the acquiring unit 11 includes a camera module or a voice input module, or includes a camera module and a voice input module. The camera module comprises a digital camera or an industrial camera device. The industrial camera device includes a linear array camera device or an area array camera device. The voice input module comprises a built-in or external microphone and the like. Correspondingly, the acquired multimedia data includes audio data and video data, wherein the video data includes image frames, status information and the like.

The clock signal generating unit 14 is configured to generate and output a clock signal. The clock signal generating unit 14 is, for example, a clock signal generating circuit that generates a clock signal by a crystal oscillator, or a clock signal generating circuit that generates a clock signal by a ramp signal. The clock signal is used to provide the encoding unit 12 and the data transmission unit 13 with a unit clock period for data processing.

The encoding unit 12 is connected to the obtaining unit 11, and is configured to encode the obtained multimedia data into multimedia playing data and synchronization control information under the control of the clock signal.

Here, the encoding unit 12 includes a processing module that can perform logic control and digital operation, and a storage module for storing intermediate data generated during operation of the processing module. Wherein, the processing module includes any one or more of the following combinations: FPGA, MCU, CPU, etc. The memory module comprises any one or more of the following combinations: volatile memories such as registers, stacks, and caches.

The encoding unit 12 synchronously encodes the audio/video data according to the clock signal to obtain multimedia playing data and synchronous control information corresponding to the multimedia playing data. According to the type of the multimedia data that can be obtained by the obtaining unit 11, the multimedia playing data includes at least one or more of the following combinations: image frames, audio data, and status information associated with the data acquisition device. The state information includes auxiliary information related to software and hardware in the obtaining unit 11, which includes but is not limited to: color information, camera shooting parameters, some reservation information specific to a particular application scenario, etc. Wherein the camera shooting parameters include, but are not limited to, exposure rate, shutter speed, white balance parameters, and the like. For example, if the data acquisition device only includes a camera module, the multimedia playing data may include only image frames, or image frames and status information. For another example, if the data acquisition device includes a camera module and a voice input module, the multimedia playing data includes an image frame and audio data, and even further includes the state information.

Here, the encoding unit 12 extracts pixel data in the image frame captured by the camera module line by line, column by column, interlace, or interlace in accordance with the playback frequency of the image frame, the number of pixels of the image frame, and the like in a unit clock cycle provided by the clock signal, and simultaneously generates synchronization control information indicating the position of the extracted pixel data in each frame of the image and the start position and the end position of the image frame. The synchronization control information correspondingly comprises at least one of a line synchronization signal and a field synchronization signal. For example, the encoding unit 12 generates a line synchronization signal and a field synchronization signal at the start time of a certain unit clock period, and extracts the first line of pixel data of the image frame in the subsequent unit clock period according to the line synchronization signal and the field synchronization signal.

The encoding unit 12 also extracts audio data segments from the audio data within a unit clock period provided by the clock signal. In some examples, the encoding unit 12 sets the extracted audio data segment before or after the corresponding image frame according to synchronization information such as a time stamp in the audio/video data, and uses a field synchronization signal to ensure that the image frame and the corresponding audio data segment are processed synchronously at the receiving end.

The encoding unit 12 also acquires status information corresponding to the current image frame and/or camera module within a unit clock period provided by the clock signal, and encodes the status information in the multimedia play data. For example, the camera module used in the acquiring unit 11 is an industrial camera, and the encoding unit 12 acquires color information corresponding to the current image frame, shooting parameters of the industrial camera, and the like, and encodes the color information and the shooting parameters in multimedia playing data. For example, the encoding unit 12 encodes the status information in a header of the multimedia play data or the like.

Here, the encoding unit 12 encodes at least one of the pixel data, the state information, and the audio data segment extracted within the unit time period into multimedia play data according to a preset encoding format. In some embodiments, the encoding unit 12 further encapsulates the multimedia playing data and the corresponding synchronization control information in at least one data packet that can be transmitted according to a standard or customized encapsulation protocol. Here, at least one of multimedia playback data and synchronization control data may be contained within the encapsulated single data packet according to an actual encapsulation rule.

In other embodiments, to facilitate transmission of the data amount of the 8K image frame as provided by the industrial camera, in some examples, the synchronization control information further includes at least one of a control code, an audio video synchronization signal. The audio and video synchronization signal can be represented by a combination of a line synchronization signal, a field synchronization signal and a control code. For example, the encoding unit 12 encodes audio signals synchronized with the image frame corresponding to the field sync signal together based on the field sync period indicated by the field sync signal, and indicates the type of multimedia data encapsulated in a single packet, etc. using a control code. The control code may describe different types by at least one field (or byte). For example, the data currently encapsulated is described by the control code to include types of multimedia data, status information, idle information, and the like. The control codes may be encapsulated in data packets at fixed intervals. For example, the control code is encapsulated in a data packet according to an interval of a fixed data amount. Or the control code may be set according to the specific position of each type of encapsulated data in the data packet. In this way, the encoding unit 12 can encapsulate the synchronization control information and the multimedia playing data together, so that the receiving end can parse the multimedia playing data to be processed synchronously according to the synchronization control information.

In still other embodiments, in order to reduce interference to the clock signal transmission caused by signal attenuation, noise interference, and the like during data transmission, the encoding unit 12 further encodes the clock signal and at least one of the multimedia playing data and the synchronization control information processed in the time period corresponding to the clock signal, transmits the encoded data using different channels, or transmits the encoded data to the data transmitting unit 13 according to a preset timing.

In some examples, the encoding unit 12 provides at least two encoding rules for the clock signal, the synchronization control information, and the multimedia playing data, so that the encoded clock signal, the synchronization control information, and the multimedia playing data can be transmitted separately according to a time sequence or using different channels. In still other examples, the encoding unit 12 uniformly encodes and encapsulates the clock signal, the synchronization control information, and the multimedia playing data according to a preset rule. Taking the example that one data includes multimedia playing data and synchronous control information to be synchronously processed in a unit clock cycle, the encoding unit 12 encodes the clock signal and the synchronous control information such as the horizontal synchronizing signal, the field synchronizing signal, the control code, etc. into digital information at a preset field position according to a preset encoding protocol, and encapsulates the digital information and the multimedia playing data together. According to the rule of actual data encapsulation, at least one of a clock signal, synchronization control information and multimedia playing data can be included in the encapsulated single data packet. For example, a packet may only include an encoded clock signal to help the data-forwarding device construct a local clock signal. For another example, a packet may include encoded clock signals, field sync signals, control codes, and null data. For another example, a data packet may include encoded clock signals, synchronization control information, and multimedia playing data. For example, a certain data packet may contain an encoded clock signal and multimedia playing data.

It should be noted that the present application is not limited to the encoding and packaging method provided by the aforementioned encoding unit 12, and the multimedia playing data is processed, such as encrypted and compressed. However, on the technical idea of performing network transmission preparation for multimedia playing data by the encoding and encapsulating method provided by the encoding unit 12, other preliminary preparation for multimedia playing data should be regarded as a technical solution obtained based on the technical teaching of the present application.

The encoding unit 12 transmits the encoded data packet to the data transmitting unit 13, and the data transmitting unit 13 transmits the encoded data packet to the receiving end. The data transmitting unit 13 may transmit a clock signal and multimedia playing data and synchronization control information determined to be transmitted based on the clock signal by using at least one data line.

Here, according to the data amount of the multimedia playing data that needs to be processed synchronously in the unit clock cycle of the data acquisition device, the transmission capability of the technician selecting the data sending unit 13 needs to satisfy the data amount of the multimedia playing data that needs to be processed synchronously in the unit clock cycle. In some embodiments, in order to match the pixel data amount and the playing frequency of the image frame of the industrial camera device, the data sending unit 13 in the data acquisition device includes an optical fiber interface, and the data sending unit 13 transmits the data packet to the receiving end by using an optical fiber medium. For example, the data sending unit 13 transmits multimedia playing data containing 8K image frames to the data switching device by using an optical fiber medium, and provides the data switching device with the multimedia playing data that can be displayed at a frequency of 120 frames/second or 60 frames/second. The 8K image frame can be captured by an 8K camera, or captured and compressed by an 8K or higher camera. For example, the 8K image frame is captured by an 8K camera, and the 8K image frame is 3300 ten thousand pixels (7680 × 4320 pixels). Here, the pixel resolution of the subsequently mentioned image frames can be based on the pixel resolution of the respective camera device used, which is not repeated in the following.

It should be noted that, depending on the amount of data actually transmitted, the transmission distance, and the number of data lines capable of transmitting data, the data sending unit 13 may include a single mode fiber interface or other network transmission interfaces.

For example, the data transmitting unit 13 transmits the data packets, such as the clock signal, the multimedia playing data, and the synchronization control information, which are separately encapsulated, in the order provided by the encoding unit 12, one by one. For another example, the data sending unit 13 sends the data packets, which are provided by the encoding unit 12 and are packaged with the clock signal, the multimedia playing data and the synchronization control information, one by one.

In order to process the received multimedia playing data according to the clock signal provided by the data acquisition device, the application also provides a data switching device. The data switching device comprises a data receiving unit and a data processing unit.

Wherein the data receiving unit corresponds to an interface used by the data transmitting unit in the data acquiring device to match a data transmission capability, a data transmission line, and the like. The data receiving unit acquires a clock signal, synchronous control information and multimedia playing data from the data acquisition device. Here, the data receiving unit includes: for a receiving interface corresponding to the data transmitting unit. In some examples, the receiving interface is a fiber optic interface. For example, the receiving interface is a single mode fiber interface.

The data processing unit is used for forwarding at least the multimedia playing data based on the synchronous control information under the control of the clock signal so as to store or display the multimedia playing data.

The data processing unit comprises a processing module which can carry out logic control and digital operation, and a storage module for storing intermediate data generated during the operation of the processing module. Wherein, the processing module includes any one or more of the following combinations: FPGA, MCU, CPU, etc. The memory module comprises any one or more of the following combinations: volatile memories such as registers, stacks, and caches.

The data processing unit correspondingly processes the digital signals received by the data receiving unit according to a coding format, a sending time sequence or a data line set for sending clock signals, synchronous control information and multimedia playing data by the data acquisition device, so as to extract the clock signals at the data acquisition device side from the digital signals, generate corresponding local clock signals, generate synchronous control information according to the local clock signals and forward the multimedia playing data.

In some embodiments, the clock signal, the synchronization control information, and the multimedia playing data received by the data switching device are encoded data that is subjected to multiple encoding processes and multi-line transmission. And the data processing unit decodes the clock signal, the synchronous control information and the multimedia playing data according to a preset decoding format.

The data processing unit correspondingly decodes the received clock information, control information and multimedia playing information according to a preset decoding format, thereby recovering the clock signal, the synchronous control information and the multimedia playing data. In one example, the data processing unit correspondingly decodes the clock information, the control information and the multimedia playing information from different data lines according to a plurality of preset decoding formats. In another example, the data processing unit decodes the clock signal, the synchronization control information and the multimedia playing data according to a preset decoding format; and under the control of the decoded clock signal, forwarding at least the decoded multimedia playing data based on the decoded synchronization control information. The data packet is in a unified coding and packaging format according to information contained in the data packet actually sent by the data acquisition device. For a single data packet, at least one of a clock signal, synchronization control information, and multimedia play data may be included in the data packet. For example, a packet may only include an encoded clock signal to help the data-forwarding device construct a local clock signal. For another example, a packet may include encoded clock signals, field sync signals, control codes, and null data. For another example, a data packet may include encoded clock signals, synchronization control information, and multimedia playing data. For example, a certain data packet may contain an encoded clock signal and multimedia playing data. And the data processing unit decodes the data packet according to a preset decoding format to obtain the clock signal, the synchronous control information and the multimedia playing data.

Here, the data processing unit buffers or forwards multimedia playing data according to the clock signal and the synchronization control information. For example, the data processing unit generates a local clock signal by using the decoded clock signal on one hand, and generates a horizontal synchronization signal and synchronously forwards multimedia playing data in one unit clock cycle by decoding on the other hand; after delaying one unit clock period, the data processing unit generates the line synchronization signal and forwards the corresponding multimedia playing data in parallel based on the line synchronization signal.

According to the data type contained in the actual multimedia playing data, the received synchronous control information also comprises a control code; correspondingly, the data processing unit forwards the data of the corresponding type in the multimedia playing data based on the type represented by the control code. Here, the data processing unit determines a data type included in the decoded data packet according to a type indicated by a preset control code, and performs forwarding processing on the multimedia playing data in combination with other synchronization signals in the synchronization control information. For example, if the data processing unit determines that the decoded data packet contains status information based on the control code, the color, brightness, etc. of the corresponding pixel in the corresponding image frame are determined according to the status information. For another example, if the data processing unit determines that the decoded data packet includes an audio data segment based on the control code, it may determine that the audio data segment and the image frame need to be played synchronously in combination with the current line-field synchronization signal; or giving the corresponding index record when unloading, etc.

In combination with the description of the above examples, the manner of forwarding the multimedia playing data by the data processing unit according to the clock signal and the synchronization control information may include playing the multimedia playing data. For this reason, in some practical applications, please refer to fig. 2, which is a schematic structural diagram of an embodiment of a data transfer device. The data transfer device 2 further includes a playing interface unit 23. Here, the playing interface unit includes playing interfaces such as HDMI, SDI, VGA, Displayport, and the like according to the matching degree between the data amount of the multimedia playing data provided by the data acquisition device and the playing capability of the playing terminal and the matching capability of the playing frequency between the data acquisition device and the playing terminal. In some examples, the play interface unit includes a one-way play interface. For example, the image frame in the transmitted multimedia playing data is 2-4K pixel data, and correspondingly, the playing interface may be an HDMI interface. In still other examples, the play interface unit includes at least two play interfaces. For example, the image frame in the transmitted multimedia playing data is 8K pixel data, and correspondingly, the playing interface adopts a four-way HDMI interface.

In order to match the playing frequency of 8K image frames and 30 frames/s (or 60 frames/s), the playing interface unit 23 uses four paths of playing interfaces to output the multimedia playing data, and the data processing unit 22 divides the image frames in the acquired multimedia playing data under the control of the horizontal-field synchronizing signal in the synchronizing control information and outputs the divided image frames to each path of playing interface.

Under the control of the clock signal from the data acquisition device, the data processing unit 22 divides the pixel data lines (or pixel data columns) according to the image frame corresponding to the line-field synchronization signal and the pixel data lines (or pixel data columns) in the image frame to obtain image sub-frames that can be output to each channel of the playback interface, and outputs the image sub-frames to the corresponding playback interfaces. And the playing terminal connected with each playing interface correspondingly displays the image sub-frames. In some examples, the image frame in the multimedia playing data is 8K pixel data, and the playing data interface unit 23 includes four playing interfaces, where the four playing interfaces are connected to an 8K display terminal; correspondingly, the data processing unit 22 divides the image frame into four image sub-frames according to the line-field synchronization signal, and outputs the four image sub-frames to each playing interface in parallel under the control of the clock signal, and the 8K display terminal displays the image frame.

In some other practical applications, at least one of the processing rate, the output rate, or the playing frequency of the playing terminal of the data transfer device does not match the multimedia playing data output by the data acquisition device according to the playing frequency thereof, and for this purpose, refer to fig. 3, which is a schematic structural diagram of the data transfer device in another embodiment. Unlike the data forwarding device shown in fig. 2, the data forwarding device shown in fig. 3 further includes an external cache unit 34 connected to the data processing unit. Here, the external cache unit 34 is a volatile memory, such as a RAM, a DRAM, and the like. The external buffer unit 34 is used for temporarily storing the received multimedia playing data.

The data processing unit 32 stores the multimedia playing data to the external buffer unit. Unlike the data transfer device shown in fig. 2, the data processing unit 32 does not directly output the obtained multimedia playing data to the playing interface unit, but temporarily stores the multimedia playing data to the external buffer unit 34 by using the clock signal of the data acquisition device to buffer the playing frequency of the playing interface unit 33. For example, the image frames and the status information in the multimedia data are stored in the external buffer unit 34 according to the line-field synchronization signal in the acquired synchronization control information, and the audio inputs corresponding to the image frames are also stored in the external buffer unit according to the audio-video synchronization signal. The data processing unit 32 reads the multimedia playing data from the external buffer unit 34 according to the local clock signal or the clock signal provided by the data acquisition device and outputs the data to the playing interface unit 33. Both the local clock signal and the source clock signal are used to ensure that the data processing unit 32 provides a basic unit clock cycle during the synchronous reading and writing of data. Here, the data processing unit 32 generates a line field synchronization signal according to the image frame and the storage address field of each pixel line (or column) obtained when the external buffer unit is stored, generates an audio/video synchronization signal according to the storage address field of the audio data segment obtained when the external buffer unit 34 is stored, and divides and outputs the image frame according to the number of the playing interfaces in the playing interface unit 33.

In other embodiments, the data processing unit 32 is further configured to extract an image frame from the buffered multimedia playing data from the external buffer unit based on a preconfigured playing frequency, recover a line-field synchronization signal according to each pixel line (or column) in the extracted image frame, and output the extracted image frame to the playing interface unit according to the recovered line-field synchronization signal.

Taking the example that the data acquisition device acquires 8K image frames and outputs the image frames according to the playing frequency of 120 frames/s, and the playing frequency that can be output by the playing interface unit in the data conversion device is 60 frames/s, the data processing unit reads the image frames in the multimedia playing data from the cache at intervals of frames according to the playing frequency of 60 frames/s, generates line and field synchronizing signals of the extracted image frames according to local clock signals, divides the corresponding image frames into four paths, and outputs the divided image frames to the playing interface unit 33 respectively by using the generated line and field synchronizing signals.

The multimedia playing data includes audio data, and the data processing unit 32 further extracts the audio data synchronized with the image frame from the external buffer unit 34 and outputs the audio data to the playing interface unit 33.

It should be noted that the above examples are only examples, and those skilled in the art may provide a scheme that the image frames may be displayed frame by frame or frame by frame according to the playing frequency of the playing interface unit, which is not described in detail herein.

In some examples, the data forwarding apparatus further includes a human-computer interaction unit (not shown) for obtaining the playing instruction. Wherein, the human-computer interaction unit includes but is not limited to: a wireless receiving module communicated with the remote controller, an interface module used for connecting a mouse, a keyboard and the like, and the like. The data processing unit extracts corresponding multimedia playing data from the cached multimedia playing data based on the acquired playing instruction, and outputs the corresponding multimedia playing data according to the synchronous control information of the extracted multimedia playing data so as to play the corresponding multimedia playing data. Wherein the playing instruction includes, but is not limited to, any one of the following: a play instruction for displaying a previous (or next) image frame, a play instruction for slowly playing (or quickly playing) multimedia play data, a play instruction for displaying frame by frame, a play instruction for playing multimedia play data based on a previous (or next) image frame, and the like.

The data processing unit extracts corresponding multimedia playing data from the buffer according to the received playing instruction, recovers a line-field synchronizing signal for display control according to a local clock signal and a data storage address of each pixel line (or column) in the image frame, and outputs the image frame indicated by the playing instruction and audio data played synchronously to the playing interface unit according to the recovered line-field synchronizing signal. For example, the received playing instruction includes frame-by-frame playing, and the data processing unit recovers each synchronization signal frame-by-frame according to the instruction and outputs the corresponding image frame to the playing interface unit, which includes forward frame-by-frame playing (or backward frame-by-frame playing) according to the playing instruction. For another example, the received play instruction includes slow play, and the data conversion device restores each synchronization signal by reducing the original speed of 120 frames/second to the speed of 30 frames/second, extracts the image frame to be played back from the buffer, and outputs the image frame to the play interface unit. It should be noted that the data conversion device may perform slow playback according to the speed indicated in the play instruction, such as 25 frames/second, or 60 frames/second.

And the data switching device is suitable for providing live multimedia playing switching according to the data volume of the multimedia data which can be stored in the external cache unit.

In some application scenarios such as monitoring, medical treatment, etc., multimedia playing data collected by a data collection device located at the front end needs to be stored in a non-volatile memory for storage and reproduction. Therefore, please refer to fig. 4, which is a schematic structural diagram of a data forwarding device according to another embodiment of the present application. Unlike the data transfer device shown in fig. 2 and 3, the data transfer device 4 includes a data receiving unit 41, a data processing unit 42, an external buffer unit 44, and a nonvolatile storage unit 45.

The data receiving unit 41 has the same or similar structure and implementation manner as the data receiving units (21, 31), and will not be described in detail herein.

The data processing unit 42 is respectively connected to the external cache unit 44 and the nonvolatile storage unit 45; the data processing unit 42 is further configured to store the multimedia playing data into the external buffer unit 44 based on the synchronization control information, and extract the buffered multimedia playing data from the external buffer unit 44 and dump the multimedia playing data into the nonvolatile storage unit 45.

Here, the data processing unit 42 may store the multimedia playing data to the external buffer unit 44 according to the synchronization control information under the control of the clock signal; establishing an index mechanism for determining storage addresses of pixel rows (or columns) in the image frame, head and tail storage addresses of the image frame and synchronous audio data storage addresses; when the multimedia playing data is read from the external buffer unit 44, not only the line-field synchronization signal can be recovered, but also the audio data segment synchronized with the corresponding image frame is determined based on the indexing mechanism; by means of the recovered line-field synchronization signal, the data processing unit 42 transfers the audio/video data for synchronous playing to the nonvolatile storage unit 45. Thus, the data transfer device can effectively solve the problem of data loss caused by data transmission rate mismatch between the data receiving unit 41 and the data processing unit 42 and between the data processing unit 42 and the nonvolatile storage unit 45.

In some practical applications, such as where image frames acquired using an industrial camera device contain 8K pixel data, to prevent buffer overflow, the non-volatile storage unit 45 contains a storage array connected in parallel with the data processing unit 42; the data processing unit 42 divides the multimedia playing data according to the storage array and stores the divided multimedia playing data into the storage array.

Here, the data processing unit 42 stores the multimedia playing data into the storage array in a manner that the multimedia playing data are read one by one from the external buffer memory after being stored into the external buffer memory unit 44. Because the storage arrays are connected with the data processing unit 42 in parallel, the data processing unit 42 divides an image frame according to the number of the storage arrays and synchronously stores the image frame in the storage arrays according to the local clock signal, so that the purpose of storing lossless and high-definition image frames by the data processing unit 42 at high speed is achieved.

It should be noted that, no matter the multimedia playing data is stored in the external buffer unit or the nonvolatile storage unit, an index corresponding to the storage address is constructed for recovering synchronization control information such as the line field synchronization signal, and therefore, detailed description thereof is omitted.

It should be noted that the data transfer device may further integrate an encoding unit and a data sending unit provided in the data acquisition device, so that the encoding unit is used to re-encode and encapsulate the synchronous control information such as the local clock signal, the recovered line field synchronization signal, and the like and the stored multimedia playing data, and the data sending unit is used to continuously transmit the multimedia playing data. Therefore, the cascade connection of the data switching devices is realized, and the problems that the multimedia playing data cannot be transmitted to a farther area due to the limitation of the length of a data transmission line and the like are solved.

In some practical applications, in order to prevent the data transfer device from losing the multimedia playing data that is not stored in the non-volatile storage unit due to abnormal power supply, the data transfer device provided in the present application further includes a power-off protection unit (not shown) for supplying power when the data transfer device is abnormally powered off and transferring the multimedia playing data buffered in the external buffer unit to the non-volatile storage unit.

Here, the power-off protection unit includes a power management module and an electric storage module. The power management module is used for monitoring whether external power supply of the data switching device is normal or not, and switching to the power storage module when the external power supply of the data switching device is abnormal. Here, the power management module includes a switch, a control circuit of the switch, and the like. The electric storage module comprises at least one capacitor for storing energy, a charging and discharging circuit of the capacitor and the like. The electricity utilization time length provided by the electricity storage module is more than or equal to the time length spent by the data processing unit for transferring the multimedia playing data in the external cache unit to the nonvolatile storage unit. For example, when the external buffer unit is almost full of multimedia playing data, the electricity consumption time provided by the electricity storage module should be greater than or equal to the time spent by the data processing unit to dump all multimedia playing data in the external buffer unit into the nonvolatile storage unit. The data processing unit can also execute shutdown operation after transferring the multimedia playing data to the nonvolatile storage unit based on the power-off detection signal provided by the power-off protection unit so as to prevent damage to hardware of the data transfer device caused by abnormal exit of the program.

Based on the structural description of the data acquisition device and the data switching device, the application also provides a data transmission system. The data transmission system may include the data acquisition device described in any of the foregoing examples and a data transfer device corresponding to the data acquisition device, and will not be repeated here.

Please refer to fig. 5, which is a schematic diagram illustrating a network architecture of a data transmission system according to an embodiment. The data acquisition device 1 comprises an acquisition unit 11, a clock signal generation unit 14, an encoding unit 12 and a data transmission unit 13; and the data transfer device 2 comprises a data receiving unit 21, a data processing unit 22 and a playing interface unit 23 as an example, wherein the acquiring unit 11 comprises an industrial camera and a voice input module, which provides image frames, status information and audio data of 8K 60 frames/s. The clock signal generation unit 14 outputs a clock signal. The clock signal is used to provide a basic unit clock period for the synchronous processing of each pixel row (or column) and audio data in an image frame. The encoding unit 12 generates a line-field synchronizing signal from the read image frame and its pixel lines (or columns) under the control of a clock signal, reads pixel data, and reads an audio data segment within a time period for capturing one or more image frames based on a time stamp in the audio data; the encoding unit 12 uniformly encodes and encapsulates the clock signal, the line-field synchronizing signal, the audio-video synchronizing signal, the control code, the pixel data, the state information, the audio data segment and the like into a transmittable data packet according to a preset encoding format. The encoding unit 12 transmits the data packets to the data transfer device one by one through the data transmitting unit 13. The data receiving unit 21 in the data switching device 2 receives and parses the data packet for delivery to the data processing unit 22. The data processing unit 22 obtains each pixel row (or column) and audio data segment of the image frame capable of being played synchronously according to the analyzed and recovered clock signal, line-field synchronizing signal, audio synchronizing signal and the like and by using the type of data in the data packet provided by the control code and the like; and dividing the obtained image frames according to the number of the playing interfaces of the playing interface unit 23, and sending the divided image sub-frames and audio data segments to each playing interface in a shunting manner, so as to realize that the audio and video containing 8K image frames are played in real time.

Please refer to fig. 6, which is a schematic diagram illustrating a network architecture of a data transmission system according to an embodiment. The data acquisition device 1 comprises an acquisition unit 11, a clock signal generation unit 14, an encoding unit 12 and a data transmission unit 13; and the data transfer device 3 includes a data receiving unit 31, a data processing unit 32, an external buffer unit 34, and a playing interface unit 33 as an example, wherein the obtaining unit 11 includes an industrial camera and a voice input module, which provides image frames, state information, and audio data of 8K 120 frames/s, wherein the playing frequency of the playing interface unit 33 in the data transfer device is less than 120 frames/s, in this example, the playing frequency of the playing interface unit 33 is 60 frames/s as an example, and the execution process of the data transmission system shown in fig. 6 is illustrated as an example. The clock signal generation unit 14 in the data acquisition device outputs a clock signal. The clock signal is used to provide a basic unit clock period for the synchronous processing of each pixel row (or column) and audio data in an image frame. The encoding unit 12 generates a line-field synchronizing signal from the read image frame and its pixel lines (or columns) under the control of a clock signal, reads pixel data, and reads an audio data segment within a time period for capturing one or more image frames based on a time stamp in the audio data; the encoding unit 12 uniformly encodes and encapsulates the clock signal, the line-field synchronizing signal, the audio-video synchronizing signal, the control code, the pixel data, the state information, the audio data segment and the like into a transmittable data packet according to a preset encoding format. The encoding unit 12 transmits the data packets to the data transfer device one by one through the data transmitting unit 13. The data receiving unit 31 in the data relay device 3 receives and parses the data packet for delivery to the data processing unit 32. The data processing unit 32 obtains each pixel row (or column) and audio data segment of the image frame capable of being played synchronously according to the analyzed and restored clock signal, line-field synchronizing signal, audio synchronizing signal and the like and by using the type of data in the data packet provided by the control code and the like, and stores the pixel row (or column) and audio data segment in the external cache unit; the data processing unit 31 reads the image frame from the external buffer unit 34 according to the local clock signal in a frame-by-frame display manner, and recovers line-field synchronization signals, audio-video synchronization signals and the like according to the data of each pixel line (or column) and state information in the image frame obtained during storage and the synchronized audio data segment; and under the control of the recovered line-field synchronizing signal, audio-video synchronizing signal and the like, dividing the obtained image frame according to the number of the playing interfaces of the playing interface unit 33, and sending the divided image sub-frames and audio data segments to each playing interface in a shunting manner so as to realize that the audio and video containing 8K image frames are played in real time.

Please refer to fig. 7, which is a schematic diagram illustrating a network architecture of a data transmission system according to another embodiment. The data acquisition device 1 comprises an acquisition unit 11, a clock signal generation unit 14, an encoding unit 12 and a data transmission unit 13; and the data transfer device 4 comprises a data receiving unit 41, a data processing unit 42, an external buffer unit 44 and a nonvolatile storage unit 45 as an example, wherein the acquiring unit 11 comprises an industrial camera and a voice input module, which provides 8K 60 frames/s of image frames, status information and audio data thereof. The clock signal generation unit 14 outputs a clock signal. The clock signal is used to provide a basic unit clock period for the synchronous processing of each pixel row (or column) and audio data in an image frame. The encoding unit 12 generates a line-field synchronizing signal from the read image frame and its pixel lines (or columns) under the control of a clock signal, reads pixel data, and reads an audio data segment within a time period for capturing one or more image frames based on a time stamp in the audio data; the encoding unit 12 uniformly encodes and encapsulates the clock signal, the line-field synchronizing signal, the audio-video synchronizing signal, the control code, the pixel data, the state information, the audio data segment and the like into a transmittable data packet according to a preset encoding format. And the coding unit sends the data packets to the data switching device one by one through the data sending unit. The data receiving unit 41 in the data conversion apparatus receives and parses the data packet to deliver to the data processing unit 42. The data processing unit 42 obtains each pixel row (or column) and audio data segment of the image frame that can be played synchronously according to the decoded and recovered clock signal, line-field synchronization signal, audio synchronization signal, etc. and by using the type of data in the data packet provided by the control code, etc., and stores the pixel row (or column) and audio data segment in the external buffer unit 44. The data processing unit 42 reads the image frame from the external buffer unit 44 according to the local clock signal, and recovers line-field synchronization signals, audio-video synchronization signals and the like according to the data of each pixel line (or column) and state information in the image frame obtained during storage, and the synchronized audio data segment; and under the control of the recovered line-field synchronizing signal, audio-video synchronizing signal and the like, segmenting the obtained image frame according to the number of the storage arrays in the nonvolatile storage unit 45, and sending the segmented image sub-frames and audio data segments to each storage array in a shunting manner so as to realize that the audio and video containing 8K image frames are stored in real time.

It should be noted that the structure of the data transmission system is only an example, and is not a limitation of the present application. In fact, according to the design requirement of the practical application scenario, the data switching device in the data transmission system may integrate an external cache unit, a play interface unit and a nonvolatile storage unit, so as to provide both real-time display and play functions of playback, fast and slow play, frame-by-frame viewing, etc. of the captured multimedia play data for a longer period of time. And will not be described in detail herein.

Please refer to fig. 8, which is a flowchart illustrating a data acquisition method according to the present application. The data acquisition method may be performed by the data acquisition apparatus provided herein, or by any other data acquisition apparatus capable of performing the data acquisition method.

The data acquisition device is used for acquiring multimedia data. The data acquisition device comprises a camera module or a voice input module, or comprises a camera module and a voice input module. The camera module comprises a digital camera or an industrial camera device. The industrial camera device includes a linear array camera device or an area array camera device. The voice input module comprises a built-in or external microphone and the like. Correspondingly, the acquired multimedia data includes audio data and video data, wherein the video data includes image frames, status information and the like.

In step S110, the acquired multimedia playing data is encoded into multimedia playing data and synchronization control information based on a clock signal. The clock signal generating unit is, for example, a clock signal generating circuit that generates a clock signal by a crystal oscillator, or a clock signal generating circuit that generates a clock signal by a ramp signal. The clock signal is used for providing a unit clock period for the encoding unit and the data transmission unit to perform data processing.

And under the control of the clock signal, encoding the acquired multimedia data into multimedia playing data and synchronous control information.

Here, the audio/video data is synchronously encoded according to the clock signal to obtain multimedia playing data and synchronous control information corresponding to the multimedia playing data. Wherein the multimedia playing data comprises at least one or more of the following combinations: image frames, audio data, and status information associated with the data acquisition device. Wherein the status information includes auxiliary information related to hardware and software in the acquisition unit, which includes but is not limited to: color information, camera shooting parameters, some reservation information specific to a particular application scenario, etc. Wherein the camera shooting parameters include, but are not limited to, exposure rate, shutter speed, white balance parameters, and the like. Here, the data included in the multimedia playing data is related to the type of multimedia data that can be collected by the data collection device. For example, if the data acquisition device only includes a camera module, the multimedia playing data may include only image frames, or image frames and status information. For another example, if the data acquisition device includes a camera module and a voice input module, the multimedia playing data includes an image frame and audio data, and even further includes the state information.

In a unit clock period provided by a clock signal, the data acquisition device extracts pixel data in the image frame shot by the camera module line by line, interlaced or alternate line according to the playing frequency of the image frame and the pixel number of the image frame, and simultaneously generates synchronous control information for the position of the extracted pixel data in each frame of the image and representing the starting position and the ending position of the image frame. The synchronization control information correspondingly comprises at least one of a line synchronization signal and a field synchronization signal. For example, the encoding unit generates a line synchronization signal and a field synchronization signal at the start time of a certain unit clock period, and extracts the first line of pixel data of the image frame in the subsequent unit clock period according to the line synchronization signal and the field synchronization signal.

The data acquisition device also extracts audio data segments from the audio data within a unit clock period provided by the clock signal. In some examples, the encoding unit sets the extracted audio data segment before or after the corresponding image frame according to synchronization information such as a time stamp in the audio/video data, and uses a field synchronization signal to ensure that the image frame and the corresponding audio data segment are processed synchronously at a receiving end.

In a unit clock period provided by the clock signal, the data acquisition device also acquires state information corresponding to the current image frame and/or the camera module, and encodes the state information in the multimedia playing data. For example, the camera module in the data acquisition device adopts an industrial camera device, and the data acquisition device acquires color information corresponding to the current image frame, shooting parameters of the industrial camera device, and the like, and encodes the color information and the shooting parameters in multimedia playing data. For example, the data acquisition device encodes the state information in a packet header of the multimedia playing data.

To this end, the data acquisition method further comprises: and a step of encoding at least one of the pixel data, the state information, and the audio data segment extracted within the unit time period into multimedia play data according to a preset encoding format. In some embodiments, the data acquisition device further encapsulates the multimedia playing data and the corresponding synchronization control information in at least one data packet that can be transmitted according to a standard or customized encapsulation protocol. Here, at least one of multimedia playback data and synchronization control data may be contained within the encapsulated single data packet according to an actual encapsulation rule.

In other embodiments, to facilitate transmission of the data amount of the 8K image frame as provided by the industrial camera, in some examples, the synchronization control information further includes at least one of a control code, an audio video synchronization signal. The audio and video synchronization signal can be represented by a combination of a line synchronization signal, a field synchronization signal and a control code. For example, based on the field sync period represented by the field sync signal, the data acquisition device encodes the audio signals synchronized with the image frame corresponding to the field sync signal together, and represents the type of multimedia data encapsulated in a single data packet using a control code, etc. The control code may describe different types by at least one field (or byte). For example, the data currently encapsulated is described by the control code to include types of multimedia data, status information, idle information, and the like. The control codes may be encapsulated in data packets at fixed intervals. For example, the control code is encapsulated in a data packet according to an interval of a fixed data amount. Or the control code may be set according to the specific position of each type of encapsulated data in the data packet. Therefore, the data acquisition device can package the synchronous control information and the multimedia playing data together, so that the receiving end can analyze the multimedia playing data to be synchronously processed according to the synchronous control information.

In some further embodiments, in order to reduce interference to the clock signal transmission due to signal attenuation, noise interference, and the like during data transmission, the data acquisition device further encodes the clock signal and at least one of the multimedia playing data and the synchronization control information processed in the time period corresponding to the clock signal, transmits the encoded data using different channels, or transmits the encoded data to the data transmission unit according to a preset timing sequence.

In some examples, the data acquisition device provides at least two encoding rules for the clock signal, the synchronization control information, and the multimedia playing data, so that the encoded clock signal, the encoded synchronization control information, and the encoded multimedia playing data can be transmitted separately according to a time sequence or by using different channels. In still other examples, the data acquisition device uniformly encodes and encapsulates the clock signal, the synchronization control information and the multimedia playing data according to preset rules. Taking the example that one data contains multimedia playing data and synchronous control information which need to be synchronously processed in a unit clock period, the data acquisition device encodes a clock signal and synchronous control information such as a line synchronous signal, a field synchronous signal, a control code and the like into digital information at a preset field position according to a preset encoding protocol, and encapsulates the digital information and the multimedia playing data together. According to the rule of actual data encapsulation, at least one of a clock signal, synchronization control information and multimedia playing data can be included in the encapsulated single data packet. For example, a packet may only include an encoded clock signal to help the data-forwarding device construct a local clock signal. For another example, a packet may include encoded clock signals, field sync signals, control codes, and null data. For another example, a data packet may include encoded clock signals, synchronization control information, and multimedia playing data. For example, a certain data packet may contain an encoded clock signal and multimedia playing data.

It should be noted that the present application is not limited to the encoding and packaging method provided by the aforementioned data acquisition device, and the multimedia playing data is processed, such as encrypted and compressed. However, on the technical idea of performing network transmission preparation for multimedia playing data by using the encoding and packaging method provided by the data acquisition device, other preliminary preparations for multimedia playing data should be regarded as technical solutions obtained based on the technical teaching of the present application.

The data acquisition device performs step S120 to transmit the clock signal, the multimedia playing data and the synchronization control information to the receiving end. The data acquisition device can adopt at least one data line to send clock signals and multimedia playing data and synchronous control information.

Here, according to the data volume of the multimedia playing data that needs to be processed synchronously in the unit clock cycle of the data acquisition device, the data transmission capability of the technician selecting the transmission line needs to meet the data volume of the multimedia playing data that needs to be processed synchronously in the unit clock cycle. In some embodiments, in order to match the pixel data amount and the playing frequency of the image frame of the industrial camera device, the data acquisition device includes an optical fiber interface therein, and the data acquisition device transmits the data packet to the receiving end by using an optical fiber medium. For example, the data acquisition device transmits multimedia playing data containing 8K image frames to the data transfer device by using an optical fiber medium, and provides the data transfer device with the multimedia playing data which can be displayed at a frequency of 120 frames/second or 60 frames/second. The 8K image frame can be captured by an 8K camera, or captured and compressed by an 8K or higher camera. For example, the 8K image frame is captured by an 8K camera, and the 8K image frame is 3300 ten thousand pixels (7680 × 4320 pixels). Here, the pixel resolution of the subsequently mentioned image frames can be based on the pixel resolution of the respective camera device used, which is not repeated in the following.

It should be noted that, depending on the amount of data actually transmitted, the transmission distance, and the number of data lines capable of transmitting data, the data sending unit may include a single mode fiber interface or other network transmission interfaces.

For example, the data acquisition device sends the data packets, such as the clock signal, the multimedia playing data, and the synchronization control information, which are provided by the data acquisition device and encapsulated separately, one by one. For another example, the data sending unit sends the data packets, which are provided by the data acquisition device and are encapsulated with the clock signal, the multimedia playing data and the synchronization control information, one by one.

Referring to fig. 9, the present application further provides a data forwarding method. The data forwarding method is mainly executed by the data forwarding device provided by the application, or any other data forwarding device capable of executing the data forwarding method.

In step S210, a clock signal, synchronization control information, and multimedia playing data from the data acquisition device are acquired. The data switching device corresponds to an interface used by the data acquisition device so as to match data transmission capacity, a data transmission line and the like. In some examples, the receiving interface is a fiber optic interface. For example, the receiving interface is a single mode fiber interface, and receives the clock signal, the synchronization control information and the multimedia playing data sent by the data acquisition device.

In step S220, under the control of the clock signal, forwarding the multimedia playing data based on the synchronization control information, so as to store or display the multimedia playing data.

The data switching device correspondingly processes the digital signal received by the data receiving unit according to a coding format, a sending time sequence or a data line set for sending a clock signal, synchronous control information and multimedia playing data by the data acquisition device, so as to extract the clock signal at the data acquisition device side from the digital signal, generate a corresponding local clock signal, and generate synchronous control information and forward the multimedia playing data according to the local clock signal.

In some embodiments, the clock signal, the synchronization control information, and the multimedia playing data received by the data switching device are encoded data that is subjected to multiple encoding processes and multi-line transmission. The step S220 includes decoding the clock signal, the synchronization control information, and the multimedia playing data according to a preset decoding format.

And correspondingly decoding the received clock information, control information and multimedia playing information according to a preset decoding format by the data switching device, thereby recovering the clock signal, the synchronous control information and the multimedia playing data. In one example, the data switching device correspondingly decodes the clock information, the control information and the multimedia playing information from different data lines according to a plurality of preset decoding formats. In another example, the data switching device decodes the clock signal, the synchronization control information and the multimedia playing data according to a preset decoding format; and under the control of the decoded clock signal, forwarding at least the decoded multimedia playing data based on the decoded synchronization control information. The data packet is in a unified coding and packaging format according to information contained in the data packet actually sent by the data acquisition device. For a single data packet, at least one of a clock signal, synchronization control information, and multimedia play data may be included in the data packet. For example, a packet may only include an encoded clock signal to help the data-forwarding device construct a local clock signal. For another example, a packet may include encoded clock signals, field sync signals, control codes, and null data. For another example, a data packet may include encoded clock signals, synchronization control information, and multimedia playing data. For example, a certain data packet may contain an encoded clock signal and multimedia playing data. And the data switching device decodes the data packet according to a preset decoding format to obtain the clock signal, the synchronous control information and the multimedia playing data.

Here, the data transfer device buffers or transfers multimedia playing data according to the clock signal and the synchronization control information. For example, the data switching device generates a local clock signal by using the decoded clock signal on one hand, and generates a horizontal synchronization signal and synchronously forwards multimedia playing data in one unit clock cycle by decoding on the other hand; after delaying one unit clock period, the data switching device generates the line synchronization signal and forwards the corresponding multimedia playing data in parallel based on the line synchronization signal.

According to the data type contained in the actual multimedia playing data, the received synchronous control information also comprises a control code; correspondingly, the data switching device forwards the corresponding type of data in the multimedia playing data based on the type represented by the control code. Here, the data transfer device determines the data type included in the decoded data packet according to the type indicated by the preset control code, and performs the transfer processing on the multimedia playing data in combination with other synchronization signals in the synchronization control information. For example, the data forwarding device determines that the decoded data packet contains status information based on the control code, and then determines the color, brightness, etc. of the corresponding pixel in the corresponding image frame according to the status information. For another example, if the data forwarding device determines that the decoded data packet includes an audio data segment based on the control code, it may determine that the audio data segment and the image frame need to be played synchronously in combination with the current line-field synchronization signal; or giving the corresponding index record when unloading, etc.

With reference to the description of the above examples, the step S220 includes outputting the multimedia playing data to a playing terminal according to the synchronization control information. Here, the data acquisition device includes playing interfaces such as HDMI, SDI, VGA, Displayport, and the like according to the matching degree between the data amount of the multimedia playing data provided by the data acquisition device and the playing capability of the playing terminal, and the matching capability of the playing frequency between the data acquisition device and the playing terminal. In some examples, the data collection device includes a one-way play interface. For example, the image frame in the transmitted multimedia playing data is 2-4K pixel data, and correspondingly, the playing interface may be an HDMI interface. In still other examples, the play interface unit includes at least two play interfaces. For example, the image frame in the transmitted multimedia playing data is 8K pixel data, and correspondingly, the playing interface adopts a four-way HDMI interface.

In order to match the playing frequency of 8K image frames and 30 frames/s (or 60 frames/s), the data acquisition device adopts four paths of playing interfaces to output multimedia playing data, and the data acquisition device divides the image frames in the acquired multimedia playing data under the control of a horizontal-field synchronizing signal in the synchronous control information and outputs the divided image frames to each path of playing interface.

Under the control of a clock signal from the data acquisition device, the data acquisition device divides the pixel data lines (or pixel data columns) according to the image frame corresponding to the line-field synchronization signal and the pixel data lines (or pixel data columns) in the image frame to obtain image sub-frames which can be output to each path of playing interface, and outputs the image sub-frames to the corresponding playing interfaces respectively. And the playing terminal connected with each playing interface correspondingly displays the image sub-frames. In some examples, the image frame in the multimedia playing data is 8K pixel data, and the playing data interface unit includes four playing interfaces, where the four playing interfaces are connected to an 8K display terminal; correspondingly, the data acquisition device divides the image frame into four image sub-frames according to the line-field synchronous signal, and outputs the four image sub-frames to each playing interface in parallel under the control of the clock signal, and the 8K display terminal displays the image frame.

In still other practical applications, at least one of the processing rate, the output rate, or the playing frequency of the playing terminal of the data transfer device does not match the multimedia playing data output by the data acquisition device according to the playing frequency thereof, and for this purpose, the data transfer device includes an external buffer unit, which may be a volatile memory, such as RAM, DRAM, or the like. The external buffer unit is used for temporarily storing the received multimedia playing data and the like.

Correspondingly, the data forwarding method further comprises the following steps: and a step of recovering the synchronous control information of the extracted multimedia playing data by transferring through an external cache unit, and outputting the obtained multimedia playing data to a playing terminal according to the recovered synchronous control information.

Here, the data transfer device does not directly output the obtained multimedia playing data to the playing terminal through the playing interface unit, but temporarily stores the multimedia playing data to the external buffer unit by using the clock signal of the data acquisition device so as to buffer the playing frequency of the playing interface unit. For example, the image frame and status information in the multimedia data are stored in the external buffer unit according to the line-field synchronization signal in the synchronization control information, and the audio input corresponding to the image frame is also stored in the external buffer unit according to the audio-video synchronization signal. The data switching device reads the multimedia playing data from the external cache unit according to the local clock signal or the clock signal provided by the data acquisition device and outputs the multimedia playing data to the playing interface unit. The local clock signal or the homologous clock signal is used for ensuring that the data transfer device provides a basic unit clock period during the synchronous reading and writing of data. The data switching device generates a line-field synchronizing signal according to the image frame obtained when the external cache unit is stored and the storage address field of each pixel line (or column) of the image frame, generates an audio-video synchronizing signal according to the storage address field of the audio data field obtained when the external cache unit is stored, and divides and outputs the image frame according to the number of the playing interfaces in the playing interface unit.

In other embodiments, the data switching device further extracts an image frame of the buffered multimedia playing data from the external buffer unit based on a preconfigured playing frequency, restores a line-field synchronization signal according to each pixel line (or column) of the extracted image frame, and outputs the extracted image frame to the playing interface unit according to the restored line-field synchronization signal.

Taking an example that a data acquisition device acquires 8K image frames and outputs the image frames according to the playing frequency of 120 frames/s, and the playing frequency which can be output by a playing interface unit in a data switching device is 60 frames/s, the data switching device selectively reads the image frames in multimedia playing data from a cache at intervals of frames according to the playing frequency of 60 frames/s, generates line and field synchronizing signals of the extracted image frames according to local clock signals, divides the corresponding image frames into four paths, and respectively outputs the divided image frames to the playing interface unit by using the generated line and field synchronizing signals.

The multimedia playing data comprises audio data, and the data switching device also extracts the audio data synchronous with the image frame from an external cache unit and outputs the audio data to the playing interface unit.

In some examples, the data forwarding apparatus further includes a human-computer interaction unit (not shown) for obtaining the playing instruction. Wherein, the human-computer interaction unit includes but is not limited to: a wireless receiving module communicated with the remote controller, an interface module used for connecting a mouse, a keyboard and the like, and the like. The data switching device extracts corresponding multimedia playing data from the cached multimedia playing data based on the acquired playing instruction, and outputs the corresponding multimedia playing data according to the synchronous control information of the extracted multimedia playing data so as to play the corresponding multimedia playing data. Wherein the playing instruction includes, but is not limited to, any one of the following: a play instruction for displaying a previous (or next) image frame, a play instruction for slowly playing (or quickly playing) multimedia play data, a play instruction for displaying frame by frame, a play instruction for playing multimedia play data based on a previous (or next) image frame, and the like.

Correspondingly, the data forwarding method further comprises the following steps: extracting corresponding multimedia playing data from the cache according to the received playing instruction, recovering a line-field synchronizing signal for display control according to a local clock signal and a data storage address of each pixel line (or column) in the image frame, and outputting the image frame indicated by the playing instruction and audio data played synchronously to a playing interface unit according to the recovered line-field synchronizing signal. For example, the received playing instruction includes frame-by-frame playing, and the data processing unit recovers each synchronization signal frame-by-frame according to the instruction and outputs the corresponding image frame to the playing interface unit, which includes forward frame-by-frame playing (or backward frame-by-frame playing) according to the playing instruction. For another example, the received play instruction includes slow play, and the data conversion device restores each synchronization signal by reducing the original speed of 120 frames/second to the speed of 30 frames/second, extracts the image frame to be played back from the buffer, and outputs the image frame to the play interface unit. It should be noted that the data conversion device may perform slow playback according to the speed indicated in the play instruction, such as 25 frames/second, or 60 frames/second.

In some application scenarios such as monitoring, medical treatment, etc., multimedia playing data collected by a data collection device located at the front end needs to be stored in a non-volatile memory for storage and reproduction. To this end, the data forwarding method further includes the steps of: the extracted synchronization control information of the multimedia playing data is recovered through the transfer of an external cache unit, and the multimedia playing data is stored into a nonvolatile storage unit according to the recovered synchronization control information.

The data switching device can store the multimedia playing data into an external cache unit according to the synchronous control information under the control of a clock signal; establishing an index mechanism for determining storage addresses of pixel rows (or columns) in the image frame, head and tail storage addresses of the image frame and synchronous audio data storage addresses; when the multimedia playing data is read from the external cache unit, not only the line-field synchronizing signal can be recovered, but also the audio data segment synchronous with the corresponding image frame is determined based on the indexing mechanism; and by means of the recovered line-field synchronizing signal, the data transfer device transfers the audio and video data for synchronous playing to the nonvolatile storage unit. Therefore, the data switching device can effectively solve the problem of data loss caused by mismatching of data transmission rates between the data receiving unit and the data switching device and between the data switching device and the nonvolatile storage unit.

In some practical applications, for example, an image frame acquired by an industrial camera device contains 8K pixel data, in order to prevent buffer overflow, the nonvolatile storage unit contains a storage array, and the storage array is connected with the data transfer device in parallel; and the data switching device divides the multimedia playing data according to the storage array and stores the divided multimedia playing data into the storage array.

The data transfer device transfers the multimedia playing data to the storage array in a mode of reading the multimedia playing data from the external cache one by one after the multimedia playing data are stored in the external cache unit. The data switching device divides an image frame according to the number of the storage arrays and synchronously stores the image frame in the storage arrays according to local clock signals so as to realize the purpose of storing lossless and high-definition image frames by the data switching device at a high speed.

In summary, the data acquisition device and the data transfer device provided by the present application use the same source clock signal for data synchronization processing, so that multimedia playing data, especially lossless images, can be played in real time and stored in different places. The transmission scheme of multimedia playing data is provided in the fields of urban security, traffic monitoring, medical image detection, industrial nondestructive image detection and the like which need high-definition image video.

It should be noted that, through the above description of the embodiments, those skilled in the art can clearly understand that part or all of the present application can be implemented by software and combined with necessary general hardware platform. The functions may also be stored in a computer-readable storage medium if they are implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the present application also provides a computer readable storage medium storing at least one program which, when executed, implements any of the aforementioned data acquisition methods or data transfer methods, such as the methods described above with respect to fig. 8 or 9.

With this understanding in mind, the technical solutions of the present application and/or portions thereof that contribute to the prior art may be embodied in the form of a software product that may include one or more machine-readable media having stored thereon machine-executable instructions that, when executed by one or more machines such as a computer, network of computers, or other electronic devices, may cause the one or more machines to perform operations in accordance with embodiments of the present application. Such as the steps in the data acquisition method or the data transfer method, etc. The machine-readable medium may include, but is not limited to, floppy diskettes, optical disks, CD-ROMs (compact disc-read only memories), magneto-optical disks, ROMs (read only memories), RAMs (random access memories), EPROMs (erasable programmable read only memories), EEPROMs (electrically erasable programmable read only memories), magnetic or optical cards, flash memory, or other type of media/machine-readable medium suitable for storing machine-executable instructions.

Also, any connection is properly termed a computer-readable medium. For example, if the instructions are transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. It should be understood, however, that computer-readable-writable storage media and data storage media do not include connections, carrier waves, signals, or other transitory media, but are intended to be non-transitory, tangible storage media. Disk and disc, as used in this application, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers.

It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

The above embodiments are merely illustrative of the principles and utilities of the present application and are not intended to limit the application. Any person skilled in the art can modify or change the above-described embodiments without departing from the spirit and scope of the present application. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical concepts disclosed in the present application shall be covered by the claims of the present application.

Claims

1. A data switching device, for transmitting multimedia playing data of 8K image frame provided by a data acquisition device, wherein the data amount transmitted by a transmission line between the data acquisition device and the data switching device in a unit clock cycle is greater than the data amount synchronously processed by a transceiving terminal in the same clock cycle, wherein the data switching device comprises:

the data receiving unit is used for acquiring a clock signal, synchronous control information and multimedia playing data from the data acquisition device; the synchronization control information comprises at least one or more of the following combinations: a line field synchronizing signal, a control code and an audio and video synchronizing signal;

the data processing unit is connected with the data receiving unit and used for forwarding the multimedia playing data based on the synchronous control information under the control of the clock signal;

the data switching device further comprises: the external cache unit, the playing interface unit and/or the nonvolatile storage unit are/is respectively connected with the data processing unit;

wherein, the process that the data processing unit forwards the multimedia playing data based on the synchronous control information under the control of the clock signal comprises the following steps:

correspondingly processing the digital signal received by the data receiving unit according to a coding format, a sending time sequence or a data line set by the data acquisition device for sending a clock signal, synchronous control information and multimedia playing data so as to extract the clock signal at the data acquisition device side from the digital signal, generate a corresponding local clock signal and transfer the multimedia playing data to the external cache unit according to the local clock signal and the synchronous control information; and at least one of the following steps:

extracting the cached multimedia playing data from the external cache unit according to the local clock signal and transferring the multimedia playing data to the nonvolatile storage unit; and/or

Extracting the cached multimedia playing data from the external cache unit according to the local clock signal and sending the multimedia playing data to the playing interface unit; or sending the forwarded and processed multimedia playing data to the playing interface unit according to the local clock signal so as to be played by the playing terminal.

2. The data switching device according to claim 1, wherein the synchronization control information comprises a line-field synchronization signal; correspondingly, the data processing unit forwards the image frames in the multimedia playing data based on the line-field synchronization signal under the control of the clock signal.

3. The data forwarding apparatus of claim 1, wherein the synchronization control information comprises a control code, and the data processing unit forwards data of a corresponding type in the multimedia playing data based on a type indicated by the control code.

4. The data switching device according to claim 1, wherein the data processing unit is further configured to decode the clock signal, the synchronization control information, and the multimedia playing data according to a preset decoding format; and under the control of the decoded clock signal, forwarding at least the decoded multimedia playing data based on the decoded synchronization control information.

5. The data switching device as claimed in claim 4, wherein the data processing unit is configured to decode a data packet containing at least one of the clock signal, the synchronization control information and the multimedia playing data according to a predetermined decoding format.

6. The data switching device according to claim 1, wherein the playing interface unit comprises: at least one path of playing interface;

and the data processing unit divides the image frames in the acquired multimedia playing data under the control of the horizontal-field synchronizing signal in the synchronizing control information and outputs the image frames to each path of playing interface in a shunting way.

7. The data switching device according to claim 1, wherein the data processing unit is configured to extract image frames from the buffered multimedia playing data from the external buffer unit based on a preconfigured playing frequency, and output the extracted image frames to the playing interface unit according to a line-field synchronization signal of the extracted image frames.

8. The data switching device of claim 7, wherein the data processing unit extracts corresponding multimedia playing data from the buffered multimedia playing data based on the obtained playing command, and outputs the corresponding multimedia playing data according to the synchronization control information of the extracted multimedia playing data, so as to play the corresponding multimedia playing data.

9. The data switching device according to claim 1, wherein the nonvolatile memory unit comprises a memory array connected in parallel with the data processing unit; and the data processing unit divides the multimedia playing data according to the storage array and stores the divided multimedia playing data into the storage array.

10. The data switching device according to claim 1, further comprising a power-off protection unit for providing power supply when the data switching device is abnormally powered off and transferring the multimedia playing data buffered in the external buffer unit to the nonvolatile storage unit.

11. The data switching device according to claim 1, wherein the data processing unit extracts corresponding multimedia playing data from the stored multimedia playing data based on the obtained playing command, and outputs the corresponding multimedia playing data according to the synchronization control information of the extracted multimedia playing data, so as to display the corresponding multimedia playing data.

12. The data transfer device of claim 1, wherein the data receiving unit comprises a fiber optic interface.

13. The data switching device according to claim 1, wherein the multimedia playing data comprises at least one or more of the following combinations: image frames, audio data, and status information associated with the data acquisition device.

14. A data transmission system, comprising:

a data acquisition device comprising:

the device comprises an acquisition unit, a processing unit and a display unit, wherein the acquisition unit is used for acquiring multimedia data containing 8K image frames;

a clock signal generating unit for generating and outputting a clock signal;

the encoding unit is connected with the acquisition unit and is used for encoding the acquired multimedia data into multimedia playing data and synchronous control information under the control of the clock signal; the synchronization control information comprises at least one or more of the following combinations: a line field synchronizing signal, a control code and an audio and video synchronizing signal;

the data sending unit is connected with the clock signal generating unit and the acquiring unit and used for sending the clock signal and sending multimedia playing data and synchronous control information which are determined to be transmitted based on the clock signal; and

the data switching apparatus of any of claims 1-13; the data volume transmitted by the transmission line between the data acquisition device and the data switching device in a unit clock cycle is larger than the data volume synchronously processed by the transceiving end in the same clock cycle.

15. The data transmission system of claim 14, wherein the data transmission unit comprises a fiber optic interface.

16. The data transmission system of claim 14, wherein the encoding unit is further configured to perform at least one encoding process on the clock signal, and the multimedia playing data and the synchronization control information processed in the time period corresponding to the clock signal;

correspondingly, the data sending unit is used for sending the encoded clock signal, the multimedia playing data and the synchronization control information.

17. A data switching method is used for transmitting multimedia playing data which is provided by a data acquisition device and contains 8K image frames, and is characterized in that the data acquisition device provides the multimedia playing data through a transmission line, wherein the data quantity transmitted by the transmission line in a unit clock period is larger than the data quantity synchronously processed by a transmitting end and a receiving end in the same clock period; the data forwarding method comprises the following steps:

acquiring a clock signal, synchronous control information and multimedia playing data from the data acquisition device; the synchronization control information comprises at least one or more of the following combinations: a line field synchronizing signal, a control code and an audio and video synchronizing signal;

correspondingly processing the received digital signals according to a coding format, a sending time sequence or a data line set by the data acquisition device for sending clock signals, synchronous control information and multimedia playing data so as to extract clock signals at the data acquisition device side from the digital signals to generate corresponding local clock signals, and forwarding the multimedia playing data according to the local clock signals and the synchronous control information;

recovering the synchronous control information of the extracted multimedia playing data through the transfer of an external cache unit, and storing the multimedia playing data into a nonvolatile storage unit according to the recovered synchronous control information; and executing at least one of the following steps:

through the transfer of an external cache unit, recovering the synchronous control information of the extracted multimedia playing data according to the local clock signal, and outputting the obtained multimedia playing data to a playing terminal according to the recovered synchronous control information;

and outputting the multimedia playing data to a playing terminal according to the synchronous control information and the local clock signal.

18. The data switching method according to claim 17, wherein the synchronization control information comprises a line-field synchronization signal; correspondingly, under the control of a clock signal, the step of forwarding at least the multimedia playing data based on the synchronization control information includes: and under the control of the clock signal, forwarding the image frames in the multimedia playing data based on the line-field synchronous signal.

19. The data forwarding method of claim 17, wherein the synchronization control information comprises a control code, and correspondingly, the step of forwarding at least the multimedia playing data based on the synchronization control information comprises: and forwarding the data of the corresponding type in the multimedia playing data based on the type represented by the control code.

20. The data forwarding method of claim 17, further comprising: decoding the clock signal, the synchronous control information and the multimedia playing data according to a preset decoding format; so as to forward at least the decoded multimedia playing data based on the decoded synchronization control information under the control of the decoded clock signal.

21. The data switching method according to claim 17, wherein the step of decoding the clock signal, the synchronization control information and the multimedia playing data according to a predetermined decoding format comprises: and decoding the data packet containing at least one of the clock signal, the synchronous control information and the multimedia playing data according to a preset decoding format.

22. The data forwarding method of claim 17, further comprising:

and extracting corresponding multimedia playing data from the stored multimedia playing data based on the acquired playing instruction and outputting the corresponding multimedia playing data so as to play the corresponding multimedia playing data.

23. The data forwarding method of claim 17, wherein the multimedia playing data comprises at least one or more of the following combinations: image frames, audio data, and status information associated with the data acquisition device.

24. A computer-readable storage medium storing at least one program; the at least one program, when invoked, performs the data forwarding method of any of claims 17-23.