WO2020087590A1 - 数据转接装置、数据采集装置及系统、方法 - Google Patents

数据转接装置、数据采集装置及系统、方法 Download PDF

Info

Publication number
WO2020087590A1
WO2020087590A1 PCT/CN2018/116626 CN2018116626W WO2020087590A1 WO 2020087590 A1 WO2020087590 A1 WO 2020087590A1 CN 2018116626 W CN2018116626 W CN 2018116626W WO 2020087590 A1 WO2020087590 A1 WO 2020087590A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
multimedia playback
unit
control information
clock signal
Prior art date
Application number
PCT/CN2018/116626
Other languages
English (en)
French (fr)
Inventor
钮旋
朱璐
周新生
阮俊瑾
朱怀安
焦炳豪
高阳
陈垄
Original Assignee
上海极清慧视科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 上海极清慧视科技有限公司 filed Critical 上海极清慧视科技有限公司
Priority to CN201880002425.2A priority Critical patent/CN109644290B/zh
Publication of WO2020087590A1 publication Critical patent/WO2020087590A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8547—Content authoring involving timestamps for synchronizing content

Definitions

  • the present application relates to the technical field of communication of multimedia playback data, and in particular, to a data switching device, data collection device, system, and method.
  • the data collection device usually compresses the acquired multimedia playback data, and performs the compressed multimedia playback data through the transmission network transmission.
  • the data loss due to compression cannot be recovered during playback, which makes it impossible for users to obtain the amount of audio and video data collected by the front end when watching and listening to audio and video;
  • a verification process (such as a response mechanism) needs to be added, which increases the delay of multimedia playback.
  • the existing technical solutions cannot meet the demand.
  • the purpose of the present application is to provide a data switching device, a data collection device, a system, and a method for solving the problem that the multimedia playback data in the prior art has a large loss and delay during transmission Problem.
  • the first aspect of the present application provides a data switching device for transmitting multimedia playback data provided by a data collection device, including: a data receiving unit that obtains data from the data collection device A clock signal, synchronization control information and multimedia playback data; a data processing unit connected to the data receiving unit for forwarding the multimedia playback data based on the synchronization control information under the control of the clock signal, In order to store or display the multimedia playback data.
  • the synchronization control information includes a line and field synchronization signal; correspondingly, the data processing unit under the control of the clock signal, based on the line and field synchronization signal
  • the image frames in the multimedia playback data are forwarded.
  • the synchronization control information includes a control code
  • the data processing unit forwards the data of the corresponding type in the multimedia playback data based on the type represented by the control code deal with.
  • the data processing unit is further configured to decode the clock signal, synchronization control information, and multimedia playback data according to a preset decoding format; and the decoded clock Under the control of the signal, at least the decoded multimedia playback data is forwarded based on the decoded synchronization control information.
  • the data processing unit is configured to decode a data packet including at least one of the clock signal, synchronization control information, and multimedia playback data according to a preset decoding format .
  • the data switching device further includes: a playback interface unit connected to the data processing unit, configured to output the multimedia according to the forwarding processing of the data processing unit Play data for playback by the playback terminal.
  • the playback interface unit includes: at least one playback interface; the data processing unit divides the acquired multimedia playback under the control of the line sync signal in the synchronization control information The image frames in the data are output separately to each playback interface.
  • the data switching device further includes an external cache unit connected to the data processing unit; the data processing unit converts the multimedia playback data based on the synchronization control information Stored in the external buffer unit; and used for extracting the buffered image frames in the multimedia playback data from the external buffer unit based on a pre-configured playback frequency, and according to the line and field synchronization signals of the extracted image frames, The extracted image frame is output to the playback interface unit.
  • the data processing unit extracts corresponding multimedia playback data from the cached multimedia playback data based on the acquired playback instruction, and synchronizes control information according to the extracted multimedia playback data
  • the corresponding multimedia playback data is output to play the corresponding multimedia playback data.
  • the data switching device further includes: an external cache unit and a non-volatile storage unit; the data processing unit is respectively connected to the external cache unit and non-easy Volatile storage unit; the data processing unit is also used to store the multimedia playback data to the external cache unit based on the synchronization control information, and to extract and transfer the cached multimedia playback data from the external cache unit Into the non-volatile storage unit.
  • the non-volatile storage unit includes a storage array, and the storage array is connected in parallel with the data processing unit; the data processing unit divides multimedia according to the storage array Play data, and store the divided multimedia play data in the storage array.
  • the data switching device further includes a power-off protection unit, configured to provide power supply when the data switching device is abnormally powered off, and store the power in the external cache unit The buffered multimedia playback data is transferred to the non-volatile storage unit.
  • the data processing unit extracts corresponding multimedia playback data from the stored multimedia playback data based on the acquired playback instruction, and synchronizes control information according to the extracted multimedia playback data
  • the corresponding multimedia playback data is output to display the corresponding multimedia playback data.
  • the data receiving unit includes an optical fiber interface.
  • the multimedia playback data includes at least one or more of the following combinations: image frames, audio data, and status information related to the data collection device.
  • the synchronization control information includes at least one or more combinations of the following: a line and field synchronization signal, a control code, and an audio and video synchronization signal.
  • a second aspect of the present application provides a data acquisition device, including: an acquisition unit for acquiring multimedia data; a clock signal generation unit for generating and outputting a clock signal; and an encoding unit connected to the acquisition unit for Under the control of the clock signal, the acquired multimedia data is encoded into multimedia playback data and synchronization control information; a data sending unit, connected to the clock signal generating unit and the acquiring unit, is used to send the clock signal and send Based on the clock signal, the transmitted multimedia playback data and synchronization control information are determined.
  • the data sending unit includes an optical fiber interface.
  • the multimedia playback data sent includes 8K image frames.
  • the encoding unit is further configured to perform at least one of the clock signal, and multimedia playback data and synchronization control information processed within a time period corresponding to the clock signal Encoding process; correspondingly, the data sending unit is used to send the encoded clock signal, multimedia playback data and synchronization control information.
  • a third aspect of the present application provides a data transmission system, comprising: the data collection device according to any one of the foregoing first aspects, and the data transfer device according to any one of the foregoing second aspects.
  • a fourth aspect of the present application provides a data transfer method for transmitting multimedia playback data provided by a data collection device, including: acquiring a clock signal, synchronization control information, and multimedia playback data from the data collection device; Under the control of the clock signal, the multimedia playback data is forwarded based on the synchronization control information to store or display the multimedia playback data.
  • the synchronization control information includes a line and field synchronization signal; correspondingly, under the control of a clock signal, at least the multimedia playback data is performed based on the synchronization control information
  • the step of forwarding processing includes: under the control of the clock signal, forwarding the image frames in the multimedia playback data based on the line and field synchronization signals.
  • the synchronization control information includes a control code
  • the step of forwarding at least the multimedia playback data based on the synchronization control information includes: based on the control code The represented type forwards the corresponding type of data in the multimedia playback data.
  • the method further includes the steps of decoding the clock signal, synchronization control information, and multimedia playback data according to a preset decoding format; Under the control of the signal, at least the decoded multimedia playback data is forwarded based on the decoded synchronization control information.
  • the step of decoding the clock signal, synchronization control information, and multimedia playback data according to a preset decoding format includes: according to the preset decoding format, the step The data packet of at least one of the clock signal, synchronization control information and multimedia playback data is decoded.
  • the step of forwarding at least the multimedia playback data based on the synchronization control information under the control of the clock signal includes: according to the synchronization control information, the The multimedia playback data is output to the playback terminal.
  • the method further includes at least one of the following: restoring synchronization control information of the extracted multimedia playback data through an external buffer unit, and according to the restored synchronization control Information, output the acquired multimedia playback data to the playback terminal; and restore the synchronization control information of the extracted multimedia playback data through an external buffer unit, and store the multimedia playback data to the recovered synchronization control information to In a non-volatile storage unit.
  • the method further includes: extracting and outputting the corresponding multimedia playback data from the stored multimedia playback data based on the acquired playback instruction, so as to play the corresponding multimedia playback data.
  • the multimedia playback data includes at least one or more of the following combinations: image frames, audio data, and status information related to the data collection device.
  • the synchronization control information includes at least one or more combinations of the following: a line and field synchronization signal, a control code, and an audio and video synchronization signal.
  • a fifth aspect of the present application provides a data collection method, including: encoding the acquired multimedia playback data into multimedia playback data and synchronization control information based on a clock signal; sending the clock signal, the multimedia playback data, and synchronization control information.
  • the method further includes: encoding the clock signal, and multimedia playback data and synchronization control information processed within a time period corresponding to the clock signal at least one Process; Correspondingly, send the encoded clock signal, multimedia playback data and synchronization control information.
  • the transmitted multimedia playback data includes 8K image frames.
  • a sixth aspect of the present application provides a computer-readable storage medium, wherein at least one program is stored; when the at least one program is called, the data transfer method according to any one of the fourth aspect is executed; or , The at least one program executes the data collection method according to any one of the fifth aspects when called.
  • the data switching device, the data collection device, the system, and the method of the present application have the following beneficial effects: the data collection device and the data switching device provided in the present application use the same clock signal for data Synchronous processing, so that multimedia playback data, especially lossless images, can be played in real time and stored in different places. In the areas of urban security, traffic monitoring and other areas that require high-definition image monitoring, it provides a multimedia playback data transmission solution.
  • the optical fiber interface in the solution described in this application can be used to acquire multimedia playback data and synchronization control information on the image acquisition device side, and the network can transmit 8K images at a speed of 120 frames per second, thereby realizing urban security ,
  • FIG. 1 shows a schematic structural diagram of an embodiment of a data collection device of the present application.
  • FIG. 2 shows a schematic structural diagram of an embodiment of the data transfer device of the present application.
  • FIG. 3 shows a schematic structural diagram of the data switching device of the present application in another embodiment.
  • FIG. 4 shows a schematic structural diagram of the data transfer device of the present application in another embodiment.
  • FIG. 5 shows a schematic diagram of the network architecture of an embodiment of the data transmission system of the present application.
  • FIG. 6 shows a schematic diagram of the network architecture of the data transmission system of the present application in another embodiment.
  • FIG. 7 shows a schematic diagram of a network architecture of the data transmission system of the present application in another embodiment.
  • FIG. 8 shows a flowchart of the data collection method of the present application.
  • FIG. 9 shows a flowchart of the data transfer method of the present application.
  • A, B or C or "A, B and / or C” means "any of the following: A; B; C; A and B; A and C; B and C; A, B and C” .
  • the exception to this definition only occurs when a combination of elements, functions, steps, or operations are inherently mutually exclusive in certain ways.
  • some embodiments may use streaming media transmission protocols, or breakpoint resume transmission and other transmission technologies to achieve point-to-point transmission or multi-point transmission of multimedia playback data.
  • Most of these methods are suitable for scenes with low real-time requirements, such as on-demand video and watching live delay.
  • real-time performance and audio and video playback quality such as urban high-definition surveillance systems, stadium playback systems, and even medical surgery multimedia teaching systems, special multimedia transmission networks need to be built to enable playback terminals to play in real time High-definition images and / or high-quality audio.
  • the existing method uses a synchronized clock signal to solve the matching problem of the multimedia playback data transmission and display rhythm of the transceiver end, which requires constant calibration of the clock signal of the transceiver end to make it synchronized; wherein the clock The signal synchronization process reduces the real-time nature of the transceiver.
  • the present application provides a data collection device.
  • the data collection device may be installed at a location such as a street for acquiring front-end multimedia playback data.
  • the data collection device is connected to the data switching device through a transmission line dedicated for transmitting multimedia playback data or a public transmission line capable of transmitting multimedia playback data.
  • the amount of data transmitted by the selected transmission line in a unit clock cycle needs to be much larger than that of the transceiver at the same clock
  • the amount of data processed synchronously during the cycle For example, according to the rate of synchronously processing data per unit clock cycle, the corresponding transmission rate of the selected transmission line is ten times, tens of times, or hundreds of times. Therefore, by using the data transmission capability of the selected transmission line, the single-source clock signal can be used as the reference clock signal for synchronous processing between the data collection device and the data switching device to achieve synchronous processing of multimedia playback data .
  • the data switching device may use a clock signal generated by the data collection device to perform data processing to achieve efficient transmission of multimedia playback data.
  • the data acquisition device 1 includes an acquisition unit 11, a clock signal generation unit 14, an encoding unit 12, and a data transmission unit 13.
  • the acquiring unit 11 is used to acquire multimedia data.
  • the acquisition unit 11 includes a camera module or a voice input module, or includes a camera module and a voice input module.
  • the camera module includes a digital camera or an industrial camera device. Examples of the industrial camera device include a linear array camera device or an area array camera device.
  • the voice input module includes a built-in or external microphone.
  • the acquired multimedia data includes audio data and video data, wherein the video data includes image frames and status information.
  • the clock signal generating unit 14 is used to generate and output a clock signal.
  • the clock signal generating unit 14 is, for example, a clock signal generating circuit that generates a clock signal by a crystal oscillator, or a clock signal generating circuit that generates a clock signal by a ramp signal.
  • the clock signal is used to provide the encoding unit 12 and the data sending unit 13 with a unit clock cycle for data processing.
  • the encoding unit 12 is connected to the acquiring unit 11 and is used to encode the acquired multimedia data into multimedia playback data and synchronization control information under the control of the clock signal.
  • the encoding unit 12 includes a processing module that can perform logic control and digital operations, and a storage module for storing intermediate data generated during operation of the processing module.
  • the examples of the processing module include any one or more of the following combinations: FPGA, MCU, CPU, and so on.
  • Examples of the storage module include any one or a combination of the following: volatile memories such as registers, stacks, and caches.
  • the encoding unit 12 synchronously encodes the audio and video data according to the clock signal to obtain multimedia playback data and synchronization control information corresponding to the multimedia playback data.
  • the multimedia playback data includes at least one or more of the following combinations: image frames, audio data, and status information related to the data collection device.
  • the state information includes auxiliary information related to the hardware and software in the acquiring unit 11, which includes but is not limited to: color information, camera shooting parameters, and some reserved information dedicated to specific application scenarios.
  • the camera shooting parameters include but are not limited to exposure rate, shutter speed, white balance parameters and the like.
  • the multimedia playback data may include only image frames, or image frames and status information.
  • the multimedia playback data includes image frames and audio data, and even includes the status information.
  • the encoding unit 12 extracts the image captured by the camera module row by row, column by row, interlaced or interlaced according to the playback frequency of the image frame and the number of pixels of the image frame within the unit clock cycle provided by the clock signal Pixel data in the frame, and simultaneously generate synchronization control information for the position of the extracted pixel data in each frame of the image and the start position and end position of the image frame.
  • the synchronization control information correspondingly includes at least one of a line synchronization signal and a field synchronization signal.
  • the encoding unit 12 generates a line sync signal and a field sync signal at the beginning of a unit clock cycle, and extracts pixel data of the first line of the image frame in a subsequent unit clock cycle according to the line sync signal and the field sync signal .
  • the encoding unit 12 also extracts audio data segments from the audio data.
  • the encoding unit 12 sets the extracted audio data segment before or after the corresponding image frame according to the synchronization information such as time stamp in the audio and video data, and uses the field synchronization signal to ensure the image frame and the corresponding The audio data segment is processed synchronously at the receiving end.
  • the encoding unit 12 also acquires state information corresponding to the current image frame and / or camera module, and encodes the state information in the multimedia playback data.
  • the camera module used in the acquiring unit 11 uses an industrial camera device, and the encoding unit 12 acquires color information corresponding to the current image frame, and shooting parameters of the industrial camera device, etc., and encodes it in multimedia playback data.
  • the encoding unit 12 encodes the status information in the header of multimedia playback data.
  • the encoding unit 12 encodes at least one of pixel data, state information, and audio data segments extracted in a unit time period into multimedia playback data according to a preset encoding format.
  • the encoding unit 12 further encapsulates the multimedia playback data and the corresponding synchronization control information in at least one data packet that can be transmitted according to a standard or custom encapsulation protocol.
  • the encapsulated single data packet may contain at least one of multimedia playback data and synchronization control data.
  • the synchronization control information further includes at least one of a control code and an audio and video synchronization signal.
  • the audio and video synchronization signal can be represented by a combination of a line synchronization signal, a field synchronization signal and a control code.
  • the encoding unit 12 encodes the audio signal synchronized with the image frame corresponding to the field synchronization signal together, and uses the control code to represent the encapsulation in a single data packet
  • the control code can describe different types by at least one field (or byte).
  • a control code is used to describe that the currently encapsulated data includes multimedia data, status information, idle information, and other types.
  • the control code may be encapsulated in the data packet at regular intervals.
  • the control code is encapsulated in a data packet at intervals of a fixed data amount.
  • the control code may set the control code according to the specific position of the encapsulated various types of data in the data packet.
  • the encoding unit 12 can encapsulate the synchronization control information and the multimedia playback data together, so that the receiving end can analyze the multimedia playback data to be synchronized according to the synchronization control information.
  • the encoding unit 12 in order to reduce interference to clock signal transmission due to signal attenuation, noise interference, and other factors during data transmission, the encoding unit 12 further converts the clock signal and within the time period corresponding to the clock signal At least one of the processed multimedia playback data and the synchronization control information performs encoding processing, uses different channels for transmission, or passes the encoded data to the data sending unit 13 according to a preset timing.
  • the encoding unit 12 provides at least two encoding rules for the clock signal, synchronization control information, and multimedia playback data, so that the encoded clock information, control information, and multimedia playback information can be obtained according to the timing or It is transmitted separately using different channels.
  • the encoding unit 12 uniformly encodes and encapsulates the clock signal, synchronization control information, and multimedia playback data according to preset rules.
  • the encoding unit 12 converts the clock signal, the line synchronization signal, the field synchronization signal, and the control code according to a preset encoding protocol
  • the isochronous control information is encoded as digital information at the position of the preset field and encapsulated with multimedia playback data.
  • the data packet may include at least one of a clock signal, synchronization control information, and multimedia playback data.
  • a certain data packet may contain only the encoded clock signal to help the data switching device construct a local clock signal.
  • a certain data packet may contain an encoded clock signal, field synchronization signal, control code, and null data.
  • a certain data packet may include an encoded clock signal, synchronization control information, and multimedia playback data.
  • a certain data packet may contain an encoded clock signal and multimedia playback data.
  • the present application is not limited to performing processing such as encryption and compression on multimedia playback data based on the encoding and packaging methods provided by the aforementioned encoding unit 12.
  • processing such as encryption and compression
  • the encoding and packaging methods provided by the encoding unit 12.
  • other preliminary preparations for the multimedia playback data should be regarded as obtained based on the technical inspiration of the present application Technical solutions.
  • the encoding unit 12 passes the encoded data packet to the data sending unit 13, and the data sending unit 13 sends the data packet to the receiving end.
  • the data sending unit 13 may use at least one data line to send a clock signal and send multimedia playback data and synchronization control information determined to be transmitted based on the clock signal.
  • the technician selects that the transmission capability of the data sending unit 13 needs to meet the data volume of the multimedia playback data that needs to be synchronously processed in the unit clock cycle.
  • the data transmission unit 13 in the data collection device includes an optical fiber interface, and the data transmission unit 13 transmits the data packet using the optical fiber medium To the receiving end.
  • the data sending unit 13 uses optical fiber media to transmit multimedia playback data containing 8K image frames to the data switching device, and provides the data switching device with multimedia that can be displayed at a frequency of 120 frames / second or 60 frames / second. Play data.
  • 8K image frames can be captured by an 8K camera, or captured and compressed by a camera of 8K or more.
  • the 8K image frame is captured by an 8K camera, and the 8K image frame is 33 million pixels (7680 * 4320 pixels).
  • the pixel resolutions of the image frames mentioned later can be derived based on the pixel resolutions of the corresponding camera devices used, which will not be repeated later.
  • the data sending unit 13 may include a single-mode fiber interface or other network transmission interface.
  • the data sending unit 13 sends the data packets one by one in the order of individually packaged clock signals, multimedia playback data, and synchronization control information provided by the encoding unit 12.
  • the data sending unit 13 sends the data packets one by one according to the order of the data packets provided by the encoding unit 12 encapsulated with the clock signal, multimedia playback data, and synchronization control information.
  • the present application also provides a data switching device.
  • the data switching device includes a data receiving unit and a data processing unit.
  • the data receiving unit corresponds to the interface used by the data sending unit in the data collection device to match the data transmission capability, data transmission line, etc.
  • the data receiving unit acquires the clock signal, synchronization control information, and multimedia playback data from the data collection device.
  • the data receiving unit includes: a receiving interface corresponding to the data sending unit.
  • the receiving interface is an optical fiber interface.
  • the receiving interface is a single-mode fiber interface.
  • the data processing unit is configured to forward at least the multimedia playback data based on the synchronization control information in order to store or display the multimedia playback data under the control of the clock signal.
  • the data processing unit includes a processing module that can perform logic control and digital operations, and a storage module for storing intermediate data generated during operation of the processing module.
  • the examples of the processing module include any one or more of the following combinations: FPGA, MCU, CPU, and so on.
  • Examples of the storage module include any one or a combination of the following: volatile memories such as registers, stacks, and caches.
  • the data processing unit processes the digital signal received by the data receiving unit according to the encoding format, transmission timing, or data line set by the data collection device for sending the clock signal, synchronization control information, and multimedia playback data to extract from it
  • the clock signal on the data collection device side generates a corresponding local clock signal, and generates synchronization control information and forwards multimedia playback data according to the local clock signal.
  • the clock signal, synchronization control information, and multimedia playback data received by the data switching device are encoded data that have undergone multiple encoding processes and multiple line transmissions.
  • the data processing unit decodes the clock signal, synchronization control information, and multimedia playback data according to a preset decoding format.
  • the data processing unit decodes the received clock information, control information and multimedia playback information according to a preset decoding format, thereby recovering the clock signal, synchronization control information and multimedia playback data.
  • the data processing unit decodes clock information, control information, and multimedia playback information from different data lines according to a variety of preset decoding formats.
  • the data processing unit decodes the clock signal, synchronization control information, and multimedia playback data according to a preset decoding format; and under the control of the decoded clock signal, based on the decoded synchronization
  • the control information forwards at least the decoded multimedia playback data.
  • the data packet adopts a unified coding and packaging format.
  • the data packet may include at least one of a clock signal, synchronization control information, and multimedia playback data.
  • a certain data packet may contain only the encoded clock signal to help the data switching device construct a local clock signal.
  • a certain data packet may contain an encoded clock signal, field synchronization signal, control code, and null data.
  • a certain data packet may include an encoded clock signal, synchronization control information, and multimedia playback data.
  • a certain data packet may contain an encoded clock signal and multimedia playback data.
  • the data processing unit decodes the data packet according to a preset decoding format to obtain the clock signal, synchronization control information, and multimedia playback data.
  • the data processing unit buffers or forwards multimedia playback data according to the clock signal and synchronization control information. For example, on the one hand, the data processing unit uses a decoded clock signal to generate a local clock signal, and on the other hand, obtains a line synchronization signal and synchronously forwards multimedia playback data within one unit clock cycle through decoding; After the cycle, the data processing unit generates the line synchronization signal and forwards the corresponding multimedia playback data in parallel based on the line synchronization signal.
  • the received synchronization control information also includes a control code; correspondingly, the data processing unit, based on the type represented by the control code, compares the corresponding type in the multimedia playback data The data is forwarded.
  • the data processing unit determines the data type contained in the decoded data packet according to the type indicated by the preset control code, and combines with other synchronization signals in the synchronization control information to forward the multimedia playback data deal with.
  • the data processing unit determines that the decoded data packet contains state information based on the control code, and then determines the color, brightness, etc. of the corresponding pixel in the corresponding image frame according to the state information.
  • the data processing unit determines that the decoded data packet contains an audio data segment based on the control code, and can determine the audio data segment and the image frame to be played synchronously in combination with the current line sync signal; Index records, etc.
  • the manner in which the data processing unit forwards the multimedia playback data according to the clock signal and the synchronization control information may include playing the multimedia playback data.
  • FIG. 2 is a schematic structural diagram of an embodiment of a data transfer device.
  • the data switching device 2 further includes a playback interface unit 23.
  • the playback interface unit includes HDMI , SDI, VGA, Displayport and other playback interfaces.
  • the playback interface unit includes a one-way playback interface.
  • the image frames in the transmitted multimedia playback data are 2-4K pixel data.
  • the playback interface may use an HDMI interface.
  • the playback interface unit includes at least two playback interfaces.
  • the image frame in the transmitted multimedia playback data is 8K pixel data.
  • the playback interface uses four HDMI interfaces.
  • the playback interface unit 23 uses a four-way playback interface to output multimedia playback data, and the data processing unit 22 Under the control of the line and field synchronization signals in the synchronization control information, the image frames in the obtained multimedia playback data are divided and output to each playback interface in a branch.
  • the data processing unit 22 converts the pixel data according to the image frame corresponding to the line-field synchronization signal and the pixel data row (or pixel data column) in the image frame
  • the rows (or pixel data columns) are divided to obtain image subframes that can be output to each playback interface, and each image subframe is output to the corresponding playback interface.
  • the playback terminal connected to each playback interface displays the image subframe correspondingly.
  • the image frame in the multimedia playback data is 8K pixel data
  • the playback data interface unit 23 includes a four-way playback interface, which is connected to an 8K display terminal; correspondingly, the data processing unit 22 is based on The line and field synchronization signal divides the image frame into four image subframes, and under the control of the clock signal, it is output to each playback interface in parallel, and the image frame is displayed by the 8K display terminal.
  • FIG. 3 is a schematic structural diagram of a data transfer device in another embodiment.
  • the data switching device shown in FIG. 3 further includes an external buffer unit 34 connected to the data processing unit.
  • the external cache unit 34 is a volatile memory, and examples thereof are RAM, DRAM, and the like.
  • the external buffer unit 34 is used to temporarily store the received multimedia playback data and the like.
  • the data processing unit 32 stores the multimedia playback data to the external cache unit. Unlike the data transfer device shown in FIG. 2, the data processing unit 32 does not directly output the obtained multimedia playback data to the playback interface unit, but uses the clock signal of the data collection device to temporarily store it to
  • the external buffer unit 34 buffers the playback frequency of the playback interface unit 33. For example, the image frame and status information in the multimedia data are stored in the external buffer unit 34 according to the line and field synchronization signal in the acquired synchronization control information, and the audio input of the corresponding image frame is also stored in the external according to the audio and video synchronization signal Cache unit.
  • the data processing unit 32 then reads and outputs the multimedia playback data from the external buffer unit 34 to the playback interface unit 33 according to the local clock signal or the clock signal provided by the data collection device. Wherein, whether it is a local clock signal or a homologous clock signal, it is used to ensure that the data processing unit 32 provides a basic unit clock period during the synchronous reading and writing of data.
  • the data processing unit 32 generates line and field synchronization signals according to the image frame and the storage address segment of each pixel row (or column) obtained when the external buffer unit is stored, and according to the result obtained when stored in the external buffer unit 34
  • the storage address segment of the audio data segment generates an audio and video synchronization signal, and divides and outputs the image frame according to the number of playback interfaces in the playback interface unit 33.
  • the data processing unit 32 is further configured to extract the cached image frames in the multimedia playback data from the external cache unit based on a pre-configured playback frequency, according to the extracted image frames
  • Each pixel row (or column) restores the line-field synchronization signal, and outputs the extracted image frame to the playback interface unit according to the restored line-field synchronization signal.
  • the data processing unit The playback frequency of 60 frames / s chooses to read the image frames in the multimedia playback data from the buffer every other frame, and generates the line and field synchronization signals of the extracted image frames according to the local clock signal, and divides the corresponding image frames into four And use the generated line and field synchronization signals to output the divided image frames to the playback interface unit 33, respectively.
  • the multimedia playback data includes audio data
  • the data processing unit 32 also extracts audio data synchronized with the image frame from the external buffer unit 34 and outputs it to the playback interface unit 33.
  • the data transfer device further includes a human-computer interaction unit (not shown) for obtaining playback instructions.
  • the human-computer interaction unit includes but is not limited to: a wireless receiving module communicating with a remote controller, an interface module for connecting a mouse, a keyboard, and the like.
  • the data processing unit extracts the corresponding multimedia playback data from the buffered multimedia playback data based on the acquired playback instruction, and outputs the corresponding multimedia playback data according to the synchronized control information of the extracted multimedia playback data, so as to play the corresponding multimedia playback data.
  • the playback instructions include but are not limited to any of the following: playback instructions for displaying the previous (or next) image frame, playback instructions for slow-motion (or fast-forward) multimedia playback data, playback instructions for frame-by-frame display, Play instructions for playing multimedia play data based on the previous (or next) image frame, etc.
  • the data processing unit extracts the corresponding multimedia playback data from the buffer according to the received playback instruction, and restores the line field for display control according to the local clock signal and the data storage address of each pixel row (or column) in the image frame
  • the synchronization signal and the image frame indicated by the playback instruction and the audio data for synchronized playback are output to the playback interface unit according to the restored line sync signal.
  • the received playback instruction includes frame-by-frame playback
  • the data processing unit restores each synchronization signal frame by frame according to the instruction and outputs the corresponding image frame to the playback interface unit. Or play back frame by frame).
  • the received playback command includes slow playback
  • the data conversion device reduces the original 120 frames / second speed to 30 frames / second speed to restore each synchronization signal and extracts the image frames required for playback from the buffer, and outputs to the playback Interface unit.
  • the data conversion device can perform slow playback according to the speed indicated in the playback instruction, such as 25 frames / second or 60 frames / second.
  • the data transfer device is suitable for providing live broadcast multimedia playback transfer.
  • the multimedia playback data collected by the front-end data collection device needs to be stored in non-volatile memory for storage and reproduction.
  • FIG. 4 is a schematic structural diagram of the data transfer device of this application in another embodiment. Unlike the aforementioned data switching device shown in FIGS. 2 and 3, the data switching device 4 includes a data receiving unit 41, a data processing unit 42, an external buffer unit 44 and a non-volatile storage unit 45.
  • the data processing unit 42 is respectively connected to the external cache unit 44 and the non-volatile storage unit 45; the data processing unit 42 is also used to store the multimedia playback data to the external based on the synchronization control information
  • the buffer unit 44 and the buffered multimedia playback data are extracted from the external buffer unit 44 and transferred to the non-volatile storage unit 45.
  • the data processing unit 42 can store the multimedia playback data to the external buffer unit 44 according to the synchronization control information under the control of the clock signal; and establish the storage address for determining the pixel row (or column) in the image frame, Indexing mechanism for the storage address of the image frame at the beginning and end, and the storage address of the synchronized audio data; With the restored line sync signal, the data processing unit 42 transfers the audio and video data for synchronous playback to the non-volatile storage unit 45. In this way, the data switching device can effectively solve the problem of data loss caused by the mismatch of the data transmission rate between the data receiving unit 41 and the data processing unit 42 and between the data processing unit 42 and the non-volatile storage unit 45.
  • the image frame obtained by using an industrial camera device contains 8K pixel data.
  • the non-volatile storage unit 45 includes a storage array, the storage array and the data processing unit 42 Parallel connection; the data processing unit 42 divides the multimedia playback data according to the storage array, and stores the divided multimedia playback data into the storage array.
  • the data processing unit 42 transfers the multimedia playback data to the storage array by storing the multimedia playback data in the external buffer unit 44 and reading them one by one from the external buffer.
  • the data processing unit 42 since the storage array and the data processing unit 42 are connected in parallel, the data processing unit 42 divides an image frame according to the number of the storage array and synchronously saves it in the storage array according to the local clock signal to realize the high speed of the data processing unit 42 The purpose of storing lossless, high-definition image frames.
  • an index corresponding to the storage address will be constructed for restoring synchronization control information such as line and field synchronization signals. Details one by one.
  • the data switching device may also be integrated with the encoding unit and the data sending unit provided in the data collection device, thereby synchronizing the local clock signal, the recovered line and field synchronization signals, etc. with the help of the encoding unit
  • the control information and the saved multimedia playback data are re-encoded and encapsulated, and the multimedia playback data is continuously transmitted by means of the data sending unit. This realizes the cascading of data switching devices and solves the problem that the multimedia playback data cannot be transferred to further areas due to the limitation of the length of the data transmission line.
  • the data switching device provided in this application further includes a power-off protection unit (Pre-illustrated), used to provide power supply when the data switching device is abnormally powered off, and transfer multimedia playback data buffered in the external buffer unit to a non-volatile storage unit.
  • a power-off protection unit Pre-illustrated
  • the power failure protection unit includes a power management module and a power storage module.
  • the power management module is used to monitor whether the external power supply of the data transfer device is normal, and switch to the power storage module when an abnormality occurs.
  • the power management module includes a switch and a control circuit of the switch.
  • the power storage module includes at least one capacitor for storing energy, and a charging and discharging circuit of the capacitor.
  • the power consumption duration that the power storage module can provide is greater than or equal to the duration that the data processing unit takes to transfer the multimedia playback data in the external cache unit to the non-volatile storage unit.
  • the power consumption duration provided by the power storage module should be greater than or equal to the data processing unit to transfer all multimedia playback data in the external cache unit to the non-volatile storage unit The time spent in.
  • the data processing unit may also perform a shutdown operation after transferring multimedia playback data to the non-volatile storage unit based on the power failure detection signal provided by the power failure protection unit to prevent data from being abnormally exited due to the program Damage caused by the hardware of the adapter.
  • the present application also provides a data transmission system.
  • the data transmission system may include the data collection device described in any one of the foregoing examples and the data transfer device corresponding to the data collection device, which will not be repeated here.
  • FIG. 5 is a schematic diagram of a network architecture of an embodiment of a data transmission system.
  • the data acquisition device 1 includes an acquisition unit 11, a clock signal generation unit 14, an encoding unit 12, and a data transmission unit 13; and the data transfer device 2 includes a data reception unit 21, a data processing unit 22, and a playback interface unit 23 as an example Among them, the acquisition unit 11 includes an industrial camera and a voice input module, which provides 8K 60 frames / s image frames, status information and audio data.
  • the clock signal generating unit 14 outputs a clock signal.
  • the clock signal is used to provide a basic unit clock cycle for synchronous processing of each pixel row (or column) and audio data in the image frame.
  • the encoding unit 12 Under the control of the clock signal, the encoding unit 12 generates a line and field synchronization signal according to the read image frame and its pixel rows (or columns), and reads pixel data, and reads a frame or Audio data segments within the time period of multiple image frames; the encoding unit 12 converts clock signals, line and field synchronization signals, audio and video synchronization signals and control codes, as well as pixel data, status information and audio data according to a preset encoding format Segments, etc. are uniformly encoded and encapsulated into transmittable data packets. The encoding unit 12 sends the data packets to the data switching device through the data sending unit 13 one by one.
  • the data receiving unit 21 in the data switching device 2 receives and parses the data packet for delivery to the data processing unit 22.
  • the data processing unit 22 obtains each pixel line of the image frame that can be played synchronously according to the recovered clock signal, line field synchronization signal, audio synchronization signal, etc., and using the type of data in the data packet provided by the control code, etc. (or Column) and audio data segment; and according to the number of playback interfaces of the playback interface unit 23, the obtained image frame is divided, and the divided image subframe and audio data segment are sent to each playback interface separately to achieve 8K Audio and video of image frames are played in real time.
  • FIG. 6 is a schematic diagram of a network architecture of an embodiment of a data transmission system.
  • the data collection device 1 includes an acquisition unit 11, a clock signal generation unit 14, an encoding unit 12, and a data transmission unit 13;
  • the interface unit 33 is an example, in which the acquisition unit 11 includes an industrial camera device and a voice input module, which provides image frames, status information and audio data of 8K / 120 frames / s, in which the playback interface unit 33 in the data transfer device
  • the playback frequency of is less than 120 frames / s.
  • the playback frequency of the playback interface unit 33 is 60 frames / s as an example to illustrate the execution process of the data transmission system shown in FIG. 6.
  • the clock signal generating unit 14 in the data collection device outputs a clock signal.
  • the clock signal is used to provide a basic unit clock cycle for synchronous processing of each pixel row (or column) and audio data in the image frame.
  • the encoding unit 12 Under the control of the clock signal, the encoding unit 12 generates a line and field synchronization signal according to the read image frame and its pixel rows (or columns), and reads pixel data, and reads a frame or Audio data segments within the time period of multiple image frames; the encoding unit 12 converts clock signals, line and field synchronization signals, audio and video synchronization signals and control codes, as well as pixel data, status information and audio data according to a preset encoding format Segments, etc.
  • the encoding unit 12 sends the data packets to the data switching device through the data sending unit 13 one by one.
  • the data receiving unit 31 in the data switching device 3 receives and parses the data packet for delivery to the data processing unit 32.
  • the data processing unit 32 obtains each pixel line of the image frame that can be played synchronously according to the recovered clock signal, line and field synchronization signal, audio synchronization signal, etc., and using the type of data in the data packet provided by the control code, etc.
  • the data processing unit 31 reads the image frame from the external buffer unit 34 according to the local clock signal according to the frame display mode, and according to the image obtained during storage Row (or column) data, status information, and synchronized audio data segments of each pixel in the frame, restoration of line and field synchronization signals, audio and video synchronization signals, etc .; and restoration of line and field synchronization signals, audio and video synchronization signals, etc.
  • the obtained image frames are divided, and the divided image subframes and audio data segments are separately sent to each playback interface to realize audio including 8K image frames
  • the video is played in real time.
  • the data acquisition device 1 includes an acquisition unit 11, a clock signal generation unit 14, an encoding unit 12, and a data transmission unit 13; and the data switching device 4 includes a data reception unit 41, a data processing unit 42, an external cache unit 44, and a non-
  • the volatile storage unit 45 is taken as an example, wherein the acquisition unit 11 includes an industrial camera device and a voice input module, which provides 8K 60 frames / s image frames, status information, and audio data thereof.
  • the clock signal generating unit 14 outputs a clock signal.
  • the clock signal is used to provide a basic unit clock cycle for synchronous processing of each pixel row (or column) and audio data in the image frame.
  • the encoding unit 12 Under the control of the clock signal, the encoding unit 12 generates a line and field synchronization signal according to the read image frame and its pixel rows (or columns), and reads pixel data, and reads a frame or Audio data segments within the time period of multiple image frames; the encoding unit 12 converts clock signals, line and field synchronization signals, audio and video synchronization signals and control codes, as well as pixel data, status information and audio data according to a preset encoding format Segments, etc. are uniformly encoded and encapsulated into transmittable data packets.
  • the encoding unit sends the data packets one by one to the data switching device through the data sending unit.
  • the data receiving unit 41 in the data switching device receives and parses the data packet for delivery to the data processing unit 42.
  • the data processing unit 42 obtains each pixel line of the image frame that can be played synchronously (or Column) and audio data segments, and stored in the external buffer unit 44.
  • the data processing unit 42 reads the image frame from the external buffer unit 44 according to the local clock signal, and according to each pixel row (or column) data, status information, and synchronized audio data segment in the image frame obtained during storage Restore the horizontal and vertical synchronization signals, audio and video synchronization signals, etc .; and under the control of the restored horizontal and vertical synchronization signals, audio and video synchronization signals, etc.
  • the image frames are divided, and the divided image subframes and audio data segments are sent to each storage array separately, so that audio and video including 8K image frames are stored in real time.
  • the structure of the above data transmission system is an example, not a limitation of the present application.
  • the data transfer device in the data transmission system can integrate an external cache unit, a playback interface unit, and a non-volatile storage unit to provide both real-time display and longer Playback functions such as playback, fast and slow playback, and frame-by-frame viewing of ingested multimedia playback data within a time period. I will not elaborate on them one by one here.
  • FIG. 8 shows a flowchart of a data collection method provided by the present application.
  • the data collection method may be performed by the data collection device provided by the present application, or by any other data collection device capable of performing the collection method.
  • the data collection device is used to collect multimedia data.
  • the data collection device includes a camera module or a voice input module, or includes a camera module and a voice input module.
  • the camera module includes a digital camera or an industrial camera device. Examples of the industrial camera device include a linear array camera device or an area array camera device.
  • the voice input module includes a built-in or external microphone.
  • the acquired multimedia data includes audio data and video data, wherein the video data includes image frames and status information.
  • step S110 based on a clock signal, the acquired multimedia playback data is encoded into multimedia playback data and synchronization control information.
  • the clock signal generating unit is exemplified by a clock signal generating circuit that generates a clock signal by a crystal oscillator or a clock signal generating circuit that generates a clock signal by a ramp signal.
  • the clock signal is used to provide a unit clock cycle for data processing to the encoding unit and the data sending unit.
  • the acquired multimedia data is encoded into multimedia playback data and synchronization control information.
  • the audio and video data are synchronously encoded according to the clock signal to obtain multimedia playback data, and synchronization control information corresponding to the multimedia playback data is obtained.
  • the multimedia playback data includes at least one or more of the following combinations: image frames, audio data, and status information related to the data collection device.
  • the state information includes auxiliary information related to the software and hardware in the acquisition unit, including but not limited to: color information, camera shooting parameters, and some reserved information dedicated to specific application scenarios.
  • the camera shooting parameters include but are not limited to exposure rate, shutter speed, white balance parameters and the like.
  • the data contained in the multimedia playback data is related to the type of multimedia data that the data collection device can collect.
  • the multimedia playback data may include only image frames, or image frames and status information.
  • the multimedia playback data includes image frames and audio data, and even includes the status information.
  • the data collection device extracts the pixel data in the image frame captured by the camera module row by row, column by row, interlaced or interlaced according to the playback frequency of the image frame and the number of pixels of the image frame , And simultaneously generate synchronization control information for the position of the extracted pixel data in each frame of the image and the start position and end position of the image frame.
  • the synchronization control information correspondingly includes at least one of a line synchronization signal and a field synchronization signal.
  • the encoding unit generates a line sync signal and a field sync signal at the beginning of a unit clock cycle, and extracts pixel data of the first line of the image frame in a subsequent unit clock cycle according to the line sync signal and the field sync signal.
  • the data collection device also extracts audio data segments from the audio data.
  • the encoding unit sets the extracted audio data segment before or after the corresponding image frame according to the synchronization information such as time stamp in the audio and video data, and uses the field synchronization signal to ensure the image frame and the corresponding The audio data segments are processed synchronously at the receiving end.
  • the data acquisition device also acquires state information corresponding to the current image frame and / or camera module, and encodes the state information in the multimedia playback data.
  • the camera module in the data collection device uses an industrial camera device.
  • the data collection device obtains color information corresponding to the current image frame, and shooting parameters of the industrial camera device, etc., and encodes it in multimedia playback data.
  • the data collection device encodes state information in the header of multimedia playback data.
  • the data collection method further includes the step of encoding at least one of pixel data, state information, and audio data segments extracted in a unit time period into multimedia playback data according to a preset encoding format.
  • the data collection device further encapsulates the multimedia playback data and the corresponding synchronization control information in at least one data packet that can be transmitted according to a standard or custom encapsulation protocol.
  • the encapsulated single data packet may contain at least one of multimedia playback data and synchronization control data.
  • the synchronization control information further includes at least one of a control code and an audio and video synchronization signal.
  • the audio and video synchronization signal can be represented by a combination of a line synchronization signal, a field synchronization signal and a control code.
  • the data acquisition device encodes the audio signal synchronized with the image frame corresponding to the field synchronization signal together, and uses the control code to represent the encapsulation in a single data packet
  • the control code can describe different types by at least one field (or byte).
  • a control code is used to describe that the currently encapsulated data includes multimedia data, status information, idle information, and other types.
  • the control code may be encapsulated in the data packet at regular intervals.
  • the control code is encapsulated in a data packet at intervals of a fixed data amount.
  • the control code may set the control code according to the specific position of the encapsulated various types of data in the data packet.
  • the data collection device can encapsulate the synchronization control information and the multimedia playback data together, so that the receiving end can analyze the multimedia playback data to be processed synchronously according to the synchronization control information.
  • the data collection device in order to reduce interference to clock signal transmission due to factors such as signal attenuation, noise interference, etc. during data transmission, the data collection device also adds the clock signal and within the time period corresponding to the clock signal At least one of the processed multimedia playback data and the synchronization control information performs encoding processing, uses different channels for transmission, or delivers the encoded data to the data sending unit according to a preset timing.
  • the data collection device provides at least two encoding rules for the clock signal, synchronization control information, and multimedia playback data, so that the corresponding clock information, control information, and multimedia playback information can be obtained according to the timing or It is transmitted separately using different channels.
  • the data collection device uniformly encodes and encapsulates the clock signal, synchronization control information, and multimedia playback data according to preset rules.
  • the data collection device converts the clock signal, the line synchronization signal, the field synchronization signal, and the control code according to a preset encoding protocol
  • the isochronous control information is encoded as digital information at the position of the preset field and encapsulated with multimedia playback data.
  • the data packet may include at least one of a clock signal, synchronization control information, and multimedia playback data.
  • a certain data packet may contain only the encoded clock signal to help the data switching device construct a local clock signal.
  • a certain data packet may contain an encoded clock signal, field synchronization signal, control code, and null data.
  • a certain data packet may include an encoded clock signal, synchronization control information, and multimedia playback data.
  • a certain data packet may contain an encoded clock signal and multimedia playback data.
  • the present application is not limited to processing such as encryption and compression on multimedia playback data based on the encoding and packaging methods provided by the aforementioned data collection device.
  • processing such as encryption and compression on multimedia playback data based on the encoding and packaging methods provided by the aforementioned data collection device.
  • other preliminary preparations for the multimedia playback data should be regarded as obtained based on the technical inspiration of the present application Technical solutions.
  • the data collection device executes step S120 to send the clock signal, multimedia playback data, and synchronization control information to the receiving end.
  • the data collection device may use at least one data line to send a clock signal and send multimedia playback data and synchronization control information.
  • the technician selects the data transmission capability of the transmission line to meet the data volume of the multimedia playback data to be processed synchronously in a unit clock cycle.
  • the data acquisition device includes an optical fiber interface, and the data acquisition device uses an optical fiber medium to transmit the data packet to the receiving end.
  • the data acquisition device uses optical fiber media to transmit multimedia playback data containing 8K image frames to the data transfer device, and provides the data transfer device with multimedia playback that can be displayed at a frequency of 120 frames / second or 60 frames / second. data.
  • 8K image frames can be captured by an 8K camera, or captured and compressed by a camera of 8K or more.
  • the 8K image frame is captured by an 8K camera, and the 8K image frame is 33 million pixels (7680 * 4320 pixels).
  • the pixel resolutions of the image frames mentioned later can be derived based on the pixel resolutions of the corresponding camera devices used, which will not be repeated later.
  • the data sending unit may include a single-mode fiber interface or other network transmission interface.
  • the data collection device sends the data packets one by one in the order of individually packaged clock signals, multimedia playback data, and synchronization control information provided by the data collection device.
  • the data sending unit sends the data packets one by one according to the sequence of the data packets provided by the data collection device and encapsulating the clock signal, multimedia playback data, and synchronization control information.
  • this application also provides a data transfer method.
  • the data transfer method is mainly performed by the data transfer device provided in this application, or any other data transfer device capable of performing the data transfer method.
  • step S210 a clock signal, synchronization control information and multimedia playback data from the data collection device are obtained.
  • the data switching device corresponds to the interface used by the data collection device to match the data transmission capability, data transmission line and the like.
  • the receiving interface is an optical fiber interface.
  • the receiving interface is a single-mode optical fiber interface, and receives the clock signal, synchronization control information, and multimedia playback data sent from the data collection device.
  • step S220 under the control of the clock signal, the multimedia playback data is forwarded based on the synchronization control information to store or display the multimedia playback data.
  • the data switching device processes the digital signal received by the data receiving unit according to the coding format, transmission timing, or data line set by the data collection device for sending clock signals, synchronization control information, and multimedia playback data,
  • the clock signal on the data collection device side is extracted therefrom, and the corresponding local clock signal is generated, and synchronization control information and multimedia playback data are forwarded according to the local clock signal.
  • the clock signal, synchronization control information, and multimedia playback data received by the data switching device are encoded data that have undergone multiple encoding processes and multiple line transmissions.
  • the step S220 includes decoding the clock signal, synchronization control information and multimedia playback data according to a preset decoding format.
  • the data switching device decodes the received clock information, control information and multimedia playback information according to a preset decoding format, thereby recovering the clock signal, synchronization control information and multimedia playback data step.
  • the data switching device decodes the clock information, control information, and multimedia playback information from different data lines according to multiple preset decoding formats.
  • the data switching device decodes the clock signal, synchronization control information, and multimedia playback data according to a preset decoding format; and under the control of the decoded clock signal, based on the decoded
  • the synchronization control information forwards at least the decoded multimedia playback data.
  • the data packet adopts a unified coding and packaging format.
  • the data packet may include at least one of a clock signal, synchronization control information, and multimedia playback data.
  • a certain data packet may contain only the encoded clock signal to help the data switching device construct a local clock signal.
  • a certain data packet may contain an encoded clock signal, field synchronization signal, control code, and null data.
  • a certain data packet may include an encoded clock signal, synchronization control information, and multimedia playback data.
  • a certain data packet may contain an encoded clock signal and multimedia playback data.
  • the data switching device decodes the data packet according to a preset decoding format to obtain the clock signal, synchronization control information, and multimedia playback data.
  • the data switching device buffers or forwards multimedia playback data according to the clock signal and synchronization control information.
  • the data switching device uses the decoded clock signal to generate a local clock signal, and on the other hand, it obtains a line synchronization signal and synchronously forwards multimedia playback data within one unit clock cycle through decoding; After the clock cycle, the data switching device generates the line synchronization signal, and forwards the corresponding multimedia playback data in parallel based on the line synchronization signal.
  • the received synchronization control information also includes a control code; correspondingly, the data switching device corresponds to the multimedia playback data based on the type represented by the control code Types of data are forwarded.
  • the data switching device determines the type of data contained in the decoded data packet according to the type indicated by the preset control code, and combines with other synchronization signals in the synchronization control information to perform multimedia playback data Forwarding processing. For example, the data switching device determines that the decoded data packet contains state information based on the control code, and then determines the color, brightness, etc. of the corresponding pixel in the corresponding image frame according to the state information.
  • the data switching device determines that the decoded data packet contains an audio data segment based on the control code, and can combine the current line and field synchronization signal to determine that the audio data segment and the image frame need to be played synchronously; or give it when transferring Corresponding index records, etc.
  • the step S220 includes outputting the multimedia playback data to the playback terminal according to the synchronization control information.
  • the data collection device includes HDMI , SDI, VGA, Displayport and other playback interfaces.
  • the data collection device includes a one-way playback interface.
  • the image frames in the transmitted multimedia playback data are 2-4K pixel data.
  • the playback interface may use an HDMI interface.
  • the playback interface unit includes at least two playback interfaces.
  • the image frame in the transmitted multimedia playback data is 8K pixel data.
  • the playback interface uses four HDMI interfaces.
  • the data acquisition device uses a four-way playback interface to output multimedia playback data, and the data acquisition device synchronizes Under the control of the line and field synchronization signals in the control information, the image frames in the obtained multimedia playback data are divided and output to each playback interface in a branch.
  • the data acquisition device converts the pixel data row according to the image frame corresponding to the line-field synchronization signal and the pixel data row (or pixel data column) in the image frame (Or pixel data column) segmentation to obtain image subframes that can be output to each playback interface, and output each image subframe to the corresponding playback interface.
  • the playback terminal connected to each playback interface displays the image subframe correspondingly.
  • the image frame in the multimedia playback data is 8K pixel data
  • the playback data interface unit includes a four-way playback interface, which is connected to an 8K display terminal; correspondingly, the data collection device
  • the synchronization signal divides the image frame into four image subframes, and under the control of the clock signal, it is output to each playback interface in parallel, and the image frame is displayed by the 8K display terminal.
  • the data transfer device includes an external cache unit, which may be a volatile memory, such as RAM, DRAM, and so on.
  • the external buffer unit is used to temporarily store the received multimedia playback data and the like.
  • the data transfer method further includes: restoring the synchronization control information of the extracted multimedia playback data through an external buffer unit, and outputting the obtained multimedia playback data to the recovered synchronization control information Steps to play the terminal.
  • the data transfer device does not directly output the obtained multimedia playback data to the playback terminal through the playback interface unit, but uses the clock signal of the data collection device to temporarily store it in an external buffer unit to buffer the playback interface
  • the playback frequency of the unit For example, the image frames and status information in the multimedia data are stored in the external buffer unit according to the line and field synchronization signals in the synchronization control information, and the audio input of the corresponding image frames is also stored in the external buffer unit according to the audio and video synchronization signals.
  • the data switching device then reads and outputs the multimedia playback data from the external buffer unit according to the local clock signal or the clock signal provided by the data collection device to the playback interface unit.
  • the data switching device determines whether it is a local clock signal or a homologous clock signal.
  • the data switching device generates a line and field synchronization signal according to the image frame and the storage address segment of each pixel row (or column) obtained when the external buffer unit is stored, and according to the result obtained when stored in the external buffer unit
  • the storage address segment of the audio data segment generates audio and video synchronization signals, and divides and outputs the image frames according to the number of playback interfaces in the playback interface unit.
  • the data switching device further extracts the cached image frames in the multimedia playback data from the external cache unit based on a pre-configured playback frequency, according to each pixel in the extracted image frames
  • the row (or column) restores the line-field synchronization signal, and outputs the extracted image frame to the playback interface unit according to the restored line-field synchronization signal.
  • the playback frequency that the playback interface unit in the data switching device can output is 60 frames / s as an example.
  • the playback frequency of 60 frames / s choose to read the image frames in the multimedia playback data from the cache every other frame, and generate the line and field synchronization signals of the extracted image frames according to the local clock signal, and divide the corresponding image frames into Four channels, and use the generated line and field synchronization signals to output the divided image frames to the playback interface unit respectively.
  • the multimedia playback data includes audio data.
  • the data switching device also extracts audio data synchronized with the image frame from its external buffer unit and outputs it to the playback interface unit.
  • the data transfer device further includes a human-computer interaction unit (not shown) for obtaining playback instructions.
  • the human-computer interaction unit includes but is not limited to: a wireless receiving module communicating with a remote controller, an interface module for connecting a mouse, a keyboard, and the like.
  • the data switching device extracts corresponding multimedia playback data from the cached multimedia playback data based on the acquired playback instruction, and outputs the corresponding multimedia playback data according to the synchronized control information of the extracted multimedia playback data, so as to play the corresponding multimedia playback data .
  • the playback instructions include but are not limited to any of the following: playback instructions for displaying the previous (or next) image frame, playback instructions for slow-motion (or fast-forward) multimedia playback data, playback instructions for frame-by-frame display, Play instructions for playing multimedia play data based on the previous (or next) image frame, etc.
  • the data switching method further includes the steps of: extracting the corresponding multimedia playback data from the buffer according to the received playback instruction, and storing the address according to the local clock signal and the data of each pixel row (or column) in the image frame
  • the line and field synchronization signals used for display control are restored, and the image frames and audio data of the synchronized playback indicated by the playback instruction are output to the playback interface unit according to the restored line and field synchronization signals.
  • the received playback instruction includes frame-by-frame playback, and the data processing unit restores each synchronization signal frame by frame according to the instruction and outputs the corresponding image frame to the playback interface unit. Or play back frame by frame).
  • the received playback command includes slow playback
  • the data conversion device reduces the original 120 frames / second speed to 30 frames / second speed to restore each synchronization signal and extracts the image frames required for playback from the buffer, and outputs to the playback Interface unit.
  • the data conversion device can perform slow playback according to the speed indicated in the playback instruction, such as 25 frames / second or 60 frames / second.
  • the data transfer device is suitable for providing live broadcast multimedia playback transfer.
  • the multimedia playback data collected by the front-end data collection device needs to be stored in non-volatile memory for storage and reproduction.
  • the data transfer method further includes the steps of: restoring the synchronization control information of the extracted multimedia playback data through an external buffer unit, and storing the multimedia playback data to a unit according to the recovered synchronization control information Non-volatile storage unit.
  • the data switching device can store multimedia playback data to an external buffer unit according to the synchronization control information under the control of the clock signal; and establish a storage address and image for determining the row (or column) of pixels in the image frame Indexing mechanism for the storage address at the beginning and end of the frame, and the storage address for synchronized audio data; Data segment; With the restored line sync signal, the data transfer device transfers the audio and video data for synchronous playback to a non-volatile storage unit. In this way, the data switching device can effectively solve the problem of data loss caused by the mismatch in the data transmission rate between the data receiving unit and the data switching device, and between the data switching device and the non-volatile storage unit.
  • the image frame obtained by using an industrial camera device contains 8K pixel data.
  • the non-volatile storage unit includes a storage array, and the storage array is parallel to the data transfer device Connection; the data switching device divides the multimedia playback data according to the storage array, and stores the divided multimedia playback data into the storage array.
  • the data switching device transfers the multimedia playback data to the storage array in a manner of reading the multimedia buffer data one by one from the external buffer after storing the multimedia playback data in the external buffer unit.
  • the data switching device since the storage array and the data switching device are connected in parallel, the data switching device divides an image frame according to the number of the storage array and synchronously saves it in the storage array according to the local clock signal, so as to realize the high speed of the data switching device The purpose of storing lossless, high-definition image frames.
  • an index corresponding to the storage address will be constructed for restoring synchronization control information such as line and field synchronization signals. Details one by one.
  • the data switching device may also be integrated with the encoding unit and the data sending unit provided in the data collection device, thereby synchronizing the local clock signal, the recovered line and field synchronization signals, etc. with the help of the encoding unit
  • the control information and the saved multimedia playback data are re-encoded and encapsulated, and the multimedia playback data is continuously transmitted by means of the data sending unit. This realizes the cascading of data switching devices and solves the problem that the multimedia playback data cannot be transferred to further areas due to the limitation of the length of the data transmission line.
  • multimedia playback data can be played in real time and stored in different places .
  • a multimedia playback data transmission solution is provided.
  • the technical solution of the present application can be embodied in the form of a software product in essence or part that contributes to the existing technology, and the computer software product can include one or more machine executable instructions stored thereon
  • a machine-readable medium when these instructions are executed by one or more machines, such as a computer, a computer network, or other electronic devices, may cause the one or more machines to perform operations according to the embodiments of the present application. For example, the steps in the data collection method or data transfer method.
  • Machine-readable media may include, but is not limited to, floppy disks, optical disks, CD-ROM (compact disk-read only memory), magneto-optical disks, ROM (read only memory), RAM (random access memory), EPROM (erasable) In addition to programmable read only memory), EEPROM (electrically erasable programmable read only memory), magnetic or optical cards, flash memory, or other types of media / machine readable media suitable for storing machine executable instructions.
  • any connection is properly termed a computer-readable medium.
  • the instruction was sent from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technology such as infrared, radio, and microwave
  • coaxial cables, fiber optic cables, twisted pairs, DSL or wireless technologies such as infrared, radio and microwave are included in the definition of the medium.
  • computer-readable and writable storage media and data storage media do not include connections, carrier waves, signals, or other temporary media, but are intended to target non-transitory, tangible storage media.
  • Disks and optical discs used in the application include compact discs (CDs), laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and Blu-ray discs, where disks usually copy data magnetically, while optical discs use lasers to optically Copy data.
  • CDs compact discs
  • DVDs digital versatile discs
  • floppy disks floppy disks
  • Blu-ray discs where disks usually copy data magnetically, while optical discs use lasers to optically Copy data.
  • the disclosed system, device, and method may be implemented in other ways.
  • the device embodiments described above are only schematic.
  • the division of the units is only a division of logical functions.
  • there may be other divisions for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

一种数据转接装置(2)、数据采集装置(1)及系统、方法，实现无损图像的实时播放和异地存储。其中，数据转接装置(2)用于传输数据采集装置(1)所提供的多媒体播放数据。数据采集装置(1)包括：获取单元(11)，用于获取多媒体数据；时钟信号生成单元(14)，用于生成并输出一时钟信号；编码单元(12)，用于在时钟信号的控制下，将所获取的多媒体数据编码成多媒体播放数据和同步控制信息；数据发送单元(13)，用于发送时钟信号，以及发送基于时钟信号而确定传输的多媒体播放数据和同步控制信息。数据转接装置(2)包括：数据接收单元(21)，获取来自数据采集装置(1)的时钟信号、同步控制信息和多媒体播放数据；数据处理单元(22)，用于在时钟信号的控制下，基于同步控制信息将多媒体播放数据进行转发处理。

Description

数据转接装置、数据采集装置及系统、方法 技术领域
本申请涉及多媒体播放数据的通信技术领域，特别是涉及一种数据转接装置、数据采集装置及系统、方法。
背景技术
受益于数据传输介质和网络传输技术的不断发展，用户收看网络直播时图像及声音的清晰度在不断提高。比如，在收看足球比赛、或者安防监控等场景下，用户均能够收看和收听到较为实时的音视频。
然而，受限于前端数据采集装置与后端数据接收装置之间的网络传输能力，数据采集装置通常将所获取的多媒体播放数据进行压缩处理，并藉由传输网络将压缩后的多媒体播放数据进行传输。一方面，由于压缩而产生的数据损失无法在播放时挽回，这使得用户在收看和收听音视频时不可能得到前端所采集的音视频数据的信息量；另一方面，为减少网络传输期间多媒体播放数据的丢失、延时等影响，在传输时，需增加校验过程(如应答机制)，这增加了多媒体播放的延时。在一些需要高清视频和无损音频的场景下，现有技术方案是无法满足需求的。
发明内容
鉴于以上所述现有技术的缺点，本申请的目的在于提供一种数据转接装置、数据采集装置及系统、方法，用于解决现有技术中多媒体播放数据在传输期间具有较大损失和延时的问题。
为实现上述目的及其他相关目的，本申请的第一方面提供一种数据转接装置，用于传输数据采集装置所提供的多媒体播放数据，包括：数据接收单元，获取来自所述数据采集装置的时钟信号、同步控制信息和多媒体播放数据；数据处理单元，连接于所述数据接收单元，用于在所述时钟信号的控制下，基于所述同步控制信息将所述多媒体播放数据进行转发处理，以便存储或显示所述多媒体播放数据。
在所述第一方面的某些实施方式中，所述同步控制信息包含行场同步信号；对应地，所述数据处理单元在所述时钟信号的控制下，基于所述行场同步信号将所述多媒体播放数据中的图像帧进行转发处理。
在所述第一方面的某些实施方式中，所述同步控制信息包含控制码，所述数据处理单元 基于所述控制码所表示的类型，将所述多媒体播放数据中对应类型的数据进行转发处理。
在所述第一方面的某些实施方式中，所述数据处理单元还用于按照预设的解码格式将所述时钟信号、同步控制信息及多媒体播放数据予以解码处理；以及在所解码的时钟信号的控制下，基于解码后的同步控制信息将至少解码后的多媒体播放数据进行转发处理。
在所述第一方面的某些实施方式中，所述数据处理单元用于按照预设的解码格式将包含所述时钟信号、同步控制信息及多媒体播放数据中至少一种的数据包予以解码处理。
在所述第一方面的某些实施方式中，所述数据转接装置还包括：播放接口单元，连接于所述数据处理单元，用于按照所述数据处理单元的转发处理，输出所述多媒体播放数据，以供播放终端播放。
在所述第一方面的某些实施方式中，所述播放接口单元包括：至少一路播放接口；所述数据处理单元在所述同步控制信息中行场同步信号的控制下，分割所获取的多媒体播放数据中的图像帧，并分路输出至每路播放接口。
在所述第一方面的某些实施方式中，所述数据转接装置还包括外部缓存单元，连接于所述数据处理单元；所述数据处理单元基于所述同步控制信息将所述多媒体播放数据存储至所述外部缓存单元；以及用于基于预配置的播放频率自所述外部缓存单元提取所缓存的所述多媒体播放数据中的图像帧，并按照所提取的图像帧的行场同步信号，将所提取的图像帧输出至所述播放接口单元。
在所述第一方面的某些实施方式中，所述数据处理单元基于所获取的播放指令从所缓存的多媒体播放数据中提取相应多媒体播放数据，并按照所提取的多媒体播放数据的同步控制信息将相应多媒体播放数据予以输出，以便播放相应多媒体播放数据。
在所述第一方面的某些实施方式中，所述数据转接装置还包括：外部缓存单元和非易失性存储单元；所述数据处理单元，分别连接于所述外部缓存单元和非易失性存储单元；所述数据处理单元还用于基于所述同步控制信息将所述多媒体播放数据存储至所述外部缓存单元，以及自所述外部缓存单元提取所缓存的多媒体播放数据并转存至所述非易失性存储单元中。
在所述第一方面的某些实施方式中，所述非易失性存储单元包含存储阵列，所述存储阵列与所述数据处理单元并行连接；所述数据处理单元按照所述存储阵列分割多媒体播放数据，并将分割后的多媒体播放数据存储至所述存储阵列中。
在所述第一方面的某些实施方式中，所述数据转接装置还包括断电保护单元，用于在所述数据转接装置异常断电时提供供电，并将所述外部缓存单元中所缓存的多媒体播放数据转存至非易失性存储单元中。
在所述第一方面的某些实施方式中，所述数据处理单元基于所获取的播放指令从所存储的多媒体播放数据中提取相应多媒体播放数据，并按照所提取的多媒体播放数据的同步控制信息将相应多媒体播放数据予以输出，以便显示相应多媒体播放数据。
在所述第一方面的某些实施方式中，所述数据接收单元包含光纤接口。
在所述第一方面的某些实施方式中，所述多媒体播放数据包括以下至少一种或多种组合：图像帧、音频数据、以及与所述数据采集装置相关的状态信息。
在所述第一方面的某些实施方式中，所述同步控制信息包括以下至少一种或多种组合：行场同步信号、控制码、音视频同步信号。
本申请第二方面提供一种数据采集装置，包括：获取单元，用于获取多媒体数据；时钟信号生成单元，用于生成并输出一时钟信号；编码单元，与所述获取单元相连，用于在所述时钟信号的控制下，将所获取的多媒体数据编码成多媒体播放数据和同步控制信息；数据发送单元，与所述时钟信号生成单元和获取单元相连，用于发送所述时钟信号，以及发送基于所述时钟信号而确定传输的多媒体播放数据和同步控制信息。
在所述第二方面的某些实施方式中，所述数据发送单元包括光纤接口。
在所述第二方面的某些实施方式中，所发送的多媒体播放数据中包含8K图像帧。
在所述第二方面的某些实施方式中，所述编码单元还用于将所述时钟信号，以及在所述时钟信号所对应时间周期内处理的多媒体播放数据和同步控制信息进行至少一种编码处理；对应地，所述数据发送单元用于将编码后的所述时钟信号、多媒体播放数据和同步控制信息予以发送。
本申请第三方面提供一种数据传输系统，包含：如前述第一方面任一所述的数据采集装置，以及如前述第二方面中任一所述的数据转接装置。
本申请第四方面提供一种数据转接方法，用于传输来自数据采集装置所提供的多媒体播放数据，包含：获取来自所述数据采集装置的时钟信号、同步控制信息和多媒体播放数据；在所述时钟信号的控制下，基于所述同步控制信息将所述多媒体播放数据进行转发处理，以便存储或显示所述多媒体播放数据。
在所述第四方面的某些实施方式中，所述同步控制信息包含行场同步信号；对应地，所述在时钟信号的控制下，基于所述同步控制信息将至少所述多媒体播放数据进行转发处理的步骤包括：在所述时钟信号的控制下，基于所述行场同步信号将所述多媒体播放数据中的图像帧进行转发处理。
在所述第四方面的某些实施方式中，所述同步控制信息包含控制码，对应地，所述基于同步控制信息将至少所述多媒体播放数据进行转发处理的步骤包括：基于所述控制码所表示 的类型，将所述多媒体播放数据中对应类型的数据进行转发处理。
在所述第四方面的某些实施方式中，所述方法还包括：按照预设的解码格式将所述时钟信号、同步控制信息及多媒体播放数据予以解码处理的步骤；以便在所解码的时钟信号的控制下，基于解码后的同步控制信息将至少解码后的多媒体播放数据进行转发处理。
在所述第四方面的某些实施方式中，所述按照预设的解码格式将所述时钟信号、同步控制信息及多媒体播放数据予以解码处理的步骤包括：按照预设的解码格式将包含所述时钟信号、同步控制信息及多媒体播放数据中至少一种的数据包予以解码处理。
在所述第四方面的某些实施方式中，所述在时钟信号的控制下，基于所述同步控制信息将至少所述多媒体播放数据进行转发处理的步骤包括：按照所述同步控制信息，将所述多媒体播放数据输出至播放终端。
在所述第四方面的某些实施方式中，所述方法还包括以下至少一种：藉由一外部缓存单元中转，恢复所提取的多媒体播放数据的同步控制信息，以及按照所恢复的同步控制信息，将所获取的多媒体播放数据输出至播放终端；以及藉由一外部缓存单元中转，恢复所提取的多媒体播放数据的同步控制信息，以及按照所恢复的同步控制信息，将多媒体播放数据存储至一非易失性存储单元中。
在所述第四方面的某些实施方式中，所述方法还包括：基于所获取的播放指令从所存储的多媒体播放数据中提取相应多媒体播放数据并予以输出，以便播放相应多媒体播放数据。
在所述第四方面的某些实施方式中，所述多媒体播放数据包括以下至少一种或多种组合：图像帧、音频数据、以及与所述数据采集装置相关的状态信息。
在所述第四方面的某些实施方式中，所述同步控制信息包括以下至少一种或多种组合：行场同步信号、控制码、音视频同步信号。
本申请第五方面提供一种数据采集方法，包括：基于一时钟信号，将所获取的多媒体播放数据编码成多媒体播放数据和同步控制信息；发送所述时钟信号、所述多媒体播放数据和同步控制信息。
在所述第五方面的某些实施方式中，所述方法还包括：将所述时钟信号，以及在所述时钟信号所对应时间周期内处理的多媒体播放数据和同步控制信息进行至少一种编码处理；对应地，将编码后的所述时钟信号、多媒体播放数据和同步控制信息予以发送。
在所述第四方面的某些实施方式中，所发送的多媒体播放数据中包含8K图像帧。
本申请第六方面提供一种计算机可读存储介质，其特征在于，存储有至少一程序；所述至少一程序在被调用时执行如第四方面中任一所述的数据转接方法；或者，所述至少一程序在被调用时执行如第五方面中任一所述的数据采集方法。
如上所述，本申请的数据转接装置、数据采集装置及系统、方法，具有以下有益效果：本申请所提供的数据采集装置和数据转接装置之间由于采用了同源的时钟信号进行数据同步处理，故而实现多媒体播放数据，特别是无损图像，能够实时播放和异地存储。在城市安防、交通监控等需要高清图像监控的领域提供了多媒体播放数据的传输方案。特别地，利用本申请所述方案中的光纤接口来获取图像采集装置侧的多媒体播放数据和同步控制信息等，能够以120帧/秒的速度将8K图像进行网络传输，由此实现将城市安防、交通监控、医疗处置等多领域中所采集的视频超高清画面的实时传输的目的。
附图说明
图1显示为本申请数据采集装置在一实施方式中的结构示意图。
图2显示为本申请数据转接装置在一实施方式中的结构示意图。
图3显示为本申请数据转接装置在又一实施方式中的结构示意图。
图4显示为本申请数据转接装置在又一实施方式中的结构示意图图。
图5显示为本申请数据传输系统在一实施方式中的网络架构示意图。
图6显示为本申请数据传输系统在又一实施方式中的网络架构示意图。
图7显示为本申请数据传输系统在另一实施方式中的网络架构示意图。
图8显示为本申请数据采集方法的流程图。
图9显示为本申请数据转接方法的流程图。
具体实施方式
以下由特定的具体实施例说明本申请的实施方式，熟悉此技术的人士可由本说明书所揭露的内容轻易地了解本申请的其他优点及功效。
如同在本文中所使用的，单数形式“一”、“一个”和“该”旨在也包括复数形式，除非上下文中有相反的指示。应当进一步理解，术语“包含”、“包括”表明存在所述的特征、步骤、操作、元件、组件、项目、种类、和/或组，但不排除一个或多个其他特征、步骤、操作、元件、组件、项目、种类、和/或组的存在、出现或添加。此处使用的术语“或”和“和/或”被解释为包括性的，或意味着任一个或任何组合。因此，“A、B或C”或者“A、B和/或C”意味着“以下任一个：A；B；C；A和B；A和C；B和C；A、B和C”。仅当元件、功能、步骤或操作的组合在某些方式下内在地互相排斥时，才会出现该定义的例外。
在现有的多媒体播放数据的网络传输中，一些实施方式可利用流媒体传输协议、或断点续传等传输技术实现多媒体播放数据的点对点传输、或多点传输。这类方式大多适用于实时 性要求低的场景，如点播视频、收看延时直播等。然而对于一些兼顾实时性和音视频播放质量的场景，如城市的高清监控系统、球场的回放系统、甚至医用手术的多媒体教学系统等应用领域，需要搭建专门的多媒体传输网络，使得播放终端能够实时播放高清图像和/或高品质音频。为此，在另一些实施方式中，现有方式中采用利用同步的时钟信号解决收发端多媒体播放数据传输和显示节奏的匹配问题，这需要不断校准收发端的时钟信号，以使其同步；其中时钟信号的同步处理过程降低了收发端的实时性。
随着用户对所收看收听的音视频清晰度要求和实时性要求不断提升，例如，在医疗、工业检测、电视信号传输微纳米检测等领域，技术人员需要传输压缩率更低、实时性更高的多媒体播放数据。为此，本申请提供一种数据采集装置。其中，所述数据采集装置可设置于如街道等用于获取前端多媒体播放数据的位置处。所述数据采集装置通过专用传输多媒体播放数据而搭建的传输线路、或者可传输多媒体播放数据的公共传输线路，与数据转接装置相连。其中，为确保数据采集装置和数据转接装置能够高效传输压缩率低、甚至无损压缩的多媒体播放数据，所选用的传输线路在单位时钟周期内所传输的数据量需远大于收发端在相同时钟周期内同步处理的数据量。例如，依据单位时钟周期同步处理数据的速率，对应选用的传输线路的传输速率是其十倍、数十倍或上百倍等。由此藉由所选用的传输线路的数据传输能力，使得所述数据采集装置和数据转接装置之间可采用单源时钟信号作为同步处理的基准时钟信号的方式实现对多媒体播放数据的同步处理。例如，利用光纤介质的传输线路，所述数据转接装置可利用所述数据采集装置侧所产生的时钟信号进行数据处理，以实现多媒体播放数据的高效传输。
请参阅图1，其显示为本申请提供的一种数据采集装置。所述数据采集装置1包括获取单元11、时钟信号生成单元14、编码单元12和数据发送单元13。
所述获取单元11用于获取多媒体数据。在此，所述获取单元11包括摄像模块或语音输入模块，或者包含摄像模块和语音输入模块。其中，所述摄像模块包括数码摄像头、或工业摄像装置。其中所述工业摄像装置举例包括线阵摄像装置或面阵摄像装置。所述语音输入模块包括内置或外接麦克等。对应地，所获取的多媒体数据包含音频数据和视频数据，其中，所述视频数据中包含图像帧和状态信息等。
所述时钟信号生成单元14用于生成并输出一时钟信号。其中，所述时钟信号生成单元14举例为藉由晶振而产生时钟信号的时钟信号生成电路，或者藉由斜坡信号而生成时钟信号的时钟信号生成电路。所述时钟信号用于为编码单元12和数据发送单元13提供用于进行数据处理的单位时钟周期。
所述编码单元12与所述获取单元11相连，用于在所述时钟信号的控制下，将所获取的 多媒体数据编码成多媒体播放数据和同步控制信息。
在此，所述编码单元12包含可进行逻辑控制和数字运算的处理模块，和用于存储所述处理模块运行期间所产生的中间数据的存储模块。其中，所述处理模块举例包括以下任一种或多种的组合：FPGA、MCU及CPU等。所述存储模块举例包括以下任一种或多种的组合：寄存器、堆栈及缓存等易失性存储器。
所述编码单元12依据时钟信号将音视频数据同步进行编码处理以得到多媒体播放数据，以及得到对应多媒体播放数据的同步控制信息。其中，根据所述获取单元11所能获取的多媒体数据的类型，所述多媒体播放数据包含以下至少一种或多种组合：图像帧、音频数据、以及与所述数据采集装置相关的状态信息。其中，所述状态信息包括与获取单元11中软硬件相关的辅助信息，其包括但不限于：颜色信息、相机拍摄参数，以及一些专用于特定应用场景的预留信息等。其中，所述相机拍摄参数包括但不限于曝光率、快门速度、白平衡参数等。例如，所述数据采集装置中仅包含摄像模块，则所述多媒体播放数据中可仅包含图像帧，或者包含图像帧和状态信息。又如，所述数据采集装置中包含摄像模块和语音输入模块，则所述多媒体播放数据中包含图像帧和音频数据，甚至还包括所述状态信息。
在此，所述编码单元12在时钟信号所提供的单位时钟周期内，按照图像帧的播放频率、图像帧的像素数量，逐行、逐列、隔行或隔列地提取摄像模块所摄取的图像帧中的像素数据，并同时产生针对所提取的像素数据在图像各帧中的位置和表示图像帧起始位置和结束位置的同步控制信息。其中，所述同步控制信息对应包含行同步信号、场同步信号中的至少一种。例如，所述编码单元12在某一单位时钟周期起始时刻生成行同步信号和场同步信号，并依据所述行同步信号和场同步信号在后续单位时钟周期内提取图像帧第一行像素数据。
在时钟信号所提供的单位时钟周期内，所述编码单元12还从音频数据中提取音频数据段。在一些示例中，所述编码单元12按照音视频数据中的时间戳等同步信息，将所提取的音频数据段设置在对应图像帧之前或之后，并利用场同步信号来保证图像帧及所对应的音频数据段在接收端被同步处理。
在时钟信号所提供的单位时钟周期内，所述编码单元12还获取对应当前图像帧和/或摄像模块的状态信息，并将状态信息编码在多媒体播放数据中。例如，所述获取单元11中所使用的摄像模块采用工业摄像装置，所述编码单元12获取对应当前图像帧的颜色信息，以及工业摄像装置的拍摄参数等，并编码在多媒体播放数据中。例如，所述编码单元12将状态信息编码在多媒体播放数据的包头等。
在此，所述编码单元12按照预设的编码格式将在单位时间周期内所提取的像素数据、状态信息和音频数据段中的至少一种编码成多媒体播放数据。在一些实施方式中，所述编码单 元12还按照标准的或自定义的封装协议将所述多媒体播放数据和所对应的同步控制信息封装至少一个可被传输的数据包中。在此，根据实际封装规则，所封装的单个数据包内可包含多媒体播放数据和同步控制数据中的至少一种。
在另一些实施方式中，为了便于传输如工业摄像装置所提供的8K图像帧的数据量，在一些示例中，所述同步控制信息还包括控制码、音视频同步信号中的至少一种。其中，所述音视频同步信号可藉由行同步信号、场同步信号和控制码的组合进行表示。例如，基于场同步信号所表示的场同步周期内，所述编码单元12将与所述场同步信号所对应的图像帧同步的音频信号编码在一起，并利用控制码表示单个数据包中所封装的多媒体数据的类型等。所述控制码可以藉由至少一个字段(或字节)来描述不同类型。例如，利用控制码描述当前封装的数据包含多媒体数据、状态信息、空闲信息等类型。所述控制码可以固定间隔封装在数据包中。例如，所述控制码依据固定数据量的间隔封装在数据包中。或者所述控制码可依据所封装的各类型数据在数据包中的具体位置，设置控制码。如此，所述编码单元12可将同步控制信息和多媒体播放数据封装在一起，以便接收端可依据同步控制信息解析待同步处理的多媒体播放数据。
在又一些实施方式中，为了减少数据传输期间因信号衰减、噪声干扰等因素对时钟信号传输的干扰，所述编码单元12还将所述时钟信号，以及在所述时钟信号所对应时间周期内处理的多媒体播放数据和同步控制信息中的至少一种进行编码处理、采用不同信道传输、或者依预设时序将编码后的数据传递给数据发送单元13。
在一些示例中，所述编码单元12为所述时钟信号、同步控制信息和多媒体播放数据提供至少两种编码规则，以使编码后得到对应的时钟信息、控制信息和多媒体播放信息可依时序或采用不同信道被单独传输。在又一些示例中，所述编码单元12按照预设的规则将时钟信号、同步控制信息和多媒体播放数据进行统一编码和封装。以一个数据中包含单位时钟周期内所需同步处理的多媒体播放数据和同步控制信息为例，所述编码单元12按照预设的编码协议将时钟信号，和行同步信号、场同步信号、控制码等同步控制信息编码为预设字段位置的数字信息，并与多媒体播放数据封装在一起。根据实际数据封装的规则，对于所封装的单个数据包来说，数据包中可包含时钟信号、同步控制信息及多媒体播放数据中的至少一种。例如，某个数据包中可仅包含编码后的时钟信号，用以帮助数据转接装置构建本地时钟信号。又如，某个数据包中可包含编码后的时钟信号、场同步信号、控制码和空数据。再如，某个数据包中可包含编码后的时钟信号、同步控制信息及多媒体播放数据。还比如，某个数据包中可包含编码后的时钟信号和多媒体播放数据。
需要说明的是，本申请并不限制在前述提及的编码单元12所能提供的编码及封装方式的 基础上，对多媒体播放数据进行如加密、压缩等处理。然而，藉由上述编码单元12所提供的编码及封装方式为多媒体播放数据进行网络传输准备的技术思想上，对多媒体播放数据进行其他前期准备，均应视为基于本申请的技术启示而得到的技术方案。
所述编码单元12将编码后的数据包传递给数据发送单元13，由所述数据发送单元13发送至接收端。其中，所述数据发送单元13可采用至少一根数据线发送时钟信号以及发送基于所述时钟信号而确定传输的多媒体播放数据和同步控制信息。
在此，根据所述数据采集装置单位时钟周期内需同步处理的多媒体播放数据的数据量，技术人员选择数据发送单元13的传输能力需满足单位时钟周期内需同步处理的多媒体播放数据的数据量。在一些实施方式中，为匹配工业摄像装置的图像帧的像素数据量以及播放频率，所述数据采集装置中的数据发送单元13包括光纤接口，所述数据发送单元13利用光纤介质将数据包传输至接收端。例如，所述数据发送单元13利用光纤介质将包含8K图像帧的多媒体播放数据传输至数据转接装置，并为数据转接装置提供可以120帧/秒、或60帧/秒的频率显示的多媒体播放数据。其中，8K图像帧可由8K摄像装置摄取而得、或者8K以上摄像装置摄取并压缩而得。例如，所述8K图像帧为利用8K摄像装置摄取的，8K图像帧为3300万像素(7680*4320像素)。在此，后续提及的图像帧的像素分辨率均可基于此推得所使用的相应摄像装置的像素分辨率，后续不再重述。
需要说明的是，根据实际传输的数据量、传输距离以及能够传递数据的数据线的数量，所述数据发送单元13可包含单模光纤接口，或者其他网络传输接口。
例如，所述数据发送单元13按照编码单元12所提供的被单独封装的时钟信号、多媒体播放数据和同步控制信息等数据包的顺序逐个发送。又如，所述数据发送单元13按照编码单元12所提供的封装有时钟信号、多媒体播放数据和同步控制信息的数据包顺序逐个发送。
为依据所述数据采集装置所提供的时钟信号处理所接收的多媒体播放数据，本申请还提供一种数据转接装置。所述数据转接装置包括数据接收单元和数据处理单元。
其中，所述数据接收单元对应于所述数据采集装置中的数据发送单元所使用的接口，以匹配数据传输能力、数据传输线路等。所述数据接收单元获取来自所述数据采集装置的时钟信号、同步控制信息和多媒体播放数据。在此，所述数据接收单元包括：用于与数据发送单元对应的接收接口。在一些示例中，所述接收接口为光纤接口。例如，所述接收接口为单模光纤接口。
所述数据处理单元用于在所述时钟信号的控制下，基于所述同步控制信息将至少所述多媒体播放数据进行转发处理，以便存储或显示所述多媒体播放数据。
在此，所述数据处理单元包含可进行逻辑控制和数字运算的处理模块，和用于存储所述 处理模块运行期间所产生的中间数据的存储模块。其中，所述处理模块举例包括以下任一种或多种的组合：FPGA、MCU及CPU等。所述存储模块举例包括以下任一种或多种的组合：寄存器、堆栈及缓存等易失性存储器。
所述数据处理单元依据于数据采集装置为发送时钟信号、同步控制信息及多媒体播放数据而设置的编码格式、发送时序、或数据线对应将数据接收单元所接收的数字信号进行处理，以从中提取数据采集装置侧的时钟信号，并生成对应的本地时钟信号，以及按照本地时钟信号产生同步控制信息和转发多媒体播放数据。
在一些实施方式中，所述数据转接装置所接收的时钟信号、同步控制信息及多媒体播放数据为经多种编码处理、多线路传输的编码数据。所述数据处理单元按照预设的解码格式将所述时钟信号、同步控制信息及多媒体播放数据予以解码处理。
在此，所述数据处理单元按照预先设定的解码格式，将所接收到的时钟信息、控制信息和多媒体播放信息进行对应解码，由此恢复出时钟信号、同步控制信息和多媒体播放数据。在一示例中，所述数据处理单元按照预先设定的多种解码格式，将来自不同数据线的时钟信息、控制信息和多媒体播放信息进行对应解码。在另一示例中，所述数据处理单元按照预设的解码格式将所述时钟信号、同步控制信息及多媒体播放数据予以解码处理；以及在所解码的时钟信号的控制下，基于解码后的同步控制信息将至少解码后的多媒体播放数据进行转发处理。其中，根据数据采集装置所实际发送的数据包中所包含的信息，所述数据包采用统一编码和封装格式。对于单个数据包来说，数据包中可包含时钟信号、同步控制信息及多媒体播放数据中的至少一种。例如，某个数据包中可仅包含编码后的时钟信号，用以帮助数据转接装置构建本地时钟信号。又如，某个数据包中可包含编码后的时钟信号、场同步信号、控制码和空数据。再如，某个数据包中可包含编码后的时钟信号、同步控制信息及多媒体播放数据。还比如，某个数据包中可包含编码后的时钟信号和多媒体播放数据。所述数据处理单元按照预设的解码格式，解码数据包，以得到所述时钟信号、同步控制信息及多媒体播放数据。
在此，所述数据处理单元依据时钟信号和同步控制信息缓存或转发多媒体播放数据。例如，所述数据处理单元一方面利用经解码得到的时钟信号生成本地时钟信号，另一方面通过解码得到在一个单位时钟周期内产生行同步信号和同步转发多媒体播放数据；在延时一个单位时钟周期后，所述数据处理单元生成所述行同步信号，并基于所述行同步信号并行地将对应的多媒体播放数据予以转发处理。
根据实际多媒体播放数据所包含的数据类型，所接收的同步控制信息中还包括控制码；对应地，所述数据处理单元基于所述控制码所表示的类型，将所述多媒体播放数据中对应类 型的数据进行转发处理。在此，所述数据处理单元按照预先设定的控制码所表示的类型，确定所解码的数据包中所包含的数据类型，并结合同步控制信息中的其他同步信号，对多媒体播放数据进行转发处理。例如，所述数据处理单元基于控制码确定所解码的数据包中包含状态信息，则依据状态信息确定对应图像帧中对应像素的颜色、亮度等。又如，所述数据处理单元基于控制码确定所解码的数据包中包含音频数据段，则可结合当前行场同步信号确定该音频数据段与图像帧需同步播放；或者在转存时给予对应的索引记录等。
结合上述各示例的描述，所述数据处理单元依据时钟信号和同步控制信息对多媒体播放数据进行转发处理的方式可包括将多媒体播放数据予以播放。为此，在一些实际应用中，请参阅图2，其显示为数据转接装置在一实施方式中的结构示意图。其中，所述数据转接装置2还包括播放接口单元23。在此，按照数据采集装置所提供的多媒体播放数据的数据量与播放终端的播放能力的匹配程度，以及数据采集装内置与播放终端之间的播放频率的匹配能力，所述播放接口单元包含HDMI、SDI、VGA、Displayport等播放接口。在一些示例中，所述播放接口单元包含一路播放接口。例如，所传递的多媒体播放数据中图像帧为2-4K像素数据，对应地，所述播放接口可选用一路HDMI接口。在又一些示例中，播放接口单元包含至少两路播放接口。例如，所传递的多媒体播放数据中图像帧为8K像素数据，对应地，所述播放接口选用四路HDMI接口。
为匹配如8K图像帧且30帧/s(或60帧/s)的播放频率，所述播放接口单元23采用四路播放接口进行多媒体播放数据的输出，以及，所述数据处理单元22在所述同步控制信息中行场同步信号的控制下，分割所获取的多媒体播放数据中的图像帧，并分路输出至每路播放接口。
在此，在来自于数据采集装置的时钟信号的控制下，所述数据处理单元22依据行场同步信号所对应的图像帧及图像帧中的像素数据行(或像素数据列)，将像素数据行(或像素数据列)进行分割，得到可输出至每路播放接口的图像子帧，并将各图像子帧分别输出至对应的播放接口。与每个播放接口相连的播放终端对应显示图像子帧。在一些示例中，所述多媒体播放数据中的图像帧为8K像素数据，播放数据接口单元23包含四路播放接口，该四路播放接口连接8K显示终端；对应地，所述数据处理单元22依据行场同步信号将图像帧分隔成四幅图像子帧，并在时钟信号的控制下，并行地输出至每一路播放接口，由8K显示终端对该图像帧予以显示。
在又一些实际应用中，数据转接装置的处理速率、输出速率、或播放终端的播放频率中的至少一种不匹配于数据采集装置按照其播放频率而输出的多媒体播放数据，为此，请参阅图3，其显示为数据转接装置在又一实施方式中的结构示意图。与图2所示的数据转接装置 不同的是，图3所示的数据转接装置还包括连接于数据处理单元的外部缓存单元34。在此，所述外部缓存单元34为一种易失性存储器，其举例为RAM、DRAM等。所述外部缓存单元34用于暂存所接收的多媒体播放数据等。
数据处理单元32将所述多媒体播放数据存储至所述外部缓存单元。与图2所示的数据转接装置不同的是，所述数据处理单元32并未直接将所得到的多媒体播放数据输出至播放接口单元，而是利用数据采集装置的时钟信号将其暂存到外部缓存单元34，以缓冲播放接口单元33的播放频率。例如，按照所获取的同步控制信息中的行场同步信号将多媒体数据中的图像帧和状态信息存入外部缓存单元34中，以及按照音视频同步信号将对应图像帧的音频输入也存入外部缓存单元中。数据处理单元32再依据本地时钟信号或者数据采集装置所提供的时钟信号从外部缓存单元34中将多媒体播放数据读取并输出至播放接口单元33。其中，无论是本地时钟信号或同源的时钟信号，均用于确保数据处理单元32在进行同步读写数据期间提供基本的单位时钟周期。在此，所述数据处理单元32按照存储外部缓存单元时所得到的图像帧及其各像素行(或列)的存储地址段生成行场同步信号，以及依据存入外部缓存单元34时所得到的音频数据段的存储地址段生成音视频同步信号，并按照播放接口单元33中播放接口的数量对图像帧进行分割并输出。
在另一些实施方式中，所述数据处理单元32还用于基于预配置的播放频率自所述外部缓存单元提取所缓存的所述多媒体播放数据中的图像帧，按照所提取的图像帧中的各像素行(或列)恢复行场同步信号，以及按照所恢复的行场同步信号将所提取的图像帧输出至所述播放接口单元。
以数据采集装置采集8K图像帧并按120帧/s的播放频率进行输出，以及数据转接装置中的播放接口单元所能输出的播放频率为60帧/s为例，所述数据处理单元按照60帧/s的播放频率选择隔帧地从缓存中读取多媒体播放数据中的图像帧，并按照本地时钟信号生成所提取的图像帧的行场同步信号，将所对应的图像帧分割成四路，并利用所生成的行场同步信号将分割后的图像帧分别输出至播放接口单元33。
所述多媒体播放数据中包含音频数据，所述数据处理单元32还从外部缓存单元34中提取与图像帧同步的音频数据，并输出至播放接口单元33。
需要说明的是，上述示例仅为举例，本领域技术人员可结合前述数据处理单元的示例描述，提供可按照播放接口单元的播放频率逐帧或隔帧显示图像帧的方案，在此不再逐一详述。
在一些示例中，所述数据转接装置还包含人机交互单元(未予图示)，用以获取播放指令。其中，所述人机交互单元包括但不限于：与遥控器通信的无线接收模块，用于连接鼠标、键盘等的接口模块等。数据处理单元基于所获取的播放指令从所缓存的多媒体播放数据中提取 相应多媒体播放数据，并按照所提取的多媒体播放数据的同步控制信息将相应多媒体播放数据予以输出，以便播放相应多媒体播放数据。其中，所述播放指令包括但不限于以下任一种：显示上一(或下一)图像帧的播放指令，慢放(或快放)多媒体播放数据的播放指令，逐帧显示的播放指令、基于上一(或下一)图像帧播放多媒体播放数据的播放指令等。
在此，数据处理单元根据所接收的播放指令从缓存中提取对应的多媒体播放数据，并按照本地时钟信号和图像帧中各像素行(或列)的数据存放地址恢复用于显示控制的行场同步信号，以及按照所恢复的行场同步信号向播放接口单元输出所述播放指令所指示的图像帧及同步播放的音频数据。例如，所接收的播放指令包含逐帧播放，数据处理单元依据该指令做一帧一帧地恢复各同步信号并将相应图像帧输出至播放接口单元，其包括按照播放指令向前逐帧播放(或向后逐帧播放)。又如，所接收的播放指令包含慢放，数据转换装置将原120帧/秒的速度降至30帧/秒的速度恢复各同步信号并从缓存中提取所需回放的图像帧，输出至播放接口单元。需要说明的是，数据转换装置可依据播放指令中所指示的速度进行慢放，如25帧/秒、或60帧/秒等。
根据所述外部缓存单元所能存储的多媒体数据的数据量，所述数据转接装置适用于提供直播的多媒体播放转接。
在一些如监控、医疗等应用场景中，位于前端的数据采集装置所采集的多媒体播放数据需保存在非易失性存储器中，以便保存和重现。为此，请参阅图4，其显示为本申请数据转接装置在又一实施方式中的结构示意图。与前述图2和图3所示的数据转接装置不同的是，所述数据转接装置4包含数据接收单元41、数据处理单元42、外部缓存单元44和非易失性存储单元45。
其中，所述数据接收单元41与前述数据接收单元(21、31)的结构和执行方式相同或相似，在此不再详述。
所述数据处理单元42分别连接于所述外部缓存单元44和非易失性存储单元45；所述数据处理单元42还用于基于所述同步控制信息将所述多媒体播放数据存储至所述外部缓存单元44，以及自所述外部缓存单元44提取所缓存的多媒体播放数据并转存至所述非易失性存储单元45中。
在此，所述数据处理单元42可在时钟信号的控制下，按照同步控制信息将多媒体播放数据存储到外部缓存单元44；并建立用于确定图像帧中像素行(或列)的存储地址、图像帧首尾存储地址、同步的音频数据存储地址的索引机制；并在从外部缓存单元44读取多媒体播放数据时，基于所述索引机制不仅可以恢复行场同步信号，还确定与对应图像帧同步的音频数据段；藉由所恢复的行场同步信号，所述数据处理单元42将用于同步播放的音视频数据转存 到非易失性存储单元45中。如此，所述数据转接装置可有效解决数据接收单元41与数据处理单元42之间，以及数据处理单元42与非易失性存储单元45之间数据传输速率不匹配而造成的数据丢失问题。
在一些实际应用中，比如利用工业摄像装置所获取的图像帧包含8K像素数据，为防止缓存溢出，所述非易失性存储单元45包含存储阵列，所述存储阵列与所述数据处理单元42并行连接；所述数据处理单元42按照所述存储阵列分割多媒体播放数据，并将分割后的多媒体播放数据存储至所述存储阵列中。
在此，所述数据处理单元42按照将多媒体播放数据存储到外部缓存单元44后，自外部缓存逐一读取的方式将多媒体播放数据转存到存储阵列中。其中，由于存储阵列与数据处理单元42采用并行连接，数据处理单元42按照存储阵列的数量将一图像帧进行分割，并按照本地时钟信号同步地保存在存储阵列中，以实现数据处理单元42高速存储无损、高清的图像帧的目的。
需要说明的是，无论是将多媒体播放数据存储到外部缓存单元亦或非易失性存储单元中，都会构建对应存储地址的索引以供恢复行场同步信号等同步控制信息，在此，不再一一详述。
还需要说明的是，所述数据转接装置还可集成有数据采集装置中所提供的编码单元和数据发送单元，由此，借助编码单元将本地时钟信号、所恢复的行场同步信号等同步控制信息和所保存的多媒体播放数据进行重新编码和封装，以及借助数据发送单元将多媒体播放数据继续传输。由此实现了数据转接装置的级联，并解决因数据传输线路长度限制，而无法将多媒体播放数据传递至更远区域等问题。
在一些实际应用中，为防止数据转接装置因异常供电而丢失尚未保存到非易失性存储单元中的多媒体播放数据，本申请所提供的数据转接装置中还包括断电保护单元(未予图示)，用于在所述数据转接装置异常断电时提供供电，并将所述外部缓存单元中所缓存的多媒体播放数据转存至非易失性存储单元中。
在此，所述断电保护单元包括电源管理模块和蓄电模块。其中电源管理模块用于监测数据转接装置的外部供电是否正常，当出现异常时切换至所述蓄电模块。在此，所述电源管理模块包含切换开关和切换开关的控制电路等。所述蓄电模块包含至少一个用于储能的电容，以及电容的充放电电路等。所述蓄电模块所能提供的用电时长大于等于数据处理单元将外部缓存单元中的多媒体播放数据转存到非易失性存储单元中所花费的时长。例如，当外部缓存单元几乎满存多媒体播放数据时，所述蓄电模块所能提供的用电时长应大于等于数据处理单元将外部缓存单元中所有多媒体播放数据转存到非易失性存储单元中所花费的时长。所述数据处理单元基于所述断电保护单元所提供的断电检测信号，还可在将多媒体播放数据转存到 非易失性存储单元后执行关机操作，以防止因程序异常退出而对数据转接装置的硬件造成的损伤。
基于前述提供的数据采集装置和数据转接装置的结构描述，本申请还提供一种数据传输系统。所述数据传输系统可包含前述任一示例所描述的数据采集装置以及对应于数据采集装置的数据转接装置，在此不再重述。
请参阅图5，其显示为数据传输系统在一实施方式中的网络架构示意图。其中，以数据采集装置1包含获取单元11、时钟信号生成单元14、编码单元12和数据发送单元13；以及数据转接装置2包含数据接收单元21、数据处理单元22和播放接口单元23为例，其中，获取单元11包含工业摄像装置和语音输入模块，其提供8K 60帧/s的图像帧、状态信息及其音频数据。时钟信号生成单元14输出一时钟信号。所述时钟信号用于对图像帧中各像素行(或列)和音频数据的同步处理提供基本的单位时钟周期。编码单元12在时钟信号的控制下，根据所读取的图像帧及其像素行(或列)生成行场同步信号，并读取像素数据，以及基于音频数据中时间戳读取拍摄一幅或多幅图像帧的时间段内的音频数据段；所述编码单元12依据预设的编码格式将时钟信号，行场同步信号、音视频同步信号和控制码，以及像素数据、状态信息和音频数据段等进行统一编码并封装成可传输的数据包。所述编码单元12将数据包逐一通过数据发送单元13发送至数据转接装置。所述数据转接装置2中的数据接收单元21接收并解析数据包以交由数据处理单元22。数据处理单元22按照解析后恢复的时钟信号、行场同步信号、音频同步信号等，并利用控制码等所提供的数据包中数据的类型，得到可同步播放的图像帧的各像素行(或列)和音频数据段；以及根据播放接口单元23的播放接口数量，将所得到的图像帧进行分割，将分割后的图像子帧及音频数据段分路发送给各播放接口，以实现包含8K图像帧的音视频被实时播放。
请参阅图6，其显示为数据传输系统在一实施方式中的网络架构示意图。其中，以数据采集装置1包含获取单元11、时钟信号生成单元14、编码单元12和数据发送单元13；以及数据转接装置3包含数据接收单元31、数据处理单元32、外部缓存单元34和播放接口单元33为例，其中，获取单元11包含工业摄像装置和语音输入模块，其提供8K 120帧/s的图像帧、状态信息及其音频数据，其中，数据转接装置中的播放接口单元33的播放频率小于120帧/s，本示例中以播放接口单元33的播放频率为60帧/s为例，举例图6所示的数据传输系统的执行过程。数据采集装置中的时钟信号生成单元14输出一时钟信号。所述时钟信号用于对图像帧中各像素行(或列)和音频数据的同步处理提供基本的单位时钟周期。编码单元12在时钟信号的控制下，根据所读取的图像帧及其像素行(或列)生成行场同步信号，并读取像素数据，以及基于音频数据中时间戳读取拍摄一幅或多幅图像帧的时间段内的音频数据段； 所述编码单元12依据预设的编码格式将时钟信号，行场同步信号、音视频同步信号和控制码，以及像素数据、状态信息和音频数据段等进行统一编码并封装成可传输的数据包。所述编码单元12将数据包逐一通过数据发送单元13发送至数据转接装置。所述数据转接装置3中的数据接收单元31接收并解析数据包以交由数据处理单元32。数据处理单元32按照解析后恢复的时钟信号、行场同步信号、音频同步信号等，并利用控制码等所提供的数据包中数据的类型，得到可同步播放的图像帧的各像素行(或列)和音频数据段，并将其保存到外部缓存单元中；数据处理单元31按照隔帧显示的方式，按照本地时钟信号从外部缓存单元34读取图像帧，并依据存储时所得到的图像帧中各像素行(或列)数据、状态信息，及所同步的音频数据段，恢复行场同步信号、音视频同步信号等；以及在所恢复的行场同步信号、音视频同步信号等的控制下，并根据播放接口单元33的播放接口数量，将所得到的图像帧进行分割，将分割后的图像子帧及音频数据段分路发送给各播放接口，以实现包含8K图像帧的音视频被实时播放。
请参阅图7，其显示为数据传输系统在又一实施方式中的网络架构示意图。其中，以数据采集装置1包含获取单元11、时钟信号生成单元14、编码单元12和数据发送单元13；以及数据转接装置4包含数据接收单元41、数据处理单元42、外部缓存单元44和非易失性存储单元45为例，其中，获取单元11包含工业摄像装置和语音输入模块，其提供8K 60帧/s的图像帧、状态信息及其音频数据。时钟信号生成单元14输出一时钟信号。所述时钟信号用于对图像帧中各像素行(或列)和音频数据的同步处理提供基本的单位时钟周期。编码单元12在时钟信号的控制下，根据所读取的图像帧及其像素行(或列)生成行场同步信号，并读取像素数据，以及基于音频数据中时间戳读取拍摄一幅或多幅图像帧的时间段内的音频数据段；所述编码单元12依据预设的编码格式将时钟信号，行场同步信号、音视频同步信号和控制码，以及像素数据、状态信息和音频数据段等进行统一编码并封装成可传输的数据包。所述编码单元将数据包逐一通过数据发送单元发送至数据转接装置。所述数据转接装置中的数据接收单元41接收并解析数据包以交由数据处理单元42。数据处理单元42按照解析后恢复的时钟信号、行场同步信号、音频同步信号等，并利用控制码等所提供的数据包中数据的类型，得到可同步播放的图像帧的各像素行(或列)和音频数据段，并保存在外部缓存单元44中。所述数据处理单元42按照本地时钟信号从外部缓存单元44读取图像帧，并依据存储时所得到的图像帧中各像素行(或列)数据、状态信息，及所同步的音频数据段，恢复行场同步信号、音视频同步信号等；以及在所恢复的行场同步信号、音视频同步信号等的控制下，并根据非易失性存储单元45中存储阵列的数量，将所得到的图像帧进行分割，将分割后的图像子帧及音频数据段分路发送给各存储阵列，以实现包含8K图像帧的音视频被实时存储。
需要说明的是，上述数据传输系统的结构均为举例，而非对本申请的限制。事实上，根据实际应用场景的设计需要，数据传输系统中的数据转接装置可集成外部缓存单元、播放接口单元和非易失性存储单元，用以既能提供实时显示，又能提供更长时间段内对所摄取的多媒体播放数据的回放、快慢放、逐帧查看等播放功能。在此不再一一详述。
请参阅图8，其显示为本申请提供的一种数据采集方法的流程图。所述数据采集方法可由本申请所提供的数据采集装置来执行，或者由任何其他能够执行所述采集方法的数据采集装置执行。
在此，所述数据采集装置用于采集多媒体数据。其中数据采集装置包含摄像模块或语音输入模块，或者包含摄像模块和语音输入模块。其中，所述摄像模块包括数码摄像头、或工业摄像装置。其中所述工业摄像装置举例包括线阵摄像装置或面阵摄像装置。所述语音输入模块包括内置或外接麦克等。对应地，所获取的多媒体数据包含音频数据和视频数据，其中，所述视频数据中包含图像帧和状态信息等。
在步骤S110中，基于一时钟信号，将所获取的多媒体播放数据编码成多媒体播放数据和同步控制信息。其中，所述时钟信号生成单元举例为藉由晶振而产生时钟信号的时钟信号生成电路，或者藉由斜坡信号而生成时钟信号的时钟信号生成电路。所述时钟信号用于为编码单元和数据发送单元提供用于进行数据处理的单位时钟周期。
在所述时钟信号的控制下，将所获取的多媒体数据编码成多媒体播放数据和同步控制信息。
在此，依据时钟信号将音视频数据同步进行编码处理以得到多媒体播放数据，以及得到对应多媒体播放数据的同步控制信息。其中所述多媒体播放数据包含以下至少一种或多种组合：图像帧、音频数据、以及与所述数据采集装置相关的状态信息。其中，所述状态信息包括与获取单元中软硬件相关的辅助信息，其包括但不限于：颜色信息、相机拍摄参数，以及一些专用于特定应用场景的预留信息等。其中，所述相机拍摄参数包括但不限于曝光率、快门速度、白平衡参数等。在此，所述多媒体播放数据中所包含的数据与数据采集装置所能采集的多媒体数据类型相关。例如，所述数据采集装置中仅包含摄像模块，则所述多媒体播放数据中可仅包含图像帧，或者包含图像帧和状态信息。又如，所述数据采集装置中包含摄像模块和语音输入模块，则所述多媒体播放数据中包含图像帧和音频数据，甚至还包括所述状态信息。
在时钟信号所提供的单位时钟周期内，数据采集装置按照图像帧的播放频率、图像帧的像素数量，逐行、逐列、隔行或隔列地提取摄像模块所摄取的图像帧中的像素数据，并同时产生针对所提取的像素数据在图像各帧中的位置和表示图像帧起始位置和结束位置的同步控 制信息。其中，所述同步控制信息对应包含行同步信号、场同步信号中的至少一种。例如，所述编码单元在某一单位时钟周期起始时刻生成行同步信号和场同步信号，并依据所述行同步信号和场同步信号在后续单位时钟周期内提取图像帧第一行像素数据。
在时钟信号所提供的单位时钟周期内，所述数据采集装置还从音频数据中提取音频数据段。在一些示例中，所述编码单元按照音视频数据中的时间戳等同步信息，将所提取的音频数据段设置在对应图像帧之前或之后，并利用场同步信号来保证图像帧及所对应的音频数据段在接收端被同步处理。
在时钟信号所提供的单位时钟周期内，所述数据采集装置还获取对应当前图像帧和/或摄像模块的状态信息，并将状态信息编码在多媒体播放数据中。例如，所述数据采集装置中的摄像模块采用工业摄像装置，所述数据采集装置获取对应当前图像帧的颜色信息，以及工业摄像装置的拍摄参数等，并编码在多媒体播放数据中。例如，所述数据采集装置将状态信息编码在多媒体播放数据的包头等。
为此，所述数据采集方法还包括：按照预设的编码格式将在单位时间周期内所提取的像素数据、状态信息和音频数据段中的至少一种编码成多媒体播放数据的步骤。在一些实施方式中，所述数据采集装置还按照标准的或自定义的封装协议将所述多媒体播放数据和所对应的同步控制信息封装至少一个可被传输的数据包中。在此，根据实际封装规则，所封装的单个数据包内可包含多媒体播放数据和同步控制数据中的至少一种。
在另一些实施方式中，为了便于传输如工业摄像装置所提供的8K图像帧的数据量，在一些示例中，所述同步控制信息还包括控制码、音视频同步信号中的至少一种。其中，所述音视频同步信号可藉由行同步信号、场同步信号和控制码的组合进行表示。例如，基于场同步信号所表示的场同步周期内，所述数据采集装置将与所述场同步信号所对应的图像帧同步的音频信号编码在一起，并利用控制码表示单个数据包中所封装的多媒体数据的类型等。所述控制码可以藉由至少一个字段(或字节)来描述不同类型。例如，利用控制码描述当前封装的数据包含多媒体数据、状态信息、空闲信息等类型。所述控制码可以固定间隔封装在数据包中。例如，所述控制码依据固定数据量的间隔封装在数据包中。或者所述控制码可依据所封装的各类型数据在数据包中的具体位置，设置控制码。如此，所述数据采集装置可将同步控制信息和多媒体播放数据封装在一起，以便接收端可依据同步控制信息解析待同步处理的多媒体播放数据。
在又一些实施方式中，为了减少数据传输期间因信号衰减、噪声干扰等因素对时钟信号传输的干扰，所述数据采集装置还将所述时钟信号，以及在所述时钟信号所对应时间周期内处理的多媒体播放数据和同步控制信息中的至少一种进行编码处理、采用不同信道传输、或 者依预设时序将编码后的数据传递给数据发送单元。
在一些示例中，所述数据采集装置为所述时钟信号、同步控制信息和多媒体播放数据提供至少两种编码规则，以使编码后得到对应的时钟信息、控制信息和多媒体播放信息可依时序或采用不同信道被单独传输。在又一些示例中，所述数据采集装置按照预设的规则将时钟信号、同步控制信息和多媒体播放数据进行统一编码和封装。以一个数据中包含单位时钟周期内所需同步处理的多媒体播放数据和同步控制信息为例，所述数据采集装置按照预设的编码协议将时钟信号，和行同步信号、场同步信号、控制码等同步控制信息编码为预设字段位置的数字信息，并与多媒体播放数据封装在一起。根据实际数据封装的规则，对于所封装的单个数据包来说，数据包中可包含时钟信号、同步控制信息及多媒体播放数据中的至少一种。例如，某个数据包中可仅包含编码后的时钟信号，用以帮助数据转接装置构建本地时钟信号。又如，某个数据包中可包含编码后的时钟信号、场同步信号、控制码和空数据。再如，某个数据包中可包含编码后的时钟信号、同步控制信息及多媒体播放数据。还比如，某个数据包中可包含编码后的时钟信号和多媒体播放数据。
需要说明的是，本申请并不限制在前述提及的数据采集装置所能提供的编码及封装方式的基础上，对多媒体播放数据进行如加密、压缩等处理。然而，藉由上述数据采集装置所提供的编码及封装方式为多媒体播放数据进行网络传输准备的技术思想上，对多媒体播放数据进行其他前期准备，均应视为基于本申请的技术启示而得到的技术方案。
所述数据采集装置执行步骤S120以将时钟信号、多媒体播放数据和同步控制信息发送至接收端。其中，所述数据采集装置可采用至少一根数据线发送时钟信号以及发送多媒体播放数据和同步控制信息。
在此，根据所述数据采集装置单位时钟周期内需同步处理的多媒体播放数据的数据量，技术人员选择传输线路的数据传输能力需满足单位时钟周期内需同步处理的多媒体播放数据的数据量。在一些实施方式中，为匹配工业摄像装置的图像帧的像素数据量以及播放频率，所述数据采集装置中包括光纤接口，所述数据采集装置利用光纤介质将数据包传输至接收端。例如，所述数据采集装置利用光纤介质将包含8K图像帧的多媒体播放数据传输至数据转接装置，并为数据转接装置提供可以120帧/秒、或60帧/秒的频率显示的多媒体播放数据。其中，8K图像帧可由8K摄像装置摄取而得、或者8K以上摄像装置摄取并压缩而得。例如，所述8K图像帧为利用8K摄像装置摄取的，8K图像帧为3300万像素(7680*4320像素)。在此，后续提及的图像帧的像素分辨率均可基于此推得所使用的相应摄像装置的像素分辨率，后续不再重述。
需要说明的是，根据实际传输的数据量、传输距离以及能够传递数据的数据线的数量， 所述数据发送单元可包含单模光纤接口，或者其他网络传输接口。
例如，所述数据采集装置按照数据采集装置所提供的被单独封装的时钟信号、多媒体播放数据和同步控制信息等数据包的顺序逐个发送。又如，所述数据发送单元按照数据采集装置所提供的封装有时钟信号、多媒体播放数据和同步控制信息的数据包顺序逐个发送。
请参阅图9，本申请还提供一种数据转接方法。所述数据转接方法主要由本申请提供的数据转接装置，或其他任何能执行所述数据转接方法的数据转接装置来执行。
在步骤S210中，获取来自所述数据采集装置的时钟信号、同步控制信息和多媒体播放数据。其中，所述数据转接装置对应于所述数据采集装置所使用的接口，以匹配数据传输能力、数据传输线路等。在一些示例中，所述接收接口为光纤接口。例如，所述接收接口为单模光纤接口，并接收来自数据采集装置所发送的时钟信号、同步控制信息和多媒体播放数据。
在步骤S220中，在所述时钟信号的控制下，基于所述同步控制信息将所述多媒体播放数据进行转发处理，以便存储或显示所述多媒体播放数据。
在此，数据转接装置依据于数据采集装置为发送时钟信号、同步控制信息及多媒体播放数据而设置的编码格式、发送时序、或数据线对应将数据接收单元所接收的数字信号进行处理，以从中提取数据采集装置侧的时钟信号，并生成对应的本地时钟信号，以及按照本地时钟信号产生同步控制信息和转发多媒体播放数据。
在一些实施方式中，所述数据转接装置所接收的时钟信号、同步控制信息及多媒体播放数据为经多种编码处理、多线路传输的编码数据。所述步骤S220包括按照预设的解码格式将所述时钟信号、同步控制信息及多媒体播放数据予以解码处理。
在此，所述数据转接装置按照预先设定的解码格式，将所接收到的时钟信息、控制信息和多媒体播放信息进行对应解码，由此恢复出时钟信号、同步控制信息和多媒体播放数据的步骤。在一示例中，所述数据转接装置按照预先设定的多种解码格式，将来自不同数据线的时钟信息、控制信息和多媒体播放信息进行对应解码。在另一示例中，所述数据转接装置按照预设的解码格式将所述时钟信号、同步控制信息及多媒体播放数据予以解码处理；以及在所解码的时钟信号的控制下，基于解码后的同步控制信息将至少解码后的多媒体播放数据进行转发处理。其中，根据数据采集装置所实际发送的数据包中所包含的信息，所述数据包采用统一编码和封装格式。对于单个数据包来说，数据包中可包含时钟信号、同步控制信息及多媒体播放数据中的至少一种。例如，某个数据包中可仅包含编码后的时钟信号，用以帮助数据转接装置构建本地时钟信号。又如，某个数据包中可包含编码后的时钟信号、场同步信号、控制码和空数据。再如，某个数据包中可包含编码后的时钟信号、同步控制信息及多媒体播放数据。还比如，某个数据包中可包含编码后的时钟信号和多媒体播放数据。所述数据 转接装置按照预设的解码格式，解码数据包，以得到所述时钟信号、同步控制信息及多媒体播放数据。
在此，所述数据转接装置依据时钟信号和同步控制信息缓存或转发多媒体播放数据。例如，所述数据转接装置一方面利用经解码得到的时钟信号生成本地时钟信号，另一方面通过解码得到在一个单位时钟周期内产生行同步信号和同步转发多媒体播放数据；在延时一个单位时钟周期后，所述数据转接装置生成所述行同步信号，并基于所述行同步信号并行地将对应的多媒体播放数据予以转发处理。
根据实际多媒体播放数据所包含的数据类型，所接收的同步控制信息中还包括控制码；对应地，所述数据转接装置基于所述控制码所表示的类型，将所述多媒体播放数据中对应类型的数据进行转发处理。在此，所述数据转接装置按照预先设定的控制码所表示的类型，确定所解码的数据包中所包含的数据类型，并结合同步控制信息中的其他同步信号，对多媒体播放数据进行转发处理。例如，所述数据转接装置基于控制码确定所解码的数据包中包含状态信息，则依据状态信息确定对应图像帧中对应像素的颜色、亮度等。又如，所述数据转接装置基于控制码确定所解码的数据包中包含音频数据段，则可结合当前行场同步信号确定该音频数据段与图像帧需同步播放；或者在转存时给予对应的索引记录等。
结合上述各示例的描述，所述步骤S220包括将按照所述同步控制信息，将所述多媒体播放数据输出至播放终端。在此，按照数据采集装置所提供的多媒体播放数据的数据量与播放终端的播放能力的匹配程度，以及数据采集装内置与播放终端之间的播放频率的匹配能力，所述数据采集装置包含HDMI、SDI、VGA、Displayport等播放接口。在一些示例中，所述数据采集装置包含一路播放接口。例如，所传递的多媒体播放数据中图像帧为2-4K像素数据，对应地，所述播放接口可选用一路HDMI接口。在又一些示例中，播放接口单元包含至少两路播放接口。例如，所传递的多媒体播放数据中图像帧为8K像素数据，对应地，所述播放接口选用四路HDMI接口。
为匹配如8K图像帧且30帧/s(或60帧/s)的播放频率，所述数据采集装置采用四路播放接口进行多媒体播放数据的输出，以及，所述数据采集装置在所述同步控制信息中行场同步信号的控制下，分割所获取的多媒体播放数据中的图像帧，并分路输出至每路播放接口。
在此，在来自于数据采集装置的时钟信号的控制下，所述数据采集装置依据行场同步信号所对应的图像帧及图像帧中的像素数据行(或像素数据列)，将像素数据行(或像素数据列)进行分割，得到可输出至每路播放接口的图像子帧，并将各图像子帧分别输出至对应的播放接口。与每个播放接口相连的播放终端对应显示图像子帧。在一些示例中，所述多媒体播放数据中的图像帧为8K像素数据，播放数据接口单元包含四路播放接口，该四路播放接口连 接8K显示终端；对应地，所述数据采集装置依据行场同步信号将图像帧分隔成四幅图像子帧，并在时钟信号的控制下，并行地输出至每一路播放接口，由8K显示终端对该图像帧予以显示。
在又一些实际应用中，数据转接装置的处理速率、输出速率、或播放终端的播放频率中的至少一种不匹配于数据采集装置按照其播放频率而输出的多媒体播放数据，为此，所述数据转接装置包含外部缓存单元，其可以是一种易失性存储器，其举例为RAM、DRAM等。所述外部缓存单元用于暂存所接收的多媒体播放数据等。
对应地，所述数据转接方法还包括：藉由一外部缓存单元中转，恢复所提取的多媒体播放数据的同步控制信息，以及按照所恢复的同步控制信息，将所获取的多媒体播放数据输出至播放终端的步骤。
在此，所述数据转接装置并未直接将所得到的多媒体播放数据通过播放接口单元输出至播放终端，而是利用数据采集装置的时钟信号将其暂存到外部缓存单元，以缓冲播放接口单元的播放频率。例如，按照同步控制信息中的行场同步信号将多媒体数据中的图像帧和状态信息存入外部缓存单元中，以及按照音视频同步信号将对应图像帧的音频输入也存入外部缓存单元中。数据转接装置再依据本地时钟信号或者数据采集装置所提供的时钟信号从外部缓存单元中将多媒体播放数据读取并输出至播放接口单元。其中，无论是本地时钟信号或同源的时钟信号，均用于确保数据转接装置在进行同步读写数据期间提供基本的单位时钟周期。在此，所述数据转接装置按照存储外部缓存单元时所得到的图像帧及其各像素行(或列)的存储地址段生成行场同步信号，以及依据存入外部缓存单元时所得到的音频数据段的存储地址段生成音视频同步信号，并按照播放接口单元中播放接口的数量对图像帧进行分割并输出。
在另一些实施方式中，所述数据转接装置还基于预配置的播放频率自所述外部缓存单元提取所缓存的所述多媒体播放数据中的图像帧，按照所提取的图像帧中的各像素行(或列)恢复行场同步信号，以及按照所恢复的行场同步信号将所提取的图像帧输出至所述播放接口单元。
以数据采集装置采集8K图像帧并按120帧/s的播放频率进行输出，以及数据转接装置中的播放接口单元所能输出的播放频率为60帧/s为例，所述数据转接装置按照60帧/s的播放频率选择隔帧地从缓存中读取多媒体播放数据中的图像帧，并按照本地时钟信号生成所提取的图像帧的行场同步信号，将所对应的图像帧分割成四路，并利用所生成的行场同步信号将分割后的图像帧分别输出至播放接口单元。
所述多媒体播放数据中包含音频数据，所述数据转接装置还从其外部缓存单元中提取与图像帧同步的音频数据，并输出至播放接口单元。
需要说明的是，上述示例仅为举例，本领域技术人员可结合前述数据转接装置的示例描述，提供可按照播放接口单元的播放频率逐帧或隔帧显示图像帧的方案，在此不再逐一详述。
在一些示例中，所述数据转接装置还包含人机交互单元(未予图示)，用以获取播放指令。其中，所述人机交互单元包括但不限于：与遥控器通信的无线接收模块，用于连接鼠标、键盘等的接口模块等。数据转接装置基于所获取的播放指令从所缓存的多媒体播放数据中提取相应多媒体播放数据，并按照所提取的多媒体播放数据的同步控制信息将相应多媒体播放数据予以输出，以便播放相应多媒体播放数据。其中，所述播放指令包括但不限于以下任一种：显示上一(或下一)图像帧的播放指令，慢放(或快放)多媒体播放数据的播放指令，逐帧显示的播放指令、基于上一(或下一)图像帧播放多媒体播放数据的播放指令等。
对应地，所述数据转接方法还包括以下步骤：根据所接收的播放指令从缓存中提取对应的多媒体播放数据，并按照本地时钟信号和图像帧中各像素行(或列)的数据存放地址恢复用于显示控制的行场同步信号，以及按照所恢复的行场同步信号向播放接口单元输出所述播放指令所指示的图像帧及同步播放的音频数据。例如，所接收的播放指令包含逐帧播放，数据处理单元依据该指令做一帧一帧地恢复各同步信号并将相应图像帧输出至播放接口单元，其包括按照播放指令向前逐帧播放(或向后逐帧播放)。又如，所接收的播放指令包含慢放，数据转换装置将原120帧/秒的速度降至30帧/秒的速度恢复各同步信号并从缓存中提取所需回放的图像帧，输出至播放接口单元。需要说明的是，数据转换装置可依据播放指令中所指示的速度进行慢放，如25帧/秒、或60帧/秒等。
根据所述外部缓存单元所能存储的多媒体数据的数据量，所述数据转接装置适用于提供直播的多媒体播放转接。
在一些如监控、医疗等应用场景中，位于前端的数据采集装置所采集的多媒体播放数据需保存在非易失性存储器中，以便保存和重现。为此，所述数据转接方法还包括以下步骤：藉由一外部缓存单元中转，恢复所提取的多媒体播放数据的同步控制信息，以及按照所恢复的同步控制信息，将多媒体播放数据存储至一非易失性存储单元中。
在此，所述数据转接装置可在时钟信号的控制下，按照同步控制信息将多媒体播放数据存储到外部缓存单元；并建立用于确定图像帧中像素行(或列)的存储地址、图像帧首尾存储地址、同步的音频数据存储地址的索引机制；并在从外部缓存单元读取多媒体播放数据时，基于所述索引机制不仅可以恢复行场同步信号，还确定与对应图像帧同步的音频数据段；藉由所恢复的行场同步信号，所述数据转接装置将用于同步播放的音视频数据转存到非易失性存储单元中。如此，所述数据转接装置可有效解决数据接收单元与数据转接装置之间，以及数据转接装置与非易失性存储单元之间数据传输速率不匹配而造成的数据丢失问题。
在一些实际应用中，比如利用工业摄像装置所获取的图像帧包含8K像素数据，为防止缓存溢出，所述非易失性存储单元包含存储阵列，所述存储阵列与所述数据转接装置并行连接；所述数据转接装置按照所述存储阵列分割多媒体播放数据，并将分割后的多媒体播放数据存储至所述存储阵列中。
在此，所述数据转接装置按照将多媒体播放数据存储到外部缓存单元后，自外部缓存逐一读取的方式将多媒体播放数据转存到存储阵列中。其中，由于存储阵列与数据转接装置采用并行连接，数据转接装置按照存储阵列的数量将一图像帧进行分割，并按照本地时钟信号同步地保存在存储阵列中，以实现数据转接装置高速存储无损、高清的图像帧的目的。
需要说明的是，无论是将多媒体播放数据存储到外部缓存单元亦或非易失性存储单元中，都会构建对应存储地址的索引以供恢复行场同步信号等同步控制信息，在此，不再一一详述。
还需要说明的是，所述数据转接装置还可集成有数据采集装置中所提供的编码单元和数据发送单元，由此，借助编码单元将本地时钟信号、所恢复的行场同步信号等同步控制信息和所保存的多媒体播放数据进行重新编码和封装，以及借助数据发送单元将多媒体播放数据继续传输。由此实现了数据转接装置的级联，并解决因数据传输线路长度限制，而无法将多媒体播放数据传递至更远区域等问题。
综上所述，本申请所提供的数据采集装置和数据转接装置之间由于采用了同源的时钟信号进行数据同步处理，故而实现多媒体播放数据，特别是无损图像，能够实时播放和异地存储。在城市安防、交通监控、医疗影像检测、工业无损影像检测等需要高清图像视频的领域提供了多媒体播放数据的传输方案。
需要说明的是，通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到本申请的部分或全部可借助软件并结合必需的通用硬件平台来实现。所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时，还可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请还提供一种计算机可读存储介质，所述存储介质存储有至少一个程序，所述程序在被执行时实现前述的任一所述的数据采集方法或数据转接方法，比如实现前述对应图8或图9所描述的方法。
基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可包括其上存储有机器可执行指令的一个或多个机器可读介质，这些指令在由诸如计算机、计算机网络或其他电子设备等一个或多个机器执行时可使得该一个或多个机器根据本申请的实施例来执行操作。例如数据采集方法或数据转接方法中的各步骤等。机器可读介质可包括，但不限于，软盘、光盘、CD-ROM(紧致盘-只读存储器)、磁光盘、ROM(只读存储器)、RAM(随机存取存储器)、EPROM(可擦 除可编程只读存储器)、EEPROM(电可擦除可编程只读存储器)、磁卡或光卡、闪存、或适于存储机器可执行指令的其他类型的介质/机器可读介质。
另外，任何连接都可以适当地称为计算机可读介质。例如，如果指令是使用同轴电缆、光纤光缆、双绞线、数字订户线(DSL)或者诸如红外线、无线电和微波之类的无线技术，从网站、服务器或其它远程源发送的，则所述同轴电缆、光纤光缆、双绞线、DSL或者诸如红外线、无线电和微波之类的无线技术包括在所述介质的定义中。然而，应当理解的是，计算机可读写存储介质和数据存储介质不包括连接、载波、信号或者其它暂时性介质，而是旨在针对于非暂时性、有形的存储介质。如申请中所使用的磁盘和光盘包括压缩光盘(CD)、激光光盘、光盘、数字多功能光盘(DVD)、软盘和蓝光光盘，其中，磁盘通常磁性地复制数据，而光盘则用激光来光学地复制数据。
应理解，在本申请的各种实施例中，上述各过程的序号的大小并不意味着执行顺序的先后，各过程的执行顺序应以其功能和内在逻辑确定，而不应对本申请实施例的实施过程构成任何限定。
在本申请所提供的几个实施例中，应该理解到，所揭露的系统、装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
上述实施例仅例示性说明本申请的原理及其功效，而非用于限制本申请。任何熟悉此技术的人士皆可在不违背本申请的精神及范畴下，对上述实施例进行修饰或改变。因此，举凡所属技术领域中具有通常知识者在未脱离本申请所揭示的精神与技术思想下所完成的一切等效修饰或改变，仍应由本申请的权利要求所涵盖。

Claims (35)

  1. 一种数据转接装置，用于传输数据采集装置所提供的多媒体播放数据，其特征在于，包括：
    数据接收单元，获取来自所述数据采集装置的时钟信号、同步控制信息和多媒体播放数据；
    数据处理单元，连接于所述数据接收单元，用于在所述时钟信号的控制下，基于所述同步控制信息将所述多媒体播放数据进行转发处理，以便存储或显示所述多媒体播放数据。
  2. 根据权利要求1所述的数据转接装置，其特征在于，所述同步控制信息包含行场同步信号；对应地，所述数据处理单元在所述时钟信号的控制下，基于所述行场同步信号将所述多媒体播放数据中的图像帧进行转发处理。
  3. 根据权利要求1所述的数据转接装置，其特征在于，所述同步控制信息包含控制码，所述数据处理单元基于所述控制码所表示的类型，将所述多媒体播放数据中对应类型的数据进行转发处理。
  4. 根据权利要求1所述的数据转接装置，其特征在于，所述数据处理单元还用于按照预设的解码格式将所述时钟信号、同步控制信息及多媒体播放数据予以解码处理；以及在所解码的时钟信号的控制下，基于解码后的同步控制信息将至少解码后的多媒体播放数据进行转发处理。
  5. 根据权利要求4所述的数据转接装置，其特征在于，所述数据处理单元用于按照预设的解码格式将包含所述时钟信号、同步控制信息及多媒体播放数据中至少一种的数据包予以解码处理。
  6. 根据权利要求1-5中任一所述的数据转接装置，其特征在于，还包括：播放接口单元，连接于所述数据处理单元，用于按照所述数据处理单元的转发处理，输出所述多媒体播放数据，以供播放终端播放。
  7. 根据权利要求6所述的数据转接装置，其特征在于，所述播放接口单元包括：至少一路播放接口；
    所述数据处理单元在所述同步控制信息中行场同步信号的控制下，分割所获取的多媒 体播放数据中的图像帧，并分路输出至每路播放接口。
  8. 根据权利要求6所述的数据转接装置，其特征在于，还包括外部缓存单元，连接于所述数据处理单元；所述数据处理单元基于所述同步控制信息将所述多媒体播放数据存储至所述外部缓存单元；以及用于基于预配置的播放频率自所述外部缓存单元提取所缓存的所述多媒体播放数据中的图像帧，并按照所提取的图像帧的行场同步信号，将所提取的图像帧输出至所述播放接口单元。
  9. 根据权利要求8所述的数据转接装置，其特征在于，所述数据处理单元基于所获取的播放指令从所缓存的多媒体播放数据中提取相应多媒体播放数据，并按照所提取的多媒体播放数据的同步控制信息将相应多媒体播放数据予以输出，以便播放相应多媒体播放数据。
  10. 根据权利要求1-5中任一所述的数据转接装置，其特征在于，还包括：外部缓存单元和非易失性存储单元；
    所述数据处理单元，分别连接于所述外部缓存单元和非易失性存储单元；所述数据处理单元还用于基于所述同步控制信息将所述多媒体播放数据存储至所述外部缓存单元，以及自所述外部缓存单元提取所缓存的多媒体播放数据并转存至所述非易失性存储单元中。
  11. 根据权利要求10所述的数据转接装置，其特征在于，所述非易失性存储单元包含存储阵列，所述存储阵列与所述数据处理单元并行连接；所述数据处理单元按照所述存储阵列分割多媒体播放数据，并将分割后的多媒体播放数据存储至所述存储阵列中。
  12. 根据权利要求10所述的数据转接装置，其特征在于，还包括断电保护单元，用于在所述数据转接装置异常断电时提供供电，并将所述外部缓存单元中所缓存的多媒体播放数据转存至非易失性存储单元中。
  13. 根据权利要求10所述的数据转接装置，其特征在于，所述数据处理单元基于所获取的播放指令从所存储的多媒体播放数据中提取相应多媒体播放数据，并按照所提取的多媒体播放数据的同步控制信息将相应多媒体播放数据予以输出，以便显示相应多媒体播放数据。
  14. 根据权利要求1所述的数据转接装置，其特征在于，所述数据接收单元包含光纤接口。
  15. 根据权利要求1所述的数据转接装置，其特征在于，所述多媒体播放数据包括以下至少一种或多种组合：图像帧、音频数据、以及与所述数据采集装置相关的状态信息。
  16. 根据权利要求1所述的数据转接装置，其特征在于，所述同步控制信息包括以下至少一种或多种组合：行场同步信号、控制码、音视频同步信号。
  17. 一种数据采集装置，其特征在于，包括：
    获取单元，用于获取多媒体数据；
    时钟信号生成单元，用于生成并输出一时钟信号；
    编码单元，与所述获取单元相连，用于在所述时钟信号的控制下，将所获取的多媒体数据编码成多媒体播放数据和同步控制信息；
    数据发送单元，与所述时钟信号生成单元和获取单元相连，用于发送所述时钟信号，以及发送基于所述时钟信号而确定传输的多媒体播放数据和同步控制信息。
  18. 根据权利要求17所述的数据采集装置，其特征在于，所述数据发送单元包括光纤接口。
  19. 根据权利要求17所述的数据采集装置，其特征在于，所发送的多媒体播放数据中包含8K图像帧。
  20. 根据权利要求17所述的数据采集装置，其特征在于，所述编码单元还用于将所述时钟信号，以及在所述时钟信号所对应时间周期内处理的多媒体播放数据和同步控制信息进行至少一种编码处理；
    对应地，所述数据发送单元用于将编码后的所述时钟信号、多媒体播放数据和同步控制信息予以发送。
  21. 一种数据传输系统，其特征在于，包含：
    如权利要求17-10中任一所述的数据采集装置，以及如权利要求1-16中任一所述的数据转接装置。
  22. 一种数据转接方法，用于传输来自数据采集装置所提供的多媒体播放数据，其特征在于， 包含：
    获取来自所述数据采集装置的时钟信号、同步控制信息和多媒体播放数据；
    在所述时钟信号的控制下，基于所述同步控制信息将所述多媒体播放数据进行转发处理，以便存储或显示所述多媒体播放数据。
  23. 根据权利要求22所述的数据转接方法，其特征在于，所述同步控制信息包含行场同步信号；对应地，所述在时钟信号的控制下，基于所述同步控制信息将至少所述多媒体播放数据进行转发处理的步骤包括：在所述时钟信号的控制下，基于所述行场同步信号将所述多媒体播放数据中的图像帧进行转发处理。
  24. 根据权利要求22所述的数据转接方法，其特征在于，所述同步控制信息包含控制码，对应地，所述基于同步控制信息将至少所述多媒体播放数据进行转发处理的步骤包括：基于所述控制码所表示的类型，将所述多媒体播放数据中对应类型的数据进行转发处理。
  25. 根据权利要求22所述的数据转接方法，其特征在于，还包括：按照预设的解码格式将所述时钟信号、同步控制信息及多媒体播放数据予以解码处理的步骤；以便在所解码的时钟信号的控制下，基于解码后的同步控制信息将至少解码后的多媒体播放数据进行转发处理。
  26. 根据权利要求25所述的数据转接方法，其特征在于，所述按照预设的解码格式将所述时钟信号、同步控制信息及多媒体播放数据予以解码处理的步骤包括：按照预设的解码格式将包含所述时钟信号、同步控制信息及多媒体播放数据中至少一种的数据包予以解码处理。
  27. 根据权利要求22-26中任一所述的数据转接方法，其特征在于，所述在时钟信号的控制下，基于所述同步控制信息将至少所述多媒体播放数据进行转发处理的步骤包括：按照所述同步控制信息，将所述多媒体播放数据输出至播放终端。
  28. 根据权利要求22-26中任一所述的数据转接方法，其特征在于，还包括以下至少一种：
    藉由一外部缓存单元中转，恢复所提取的多媒体播放数据的同步控制信息，以及按照所恢复的同步控制信息，将所获取的多媒体播放数据输出至播放终端；以及
    藉由一外部缓存单元中转，恢复所提取的多媒体播放数据的同步控制信息，以及按照所恢复的同步控制信息，将多媒体播放数据存储至一非易失性存储单元中。
  29. 根据权利要求28所述的数据转接方法，其特征在于，还包括：
    基于所获取的播放指令从所存储的多媒体播放数据中提取相应多媒体播放数据并予以输出，以便播放相应多媒体播放数据。
  30. 根据权利要求22所述的数据转接方法，其特征在于，所述多媒体播放数据包括以下至少一种或多种组合：图像帧、音频数据、以及与所述数据采集装置相关的状态信息。
  31. 根据权利要求22所述的数据转接方法，其特征在于，所述同步控制信息包括以下至少一种或多种组合：行场同步信号、控制码、音视频同步信号。
  32. 一种数据采集方法，其特征在于，包括：
    基于一时钟信号，将所获取的多媒体播放数据编码成多媒体播放数据和同步控制信息；
    发送所述时钟信号、所述多媒体播放数据和同步控制信息。
  33. 根据权利要求32所述的数据采集方法，其特征在于，还包括：将所述时钟信号，以及在所述时钟信号所对应时间周期内处理的多媒体播放数据和同步控制信息进行至少一种编码处理；
    对应地，将编码后的所述时钟信号、多媒体播放数据和同步控制信息予以发送。
  34. 根据权利要求24所述的数据采集方法，其特征在于，所发送的多媒体播放数据中包含8K图像帧。
  35. 一种计算机可读存储介质，其特征在于，存储有至少一程序；所述至少一程序在被调用时执行如权利要求22-31中任一所述的数据转接方法；或者，所述至少一程序在被调用时执行如权利要求32-34中任一所述的数据采集方法。
PCT/CN2018/116626 2018-11-02 2018-11-21 数据转接装置、数据采集装置及系统、方法 WO2020087590A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201880002425.2A CN109644290B (zh) 2018-11-02 2018-11-21 数据转接装置、数据采集装置及系统、方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811303551 2018-11-02
CN201811303551.X 2018-11-02

Publications (1)

Publication Number Publication Date
WO2020087590A1 true WO2020087590A1 (zh) 2020-05-07

Family

ID=70463547

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/116626 WO2020087590A1 (zh) 2018-11-02 2018-11-21 数据转接装置、数据采集装置及系统、方法

Country Status (1)

Country Link
WO (1) WO2020087590A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050034172A1 (en) * 2003-07-11 2005-02-10 Pioneer Corporation System and method for transmitting video signals
CN202696738U (zh) * 2012-06-08 2013-01-23 深圳路迪网络有限公司 一种视频输出信号同步控制装置
CN103188473A (zh) * 2011-12-27 2013-07-03 北京同步科技有限公司 视频采集卡及其处理方法
CN205029787U (zh) * 2015-10-10 2016-02-10 杭州海康威视数字技术股份有限公司 监控系统
CN107277295A (zh) * 2017-06-22 2017-10-20 北京数码视讯科技股份有限公司 视频同步处理装置及方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050034172A1 (en) * 2003-07-11 2005-02-10 Pioneer Corporation System and method for transmitting video signals
CN103188473A (zh) * 2011-12-27 2013-07-03 北京同步科技有限公司 视频采集卡及其处理方法
CN202696738U (zh) * 2012-06-08 2013-01-23 深圳路迪网络有限公司 一种视频输出信号同步控制装置
CN205029787U (zh) * 2015-10-10 2016-02-10 杭州海康威视数字技术股份有限公司 监控系统
CN107277295A (zh) * 2017-06-22 2017-10-20 北京数码视讯科技股份有限公司 视频同步处理装置及方法

Similar Documents

Publication Publication Date Title
CN106992959B (zh) 一种3d全景音视频直播系统及音视频采集方法
CN109644290B (zh) 数据转接装置、数据采集装置及系统、方法
TW200931268A (en) Method, apparatus and system for generating and facilitating mobile high-definition multimedia interface
CN106603889A (zh) 一种基于fpga芯片模块的超高清vr固态延时器
US20150139614A1 (en) Input/output system for editing and playing ultra-high definition image
US20140281011A1 (en) System and method for replicating a media stream
WO2024061295A1 (zh) 视频数据的处理方法和系统
JP2016103830A (ja) ２ｄ映像メディア標準に基づいて３ｄ立体映像ファイルを生成及び再生するシステム及び方法
CN111010541A (zh) 基于fpga与压缩处理器的视频处理模块
US9584755B2 (en) Endoscope with high definition video recorder/player
CN110996122B (zh) 视频帧传输方法、装置、计算机设备及存储介质
CN109040818B (zh) 直播时的音视频同步方法、存储介质、电子设备及系统
CN108924502A (zh) 一种便携式图传系统及其图传方法
KR101171389B1 (ko) Ｓｄｉ를 이용한 압축 영상 전달 시스템 및 그 방법
CN110351576B (zh) 一种在工业场景下进行实时视频流快速显示的方法及其系统
CN111406404B (zh) 获得视频文件的压缩方法、解压缩方法、系统及存储介质
US20230025664A1 (en) Data processing method and apparatus for immersive media, and computer-readable storage medium
WO2020087590A1 (zh) 数据转接装置、数据采集装置及系统、方法
KR100578438B1 (ko) 비디오 캡쳐 장치 및 저속 데이타 링크를 통해 고품질의 비디오를 송신하는 방법
CN112565799B (zh) 视频数据处理方法和装置
JP5808485B2 (ja) 移動端末の録画方法、関連装置及びシステム
KR102426993B1 (ko) 에이브이 송수신 시스템
CN115734004A (zh) 视频处理方法、装置、系统和设备
JP5367771B2 (ja) 映像伝送システム
CN205092920U (zh) 高分辨率视频传输系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18938981

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18938981

Country of ref document: EP

Kind code of ref document: A1