CN109644290A - Data switching device, data acquisition device and system, method - Google Patents

Data switching device, data acquisition device and system, method Download PDF

Info

Publication number
CN109644290A
CN109644290A CN201880002425.2A CN201880002425A CN109644290A CN 109644290 A CN109644290 A CN 109644290A CN 201880002425 A CN201880002425 A CN 201880002425A CN 109644290 A CN109644290 A CN 109644290A
Authority
CN
China
Prior art keywords
data
multimedia
unit
multimedia data
clock signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201880002425.2A
Other languages
Chinese (zh)
Other versions
CN109644290B (en
Inventor
钮旋
朱璐
周新生
阮俊瑾
朱怀安
焦炳豪
高阳
陈垄
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jiqing Huishi Technology Co Ltd
Original Assignee
Shanghai Jiqing Huishi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Jiqing Huishi Technology Co Ltd filed Critical Shanghai Jiqing Huishi Technology Co Ltd
Priority claimed from PCT/CN2018/116626 external-priority patent/WO2020087590A1/en
Publication of CN109644290A publication Critical patent/CN109644290A/en
Application granted granted Critical
Publication of CN109644290B publication Critical patent/CN109644290B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8547—Content authoring involving timestamps for synchronizing content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/22—Adaptations for optical transmission

Abstract

The application provides a kind of data switching device, data acquisition device and system, method.Wherein, data switching device is used for transmission multimedia data provided by data acquisition device.Data acquisition device includes: acquiring unit, for obtaining multi-medium data；Clock generating unit, for generating and exporting a clock signal；Coding unit is used under control of the clock signal, by acquired multi-medium data coding at multimedia data and synchronically controlling information；Data transmission unit is used for tranmitting data register signal, and sends the multimedia data and synchronically controlling information for being determined transmission based on clock signal.Data switching device includes: data receipt unit, obtains clock signal, synchronically controlling information and multimedia data from data acquisition device；Data processing unit, under control of the clock signal, multimedia data being forwarded processing based on synchronically controlling information.The application realizes the real-time broadcasting and strange land storage of lossless image.

Description

Data switching device, data acquisition device and system, method
Technical field
This application involves the fields of communication technology of multimedia data, more particularly to a kind of data switching device, number According to acquisition device and system, method.
Background technique
The continuous development of data transmission media and network transmission technology is benefited from, image and sound when user watches network direct broadcasting The clarity of sound is being continuously improved.For example, in the case where watching the scenes such as football match or safety monitoring, with can watch per family With the more real-time audio-video of uppick.
However, being limited to the network capacity between front-end data acquisition device and Back end data reception device, data Acquired multimedia data are usually carried out compression processing by acquisition device, and by transmission network by compressed more matchmakers Body played data is transmitted.On the one hand, the data degradation generated due to compression can not be retrieved when playing, this makes user The information content of front end audio, video data collected can not be obtained when watching and listening to audio-video；It on the other hand, is reduction The loss of multimedia data, delay etc. influence during network transmission, in transmission, need to increase checking procedure (such as answering machine System), which increase the delays of multimedia.Under some scenes for needing HD video and lossless audio, prior art side Case is unable to satisfy demand.
Summary of the invention
In view of the foregoing deficiencies of prior art, the application is designed to provide a kind of data switching device, data Acquisition device and system, method, for solve in the prior art multimedia data have during the transmission greater loss and The problem of delay.
In order to achieve the above objects and other related objects, the first aspect of the application provides a kind of data switching device, uses The multimedia data provided by transmission data acquisition device, comprising: data receipt unit is obtained and adopted from the data Clock signal, synchronically controlling information and the multimedia data of acquisition means；Data processing unit is connected to the data receiver Unit, for being carried out the multimedia data based on the synchronically controlling information under the control of the clock signal Forward process, to store or show the multimedia data.
In the certain embodiments of the first aspect, the synchronically controlling information includes row field sync signal；It is corresponding Ground, the data processing unit are broadcast the multimedia under the control of the clock signal, based on the row field sync signal It puts the picture frame in data and is forwarded processing.
In the certain embodiments of the first aspect, the synchronically controlling information includes control code, at the data Unit is managed based on type represented by the control code, the data of corresponding types in the multimedia data are forwarded Processing.
In the certain embodiments of the first aspect, the data processing unit is also used to according to preset decoding lattice The clock signal, synchronically controlling information and multimedia data are given decoding process by formula；And in clock decoded Under the control of signal, at least decoded multimedia data are forwarded by place based on decoded synchronically controlling information Reason.
In the certain embodiments of the first aspect, the data processing unit is used for according to preset codec format Data packet comprising at least one of the clock signal, synchronically controlling information and multimedia data is given at decoding Reason.
In the certain embodiments of the first aspect, the data switching device further include: playback interface unit, even It is connected to the data processing unit, for the forward process according to the data processing unit, exports the multimedia number According to for playback terminal broadcasting.
In the certain embodiments of the first aspect, the playback interface unit includes: at least playback interface all the way； The data processing unit under the control of row field sync signal, is divided acquired multimedia and is broadcast in the synchronically controlling information The picture frame in data is put, and branch is exported to every road playback interface.
In the certain embodiments of the first aspect, the data switching device further includes external cache unit, even It is connected to the data processing unit；The data processing unit is based on the synchronically controlling information for the multimedia data It stores to the external cache unit；And delay for the broadcasting frequency based on pre-configuration from external cache unit extraction The picture frame in the multimedia data deposited, and according to the row field sync signal of extracted picture frame, it will be extracted Picture frame export to the playback interface unit.
In the certain embodiments of the first aspect, the data processing unit based on acquired play instruction from Corresponding multimedia data are extracted in the multimedia data cached, and according to extracted multimedia data Synchronically controlling information is exported corresponding multimedia data, to play corresponding multimedia data.
In the certain embodiments of the first aspect, the data switching device further include: external cache unit and Non-volatile memory cells；The data processing unit is connected to the external cache unit and non-volatile memories list Member；The data processing unit is also used to store the multimedia data to described outer based on the synchronically controlling information Portion's cache unit, and extract cached multimedia data from the external cache unit and be transferred to described non-volatile In property storage unit.
In the certain embodiments of the first aspect, the non-volatile memory cells include storage array, described Storage array and the data processing unit are connected in parallel；The data processing unit divides multimedia according to the storage array Played data, and the multimedia data after segmentation are stored into the storage array.
In the certain embodiments of the first aspect, the data switching device further includes power-off protection unit, is used In providing power supply in the data switching device abnormal power-down, and the multimedia cached in the external cache unit is broadcast Data conversion storage is put into non-volatile memory cells.
In the certain embodiments of the first aspect, the data processing unit based on acquired play instruction from Corresponding multimedia data are extracted in the multimedia data stored, and according to extracted multimedia data Synchronically controlling information is exported corresponding multimedia data, to show corresponding multimedia data.
In the certain embodiments of the first aspect, the data receipt unit includes optical fiber interface.
In the certain embodiments of the first aspect, the multimedia data are comprised at least one of the following or more Kind combination: picture frame, audio data and status information relevant to the data acquisition device.
In the certain embodiments of the first aspect, the synchronically controlling information is comprised at least one of the following or a variety of Combination: row field sync signal, control code, audio-visual synchronization signal.
The application second aspect provides a kind of data acquisition device, comprising: acquiring unit, for obtaining multi-medium data； Clock generating unit, for generating and exporting a clock signal；Coding unit is connected with the acquiring unit, is used for Under the control of the clock signal, by acquired multi-medium data coding at multimedia data and synchronically controlling information； Data transmission unit is connected with the clock generating unit and acquiring unit, for sending the clock signal, Yi Jifa Send the multimedia data and synchronically controlling information that transmission is determined based on the clock signal.
In the certain embodiments of the second aspect, the data transmission unit includes optical fiber interface.
It include 8K picture frame in transmitted multimedia data in the certain embodiments of the second aspect.
In the certain embodiments of the second aspect, the coding unit is also used to the clock signal, and The multimedia data and synchronically controlling information handled in the time cycle corresponding to the clock signal carry out at least one Coded treatment；Accordingly, the data transmission unit be used for will encode after the clock signal, multimedia data and together Step control information is sent.
The application third aspect provides a kind of data transmission system, includes: the data as described in aforementioned first aspect is any Acquisition device, and the data switching device as described in any in aforementioned second aspect.
The application fourth aspect provides a kind of data switch method, is used for transmission more provided by the data acquisition device Media play data include: obtaining clock signal, synchronically controlling information and multimedia from the data acquisition device Data；Under the control of the clock signal, the multimedia data are forwarded based on the synchronically controlling information Processing, to store or show the multimedia data.
In the certain embodiments of the fourth aspect, the synchronically controlling information includes row field sync signal；It is corresponding Ground, it is described under control of the clock signal, at least described multimedia data are turned based on the synchronically controlling information The step of hair processing includes: to be based on the row field sync signal for the multimedia under the control of the clock signal Picture frame in data is forwarded processing.
In the certain embodiments of the fourth aspect, the synchronically controlling information includes control code, accordingly, described Based on synchronically controlling information will at least described multimedia data be forwarded processing the step of include: based on the control code The data of corresponding types in the multimedia data are forwarded processing by represented type.
In the certain embodiments of the fourth aspect, the method also includes: according to preset codec format by institute State the step of clock signal, synchronically controlling information and multimedia data give decoding process；So as in clock decoded Under the control of signal, at least decoded multimedia data are forwarded by place based on decoded synchronically controlling information Reason.
In the certain embodiments of the fourth aspect, it is described according to preset codec format by the clock signal, It will include institute that the step of synchronically controlling information and multimedia data give decoding process, which includes: according to preset codec format, The data packet for stating at least one of clock signal, synchronically controlling information and multimedia data gives decoding process.
In the certain embodiments of the fourth aspect, it is described under control of the clock signal, based on the synchronous control Information processed will at least described multimedia data the step of being forwarded processing include: according to the synchronically controlling information, will The multimedia data are exported to playback terminal.
In the certain embodiments of the fourth aspect, the method also includes following at least one: outside one Cache unit transfer restores the synchronically controlling information of extracted multimedia data, and according to the synchronous control restored Information processed exports acquired multimedia data to playback terminal；And by an external cache unit transfer, restore The synchronically controlling information of extracted multimedia data, and according to the synchronically controlling information restored, multimedia is broadcast Data are put to store into a non-volatile memory cells.
In the certain embodiments of the fourth aspect, the method also includes: based on acquired play instruction from Corresponding multimedia data are extracted in the multimedia data stored and are exported, and are broadcast to play corresponding multimedia Put data.
In the certain embodiments of the fourth aspect, the multimedia data are comprised at least one of the following or more Kind combination: picture frame, audio data and status information relevant to the data acquisition device.
In the certain embodiments of the fourth aspect, the synchronically controlling information is comprised at least one of the following or a variety of Combination: row field sync signal, control code, audio-visual synchronization signal.
The 5th aspect of the application provides a kind of collecting method, comprising: a clock signal is based on, by acquired more matchmakers Body played data is encoded into multimedia data and synchronically controlling information；Send the clock signal, the multimedia Data and synchronically controlling information.
In the certain embodiments of the 5th aspect, the method also includes: by the clock signal, and in institute It states the multimedia data handled in the time cycle corresponding to clock signal and synchronically controlling information carries out at least one coding Processing；Accordingly, the clock signal, multimedia data and the synchronically controlling information after coding are sent.
It include 8K picture frame in transmitted multimedia data in the certain embodiments of the fourth aspect.
The 6th aspect of the application provides a kind of computer readable storage medium, which is characterized in that is stored with an at least program； An at least program executes the data switch method as described in any in fourth aspect when called；Alternatively, it is described at least One program executes the collecting method as described in any in terms of the 5th when called.
As described above, the data switching device of the application, data acquisition device and system, method, have below beneficial to effect Fruit: it is counted between data acquisition device and data switching device provided herein due to using homologous clock signal According to synchronization process, so realizing multimedia data, especially lossless image, it can play and be stored with strange land in real time.In city City's security protection, traffic monitoring etc. need the field of high-definition image monitoring to provide the transmission plan of multimedia data.Particularly, The multimedia data and synchronously control of image collecting device side are obtained using the optical fiber interface in herein described scheme Information etc., can with 120 frames/second speed by 8K image carry out network transmission, be achieved in by city security protection, traffic monitoring, The purpose of the real-time Transmission of video ultra high-definition picture collected during medical treatment etc. is multi-field.
Detailed description of the invention
Fig. 1 is shown as the structural schematic diagram of the application data acquisition device in one embodiment.
Fig. 2 is shown as the structural schematic diagram of the application data switching device in one embodiment.
Fig. 3 is shown as the structural schematic diagram of the application data switching device in yet another embodiment.
Fig. 4 is shown as the structural schematic diagram figure of the application data switching device in yet another embodiment.
Fig. 5 is shown as the network architecture schematic diagram of the application data transmission system in one embodiment.
Fig. 6 is shown as the network architecture schematic diagram of the application data transmission system in yet another embodiment.
Fig. 7 is shown as the network architecture schematic diagram of the application data transmission system in another embodiment.
Fig. 8 is shown as the flow chart of the application collecting method.
Fig. 9 is shown as the flow chart of the application data switch method.
Specific embodiment
Presently filed embodiment is illustrated by particular specific embodiment below, those skilled in the art can be by this explanation Content disclosed by book understands other advantages and effect of the application easily.
As used in herein, singular " one ", "one" and "the" are intended to also including plural form, unless There is opposite instruction in context.It will be further understood that term "comprising", " comprising " show there are the feature, step, Operation, element, component, project, type, and/or group, but it is not excluded for one or more other features, step, operation, element, group Presence, appearance or the addition of part, project, type, and/or group.Term "or" and "and/or" used herein are interpreted as including Property, or mean any one or any combination.Therefore, " A, B or C " or " A, B and/or C " mean " it is following any one: A；B；C；A and B；A and C；B and C；A, B and C ".Only when element, function, step or the combination of operation under certain modes inherently When mutually exclusive, it just will appear the exception of this definition.
In the network transmission of existing multimedia data, some embodiments can using streaming media transmission protocol, Or the transmission technologys such as breakpoint transmission realize the point-to-point transmission or multicast communication of multimedia data.This kind of mode is fitted mostly The scene low for requirement of real-time, such as order video, watch delay live.However real-time and sound view are taken into account for some The scene of frequency play quality, such as the multimedia teaching of the high-definition monitoring system, the playback system in court, even medical operation in city The application fields such as system need to build special multimedia delivery network, playback terminal are enabled to play high-definition image in real time And/or high quality audio.For this purpose, in other embodiments, being solved in existing way using using synchronous clock signal The matching problem of the transmission of sending and receiving end multimedia data and display rhythm, this needs the clock signal of constantly calibration sending and receiving end, So that it is synchronized；Wherein the synchronization process process of clock signal reduces the real-time of sending and receiving end.
As user is to watching that the audio-video clarity listened to requires and requirement of real-time is constantly promoted, for example, curing The fields such as treatment, the micro-nano detection of industrial detection, television signal transmission, technical staff need to transmit compression ratio is lower, real-time more High multimedia data.For this purpose, the application provides a kind of data acquisition device.Wherein, the data acquisition device can be set Such as street is placed in be used to obtain at the position of front end multimedia data.The data acquisition device is more by dedicated transmissions Media play data and the transmission line built or the common transmission route that can transmit multimedia data turn with data Connection device is connected.Wherein, for ensure data acquisition device and data switching device can high efficiency of transmission compression ratio it is low, even lossless The multimedia data of compression, the data volume that selected transmission line is transmitted within the unit clock period need to be much larger than receipts The data volume of originator synchronization process within the identical clock cycle.For example, the rate according to unit clock cycle synchronisation processing data, The transmission rate of the corresponding transmission line selected is its ten times, decades of times or hundreds of times etc..Thus by selected transmission line The data transmission capabilities on road, so that single source clock signal conduct can be used between the data acquisition device and data switching device The mode of the reference clock signal of synchronization process realizes the synchronization process to multimedia data.For example, utilizing fiber medium Transmission line, the data switching device can using clock signal caused by the data acquisition device side carry out data at Reason, to realize the high efficiency of transmission of multimedia data.
Referring to Fig. 1, it is shown as a kind of data acquisition device provided by the present application.The data acquisition device 1 includes Acquiring unit 11, clock generating unit 14, coding unit 12 and data transmission unit 13.
The acquiring unit 11 is for obtaining multi-medium data.Here, the acquiring unit 11 includes photographing module or language Sound input module, or include photographing module and voice input module.Wherein, the photographing module include digital camera head or Industrial photographic device.Wherein the industrial photographic device citing includes linear array photographic device or face battle array photographic device.The voice Input module includes built-in or external Mike etc..Accordingly, acquired multi-medium data includes audio data and video data, Wherein, picture frame and status information etc. are included in the video data.
The clock generating unit 14 is for generating and exporting a clock signal.Wherein, the clock signal generates Unit 14 is exemplified as by crystal oscillator and generating the clock signal generating circuit of clock signal, or by ramp signal and when generating The clock signal generating circuit of clock signal.The clock signal is used to provide and be used for for coding unit 12 and data transmission unit 13 Carry out the unit clock period of data processing.
The coding unit 12 is connected with the acquiring unit 11, for will be obtained under the control of the clock signal The multi-medium data coding taken is at multimedia data and synchronically controlling information.
Here, the coding unit 12 includes the processing module that can carry out logic control and digital operation, and for storing The memory module of generated intermediate data during the processing module operation.Wherein, the processing module citing includes following Any one or more combination: FPGA, MCU and CPU etc..The memory module citing includes following any one or more group It closes: the volatile memory such as register, storehouse and caching.
The coding unit 12 broadcasts the synchronous progress coded treatment of audio, video data to obtain multimedia according to clock signal Data are put, and obtain the synchronically controlling information of corresponding multimedia data.Wherein, it can be obtained according to the acquiring unit 11 The type of the multi-medium data taken, the multimedia data include following at least one or more of combination: picture frame, audio Data and status information relevant to the data acquisition device.Wherein, the status information include in acquiring unit 11 The relevant auxiliary information of software and hardware comprising but be not limited to: colouring information, camera acquisition parameter and it is some be exclusively used in it is specific Reserved information of application scenarios etc..Wherein, the camera acquisition parameter includes but is not limited to exposure rate, shutter speed, white balance Parameter etc..For example, only include photographing module in the data acquisition device, then it can be only comprising figure in the multimedia data As frame, or include picture frame and status information.For another example, mould is inputted comprising photographing module and voice in the data acquisition device Block includes then picture frame and audio data in the multimedia data, or even further includes the status information.
Here, in the unit clock period provided by clock signal of coding unit 12, according to the broadcasting of picture frame The pixel quantity of frequency, picture frame, line by line, by column, interlacing or picture in the picture frame that photographing module is absorbed is extracted every column Prime number evidence, and simultaneously generate for position of the extracted pixel data in each frame of image and indicate image frame start position and The synchronically controlling information of end position.Wherein, the synchronically controlling information is corresponding comprising in line synchronising signal, field sync signal It is at least one.For example, the coding unit 12 generates line synchronising signal and field synchronization in a certain unit clock period start time Signal, and picture frame the first row pixel is extracted within the following unitary clock cycle according to the line synchronising signal and field sync signal Data.
In the unit clock period provided by clock signal, the coding unit 12 also extracts audio from audio data Data segment.In some instances, the coding unit 12 will be extracted according to synchronizing informations such as timestamps in audio, video data Audio data section be arranged before or after correspondence image frame, and guarantee using field sync signal picture frame and corresponding Audio data section is synchronized to handle in receiving end.
In the unit clock period provided by clock signal, the coding unit 12 also obtains corresponding current image frame And/or the status information of photographing module, and by status information coding in multimedia data.For example, the acquiring unit For photographing module used in 11 using industrial photographic device, the coding unit 12 obtains the color letter of corresponding current image frame Breath, and the acquisition parameters etc. of industrial photographic device, and encode in multimedia data.For example, the coding unit 12 Status information is encoded in the packet header etc. of multimedia data.
Here, the coding unit 12 according to preset coded format will in unit period extracted pixel number Multimedia data are encoded into according at least one of, status information and audio data section.In some embodiments, described Coding unit 12 is according further to standard or customized tunneling by the multimedia data and corresponding synchronous control In at least one data packet that can be transmitted of Information encapsulation processed.Here, according to actual package rule, packaged single data packet It inside may include at least one of multimedia data and synchronously control data.
In other embodiments, for the ease of the data of transmission 8K picture frame as provided by industrial photographic device Amount, in some instances, the synchronically controlling information further includes at least one of control code, audio-visual synchronization signal.Wherein, The audio-visual synchronization signal can be indicated by the combination of line synchronising signal, field sync signal and control code.For example, being based on In field sync period represented by field sync signal, the coding unit 12 by with picture frame corresponding to the field sync signal Synchronous audio-frequency signal coding together, and utilizes the type of multi-medium data packaged in control code expression single data packet Deng.The control code can describe different type by least one field (or byte).For example, being worked as using control code description The data of preceding encapsulation include the types such as multi-medium data, status information, free message.The control code can be encapsulated with fixed intervals In the packet.For example, the control code encapsulates in the packet according to the interval of fixed data amount.Or the control code can According to the specific location of packaged all types of data in the packet, control code is set.In this way, the coding unit 12 can incite somebody to action Synchronically controlling information and multimedia data are packaged together, so that receiving end can be to be synchronized according to synchronically controlling information parsing The multimedia data of processing.
In yet other embodiments, in order to reduce between data transfer period because of factors clock synchronizations such as signal decaying, noise jammings The interference of clock signal transmission, the coding unit 12 is also by the clock signal, and the time corresponding to the clock signal At least one of the multimedia data handled in period and synchronically controlling information carry out coded treatment, using different channels It transmits or the data after coding is passed into data transmission unit 13 according to default timing.
In some instances, the coding unit 12 is the clock signal, synchronically controlling information and multimedia number According at least two coding rules are provided, so as to obtain corresponding clock information, control information and multimedia information after coding It can individually be transmitted according to timing or using different channels.In other example, the coding unit 12 is according to default rule Clock signal, synchronically controlling information and multimedia data are subjected to Unified coding and encapsulation.To include list in a data In the bit clock period for the multimedia data of required synchronization process and synchronically controlling information, the coding unit 12 according to The synchronously controls information coding such as clock signal and line synchronising signal, field sync signal, control code is pre- by preset coding protocol If the digital information of field location, and be packaged together with multimedia data.According to real data encapsulate rule, for It may include in clock signal, synchronically controlling information and multimedia data in data packet for packaged single data packet At least one.For example, can be only comprising the clock signal after coding, to help data switching device to construct in some data packet Local clock pulses.For another example, it in some data packet may include after coding clock signal, field sync signal, control code and empty number According to.For another example, may include in some data packet coding after clock signal, synchronically controlling information and multimedia data.Also compare Such as, may include in some data packet coding after clock signal and multimedia data.
It should be noted that the application is not limited in the coding and encapsulation that the aforementioned coding unit 12 referred to can be provided On the basis of mode, multimedia data such as encrypt, compress processing.However, by above-mentioned 12 institute of coding unit The coding and packaged type of offer are that multimedia data carry out in the technical idea of network transmission preparation, to multimedia Data carry out other early-stage preparations, are regarded as technical solution obtained from the technical inspiration based on the application.
Data packet after coding is passed to data transmission unit 13 by the coding unit 12, by the data transmission unit 13 are sent to receiving end.Wherein, at least one data line tranmitting data register signal and hair can be used in the data transmission unit 13 Send the multimedia data and synchronically controlling information that transmission is determined based on the clock signal.
Here, according to the number of the multimedia data of the data acquisition device unit clock period domestic demand synchronization process According to amount, the transmittability of technical staff's selection data transmission unit 13 need to meet more matchmakers of unit clock period domestic demand synchronization process The data volume of body played data.In some embodiments, for match industrial photographic device picture frame amount of pixel data with And broadcasting frequency, the data transmission unit 13 in the data acquisition device include optical fiber interface, the data transmission unit 13 Data packet is transmitted to receiving end using fiber medium.For example, the data transmission unit 13 will include 8K using fiber medium The multimedia data of picture frame are transmitted to data switching device, and for data switching device provide can with 120 frames/second or The multimedia data that 60 frames/second frequency is shown.Wherein, 8K picture frame can be absorbed by 8K photographic device and or 8K The above photographic device absorbs and compresses and obtain.For example, the 8K picture frame is to be absorbed using 8K photographic device, 8K picture frame is 33000000 pixels (7680*4320 pixel).Here, the pixel resolution of the subsequent picture frame referred to can push away to be made based on this The pixel resolution of corresponding photographic device, it is subsequent no longer to repeat.
It should be noted that according to the data volume of actual transmissions, transmission range and the data line that data can be transmitted Quantity, the data transmission unit 13 may include single mode optical fiber interface or other network transport interfaces.
For example, the data transmission unit 13 is according to the clock signal, more being separately packaged provided by coding unit 12 The sequence of the data packets such as media play data and synchronically controlling information is sent one by one.For another example, the data transmission unit 13 according to The packet sequence of clock signal, multimedia data and synchronically controlling information is packaged with provided by coding unit 12 one by one It sends.
For according to the received multimedia data of the processing of clock signal provided by the data acquisition device, this Shen A kind of data switching device is please also provided.The data switching device includes data receipt unit and data processing unit.
Wherein, it is connect used in the data transmission unit that the data receipt unit corresponds in the data acquisition device Mouthful, with matched data transmittability, data transmission link etc..The data receipt unit, which obtains, comes from the data acquisition device Clock signal, synchronically controlling information and multimedia data.Here, the data receipt unit includes: to be used for and data The corresponding receiving interface of transmission unit.In some instances, the receiving interface is optical fiber interface.For example, the receiving interface For single mode optical fiber interface.
The data processing unit is used under the control of the clock signal, will at least based on the synchronically controlling information The multimedia data are forwarded processing, to store or show the multimedia data.
Here, the data processing unit includes the processing module that can carry out logic control and digital operation, and for depositing Store up the memory module of generated intermediate data during the processing module is run.Wherein, processing module citing include with Under any one or more combination: FPGA, MCU and CPU etc..The memory module citing includes following any one or more group It closes: the volatile memory such as register, storehouse and caching.
It is tranmitting data register signal, synchronically controlling information and multimedia that the data processing unit, which is dependent on data acquisition device, Played data and the coded format that is arranged, transmission timing or data line are corresponding by data receipt unit received digital signal It is handled, therefrom to extract the clock signal of data acquisition device side, and generates corresponding local clock pulses, and according to Local clock pulses generate synchronically controlling information and repeating multimedia played data.
In some embodiments, the received clock signal of the data switching device institute, synchronically controlling information and more matchmakers Body played data is the coded data transmitted through a variety of coded treatments, multi-line.The data processing unit is according to preset solution The clock signal, synchronically controlling information and multimedia data are given decoding process by code format.
Here, the data processing unit by received clock information, is controlled according to preset codec format Information and multimedia information carry out corresponding decoding, thus recover clock signal, synchronically controlling information and multimedia Data.In one example, the data processing unit, will be from different data line according to preset a variety of codec formats Clock information, control information and multimedia information carry out corresponding decoding.In another example, the data processing unit is pressed The clock signal, synchronically controlling information and multimedia data are given into decoding process according to preset codec format；And It, will at least decoded multimedia number based on decoded synchronically controlling information under the control of clock signal decoded It is handled according to being forwarded.Wherein, the information according to included in the data acquisition device practical data packet sent, the data Packet uses Unified coding and encapsulation format.It may include clock signal, synchronously control letter in data packet for single data packet At least one of breath and multimedia data.For example, can only include the clock signal after coding in some data packet, to Data switching device is helped to construct local clock pulses.For another example, may include in some data packet coding after clock signal, field it is same Walk signal, control code and empty data.For another example, may include in some data packet coding after clock signal, synchronically controlling information and Multimedia data.Also for example, may include the clock signal and multimedia data after coding in some data packet.It is described Data processing unit is according to preset codec format, decoding data packet, to obtain the clock signal, synchronically controlling information and more Media play data.
Here, the data processing unit plays number according to clock signal and synchronically controlling information caching or repeating multimedia According to.For example, on the one hand the data processing unit generates local clock pulses, another party using decoded obtained clock signal Face obtains generating line synchronising signal and synchronous repeating multimedia played data within a unit clock period by decoding；Prolonging When one unit clock period after, the data processing unit generates the line synchronising signal, and is based on the line synchronising signal Corresponding multimedia data are concurrently given into forward process.
It further include control in the received synchronically controlling information of institute according to the data type that practical multimedia data are included Code processed；Accordingly, the data processing unit, will be in the multimedia data based on type represented by the control code The data of corresponding types are forwarded processing.Here, the data processing unit is according to represented by preset control code Type determines data type included in data packet decoded, and other synchronization signals in combination synchronically controlling information, Processing is forwarded to multimedia data.For example, the data processing unit determines data decoded based on control code Include status information in packet, then determines the color of respective pixel, brightness etc. in correspondence image frame according to status information.For another example, institute Data processing unit is stated to determine based on control code comprising audio data section in data packet decoded, then it is same in combination with current line field Step signal determines that the audio data section need to be played simultaneously with picture frame；Or corresponding index record is given in unloading etc..
In conjunction with above-mentioned each exemplary description, the data processing unit is according to clock signal and synchronically controlling information to more matchmakers The mode that body played data is forwarded processing may include being played multimedia data.For this purpose, being answered in some reality In, referring to Fig. 2, it is shown as the structural schematic diagram of data switching device in one embodiment.Wherein, the data turn Connection device 2 further includes playback interface unit 23.Here, according to the data of multimedia data provided by data acquisition device Amount and the built-in broadcasting frequency between playback terminal of matching degree and data acquisition dress of the ability to play of playback terminal Matching capacity, the playback interface unit include the playback interfaces such as HDMI, SDI, VGA, Displayport.In some instances, The playback interface unit includes playback interface all the way.For example, picture frame is 2-4K picture in the multimedia data transmitted HDMI interface all the way can be selected in prime number evidence, accordingly, the playback interface.In other example, playback interface unit includes At least two-way playback interface.For example, picture frame is 8K pixel data in the multimedia data transmitted, it is accordingly, described Playback interface selects four tunnel HDMI interface.
To match the broadcasting frequency such as 8K picture frame and 30 frames/s (or 60 frames/s), the playback interface unit 23 uses four Road playback interface carries out the output of multimedia data, and, the data processing unit 22 is in the synchronically controlling information Under the control of middle row field sync signal, divide the picture frame in acquired multimedia data, and branch is exported to every road Playback interface.
Here, under the control from the clock signal of data acquisition device, the data processing unit 22 is according to row Picture frame corresponding to field sync signal and the lines of pixel data in picture frame (or pixel data array), by lines of pixel data (or Pixel data array) it is split, the image subframes that may be output to every road playback interface are obtained, and each image subframes are exported respectively To corresponding playback interface.Displays image sub-frames corresponding with the playback terminal that each playback interface is connected.In some instances, institute Stating the picture frame in multimedia data is 8K pixel data, and played data interface unit 23 includes four tunnel playback interfaces, should Four tunnel playback interfaces connect 8K display terminal；Accordingly, the data processing unit 22 is according to row field sync signal by picture frame Four width image subframes are separated into, and under control of the clock signal, concurrently export to per playback interface all the way, shown eventually by 8K End shows the picture frame.
In other practical application, the broadcasting frequency of the processing speed of data switching device, output speed or playback terminal At least one of rate does not match the multimedia data that data acquisition device is exported according to its broadcasting frequency, for this purpose, Referring to Fig. 3, it is shown as the structural schematic diagram of data switching device in yet another embodiment.Turn with data shown in Fig. 2 Unlike connection device, data switching device shown in Fig. 3 further includes the external cache unit 34 for being connected to data processing unit. Here, the external cache unit 34 is a kind of volatile memory, it is exemplified as RAM, DRAM etc..The external cache unit 34 for temporary received multimedia data of institute etc..
Data processing unit 32 stores the multimedia data to the external cache unit.With it is shown in Fig. 2 Unlike data switching device, the data processing unit 32 not directly by obtained multimedia data export to Playback interface unit, but external cache unit 34 is kept in using the clock signal of data acquisition device, it is broadcast with buffering Put the broadcasting frequency of interface unit 33.For example, according to the row field sync signal in acquired synchronically controlling information by multimedia In picture frame in data and status information deposit external cache unit 34, and according to audio-visual synchronization signal by correspondence image The audio input of frame is also stored in external cache unit.Data processing unit 32 is acquired according to local clock pulses or data again Clock signal provided by device by multimedia reading data and is exported to playback interface list from external cache unit 34 Member 33.Wherein, either local clock pulses or homologous clock signal, be used to ensure data processing unit 32 carry out it is same The basic unit clock period is provided during step read-write data.Here, the data processing unit 32 is according to storage external cache The storage address section of obtained picture frame and its each pixel column (or column) generates row field sync signal when unit, and foundation is deposited The storage address section for entering obtained audio data section when external cache unit 34 generates audio-visual synchronization signal, and according to broadcasting The quantity of playback interface is split and exports to picture frame in interface unit 33.
In other embodiments, the data processing unit 32 is also used to the broadcasting frequency based on pre-configuration described in External cache unit extracts the picture frame in the multimedia data cached, according to each in extracted picture frame Pixel column (or column) restores row field sync signal, and exports extracted picture frame according to the row field sync signal restored To the playback interface unit.
8K picture frame is acquired with data acquisition device and is exported by 120 frames/s broadcasting frequency and data switch For the broadcasting frequency that playback interface unit in device can be output is 60 frames/s, the data processing unit is according to 60 frames/s Broadcasting frequency selection every frame from the picture frame read in caching in multimedia data, and it is raw according to local clock pulses At the row field sync signal of extracted picture frame, by corresponding image frame division Cheng Silu, and row field generated is utilized Synchronization signal exports the picture frame after segmentation respectively to playback interface unit 33.
It include audio data in the multimedia data, the data processing unit 32 is also from external cache unit 34 The audio data of middle extraction and image frame synchronization, and export to playback interface unit 33.
It should be noted that above-mentioned example is only for example, those skilled in the art are in combination with said data processing unit Example description, provide can according to playback interface unit broadcasting frequency frame by frame or every frame show picture frame scheme, herein no longer It is described in detail one by one.
In some instances, the data switching device also includes man-machine interaction unit (being unillustrated), is broadcast to obtain Put instruction.Wherein, the man-machine interaction unit includes but is not limited to: the wireless receiving module communicated with remote controler, for connecting The interface module etc. of mouse, keyboard etc..Data processing unit is based on acquired play instruction from the multimedia cached Corresponding multimedia data are extracted in data, and will be corresponding according to the synchronically controlling information of extracted multimedia data Multimedia data are exported, to play corresponding multimedia data.Wherein, the play instruction includes but unlimited In following any: the play instruction of upper (or next) picture frame of display, slow play (or putting fastly) multimedia data are broadcast Instruction is put, play instruction, the play instruction based on upper one (or next) picture frame broadcasting multimedia data shown frame by frame Deng.
Here, data processing unit extracts corresponding multimedia number according to the received play instruction of institute from caching According to, and restore according to the data storage address of pixel column each in local clock pulses and picture frame (or column) for display control Row field sync signal, and exported indicated by the play instruction according to the row field sync signal restored to playback interface unit Picture frame and the audio data that is played simultaneously.For example, the received play instruction of institute includes to play frame by frame, data processing unit according to It is done according to the instruction and on a frame-by-frame basis restores each synchronization signal and export respective image frame to playback interface unit comprising according to Play instruction plays forward (or playing frame by frame backward) frame by frame.For another example, the received play instruction of institute includes slow play, data conversion dress Set the figure that the speed of former 120 frames/second is down to playback needed for 30 frames/second speed is restored each synchronization signal and extracted from caching As frame, output to playback interface unit.It should be noted that data conversion device can be according to speed indicated in play instruction Carry out slow play, such as 25 frames/second or 60 frames/second.
According to the data volume for the multi-medium data that the external cache unit may store, the data switching device is applicable in It transfers in the multimedia for providing live streaming.
In some such as monitoring, medical treatment application scenarios, the data acquisition device multimedia collected positioned at front end is broadcast Putting data need to be saved in non-volatile memory, to save and to reappear.For this purpose, referring to Fig. 4, it is shown as the application number According to the structural schematic diagram of switching device in yet another embodiment.It is different from earlier figures 2 and data switching device shown in Fig. 3 It is that the data switching device 4 includes data receipt unit 41, data processing unit 42, external cache unit 44 and non-volatile Property storage unit 45.
Wherein, the data receipt unit 41 is identical as the structure of aforementioned data receiving unit (21,31) and executive mode Or it is similar, this will not be detailed here.
The data processing unit 42 is connected to the external cache unit 44 and non-volatile memory cells 45；Institute Data processing unit 42 is stated to be also used to store the multimedia data to the outside based on the synchronically controlling information Cache unit 44, and extract cached multimedia data from the external cache unit 44 and be transferred to described non-easy In the property lost storage unit 45.
Here, the data processing unit 42 can under control of the clock signal, according to synchronically controlling information by multimedia Played data is stored to external cache unit 44；And foundation is for determining the storage address, figure of pixel column in picture frame (or column) As the Indexing Mechanism of frame head and the tail storage address, the audio data storage address of synchronization；And it is more being read from external cache unit 44 When media play data, row field sync signal can not only be restored based on the Indexing Mechanism, also determination is same with correspondence image frame The audio data section of step；By the row field sync signal restored, sound that the data processing unit 42 will be used to be played simultaneously Video data dumps in non-volatile memory cells 45.In this way, the data switching device can effectively solve data receiver list Data transmit speed between member 41 and data processing unit 42 and between data processing unit 42 and non-volatile memory cells 45 Rate mismatch and caused by data loss problem.
Include 8K pixel data in some practical applications, such as using picture frame acquired in industrial photographic device, is Cache overflow is prevented, the non-volatile memory cells 45 include storage array, the storage array and the data processing list Member 42 is connected in parallel；The data processing unit 42 divides multimedia data according to the storage array, and will be after segmentation Multimedia data store into the storage array.
Here, the data processing unit 42 is stored according to by multimedia data to after external cache unit 44, from The mode that external cache is read one by one is by multimedia data conversion storage into storage array.Wherein, due to storage array and number According to processing unit 42 using being connected in parallel, a picture frame is split by data processing unit 42 according to the quantity of storage array, And be synchronously stored in storage array according to local clock pulses, to realize that 42 high speed storing of data processing unit is lossless, high The purpose of clear picture frame.
It should be noted that either multimedia data are stored to external cache unit or non-volatile memories In unit, can all construct corresponding storage address is indexed for the synchronically controlling informations such as recovery row field sync signal, here, no longer It is described in detail one by one.
It should also be noted that, the data switching device can also be integrated with coding list provided in data acquisition device Local clock pulses, the row field sync signal restored etc. are synchronized by coding unit control as a result, by member and data transmission unit Information processed and the multimedia data saved are recompiled and are encapsulated, and by data transmission unit by multimedia Played data continues to transmit.It is thus achieved that the cascade of data switching device, and solve to limit because of data transmission line length, and The problems such as multimedia data can not be transferred to more far region.
In some practical applications, for prevent data switching device because extremely power supply due to lose not yet be saved in it is non-volatile Multimedia data in storage unit, further include in data switching device provided herein power-off protection unit (not Give diagram), for providing power supply in the data switching device abnormal power-down, and will be cached in the external cache unit Multimedia data conversion storage into non-volatile memory cells.
Here, the power-off protection unit includes power management module and power storage module.Wherein power management module is used for Whether the external power supply of monitoring data switching device is normal, switches to the power storage module when occurring abnormal.Here, the electricity Source control module includes the control circuit etc. of switching switch and switching switch.The power storage module includes that at least one is used for energy storage Capacitor and the charge-discharge circuit of capacitor etc..The electricity consumption duration that the power storage module can be provided is more than or equal to data processing The duration that unit is spent the multimedia data conversion storage in external cache unit into non-volatile memory cells.Example Such as, when external cache unit almost completely deposits multimedia data, the electricity consumption duration that the power storage module can be provided should be big In be equal to data processing unit by multimedia data conversion storages all in external cache unit into non-volatile memory cells The duration spent.The data processing unit is based on outage detection signal provided by the power-off protection unit, can also be Power-off operation will be executed after multimedia data conversion storage to non-volatile memory cells, to prevent because that program exception exits is right It is damaged caused by the hardware of data switching device.
The structure of data acquisition device and data switching device based on aforementioned offer describes, and the application also provides a kind of number According to Transmission system.The data transmission system may include data acquisition device described in aforementioned any example and correspond to number According to the data switching device of acquisition device, no longer repeat herein.
Referring to Fig. 5, it is shown as the network architecture schematic diagram of data transmission system in one embodiment.Wherein, with Data acquisition device 1 includes acquiring unit 11, clock generating unit 14, coding unit 12 and data transmission unit 13；With And data switching device 2 is comprising for data receipt unit 21, data processing unit 22 and playback interface unit 23, wherein obtains Taking unit 11 includes industrial photographic device and voice input module, provides 60 frames of 8K/s picture frame, status information and its sound Frequency evidence.Clock generating unit 14 exports a clock signal.The clock signal be used for pixel column each in picture frame (or Column) and the synchronization process of audio data the basic unit clock period is provided.Coding unit 12 under control of the clock signal, root Row field sync signal, and reads pixel data are generated according to read picture frame and its pixel column (or column), and is based on audio Timestamp reads the audio data section in the period of shooting one or more picture frame in data；12 foundation of coding unit Preset coded format is by clock signal, row field sync signal, audio-visual synchronization signal and control code and pixel data, shape State information and audio data section etc. carry out Unified coding and are packaged into the data packet that can be transmitted.The coding unit 12 is by data packet Data switching device is sent to by data transmission unit 13 one by one.Data receipt unit 21 in the data switching device 2 Data packet is received and parsed through to transfer to data processing unit 22.Data processing unit 22 according to the clock signal restored after parsing, Row field sync signal, audio synchronous signal etc., and using the type of data in data packet provided by control code etc., obtaining can be same Walk each pixel column (or column) and audio data section of the picture frame played；And the playback interface number according to playback interface unit 23 Amount, obtained picture frame is split, by after segmentation image subframes and audio data section branch be sent to it is each broadcasting connect Mouthful, to realize that the audio-video comprising 8K picture frame is played in real time.
Referring to Fig. 6, it is shown as the network architecture schematic diagram of data transmission system in one embodiment.Wherein, with Data acquisition device 1 includes acquiring unit 11, clock generating unit 14, coding unit 12 and data transmission unit 13；With And data switching device 3 includes data receipt unit 31, data processing unit 32, external cache unit 34 and playback interface unit For 33, wherein acquiring unit 11 includes industrial photographic device and voice input module, provides 120 frames of 8K/s image Frame, status information and its audio data, wherein the broadcasting frequency of the playback interface unit 33 in data switching device is less than 120 Frame/s, in this example by taking the broadcasting frequency of playback interface unit 33 is 60 frames/s as an example, data transmission system shown in fig. 6 of illustrating Implementation procedure.Clock generating unit 14 in data acquisition device exports a clock signal.The clock signal is used for The basic unit clock period is provided to pixel column each in picture frame (or column) and the synchronization process of audio data.Coding unit 12 Under control of the clock signal, row field sync signal is generated according to read picture frame and its pixel column (or column), and read Pixel data, and the audio data in the period for shooting one or more picture frame is read based on timestamp in audio data Section；The coding unit 12 is according to preset coded format by clock signal, row field sync signal, audio-visual synchronization signal and control Code and pixel data processed, status information and audio data section etc. carry out Unified coding and are packaged into the data packet that can be transmitted.Institute It states coding unit 12 data packet is passed through into data transmission unit 13 one by one and be sent to data switching device.The data switching device Data receipt unit 31 in 3 receives and parses through data packet to transfer to data processing unit 32.Data processing unit 32 is according to solution Clock signal, row field sync signal, audio synchronous signal for restoring after analysis etc., and using in data packet provided by control code etc. The type of data obtains each pixel column (or column) and audio data section for the picture frame that can be played simultaneously, and is saved into outer In portion's cache unit；Data processing unit 31 is by such a way that frame is shown, according to local clock pulses from external cache unit 34 read picture frame, and according to pixel column (or column) data, status information each in picture frame obtained when storing, and synchronize Audio data section, restore row field sync signal, audio-visual synchronization signal etc.；And restored row field sync signal, sound Under the control of video synchronization signal etc., and according to the playback interface quantity of playback interface unit 33, by obtained picture frame into Row segmentation, by after segmentation image subframes and audio data section branch be sent to each playback interface, with realize include 8K picture frame Audio-video played in real time.
Referring to Fig. 7, it is shown as the network architecture schematic diagram of data transmission system in yet another embodiment.Wherein, It include acquiring unit 11, clock generating unit 14, coding unit 12 and data transmission unit 13 with data acquisition device 1； And data switching device 4 includes data receipt unit 41, data processing unit 42, external cache unit 44 and non-volatile deposits For storage unit 45, wherein acquiring unit 11 includes industrial photographic device and voice input module, provides 60 frames of 8K/s Picture frame, status information and its audio data.Clock generating unit 14 exports a clock signal.The clock signal is used for The basic unit clock period is provided to pixel column each in picture frame (or column) and the synchronization process of audio data.Coding unit 12 Under control of the clock signal, row field sync signal is generated according to read picture frame and its pixel column (or column), and read Pixel data, and the audio data in the period for shooting one or more picture frame is read based on timestamp in audio data Section；The coding unit 12 is according to preset coded format by clock signal, row field sync signal, audio-visual synchronization signal and control Code and pixel data processed, status information and audio data section etc. carry out Unified coding and are packaged into the data packet that can be transmitted.Institute It states coding unit data packet is passed through into data transmission unit one by one and be sent to data switching device.In the data switching device Data receipt unit 41 receives and parses through data packet to transfer to data processing unit 42.Data processing unit 42 is according to extensive after parsing Multiple clock signal, row field sync signal, audio synchronous signal etc., and utilize data in data packet provided by control code etc. Type obtains each pixel column (or column) and audio data section for the picture frame that can be played simultaneously, and is stored in external cache unit In 44.The data processing unit 42 reads picture frame from external cache unit 44 according to local clock pulses, and according to storage When obtained picture frame in each pixel column (or column) data, status information, it is same to restore row field and the audio data section synchronized Walk signal, audio-visual synchronization signal etc.；And under the control of row field sync signal, the audio-visual synchronization signal restored etc., And according to the quantity of storage array in non-volatile memory cells 45, obtained picture frame is split, after segmentation Image subframes and audio data section branch are sent to each storage array, to realize that the audio-video comprising 8K picture frame is deposited in real time Storage.
It should be noted that the structure of above-mentioned data transmission system is citing, rather than the limitation to the application.It is true On, according to the design needs of practical application scene, data switching device in data transmission system can integrating external cache unit, Playback interface unit and non-volatile memory cells, can provide real-time display and provide in a longer period of time to institute The playback of the multimedia data of intake, forwarding and slowing such as check at the playing functions frame by frame.It is no longer described in detail one by one herein.
Referring to Fig. 8, its flow chart for being shown as a kind of collecting method provided by the present application.The data acquisition side Method can be executed by data acquisition device provided herein, or the number of the acquisition method is able to carry out by any other It is executed according to acquisition device.
Here, the data acquisition device is for acquiring multi-medium data.Wherein data acquisition device includes photographing module Or voice input module, or include photographing module and voice input module.Wherein, the photographing module includes digital vedio recording Head or industrial photographic device.Wherein the industrial photographic device citing includes linear array photographic device or face battle array photographic device.It is described Voice input module includes built-in or external Mike etc..Accordingly, acquired multi-medium data includes audio data and video Data, wherein include picture frame and status information etc. in the video data.
In step s 110, it is based on a clock signal, by acquired multimedia data encoding at multimedia Data and synchronically controlling information.Wherein, the clock generating unit be exemplified as generating by crystal oscillator clock signal when Clock signal generating circuit, or generate by ramp signal the clock signal generating circuit of clock signal.The clock signal For providing the unit clock period for carrying out data processing for coding unit and data transmission unit.
Under the control of the clock signal, by acquired multi-medium data coding at multimedia data with it is synchronous Control information.
Here, according to clock signal by the synchronous coded treatment that carries out of audio, video data to obtain multimedia data, with And obtain the synchronically controlling information of corresponding multimedia data.Wherein the multimedia data include following at least one Or multiple combinations: picture frame, audio data and status information relevant to the data acquisition device.Wherein, the state Information includes auxiliary information relevant to software and hardware in acquiring unit comprising but be not limited to: colouring information, camera shooting ginseng Several and some reserved information etc. for being exclusively used in specific application scene.Wherein, the camera acquisition parameter includes but is not limited to expose Light rate, shutter speed, white balance parameter etc..Here, data included in the multimedia data and data acquisition fill It is related to set the multimedia data type that can be acquired.For example, only include photographing module in the data acquisition device, then it is described more It can only include picture frame in media play data, or include picture frame and status information.For another example, in the data acquisition device It then include picture frame and audio data in the multimedia data, or even go back comprising photographing module and voice input module Including the status information.
In the unit clock period provided by clock signal, data acquisition device according to picture frame broadcasting frequency, figure As the pixel quantity of frame, line by line, by column, interlacing or pixel data in the picture frame that photographing module is absorbed is extracted every column, And it is generated simultaneously for position of the extracted pixel data in each frame of image and indicates image frame start position and stop bits The synchronically controlling information set.Wherein, corresponding at least one comprising in line synchronising signal, field sync signal of the synchronically controlling information Kind.For example, the coding unit generates line synchronising signal and field sync signal in a certain unit clock period start time, and according to Picture frame the first row pixel data is extracted within the following unitary clock cycle according to the line synchronising signal and field sync signal.
In the unit clock period provided by clock signal, the data acquisition device also extracts sound from audio data Frequency data segment.In some instances, the coding unit will be extracted according to synchronizing informations such as timestamps in audio, video data Audio data section be arranged before or after correspondence image frame, and guarantee using field sync signal picture frame and corresponding Audio data section is synchronized to handle in receiving end.
In the unit clock period provided by clock signal, the data acquisition device also obtains corresponding current image frame And/or the status information of photographing module, and by status information coding in multimedia data.For example, the data acquisition For photographing module in device using industrial photographic device, the data acquisition device obtains the color letter of corresponding current image frame Breath, and the acquisition parameters etc. of industrial photographic device, and encode in multimedia data.For example, the data acquisition dress It sets and encodes status information in the packet header etc. of multimedia data.
For this purpose, the collecting method further include: will be mentioned in unit period according to preset coded format At least one of pixel data, status information and audio data section for taking are encoded into the step of multimedia data.One In a little embodiments, the data acquisition device is according further to standard or customized tunneling by the multimedia number It is encapsulated in the data packet that at least one can be transmitted according to corresponding synchronically controlling information.Here, according to actual package rule, It may include at least one of multimedia data and synchronously control data in packaged single data packet.
In other embodiments, for the ease of the data of transmission 8K picture frame as provided by industrial photographic device Amount, in some instances, the synchronically controlling information further includes at least one of control code, audio-visual synchronization signal.Wherein, The audio-visual synchronization signal can be indicated by the combination of line synchronising signal, field sync signal and control code.For example, being based on In field sync period represented by field sync signal, the data acquisition device by with image corresponding to the field sync signal The audio-frequency signal coding of frame synchronization together, and utilizes the class of multi-medium data packaged in control code expression single data packet Type etc..The control code can describe different type by least one field (or byte).For example, being described using control code The data of current encapsulation include the types such as multi-medium data, status information, free message.The control code can be sealed with fixed intervals Dress is in the packet.For example, the control code encapsulates in the packet according to the interval of fixed data amount.Or the control code Control code can be set according to the specific location of packaged all types of data in the packet.In this way, the data acquisition device Synchronically controlling information and multimedia data can be packaged together, so as to receiving end can according to synchronically controlling information parse to The multimedia data of synchronization process.
In yet other embodiments, in order to reduce between data transfer period because of factors clock synchronizations such as signal decaying, noise jammings The interference of clock signal transmission, the data acquisition device is also by the clock signal, and when corresponding to the clock signal Between at least one of the multimedia data that handle in the period and synchronically controlling information carry out coded treatment, using different letters It transmits or the data after coding is passed into data transmission unit according to default timing in road.
In some instances, the data acquisition device is the clock signal, synchronically controlling information and multimedia Data provide at least two coding rules, so as to obtain corresponding clock information, control information and multimedia letter after coding Breath can individually be transmitted according to timing or using different channels.In other example, the data acquisition device is according to preset Clock signal, synchronically controlling information and multimedia data are carried out Unified coding and encapsulation by rule.To be wrapped in a data In period containing unit clock for the multimedia data of required synchronization process and synchronically controlling information, the data acquisition dress It sets and compiles the synchronically controlling informations such as clock signal and line synchronising signal, field sync signal, control code according to preset coding protocol Code is the digital information of preset field position, and is packaged together with multimedia data.The rule encapsulated according to real data It then, may include clock signal, synchronically controlling information and multimedia in data packet for packaged single data packet At least one of data.For example, can be only comprising the clock signal after coding, to help data switch to fill in some data packet Set building local clock pulses.For another example, may include in some data packet coding after clock signal, field sync signal, control code With empty data.For another example, may include in some data packet coding after clock signal, synchronically controlling information and multimedia number According to.Also for example, may include the clock signal and multimedia data after coding in some data packet.
It should be noted that the application is not limited in the coding and envelope that the aforementioned data acquisition device referred to can be provided On the basis of dress mode, multimedia data such as encrypt, compress processing.It is filled however, being acquired by above-mentioned data Coding and packaged type provided by setting are that multimedia data carry out in the technical idea of network transmission preparation, to multimedia Played data carries out other early-stage preparations, is regarded as technical solution obtained from the technical inspiration based on the application.
The data acquisition device executes step S120 with by clock signal, multimedia data and synchronically controlling information It is sent to receiving end.Wherein, the data acquisition device can be used at least one data line tranmitting data register signal and send more Media play data and synchronically controlling information.
Here, according to the number of the multimedia data of the data acquisition device unit clock period domestic demand synchronization process According to amount, the data transmission capabilities of technical staff's selection transmission line need to meet the multimedia of unit clock period domestic demand synchronization process The data volume of played data.In some embodiments, for match industrial photographic device picture frame amount of pixel data and Broadcasting frequency, includes optical fiber interface in the data acquisition device, and the data acquisition device is using fiber medium by data packet It is transmitted to receiving end.For example, the data acquisition device utilizes fiber medium by the multimedia data comprising 8K picture frame It is transmitted to data switching device, and provides the more matchmakers that can be shown with 120 frames/second or 60 frames/second frequency for data switching device Body played data.Wherein, 8K picture frame can be absorbed by 8K photographic device and or 8K or more photographic device absorb and compress and ?.For example, the 8K picture frame is to be absorbed using 8K photographic device, 8K picture frame is 33,000,000 pixels (7680*4320 picture Element).Here, the pixel resolution of the subsequent picture frame referred to can be pushed away based on this used in corresponding photographic device pixel Resolution ratio, it is subsequent no longer to repeat.
It should be noted that according to the data volume of actual transmissions, transmission range and the data line that data can be transmitted Quantity, the data transmission unit may include single mode optical fiber interface or other network transport interfaces.
For example, the data acquisition device is according to the clock signal, more being separately packaged provided by data acquisition device The sequence of the data packets such as media play data and synchronically controlling information is sent one by one.For another example, the data transmission unit is according to number According to being packaged with the packet sequence of clock signal, multimedia data and synchronically controlling information provided by acquisition device one by one It sends.
Referring to Fig. 9, the application also provides a kind of data switch method.The data switch method is mainly mentioned by the application The data switching device of confession or other any energy execute the data switching device of the data switch method to execute.
In step S210, clock signal, synchronically controlling information and multimedia from the data acquisition device are obtained Played data.Wherein, the data switching device corresponds to interface used in the data acquisition device, is passed with matched data Movement Capabilities, data transmission link etc..In some instances, the receiving interface is optical fiber interface.For example, the receiving interface is Single mode optical fiber interface, and receive clock signal, synchronically controlling information and multimedia transmitted by the data acquisition device Data.
In step S220, under the control of the clock signal, the synchronically controlling information is based on by the multimedia Played data is forwarded processing, to store or show the multimedia data.
Here, it is tranmitting data register signal, synchronically controlling information and more matchmakers that data switching device, which is dependent on data acquisition device, Body played data and be arranged coded format, transmission timing or data line are corresponding believes the received number of data receipt unit institute It number is handled, therefrom to extract the clock signal of data acquisition device side, and generates corresponding local clock pulses, and press Synchronically controlling information and repeating multimedia played data are generated according to local clock pulses.
In some embodiments, the received clock signal of the data switching device institute, synchronically controlling information and more matchmakers Body played data is the coded data transmitted through a variety of coded treatments, multi-line.The step S220 includes according to preset solution The clock signal, synchronically controlling information and multimedia data are given decoding process by code format.
Here, the data switching device by received clock information, is controlled according to preset codec format Information and multimedia information carry out corresponding decoding, thus recover clock signal, synchronically controlling information and multimedia The step of data.In one example, the data switching device will come from different numbers according to preset a variety of codec formats Corresponding decoding is carried out according to the clock information of line, control information and multimedia information.In another example, the data switch Device gives the clock signal, synchronically controlling information and multimedia data at decoding according to preset codec format Reason；It, will at least decoded more matchmakers based on decoded synchronically controlling information and under the control of clock signal decoded Body played data is forwarded processing.Wherein, the information according to included in the data acquisition device practical data packet sent, The data packet uses Unified coding and encapsulation format.It may include clock signal in data packet, same for single data packet Step control at least one of information and multimedia data.For example, can be only comprising the clock after coding in some data packet Signal, to help data switching device to construct local clock pulses.For another example, may include in some data packet coding after clock Signal, field sync signal, control code and empty data.It for another example, may include clock signal after coding, synchronous control in some data packet Information processed and multimedia data.Also for example, may include the clock signal and multimedia after encoding in some data packet Data.The data switching device is according to preset codec format, decoding data packet, to obtain the clock signal, synchronous control Information processed and multimedia data.
Here, the data switching device plays number according to clock signal and synchronically controlling information caching or repeating multimedia According to.For example, on the one hand the data switching device generates local clock pulses, another party using decoded obtained clock signal Face obtains generating line synchronising signal and synchronous repeating multimedia played data within a unit clock period by decoding；Prolonging When one unit clock period after, the data switching device generates the line synchronising signal, and is based on the line synchronising signal Corresponding multimedia data are concurrently given into forward process.
It further include control in the received synchronically controlling information of institute according to the data type that practical multimedia data are included Code processed；Accordingly, the data switching device, will be in the multimedia data based on type represented by the control code The data of corresponding types are forwarded processing.Here, the data switching device is according to represented by preset control code Type determines data type included in data packet decoded, and other synchronization signals in combination synchronically controlling information, Processing is forwarded to multimedia data.For example, the data switching device determines data decoded based on control code Include status information in packet, then determines the color of respective pixel, brightness etc. in correspondence image frame according to status information.For another example, institute Data switching device is stated to determine based on control code comprising audio data section in data packet decoded, then it is same in combination with current line field Step signal determines that the audio data section need to be played simultaneously with picture frame；Or corresponding index record is given in unloading etc..
In conjunction with above-mentioned each exemplary description, the step S220 includes will be according to the synchronically controlling information, will be described more Media play data are exported to playback terminal.Here, according to the data of multimedia data provided by data acquisition device Amount and the built-in broadcasting frequency between playback terminal of matching degree and data acquisition dress of the ability to play of playback terminal Matching capacity, the data acquisition device include the playback interfaces such as HDMI, SDI, VGA, Displayport.In some instances, The data acquisition device includes playback interface all the way.For example, picture frame is 2-4K picture in the multimedia data transmitted HDMI interface all the way can be selected in prime number evidence, accordingly, the playback interface.In other example, playback interface unit includes At least two-way playback interface.For example, picture frame is 8K pixel data in the multimedia data transmitted, it is accordingly, described Playback interface selects four tunnel HDMI interface.
To match the broadcasting frequency such as 8K picture frame and 30 frames/s (or 60 frames/s), the data acquisition device uses four tunnels Playback interface carries out the output of multimedia data, and, data acquisition device row in the synchronically controlling information Under the control of field sync signal, divide the picture frame in acquired multimedia data, and branch is exported to every road and played Interface.
Here, the data acquisition device is according to row field under the control from the clock signal of data acquisition device Picture frame corresponding to synchronization signal and the lines of pixel data in picture frame (or pixel data array), by lines of pixel data (or picture Prime number is according to column) be split, obtain the image subframes that may be output to every road playback interface, and by each image subframes export respectively to Corresponding playback interface.Displays image sub-frames corresponding with the playback terminal that each playback interface is connected.In some instances, described Picture frame in multimedia data is 8K pixel data, and played data interface unit includes four tunnel playback interfaces, four tunnel Playback interface connects 8K display terminal；Accordingly, picture frame is separated by the data acquisition device according to row field sync signal Four width image subframes, and under control of the clock signal, it concurrently exports to every playback interface all the way, by 8K display terminal to this Picture frame is shown.
In other practical application, the broadcasting frequency of the processing speed of data switching device, output speed or playback terminal At least one of rate does not match the multimedia data that data acquisition device is exported according to its broadcasting frequency, for this purpose, The data switching device includes external cache unit, can be a kind of volatile memory, is exemplified as RAM, DRAM etc.. The external cache unit is for temporary received multimedia data of institute etc..
Accordingly, the data switch method further include: by an external cache unit transfer, restore extracted more matchmakers The synchronically controlling information of body played data, and according to the synchronically controlling information restored, by acquired multimedia number The step of according to output to playback terminal.
Here, obtained multimedia data are not directly passed through playback interface unit by the data switching device It exports to playback terminal, but is kept in external cache unit using the clock signal of data acquisition device, broadcast with buffering Put the broadcasting frequency of interface unit.For example, according to the row field sync signal in synchronically controlling information by the figure in multi-medium data As in frame and status information deposit external cache unit, and according to audio-visual synchronization signal by the audio input of correspondence image frame Also it is stored in external cache unit.Data switching device again according to provided by local clock pulses or data acquisition device when Clock signal by multimedia reading data and is exported to playback interface unit from external cache unit.Wherein, either originally Ground clock signal or homologous clock signal are used to ensure that data switching device provides base during synchronizing read-write data This unit clock period.Here, the data switching device according to obtained picture frame when storage external cache unit and The storage address section of its each pixel column (or column) generates row field sync signal, and according to deposit external cache unit when is acquired The storage address section of audio data section generate audio-visual synchronization signal, and according to the quantity of playback interface in playback interface unit Picture frame is split and is exported.
In other embodiments, the data switching device is also slow from the outside based on the broadcasting frequency of pre-configuration Memory cell extracts the picture frame in the multimedia data cached, according to each pixel column in extracted picture frame (or column) restore row field sync signal, and export extracted picture frame to described according to the row field sync signal restored Playback interface unit.
8K picture frame is acquired with data acquisition device and is exported by 120 frames/s broadcasting frequency and data switch For the broadcasting frequency that playback interface unit in device can be output is 60 frames/s, the data switching device is according to 60 frames/s Broadcasting frequency selection every frame from the picture frame read in caching in multimedia data, and it is raw according to local clock pulses At the row field sync signal of extracted picture frame, by corresponding image frame division Cheng Silu, and row field generated is utilized Synchronization signal exports the picture frame after segmentation respectively to playback interface unit.
It include audio data in the multimedia data, the data switching device is also from its external cache unit The audio data with image frame synchronization is extracted, and is exported to playback interface unit.
It should be noted that above-mentioned example is only for example, those skilled in the art are in combination with aforementioned data switching device Example description, provide can according to playback interface unit broadcasting frequency frame by frame or every frame show picture frame scheme, herein no longer It is described in detail one by one.
In some instances, the data switching device also includes man-machine interaction unit (being unillustrated), is broadcast to obtain Put instruction.Wherein, the man-machine interaction unit includes but is not limited to: the wireless receiving module communicated with remote controler, for connecting The interface module etc. of mouse, keyboard etc..Data switching device is based on acquired play instruction from the multimedia cached Corresponding multimedia data are extracted in data, and will be corresponding according to the synchronically controlling information of extracted multimedia data Multimedia data are exported, to play corresponding multimedia data.Wherein, the play instruction includes but unlimited In following any: the play instruction of upper (or next) picture frame of display, slow play (or putting fastly) multimedia data are broadcast Instruction is put, play instruction, the play instruction based on upper one (or next) picture frame broadcasting multimedia data shown frame by frame Deng.
Accordingly, the data switch method is further comprising the steps of: being mentioned from caching according to the received play instruction of institute Corresponding multimedia data are taken, and according to the data storing place of pixel column each in local clock pulses and picture frame (or column) The row field sync signal for being used for display control is restored in location, and defeated to playback interface unit according to the row field sync signal restored Picture frame and the audio data being played simultaneously indicated by the play instruction out.For example, the received play instruction of institute include by Frame plays, and data processing unit is done according to the instruction on a frame-by-frame basis to be restored each synchronization signal and export respective image frame to broadcasting Put interface unit comprising play frame by frame forward according to play instruction (or playing frame by frame backward).For another example, the received broadcasting of institute refers to Enabling includes slow play, data conversion device by the speed of former 120 frames/second be down to 30 frames/second speed restore each synchronization signal and from The picture frame played back needed for being extracted in caching, output to playback interface unit.It should be noted that data conversion device can foundation Indicated speed carries out slow play, such as 25 frames/second or 60 frames/second in play instruction.
According to the data volume for the multi-medium data that the external cache unit may store, the data switching device is applicable in It transfers in the multimedia for providing live streaming.
In some such as monitoring, medical treatment application scenarios, the data acquisition device multimedia collected positioned at front end is broadcast Putting data need to be saved in non-volatile memory, to save and to reappear.For this purpose, the data switch method further includes following Step: by an external cache unit transfer, restoring the synchronically controlling information of extracted multimedia data, and according to The synchronically controlling information restored stores multimedia data into a non-volatile memory cells.
Here, the data switching device can under control of the clock signal broadcast multimedia according to synchronically controlling information Data storage is put to external cache unit；And foundation is for determining the storage address, picture frame of pixel column in picture frame (or column) The Indexing Mechanism of head and the tail storage address, the audio data storage address of synchronization；And it is broadcast reading multimedia from external cache unit When putting data, row field sync signal can not only be restored based on the Indexing Mechanism, the also determining sound with correspondence image frame synchronization Frequency data segment；By the row field sync signal restored, the audio, video data that the data switching device will be used to be played simultaneously It dumps in non-volatile memory cells.In this way, the data switching device can effectively solve data receipt unit and data turn Between connection device and between data switching device and non-volatile memory cells message transmission rate mismatch and caused by number According to the problem of loss.
Include 8K pixel data in some practical applications, such as using picture frame acquired in industrial photographic device, is Cache overflow is prevented, the non-volatile memory cells include storage array, the storage array and the data switching device Parallel connection；The data switching device divides multimedia data according to the storage array, and by more matchmakers after segmentation Body played data is stored into the storage array.
Here, the data switching device is stored according to by multimedia data to after external cache unit, from outside The mode that caching is read one by one is by multimedia data conversion storage into storage array.Wherein, since storage array and data turn One picture frame is split using parallel connection, data switching device according to the quantity of storage array by connection device, and according to this It is stored in storage array to ground clock signal synchronization, to realize that data switching device high speed storing is lossless, picture frame of high definition Purpose.
It should be noted that either multimedia data are stored to external cache unit or non-volatile memories In unit, can all construct corresponding storage address is indexed for the synchronically controlling informations such as recovery row field sync signal, here, no longer It is described in detail one by one.
It should also be noted that, the data switching device can also be integrated with coding list provided in data acquisition device Local clock pulses, the row field sync signal restored etc. are synchronized by coding unit control as a result, by member and data transmission unit Information processed and the multimedia data saved are recompiled and are encapsulated, and by data transmission unit by multimedia Played data continues to transmit.It is thus achieved that the cascade of data switching device, and solve to limit because of data transmission line length, and The problems such as multimedia data can not be transferred to more far region.
In conclusion homologous due to using between data acquisition device and data switching device provided herein Clock signal carry out data synchronization processing, so realize multimedia data, especially lossless image, can play in real time and Strange land storage.In city, security protection, traffic monitoring, medical imaging detection, industrial non-destructive Image detection etc. need high-definition image video Field provide the transmission plan of multimedia data.
It should be noted that through the above description of the embodiments, those skilled in the art can be understood that It can be realized to some or all of the application by software and in conjunction with required general hardware platform.If the function is with soft The form of part functional unit realizes and when sold or used as an independent product, can also be stored in one it is computer-readable In storage medium.Based on this understanding, the application also provides a kind of computer readable storage medium, the storage medium storage There is at least one program, described program realizes any collecting method or data switch side above-mentioned when executed Method, for example realize method described in aforementioned corresponding diagram 8 or Fig. 9.
Based on this understanding, substantially the part that contributes to existing technology can in other words for the technical solution of the application To be expressed in the form of software products, which may include be stored thereon with machine-executable instruction one A or multiple machine readable medias, these instructions by computer, computer network or other electronic equipments etc. one or Multiple machines may make the one or more machine to execute operation according to an embodiment of the present application when executing.Such as data acquisition Each step etc. in method or data switch method.Machine readable media may include, but be not limited to, floppy disk, CD, CD-ROM (compact-disc-read-only memory), magneto-optic disk, ROM (read-only memory), RAM (random access memory), EPROM (erasable can Program read-only memory), EEPROM (electrically erasable programmable read-only memory), magnetic or optical card, flash memory or be suitable for storage machine Other kinds of medium/machine readable media of device executable instruction.
In addition, any connection can be properly termed as computer-readable medium.For example, if instruction is using coaxial electrical The wireless technology of cable, optical fiber cable, twisted pair, digital subscriber line (DSL) or such as infrared ray, radio and microwave etc, It is sent from website, server or other remote sources, then the coaxial cable, optical fiber cable, twisted pair, DSL or such as red The wireless technology of outside line, radio and microwave etc includes in the definition of the medium.It is to be understood, however, that calculating The read-write storage medium of machine and data storage medium do not include connection, carrier wave, signal or other fugitive mediums, and are intended to It is directed to non-transitory, tangible storage medium.The disk as used in application and CD include compact disk (CD), laser CD, CD, digital versatile disc (DVD), floppy disk and Blu-ray Disc, wherein disk usually magnetically replicate data, and light Disk is then with laser come optically replicate data.
It should be understood that magnitude of the sequence numbers of the above procedures are not meant to execute suitable in the various embodiments of the application Sequence it is successive, the execution of each process sequence should be determined by its function and internal logic, the implementation without coping with the embodiment of the present application Process constitutes any restriction.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, it can be with It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit It closes or communicates to connect, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.
The principles and effects of the application are only illustrated in above-described embodiment, not for limitation the application.It is any ripe Know the personage of this technology all can without prejudice to spirit herein and under the scope of, carry out modifications and changes to above-described embodiment.Cause This, those of ordinary skill in the art is complete without departing from spirit disclosed herein and institute under technical idea such as At all equivalent modifications or change, should be covered by claims hereof.

Claims (35)

1. a kind of data switching device is used for transmission multimedia data provided by data acquisition device, which is characterized in that Include:
Data receipt unit obtains clock signal, synchronically controlling information and multimedia from the data acquisition device Data；
Data processing unit is connected to the data receipt unit, described same for being based under the control of the clock signal The multimedia data are forwarded processing by step control information, to store or show the multimedia data.
2. data switching device according to claim 1, which is characterized in that the synchronically controlling information includes row field synchronization Signal；Accordingly, the data processing unit, will be described based on the row field sync signal under the control of the clock signal Picture frame in multimedia data is forwarded processing.
3. data switching device according to claim 1, which is characterized in that the synchronically controlling information includes control code, The data processing unit is based on type represented by the control code, by the number of corresponding types in the multimedia data It is handled according to being forwarded.
4. data switching device according to claim 1, which is characterized in that the data processing unit is also used to according to pre- If codec format the clock signal, synchronically controlling information and multimedia data are given into decoding process；And institute Under the control of decoded clock signal, based on decoded synchronically controlling information will at least decoded multimedia data into Row forward process.
5. data switching device according to claim 4, which is characterized in that the data processing unit is used for according to default Codec format the data packet comprising at least one of the clock signal, synchronically controlling information and multimedia data is given With decoding process.
6. any data switching device in -5 according to claim 1, which is characterized in that further include: playback interface unit, It is connected to the data processing unit, for the forward process according to the data processing unit, exports the multimedia Data, for playback terminal broadcasting.
7. data switching device according to claim 6, which is characterized in that the playback interface unit includes: at least one Road playback interface；
The data processing unit under the control of row field sync signal, divides acquired more matchmakers in the synchronically controlling information Picture frame in body played data, and branch is exported to every road playback interface.
8. data switching device according to claim 6, which is characterized in that further include external cache unit, be connected to institute State data processing unit；The data processing unit be based on the synchronically controlling information by the multimedia data store to The external cache unit；And cached institute is extracted from the external cache unit for the broadcasting frequency based on pre-configuration The picture frame in multimedia data is stated, and according to the row field sync signal of extracted picture frame, by extracted image Frame is exported to the playback interface unit.
9. data switching device according to claim 8, which is characterized in that the data processing unit is based on acquired Play instruction extracts corresponding multimedia data from the multimedia data cached, and according to extracted multimedia The synchronically controlling information of played data is exported corresponding multimedia data, to play corresponding multimedia number According to.
10. any data switching device in -5 according to claim 1, which is characterized in that further include: external cache unit And non-volatile memory cells；
The data processing unit is connected to the external cache unit and non-volatile memory cells；At the data Reason unit is also used to store the multimedia data to the external cache unit based on the synchronically controlling information, with And cached multimedia data are extracted from the external cache unit and are transferred in the non-volatile memory cells.
11. data switching device according to claim 10, which is characterized in that the non-volatile memory cells include to deposit Array is stored up, the storage array and the data processing unit are connected in parallel；The data processing unit is according to the storage battle array Column split multimedia data, and the multimedia data after segmentation are stored into the storage array.
12. data switching device according to claim 10, which is characterized in that further include power-off protection unit, be used for Power supply, and the multimedia number that will be cached in the external cache unit are provided when the data switching device abnormal power-down According to being transferred in non-volatile memory cells.
13. data switching device according to claim 10, which is characterized in that the data processing unit is based on acquired Play instruction corresponding multimedia data are extracted from the multimedia data stored, and according to extracted more matchmakers The synchronically controlling information of body played data is exported corresponding multimedia data, to show corresponding multimedia number According to.
14. data switching device according to claim 1, which is characterized in that the data receipt unit connects comprising optical fiber Mouthful.
15. data switching device according to claim 1, which is characterized in that the multimedia data include following At least one or more of combination: picture frame, audio data and status information relevant to the data acquisition device.
16. data switching device according to claim 1, which is characterized in that the synchronically controlling information include with down toward Few one or more combinations: row field sync signal, control code, audio-visual synchronization signal.
17. a kind of data acquisition device characterized by comprising
Acquiring unit, for obtaining multi-medium data；
Clock generating unit, for generating and exporting a clock signal；
Coding unit is connected with the acquiring unit, under the control of the clock signal, by acquired multimedia number According to being encoded into multimedia data and synchronically controlling information；
Data transmission unit is connected with the clock generating unit and acquiring unit, for sending the clock signal, with And send the multimedia data and synchronically controlling information that transmission is determined based on the clock signal.
18. data acquisition device according to claim 17, which is characterized in that the data transmission unit includes that optical fiber connects Mouthful.
19. data acquisition device according to claim 17, which is characterized in that wrapped in transmitted multimedia data Picture frame containing 8K.
20. data acquisition device according to claim 17, which is characterized in that the coding unit is also used to when will be described The multimedia data that are handled in clock signal, and the time cycle corresponding to the clock signal and synchronically controlling information into Row at least one coded treatment；
Accordingly, the clock signal, multimedia data after the data transmission unit is used to encode are controlled with synchronous Information processed is sent.
21. a kind of data transmission system, characterized by comprising:
Data acquisition device as described in any in claim 17-10, and the number as described in any in claim 1-16 According to switching device.
22. a kind of data switch method, it is used for transmission the multimedia data provided by the data acquisition device, feature It is, includes:
Obtain clock signal, synchronically controlling information and multimedia data from the data acquisition device；
Under the control of the clock signal, the multimedia data are forwarded by place based on the synchronically controlling information Reason, to store or show the multimedia data.
23. data switch method according to claim 22, which is characterized in that the synchronically controlling information includes that row field is same Walk signal；Accordingly, it is described under control of the clock signal, based on the synchronically controlling information will at least described multimedia Data be forwarded the step of processing include: under the control of the clock signal, will be described based on the row field sync signal Picture frame in multimedia data is forwarded processing.
24. data switch method according to claim 22, which is characterized in that the synchronically controlling information includes control Code, accordingly, it is described based on synchronically controlling information will at least described multimedia data be forwarded processing the step of include: Based on type represented by the control code, the data of corresponding types in the multimedia data are forwarded processing.
25. data switch method according to claim 22, which is characterized in that further include: according to preset codec format The step of clock signal, synchronically controlling information and multimedia data are given into decoding process；So as to decoded Under the control of clock signal, at least decoded multimedia data are forwarded based on decoded synchronically controlling information Processing.
26. data switch method according to claim 25, which is characterized in that it is described according to preset codec format by institute Stating the step of clock signal, synchronically controlling information and multimedia data give decoding process includes: according to preset decoding Format is decoded the data packet comprising at least one of the clock signal, synchronically controlling information and multimedia data Processing.
27. according to the data switch method any in claim 22-26, which is characterized in that described in clock signal Under control, based on the synchronically controlling information will at least described multimedia data be forwarded processing the step of include: by According to the synchronically controlling information, the multimedia data are exported to playback terminal.
28. according to the data switch method any in claim 22-26, which is characterized in that further include following at least one Kind:
By an external cache unit transfer, restore the synchronically controlling information of extracted multimedia data, and according to The synchronically controlling information restored exports acquired multimedia data to playback terminal；And
By an external cache unit transfer, restore the synchronically controlling information of extracted multimedia data, and according to The synchronically controlling information restored stores multimedia data into a non-volatile memory cells.
29. data switch method according to claim 28, which is characterized in that further include:
Corresponding multimedia data are extracted from the multimedia data stored based on acquired play instruction and are given With output, to play corresponding multimedia data.
30. data switch method according to claim 22, which is characterized in that the multimedia data include following At least one or more of combination: picture frame, audio data and status information relevant to the data acquisition device.
31. data switch method according to claim 22, which is characterized in that the synchronically controlling information include with down toward Few one or more combinations: row field sync signal, control code, audio-visual synchronization signal.
32. a kind of collecting method characterized by comprising
Based on a clock signal, acquired multimedia data encoding is believed at multimedia data and synchronously control Breath；
Send the clock signal, the multimedia data and synchronically controlling information.
33. collecting method according to claim 32, which is characterized in that further include: by the clock signal, and The multimedia data and synchronically controlling information handled in the time cycle corresponding to the clock signal carry out at least one Coded treatment；
Accordingly, the clock signal, multimedia data and the synchronically controlling information after coding are sent.
34. collecting method according to claim 24, which is characterized in that wrapped in transmitted multimedia data Picture frame containing 8K.
35. a kind of computer readable storage medium, which is characterized in that be stored with an at least program；An at least program is in quilt The data switch method as described in any in claim 22-31 is executed when calling；Alternatively, an at least program is called Collecting method of the Shi Zhihang as described in any in claim 32-34.
CN201880002425.2A 2018-11-02 2018-11-21 Data switching device, data acquisition device, system and method Active CN109644290B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201811303551 2018-11-02
CN201811303551X 2018-11-02
PCT/CN2018/116626 WO2020087590A1 (en) 2018-11-02 2018-11-21 Data transfer device, data acquisition device, system, and method

Publications (2)

Publication Number Publication Date
CN109644290A true CN109644290A (en) 2019-04-16
CN109644290B CN109644290B (en) 2022-03-08

Family

ID=66060074

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880002425.2A Active CN109644290B (en) 2018-11-02 2018-11-21 Data switching device, data acquisition device, system and method

Country Status (1)

Country Link
CN (1) CN109644290B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110636219A (en) * 2019-09-03 2019-12-31 北京三快在线科技有限公司 Video data stream transmission method and device
WO2021109827A1 (en) * 2019-12-03 2021-06-10 深圳市沃特沃德股份有限公司 Method and apparatus for outputting multi-channel image data, and computer device
CN113271476A (en) * 2021-05-12 2021-08-17 湖南泽天智航电子技术有限公司 Synchronization method, device, apparatus and system for improving video data stream frame

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006191160A (en) * 2004-12-28 2006-07-20 Sony Corp Optical transmission system
CN202282830U (en) * 2011-10-27 2012-06-20 上海德致伦电子科技有限公司 Image processing chip and video monitoring system
CN103686093A (en) * 2013-12-29 2014-03-26 广州视声电子科技有限公司 Video door bell
CN204559747U (en) * 2015-04-07 2015-08-12 华南理工大学 A kind of high definition LED display video data R-T unit
CN205029787U (en) * 2015-10-10 2016-02-10 杭州海康威视数字技术股份有限公司 Monitoring system
CN107277295A (en) * 2017-06-22 2017-10-20 北京数码视讯科技股份有限公司 Audio video synchronization processing unit and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006191160A (en) * 2004-12-28 2006-07-20 Sony Corp Optical transmission system
CN202282830U (en) * 2011-10-27 2012-06-20 上海德致伦电子科技有限公司 Image processing chip and video monitoring system
CN103686093A (en) * 2013-12-29 2014-03-26 广州视声电子科技有限公司 Video door bell
CN204559747U (en) * 2015-04-07 2015-08-12 华南理工大学 A kind of high definition LED display video data R-T unit
CN205029787U (en) * 2015-10-10 2016-02-10 杭州海康威视数字技术股份有限公司 Monitoring system
CN107277295A (en) * 2017-06-22 2017-10-20 北京数码视讯科技股份有限公司 Audio video synchronization processing unit and method

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110636219A (en) * 2019-09-03 2019-12-31 北京三快在线科技有限公司 Video data stream transmission method and device
CN110636219B (en) * 2019-09-03 2020-12-01 北京三快在线科技有限公司 Video data stream transmission method and device
WO2021109827A1 (en) * 2019-12-03 2021-06-10 深圳市沃特沃德股份有限公司 Method and apparatus for outputting multi-channel image data, and computer device
CN113271476A (en) * 2021-05-12 2021-08-17 湖南泽天智航电子技术有限公司 Synchronization method, device, apparatus and system for improving video data stream frame

Also Published As

Publication number Publication date
CN109644290B (en) 2022-03-08

Similar Documents

Publication Publication Date Title
CN103650515B (en) wireless 3D streaming server
CN105744382B (en) Method and apparatus for emitting encoded video data
CN109644290A (en) Data switching device, data acquisition device and system, method
CN103220543B (en) Real time three dimensional (3D) video communication system and implement method thereof based on Kinect
CN108924600A (en) Sending and receiving methods, device and the electronic equipment of live data
CN102802039B (en) Multi-channel video hybrid decoding output method and device
CN107005729A (en) The coffret transmitted for multimedia and file
CN106603889A (en) Ultra high-definition VR solid-state delayer based on FPGA chip
CN112866753A (en) Broadcast signal transmitting apparatus and method, and broadcast signal receiving apparatus and method
CN112954433B (en) Video processing method, device, electronic equipment and storage medium
WO2014144641A1 (en) System and method for replicating a media stream
KR20130099723A (en) Input-output system for eding and playing of uhd image contents
CN1534503A (en) Method of realizing real time image sound talks in network game, system and storage medium thereof
US9584755B2 (en) Endoscope with high definition video recorder/player
CN206472189U (en) A kind of ultra high-definition VR solid time delayers based on fpga chip module
CN109040818A (en) Audio and video synchronization method, storage medium, electronic equipment and system when live streaming
CN1098600C (en) Transport processor interface for a digital television system
US20230025664A1 (en) Data processing method and apparatus for immersive media, and computer-readable storage medium
US20070058684A1 (en) Transparent methods for altering the video decoder frame-rate in a fixed-frame-rate audio-video multiplex structure
CN105657448B (en) A kind of retransmission method, the apparatus and system of encoded video stream
CN112565799B (en) Video data processing method and device
CN102802002B (en) Method for mobile phone to play back 3-dimensional television videos
CN105187688A (en) Method and system for carrying out synchronization on real-time video and audio collected by mobile phone
CN109104635A (en) The method and system of instant delivery screen picture
WO2020087590A1 (en) Data transfer device, data acquisition device, system, and method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant