CN104284098B - The processing method and system of video data - Google Patents
The processing method and system of video data Download PDFInfo
- Publication number
- CN104284098B CN104284098B CN201310276055.0A CN201310276055A CN104284098B CN 104284098 B CN104284098 B CN 104284098B CN 201310276055 A CN201310276055 A CN 201310276055A CN 104284098 B CN104284098 B CN 104284098B
- Authority
- CN
- China
- Prior art keywords
- markers
- video
- processor
- calibration
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The invention discloses a kind of processing method of video data and system, and in the above-mentioned methods, video processor receives the video data stream for coming from one or more input equipments；Video processor carries out partition encoding processing according to the one or more video-stream processors being connected with the video processor to video data stream, and mark is encapsulated into each packet after partition encoding is handled high-ranking officers on time, calibration markers is used to make one or more video-stream processors include each packet synchronisation after partition encoding is handled in television splicing wall, the calibration markers is when video processor carries out partition encoding processing to video data stream, is obtained after being calibrated according to the current time index of server；Video processor sends the packet after partition encoding is handled to one or more video-stream processors.Which thereby enhance cutting screen block number of the distributed giant-screen control system on television splicing wall it is more in the case of, the degree of accuracy of simultaneous display, lifted Consumer's Experience.
Description
Technical field
The present invention relates to field of video displaying, in particular to the processing method and system of a kind of video data.
Background technology
At present, centralized giant-screen control system refers to carry out the defeated of vision signal and/or audio signal by video line
Enter and export, vision signal and/or audio signal pass through Peripheral Component Interconnect standard in internal system（Peripheral
Component Interconnect, referred to as PCI）Or the large-size screen monitors curtain controller that simulation switching is transmitted, it is current city
The main flow of screen control technology on field.
However, following defect be present using the control of centralized giant-screen：
（1）Centralized giant-screen control system generally needs to be adopted using capture card access signal, signal access capability
The restriction of the factors such as truck ability, cabinet slot number, bus bandwidth, its signal access capability are limited.
（2）Centralized giant-screen control system utilizes central processing unit（Central Processing Unit, referred to as
CPU）Total data is handled, using PCI/PCI-X bus transfer datas, its processing speed is limited by CPU speed and bus bar
It is wide.It can not ensure the real-time of every road signal as process signal increases.
（3）Centralized giant-screen control system is transmitted using dummycable or multiple analog-digital conversion mode,
Its signal easily incurs loss or disturbed, therefore image quality is poor.
（4）Centralized giant-screen control system is using cable point-to-point connection signal source with controller, it is necessary to according to user
Need controller of automatic measurement, matrix and cable laying.It is difficult in adapt to if the quantity of access signal changes, therefore, this is
The scalability of system is poor.
（5）All signals of centralized giant-screen control system focus on by controller, once event occurs for controller
Hinder or the machine of delaying will cause whole large-size screen monitors curtain wall not show normally.
Therefore, in order to solve drawbacks described above existing for centralized giant-screen control system, distribution is proposed in correlation technique
The solution of formula giant-screen control system.Distributed giant-screen control system refers to that vision signal passes through coded treatment（Such as：
H.264）Sent via network to display terminal, long range video can not be used so as to solve centralized giant-screen control system
The problem of line, while the scale of television splicing wall can also be improved by arbitrarily increasing module.Because vision signal passes through net
Network is transmitted, and therefore, each network node can be separately positioned on different regions, and its scale can with unlimited expand,
Efficiently solve centralized giant-screen control system defect present in screen control.
Fig. 1 is the configuration diagram according to the distributed giant-screen control system of correlation technique.As shown in figure 1, the distribution
Formula giant-screen control system mainly includes following three parts：
（1）Front end input equipment, such as：Computer input source, analog video camera, web camera（IP CAMERA, letter
Referred to as IPC）, digital video recorder（Digital Video Recorder, referred to as DVR）, it is main to be responsible for providing giant-screen
The original image of splicing；
（2）Embedded device, such as：Bayonet nut connector（Bayonet Nut Connector, referred to as BNC）Depending on
Frequency processor, three primary colors（RGB）Video processor, code stream processor and video-stream processor, the main cutting coding for completing image
With display；
（3）Server program, it is mainly used in managing and controls front end input and embedded device to perform corresponding operation.
Communicated between modules by network, user carries out the splicing of image using distributed AC servo system client
And display.Because front end input, embedded device and the server of distributed giant-screen control system are all scattered placements, and
Non-integration in a total system, all the way image after cutting encodes by network destined to different video-stream processors,
The process that each cutting cube carries out decoding display on video-stream processor can regard orthogonal as, so how to realize
Simultaneous display just becomes distributed giant-screen control system technical barrier urgently to be resolved hurrily.
The method of existing distributed giant-screen control system generally use is in 99% in the code stream for first finishing cutting
Be transmitted, then above-mentioned 99% code stream will send totally after again by residue 1% code stream be transmitted.Due to last 1%
Code stream in the data volume that includes it is very small, display immediately is i.e. achievable after each display end receives the data sent to the end
It is synchronous.However, simultaneous display is easily achieved in the case that cutting block number of the above-mentioned technical proposal in distributed giant-screen is less,
But after cutting block number increases, such as：Cutting block number in distributed giant-screen is 64 pieces, and the performance of its simultaneous display will
It is severely impacted.Because each frame of 64 road images also needs to wait remaining to split block after 99% data have been sent
Need could to send the data of residue 1% after 99% data are sent, thus not only influence distributed giant-screen control system
The performance of system, and delay also can more increase.Therefore, distributed giant-screen control system can by equipment performance, use ring
Many influences such as border and network condition.
The content of the invention
The invention provides a kind of processing method of video data and system, at least to solve the distribution in correlation technique
Giant-screen control system is when the cutting screen block number on television splicing wall is more, the problem of effect of simultaneous display is poor.
A kind of according to an aspect of the invention, there is provided processing method of video data.
Included according to the processing method of the video data of the present invention：Video processor, which receives, comes from one or more inputs
The video data stream of equipment；Video processor is according to the one or more video-stream processors being connected with the video processor to video
Data flow carries out partition encoding processing, and mark is encapsulated into each packet after partition encoding is handled high-ranking officers on time, its
In, calibration markers is used to make one or more video-stream processors show each packet synchronisation after partition encoding is handled
On television splicing wall, the calibration markers is when video processor carries out partition encoding processing to video data stream, according to clothes
What the current time index of business device obtained after being calibrated；Video processor sends the packet after partition encoding is handled to one
Individual or multiple video-stream processors.
Preferably, video processor carries out calibration according to the current time index of server includes：Video processor is every default
Computation of Period itself markers and the markers offset of server current time index；Video processor is calibrated according to markers offset
Processing, obtain calibration markers.
Preferably, video processor calculates itself markers and the markers offset of server current time index and included：At video
When managing the first processor in device to server transmission calibration request message, and first recorded when sending calibration request message
Mark；Server, which records the second markers when receiving calibration request message and then sends adjustments responsive to first processor, to disappear
Breath, wherein, the information carried in adjustments responsive message includes：Second markers and server record when sending adjustments responsive message
Under the 3rd markers；First processor records the 4th markers when receiving adjustments responsive message；First processor is according to
One markers, the second markers, the 3rd markers and the 4th markers calculate markers offset.
Preferably, video processor carries out calibration process according to markers offset, and obtaining calibration markers includes：First processing
Device adjusts itself markers according to markers offset；Second processor in video processor receives the tune for coming from first processor
Itself markers after whole and target propagation delay time when calculating itself after first processor transmission adjustment；Second processor is using tune
Itself markers and propagation delay time after whole calculate calibration markers.
Preferably, second processor carries out markers calibration every preset duration and server.
Preferably, the packet after partition encoding is handled is sent to one or more displays in video processor
After managing device, in addition to：Each video-stream processor receives warp via the port of video processor corresponding with the video-stream processor
Packet after over-segmentation coded treatment；Each video-stream processor carries out decoding process to the packet received, and parses
Calibrate markers；Each video-stream processor determines the markers of video data of the output Jing Guo decoding process according to calibration markers.
According to another aspect of the present invention, there is provided a kind of processing system of video data.
Included according to the processing system of the video data of the present invention：Video processor；Video processor includes：First receives
Module, the video data stream of one or more input equipments is come from for receiving；Processing module, for according to at the video
The one or more video-stream processors for managing device connection carry out partition encoding processing to video data stream, and mark is encapsulated into high-ranking officers on time
In each packet after partition encoding is handled, wherein, calibration markers is used to make one or more video-stream processors will be through
Each packet synchronisation after over-segmentation coded treatment is shown on television splicing wall, and the calibration markers is in video processor pair
When video data stream carries out partition encoding processing, obtained after being calibrated according to the current time index of server；Sending module, use
Sent in by the packet after partition encoding is handled to one or more video-stream processors.
Preferably, processing module includes：First processing units；First processing units include：Transmission sub-unit, for clothes
Business device sends calibration request message, and records the first markers when sending calibration request message；First receiving subelement, is used for
The adjustments responsive message for coming from server is received, wherein, the information carried in adjustments responsive message includes：Server is receiving
The 3rd markers that the second markers and server recorded during to calibration request message are recorded when sending adjustments responsive message；
First computation subunit, for according to recorded when receiving adjustments responsive message the 4th markers, the first markers, second when
Mark and the 3rd markers calculate markers offset.
Preferably, first processing units also include：Subelement is adjusted, for adjusting itself markers according to markers offset；
Processing module also includes：Second processing unit；Second processing unit includes：Second receiving subelement, come from for receiving
Itself markers after the adjustment of one processing unit；Second computation subunit, after calculating first processing units transmission adjustment
Itself when target propagation delay time；3rd computation subunit, for calculating calibration using itself markers after adjusting and propagation delay time
Markers.
Preferably, said system also includes：One or more video-stream processors；Each video-stream processor includes：Second
Receiving module, for being received via the port of video processor corresponding with the video-stream processor after partition encoding is handled
Packet；Decoder module, for carrying out decoding process to the packet received, and parse calibration markers；Determining module, use
In the markers that video data of the output Jing Guo decoding process is determined according to calibration markers.
By the present invention, the video data stream for coming from one or more input equipments is received using video processor；Depending on
Frequency processor carries out partition encoding according to the one or more video-stream processors being connected with the video processor to video data stream
Processing, and mark is encapsulated into each packet after partition encoding is handled high-ranking officers on time, the calibration markers is used to make one
Or multiple video-stream processors include each packet synchronisation after partition encoding is handled on television splicing wall, the calibration
Markers is when video processor carries out partition encoding processing to video data stream, is calibrated according to the current time index of server
Obtain afterwards；Video processor sends the packet after partition encoding is handled to one or more video-stream processors, solution
Distributed giant-screen control system in correlation technique of having determined is synchronous aobvious when the cutting screen block number on television splicing wall is more
The problem of effect shown is poor, and then improve cutting screen block number of the distributed giant-screen control system on television splicing wall
In the case of more, the degree of accuracy of simultaneous display, Consumer's Experience is lifted.
Brief description of the drawings
Accompanying drawing described herein is used for providing a further understanding of the present invention, forms the part of the application, this hair
Bright schematic description and description is used to explain the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings：
Fig. 1 is the configuration diagram according to the distributed giant-screen control system of correlation technique；
Fig. 2 is the flow chart of the processing method of video data according to embodiments of the present invention；
Fig. 3 is the server according to the preferred embodiment of the invention interaction schematic diagram synchronous with individual equipment markers；
Fig. 4 is the schematic diagram of video image split screen simultaneous display according to the preferred embodiment of the invention；
Fig. 5 is the signal that video-stream processor according to the preferred embodiment of the invention carries out video image decoding output procedure
Figure；
Fig. 6 is the structured flowchart of the processing system of video data according to embodiments of the present invention；
Fig. 7 is the structured flowchart of the processing system of video data according to the preferred embodiment of the invention.
Embodiment
Describe the present invention in detail below with reference to accompanying drawing and in conjunction with the embodiments.It should be noted that do not conflicting
In the case of, the feature in embodiment and embodiment in the application can be mutually combined.
In the following description, except as otherwise noted, otherwise by with reference to the action and behaviour performed by one or more computers
The symbol of work is represented to describe present embodiments.Wherein, computer includes personal computer, server, mobile terminal
Etc. various products, use CPU, single-chip microcomputer, DSP etc. that there is the equipment of process chip to be properly termed as computer.Thus, it is possible to
Understand, this kind of action and operation that sometimes referred to as computer performs include the processing unit of computer to structured form table
The manipulation of the electric signal of registration evidence.Safeguarded on this manipulation transforms data or position in the accumulator system of computer
It, this reconfigures or changed the operation of computer in a manner of those skilled in the art understands.Safeguard the data of data
Structure is the physical location of the memory with particular community defined in the form of data.However, although in above-mentioned context
Described in the present invention, but its being not intended to limit property, as understood by those skilled in the art, described below is dynamic
Make and each side of operation can also be realized with hardware.
Accompanying drawing is turned to, wherein identical reference number refers to identical element, and the principle of the application is illustrated as in a conjunction
Realized in suitable computing environment.Describe based on described embodiments herein, and be not considered as on herein not below
The alternative embodiment that is expressly recited and limit the application.
Following examples may apply in computer, such as：It is applied in PC.It can also be applied to and employ intelligence at present
In mobile terminal in energy operating system, and it is not limited to this.Do not have for the operating system of computer or mobile terminal
Particular/special requirement, if contact can be detected, determine whether the contact is consistent with pre-defined rule, and the attribute according to the contact
Realize corresponding function.
Fig. 2 is the flow chart of the processing method of video data according to embodiments of the present invention.As shown in Fig. 2 this method can
With including following processing step：
Step S202：Video processor receives the video data stream for coming from one or more input equipments；
Step S204：Video processor is according to the one or more video-stream processors being connected with the video processor to video
Data flow carries out partition encoding processing, and mark is encapsulated into each packet after partition encoding is handled high-ranking officers on time, its
In, calibration markers is used to make one or more video-stream processors show each packet synchronisation after partition encoding is handled
On television splicing wall, the calibration markers is when video processor carries out partition encoding processing to video data stream, according to clothes
What the current time index of business device obtained after being calibrated；
Step S206：Video processor sends the packet after partition encoding is handled to one or more displays
Manage device.
In correlation technique, using distributed giant-screen control system every road signal can be caused to add by independent processor
With processing, a large amount of computings of whole system are dispersed in each processor；Led to simultaneously using network as the exchange that signal transmits
Road, each processor are merely responsible for signal all the way, and some processor fault does not interfere with the normal work of other processors；Additionally
Access and the display output of any multiple signals can be supported, whole signals utilize network transmission, exchange and connection, all accesses
The signal source of the network can show that system architecture is flexible on combination, and scalability is strong.However, in correlation technique
For distributed giant-screen control system when the cutting screen block number on television splicing wall is more, the effect of simultaneous display is poor, adopts
With method as shown in Figure 2, video processor receives the video data stream for coming from one or more input equipments；Video processing
Device carries out partition encoding processing according to the one or more video-stream processors being connected with the video processor to video data stream, and
Mark is encapsulated into each packet after partition encoding is handled high-ranking officers on time, and the calibration markers is used to make one or more show
Show processor by each packet synchronisation after partition encoding is handled include on television splicing wall, the calibration markers be
When video processor carries out partition encoding processing to video data stream, obtained after being calibrated according to the current time index of server
's；Video processor sends the packet after partition encoding is handled to one or more video-stream processors, solves phase
Distributed giant-screen control system in the technology of pass is when the cutting screen block number on television splicing wall is more, the effect of simultaneous display
The problem of fruit is poor, and then it is more to improve cutting screen block number of the distributed giant-screen control system on television splicing wall
In the case of, the degree of accuracy of simultaneous display, lift Consumer's Experience.
The processing method of the video data provided using the present embodiment, each video processor in system is in distribution
Under the unified command scheduling for controlling client, following major function can be completed（Following partial function is some sides of being preferable to carry out
What formula had）：IP based network flexibly exchanges connection, supports random scale combination display control, breaks through viewing area boundary,
Polytype window video signal can be in full frame scope arbitrarily across screen, roaming, scaling, superposition；It can be handed over according to network
The scale access different types of video signal source of multichannel is changed, supports the display control of random scale large screen television combination；
In any cell screen can real-time activity form, all forms can arbitrarily be superimposed；Support signal multicast functionality, same signal source
It can be simultaneously displayed on any number of display unit screens, and all forms are all real-time, synchronous；Can be by reality per road signal
When monitor, support all windowed signals to be echoed on control software interface；Intuitively graphic user interface, support telecommunication network control
System, giant-screen partition management is supported, support more people while giant-screen is controlled, dispatch and managed, support multiple management power
Limit division；All processor softwares can be updated by network, can easily carry out the upgrading of performance and function, be not required to pair
Expanded application carries out secondary development, reduces system extension expense；Distributed computing architecture, fault-tolerant ability is strong, and performance is highly reliable,
Any processor failure only influences the road signal or unit screen is shown, and has no effect on the normal work of other processors, changes
Processor does not interfere with network normal operation yet, can neatly by certain, signal is switched to other passages and shown all the way, favorably
In the emergent display of whole large screen system.
In a preferred embodiment, a television splicing wall can be divided into more sub- combinations, and to splice per height
Video-stream processor corresponding to wall setting, the number for the unit screen that every sub- combination is included should be no more than single video-stream processor
The quantity for the largest unit screen that can be handled.After video-stream processor corresponding to being set respectively for every sub- combination, per height
The video and/or audio data of combination corresponding part picture in whole television splicing wall are shown as corresponding to the sub- combination
Processor is responsible for processing.As a kind of preferred embodiment of the present invention, in order to maximally utilise each video-stream processor
Data-handling capacity, the quantity for the largest unit screen that can be handled according to each video-stream processor, can preset and show
Show the one-to-one multiple sub- combinations of acquiescence of processor, the split screen combination then included according to television splicing wall and silent
Recognize the split screen combination that sub- combination is included, television splicing wall is divided into several combinations for giving tacit consent to sub- combination.Often
The maximum split screen number of individual video-stream processor processing is determined by the data-handling capacity of its own, at the data of single video-stream processor
Reason ability is stronger, and the quantity of its largest unit screen handled is more, i.e., the unit screen that sub- combination of acquiescence is included corresponding to it
Quantity it is more.As can be seen here, acquiescence son splicing is divided according to the quantity of the maximum processing unit screen of each video-stream processor
Wall, complete television splicing wall then is combined into using giving tacit consent to sub- combination, it is possible to make full use of each video-stream processor
Maximum data disposal ability, reduce the waste of processor resource.
Preferably, above-mentioned video processor carries out calibration according to the current time index of server can include following operation：
Step S1：Video processor calculates itself markers every predetermined period and the markers of server current time index is offset
Amount；
Step S2：Video processor carries out calibration process according to markers offset, obtains calibration markers.
In a preferred embodiment, a time calibration clothes can be opened on the server of distributed giant-screen control system
Business program, the current markers of the equipment is calibrated to synchronous with the markers of server by each distributed apparatus by network.
It should be noted that although distributed giant-screen control system mainly includes front end input equipment, embedded set
Standby and server, still, the stationary problem between individual equipment and server can be decomposed on simultaneous display problem.
Realizing that display is synchronous only needs the markers of all devices being calibrated to and the personal computer where server
（Personal computer, referred to as PC）Markers be consistent.And only it is required on the PC where server
There is provided the timer of enough accuracy can meet to require, therefore, as a preferred embodiment of the present invention, can use
Windows QueryPerformanceFrequency/QueryPerformanceCounter group of functions is fully able to meet
The other clocking requirement of Millisecond.By using technical scheme provided by the present invention, it is advantageous that giant-screen system need not be considered
The specific scale of system, and when only needing to pay close attention to the school of individual equipment whether school with server when it is synchronous.
Preferably, in step sl, video processor calculates the markers offset of itself markers and server current time index
It may comprise steps of：
Step S11：First processor in video processor sends calibration request message to server, and is calibrated sending
The first markers is recorded during request message；
Step S12：Server records the second markers when receiving calibration request message, is then sent out to first processor
Adjustments responsive message is sent, wherein, the information that the adjustments responsive message carries includes：Second markers and server are sending calibration sound
Answer the 3rd markers recorded during message；
Step S13：The 4th markers that first processor is recorded when receiving adjustments responsive message,
Step S14：First processor is inclined according to the first markers, the second markers, the 3rd markers and the 4th markers calculating markers
Shifting amount.
In a preferred embodiment, each video processor in system can use dual core processor, arm processor
（Equivalent to the first processor mentioned in the present embodiment）Stable performance, it is powerful.Digital signal processor（Digital
Signal Processor, referred to as DSP）（Equivalent to the second processor mentioned in example below）It is a kind of data signal
Process chip, it is that its processing speed is exceedingly fast the characteristics of Digital Signal Processing.Primary processor is being done using ARM and used
DSP is done under the Duo-Core Architecture of coprocessor, can build the system that one highly stable and processing speed is exceedingly fast.
In a preferred embodiment, the markers offset between the markers of server and the markers of individual equipment can be determined.
In order to improve accuracy, individual equipment needs to measure the propagation delay between server and individual equipment, with calculating and server
Between markers offset.
Fig. 3 is the server according to the preferred embodiment of the invention interaction schematic diagram synchronous with individual equipment markers.
As shown in figure 3, the interaction is as follows：
At the T1 moment, arm processor sends UDP message bag to server, wherein, carry itself in the UDP message bag
Current markers T1；
At the T2 moment, server receives above-mentioned UDP message bag and the markers T2 of received data packet this moment is recorded；
At the T3 moment, server is by the markers T2 of self record, the markers T3 of transmission UDP message bag and in ARM transmissions
UDP message bag in the markers T1 that carries feed back to arm processor；
At the T4 moment, the markers T4 of arm processor record now, and according to markers T1, T2, T3 and T4 of server feedback
Current server markers T5 can be calculated；
In the preferred embodiment, it is assumed that the markers deviation between individual equipment and server is X, individual equipment and service
The network transfer delay of one way is Y between device, is therefore deduced that：
T2=（T1+X）+ Y ... formula 1
T4=（T3-X）+ Y ... formula 2
As can be seen here, X, Y value are only related with T3 difference to T1 difference and T4 to T2, and with T3 and T2 difference
Be worth it is unrelated, i.e., markers deviation X between individual equipment and server and the time required for server process UDP message bag without
Close.Accordingly, individual equipment can calculate markers deviation X by above-mentioned markers T1, T2, T3 and T4, to adjust local markers.
Therefore, can be drawn according to above-mentioned formula 1 and formula 2：
X=[（T2-T1）-（T4-T3）]/2, i.e., above-mentioned markers offset.
During being preferable to carry out, first processor sends UDP packet to server, wherein, the use
Calibration request message is carried in user data datagram protocol packet.
In a preferred embodiment, in order to reduce network delay, so during at whole school, User Datagram Protocol is used
View（User Datagram Protocol, referred to as UDP）Packet, rather than use transmission control protocol（Transmission
Control Protocol, referred to as TCP）Packet is realized.Server needs to service line during the school of one udp port of unlatching
Journey realizes all synchronizing processes.
Preferably, in step s 2, video processor carries out calibration process according to markers offset, and obtaining calibration markers can
With including following processing step：
Step S21：First processor adjusts itself markers according to markers offset；
Step S22：When second processor in video processor receives itself after coming from the adjustment of first processor
Target propagation delay time when marking and calculating itself after first processor transmission adjusts；
Step S23：Second processor calculates calibration markers using itself markers after adjustment and propagation delay time.
In a preferred embodiment, as shown in figure 3, according to the markers offset X calculated, local markers can be entered
Row calibration, and then ask for markers T5, i.e. T5=T4+X=[（T2-T1）+（T4+T3）]/2；Finally will in T5 moment, arm processor
The server markers T5 being calculated is sent to DSP, and the delay that increase sends order in addition is when can obtain accurate server
Mark T6.
It should be noted that above-mentioned markers T1-T6 is accurate to millisecond.
During being preferable to carry out, above-mentioned second processor carries out markers calibration every preset duration and server.
State in realization in synchronizing process and can also be noted that at following 2 points：
It is the burden for reducing server when opening school using server the reason for service mode, i.e., using one or more
Input equipment actively initiates markers calibration request to server, is sent without server active poll to each input equipment
Markers calibration request, so as to reduce the burden of server；
Because the clock module where the clock module inside DSP and server on PC has error, therefore, every pre-
If duration, equipment just need again with server time-revise once, such as：Every 5 minutes equipment just need again with server school
Shi Yici.
Preferably, in step S206, video processor the packet after partition encoding is handled is sent to one or
After multiple video-stream processors, following operation can also be included：
Step S3：Each video-stream processor receives via the port of video processor corresponding with the video-stream processor to be passed through
Packet after partition encoding processing；
Step S4：Each video-stream processor carries out decoding process to the packet received, and parses calibration markers；
Step S5：Each video-stream processor according to calibration markers determine video data of the output Jing Guo decoding process when
Mark.
In a preferred embodiment, video processor can include but is not limited at least one of：At RGB processors, BNC
Manage device, code stream processor.Span mode is indicating that the viewing area by display module is divided at least two split screens, split screen mould
Formula can specifically include left and right 2 panes, upper and lower 2 panes, 3 panes, four split screens, six split screens and eight split screens etc., can be according to aobvious
Show that needs pre-set the span mode for being available for user to select.It is determined that video flowing corresponding to each split screen, corresponding to each split screen
Video source is identical, i.e., the video flowing is all collected in real time by camera module.
Fig. 4 is the schematic diagram of video image split screen simultaneous display according to the preferred embodiment of the invention.As shown in figure 4, regard
Piece image can be cut into polylith by frequency processor（Such as：4 pieces）, that is, segmentation figure is formed as P1, segmentation figure are as P2, segmentation figure
Picture P3 and segmentation figure are sent to video-stream processor 1, video-stream processor 2, video-stream processor 3 and video-stream processor 4 respectively as P4.
If realizing the simultaneous display of segmentation figure picture, the markers of equipment that will all be registered on server and server are needed
Markers is consistent；Moreover, video processor needs that the markers increase finished will be calibrated when carrying out coded treatment cutting image
To the private information of code stream；In addition, one section of addition is prolonged after video-stream processor can also extract markers from private information
When output image again.
Video processor can include：N number of output port, the video processor can be by partitioning video datas into behind N roads
Being exported, its N number of output port is connected with N number of video-stream processor, wherein, one display of corresponding connection of an output port
Device；And N number of video-stream processor is connected with N number of output port of video processor respectively, wherein, a display is corresponding to be connected
One output port of video processor.Above-mentioned N number of video-stream processor according to split screen number M set in advance on television splicing wall,
Video data is displayed in full screen, wherein, when N is the positive integer more than or equal to 2, M value is identical with N；And work as N
When value is 1, M value is the positive integer more than or equal to 2.
Using the resolution ratio of inputted video image as 1024 × 768, exemplified by television splicing wall is according to 2 × 2 splicings, unit
The signal pixels point difference of screen segmentation is as follows：Upper left corner unit screen, transverse axis segmentation valid pixel point range is the picture of 0 pixel -512
Element, longitudinal axis segmentation valid pixel point range is the pixel of 0 pixel -384；Upper right corner unit screen, transverse axis segmentation valid pixel point range
For the pixel of 513 pixel -1024, longitudinal axis segmentation valid pixel point range is the pixel of 0 pixel -384；Lower left corner unit screen, transverse axis point
It is the pixel of 0 pixel -512 to cut valid pixel point range, and longitudinal axis segmentation valid pixel point range is the pixel of 385 pixel -768；Bottom right
Angle unit screen, transverse axis segmentation valid pixel point range are the pixel of 513 pixel -1024, and longitudinal axis segmentation valid pixel point range is 385
The pixel of pixel -768.
And for the signal of non-integer ratio segmentation, preferentially a pixel signal can be taken to be split, with this more
Ensure that artwork effective pixel points will not lose, using the resolution ratio of inputted video image as 1024 × 768, television splicing wall is according to 3
Exemplified by × 3 splicings, the signal pixels point difference of unit screen segmentation is as follows：Upper left side unit screen, transverse axis segmentation valid pixel
Point range is the pixel of 0 pixel -342, and longitudinal axis segmentation valid pixel point range is the pixel of 0 pixel -256；Surface unit screen, transverse axis
Segmentation valid pixel point range is the pixel of 341 pixel -683, and longitudinal axis segmentation valid pixel point range is the pixel of 0 pixel -256；It is right
Upper unit screen, transverse axis segmentation valid pixel point range are the pixel of 682 pixel -1024, and longitudinal axis segmentation valid pixel point range is 0
The pixel of pixel -256；Front-left unit screen, transverse axis segmentation valid pixel point range are the pixel of 0 pixel -342, and longitudinal axis segmentation is effective
Pixel point range is the pixel of 257 pixel -512；Centre unit screen, transverse axis segmentation valid pixel point range is 341 pixels -683
Pixel, longitudinal axis segmentation valid pixel point range is the pixel of 257 pixel -512；Front-right unit screen, transverse axis segmentation effective pixel points
Scope is the pixel of 682 pixel -1024, and longitudinal axis segmentation valid pixel point range is the pixel of 257 pixel -512；Lower left unit screen,
Transverse axis segmentation valid pixel point range is the pixel of 0 pixel -342, and longitudinal axis segmentation valid pixel point range is the picture of 513 pixel -768
Element；Underface unit screen, transverse axis segmentation valid pixel point range is the pixel of 341 pixel -683, and the longitudinal axis splits effective pixel points model
Enclose for the pixel of 513 pixel -768；Lower right unit screen, transverse axis segmentation valid pixel point range is the pixel of 682 pixel -1024, is indulged
Axle segmentation valid pixel point range is the pixel of 513 pixel -768.
As another preferred embodiment of the present invention, Fig. 5 is that video-stream processor according to the preferred embodiment of the invention enters
The schematic diagram of row video image decoding output procedure.As shown in figure 5, after DSP gets accurate server markers, you can
The amendment markers got is managed using the timing module of itself.
T1：The server markers of the amendment got can be encapsulated into UDP message when video processor cuts and encoded
In the privately owned field of bag；
△T：Time delay set in advance, when setting the period, therefore, to assure that code stream can be shown processor
It is complete to receive and accurately decode；
T2：Video-stream processor is parsed to obtain standard of the code stream at the coding moment to the UDP message bag encapsulated in code stream
True markers, the markers of accurate output image is obtained after then being calculated with △ T.
Because same image after cutting when being encoded, the markers at present encoding moment is all carried, therefore,
Shown even if different video-stream processors carries out decoding, the markers of obtained same two field picture is all duplicate, as long as energy
Enough ensure to be consistent to server during all devices school, then extraordinary simultaneous display effect will be obtained.
In addition, another preferred embodiment as the present invention, in the system in addition to setting video processor, may be used also
To increase audio process, among multimedia data stream, such as：High-resolution multimedia（HDMI）Signal, video image
Array（VGA）Signal, voice data is decoded, such as：Sound processing, audio enhanced processing, so as to obtain required audio number
According to；Loudspeaker, it is connected with audio process, the voice data for decoding to obtain through audio process for broadcasting.
During being preferable to carry out, the punctual mark of above-mentioned video processor high-ranking officers is encapsulated into every after partition encoding is handled
Private data field in individual packet.
Under normal circumstances, MPEG2DSMCC field formats storage private data can be used, you can with using private data
Table.Such as：The field that DSMCC stream type are 0x0D can be arranged to DSMCC SECTIONS, wherein it is possible to wrap
Include polytype private data.
Fig. 6 is the structured flowchart of the processing system of video data according to embodiments of the present invention.As shown in fig. 6, the video
The processing system of data can include：Included according to the processing system of the video data of the present invention：Video processor 10；At video
Reason device 10 can include：First receiving module 100, the video data stream of one or more input equipments is come from for receiving；
Processing module 102, for being carried out according to the one or more video-stream processors being connected with the video processor to video data stream
Partition encoding processing, and mark is encapsulated into each packet after partition encoding is handled high-ranking officers on time, wherein, calibrate markers
For making one or more video-stream processors include each packet synchronisation after partition encoding is handled in television splicing
On wall, the calibration markers is when video processor carries out partition encoding processing to video data stream, according to the current of server
What markers obtained after being calibrated；Sending module 104, for the packet after partition encoding is handled to be sent to one or
Multiple video-stream processors.
Using system as shown in Figure 6, solves the distributed giant-screen control system in correlation technique in television splicing
When cutting screen block number on wall is more, the problem of effect of simultaneous display is poor, and then improve distributed giant-screen control
In the case that cutting screen block number of the system on television splicing wall is more, the degree of accuracy of simultaneous display, Consumer's Experience is lifted.
Preferably, processing module 102, it is additionally operable to calculate the markers offset of itself markers and server current time index, with
And calibration process is carried out according to markers offset, obtain calibration markers.
Preferably, as shown in fig. 7, processing module 102 can include：First processing units 1020；First processing units
1020 can include：Transmission sub-unit（Not shown in figure）, for sending calibration request message to server, and calibrated sending
The first markers is recorded during request message；First receiving subelement（Not shown in figure）, come from the school of server for receiving
Quasi- response message, wherein, the information carried in adjustments responsive message includes：Server records when receiving calibration request message
Under the 3rd markers recorded when sending adjustments responsive message of the second markers and server；First computation subunit（In figure
It is not shown）, for according to the 4th markers, the first markers, the second markers and the recorded when receiving adjustments responsive message
Three markers calculate markers offset.
Preferably, first processor sends UDP packet to server, wherein, UDP
Calibration request message is carried in packet.
Preferably, as shown in fig. 7, first processing units 1020 can also include：Adjust subelement（Not shown in figure）, use
In adjusting itself markers according to markers offset；Processing module 102 can also include：Second processing unit 1022；Second processing
Unit 1022 can include：Second receiving subelement（Not shown in figure）, the adjustment of first processing units is come from for receiving
Itself markers afterwards；Second computation subunit（Not shown in figure）, for calculate first processing units transmission adjustment after itself
When target propagation delay time；3rd computation subunit（Not shown in figure）, for using itself markers and propagation delay time after adjusting
Calculate calibration markers.
Preferably, second processor carries out markers calibration every preset duration and server.
Preferably, said system also includes：One or more video-stream processors 20；Each video-stream processor 20 can wrap
Include：Second receiving module 200, compiled for being received via the port of video processor corresponding with the video-stream processor through over-segmentation
Packet after code processing；Decoder module 202, for carrying out decoding process to the packet that receives, and when parsing calibration
Mark；Determining module 204, for determining the markers of video data of the output Jing Guo decoding process according to calibration markers.
Preferably, mark is encapsulated into the private in each packet after partition encoding is handled to video processor high-ranking officers on time
There is data field.
As can be seen from the above description, following technique effect is above embodiments enabled（It should be noted that these
Effect is the effect that some preferred embodiments can reach）：Synchronization is realized by the way of software, without extra increase hardware
Cost；The synchronization of equipment room is carried out using markers mode；Realized using target mode when being added in code stream private information
The simultaneous display of image level.
Obviously, those skilled in the art should be understood that above-mentioned each module of the invention or each step can be with general
Computing device realize that they can be concentrated on single computing device, or be distributed in multiple computing devices and formed
Network on, alternatively, they can be realized with the program code that computing device can perform, it is thus possible to they are stored
Performed in the storage device by computing device, and in some cases, can be with different from shown in order execution herein
The step of going out or describing, they are either fabricated to each integrated circuit modules respectively or by multiple modules in them or
Step is fabricated to single integrated circuit module to realize.So, the present invention is not restricted to any specific hardware and software combination.
The preferred embodiments of the present invention are the foregoing is only, are not intended to limit the invention, for the skill of this area
For art personnel, the present invention can have various modifications and variations.Within the spirit and principles of the invention, that is made any repaiies
Change, equivalent substitution, improvement etc., should be included in the scope of the protection.
Claims (9)
- A kind of 1. processing method of video data, it is characterised in that including：Video processor receives the video data stream for coming from one or more input equipments；The video processor connects one or more video-stream processors, and the video processor is according to its connection to described Video data stream carries out partition encoding processing, and mark is encapsulated into each packet after partition encoding is handled to high-ranking officers on time In, wherein, the calibration markers is used to make one or more of video-stream processors by described after partition encoding is handled Each packet synchronisation is shown on television splicing wall, and the calibration markers is to the video data stream in the video processor When carrying out partition encoding processing, obtained after being calibrated according to the current time index of server；The video processor sends the packet after partition encoding is handled to one or more of video-stream processors,The video processor carries out calibration according to the current time index of server to be included：The video processor calculates the markers offset of itself markers and the server current time index every predetermined period；The video processor carries out calibration process according to the markers offset, obtains the calibration markers, wherein, the school Mark on time synchronous with the markers of the server for the current markers of the video processor to be calibrated to.
- 2. according to the method for claim 1, it is characterised in that the video processor calculate itself markers with it is described The markers offset of server current time index includes：First processor in the video processor sends calibration request message to the server, and is sending the calibration The first markers is recorded during request message；The server records the second markers when receiving the calibration request message, is then sent out to the first processor Adjustments responsive message is sent, wherein, the information carried in the adjustments responsive message includes:Second markers and the server The 3rd markers recorded when sending the adjustments responsive message；The first processor records the 4th markers when receiving the adjustments responsive message；The first processor is according to first markers, second markers, the 3rd markers and the 4th markers meter Calculate the markers offset.
- 3. according to the method for claim 2, it is characterised in that the video processor is carried out according to the markers offset Calibration process, obtaining the calibration markers includes：The first processor itself markers according to adjusting the markers offset；When second processor in the video processor receives itself after coming from the adjustment of the first processor Mark and calculate target propagation delay time when the first processor transmits itself after the adjustment；The second processor uses itself markers after the adjustment and the propagation delay time to calculate the calibration markers.
- 4. according to the method for claim 3, it is characterised in that the second processor is every preset duration and the service Device carries out markers calibration.
- 5. according to the method for claim 1, it is characterised in that will be after partition encoding is handled in the video processor Packet send to one or more of video-stream processors, in addition to：Each video-stream processor is received by partition encoding via the port of video processor corresponding with the video-stream processor Packet after reason；Each video-stream processor carries out decoding process to the packet received, and parses the calibration markers；Each video-stream processor determines the markers of video data of the output Jing Guo decoding process according to the calibration markers.
- A kind of 6. processing system of video data, it is characterised in that including：Video processor；The video processor includes：First receiving module, the video data stream of one or more input equipments is come from for receiving；Processing module, the one or more video-stream processors being connected for basis with the video processor, to the video data Stream carries out partition encoding processing, and mark is encapsulated into each packet after partition encoding is handled high-ranking officers on time, wherein, institute Calibration markers is stated to be used to make one or more of video-stream processors by each packet after partition encoding is handled For simultaneous display on television splicing wall, the calibration markers is to carry out segmentation volume to the video data stream in the video processor During code processing, obtained after being calibrated according to the current time index of server；Sending module, for the packet after partition encoding is handled to be sent to one or more of video-stream processors,The processing module, it is additionally operable to perform：The markers offset of itself markers and the server current time index is calculated every predetermined period；Calibration process is carried out according to the markers offset, obtains the calibration markers, wherein, the calibration markers is used for institute State the current markers of video processor be calibrated to it is synchronous with the markers of the server.
- 7. system according to claim 6, it is characterised in that the processing module includes：First processing units；The first processing units include：Transmission sub-unit, for sending calibration request message to the server, and remember when sending the calibration request message Lower first markers of record；First receiving subelement, the adjustments responsive message of the server is come from for receiving, wherein, the adjustments responsive disappears The information carried in breath includes:The second markers that the server is recorded when receiving the calibration request message and described The 3rd markers that server is recorded when sending the adjustments responsive message；First computation subunit, for according to the 4th markers recorded when receiving the adjustments responsive message, described the One markers, second markers and the 3rd markers calculate the markers offset.
- 8. system according to claim 7, it is characterised in thatThe first processing units also include：Subelement is adjusted, for itself markers according to markers offset adjustment；The processing module also includes:Second processing unit；The second processing unit includes：Second receiving subelement, for receiving itself markers after coming from the adjustment of the first processing units；Second computation subunit, for when calculating that target is transmitted when the first processing units transmit itself after the adjustment Prolong；3rd computation subunit, when calculating the calibration for itself markers after the use adjustment and the propagation delay time Mark.
- 9. system according to claim 8, it is characterised in that the system also includes：At one or more of displays Manage device；Each video-stream processor includes：Second receiving module, pass through partition encoding for being received via the port of video processor corresponding with the video-stream processor Packet after processing；Decoder module, for carrying out decoding process to the packet received, and parse the calibration markers；Determining module, for determining the markers of video data of the output Jing Guo decoding process according to the calibration markers.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310276055.0A CN104284098B (en) | 2013-07-01 | 2013-07-01 | The processing method and system of video data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310276055.0A CN104284098B (en) | 2013-07-01 | 2013-07-01 | The processing method and system of video data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104284098A CN104284098A (en) | 2015-01-14 |
| CN104284098B true CN104284098B (en) | 2017-11-14 |
Family
ID=52258538
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310276055.0A Active CN104284098B (en) | 2013-07-01 | 2013-07-01 | The processing method and system of video data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104284098B (en) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105516689B (en) * | 2016-01-26 | 2018-07-03 | 深圳市维冠视界科技股份有限公司 | A kind of distribution splicing display method and system |
| CN108259783B (en) * | 2016-12-29 | 2020-07-24 | 杭州海康威视数字技术股份有限公司 | Digital matrix synchronous output control method and device and electronic equipment |
| CN108184094A (en) * | 2017-12-29 | 2018-06-19 | 北京视觉世界科技有限公司 | Video picture displaying method and device |
| CN110460891B (en) * | 2018-05-08 | 2021-09-10 | 杭州海康威视数字技术股份有限公司 | Video frame output method and device, electronic equipment and storage medium |
| CN109040839A (en) * | 2018-08-21 | 2018-12-18 | 北京深瞐科技有限公司 | Wisdom video structural method and device |
| CN110896477B (en) * | 2018-09-13 | 2022-04-05 | 杭州海康威视数字技术股份有限公司 | Video coding method, device, coding equipment and storage medium |
| TWI690878B (en) * | 2018-11-02 | 2020-04-11 | 緯創資通股份有限公司 | Synchronous playback system and synchronous playback method |
| CN110489072B (en) * | 2019-08-20 | 2023-10-10 | 东软集团股份有限公司 | Method and device for synchronizing multiple screens of intelligent cabin and intelligent cabin |
| CN111010616A (en) * | 2019-12-23 | 2020-04-14 | 威创集团股份有限公司 | Audio and video transmission method and system based on IP network |
| CN111108470B (en) * | 2019-12-24 | 2021-12-07 | 威创集团股份有限公司 | Whole wall redisplay method and device for distributed splicing system and computer equipment |
| CN113094008B (en) * | 2021-03-02 | 2023-04-18 | 浙江大华技术股份有限公司 | Data display control method and device and computer readable storage medium |
| CN114217762A (en) * | 2021-12-27 | 2022-03-22 | 稿定（厦门）科技有限公司 | Method, server and equipment for online display of multiple equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101807389A (en) * | 2010-03-19 | 2010-08-18 | 上海博康智能网络科技有限公司 | Large screen splicing method and system |
| CN102196243A (en) * | 2011-04-02 | 2011-09-21 | 杭州华三通信技术有限公司 | Video data processing method, device and system |
| CN102226943A (en) * | 2011-04-29 | 2011-10-26 | 杭州海康威视数字技术股份有限公司 | System and method for realizing screen splicing |
| CN102347792A (en) * | 2010-07-30 | 2012-02-08 | 国际商业机器公司 | Method for adapting radio remote unit (RRU) and base band unit (BBU) and equipment thereof |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5151211B2 (en) * | 2007-03-30 | 2013-02-27 | ソニー株式会社 | Multi-screen synchronized playback system, display control terminal, multi-screen synchronized playback method, and program |
| CN102637120B (en) * | 2012-03-29 | 2014-11-26 | 重庆海康威视科技有限公司 | System and method for controlling synchronous display of spliced screens |
-
2013
- 2013-07-01 CN CN201310276055.0A patent/CN104284098B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101807389A (en) * | 2010-03-19 | 2010-08-18 | 上海博康智能网络科技有限公司 | Large screen splicing method and system |
| CN102347792A (en) * | 2010-07-30 | 2012-02-08 | 国际商业机器公司 | Method for adapting radio remote unit (RRU) and base band unit (BBU) and equipment thereof |
| CN102196243A (en) * | 2011-04-02 | 2011-09-21 | 杭州华三通信技术有限公司 | Video data processing method, device and system |
| CN102226943A (en) * | 2011-04-29 | 2011-10-26 | 杭州海康威视数字技术股份有限公司 | System and method for realizing screen splicing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104284098A (en) | 2015-01-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104284098B (en) | The processing method and system of video data | |
| US9741316B2 (en) | Method and system for displaying pixels on display devices | |
| CN103324457B (en) | Terminal and multi-task data display method | |
| EP2487903B1 (en) | Automatic video layouts for multi-stream multi-site telepresence conferencing system | |
| CN108632674A (en) | A kind of playback method and client of panoramic video | |
| CN104375789A (en) | Synchronous displaying method and system of tiled display screen | |
| CN203025533U (en) | Ethernet-based control system for four-dimensional cinema | |
| CN103491317B (en) | Three-dimensional figure and image multi-screen synchronous broadcasting method, device and system | |
| EP3471405A1 (en) | Video signal transmission method and apparatus | |
| WO2019233314A1 (en) | Method for echo imaging on television wall, service device and television wall system | |
| CN101577816B (en) | Device and method supporting multichannel high definition video decoding | |
| EP2478709B1 (en) | Three dimensional (3d) video for two-dimensional (2d) video messenger applications | |
| CN207399423U (en) | A kind of distributed network video process apparatus | |
| CN103795979A (en) | Method and device for synchronizing distributed image stitching | |
| CN103986960A (en) | Method for single-video picture division route teletransmission precise synchronization tiled display | |
| CN101197647A (en) | Multi-channel real-time three-dimensional vision rendering indication method | |
| CN102298491B (en) | Embedded graphical interface system and image generation method thereof | |
| US10129500B2 (en) | Multi-display apparatus | |
| CN107959602B (en) | A kind of method of network entry and device | |
| CN105578248B (en) | Fancy splicing playing method, device and system | |
| WO2017016568A1 (en) | Method and telecommunications network for streaming and for reproducing applications | |
| JP2017107173A (en) | Multi-display device | |
| CN106603537A (en) | System and method for marking video signal source of mobile intelligent terminal | |
| JP2008066787A (en) | Matrix switcher and control method of matrix switcher | |
| US9118947B2 (en) | Multi-vision virtualization system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |