CN104168466B - A kind of multi-screen audio video synchronization player method and device - Google Patents
A kind of multi-screen audio video synchronization player method and device Download PDFInfo
- Publication number
- CN104168466B CN104168466B CN201410415455.XA CN201410415455A CN104168466B CN 104168466 B CN104168466 B CN 104168466B CN 201410415455 A CN201410415455 A CN 201410415455A CN 104168466 B CN104168466 B CN 104168466B
- Authority
- CN
- China
- Prior art keywords
- frame
- video
- node
- main control
- control computer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention discloses a kind of multi-screen audio video synchronization player method and device, its method comprises: the small video that ultrahigh resolution video source is cut into equal portions is placed on different node machines, convert each video data to YUV image sequence, the same frame sequence of each small video adopts identical number-mark; YUV image sequence is generated to YUV file; Main control computer sends a command to and makes all node machines start displaying video at synchronization; Camera starts synchronously to take whole video pictures, the numbering of analysis frame; In the time having frame number inconsistent, main control computer sends a command to the inconsistent node machine maintenance of frame and changes the sequence number that needs the frame of playing, and takes out the frame image sequence that will play from this node machine, reaches all frame numbers of same picture consistent. The present invention is without artificial pre-adjustment audio video synchronization, audio video synchronization play have intellectuality, frame speed to be play stable, occurs when asynchronous, can select fast which frame and play, restart broadcasting without suspending video at frame.
Description
Technical field
The present invention relates to field of video processing, more specifically, relate to a kind of multi-screen audio video synchronization player method and device.
Background technology
Along with digital camera Play System is more and more higher to the requirement of definition, the resolution ratio of output picture is considerably beyond the computer output resolution ratio of a display device in other words, therefore often need multiple devices to splice together the complete picture of a ultrahigh resolution, how to ensure all devices output picture synchronously just become a key issue.
Conventional method mainly contains two kinds:
1, coordinate by network or other communication modes, ensure that all machines paint a frame picture at synchronization. Concrete grammar is: in system, have a table scale to make the machine of master control, notify other all machines to generate a certain frame picture by network, after all machines are generated, first do not export, but notice master control, master control knows that all machines are all ready to new picture and send later again the order of an output, when all drafting machines are received this order, export together picture, thereby realize synchronous. The defect of the method is to rely on machine communication before, if by network communication, each frame at least has twice communication: master control-> node, node-> master control, network unstable, the loss of packet, time delay, response time, the processing time of networking command all can impact synchronous broadcasting, thereby cause frame speed unstable, movie playback is not smooth, occurs the effect of card. If can increase again hardware cost by the communication apparatus of other high-performance high stability.
2, trigger drafting by the timer of every equipment self: first on every machine, have a timer through calibration, before starting to play, all machines all can receive that starts a play command, which moment order will inform from starts to play, because the broadcasting clock of all machines is through calibration, therefore everybody can play the first frame in the same moment, afterwards according to the new picture of the clock of self timer each output one frame, as long as timer clock is consistent, just can keep synchronous always. The shortcoming of the method has 2 points: the one, and all machines are installed timer accurately, increase cost too large. The 2nd, for playing on computers digital film, output picture all will pass through video card, and the output of video card is directly related with refreshing of video card, even if timer can be very accurate, still will wait for the refresh cycle of video card.
In the time solving two kinds of methods of tradition, whether synchronously all to observe with the human eye whole picture, and because video playback frame per second is fast, human eye is often difficult to distinguish that whether video pictures is synchronous, even if human eye easily sees that successive frame is asynchronous, also can only carry out manual intervention adjustment audio video synchronization by stopping video playback, seldom use complete intelligentized method and synchronously play.
In order to overcome the deficiency of conventional method, there is technical staff to propose " video synchronization method of taking based on camera ", the method is by ultrahigh resolution video source is cut into small video, and small video is placed on different node machines, and the same frame of each small video adopts identical number-mark; Whether unanimously carry out audio video synchronization processing by the whole picture of camera capture video. The method communicates without Adoption Network, can reduce greatly the stationary problem that network service is abnormal and network response abnormality causes. But in the time existing frame asynchronous, need to suspend after video is adjusted and replay again.
Summary of the invention
For above-mentioned the deficiencies in the prior art, first the present invention proposes a kind of multi-screen audio video synchronization player method, the method is without artificial pre-adjustment audio video synchronization, audio video synchronization is play there is intellectuality, frame speed to play stable, occur when asynchronous at frame, can select fast any frame and play, restart to play without suspending video.
Another object of the present invention is to propose a kind of multi-screen audio video synchronization playing device.
To achieve these goals, technical scheme of the present invention is:
A kind of multi-screen audio video synchronization player method, comprises the following steps:
S1: the small video that ultrahigh resolution video source is cut into equal portions is placed on different node machines, converts each video data to YUV image sequence, and the same frame sequence of each small video adopts identical number-mark;
S2: YUV image sequence is generated to YUV file according to the storage rule of setting;
S3: the main control computer that connects camera sends a command to all node machines, makes all node machines start displaying video at synchronization;
S4: camera starts synchronously to take whole video pictures, and whether analyze the numbering of all frames consistent;
S5: when running into when having frame number inconsistent, main control computer sends a command to the inconsistent node machine maintenance of frame and changes the sequence number that needs the frame of playing, and takes out the frame image sequence that will play from this node machine, and the frame number that reaches all node machines of same picture is consistent.
Wherein, in step S1, ultrahigh resolution video should be divided into into several small videos with equal resolution, small video can be spliced into an original frame superelevation picture, each small video is placed on different node machines, each video data must be converted to yuv format, because the data of yuv format are all frame frames, in video playback, audio video synchronization can be accurate to each frame, the position of each video numbering can arrange as required, is put in the scope that camera can photograph as far as possible. Meanwhile, the same frame of each small video adopts identical label mark, numbering is preserved with corresponding frame of video, so that main control computer inquiry judging, while adopting number-mark small video to use camera to take, judges the synchronism of video according to the numbering of taking.
A kind of multi-screen audio video synchronization playing device, comprising:
Video slicing module: be placed on different node machines for the small video that ultrahigh resolution video source is cut into equal portions, convert each video data to YUV image sequence, the same frame sequence of each small video adopts identical number-mark;
YUV modular converter: YUV image sequence is generated to YUV file according to the storage rule of setting;
Control module: the main control computer that connects camera sends a command to all node machines, makes all node machines start displaying video at synchronization;
Audio video synchronization identification module: camera starts synchronously to take whole video pictures, and whether analyze the numbering of all frames consistent;
Correction module: when running into when having frame number inconsistent, main control computer sends a command to the inconsistent node machine maintenance of frame and changes the sequence number that needs the frame of playing, take out the frame image sequence that will play from this node machine, the frame number that reaches all node machines of same picture is consistent.
Compared with prior art, beneficial effect of the present invention is: first, video data is converted to yuv format, makes audio video synchronization to be accurate to each frame in the time of video playback; Existing when asynchronous, can read fast the asynchronous node machine of the frame sequence frame number of makeing mistakes, adjust without the refresh rate by computer hardware equipment; Adopt data structure: structFrameInfo to store YUV file, can facilitate frame asynchronous time, fast selected which frame is play, and again develops broadcasting without suspending video. Secondly the frame per second of camera and the frame per second of whole picture are synchronizeed, and can prevent that the picture of taking from having flicker. Finally, number synchronously to judge by the picture in camera shooting picture, reduce manual intervention, realize and adjust automation; And can reduce the stationary problem that Network Abnormal and network response abnormality cause; The present invention adopts camera to take, and does not need ceaselessly to send synch command, only needs the wrong calibration that just sends, and can reduce the use of network system resources.
Brief description of the drawings
Fig. 1 is the flow chart of the embodiment of the present invention.
Fig. 2 is that the camera of the embodiment of the present invention is taken the video playback schematic diagram after cutting.
Detailed description of the invention
Below in conjunction with accompanying drawing, the present invention will be further described, but embodiments of the present invention are not limited to this.
Embodiment
As Fig. 1, a kind of multi-screen audio video synchronization player method, comprises the following steps:
S1: the small video that ultrahigh resolution video source is cut into equal portions is placed on different node machines, the same frame numeral number of each small video, in the present embodiment, each video first and second ..., N frame adopt respectively numbering 1,2 ..., N mark; Being convenient to camera takes;
S2: YUV image sequence is generated to YUV file according to the storage rule of setting, conveniently synchronously process in the time that audio video synchronization is play;
S3: the main control computer that connects camera sends a command to all node machines, makes all node machines start displaying video at synchronization;
S4: camera starts synchronously to take whole video pictures, and whether analyze the numbering of all frames consistent;
S5: when running into when having frame number inconsistent, main control computer sends a command to the inconsistent node machine maintenance of frame and changes the sequence number that needs the frame of playing, and takes out the frame image sequence that will play from this node machine, and the frame number that reaches all node machines of same picture is consistent.
Wherein, in step S1, ultrahigh resolution video should be divided into the video of the resolution sizes of each node machine of equal portions, the present embodiment is as Fig. 2, be set to 2 × 2 systems, each video resolution is 1024 × 768, and each video data must be converted to yuv format, because the data of yuv format are all frame frames, in video playback, audio video synchronization can be accurate to each frame, the position of each video numbering can arrange as required, is put in the scope that camera can photograph as far as possible.
Step S2 relates to a kind of storage means of YUV file, sets in advance in the method following data structure: structFrameInfo
{
FrameIndex; // (2 byte) number of frames
StartPos; The starting position of // (4 byte) fragment data
EndPos; The end position of // (4 byte) fragment data
FrameWeidth; // (2 byte) frame width
FrameHeight; // (2 byte) vertical frame dimension degree
FrameRate; // (2 byte) frame rate
}
In front 16 information that byte is used for storing all frames of the first frame, comprise the information of structFrameInfo data structure, when facilitating like this frame asynchronous, fast selected which frame is play, and again develops broadcasting without suspending video.
In step S3, main control computer must be the node machine that is connected to camera, and any node machine all can connect camera as main control computer; In step S4, the frame per second of camera must be synchronous with the frame per second of whole splicing picture, and the picture of not so taking has flicker, so before camera is taken, main control computer must read once the display frame rate of whole picture.
In step S5, in the time having a certain node machine and current image frame inconsistent, judge, whether the numbering that judges nonsynchronous node machine is greater than current whole picture numbering, if be greater than, read by front 16 bytes of YUV file store frame information the normal frame number that next time needs broadcasting, and send to nonsynchronous node machine to proofread and correct this frame number by main control computer.
Due to the delay effect of Internet Transmission, need to calculate and send to the end and transmit which number of frames, suppose that network delay is T1, frame playback rate reads from data structure structFrameInfo, frame per second is frameRate, and the current frame number of having play is M, M=T1/ (60/frameRate), so the frame number that main control computer sends must add M on the basis of next frame number, Here it is frame number that this asynchronous node machine need to play.
When the numbering of nonsynchronous node machine is, while being less than current whole picture numbering, reading by front 16 bytes of YUV file store frame information the normal frame number that needs broadcasting, and send to nonsynchronous node machine to proofread and correct this frame number by main control computer next time.
Due to the delay effect of Internet Transmission, need to calculate and send to the end and transmit which number of frames, suppose that network delay is T1, frame playback rate reads from data structure structFrameInfo, frame per second is frameRate, and the current frame number of having play is M, M=T1/ (60/frameRate), so the frame number that main control computer sends must add M on the basis of next frame number, Here it is frame number that this asynchronous node machine need to play.
Above-described embodiments of the present invention, do not form limiting the scope of the present invention. Any amendment of having done within spiritual principles of the present invention, be equal to and replace and improvement etc., within all should being included in claim protection domain of the present invention.
Claims (5)
1. a multi-screen audio video synchronization player method, is characterized in that, comprises the following steps:
S1: the small video that ultrahigh resolution video source is cut into equal portions is placed on different node machines, converts each video data to YUV image sequence, and the same frame sequence of each small video adopts identical number-mark;
S2: YUV image sequence is generated to YUV file according to the storage rule of setting;
S3: the main control computer that connects camera sends a command to all node machines, makes all node machines start displaying video at synchronization;
S4: camera starts synchronously to take whole video pictures, and whether analyze the numbering of all frames consistent;
S5: when running into when having frame number inconsistent, main control computer sends a command to the inconsistent node machine maintenance of frame and changes the sequence number that needs the frame of playing, and takes out the frame image sequence that will play from this node machine, and the frame number that reaches all node machines of same picture is consistent;
In the time having a certain node machine and current image frame inconsistent, read the normal frame number that next time needs broadcasting by front 16 bytes of YUV file store frame information, and send to nonsynchronous node machine to proofread and correct this frame number by main control computer;
Due to the delay effect of Internet Transmission, need to calculate and send to the end and transmit which number of frames, if network delay is T1, frame playback rate reads from data structure structFrameInfo, frame per second is frameRate, and the frame number that current nonsynchronous node machine has been play is M, M=T1/ (60/frameRate), so the frame number that main control computer sends must add M on the basis of next frame number, the frame of this frame number is put in this asynchronous node machine sowing.
2. multi-screen audio video synchronization player method according to claim 1, is characterized in that, the concrete mode that " YUV image sequence is generated to YUV file according to the storage rule of setting " in described step S2 is:
Set in advance following data structure: structFrameInfo
FrameIndex, accounts for 2 bytes, represents number of frames;
StartPos, accounts for 4 bytes, represents the starting position of fragment data;
EndPos, accounts for 4 bytes, represents the end position of fragment data;
FrameWeidth, accounts for 2 bytes, represents frame width;
FrameHeight, accounts for 2 bytes, represents vertical frame dimension degree;
FrameRate, accounts for 2 bytes, represents frame rate;
In front 16 information that byte is used for storing all frames of the first frame, comprise the information of structFrameInfo data structure.
3. multi-screen audio video synchronization player method according to claim 2, is characterized in that, described main control computer is the node machine that is connected to camera, and any node machine can both connect camera as main control computer.
4. multi-screen audio video synchronization player method according to claim 3, is characterized in that, the frame per second of described camera is synchronizeed with the frame per second of whole video, and, before camera is taken, main control computer need at least read once the display frame rate of whole picture.
5. application rights requires a multi-screen audio video synchronization playing device for method described in 1, it is characterized in that, comprising:
Video slicing module: be placed on different node machines for the small video that ultrahigh resolution video source is cut into equal portions, convert each video data to YUV image sequence, the same frame sequence of each small video adopts identical number-mark;
YUV modular converter: YUV image sequence is generated to YUV file according to the storage rule of setting;
Control module: the main control computer that connects camera sends a command to all node machines, makes all node machines start displaying video at synchronization;
Audio video synchronization identification module: camera starts synchronously to take whole video pictures, and whether analyze the numbering of all frames consistent;
Correction module: when running into when having frame number inconsistent, main control computer sends a command to the inconsistent node machine maintenance of frame and changes the sequence number that needs the frame of playing, take out the frame image sequence that will play from this node machine, the frame number that reaches all node machines of same picture is consistent.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410415455.XA CN104168466B (en) | 2014-08-22 | 2014-08-22 | A kind of multi-screen audio video synchronization player method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410415455.XA CN104168466B (en) | 2014-08-22 | 2014-08-22 | A kind of multi-screen audio video synchronization player method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104168466A CN104168466A (en) | 2014-11-26 |
| CN104168466B true CN104168466B (en) | 2016-05-25 |
Family
ID=51912071
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410415455.XA Expired - Fee Related CN104168466B (en) | 2014-08-22 | 2014-08-22 | A kind of multi-screen audio video synchronization player method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104168466B (en) |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104506919B (en) * | 2014-12-26 | 2018-08-31 | 上海昭宁信息科技有限公司 | Show the synchronous method and its system of content and display screen movement |
| US9672791B2 (en) * | 2015-01-14 | 2017-06-06 | Lenovo (Singapore) Pte. Ltd. | Actuation of device for viewing of first content frames presented on a display between second content frames |
| CN104993901B (en) * | 2015-07-09 | 2017-08-29 | 广东威创视讯科技股份有限公司 | Distributed system method of data synchronization and device |
| CN105187689A (en) * | 2015-10-12 | 2015-12-23 | 国家电网公司 | Method for synchronizing ultra-high-definition video played jointly by multiple terminals |
| CN106406793B (en) * | 2016-09-13 | 2019-09-17 | 广东威创视讯科技股份有限公司 | The identity configuration method and system and IP address distribution method and system of Node station |
| CN106851408A (en) * | 2017-02-22 | 2017-06-13 | 微鲸科技有限公司 | A kind of television set throws screen monitoring device and method |
| CN107027066B (en) * | 2017-03-24 | 2020-08-18 | 深圳市环球数码科技有限公司 | High-resolution digital movie theater playing method and system |
| CN107231533B (en) * | 2017-06-12 | 2019-12-13 | 深圳市瑞立视多媒体科技有限公司 | synchronous exposure method and device and terminal equipment |
| CN110611838A (en) * | 2019-09-09 | 2019-12-24 | 中国联合网络通信集团有限公司 | Multi-screen playing method, device and system |
| CN111147943B (en) * | 2019-12-23 | 2022-06-21 | 大峡谷照明系统（苏州）股份有限公司 | Multimedia light linkage playing method and device, computer equipment and storage medium |
| CN111221611B (en) * | 2020-01-03 | 2023-11-24 | 北京恒泰实达科技股份有限公司 | Method for realizing synchronous switching of display pictures of multiple hosts |
| CN112770164A (en) * | 2020-12-22 | 2021-05-07 | 上海幻维数码创意科技股份有限公司 | Video synchronous playing method |
| CN112839220A (en) * | 2020-12-31 | 2021-05-25 | 杭州当虹科技股份有限公司 | Method for realizing quality observation of HDR video through sdi sdk |
| CN114025150A (en) * | 2021-10-29 | 2022-02-08 | 歌尔光学科技有限公司 | Video frame synchronization method and device for multi-head-mounted equipment, head-mounted equipment and medium |
| CN114302064B (en) * | 2022-01-27 | 2024-01-26 | 北京同尔科技有限公司 | Video processing method, device and system based on receiving card |
| CN114638831B (en) * | 2022-05-18 | 2022-10-21 | 合肥宏晶半导体科技有限公司 | Image analysis method and device |
| CN115426515B (en) * | 2022-08-03 | 2024-05-10 | 西安诺瓦星云科技股份有限公司 | Method, device, system and storage medium for multi-device synchronous calibration |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101321301A (en) * | 2008-07-08 | 2008-12-10 | 浙江大学 | Camera array synchronization video acquisition and processing system |
| CN102158633A (en) * | 2011-01-24 | 2011-08-17 | 广东威创视讯科技股份有限公司 | Synchronous image signal processing method |
| CN103079088A (en) * | 2012-12-14 | 2013-05-01 | 广东威创视讯科技股份有限公司 | Multi-screen video preprocessing and synchronous broadcasting method and system |
| CN103151058A (en) * | 2013-01-30 | 2013-06-12 | 福建三元达通讯股份有限公司 | Method and system of displaying video simultaneously |
| CN103347144A (en) * | 2013-07-01 | 2013-10-09 | 广东威创视讯科技股份有限公司 | Video synchronization method based on camera photographing |
| CN103491317A (en) * | 2013-09-06 | 2014-01-01 | 北京东方艾迪普科技发展有限公司 | Three-dimensional figure and image multi-screen synchronous broadcasting method, device and system |
-
2014
- 2014-08-22 CN CN201410415455.XA patent/CN104168466B/en not_active Expired - Fee Related
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101321301A (en) * | 2008-07-08 | 2008-12-10 | 浙江大学 | Camera array synchronization video acquisition and processing system |
| CN102158633A (en) * | 2011-01-24 | 2011-08-17 | 广东威创视讯科技股份有限公司 | Synchronous image signal processing method |
| CN103079088A (en) * | 2012-12-14 | 2013-05-01 | 广东威创视讯科技股份有限公司 | Multi-screen video preprocessing and synchronous broadcasting method and system |
| CN103151058A (en) * | 2013-01-30 | 2013-06-12 | 福建三元达通讯股份有限公司 | Method and system of displaying video simultaneously |
| CN103347144A (en) * | 2013-07-01 | 2013-10-09 | 广东威创视讯科技股份有限公司 | Video synchronization method based on camera photographing |
| CN103491317A (en) * | 2013-09-06 | 2014-01-01 | 北京东方艾迪普科技发展有限公司 | Three-dimensional figure and image multi-screen synchronous broadcasting method, device and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104168466A (en) | 2014-11-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104168466B (en) | A kind of multi-screen audio video synchronization player method and device | |
| CN103347144B (en) | A kind of video synchronization method based on camera shooting | |
| KR101828639B1 (en) | Method for synchronizing multimedia flows and corresponding device | |
| CN104375789B (en) | The synchronous display method and system of mosaic screen | |
| CN108495152B (en) | Video live broadcast method and device, electronic equipment and medium | |
| US20160066007A1 (en) | Video playback method, media device, playback device, and multimedia system | |
| CN103079088B (en) | Multi-screen video pre-filtering and synchronous broadcast method and system | |
| CN106412633A (en) | Screen mapping method and display clock synchronization control method and system of distributed multi-screen splicing controller | |
| CN103986960A (en) | Method for single-video picture division route teletransmission precise synchronization tiled display | |
| CN106464961B (en) | Receiving apparatus, transmitting apparatus, and data processing method | |
| JP2015099346A (en) | Multi-screen display system, and image signal correcting method for the same | |
| CN107995503B (en) | Audio and video playing method and device | |
| CN104079955A (en) | Method, device and system of OTT (Over The Top) live broadcast | |
| US20130187832A1 (en) | Display apparatus and method for controlling the same | |
| CN106454154A (en) | Television wall splicing method and system | |
| CN101478683A (en) | Synchronizing audio and video frames | |
| CN114079813A (en) | Picture synchronization method, coding method, video playing device and video coding device | |
| CN103297707A (en) | Ultrahigh-definition video play system | |
| CN106060580B (en) | Image synchronous display method and device | |
| JP2017050609A (en) | Video processing system, video processing apparatus, video processing program, and video processing method | |
| CN103581741A (en) | Special-effect playing device and method | |
| JP6606526B2 (en) | Synchronization control device and synchronization control method | |
| CN111835988B (en) | Subtitle generation method, server, terminal equipment and system | |
| CN101833935A (en) | Multi-machine video synchronous playing method based on display card refresh rate | |
| KR102031919B1 (en) | Multi image display system for providing active time synchronization and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: Kezhu road high tech Industrial Development Zone, Guangzhou city of Guangdong Province, No. 233 510670 Patentee after: VTRON GROUP Co.,Ltd. Address before: Kezhu road high tech Industrial Development Zone, Guangzhou city of Guangdong Province, No. 233 510670 Patentee before: VTRON TECHNOLOGIES Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160525 Termination date: 20210822 |