CN101399967A - Method for video and audio synchronous monitoring applied in recording system - Google Patents
Method for video and audio synchronous monitoring applied in recording system Download PDFInfo
- Publication number
- CN101399967A CN101399967A CN 200710122453 CN200710122453A CN101399967A CN 101399967 A CN101399967 A CN 101399967A CN 200710122453 CN200710122453 CN 200710122453 CN 200710122453 A CN200710122453 A CN 200710122453A CN 101399967 A CN101399967 A CN 101399967A
- Authority
- CN
- China
- Prior art keywords
- data
- audio
- video
- looking
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Closed-Circuit Television Systems (AREA)
Abstract
The invention relates to a synchronous monitoring method for video and audio frequency in acquisition system, belonging to acquisition monitoring field. The system present invention belongs to comprises four modules: data acquisition module, data compression module, data transmission module, data reception and display module. The former three modules are configured at an acquisition device, the data reception module is configured at monitoring device. The invention increases a compression/transmission channel in the acquisition device, compresses video and audio frequency signal processed by acquisition device to low code rate stream media data in real time, and issues to monitoring device by network for visualized watching by related person, and satisfies different demand of acquisition system.
Description
Technical field
The invention belongs to and include the monitoring field, be specifically related to a kind of method that is applied in looking in the acceptance system, audio synchronous monitoring.
Background technology
At acceptance system, particularly master control is included in the extensive acceptance system of a class, and the user need supervise the running status and the signal condition of each radio-cassette player usually in real time, with the variety of issue of guaranteeing in time to find to occur in the acceptance system, guarantees to include the quality of material.Wherein the monitoring for the radio-cassette player signal seems particularly important because it directly reflected acceptance system current handling look, audio case, the visual impression of material quality can be provided for the user.
Chang Yong scheme comprised following several in the past: 1, on radio-cassette player, increase by one look, the audio detection module, the situation of the video/audio that the real-time analysis radio-cassette player is being handled, according to certain rule signal is detected, if find not meet the situation of rule, promptly send alarm signal, carry out sound, light warning by supervising device to supervising device; 2, with the current vision signal sectional drawing of handling of radio-cassette player, send to supervising device with certain frequency, the user can see the disconnected video pictures that continues on supervising device; 3, adopt extra video wall, the signal that all radio-cassette players are being handled is connected on the video wall by equipment such as matrixes, carries out signal monitoring by video wall.
These three kinds of schemes commonly used all have its limitation at present, scheme 1 is too not directly perceived for the user, the user can only know that signal goes wrong according to methods such as indicator lights, can not see and hear current picture and sound, and utilize algorithm to carry out sound picture detection itself certain limitation is just arranged according to certain rule, be difficult to cover all signal problems, scheme 2 can take certain network bandwidth, and what the user saw is the picture that a width of cloth width of cloth is beated, and does not have the continuous sensation of TV signal, the most important thing is, adopt this mode, can't transmit sound, the user can't judge whether voice signal is normal, and scheme 3 is the most a kind of modes, signal quality is also best, but it has two weakness, at first disposes extra video wall, equipment investments such as expansion matrix are huge, in addition, what its reflected is the signal quality that inserts radio-cassette player, but not the signal quality that current radio-cassette player is being handled can't in time be found the inner problem that occurs of acceptance system, makes mistakes as IO integrated circuit board processing signals etc.
Summary of the invention
At the defective that exists in the prior art, the purpose of this invention is to provide a kind of method that is applied in looking in the acceptance system, audio synchronous monitoring, use this method can not take the too high network bandwidth, do not need to be equipped with expensive extras yet, can look simultaneously for the user provides intuitively, the signal of audio sync, thereby can effectively improve the acceptance system quality monitoring, better meet consumers' demand, for the developer, also provide more simple various implementation.
For reaching above purpose, the technical solution used in the present invention is:
A kind of method that is applied in looking in the acceptance system, audio synchronous monitoring may further comprise the steps:
Step 1, data acquisition module obtains the video/audio of nothing compression and the video/audio that obtains is carried out normalization and synchronous preliminary treatment from including device;
Step 2, data compressing module receives data after the normalization from data acquisition module, and data are compressed;
Step 3, data transmission module receives the good data of compression from data compressing module, and these data in real time are sent to Data Receiving and display module in the supervising device;
Step 4, Data Receiving and display module receiving real-time data, and with these data decodes, the synchronous programme signal of output is in real time checked for the user on video and audio output device then.
Further, in step 1, include device inside and also be provided with signal processing flow, each node of signal processing flow all can carry out respective handling to signal, up to arriving the final module of including; Described data acquisition facility therefrom obtains required video/audio by adding signal processing flow.
Data acquisition module is placed on the front end of including module.
After getting access to original video/audio, at first video/audio is normalized to the frame encapsulating structure of identical duration according to current standard, then according to attach look, timestamp on the audio signal carries out synchronously, finding that the mode that employing when asynchronous abandons redundant data keeps data sync.
In described normalization and synchronous preprocessing process, at first original video/audio is temporarily stored in the data buffer, when the data in the data buffer surpass definite value, it is packet with data encapsulation that video/audio is sent into frame encapsulation device, sending into frame synchronizer then carries out synchronously frame of video and audio frame, described definite value is 40ms when Phase Alternation Line system, is 33.37ms when TSC-system.
Further, in the step 2, in compression process, be the less picture of size in advance with the video data down conversion, voice data is resampled is the low sampling rate audio frequency.
Compression back data are the stream medium data of low code check.
In compression process, adopt Windows Media to carry out data compression, corresponding with it, the data transmission module in downstream adopts MMS (Microsoft Media Server) Protocol to transmit.
Further, in compression process, video image size down conversion is wide by 288 for long 352, and audio frequency adopts the stereo resampling of 32KHz kilohertz, and video code rate 250kbps, audio code rate establish and adopt 32kbps.
Further, in the step 3, the data after the compression are transmitted in real time with unicast or multicast mode on local area network (LAN).
Further, the agreement of the employing when transmission of the data after the compression is RTSP or MMS.
Further, in the step 4, Data Receiving and display module are realized monitoring by following dual mode: 1) play the video of including the device transmission by mms by Windows Media Player on any PC; 2) embedded WMS protocol resolver and decoder on supervising device.
In the step 4, behind Data Receiving and the display module receiving real-time data, look the video/audio that audio detection module real-time analysis radio-cassette player is being handled, rule according to prior setting detects signal, if find to have the situation of the rule of not meeting, promptly send alarm signal, carry out sound, light warning, remind the operator on duty to check the video/audio signal of real-time transmission by supervising device to supervising device.
Effect of the present invention is: adopt method and system of the present invention, in not expanding existing acceptance system under the hardware devices circumstances, make the time to the looking of acceptance system, audio synchronous monitoring, can not take the too high network bandwidth, do not need to be equipped with expensive extras yet, can look simultaneously for the user provides intuitively, the signal of audio sync, thereby can effectively improve the acceptance system quality monitoring, better meet consumers' demand.
Description of drawings
Fig. 1 is the principle schematic of the method for the invention;
Fig. 2 is the structural representation of the applied acceptance system of the present invention;
Fig. 3 is the data acquisition module fundamental diagram;
Fig. 4 is data compression and a sending module fundamental diagram in the present embodiment.
Embodiment
For the purpose, technical scheme and the advantage that make the embodiment of the invention is clearer,, the specific embodiment of the present invention is described in further details below in conjunction with embodiment and accompanying drawing.
Connection between each module of present embodiment and operation principle as shown in Figure 1, Fig. 2 is the structural representation of the applied acceptance system of the present invention.
The present invention is applied in looking in the acceptance system, audio synchronous monitoring system, and this system comprises and include device 21, supervising device 22, also is provided with on the device with lower module including: data acquisition module 11, data compressing module 12, data transmission module 13; On supervising device 22, also be provided with Data Receiving and display module 14.
In the present embodiment, as shown in Figure 3, be provided with video data buffer 31, frame of video wrapper 32, audio data buffer 33, audio frame wrapper 34, frame synchronizer 35 in the described data acquisition module 11.
As shown in Figure 4, be provided with video downconverter 41, audio resampling device 42, WINDOWS MEDIA compression set 43 and MMS service unit 44 in the described data compressing module 12.
A kind of method that is applied in looking in the acceptance system, audio synchronous monitoring may further comprise the steps:
Step 1, data acquisition module 11 obtains the video/audio of nothing compression and the video/audio that obtains is carried out normalization and synchronous preliminary treatment from including device;
Data acquisition module 11 gets access to the video/audio that does not have compression from include data flow, video data adopts the RGB coding, and voice data adopts pcm encoder.In the present embodiment, what acceptance system was included is pal signal, i.e. 25 frame/seconds, so in the normalization process, as shown in Figure 3, at first initial data is temporarily stored in video data buffer 31, in the audio data buffer 33, in data buffer 31, when 33 data surpass 40ms (during Phase Alternation Line system), data are sent into frame encapsulation device 32, be the packet of 40ms/ frame with data encapsulation in 34, sending into 35 pairs of frame of video of frame synchronizer and audio frame then carries out synchronously, that is to say simultaneous image and voice data are aimed at that carry out according to timestamp synchronously, the operation principle of frame synchronizer 35 is as follows:
If 11 cut-in times of data acquisition module are T
o, current n the audio frame zero-time of obtaining is S
n, the concluding time is T
n, can calculate current audio data block duration D
n=T
n-S
n, establishing the voice data frame number that has abandoned before this is m, then n frame voice data arrives amount of audio data population deviation constantly:
The video data volume population deviation in the time of in like manner can calculating the arrival of n frame video data
Just can calculate the asynchronous amount of current video/audio according to the population deviation of the population deviation of voice data and video data:
When | U
n|=during 40ms, illustrate that the asynchronous state of video/audio has surpassed a frame, need abandon frame data, work as U
n0 o'clock, show that the voice data population deviation exceeds, video data need be abandoned a frame, will abandon the video frame number simultaneously and add 1, otherwise voice data need be abandoned a frame, simultaneously audio frequency is abandoned audio frame number m and added 1.
Step 2, data compressing module 12 receives data after the normalization from data acquisition module, and data are compressed;
We adopt WINDOWS MEDIA to carry out data compression in the present embodiment, and are corresponding with it, and the data transmission module in downstream adopts MMS (Microsoft Media Server) Protocol 15 to transmit, so we merge processing with data compressing module 12 and data transmission module 13 here.Because this module will be deployed in and include the including on the device of two code streams simultaneously, because including two code streams requires very high to computing power, particularly require very high to CPU, in order to reduce data compressing module taking to CPU, adopting the video image size in the present embodiment is that length 352 is wide by 288 by long 720 wide 576 down conversions, audio frequency adopts the 32KHz kilohertz stereo, video code rate 250kbps, audio code rate is established and is adopted 32kbps, experimental results show that, go out and image in above-mentioned parameter condition lower compression, sound can reach preferable quality, simultaneously to CPU, the occupancy of the network bandwidth also relatively rationally.
Step 3, data transmission module 13 receives the good data of compression from data compressing module, and these data in real time are sent to Data Receiving and display module 14 in the supervising device; Data after the compression can transmit in real time with unicast or multicast mode on local area network (LAN).
Step 4, Data Receiving and display module 14 receiving real-time datas, and with these data decodes, the synchronous programme signal of output is in real time checked for the user on video and audio output device then.
At Data Receiving/display module 14 two kinds of different implementations are arranged: 1) on any PC, play the video of including the device transmission by mms by Windows Media Player; 2) embedded WMS protocol resolver and decoder on supervising device.Adopt first kind of mode, monitor mode is quite flexible, not needing fully that under the Windows system additional software is installed can carry out, during the second way, whether the user can send according to transmitting terminal at the supervising device upper domination number, do not need to monitor a certain when including the device signal as the user like this, this can be included the data compression and the delivery module of device and close, reduce unnecessary resource consumption.
In the present embodiment,, can well solve the user and include the demand of signal source on the device, examine but this method needs the user to keep before supervising device or PC always in remote monitoring by adopting method of the present invention.So in the present embodiment, we on including device except disposing aforesaid module, also disposed and looked the audio detection module, the described audio detection module of looking is used for the video/audio that the real-time analysis radio-cassette player is being handled, rule according to prior setting detects signal, if find to have the situation of the rule of not meeting, promptly sends alarm signal to supervising device, carry out sound, light warning by supervising device, remind the operator on duty to check the video/audio signal of real-time transmission.These modules cooperatively interact, and can alleviate user's working strength to a great extent to bringing bigger flexibility ratio in user's use.
Method of the present invention is not limited to the embodiment described in the embodiment, and those skilled in the art's technical scheme according to the present invention draws other execution mode, belongs to technological innovation scope of the present invention equally.
Claims (14)
1. method that is applied in looking in the acceptance system, audio synchronous monitoring may further comprise the steps:
Step 1, data acquisition module obtains the video/audio of nothing compression and the video/audio that obtains is carried out normalization and synchronous preliminary treatment from including device;
Step 2, data compressing module receives data after the normalization from data acquisition module, and data are compressed;
Step 3, data transmission module receives the good data of compression from data compressing module, and these data in real time are sent to Data Receiving and display module in the supervising device;
Step 4, Data Receiving and display module receiving real-time data, and with these data decodes, the synchronous programme signal of output is in real time checked for the user on video and audio output device then.
2. a kind of method that is applied in looking in the acceptance system, audio synchronous monitoring as claimed in claim 1, it is characterized in that: in the step 1, include device inside and also be provided with signal processing flow, each node of signal processing flow all can carry out respective handling to signal, up to arriving the final module of including; Described data acquisition facility therefrom obtains required video/audio by adding signal processing flow.
3. a kind of method that is applied in looking in the acceptance system, audio synchronous monitoring as claimed in claim 1 is characterized in that: in the step 1, data acquisition module is placed on the front end of including module.
4. a kind of method that is applied in looking in the acceptance system, audio synchronous monitoring as claimed in claim 1, it is characterized in that: in the step 1, after getting access to original video/audio, at first video/audio is normalized to the frame encapsulating structure of identical duration according to current standard, then according to attach look, timestamp on the audio signal carries out synchronously, finding that the mode that employing when asynchronous abandons redundant data keeps data sync.
5. a kind of method that is applied in looking in the acceptance system, audio synchronous monitoring as claimed in claim 4, it is characterized in that: in normalization described in the step 1 and synchronous preprocessing process, at first original video/audio is temporarily stored in the data buffer, when the data in the data buffer surpass definite value, it is packet with data encapsulation that video/audio is sent into frame encapsulation device, sending into frame synchronizer then carries out synchronously frame of video and audio frame, described definite value is 40ms when Phase Alternation Line system, is 33.37ms when TSC-system.
6. as claim 1,2,3 or 4 described a kind of methods that are applied in looking in the acceptance system, audio synchronous monitoring, it is characterized in that: in the step 2, in compression process, be the less picture of size in advance with the video data down conversion, voice data is resampled is the low sampling rate audio frequency.
7. a kind of method that is applied in looking in the acceptance system, audio synchronous monitoring as claimed in claim 6 is characterized in that: in the step 2, compression back data are the stream medium data of low code check.
8. a kind of method that is applied in looking in the acceptance system, audio synchronous monitoring as claimed in claim 7, it is characterized in that: in compression process, adopt Windows Media to carry out data compression, corresponding with it, the data transmission module in downstream adopts MMS (Microsoft Media Server) Protocol to transmit.
9. a kind of method that is applied in looking in the acceptance system, audio synchronous monitoring as claimed in claim 8, it is characterized in that: in compression process, video image size down conversion is wide by 288 for long 352, audio frequency adopts the stereo resampling of 32KHz kilohertz, video code rate 250kbps, audio code rate establish and adopt 32kbps.
10. as claim 1,2,3 or 4 described a kind of methods that are applied in looking in the acceptance system, audio synchronous monitoring, it is characterized in that: in the step 3, the data after the compression are transmitted in real time with unicast or multicast mode on local area network (LAN).
11. as claim 1,2,3 or 4 described a kind of methods that are applied in looking in the acceptance system, audio synchronous monitoring, it is characterized in that: the agreement that the data after the compression adopt when transmission is RTSP or MMS.
12. as claim 1,2,3 or 4 described a kind of methods that are applied in looking in the acceptance system, audio synchronous monitoring, it is characterized in that, in the step 4, Data Receiving and display module are realized monitoring in the following manner: play the video of including the device transmission by mms by Windows Media Player on PC.
13. as claim 1,2,3 or 4 described a kind of methods that are applied in looking in the acceptance system, audio synchronous monitoring, it is characterized in that, in the step 4, Data Receiving and display module are realized monitoring in the following manner: embedded WMS protocol resolver and decoder on supervising device, play the video of including the device transmission by supervising device.
14. as claim 1,2,3 or 4 described a kind of methods that are applied in looking in the acceptance system, audio synchronous monitoring, it is characterized in that, in the step 4, behind Data Receiving and the display module receiving real-time data, look the video/audio that audio detection module real-time analysis radio-cassette player is being handled, rule according to prior setting detects signal, if find to have the situation of the rule of not meeting, promptly send alarm signal to supervising device, carry out sound, light warning by supervising device, remind the operator on duty to check the video/audio signal of real-time transmission.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710122453 CN101399967A (en) | 2007-09-26 | 2007-09-26 | Method for video and audio synchronous monitoring applied in recording system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710122453 CN101399967A (en) | 2007-09-26 | 2007-09-26 | Method for video and audio synchronous monitoring applied in recording system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101399967A true CN101399967A (en) | 2009-04-01 |
Family
ID=40518181
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200710122453 Pending CN101399967A (en) | 2007-09-26 | 2007-09-26 | Method for video and audio synchronous monitoring applied in recording system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101399967A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103841432A (en) * | 2012-11-26 | 2014-06-04 | 浙江大华技术股份有限公司 | Transmission method and equipment of composite video data |
| CN104967904A (en) * | 2014-04-10 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Method for recording and playing back terminal video and apparatus thereof |
-
2007
- 2007-09-26 CN CN 200710122453 patent/CN101399967A/en active Pending
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103841432A (en) * | 2012-11-26 | 2014-06-04 | 浙江大华技术股份有限公司 | Transmission method and equipment of composite video data |
| CN103841432B (en) * | 2012-11-26 | 2017-10-27 | 浙江大华技术股份有限公司 | The transmission method and equipment of a kind of composite video data |
| CN104967904A (en) * | 2014-04-10 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Method for recording and playing back terminal video and apparatus thereof |
| CN104967904B (en) * | 2014-04-10 | 2018-08-17 | 腾讯科技（深圳）有限公司 | The method and device of terminal video recording and playback |
| US10453493B2 (en) | 2014-04-10 | 2019-10-22 | Tencent Technology (Shenzhen) Company Limited | Method and apparatus for recording and replaying video of terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2901669B1 (en) | Near-end indication that the end of speech is received by the far end in an audio or video conference | |
| CN102547243B (en) | Audio and video remote monitoring method and system based on 3G (the 3rd generation telecommunication) network | |
| WO2001080492A3 (en) | Quality of service monitor for multimedia communications system | |
| WO2006039062A3 (en) | Method and apparatus for providing an alarm notification by a dispatch call | |
| CN104427286B (en) | A kind of method and system carrying out video calling | |
| KR20080046291A (en) | Clock-based time slicing | |
| CN104284098A (en) | Method and system for processing video data | |
| US20030206739A1 (en) | Audio/video IP camera | |
| CN102006452A (en) | Method for monitoring terminal through IP network and MCU | |
| CN101399967A (en) | Method for video and audio synchronous monitoring applied in recording system | |
| CN101399979A (en) | Video and audio synchronized monitoring system applied in recording system | |
| CN111770316B (en) | Audio and video encoder | |
| CN101686369B (en) | Novel wireless video doorphone system | |
| CN103139544A (en) | Internet protocol camera embedded in instant communication tool | |
| CN110213675A (en) | A kind of bimodulus intercom and system based on Internet of Things | |
| CN102164272A (en) | Method for reducing cloud deck control delay in network video monitoring platform | |
| CN201118822Y (en) | Novel wireless visual inter-speaking system | |
| CN106454276A (en) | Audio and video integration device and integrated video monitoring system | |
| CN105704422B (en) | A kind of video conference group network system and its method | |
| CN211509209U (en) | SDI video H.265 coding and decoding transmission equipment | |
| CN105763281B (en) | The method and system of OTN equipment room fast-negotiation business mapped modes | |
| CN115986944B (en) | Method for transmitting power distribution ring main unit on-line monitoring and environment monitoring data through DTU | |
| CN109600789A (en) | A kind of VoLTE voice quality MOS appraisal procedure based on commerce terminal | |
| CN109640030A (en) | A kind of audio-video peripheral expansion device and method of video conferencing system | |
| CN215010499U (en) | Railway transportation conference television terminal and conference television system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Open date: 20090401 |