CN101399979A - Video and audio synchronized monitoring system applied in recording system - Google Patents

Video and audio synchronized monitoring system applied in recording system Download PDF

Info

Publication number
CN101399979A
CN101399979A CN 200710122454 CN200710122454A CN101399979A CN 101399979 A CN101399979 A CN 101399979A CN 200710122454 CN200710122454 CN 200710122454 CN 200710122454 A CN200710122454 A CN 200710122454A CN 101399979 A CN101399979 A CN 101399979A
Authority
CN
China
Prior art keywords
audio
data
video
module
frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 200710122454
Other languages
Chinese (zh)
Inventor
朱伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Newauto Silicon Valley Video Technology Co Ltd
Original Assignee
Newauto Silicon Valley Video Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Newauto Silicon Valley Video Technology Co Ltd filed Critical Newauto Silicon Valley Video Technology Co Ltd
Priority to CN 200710122454 priority Critical patent/CN101399979A/en
Publication of CN101399979A publication Critical patent/CN101399979A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Closed-Circuit Television Systems (AREA)

Abstract

The invention relates to a synchronous monitoring system for monitoring video, audio frequency for acquisition system, belonging to acquisition monitoring field. The acquisition system of the inventive system is disposed with data acquisition module, data compression module, data transmission module; the monitoring device is disposed with data receiving module; the acquisition device is added with a compression/ transmission channel for compressing the video, audio frequency signal being processed by acquisition device to stream media data of low code rate in real time, and the stream media data is issued to monitoring device by network for direct watching/listening for related person to satisfy different needs of the acquisition system.

Description

Be applied in looking in the acceptance system, audio synchronous monitoring system
Technical field
The invention belongs to and include the monitoring field, be specifically related to a kind of system that is applied in looking in the acceptance system, audio synchronous monitoring.
Background technology
At acceptance system, particularly master control is included in the extensive acceptance system of a class, and the user need supervise the running status and the signal condition of each radio-cassette player usually in real time, with the variety of issue of guaranteeing in time to find to occur in the acceptance system, guarantees to include the quality of material.Wherein the monitoring for the radio-cassette player signal seems particularly important because it directly reflected acceptance system current handling look, audio case, the visual impression of material quality can be provided for the user.
Chang Yong scheme comprised following several in the past: 1, on radio-cassette player, increase by one look, the audio detection module, the situation of the video/audio that the real-time analysis radio-cassette player is being handled, according to certain rule signal is detected, if find not meet the situation of rule, promptly send alarm signal, carry out sound, light warning by supervising device to supervising device; 2, with the current vision signal sectional drawing of handling of radio-cassette player, send to supervising device with certain frequency, the user can see the disconnected video pictures that continues on supervising device; 3, adopt extra video wall, the signal that all radio-cassette players are being handled is connected on the video wall by equipment such as matrixes, carries out signal monitoring by video wall.
These three kinds of schemes commonly used all have its limitation at present, scheme 1 is too not directly perceived for the user, the user can only know that signal goes wrong according to methods such as indicator lights, can not see and hear current picture and sound, and utilize algorithm to carry out sound picture detection itself certain limitation is just arranged according to certain rule, be difficult to cover all signal problems, scheme 2 can take certain network bandwidth, and what the user saw is the picture that a width of cloth width of cloth is beated, and does not have the continuous sensation of TV signal, the most important thing is, adopt this mode, can't transmit sound, the user can't judge whether voice signal is normal, and scheme 3 is the most a kind of modes, signal quality is also best, but it has two weakness, at first disposes extra video wall, equipment investments such as expansion matrix are huge, in addition, what its reflected is the signal quality that inserts radio-cassette player, but not the signal quality that current radio-cassette player is being handled can't in time be found the inner problem that occurs of acceptance system, makes mistakes as IO integrated circuit board processing signals etc.
Summary of the invention
At the defective that exists in the prior art, the purpose of this invention is to provide a kind of looking in the acceptance system, audio synchronous monitoring system of being applied in, use these method and system can not take the too high network bandwidth, do not need to be equipped with expensive extras yet, can look simultaneously for the user provides intuitively, the signal of audio sync, thereby can effectively improve the acceptance system quality monitoring, better meet consumers' demand, for the developer, also provide more simple various implementation.
For reaching above purpose, the technical solution used in the present invention is:
A kind of system that is applied in looking in the acceptance system, audio synchronous monitoring comprises and includes device, supervising device, it is characterized in that, also is provided with on the device with lower module including:
Be used for obtaining the video/audio of nothing compression and the video/audio that obtains being carried out normalization and synchronous pretreated data acquisition module from including device;
Be used for receiving data after the normalization data compressing module that data are compressed from data acquisition module;
Be used for receiving the good data of compression, these data in real time be sent to the data transmission module of supervising device from data compressing module;
Also be provided with Data Receiving and display module on supervising device, this module is used for receiving real-time data, and with these data decodes, the synchronous programme signal of output is in real time checked for the user on video and audio output device then.
Further, be provided with video data buffer, frame of video wrapper, audio data buffer, audio frame wrapper, frame synchronizer in the described data acquisition module, data acquisition module is transferred to video data buffer, the audio data buffer temporary respectively from video, the voice data of including device and getting access to, carry out normalization and synchronous preliminary treatment through being transferred to frame synchronizer after frame of video wrapper, the encapsulation of audio frame wrapper respectively then.
After described data acquisition module gets access to original video/audio, at first video/audio is normalized to the frame encapsulating structure of identical duration according to current standard, then according to attach look, timestamp on the audio signal carries out synchronously, finding that the mode that employing when asynchronous abandons redundant data keeps data sync.
Described data acquisition module is in carrying out normalization and synchronous preprocessing process, at first original video/audio is temporarily stored in the data buffer, when the data in the data buffer surpass 40ms, it is the packet of 40ms/ frame with data encapsulation that video/audio is sent into frame encapsulation device, sends into frame synchronizer then frame of video and audio frame are carried out synchronously.
Further, be provided with the video downconverter that is used for the video down conversion in the described data compressing module.
Also be provided with the audio resampling device that is used for audio resampling in the described data compressing module.
Also be provided with the WMV compression set in the described data compressing module, in compression process, adopt Windows Media to carry out data compression, corresponding with it, also be provided with the MMS service unit in the described data transmission module, the data transmission module in downstream adopts MMS (Microsoft Media Server) Protocol to transmit.
Further, described Data Receiving and display module are deployed in separately on the interior any PC of local area network (LAN), play by mms by the Windows Media Player on the PC and include the video that device transmits.
Perhaps, described Data Receiving and display module are play by embedded WMS protocol resolver and decoder on the supervising device and are included the video that device transmits.
Further, the described device inside of including also is provided with the signal processing flow module, and each node of signal processing flow module all can carry out respective handling to signal, up to arriving the final module of including; Described data acquisition facility therefrom obtains required video/audio by adding the signal processing flow module.
Further, look the audio detection module including also to be provided with on the device, the described audio detection module of looking is used for the video/audio that the real-time analysis radio-cassette player is being handled, rule according to prior setting detects signal, if find to have the situation of the rule of not meeting, promptly send alarm signal, carry out sound, light warning, remind the operator on duty to check the video/audio signal of real-time transmission by supervising device to supervising device.
Effect of the present invention is: adopt method and system of the present invention, in not expanding existing acceptance system under the hardware devices circumstances, make the time to the looking of acceptance system, audio synchronous monitoring, can not take the too high network bandwidth, do not need to be equipped with expensive extras yet, can look simultaneously for the user provides intuitively, the signal of audio sync, thereby can effectively improve the acceptance system quality monitoring, better meet consumers' demand.
Description of drawings
Fig. 1 is that system of the present invention forms module and connection diagram;
Fig. 2 is the structural representation of the applied acceptance system of the present invention;
Fig. 3 is the data acquisition module fundamental diagram;
Fig. 4 is the data compression and the sending module fundamental diagram of the specific embodiment of the invention.
Embodiment
For the purpose, technical scheme and the advantage that make the embodiment of the invention is clearer,, the specific embodiment of the present invention is described in further details below in conjunction with embodiment and accompanying drawing.
The modular structure of present embodiment as shown in Figure 1, Fig. 2 is the structural representation of the applied acceptance system of the present invention.
A kind of system that is applied in looking in the acceptance system, audio synchronous monitoring comprises and includes device 21, supervising device 22, it is characterized in that, also is provided with on the device with lower module including:
Be used for obtaining the video/audio of nothing compression and the video/audio that obtains being carried out normalization and synchronous pretreated data acquisition module 11 from including device 21;
Be used for receiving data after the normalization data compressing module 12 that data are compressed from data acquisition module;
Be used for receiving the good data of compression, these data in real time be sent to the data transmission module 13 of supervising device from data compressing module;
Also be provided with Data Receiving and display module 14 on supervising device 22, this module is used for receiving real-time data, and with these data decodes, the synchronous programme signal of output is in real time checked for the user on video and audio output device then.
In the present embodiment, as shown in Figure 3, be provided with video data buffer 31, frame of video wrapper 32, audio data buffer 33, audio frame wrapper 34, frame synchronizer 35 in the described data acquisition module 11.
As shown in Figure 4, be provided with video downconverter 41, audio resampling device 42, WINDOWS MEDIA compression set 43 and MMS service unit 44 in the described data compressing module 12.
Data acquisition module 11 gets access to the video/audio that does not have compression from include data flow, video data adopts the RGB coding, and voice data adopts pcm encoder.In the present embodiment, what acceptance system was included is pal signal, i.e. 25 frame/seconds, so in the normalization process, as shown in Figure 3, at first initial data is temporarily stored in video data buffer 31, in the audio data buffer 33, in data buffer 31, when 33 data surpass 40ms, data are sent into frame encapsulation device 32, be the packet of 40ms/ frame with data encapsulation in 34, sending into 35 pairs of frame of video of frame synchronizer and audio frame then carries out synchronously, that is to say simultaneous image and voice data are aimed at that carry out according to timestamp synchronously, the operation principle of frame synchronizer 35 is as follows:
If 11 cut-in times of data acquisition module are T o, current n the audio frame zero-time of obtaining is S n, the concluding time is T n, can calculate current audio data block duration D n=T n-S n, establishing the voice data frame number that has abandoned before this is m, then n frame voice data arrives amount of audio data population deviation constantly:
Δ n = S n - T o - Σ i = 0 n - 1 Di - 40 × m ,
The video data volume population deviation in the time of in like manner can calculating the arrival of n frame video data
Figure A200710122454D00082
Just can calculate the asynchronous amount of current video/audio according to the population deviation of the population deviation of voice data and video data:
U n = Δ n - Δ n ′
When | U n|=during 40ms, illustrate that the asynchronous state of video/audio has surpassed a frame, need abandon frame data, work as U n0 o'clock, show that the voice data population deviation exceeds, video data need be abandoned a frame, will abandon the video frame number simultaneously and add 1, otherwise voice data need be abandoned a frame, simultaneously audio frequency is abandoned audio frame number m and added 1.
We adopt WINDOWS MEDIA to carry out data compression in the present embodiment, and are corresponding with it, and the data transmission module in downstream adopts MMS (Microsoft Media Server) Protocol 15 to transmit, so we merge processing with data compressing module 12 and data transmission module 13 here.Because this module will be deployed in and include the including on the device of two code streams simultaneously, because including two code streams requires very high to computing power, particularly require very high to CPU, in order to reduce data compressing module taking to CPU, adopting the video image size in the present embodiment is that length 352 is wide by 288 by long 720 wide 576 down conversions, audio frequency adopts the 32KHz kilohertz stereo, video code rate 250kbps, audio code rate is established and is adopted 32kbps, experimental results show that, go out and image in above-mentioned parameter condition lower compression, sound can reach preferable quality, simultaneously to CPU, the occupancy of the network bandwidth also relatively rationally.
At Data Receiving/display module 14 two kinds of different implementations are arranged: 1) on any PC, play the video of including the device transmission by mms by Windows Me dia Player; 2) embedded WMS protocol resolver and decoder on supervising device.Adopt first kind of mode, monitor mode is quite flexible, not needing fully that under the Windows system additional software is installed can carry out, during the second way, whether the user can send according to transmitting terminal at the supervising device upper domination number, do not need to monitor a certain when including the device signal as the user like this, this can be included the data compression and the delivery module of device and close, reduce unnecessary resource consumption.
In the present embodiment,, can well solve the user and include the demand of signal source on the device, examine but this method needs the user to keep before supervising device or PC always in remote monitoring by adopting method of the present invention.So in the present embodiment, we on including device except disposing aforesaid module, also disposed and looked the audio detection module, the described audio detection module of looking is used for the video/audio that the real-time analysis radio-cassette player is being handled, rule according to prior setting detects signal, if find not meet the situation of rule, promptly sends alarm signal to supervising device, carry out sound, light warning by supervising device, remind the operator on duty to check the video/audio signal of real-time transmission by said method.These modules cooperatively interact, and can alleviate user's working strength to a great extent to bringing bigger flexibility ratio in user's use.
System of the present invention is not limited to the embodiment described in the embodiment, and those skilled in the art's technical scheme according to the present invention draws other execution mode, belongs to technological innovation scope of the present invention equally.

Claims (11)

1. one kind is applied in looking in the acceptance system, audio synchronous monitoring system, comprises and includes device, supervising device, it is characterized in that, also is provided with on the device with lower module including:
Be used for obtaining the video/audio of nothing compression and the video/audio that obtains being carried out normalization and synchronous pretreated data acquisition module from including device;
Be used for receiving data after the normalization data compressing module that data are compressed from data acquisition module;
Be used for receiving the good data of compression, these data in real time be sent to the data transmission module of supervising device from data compressing module;
Also be provided with Data Receiving and display module on supervising device, this module is used for receiving real-time data, and with these data decodes, the synchronous programme signal of output is in real time checked for the user on video and audio output device then.
2. a kind of looking in the acceptance system, audio synchronous monitoring system of being applied in as claimed in claim 1, it is characterized in that: be provided with video data buffer, frame of video wrapper, audio data buffer, audio frame wrapper, frame synchronizer in the described data acquisition module, be transferred to video data buffer, the audio data buffer temporaryly respectively from including video, voice data that device gets access to, carry out normalization and synchronous preliminary treatment through being transferred to frame synchronizer after frame of video wrapper, the encapsulation of audio frame wrapper respectively then.
3. a kind of looking in the acceptance system, audio synchronous monitoring system of being applied in as claimed in claim 2, it is characterized in that: after described data acquisition module gets access to original video/audio, at first video/audio is normalized to the frame encapsulating structure of identical duration according to current standard, then according to attach look, timestamp on the audio signal carries out synchronously, finding that the mode that employing when asynchronous abandons redundant data keeps data sync.
4. a kind of looking in the acceptance system, audio synchronous monitoring system of being applied in as claimed in claim 3, it is characterized in that: described data acquisition module is in carrying out normalization and synchronous preprocessing process, at first original video/audio is temporarily stored in the data buffer, when the data in the data buffer surpass 40ms, it is the packet of 40ms/ frame with data encapsulation that video/audio is sent into frame encapsulation device, sends into frame synchronizer then frame of video and audio frame are carried out synchronously.
5. as claim 1,2,3 or 4 described a kind of looking in the acceptance system, audio synchronous monitoring systems of being applied in, it is characterized in that: be provided with the video downconverter that is used for the video down conversion in the described data compressing module.
6. a kind of looking in the acceptance system, audio synchronous monitoring system of being applied in as claimed in claim 5 is characterized in that: also be provided with the audio resampling device that is used for audio resampling in the described data compressing module.
7. a kind of looking in the acceptance system, audio synchronous monitoring system of being applied in as claimed in claim 6, it is characterized in that: also be provided with Windows Media compression set in the described data compressing module, in compression process, adopt Windows Media to carry out data compression, corresponding with it, also be provided with the MMS service unit in the described data transmission module, the data transmission module in downstream adopts MMS (Microsoft Media Server) Protocol to transmit.
8. as claim 1,2,3 or 4 described a kind of systems that are applied in looking in the acceptance system, audio synchronous monitoring, it is characterized in that: described Data Receiving and display module are deployed in separately on the interior any PC of local area network (LAN), play by mms by the Windows Media Player on the PC and include the video that device transmits.
9. as claim 1,2,3 or 4 described a kind of systems that are applied in looking in the acceptance system, audio synchronous monitoring, it is characterized in that: described Data Receiving and display module are play by embedded WMS protocol resolver and decoder on the supervising device and are included the video that device transmits.
10. as claim 1,2,3 or 4 described a kind of systems that are applied in looking in the acceptance system, audio synchronous monitoring, it is characterized in that: include device inside and also be provided with the signal processing flow module, each node of signal processing flow module all can carry out respective handling to signal, up to arriving the final module of including; Described data acquisition facility therefrom obtains required video/audio by adding the signal processing flow module.
11. as claim 1,2,3 or 4 described a kind of methods that are applied in looking in the acceptance system, audio synchronous monitoring, it is characterized in that, look the audio detection module including also to be provided with on the device, the described audio detection module of looking is used for the video/audio that the real-time analysis radio-cassette player is being handled, rule according to prior setting detects signal, if find to have the situation of the rule of not meeting, promptly send alarm signal to supervising device, carry out sound, light warning by supervising device, remind the operator on duty to check the video/audio signal of real-time transmission.
CN 200710122454 2007-09-26 2007-09-26 Video and audio synchronized monitoring system applied in recording system Pending CN101399979A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200710122454 CN101399979A (en) 2007-09-26 2007-09-26 Video and audio synchronized monitoring system applied in recording system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200710122454 CN101399979A (en) 2007-09-26 2007-09-26 Video and audio synchronized monitoring system applied in recording system

Publications (1)

Publication Number Publication Date
CN101399979A true CN101399979A (en) 2009-04-01

Family

ID=40518190

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200710122454 Pending CN101399979A (en) 2007-09-26 2007-09-26 Video and audio synchronized monitoring system applied in recording system

Country Status (1)

Country Link
CN (1) CN101399979A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104936021A (en) * 2015-06-02 2015-09-23 无锡天脉聚源传媒科技有限公司 Video play monitoring method and apparatus
CN115348463A (en) * 2022-07-11 2022-11-15 西安诺瓦星云科技股份有限公司 Display screen monitoring method, system, device, electronic equipment and storage medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104936021A (en) * 2015-06-02 2015-09-23 无锡天脉聚源传媒科技有限公司 Video play monitoring method and apparatus
CN104936021B (en) * 2015-06-02 2018-03-09 无锡天脉聚源传媒科技有限公司 The monitoring method and device of a kind of video playback
CN115348463A (en) * 2022-07-11 2022-11-15 西安诺瓦星云科技股份有限公司 Display screen monitoring method, system, device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
KR940000395B1 (en) Multiplexed digital packet telephones system
CN102547243B (en) Audio and video remote monitoring method and system based on 3G (the 3rd generation telecommunication) network
WO2001080492A3 (en) Quality of service monitor for multimedia communications system
WO2006039062A3 (en) Method and apparatus for providing an alarm notification by a dispatch call
WO2010080441A2 (en) Synchronization of a plurality of data streams
CN104301665B (en) Two-wire multi-channel video gate system
CN102215381A (en) Integrating device and method for integrating digital video monitoring systems
CN102006452A (en) Method for monitoring terminal through IP network and MCU
CN101252681A (en) Video monitoring system based on AVS
CN101399979A (en) Video and audio synchronized monitoring system applied in recording system
CN100466728C (en) Long-distance monitoring business realizing method, system and terminal equipment between video information terminals
CN101399967A (en) Method for video and audio synchronous monitoring applied in recording system
CN111770316B (en) Audio and video encoder
CN101686369B (en) Novel wireless video doorphone system
CN110213675A (en) A kind of bimodulus intercom and system based on Internet of Things
CN201118822Y (en) Novel wireless visual inter-speaking system
CN106454276A (en) Audio and video integration device and integrated video monitoring system
CN209419734U (en) A kind of audio-video peripheral expansion device of video conferencing system
CN101442575A (en) Method for implementing network voice system
CN105704422B (en) A kind of video conference group network system and its method
US7499461B2 (en) Gateway apparatus
CN115986944B (en) Method for transmitting power distribution ring main unit on-line monitoring and environment monitoring data through DTU
CN109640030A (en) A kind of audio-video peripheral expansion device and method of video conferencing system
CN211509209U (en) SDI video H.265 coding and decoding transmission equipment
CN202004911U (en) Audio and video signal processing device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20090401