CN102170582B - Quality of service (QoS)-based audio and video quality of experience evaluation platform and evaluation method - Google Patents
Quality of service (QoS)-based audio and video quality of experience evaluation platform and evaluation method Download PDFInfo
- Publication number
- CN102170582B CN102170582B CN 201110132701 CN201110132701A CN102170582B CN 102170582 B CN102170582 B CN 102170582B CN 201110132701 CN201110132701 CN 201110132701 CN 201110132701 A CN201110132701 A CN 201110132701A CN 102170582 B CN102170582 B CN 102170582B
- Authority
- CN
- China
- Prior art keywords
- audio
- file
- video
- looking
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention relates to a quality of service (QoS)-based audio and video quality of experience evaluation platform and a QoS-based audio and video quality of experience evaluation method. The method comprises that: an audio and video coding module codes a multimedia file into an audio and video source file in a given format; an audio and video transmission module encapsulates the audio and video source file into a data packet, and transmits the data packet to a network; a network simulation module simulates the non-destruction or destruction of an actual network environment by the setting of network parameters to obtain a non-destructive or destructive network environment; an audio and video receiving module decapsulates the data packet on the network and dumps decapsulated data into a reference audio and video file in the non-destructive network environment, and receives the destructive data packet on the network, decapsulates the received data packet and dumps the decapsulated data into a test audio and video file in the destructive network environment; an audio and video decoding module separates video tracks and audio tracks in the reference audio and video file and the test audio and video file, and decodes the video tracks and the audio tracks into a video format and an audio format required by evaluation respectively; and finally an audio and video quality evaluation module evaluates video files and audio files respectively.
Description
Technical field
The present invention relates to a kind of audio experience quality assessment technology of looking, espespecially a kind ofly look audio experience quality assessment platform and evaluating method based on QoS.
Background technology
Along with the development of the Internet, IPTV just constantly is deep in the middle of the increasing family as a new business.IPTV is the infrastructure of utilizing broadband cabled television network, as main terminal appliance, provides the multiple digital media service that comprises TV programme with domestic television set by internet protocol.IPTV has very flexibly interaction characteristic, because have the symmetrical mutual innate advantage of the Internet, its program can adopt the multiple published methods such as broadcasting, multicast or clean culture in net.Can realize very neatly the several functions such as electronic menu, displaying predetermined programme, in real time F.F., rewind down, terminal account number and accounting management, Promgramming.
Yet the Internet is a kind of transmission of doing one's best (Best-effort) network, and the situations such as the bandwidth variation in the transmission course of Streaming Media, packet loss, shake, time delay happen occasionally, and they can experience the generation adverse influence to the user.In the past to network service quality (Quality of Service, be called for short QoS) research be to improve network performance and whole resource utilization is purpose, what IPTV service provider paid close attention to then is user's impression, QoS obviously can't satisfy this requirement, therefore, in order to reflect more really user's experience impression, need to introduce the satisfaction of watching that user experience quality (Quality of Experience is called for short QoE) is described the user.
IPTV has mixed track of video and audio track in transmission course, and up to the present, most of research only is to carry out for simple video QoE and audio frequency QoE, in addition, the qos parameter of real network environment is uncontrollable, be unfavorable for the collection of experimental data, therefore, be necessary to propose a kind of for look QoE after the audio mix study and do not rely on live network based on QoS look audio experience quality (QoE) evaluation and test platform and evaluating method, just become present industry problem anxious to be overcome.
Summary of the invention
In view of the shortcoming of above-mentioned prior art, the object of the invention is to provide a kind of and looks audio experience quality assessment platform and evaluating method for what look QoE after the audio mix studies and do not rely on live network based on QoS.
For achieving the above object, the audio experience quality assessment platform of looking based on QoS provided by the present invention comprises: the video encoding module, and it is used for looking the audio-source file with what multimedia file was encoded into the prescribed coding form; Depending on the audio frequency sending module, it connects described video encoding module, and is used for the described audio-source file of looking is packaged into packet according to the host-host protocol of appointment, and sends on the network; The network simulation module, the one end is connected with described video sending module, and in order to by to the setting of network parameter, the not damaged of artificial actual network environment or damage is arranged is to obtain lossless network environment or lossy networks environment; Depending on the audio frequency receiver module, its other end with described network simulation module is connected, and under the lossless network environment that described network simulation module provides, described packet is unpacked, dump is looked audio file for reference again, and under the lossy networks environment that the network simulation module provides, receives impaired packet on the network, and to the compensation of encoding of damaged data bag, look audio file take recompile and dump as test; Depending on the audio decoder module, its with look the audio frequency receiver module and be connected, look audio file and test track of video and the audio track of looking in the audio file for separating of the reference of institute's dump, and these two tracks are decoded as respectively for the video file of the video format of evaluating and testing and the audio file of audio format; And look audio quality and evaluate and test module, its with look the audio decoder module and be connected, with the video file under the lossless network environment and audio file as the evaluation and test reference paper, with the video file under the lossy networks environment and audio file as the evaluation and test test file, depending on the audio experience quality evaluation.
In addition, the present invention also provides a kind of evaluating method of looking audio experience quality assessment platform based on QoS, it is to build looking on the audio experience quality assessment platform based on QoS, described evaluation and test platform comprises the video encoding module, looks the audio frequency sending module, the network simulation module, look the audio frequency receiver module, look the audio decoder module and look audio quality evaluation and test module, this evaluating method comprises: 1) form of Audio and Video is encoded to the coded format that is fit to Internet Transmission by the video encoding module, and is packaged into and looks the audio-source file; 2) by the network simulation module network parameter is arranged, the not damaged of artificial actual network environment is to obtain the lossless network environment; 3) will look the audio-source file and be packaged into packet and send on the described lossless network by looking the audio frequency sending module; 4) the audio frequency receiver module unpacks broadcast with the packet on the network and simultaneously dump is looked audio file for reference by looking; 5) again network parameter is arranged by the network simulation module, the damage of artificial actual network environment is to obtain the lossy networks environment; 6) again will look the audio-source file and be packaged into packet and send on the lossy networks that described network simulation module provides by looking the audio frequency sending module; 7) the audio frequency receiver module unpacks broadcast again with packet impaired on the network and simultaneously dump is looked audio file for test by looking; 8) audio file is looked in the reference of institute's dump is separated with audio track with the test track of video of looking in the audio file by looking the audio decoder module, and be decoded as separately the video file of evaluating and testing needed video format and the audio file of audio format; And 9) by looking audio quality evaluation and test module decode video file and the audio file that generates estimated respectively, obtained looking audio experience quality assessment result.
In the evaluating method of looking audio experience quality assessment platform based on QoS of the present invention, also comprise following preparation process: a) the network simulation module adopts NIST Net software emulation real network environmental damage, set the qos parameters such as time-delay, shake, packet loss, bandwidth, and start NIST Net simulation software; And b) describedly look the audio frequency sending module and look the audio frequency receiver module and all adopt VLC software, selecting host-host protocol is RTP/MPEG Transport Stream, and the transcoding function of cancellation acquiescence starts VLC software at last.In addition, above-mentioned steps 3) further comprise: look the transmission of audio frequency sending module startup VLC software and look the audio-source file to described lossless network.Above-mentioned steps 4) further comprises: 4-1) look the audio frequency receiver module and start VLC software and open corresponding port monitoring, wait for that looking the transmission of audio frequency sending module looks the audio-source file; And 4-2) look the audio frequency receiver module and detect and look the audio-source file, then play the described audio-source file of looking, what will receive simultaneously looks the audio-source file dumping for reference to looking audio file.
In addition, above-mentioned steps 1) further comprise: 1-1) utilize ffmpeg with the video source file of Video coding for the stream media format of suitable Internet Transmission; 1-2) utilize ffmpeg with the audio-source file of audio coding for the stream media format of suitable Internet Transmission; And 1-3) utilizes ffmpeg that video source file and audio-source file are packaged into and look the audio-source file, and be written into and be fit to the looking in the audio container of Internet Transmission.
Above-mentioned steps 5), 6) and 7) further comprise: 5-1) open Network Simulation Software NIST Net, the network parameter of emulation is arranged, the damage of artificial actual network environment is to obtain the lossy networks environment; 6-1) look the transmission of audio frequency sending module startup VLC software and look the audio-source file to described lossy networks; And 7-1) looking the audio frequency receiver module starts VLC software and opens corresponding port monitoring, wait is looked the transmission of audio frequency sending module and is looked the audio-source file, when detecting when looking the audio-source file, then play the described audio-source file of looking, the audio-source file dumping of looking that will receive is simultaneously looked audio file for test.
Above-mentioned steps 8) further comprise: 8-1) utilize ffmpeg with reference to the reference video file of looking track of video in the audio file and be decoded as yuv format, audio track is decoded as the reference audio file of WAV form; And 8-2) utilize ffmpeg that the test video file that track of video in the audio file is decoded as yuv format is looked in test, audio track is decoded as the testing audio file of WAV form.
Above-mentioned steps 9) further comprises: 9-1) utilize the BVQM evaluating software that the reference video file of yuv format and the test video file of yuv format are evaluated and tested, obtain quality of experience of video value (MOSv); 9-2) utilize the PESQ evaluating software that the reference audio file of audio file WAV form and the testing audio file of WAV form are evaluated and tested, obtain audio experience quality assessment value (MOSa); And 9-3) utilize mixed formulation to obtain the final audio experience quality assessment value (MOSm) of looking.
Below in conjunction with technique scheme, useful technique effect of the present invention is described.Than prior art, the present invention is encoded to multimedia file the coded format that is fit to Internet Transmission by the video encoding module, and be packaged into and look the audio-source file, by looking the audio frequency sending module it is packaged into packet and sends to network again, follow by the network simulation module by the setting to network parameter, the not damaged of artificial actual network environment or damage is arranged, to obtain lossless network environment or lossy networks environment, accordingly with by looking the audio frequency receiver module under the lossless network environment, packet on the network is unpacked again dump look audio file for reference, and under the lossy networks environment, impaired packet again unpacks also dump and looks audio file for test on the reception network, then, separate with audio track with the track of video that test is looked in the audio file with reference to looking audio file by looking the audio decoder module, and be decoded as separately evaluation and test needed video format and audio format, at last, by looking audio quality evaluation and test module video file and audio file are estimated respectively, analog subscriber is watched the whole process of multimedia video thus, than traditional system's better authenticity of utilizing live network to simulate, stability, accuracy and repeatability.
Description of drawings
Fig. 1 is the block schematic diagram of the quality of experience of video platform based on QoS of the present invention.
Fig. 2 is for using the quality of experience of video platform based on QoS of the present invention and postponing for 100ms, be dithered as the NIST Net software simulation design sketch of 10ms.
Fig. 3 is for using the graph of a relation between the General Model video objective evaluation of estimate (VQM) and subjective assessment value (Subjective) among the quality of experience of video platform based on QoS of the present invention and the BVQM.
Fig. 4 is the operating procedure flow chart of the evaluating method of looking audio experience quality assessment platform based on QoS of the present invention.
Fig. 5 is the graph of a relation between heterogeneous networks damage and the quality of experience of video (MOSv).
Fig. 6 is the graph of a relation between heterogeneous networks damage and the audio experience quality (MOSa).
Fig. 7 is that heterogeneous networks damages and look the graph of a relation between the audio experience quality (MOSm).
[main element symbol description]
11 video encoding modules
12 look the audio frequency sending module
13 network simulation modules
14 look the audio frequency receiver module
15 look the audio decoder module
16 look audio quality evaluation and test module
S10～S18 step
Embodiment
Below by specific instantiation explanation embodiments of the present invention, those of ordinary skill in the field can understand other advantages of the present invention and effect easily by content disclosed in the present specification.The present invention also can be implemented or be used by other different instantiations, and the every details in this specification also can be based on different viewpoints and application, carries out various modifications and change under the spirit of the present invention not deviating from.
See also Fig. 1, it is for showing the block schematic diagram of looking audio experience quality assessment platform based on QoS of the present invention, as shown in the figure, looking audio experience quality assessment platform comprises video encoding module 11, looks audio frequency sending module 12, network simulation module 13, look audio frequency receiver module 14, look audio decoder module 15 and look audio quality evaluation and test module 16 based on QoS of the present invention.Below namely cooperate Fig. 2 and 3 describe in detail QoS of the present invention look audio experience quality assessment platform on take off each module.
Connect video encoding module 11 depending on audio frequency sending module 12, and be packaged into packet for this being looked the host-host protocol of audio-source file according to appointment, and send on the network.In the present embodiment, this is looked audio frequency sending module 12 and adopts VLC software, the host-host protocol of appointment is RTP/MPEG Transport Stream, VLC is a playout software of increasing income, has cross-platform characteristic, it supports numerous audio ﹠ video decoders and file format, also can under connecting, use the express network of IPv4 or IPv6 as unicast or multicast streaming media server, start VLC, open corresponding port network is monitored, in case just can play the video-voice frequency flow dump that to receive for looking audio file while receive the video-voice frequency flow media information.
One end of network simulation module 13 is connected with this video sending module 12, and in order to by the setting to the network parameter of want emulation, the not damaged of artificial actual network environment or damage is arranged is to obtain lossless network environment or lossy networks environment.In the present embodiment, the NIST Net software that this network simulation module 13 adopts NIST to provide, NIST Net is the Network Simulation Software that is provided by the NIST of American National Standard technical research institute, it realizes control to qos parameter having higher precision at the level of operating system nucleus, starts NIST Net software, set therein qos parameter, begin to start emulation, and can by adjusting the QoS parameters, realize the emulation to network delay, shake and packet loss characteristic variations situation; Fig. 2 is that the delay that NIST Net arranges is 100ms, the simulate effect figure when being dithered as 10ms.
Be connected depending on the other end of audio frequency receiver module 14 with network simulation module 13, and under the lossless network environment that this network simulation module 15 provides, described packet is unpacked, dump is looked audio file for reference again, and under the lossy networks environment that network simulation module 15 provides, receive impaired packet on the network, and to the compensation of encoding of damaged data bag, look audio file take recompile and dump as testing.In the present embodiment, this is looked audio frequency receiver module 14 and adopts VLC software.
Depending on audio decoder module 15 with look audio frequency receiver module 14 and be connected, look audio file and test track of video and the audio track of looking in the audio file for separating of the reference of institute's dump, and these two tracks are decoded as respectively for the video file of the video format of evaluating and testing and the audio file of audio format.In the present embodiment, this is looked audio decoder module 15 and adopts ffmpeg, the video format that is used for evaluation and test is yuv format, the audio format that is used for evaluation and test is the WAV form, the track of video that is about to look in the audio file is decoded as yuv format, the audio track of looking in the audio file is decoded as the WAV form, and ffmpeg is a free software, the total solution that it provides and has recorded, conversion and fluidisation are looked audio frequency.
Depending on audio quality evaluation and test module 16 with look audio decoder module 15 and be connected, with the video file under the lossless network environment and audio file as the evaluation and test reference paper, with the video file under the lossy networks environment and audio file as the evaluation and test test file, depending on the audio experience quality evaluation.In the present embodiment, video quality evaluation software BVQM and PESQ software that audio quality evaluation module 16 uses ITS to provide are provided for this, wherein, BVQM is a quality evaluation software for video of American I TS organization development, its evaluation method and calibration steps are respectively by ITU-T Recommendation J.144, ITU-T Recommendation J.244 standard includes, has higher evaluation precision, calculating by BVQM, can obtain [0,1] the video objective evaluation of estimate (VQM) on the interval, Fig. 3 is the relation between VQM and the subjective assessment value (Subjective), both Pearson came linearly dependent coefficients are 0.948, therefore the subjective assessment value of selecting BVQM to weigh the user has higher accuracy, and PESQ is a objective audio quality testing software, is mainly used in the evaluation and test of communication sound intermediate frequency.
Use above-mentioned based on QoS look audio experience quality assessment platform, can obtain the operating process of looking audio experience quality assessment method based on QoS as shown in Figure 4.As shown in Figure 4, execution in step S10 at first is encoded to the coded format that is fit to Internet Transmission by the video encoding module with the form of Audio and Video, and is packaged into and looks the audio-source file.Preferably, in the present embodiment, at first, utilize ffmpeg with the video source file of Video coding for the stream media format of suitable Internet Transmission; Then, utilize ffmpeg with the audio-source file of audio coding for the stream media format of suitable Internet Transmission; At last, utilize ffmpeg that video source file and audio-source file are packaged into and look the audio-source file, and be written into and be fit to the looking in the audio container of Internet Transmission.Then, carry out step S11.
At step S11, by the network simulation module network parameter is arranged, the not damaged of artificial actual network environment is to obtain the lossless network environment.Then, carry out step S12.
At step S12, to look the audio-source file and be packaged into packet and send on this lossless network by looking the audio frequency sending module, in the present embodiment, this is looked the audio frequency sending module and adopts VLC software, selecting host-host protocol is RTP/MPEG Transport Stream, the transcoding function of cancellation acquiescence starts VLC software at last, and transmission is looked the audio-source file to this lossless network.Then, carry out step S13.
At step S13, by look the audio frequency receiver module with the packet on the network unpack play and simultaneously dump for reference to looking audio file, audio file is looked in the reference during as evaluation and test.In the present embodiment, namely start VLC software and open corresponding port monitoring by looking the audio frequency receiver module, wait is looked the transmission of audio frequency sending module and is looked the audio-source file, when detecting when looking the audio-source file, then play this and look the audio-source file, the audio-source file dumping of looking that will receive is simultaneously looked audio file for reference.Then, carry out step S14.
At step S14, again network parameter is arranged by the network simulation module, the damage of artificial actual network environment, to obtain the lossy networks environment, in the present embodiment, this network simulation module adopts NIST Net software emulation real network environmental damage, sets the qos parameters such as time-delay, shake, packet loss, bandwidth, to obtain the lossy networks environment.Then, carry out step S15.
At step S15, again will look the audio-source file and be packaged into packet and send on the lossy networks that described network simulation module provides by looking the audio frequency sending module, in the present embodiment, this is looked the transmission of audio frequency sending module startup VLC software and looks the audio-source file to this lossy networks.Then, carry out step S16.
At step S16, packet impaired on the network is unpacked again play and simultaneously dump is looked audio file for test by looking the audio frequency receiver module, audio file is looked in the test during as evaluation and test.In the present embodiment, this is looked the audio frequency receiver module and starts VLC software and open corresponding port monitoring, wait is looked the transmission of audio frequency sending module and is looked the audio-source file, when detecting when looking the audio-source file, then play this and look the audio-source file, the audio-source file dumping of looking that will receive is simultaneously looked audio file for test.Then, carry out step S17.
At step S17, audio file is looked in the reference of institute's dump is separated with audio track with the test track of video of looking in the audio file by looking the audio decoder module, and be decoded as separately the video file of evaluating and testing needed video format and the audio file of audio format.In the present embodiment, namely utilize ffmpeg with reference to the reference video file of looking track of video in the audio file and be decoded as yuv format, audio track is decoded as the reference audio file of WAV form, utilize simultaneously ffmpeg that the test video file that track of video in the audio file is decoded as yuv format is looked in test, audio track is decoded as the testing audio file of WAV form.Then, carry out step S18.
At step S18, by looking audio quality evaluation and test module decode video file and the audio file that generates estimated respectively, obtain looking audio experience quality assessment result.In the present embodiment, at first be to utilize the BVQM evaluating software that the reference video file of yuv format and the test video file of yuv format are evaluated and tested, obtain quality of experience of video value (MOSv); Then, utilize the PESQ evaluating software that the reference audio file of audio file WAV form and the testing audio file of WAV form are evaluated and tested, obtain audio experience quality assessment value (MOSa); Then, utilize mixed formulation to obtain the final audio experience quality assessment value (MOSm) of looking.
For quality of experience of video platform and evaluating method based on QoS of the present invention are used in more detailed understanding, below in conjunction with Fig. 5 to 7 and take video encoding module 11 with look audio decoder module 15 and adopt ffmpeg, network simulation module 13 to adopt NIST Net softwares and look audio quality evaluation and test module 16 and adopt BVQM and PESQ software as example, come application the present invention evaluate and test packet loss (drop) and the shake (jitter) on looking the impact of audio quality, specifically evaluate and test step as follows:
1) choose a multimedia file, with ffmpeg it is encoded, coded format is as follows:
Video coding: mpeg-4, resolution: 320x240, code check 512kbps, frame per second 30fps;
Audio coding: mp3, sample rate: 48000HZ, code check: 128kbps, channel number: 2;
Container: mp4.
2) parameters is in NIST Net: postpone: 0ms; Shake: 0ms; Packet loss: 0%, to obtain the lossless network environment;
3) open VLC receiving terminal (namely looking the audio frequency receiver module), it is 5004 that receiving port is set, and monitors;
4) open VLC transmitting terminal (namely looking the audio frequency sending module), select step 1) in encoded look the audio-source file, it is RTP/MPEG Transport Stream that host-host protocol is set, the target port of transmission is 5004, the purpose IP address of transmission is the address of VLC receiving terminal IP, begins transmission;
5) the audio-source file of looking that the VLC receiving terminal is received is looked audio file (MultiMedia_ref) as the reference of evaluation and test;
6) in NIST Net, reset again following parameter:
Postpone: 100ms; Shake: 0ms, 2ms, 5ms, 10ms, 20ms; Packet loss: 0%, 1%, 2%, 5%, 7%, to obtain the lossy networks environment;
Repeating step 3) and step 4), with the VLC receiving terminal receive look the audio-source file as the evaluation and test test look audio file (MultiMedia_test).
7) utilize ffmpeg to be decoded as the reference video file (Video_ref.yuv) of yuv format and the reference audio file (Audio_ref.wav) of WAV form with reference to looking audio file; Simultaneously, test is looked audio file and be decoded as the test video file (Video_test.yuv) of yuv format and the testing audio file (Audio_test.wav) of WAV form.
8) utilize BVQM that Video_ref.yuv and Video_test.yuv are evaluated and tested, obtain quality of experience of video (MOSv) evaluation result; Utilize PESQ that Audio_ref.wav and Audio_test.wav are evaluated and tested, obtain audio experience quality (MOSa) evaluation result.
9) with (MOSv) and (MOSa) linear transformation to [0,5] on the interval, obtain respectively the graph of a relation between heterogeneous networks damage (packet loss and shake) and the quality of experience of video (MOSv) as shown in Figure 5 and heterogeneous networks shown in Figure 6 damages and audio experience quality (MOSa) between graph of a relation, by mixed formulation (MOSm)=f ((MOSv), (MOSa)) obtain final audio experience quality (MOSm) evaluation result of looking, get temporarily f (x herein, y)=min (x, y), namely obtain heterogeneous networks damage as shown in Figure 7 and look graph of a relation between the audio experience quality (MOSm).
In sum, the present invention mainly is encoded to multimedia file the coded format that is fit to Internet Transmission by the video encoding module, and be packaged into and look the audio-source file, this is looked the audio-source file be packaged into packet and send to network by looking the audio frequency sending module again, follow by the network simulation module by the setting to network parameter, the not damaged of artificial actual network environment or damage is arranged, to obtain lossless network environment or lossy networks environment, accordingly with by looking the audio frequency receiver module under the lossless network environment, packet on the network is unpacked again dump look audio file for reference, and under the lossy networks environment, impaired packet again unpacks also dump and looks audio file for test on the reception network, then, separate with audio track with the track of video that test is looked in the audio file with reference to looking audio file by looking the audio decoder module, and be decoded as separately evaluation and test needed video format and audio format, at last, by looking audio quality evaluation and test module video file and audio file are estimated respectively, realization is studied for the QoE that looks after the audio mix, analog subscriber is watched the whole transmission of the video-voice frequency flow media such as IPTV thus, transmission, receive, the process of playing, in order to evaluating and testing user's subjective Quality of experience (QoE), system's better authenticity of simulating than dependence live network in the past, stability, accuracy and repeatability.
Above-described embodiment is illustrative principle of the present invention and effect thereof only, but not is used for restriction the present invention.Any person of an ordinary skill in the technical field all can be under spirit of the present invention and category, and above-described embodiment is modified and changed.Therefore, the scope of the present invention should be listed such as the scope of appending claims.
Claims (9)
- One kind based on QoS look audio experience quality assessment platform, it is characterized in that, described evaluation and test platform comprises:The video encoding module, it is used for looking the audio-source file with what multimedia file was encoded into the prescribed coding form;Depending on the audio frequency sending module, it connects described video encoding module, and is used for the described audio-source file of looking is packaged into packet according to the host-host protocol of appointment, and sends on the network;The network simulation module, the one end is connected with the described audio frequency sending module of looking, and in order to by to the setting of network parameter, the not damaged of artificial actual network environment or damage is arranged is to obtain lossless network environment or lossy networks environment;Depending on the audio frequency receiver module, its other end with described network simulation module is connected, and under the lossless network environment that described network simulation module provides, described packet is unpacked, dump is looked audio file for reference again, and under the lossy networks environment that the network simulation module provides, receives impaired packet on the network, and to the compensation of encoding of damaged data bag, look audio file take recompile and dump as test;Depending on the audio decoder module, its with look the audio frequency receiver module and be connected, look audio file and test track of video and the audio track of looking in the audio file for separating of the reference of institute's dump, and these two tracks are decoded as respectively for the video file of the video format of evaluating and testing and the audio file of audio format; AndDepending on audio quality evaluation and test module, its with look the audio decoder module and be connected, with the video file under the lossless network environment and audio file as the evaluation and test reference paper, with the video file under the lossy networks environment and audio file as the evaluation and test test file, depending on the audio experience quality evaluation.
- 2. evaluating method of looking audio experience quality assessment platform based on QoS, it is to build looking on the audio experience quality assessment platform based on QoS, described evaluation and test platform comprises the video encoding module, looks the audio frequency sending module, the network simulation module, look the audio frequency receiver module, look the audio decoder module and look audio quality evaluation and test module, it is characterized in that, described evaluating method comprises:1) form of Audio and Video is encoded to the coded format that is fit to Internet Transmission by the video encoding module, and is packaged into and looks the audio-source file;2) by the network simulation module network parameter is arranged, the not damaged of artificial actual network environment is to obtain the lossless network environment;3) will look the audio-source file and be packaged into packet and send on the described lossless network by looking the audio frequency sending module;4) the audio frequency receiver module unpacks broadcast with the packet on the network and simultaneously dump is looked audio file for reference by looking;5) again network parameter is arranged by the network simulation module, the damage of artificial actual network environment is to obtain the lossy networks environment;6) again will look the audio-source file and be packaged into packet and send on the lossy networks that described network simulation module provides by looking the audio frequency sending module;7) the audio frequency receiver module unpacks broadcast again with packet impaired on the network and simultaneously dump is looked audio file for test by looking;8) audio file is looked in the reference of institute's dump is separated with audio track with the test track of video of looking in the audio file by looking the audio decoder module, and be decoded as separately the video file of evaluating and testing needed video format and the audio file of audio format; And9) by looking audio quality evaluation and test module decode video file and the audio file that generates estimated respectively, obtained looking audio experience quality assessment result.
- 3. the evaluating method of looking audio experience quality assessment platform based on QoS according to claim 2 is characterized in that, also comprises following preparation process:A) the network simulation module adopts NIST Net software emulation real network environmental damage, sets time-delay, shake, packet loss, bandwidth qos parameter, and starts NIST Net simulation software; AndB) describedly look the audio frequency sending module and look the audio frequency receiver module and all adopt VLC software, selecting host-host protocol is RTP/MPEG Transport Stream, and the transcoding function of cancellation acquiescence starts VLC software at last.
- 4. the evaluating method of looking audio experience quality assessment platform based on QoS according to claim 3 is characterized in that described step 3) further comprise: look the transmission of audio frequency sending module startup VLC software and look the audio-source file to described lossless network.
- 5. the evaluating method of looking audio experience quality assessment platform based on QoS according to claim 4 is characterized in that described step 4) further comprise:4-1) look the audio frequency receiver module and start VLC software and open corresponding port monitoring, wait for that looking the transmission of audio frequency sending module looks the audio-source file; And4-2) look the audio frequency receiver module and detect and look the audio-source file, then play the described audio-source file of looking, what will receive simultaneously looks the audio-source file dumping for reference to looking audio file.
- 6. the evaluating method of looking audio experience quality assessment platform based on QoS according to claim 2 is characterized in that described step 1) further comprise:1-1) utilize ffmpeg with the video source file of Video coding for the stream media format of suitable Internet Transmission;1-2) utilize ffmpeg with the audio-source file of audio coding for the stream media format of suitable Internet Transmission; And1-3) utilize ffmpeg that video source file and audio-source file are packaged into and look the audio-source file, and be written into and be fit to the looking in the audio container of Internet Transmission.
- 7. the evaluating method of looking audio experience quality assessment platform based on QoS according to claim 2 is characterized in that described step 5), 6) and 7) further comprise:5-1) open Network Simulation Software NIST Net, the network parameter of emulation is arranged, the damage of artificial actual network environment is to obtain the lossy networks environment;6-1) look the transmission of audio frequency sending module startup VLC software and look the audio-source file to described lossy networks; And7-1) looking the audio frequency receiver module starts VLC software and opens corresponding port monitoring, wait is looked the transmission of audio frequency sending module and is looked the audio-source file, when detecting when looking the audio-source file, then play the described audio-source file of looking, the audio-source file dumping of looking that will receive is simultaneously looked audio file for test.
- 8. the evaluating method of looking audio experience quality assessment platform based on QoS according to claim 2 is characterized in that described step 8) further comprise:8-1) utilize ffmpeg with reference to the reference video file of looking track of video in the audio file and be decoded as yuv format, audio track is decoded as the reference audio file of WAV form; And8-2) utilize ffmpeg that the test video file that track of video in the audio file is decoded as yuv format is looked in test, audio track is decoded as the testing audio file of WAV form.
- 9. the evaluating method of looking audio experience quality assessment platform based on QoS according to claim 8 is characterized in that described step 9) further comprise:9-1) utilize batch video quality evaluating software that the reference video file of yuv format and the test video file of yuv format are evaluated and tested, obtain quality of experience of video value (MOSv);9-2) utilize the PESQ evaluating software that the reference audio file of audio file WAV form and the testing audio file of WAV form are evaluated and tested, obtain audio experience quality assessment value (MOSa); And9-3) utilize mixed formulation to obtain the final audio experience quality assessment value (MOSm) of looking, described mixed formulation is (MOSm)=f ((MOSv), (MOSa)), wherein, MOSv is expressed as quality of experience of video, and MOSa is expressed as the audio experience quality.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110132701 CN102170582B (en) | 2011-05-20 | 2011-05-20 | Quality of service (QoS)-based audio and video quality of experience evaluation platform and evaluation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110132701 CN102170582B (en) | 2011-05-20 | 2011-05-20 | Quality of service (QoS)-based audio and video quality of experience evaluation platform and evaluation method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102170582A CN102170582A (en) | 2011-08-31 |
| CN102170582B true CN102170582B (en) | 2013-02-13 |
Family
ID=44491535
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201110132701 Expired - Fee Related CN102170582B (en) | 2011-05-20 | 2011-05-20 | Quality of service (QoS)-based audio and video quality of experience evaluation platform and evaluation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102170582B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8897144B2 (en) * | 2011-10-14 | 2014-11-25 | T-Mobile Usa, Inc. | Quality of user experience testing for video transmissions |
| CN102843573A (en) * | 2012-07-16 | 2012-12-26 | 上海大学 | Video transmission quality evaluation method implemented by using QoS (quality of service) parameters of wireless local area networks |
| CN103634577B (en) | 2012-08-22 | 2014-12-31 | 华为技术有限公司 | Multimedia quality monitoring method and apparatus |
| CN104539943B (en) * | 2012-08-22 | 2017-01-04 | 华为技术有限公司 | The monitoring method and apparatus of multimedia quality |
| CN102932665A (en) * | 2012-11-14 | 2013-02-13 | 北京汉邦高科数字技术股份有限公司 | Method for testing decoding performance of network hard disk video recorder |
| CN103475896A (en) * | 2013-07-24 | 2013-12-25 | 同济大学 | Interactive video and audio experience-quality assessment platform and method based on Qos |
| CN103841412B (en) * | 2014-03-18 | 2016-03-02 | 北京邮电大学 | A kind of Internet video quality measurement of user experience method and apparatus |
| CN105430383A (en) * | 2015-12-07 | 2016-03-23 | 广东电网有限责任公司珠海供电局 | Method for evaluating experience quality of video stream media service |
| CN108650550B (en) * | 2018-07-05 | 2021-06-25 | 平安科技（深圳）有限公司 | Network transmission quality analysis method and device, computer equipment and storage medium |
| CN111614923A (en) * | 2019-02-25 | 2020-09-01 | 疯壳(深圳)科技有限公司 | Network real-time communication method and system thereof |
| CN114071131B (en) * | 2022-01-07 | 2022-04-15 | 军事科学院系统工程研究院网络信息研究所 | Test device, method, electronic device, and medium for video encoding and decoding device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1487217A2 (en) * | 2003-06-13 | 2004-12-15 | Microsoft Corporation | Robust delivery of video data |
| CN1938972A (en) * | 2004-01-30 | 2007-03-28 | Sk电信有限公司 | Methods and apparatuses for measuring transmission quality of multimedia data |
| CN101841733A (en) * | 2009-03-19 | 2010-09-22 | 富士通株式会社 | Information Acquisition System, data obtain device and data preparation method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009188674A (en) * | 2008-02-05 | 2009-08-20 | Fujitsu Ltd | Transmitting apparatus, receiving apparatus, moving image sound transmission quality evaluating method, and moving image sound transmission quality evaluation program |
-
2011
- 2011-05-20 CN CN 201110132701 patent/CN102170582B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1487217A2 (en) * | 2003-06-13 | 2004-12-15 | Microsoft Corporation | Robust delivery of video data |
| CN1938972A (en) * | 2004-01-30 | 2007-03-28 | Sk电信有限公司 | Methods and apparatuses for measuring transmission quality of multimedia data |
| CN101841733A (en) * | 2009-03-19 | 2010-09-22 | 富士通株式会社 | Information Acquisition System, data obtain device and data preparation method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102170582A (en) | 2011-08-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102170582B (en) | Quality of service (QoS)-based audio and video quality of experience evaluation platform and evaluation method | |
| US11665384B2 (en) | Method and apparatus for transmitting media data in multimedia transport system | |
| KR101594351B1 (en) | Streaming of multimedia data from multiple sources | |
| CN102263959B (en) | Direct broadcast transfer method and system | |
| AU2008202703B2 (en) | Apparatus and method for providing multimedia content | |
| CN101594552B (en) | Testing method for IPTV service quality damage by network transmission | |
| CN101009824A (en) | A network transfer method for audio/video data | |
| CN103002353A (en) | Method and device for packaging multimedia documents | |
| TWI591999B (en) | Carriage of media content quality information | |
| CN103517135A (en) | Method, system and television capable of playing MP4-format video files continuously | |
| CN102098585A (en) | Method for intelligently playing web television | |
| CN103763588A (en) | Stream forwarding method, device, server and system for video advertising insertion | |
| CN112616065A (en) | Screen image initiating method and device, computer equipment, readable storage medium and screen image presenting system | |
| CN108494792A (en) | A kind of flash player plays the converting system and its working method of hls video flowings | |
| CN115552914A (en) | System and method for enhanced multimedia signal broadcasting, reception, data delivery and data collection | |
| CN105430510A (en) | Video on demand method, gateway, smart terminal and video on demand system | |
| CN102223262B (en) | Evaluation platform and method of quality of experience of video based on QoS | |
| Wang et al. | A study on QoS/QoE correlation model in wireless-network | |
| CN103024441B (en) | A kind of method of playing television program at mobile terminal | |
| CN103475896A (en) | Interactive video and audio experience-quality assessment platform and method based on Qos | |
| Jiménez et al. | The upstream matters: impact of uplink performance on YouTube 360 live video streaming in LTE | |
| Ksentini et al. | QoE-oriented adaptive SVC decoding in DVB-T2 | |
| CN109104635A (en) | The method and system of instant delivery screen picture | |
| CN104869474A (en) | Expansible mobile streaming media system and application method thereof | |
| CN112437263A (en) | Video plug flow method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130213 Termination date: 20150520 |
|
| EXPY | Termination of patent right or utility model |