CN102170582A - Quality of service (QoS)-based audio and video quality of experience evaluation platform and evaluation method - Google Patents
Quality of service (QoS)-based audio and video quality of experience evaluation platform and evaluation method Download PDFInfo
- Publication number
- CN102170582A CN102170582A CN 201110132701 CN201110132701A CN102170582A CN 102170582 A CN102170582 A CN 102170582A CN 201110132701 CN201110132701 CN 201110132701 CN 201110132701 A CN201110132701 A CN 201110132701A CN 102170582 A CN102170582 A CN 102170582A
- Authority
- CN
- China
- Prior art keywords
- audio
- file
- video
- network
- looking
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention relates to a quality of service (QoS)-based audio and video quality of experience evaluation platform and a QoS-based audio and video quality of experience evaluation method. The method comprises that: an audio and video coding module codes a multimedia file into an audio and video source file in a given format; an audio and video transmission module encapsulates the audio and video source file into a data packet, and transmits the data packet to a network; a network simulation module simulates the non-destruction or destruction of an actual network environment by the setting of network parameters to obtain a non-destructive or destructive network environment; an audio and video receiving module decapsulates the data packet on the network and dumps decapsulated data into a reference audio and video file in the non-destructive network environment, and receives the destructive data packet on the network, decapsulates the received data packet and dumps the decapsulated data into a test audio and video file in the destructive network environment; an audio and video decoding module separates video tracks and audio tracks in the reference audio and video file and the test audio and video file, and decodes the video tracks and the audio tracks into a video format and an audio format required by evaluation respectively; and finally an audio and video quality evaluation module evaluates video files and audio files respectively.
Description
Technical field
The present invention relates to a kind of audio experience quality assessment technology of looking, refer to especially a kind ofly look audio experience quality assessment platform and evaluating method based on QoS.
Background technology
Along with Internet development, IPTV just constantly is deep in the middle of the increasing family as a new business.IPTV is an infrastructure of utilizing broadband cabled television network, as main terminal appliance, provides the multiple digital media service that comprises TV programme with domestic television set by internet protocol.IPTV has interaction characteristic very flexibly, because have the mutual innate advantage of the symmetry of the Internet, its program can adopt multiple published methods such as broadcasting, multicast or clean culture in net.Can realize multiple functions such as electronic menu, displaying predetermined programme, F.F. in real time, rewind down, terminal account number and accounting management, Promgramming very neatly.
Yet the Internet is a kind of transmission of doing one's best (Best-effort) network, and situations such as the bandwidth change in the transmission course of Streaming Media, packet loss, shake, time delay happen occasionally, and they can produce adverse influence to user experience.In the past to network service quality (Quality of Service, be called for short QoS) research be to be purpose to improve network performance and whole resource utilization, what IPTV service provider paid close attention to then is user's impression, QoS obviously can't satisfy this requirement, therefore, in order can more real reflection sense of experience of users to be subjected to, need to introduce the satisfaction of watching that user experience quality (Quality of Experience is called for short QoE) is described the user.
IPTV has mixed track of video and audio track in transmission course, and up to the present, most of research only is to carry out at simple video QoE and audio frequency QoE, in addition, the qos parameter of real network environment is uncontrollable, be unfavorable for collection of experiment data, therefore, be necessary to propose a kind of at look QoE after the audio mix study and do not rely on live network based on QoS look audio experience quality (QoE) evaluation and test platform and evaluating method, just become present industry problem anxious to be overcome.
Summary of the invention
In view of the shortcoming of above-mentioned prior art, the object of the invention is to provide a kind of and looks audio experience quality assessment platform and evaluating method at what look QoE after the audio mix studies and do not rely on live network based on QoS.
For achieving the above object, the audio experience quality assessment platform of looking based on QoS provided by the present invention comprises: the video encoding module, and it is used for looking the audio-source file with what multimedia file was encoded into the prescribed coding form; Look the audio frequency sending module, it connects described video encoding module, and is used for the described audio-source file of looking is packaged into packet according to the host-host protocol of appointment, and sends on the network; The network simulation module, the one end is connected with described video sending module, and in order to by to the setting of network parameter, the not damaged of artificial actual network environment or damage is arranged is to obtain the lossless network environment or to diminish network environment; Look the audio frequency receiver module, its other end with described network simulation module is connected, and under the lossless network environment that described network simulation module is provided, described packet is unpacked, dump is looked audio file for reference again, and diminishing under the network environment that the network simulation module is provided, receives impaired packet on the network, and, serve as that audio file is looked in test with recompile and dump to the compensation of encoding of damaged data bag; Look the audio decoder module, its with look the audio frequency receiver module and be connected, track of video and the audio track that audio file is looked in audio file and test looked in the reference that is used for separating institute's dump, and these two tracks are decoded as the video file of the video format that is used to evaluate and test and the audio file of audio format respectively; And look audio quality and evaluate and test module, its with look the audio decoder module and be connected, as the evaluation and test reference paper,, look the audio experience quality evaluation with the video file under the lossless network environment and audio file to diminish video file under the network environment and audio file as the evaluation and test test file.
In addition, the present invention also provides a kind of evaluating method of looking audio experience quality assessment platform based on QoS, it is to build looking on the audio experience quality assessment platform based on QoS, described evaluation and test platform comprises the video encoding module, looks the audio frequency sending module, the network simulation module, look the audio frequency receiver module, look the audio decoder module and look audio quality evaluation and test module, this evaluating method comprises: 1) by the video encoding module form of video and audio frequency is encoded to the coded format that is fit to Network Transmission, and is packaged into and looks the audio-source file; 2) by the network simulation module network parameter is provided with, the not damaged of artificial actual network environment is to obtain the lossless network environment; 3) will look the audio-source file and be packaged into packet and send on the described lossless network by looking the audio frequency sending module; 4) the audio frequency receiver module unpacks broadcast with the packet on the network and dump is simultaneously looked audio file for reference by looking; 5) once more network parameter is provided with by the network simulation module, the damage of artificial actual network environment is to obtain diminishing network environment; 6) will look the audio-source file once more and be packaged into packet and send to diminishing on the network that described network simulation module provided by looking the audio frequency sending module; 7) the audio frequency receiver module unpacks broadcast once more with packet impaired on the network and dump is simultaneously looked audio file for test by looking; 8) audio file is looked in the reference of institute's dump is separated with audio track by looking the audio decoder module, and be decoded as the video file of evaluating and testing needed video format and the audio file of audio format separately with the test track of video of looking in the audio file; And 9) by looking audio quality evaluation and test module decode video file and the audio file that generates estimated respectively, obtained looking audio experience quality assessment result.
In the evaluating method of looking audio experience quality assessment platform based on QoS of the present invention, also comprise following preparation process: a) the network simulation module adopts NIST Net software emulation real network environmental damage, set qos parameters such as time-delay, shake, packet loss, bandwidth, and start NIST Net simulation software; And b) describedly look the audio frequency sending module and look the audio frequency receiver module and all adopt VLC software, selecting host-host protocol is RTP/MPEG Transport Stream, and the transcoding function of cancellation acquiescence starts VLC software at last.In addition, above-mentioned steps 3) further comprise: look the transmission of audio frequency sending module startup VLC software and look the audio-source file to described lossless network.Above-mentioned steps 4) further comprises: 4-1) look the audio frequency receiver module and start VLC software and open the corresponding ports monitoring, wait for that looking the transmission of audio frequency sending module looks the audio-source file; And 4-2) look the audio frequency receiver module and detect and look the audio-source file, then play the described audio-source file of looking, what will receive simultaneously looks the audio-source file dumping for reference to looking audio file.
In addition, above-mentioned steps 1) further comprise: 1-1) utilize ffmpeg with the video source file of video coding for the stream media format of suitable Network Transmission; 1-2) utilize ffmpeg with the audio-source file of audio coding for the stream media format of suitable Network Transmission; And 1-3) utilizes ffmpeg that video source file and audio-source file are packaged into and look the audio-source file, and be written into and be fit to the looking in the audio container of Network Transmission.
Above-mentioned steps 5), 6) and 7) further comprise: 5-1) open network simulation software NIST Net, the network parameter of emulation is provided with, the damage of artificial actual network environment is to obtain diminishing network environment; 6-1) looking the audio frequency sending module starts VLC software and sends and look the audio-source file and diminish on the network to described; And 7-1) looking the audio frequency receiver module starts VLC software and opens the corresponding ports monitoring, wait is looked the transmission of audio frequency sending module and is looked the audio-source file, when detecting when looking the audio-source file, then play the described audio-source file of looking, the audio-source file dumping of looking that will receive is simultaneously looked audio file for test.
Above-mentioned steps 8) further comprise: 8-1) utilize the ffmpeg will be with reference to looking the reference video file that track of video in the audio file is decoded as yuv format, audio track be decoded as the reference audio file of WAV form; And 8-2) utilize ffmpeg that the test video file that track of video in the audio file is decoded as yuv format is looked in test, audio track is decoded as the testing audio file of WAV form.
Above-mentioned steps 9) further comprises: 9-1) utilize the BVQM evaluating software that the reference video file of yuv format and the test video file of yuv format are evaluated and tested, obtain quality of experience of video evaluation and test value (MOSv); 9-2) utilize the PESQ evaluating software that the reference audio file of audio file WAV form and the testing audio file of WAV form are evaluated and tested, obtain audio experience quality assessment value (MOSa); And 9-3) utilize mixed formulation to obtain the final audio experience quality assessment value (MOSm) of looking.
Below in conjunction with technique scheme, useful technique effect of the present invention is described.Than prior art, the present invention is encoded to multimedia file the coded format that is fit to Network Transmission by the video encoding module, and be packaged into and look the audio-source file, by looking the audio frequency sending module it is packaged into packet and sends to network again, follow by the network simulation module by setting network parameter, the not damaged of artificial actual network environment or damage is arranged, to obtain the lossless network environment or to diminish network environment, in view of the above with by looking the audio frequency receiver module under the lossless network environment, packet on the network is unpacked dump again look audio file for reference, and diminishing under the network environment, impaired packet unpacks also dump once more and looks audio file for test on the reception network, then, to separate with audio track with the track of video that test is looked in the audio file with reference to looking audio file by looking the audio decoder module, and be decoded as evaluation and test needed video format and audio format separately, at last, by looking audio quality evaluation and test module video file and audio file are estimated respectively, analog subscriber is watched the whole process of multimedia video thus, carries out the system for simulating better authenticity than traditional live network that utilizes, stability, accuracy and repeatability.
Description of drawings
Fig. 1 is a block schematic diagram of evaluating and testing platform based on the quality of experience of video of QoS of the present invention.
Fig. 2 for use of the present invention based on QoS quality of experience of video evaluation and test platform and postpone for 100ms, be dithered as the NIST Net software simulation design sketch of 10ms.
Fig. 3 for use of the present invention based on QoS quality of experience of video evaluation and test platform and BVQM in graph of a relation between General Model video objective evaluation of estimate (VQM) and the subjective assessment value (Subjective).
Fig. 4 is the operating procedure flow chart of the evaluating method of looking audio experience quality assessment platform based on QoS of the present invention.
Fig. 5 is the graph of a relation between heterogeneous networks damage and the quality of experience of video (MOSv).
Fig. 6 is the graph of a relation between heterogeneous networks damage and the audio experience quality (MOSa).
Fig. 7 damages and looks the graph of a relation between the audio experience quality (MOSm) for heterogeneous networks.
[main element symbol description]
11 video encoding modules
12 look the audio frequency sending module
13 network simulation modules
14 look the audio frequency receiver module
15 look the audio decoder module
16 look audio quality evaluation and test module
S10～S18 step
Embodiment
Below by specific instantiation explanation embodiments of the present invention, those of ordinary skill in the field can understand other advantages of the present invention and effect easily by the content that this specification disclosed.The present invention also can be implemented or be used by other different instantiations, and the every details in this specification also can be based on different viewpoints and application, carries out various modifications and change under the spirit of the present invention not deviating from.
See also Fig. 1, it is for showing the block schematic diagram of looking audio experience quality assessment platform based on QoS of the present invention, as shown in the figure, looking audio experience quality assessment platform comprises video encoding module 11, looks audio frequency sending module 12, network simulation module 13, look audio frequency receiver module 14, look audio decoder module 15 and look audio quality evaluation and test module 16 based on QoS of the present invention.Below promptly cooperate Fig. 2 and 3 describe in detail QoS of the present invention look audio experience quality assessment platform on take off each module.
Video encoding module 11 is to be used for looking the audio-source file with what multimedia file was encoded into the prescribed coding form.
Look audio frequency sending module 12 and connect video encoding modules 11, and be used for that this is looked the audio-source file and be packaged into packet, and send on the network according to the host-host protocol of appointment.In the present embodiment, this is looked audio frequency sending module 12 and adopts VLC software, the host-host protocol of appointment is RTP/MPEG Transport Stream, VLC is a playout software of increasing income, has cross-platform characteristic, it supports numerous audio ﹠ video decoders and file format, also can under connecting, use the express network of IPv4 or IPv6 as unicast or multicast streaming media server, start VLC, open corresponding ports network is monitored, in case just can play the video-voice frequency flow dump that to receive for looking audio file while receive the video-voice frequency flow media information.
One end of network simulation module 13 is connected with this video sending module 12, and in order to by the setting to the network parameter of want emulation, the not damaged of artificial actual network environment or damage is arranged is to obtain the lossless network environment or to diminish network environment.In the present embodiment, the NIST Net software that this network simulation module 13 adopts NIST to provide, NIST Net is the network simulation software that is provided by the NIST of American National Standard technical research institute, it realizes the control to qos parameter on the level of operating system nucleus, have higher precision, starts NIST Net software, set qos parameter therein, begin to start emulation, and can realize emulation by adjusting the QoS parameters to network delay, shake and packet loss characteristic variations situation; Fig. 2 is 100ms for the delay that NIST Net is provided with, the simulate effect figure when being dithered as 10ms.
Looking audio frequency receiver module 14 is connected with the other end of network simulation module 13, and under the lossless network environment that this network simulation module 15 is provided, described packet is unpacked, dump is looked audio file for reference again, and diminishing under the network environment that network simulation module 15 is provided, receive impaired packet on the network, and, serve as to test to look audio file with recompile and dump to the compensation of encoding of damaged data bag.In the present embodiment, this is looked audio frequency receiver module 14 and adopts VLC software.
Look audio decoder module 15 and look audio frequency receiver module 14 and be connected, track of video and the audio track that audio file is looked in audio file and test looked in the reference that is used for separating institute's dump, and these two tracks are decoded as the video file of the video format that is used to evaluate and test and the audio file of audio format respectively.In the present embodiment, this is looked audio decoder module 15 and adopts ffmpeg, the video format that is used to evaluate and test is a yuv format, the audio format that is used to evaluate and test is the WAV form, the track of video that is about to look in the audio file is decoded as yuv format, the audio track of looking in the audio file is decoded as the WAV form, and ffmpeg is a free software, the total solution that it provides and has recorded, conversion and fluidisation are looked audio frequency.
Look audio quality evaluation and test module 16 and look audio decoder module 15 and be connected, with the video file under the lossless network environment and audio file as the evaluation and test reference paper, to diminish video file under the network environment and audio file, look the audio experience quality evaluation as the evaluation and test test file.In the present embodiment, video quality evaluation software BVQM and PESQ software that audio quality evaluation module 16 uses ITS to provide are provided for this, wherein, BVQM is a quality evaluation software at video of American I TS organization development, its evaluation method and calibration steps are respectively by ITU-T Recommendation J.144, ITU-T Recommendation J.244 standard includes, has higher evaluation precision, calculating by BVQM, can obtain [0,1] the video objective evaluation of estimate (VQM) on the interval, Fig. 3 is the relation between VQM and the subjective assessment value (Subjective), both Pearson came linearly dependent coefficients are 0.948, therefore the subjective assessment value of selecting for use BVQM to weigh the user has higher accuracy, and PESQ is an a objective audio quality testing software, is mainly used in the evaluation and test of communication sound intermediate frequency.
Use above-mentioned based on QoS look audio experience quality assessment platform, can obtain the operating process of looking audio experience quality assessment method as shown in Figure 4 based on QoS.As shown in Figure 4, execution in step S10 at first is encoded to the coded format that is fit to Network Transmission by the video encoding module with the form of video and audio frequency, and is packaged into and looks the audio-source file.Preferably, in the present embodiment, at first, utilize ffmpeg with the video source file of video coding for the stream media format of suitable Network Transmission; Then, utilize ffmpeg with the audio-source file of audio coding for the stream media format of suitable Network Transmission; At last, utilize ffmpeg that video source file and audio-source file are packaged into and look the audio-source file, and be written into and be fit to the looking in the audio container of Network Transmission.Then, carry out step S11.
At step S11, by the network simulation module network parameter is provided with, the not damaged of artificial actual network environment is to obtain the lossless network environment.Then, carry out step S12.
At step S12, to look the audio-source file and be packaged into packet and send on this lossless network by looking the audio frequency sending module, in the present embodiment, this is looked the audio frequency sending module and adopts VLC software, selecting host-host protocol is RTP/MPEG Transport Stream, the transcoding function of cancellation acquiescence starts VLC software at last, and transmission is looked the audio-source file to this lossless network.Then, carry out step S13.
At step S13, by look the audio frequency receiver module with the packet on the network unpack play and dump simultaneously for reference to looking audio file, audio file is looked in the reference during as evaluation and test.In the present embodiment, promptly start VLC software and open the corresponding ports monitoring by looking the audio frequency receiver module, wait is looked the transmission of audio frequency sending module and is looked the audio-source file, when detecting when looking the audio-source file, then play this and look the audio-source file, the audio-source file dumping of looking that will receive is simultaneously looked audio file for reference.Then, carry out step S14.
At step S14, once more network parameter is provided with by the network simulation module, the damage of artificial actual network environment, to obtain diminishing network environment, in the present embodiment, this network simulation module adopts NIST Net software emulation real network environmental damage, sets qos parameters such as time-delay, shake, packet loss, bandwidth, to obtain diminishing network environment.Then, carry out step S15.
At step S15, to look the audio-source file once more and be packaged into packet and send to diminishing on the network that described network simulation module provided by looking the audio frequency sending module, in the present embodiment, this is looked the audio frequency sending module and starts VLC software and send and look the audio-source file and diminish on the network to this.Then, carry out step S16.
At step S16, packet impaired on the network is unpacked once more play and dump is simultaneously looked audio file for test by looking the audio frequency receiver module, audio file is looked in the test during as evaluation and test.In the present embodiment, this is looked the audio frequency receiver module and starts VLC software and open the corresponding ports monitoring, wait is looked the transmission of audio frequency sending module and is looked the audio-source file, when detecting when looking the audio-source file, then play this and look the audio-source file, the audio-source file dumping of looking that will receive is simultaneously looked audio file for test.Then, carry out step S17.
At step S17, audio file is looked in the reference of institute's dump is separated with audio track by looking the audio decoder module, and be decoded as the video file of evaluating and testing needed video format and the audio file of audio format separately with the test track of video of looking in the audio file.In the present embodiment, promptly utilize the ffmpeg will be with reference to looking the reference video file that track of video in the audio file is decoded as yuv format, audio track is decoded as the reference audio file of WAV form, utilize ffmpeg that the test video file that track of video in the audio file is decoded as yuv format is looked in test simultaneously, audio track is decoded as the testing audio file of WAV form.Then, carry out step S18.
At step S18, by looking audio quality evaluation and test module decode video file and the audio file that generates estimated respectively, obtain looking audio experience quality assessment result.In the present embodiment, at first be to utilize the BVQM evaluating software that the reference video file of yuv format and the test video file of yuv format are evaluated and tested, obtain quality of experience of video evaluation and test value (MOSv); Then, utilize the PESQ evaluating software that the reference audio file of audio file WAV form and the testing audio file of WAV form are evaluated and tested, obtain audio experience quality assessment value (MOSa); Then, utilize mixed formulation to obtain the final audio experience quality assessment value (MOSm) of looking.
For quality of experience of video evaluation and test platform and the evaluating method based on QoS of the present invention used in more detailed understanding, below in conjunction with Fig. 5 to 7 and with video encoding module 11 with look audio decoder module 15 and adopt ffmpeg, network simulation module 13 to adopt NIST Net softwares and look audio quality evaluation and test module 16 to adopt BVQM and PESQ software be example, illustrate that using the present invention evaluates and tests packet loss (drop) and shake (jitter) to looking the influence of audio quality, it is as follows specifically to evaluate and test step:
1) choose a multimedia file, with ffmpeg it is encoded, coded format is as follows:
Video coding: mpeg-4, resolution: 320x240, code check 512kbps, frame per second 30fps;
Audio coding: mp3, sample rate: 48000HZ, code check: 128kbps, channel number: 2;
Container: mp4.
2) parameter being set in NIST Net is: postpone: 0ms; Shake: 0ms; Packet loss: 0%, to obtain the lossless network environment;
3) open VLC receiving terminal (promptly looking the audio frequency receiver module), it is 5004 that receiving port is set, and monitors;
4) open VLC transmitting terminal (promptly looking the audio frequency sending module), that selects to have encoded in the step 1) looks the audio-source file, and it is RTP/MPEG Transport Stream that host-host protocol is set, and the target port of transmission is 5004, the purpose IP address of transmission is the address of VLC receiving terminal IP, begins transmission;
5) the audio-source file of looking that the VLC receiving terminal is received is looked audio file (MultiMedia_ref) as the reference of evaluation and test;
6) in NIST Net, reset following parameter again:
Postpone: 100ms; Shake: 0ms, 2ms, 5ms, 10ms, 20ms; Packet loss: 0%, 1%, 2%, 5%, 7%, to obtain diminishing network environment;
Repeating step 3) and step 4), the audio-source file of looking that the VLC receiving terminal is received is looked audio file (MultiMedia_test) as the test of evaluation and test.
7) utilize ffmpeg to be decoded as the reference video file (Video_ref.yuv) of yuv format and the reference audio file (Audio_ref.wav) of WAV form with reference to looking audio file; Simultaneously, test is looked audio file and be decoded as the test video file (Video_test.yuv) of yuv format and the testing audio file (Audio_test.wav) of WAV form.
8) utilize BVQM that Video_ref.yuv and Video_test.yuv are evaluated and tested, obtain quality of experience of video (MOSv) evaluation result; Utilize PESQ that Audio_ref.wav and Audio_test.wav are evaluated and tested, obtain audio experience quality (MOSa) evaluation result.
9) with (MOSv) and (MOSa) linear transformation to [0,5] on the interval, obtain the graph of a relation between heterogeneous networks damage (packet loss and shake) and the quality of experience of video (MOSv) as shown in Figure 5 respectively and heterogeneous networks shown in Figure 6 damages and audio experience quality (MOSa) between graph of a relation, by mixed formulation (MOSm)=f ((MOSv), (MOSa)) obtain final audio experience quality (MOSm) evaluation result of looking, get f (x herein temporarily, y)=min (x, y), promptly obtain heterogeneous networks damage as shown in Figure 7 and look graph of a relation between the audio experience quality (MOSm).
In sum, the present invention mainly is encoded to multimedia file the coded format that is fit to Network Transmission by the video encoding module, and be packaged into and look the audio-source file, this is looked the audio-source file be packaged into packet and send to network by looking the audio frequency sending module again, follow by the network simulation module by setting network parameter, the not damaged of artificial actual network environment or damage is arranged, to obtain the lossless network environment or to diminish network environment, in view of the above with by looking the audio frequency receiver module under the lossless network environment, packet on the network is unpacked dump again look audio file for reference, and diminishing under the network environment, impaired packet unpacks also dump once more and looks audio file for test on the reception network, then, to separate with audio track with the track of video that test is looked in the audio file with reference to looking audio file by looking the audio decoder module, and be decoded as evaluation and test needed video format and audio format separately, at last, by looking audio quality evaluation and test module video file and audio file are estimated respectively, realization is studied at the QoE that looks after the audio mix, analog subscriber is watched the whole transmission of video-voice frequency flow medium such as IPTV thus, transmission, receive, the process of playing, in order to evaluation and test user's subjective Quality of experience (QoE), carry out the system for simulating better authenticity than in the past dependence live network, stability, accuracy and repeatability.
The foregoing description is illustrative principle of the present invention and effect thereof only, but not is used to limit the present invention.Any person of an ordinary skill in the technical field all can be under spirit of the present invention and category, and the foregoing description is modified and changed.Therefore, the scope of the present invention should be listed as the scope of appending claims.
Claims (9)
- One kind based on QoS look audio experience quality assessment platform, it is characterized in that described evaluation and test platform comprises:The video encoding module, it is used for looking the audio-source file with what multimedia file was encoded into the prescribed coding form;Look the audio frequency sending module, it connects described video encoding module, and is used for the described audio-source file of looking is packaged into packet according to the host-host protocol of appointment, and sends on the network;The network simulation module, the one end is connected with described video sending module, and in order to by to the setting of network parameter, the not damaged of artificial actual network environment or damage is arranged is to obtain the lossless network environment or to diminish network environment;Look the audio frequency receiver module, its other end with described network simulation module is connected, and under the lossless network environment that described network simulation module is provided, described packet is unpacked, dump is looked audio file for reference again, and diminishing under the network environment that the network simulation module is provided, receives impaired packet on the network, and, serve as that audio file is looked in test with recompile and dump to the compensation of encoding of damaged data bag;Look the audio decoder module, its with look the audio frequency receiver module and be connected, track of video and the audio track that audio file is looked in audio file and test looked in the reference that is used for separating institute's dump, and these two tracks are decoded as the video file of the video format that is used to evaluate and test and the audio file of audio format respectively; AndLook audio quality evaluation and test module, its with look the audio decoder module and be connected, as the evaluation and test reference paper,, look the audio experience quality evaluation with the video file under the lossless network environment and audio file to diminish video file under the network environment and audio file as the evaluation and test test file.
- 2. evaluating method of looking audio experience quality assessment platform based on QoS, it is to build looking on the audio experience quality assessment platform based on QoS, described evaluation and test platform comprises the video encoding module, looks the audio frequency sending module, the network simulation module, look the audio frequency receiver module, look the audio decoder module and look audio quality evaluation and test module, it is characterized in that described evaluating method comprises:1) by the video encoding module form of video and audio frequency is encoded to the coded format that is fit to Network Transmission, and is packaged into and looks the audio-source file;2) by the network simulation module network parameter is provided with, the not damaged of artificial actual network environment is to obtain the lossless network environment;3) will look the audio-source file and be packaged into packet and send on the described lossless network by looking the audio frequency sending module;4) the audio frequency receiver module unpacks broadcast with the packet on the network and dump is simultaneously looked audio file for reference by looking;5) once more network parameter is provided with by the network simulation module, the damage of artificial actual network environment is to obtain diminishing network environment;6) will look the audio-source file once more and be packaged into packet and send to diminishing on the network that described network simulation module provided by looking the audio frequency sending module;7) the audio frequency receiver module unpacks broadcast once more with packet impaired on the network and dump is simultaneously looked audio file for test by looking;8) audio file is looked in the reference of institute's dump is separated with audio track by looking the audio decoder module, and be decoded as the video file of evaluating and testing needed video format and the audio file of audio format separately with the test track of video of looking in the audio file; And9) by looking audio quality evaluation and test module decode video file and the audio file that generates estimated respectively, obtained looking audio experience quality assessment result.
- 3. the evaluating method of looking audio experience quality assessment platform based on QoS according to claim 2 is characterized in that, also comprises following preparation process:A) the network simulation module adopts NIST Net software emulation real network environmental damage, sets qos parameters such as time-delay, shake, packet loss, bandwidth, and starts NIST Net simulation software; AndB) describedly look the audio frequency sending module and look the audio frequency receiver module and all adopt VLC software, selecting host-host protocol is RTP/MPEG Transport Stream, and the transcoding function of cancellation acquiescence starts VLC software at last.
- 4. the evaluating method of looking audio experience quality assessment platform based on QoS according to claim 3 is characterized in that described step 3) further comprises: look the transmission of audio frequency sending module startup VLC software and look the audio-source file to described lossless network.
- 5. the evaluating method of looking audio experience quality assessment platform based on QoS according to claim 4 is characterized in that described step 4) further comprises:4-1) look the audio frequency receiver module and start VLC software and open the corresponding ports monitoring, wait for that looking the transmission of audio frequency sending module looks the audio-source file; And4-2) look the audio frequency receiver module and detect and look the audio-source file, then play the described audio-source file of looking, what will receive simultaneously looks the audio-source file dumping for reference to looking audio file.
- 6. the evaluating method of looking audio experience quality assessment platform based on QoS according to claim 2 is characterized in that described step 1) further comprises:1-1) utilize ffmpeg with the video source file of video coding for the stream media format of suitable Network Transmission;1-2) utilize ffmpeg with the audio-source file of audio coding for the stream media format of suitable Network Transmission; And1-3) utilize ffmpeg that video source file and audio-source file are packaged into and look the audio-source file, and be written into and be fit to the looking in the audio container of Network Transmission.
- 7. the evaluating method of looking audio experience quality assessment platform based on QoS according to claim 2 is characterized in that described step 5), 6) and 7) further comprise:5-1) open network simulation software NIST Net, the network parameter of emulation is provided with, the damage of artificial actual network environment is to obtain diminishing network environment;6-1) looking the audio frequency sending module starts VLC software and sends and look the audio-source file and diminish on the network to described; And7-1) looking the audio frequency receiver module starts VLC software and opens the corresponding ports monitoring, wait is looked the transmission of audio frequency sending module and is looked the audio-source file, when detecting when looking the audio-source file, then play the described audio-source file of looking, the audio-source file dumping of looking that will receive is simultaneously looked audio file for test.
- 8. the evaluating method of looking audio experience quality assessment platform based on QoS according to claim 2 is characterized in that described step 8) further comprises:8-1) utilize the ffmpeg will be with reference to looking the reference video file that track of video in the audio file is decoded as yuv format, audio track be decoded as the reference audio file of WAV form; And8-2) utilize ffmpeg that the test video file that track of video in the audio file is decoded as yuv format is looked in test, audio track is decoded as the testing audio file of WAV form.
- 9. the evaluating method of looking audio experience quality assessment platform based on QoS according to claim 8 is characterized in that described step 9) further comprises:9-1) utilize the BVQM evaluating software that the reference video file of yuv format and the test video file of yuv format are evaluated and tested, obtain quality of experience of video evaluation and test value (MOSv);9-2) utilize the PESQ evaluating software that the reference audio file of audio file WAV form and the testing audio file of WAV form are evaluated and tested, obtain audio experience quality assessment value (MOSa); And9-3) utilize mixed formulation to obtain the final audio experience quality assessment value (MOSm) of looking.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110132701 CN102170582B (en) | 2011-05-20 | 2011-05-20 | Quality of service (QoS)-based audio and video quality of experience evaluation platform and evaluation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110132701 CN102170582B (en) | 2011-05-20 | 2011-05-20 | Quality of service (QoS)-based audio and video quality of experience evaluation platform and evaluation method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102170582A true CN102170582A (en) | 2011-08-31 |
| CN102170582B CN102170582B (en) | 2013-02-13 |
Family
ID=44491535
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201110132701 Expired - Fee Related CN102170582B (en) | 2011-05-20 | 2011-05-20 | Quality of service (QoS)-based audio and video quality of experience evaluation platform and evaluation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102170582B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102843573A (en) * | 2012-07-16 | 2012-12-26 | 上海大学 | Video transmission quality evaluation method implemented by using QoS (quality of service) parameters of wireless local area networks |
| CN102932665A (en) * | 2012-11-14 | 2013-02-13 | 北京汉邦高科数字技术股份有限公司 | Method for testing decoding performance of network hard disk video recorder |
| WO2013056123A2 (en) | 2011-10-14 | 2013-04-18 | T-Mobile USA, Inc | Quality of user experience testing for video transmissions |
| CN103475896A (en) * | 2013-07-24 | 2013-12-25 | 同济大学 | Interactive video and audio experience-quality assessment platform and method based on Qos |
| WO2014029311A1 (en) * | 2012-08-22 | 2014-02-27 | 华为技术有限公司 | Multimedia quality monitoring method and device |
| CN103841412A (en) * | 2014-03-18 | 2014-06-04 | 北京邮电大学 | Network video user experience quality measurement method and device |
| CN104539943A (en) * | 2012-08-22 | 2015-04-22 | 华为技术有限公司 | Method and device for monitoring multimedia quality |
| CN105430383A (en) * | 2015-12-07 | 2016-03-23 | 广东电网有限责任公司珠海供电局 | Method for evaluating experience quality of video stream media service |
| CN108650550A (en) * | 2018-07-05 | 2018-10-12 | 平安科技（深圳）有限公司 | Network transmission quality analysis method, device, computer equipment and storage medium |
| CN111614923A (en) * | 2019-02-25 | 2020-09-01 | 疯壳(深圳)科技有限公司 | Network real-time communication method and system thereof |
| CN114071131A (en) * | 2022-01-07 | 2022-02-18 | 军事科学院系统工程研究院网络信息研究所 | Test device, method, electronic device, and medium for video encoding and decoding device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1487217A2 (en) * | 2003-06-13 | 2004-12-15 | Microsoft Corporation | Robust delivery of video data |
| CN1938972A (en) * | 2004-01-30 | 2007-03-28 | Sk电信有限公司 | Methods and apparatuses for measuring transmission quality of multimedia data |
| US20090196307A1 (en) * | 2008-02-05 | 2009-08-06 | Fujitsu Limited | Transmitter apparatus, receiver apparatus, moving image and audio transmission evaluation method, and computer readable storage medium storing program thereof |
| CN101841733A (en) * | 2009-03-19 | 2010-09-22 | 富士通株式会社 | Information Acquisition System, data obtain device and data preparation method |
-
2011
- 2011-05-20 CN CN 201110132701 patent/CN102170582B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1487217A2 (en) * | 2003-06-13 | 2004-12-15 | Microsoft Corporation | Robust delivery of video data |
| CN1938972A (en) * | 2004-01-30 | 2007-03-28 | Sk电信有限公司 | Methods and apparatuses for measuring transmission quality of multimedia data |
| US20090196307A1 (en) * | 2008-02-05 | 2009-08-06 | Fujitsu Limited | Transmitter apparatus, receiver apparatus, moving image and audio transmission evaluation method, and computer readable storage medium storing program thereof |
| CN101841733A (en) * | 2009-03-19 | 2010-09-22 | 富士通株式会社 | Information Acquisition System, data obtain device and data preparation method |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013056123A2 (en) | 2011-10-14 | 2013-04-18 | T-Mobile USA, Inc | Quality of user experience testing for video transmissions |
| EP3457704A1 (en) * | 2011-10-14 | 2019-03-20 | T-Mobile USA, Inc. | Quality of user experience testing for video transmissions |
| EP2767039B1 (en) * | 2011-10-14 | 2018-12-05 | T-Mobile USA, Inc. | Quality of user experience testing for video transmissions |
| CN102843573A (en) * | 2012-07-16 | 2012-12-26 | 上海大学 | Video transmission quality evaluation method implemented by using QoS (quality of service) parameters of wireless local area networks |
| US10116929B2 (en) | 2012-08-22 | 2018-10-30 | Huawei Technologies Co., Ltd. | Multimedia quality monitoring method, and device |
| WO2014029311A1 (en) * | 2012-08-22 | 2014-02-27 | 华为技术有限公司 | Multimedia quality monitoring method and device |
| CN104539943A (en) * | 2012-08-22 | 2015-04-22 | 华为技术有限公司 | Method and device for monitoring multimedia quality |
| US9402074B2 (en) | 2012-08-22 | 2016-07-26 | Huawei Technologies Co., Ltd. | Multimedia quality monitoring method, and device |
| CN104539943B (en) * | 2012-08-22 | 2017-01-04 | 华为技术有限公司 | The monitoring method and apparatus of multimedia quality |
| CN102932665A (en) * | 2012-11-14 | 2013-02-13 | 北京汉邦高科数字技术股份有限公司 | Method for testing decoding performance of network hard disk video recorder |
| CN103475896A (en) * | 2013-07-24 | 2013-12-25 | 同济大学 | Interactive video and audio experience-quality assessment platform and method based on Qos |
| CN103841412A (en) * | 2014-03-18 | 2014-06-04 | 北京邮电大学 | Network video user experience quality measurement method and device |
| CN103841412B (en) * | 2014-03-18 | 2016-03-02 | 北京邮电大学 | A kind of Internet video quality measurement of user experience method and apparatus |
| CN105430383A (en) * | 2015-12-07 | 2016-03-23 | 广东电网有限责任公司珠海供电局 | Method for evaluating experience quality of video stream media service |
| CN108650550A (en) * | 2018-07-05 | 2018-10-12 | 平安科技（深圳）有限公司 | Network transmission quality analysis method, device, computer equipment and storage medium |
| WO2020006912A1 (en) * | 2018-07-05 | 2020-01-09 | 平安科技（深圳）有限公司 | Method and device for analyzing network transmission quality, computer equipment and storage medium |
| CN108650550B (en) * | 2018-07-05 | 2021-06-25 | 平安科技（深圳）有限公司 | Network transmission quality analysis method and device, computer equipment and storage medium |
| CN111614923A (en) * | 2019-02-25 | 2020-09-01 | 疯壳(深圳)科技有限公司 | Network real-time communication method and system thereof |
| CN114071131A (en) * | 2022-01-07 | 2022-02-18 | 军事科学院系统工程研究院网络信息研究所 | Test device, method, electronic device, and medium for video encoding and decoding device |
| CN114071131B (en) * | 2022-01-07 | 2022-04-15 | 军事科学院系统工程研究院网络信息研究所 | Test device, method, electronic device, and medium for video encoding and decoding device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102170582B (en) | 2013-02-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102170582B (en) | Quality of service (QoS)-based audio and video quality of experience evaluation platform and evaluation method | |
| US11245940B2 (en) | Method and apparatus for transmitting media data in multimedia transport system | |
| CN102263959B (en) | Direct broadcast transfer method and system | |
| AU2008202703B2 (en) | Apparatus and method for providing multimedia content | |
| CN112752115B (en) | Live broadcast data transmission method, device, equipment and medium | |
| CN101594552B (en) | Testing method for IPTV service quality damage by network transmission | |
| CN105072506B (en) | The transmission method and system of live teaching broadcast video | |
| CN101529810B (en) | Method and system of network television tesing, and central office testing equipment | |
| TWI591999B (en) | Carriage of media content quality information | |
| CN102014284A (en) | Method, system and device for acquiring parameter set value of video code stream in transcoding business | |
| CN102098585A (en) | Method for intelligently playing web television | |
| CN112616065A (en) | Screen image initiating method and device, computer equipment, readable storage medium and screen image presenting system | |
| CN115552914A (en) | System and method for enhanced multimedia signal broadcasting, reception, data delivery and data collection | |
| CN101848367A (en) | File-based video live webcasting method | |
| CN103024441B (en) | A kind of method of playing television program at mobile terminal | |
| CN102223262B (en) | Evaluation platform and method of quality of experience of video based on QoS | |
| CN105430510A (en) | Video on demand method, gateway, smart terminal and video on demand system | |
| Wang et al. | A study on QoS/QoE correlation model in wireless-network | |
| CN102368721A (en) | Performance testing system and method for MS (Media Server) clustered system | |
| CN103475896A (en) | Interactive video and audio experience-quality assessment platform and method based on Qos | |
| Jiménez et al. | The upstream matters: impact of uplink performance on YouTube 360 live video streaming in LTE | |
| CN112437263A (en) | Video plug flow method and system | |
| Qiang | [Retracted] Consumption Reduction Solution of TV News Broadcast System Based on Wireless Communication Network | |
| Ksentini et al. | QoE-oriented adaptive SVC decoding in DVB-T2 | |
| Baltoglou et al. | IPTV QoS and QoE measurements in wired and wireless networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130213 Termination date: 20150520 |
|
| EXPY | Termination of patent right or utility model |