CN107404646A - The method, apparatus and headend of video quality assessment - Google Patents
The method, apparatus and headend of video quality assessment Download PDFInfo
- Publication number
- CN107404646A CN107404646A CN201610338793.7A CN201610338793A CN107404646A CN 107404646 A CN107404646 A CN 107404646A CN 201610338793 A CN201610338793 A CN 201610338793A CN 107404646 A CN107404646 A CN 107404646A
- Authority
- CN
- China
- Prior art keywords
- video
- frame
- configured information
- assessed
- quality assessment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/004—Diagnosis, testing or measuring for television systems or their details for digital television systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64784—Data processing by the network
- H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets
Abstract
The invention provides a kind of method, apparatus of video quality assessment and headend.The device of video quality assessment receives the video flowing of video to be assessed, and the video flowing includes multiple frame of video, and each frame of video in the plurality of frame of video is carried at least one video bag；The device of the video quality assessment receives the configured information that headend is sent, and the configured information is used to indicate the mapping relations between the frame type video bag corresponding with the frame of video of each frame of video in the plurality of frame of video；The device of the video quality assessment determines the video quality evaluation of the video to be assessed according to the video flowing of the video to be assessed and the configured information.The present invention can accurately assess the quality of video.
Description
Technical field
The present invention relates to communication technical field, is commented more particularly, to video quality in communication technical field
The method, apparatus and headend estimated.
Background technology
With the fast development of network technology, VOD, Web TV, videophone etc. become width
Main business with network, they all use the data transfer mode of Internet video.Therefore, Internet video
Service quality quality can directly affect the development of above-mentioned business.
In order to ensure the service quality of Internet video, it is necessary to be monitored and assess to Internet video, so as to
Take appropriate measures in time and be adjusted and safeguard, to ensure above-mentioned business normal operation.
At present, industry typically passes through video mean opinion score (English：Mean opinion score-video,
Referred to as：MOS-V) value assesses the quality of video traffic, main to consider when calculating MOS-V values
Parameter for key business index (English：Key performance indication, referred to as：KPI), example
Such as, frame sign, frame type, image sets (English：Group of pictures, referred to as：GOP) structure,
And the abundant in content degree of current video, motility, scene switching etc..
The method of existing video quality assessment meets the situation of frame encryption or LOF in processing procedure
When, obtain assessment and regard the methods of the estimation of generally use I frames, gop structure estimation and scene switching estimation
The parameter of frequency quality, and the assessment result of video quality is obtained according to the parameter of these estimations.
Obtained however, the parameter used in existing video quality evaluation method is all estimated, can not
Avoid there is error, it is thus impossible to which enough accurately assess video quality.
The content of the invention
, can be accurate the invention provides a kind of method, apparatus of video quality assessment and headend
Assess the quality of video.
In a first aspect, the invention provides a kind of method of video quality assessment, this method includes：Receive
The video flowing of video to be assessed, the video flowing include multiple frame of video, and each in the plurality of frame of video regards
Frequency frame is carried at least one video bag；Receive the configured information that headend is sent, the configured information
For indicating the frame type of each frame of video in the plurality of frame of video, each frame of video is corresponding regards with this
Mapping relations between frequency bag；According to the video flowing of the video to be assessed and the configured information, it is determined that this is treated
Assess the video quality evaluation of video.
It should be understood that can be divided into I frames, P frames, B frames and the scene of the frame of video of the embodiment of the present invention are cut
Change frame.I frames are referred to as reference frame, and it includes the complete information of original image, therefore often also maximum；P
Frame is referred to as single directional prediction frame, is obtained by the difference for encoding present image and previous I frames or P frames；
B frames are bi-directional predicted frames, and bi-directional predicted obtain is carried out by former and later two P frames；Scene switch frame represents
Current video pictures scene is switched, and typically, scene switch frame can be I frames or P
Frame.
Alternatively, the mapping relations can be that the frame type of each frame of video in the plurality of frame of video regards with this
Mapping relations between the bag sequence number of at least one video bag corresponding to frequency frame, can also be the plurality of video
Reflecting between the bag serial number range of the frame type video bag corresponding with the frame of video of each frame of video in frame
Penetrate relation.
With reference in a first aspect, in the first possible implementation of first aspect, this is to be evaluated according to this
Estimate the video flowing and the configured information of video, determine the video quality evaluation of the video to be assessed, bag
Include：According to the video flowing and configured information, video mean opinion score MOS-V parameters are determined, should
Every pixel bit rates of MOS-V parameters including the video to be assessed, content answering over time and space
It is at least one in frame information Loss Rate caused by freeze frame rate caused by miscellaneous degree, packet loss and packet loss；Root
According to the MOS-V parameters, the MOS-V values of the video to be assessed are determined.
With reference to the possible implementation of the first of first aspect or first aspect, the second of first aspect
In kind mode in the cards, the configured information of reception headend transmission, including：Receive the head end
The configured information that equipment is forwarded by control centre.
Video quality assessment situation in the embodiment of the present invention by control centre to all nodes in network
It is managed and monitors, once the control centre that gone wrong in network can know in time, and is adjusted
Section and maintenance.
With reference to the first or second of possible implementation of first aspect, first aspect, in first party
In the third possible implementation in face, the configured information of reception headend transmission, including：Connect
Receive at least one mapped file or at least one data message, at least one mapped file or this at least one
The configured information is carried in individual data message.
With reference to first aspect, first aspect the first any of to the third possible implementation
Possible implementation, in the third possible implementation of first aspect, the reception is to be assessed to be regarded
The video flowing of frequency, including：After the configured information that the headend is sent is received, it is to be evaluated to receive this
Estimate the video flowing of video.
Alternatively, video quality assessment device receives the video flowing after can first receiving the configured information, this
Since sample, when the video quality assessment device obtains the video flowing, have been received that headend is sent out
The configured information sent, complete video flowing can be decoded according to the configured information, and if the video
Quality assessment device first receives the configured information and receives the configured information again, then to obtain configured information it
Before the partial video stream that receives when carrying out video quality assessment, may also need to obtain the portion by estimation
Divide the MOS-V values of video flowing, therefore, can using the video flowing is received after first receiving the configured information
To improve the accuracy of video quality assessment.
Second aspect, the invention provides a kind of method of video quality assessment, this method includes：To regarding
Frequency quality assessment device sends the video flowing of video to be assessed, and the video flowing includes multiple frame of video, and this is more
Each frame of video in individual frame of video is carried at least one video bag；To the video quality assessment device
Send configured information, the configured information be used to indicating in the plurality of frame of video the frame type of each frame of video and
Mapping relations between video bag corresponding to the frame of video, in order to which the video quality assessment device is according to this
Video flowing and configured information determine the video quality evaluation of the video to be assessed.
With reference to second aspect, in the first possible implementation of second aspect, this is to the video matter
Measure apparatus for evaluating and send configured information, including：Forwarded by control centre to the video quality assessment device
The configured information.
With reference to the possible implementation of the first of second aspect or second aspect, the second of second aspect
In the possible implementation of kind, this sends configured information to the video quality assessment device, including：To this
Video quality assessment device sends at least one mapped file or at least one data message, and this is at least one
The configured information is carried in mapped file or at least one data message.
With reference to the first or second of possible implementation of second aspect, second aspect, in second party
In the third possible implementation in face, this sends regarding for video to be assessed to video quality assessment device
Frequency flows, including：After the configured information is sent to the video quality assessment device, the video flowing is sent.
The third aspect, the invention provides a kind of device of video quality assessment, for performing above-mentioned first
Method in any possible implementation of aspect or first aspect.Specifically, the device includes being used for
Perform the unit of the method in any possible implementation of above-mentioned first aspect or first aspect.
Fourth aspect, the invention provides a kind of headend, for performing above-mentioned second aspect or second
Method in any possible implementation of aspect.Specifically, the device includes being used to perform above-mentioned the
The unit of method in any possible implementation of two aspects or second aspect.
5th aspect, the invention provides a kind of device of video quality assessment, the device includes：Receive
Device, transmitter, memory, processor and bus system.Wherein, the receiver, the transmitter, should
Memory is connected with the processor by the bus system, and the memory is used for store instruction, the processor
For performing the instruction of the memory storage, and transmitter is controlled to send signal, and when the processor is held
During the instruction of the row memory storage, any possible realization of first aspect or first aspect can be realized
Method in mode.
6th aspect, the invention provides a kind of headend, the headend includes：Receiver, hair
Send device, memory, processor and bus system.Wherein, the receiver, the transmitter, the memory
It is connected with the processor by the bus system, the memory is used for store instruction, and the processor is used to hold
The instruction of the row memory storage, and control transmitter to send signal, and when the computing device, this is deposited
During the instruction of reservoir storage, in any possible implementation that second aspect or second aspect can be realized
Method.
7th aspect, the invention provides a kind of computer-readable medium, for storing computer program,
The computer program is included in any possible implementation for performing first aspect or first aspect
Method instruction.
Eighth aspect, the invention provides a kind of computer-readable medium, for storing computer program,
The computer program is included in any possible implementation for performing second aspect or second aspect
Method instruction.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be in the embodiment of the present invention
The required accompanying drawing used is briefly described.
Fig. 1 is the schematic block diagram of the video quality assessment system of the embodiment of the present invention.
Fig. 2 is the indicative flowchart of the method for the video quality assessment of the embodiment of the present invention.
Fig. 3 is the indicative flowchart of the method for another video quality assessment of the embodiment of the present invention.
Fig. 4 is the schematic block diagram of the device of the video quality assessment of the embodiment of the present invention.
Fig. 5 is the schematic block diagram of the headend of the embodiment of the present invention.
Fig. 6 is the schematic block diagram of the device of another video quality assessment of the embodiment of the present invention.
Fig. 7 is the schematic block diagram of another headend of the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out
Description.
Fig. 1 shows the schematic block diagram of the video quality assessment system 100 of the embodiment of the present invention, such as schemes
Shown in 1, the system 100 includes headend 110, network node 120, terminal device 130, video
Quality assessment device 140 and video quality assessment device 150, wherein, the video flowing of video to be assessed from
Headend 110 is sent, and is decoded and is played via the incoming terminal equipment 130 of network node 120, should
Video quality assessment device 140 is used to assess the video quality at network node 120, the video
Quality assessment device 150 is used to assess the video quality at terminal device 130.
Fig. 1 schematically illustrates a network node and a terminal device, alternatively, the video matter
Amount assessment system 100 can include multiple network nodes and multiple terminal devices, and the video flowing can be with
Sent from headend, flow through at least one network node, and eventually arrive at least one terminal device,
Terminal device in the embodiment of the present invention can be set top box, television set, mobile phone, computer or flat board electricity
Brain etc. can be not construed as limiting with the equipment of decoded video streams, the embodiment of the present invention to this.
Alternatively, the video quality assessment system 100 can also include control centre, and the headend can
To forward video flowing and/or configured information to network node and/or terminal device by control centre, so as to
The quality of the video traffic of whole net can be managed collectively and be monitored in the control centre.
Alternatively, the video quality assessment device in the embodiment of the present invention can be used as single equipment pendant
In each network node either beside terminal device or the video quality assessment device can be integrated in often
It is to be assessed in order to be received to network node and terminal device in individual network node or terminal device
Video carries out video quality assessment, and the embodiment of the present invention is not construed as limiting to this.
Fig. 2 shows the indicative flowchart of the method 200 of the video quality assessment of the embodiment of the present invention,
This method 200 can apply to video quality assessment system as shown in Figure 1, but the embodiment of the present invention is not
It is limited to this.
S210, headend send the video flowing of video to be assessed, the video to video quality assessment device
Flowing includes multiple frame of video, and each frame of video in the plurality of frame of video is carried at least one video bag
In.
It should be understood that the video flowing can be video flowing corresponding to the video traffic specified, the video traffic
Can be the network video services such as VOD service, network TV business and visual telephone service, this hair
Bright embodiment is not construed as limiting to this.
Specifically, the headend can send the video of the video to be assessed to video quality assessment device
Stream, the video flowing include multiple frame of video, and each frame of video in the plurality of frame of video is carried at least one
In individual video bag, such as the video bag can be RTP (English：real-time transport
Protocol, referred to as：RTP) wrap, the packet header carrying package sequence number of each RTP video bags, and the head end
The bag sequence number for the video bag that equipment is sent is continuous.
S220, the headend send configured information to the video quality assessment device, and the configured information is used
In the frame type video bag corresponding with the frame of video for indicating each frame of video in the plurality of frame of video it
Between mapping relations, in order to which the video quality assessment device determines according to the video flowing and the configured information
The video quality evaluation of the video to be assessed.
It should be understood that can be divided into I frames, P frames, B frames and the scene of the frame of video of the embodiment of the present invention are cut
Change frame.I frames are intra-coded frames, and P frames are forward predicted frames, and B frames are two-way interpolation frames, wherein, I
Frame includes the complete information of original image, therefore often also maximum, and P frames and B frame recordings is phase
Change for I frames or P frames, i.e. each I frame typically have the B frames and P using I frames as reference
Frame, described I frames, P frames and B frames not merely correspond to existing video standard in embodiments of the present invention
In definition, I frames can be all frames using intra-frame encoding mode, and P frames and B frames can be all
Using the frame of interframe encoding mode；The video pictures scene that scene switch frame represents current is switched,
Typically, scene switch frame can be that I frames or P frames, the embodiment of the present invention are not construed as limiting to this.
It should also be understood that a video flowing is generally by multiple picture groups (English：Group of pictures, letter
Claim：GOP) form, each GOP can be seen as a scene, and each GOP is generally by one
Leading I frames are formed plus some B frames and P frames.
Specifically, the headend can send configured information, the instruction to the video quality assessment device
Information is used to indicate video bag of the frame type of each frame of video with carrying the frame of video in the video flowing
Corresponding relation.
Alternatively, the mapping relations can be in the plurality of frame of video the frame type of each frame of video with it is described
Mapping relations between the bag sequence number of at least one video bag corresponding to frame of video, can also be the plurality of regard
In frequency frame the bag serial number range of the frame type video bag corresponding with frame of video this described of each frame of video it
Between mapping relations, not limited to this of the embodiment of the present invention.
Alternatively, the mapping relations can be the forms such as mapping table, associated diagram, concordance list, and the present invention is real
Example is applied to be not construed as limiting this.
Alternatively, the headend directly can send the configured information to the video quality assessment device,
Or the configured information can also be sent to video quality assessment device by control centre, the present invention is implemented
Example is not construed as limiting to this.
Video quality assessment that can be by control centre to all nodes in network in the embodiment of the present invention
Situation is managed and monitored, once the control centre that gone wrong in network can know in time, goes forward side by side
Row regulation and maintenance.
Alternatively, the configured information can be carried at least one mapped file or extremely by the headend
The video quality assessment device is sent in a few data message, the embodiment of the present invention is not limited this
It is fixed.
Specifically, the configured information of the video to be assessed can be carried on a mapping text by the headend
The video quality assessment device is sent in part or a data message, wherein, the configured information includes
Mapping between the frame type video bag corresponding with the frame of video of each frame of video in multiple frame of video
Relation；The video to be assessed can also be divided into multiple video segments, and it is every in the plurality of video segment
Individual video segment includes multiple frame of video, and the configured information can be divided into multiple and the plurality of video segment
Each video segment corresponding to sub- configured information, the headend can be by the plurality of sub- configured information point
It is not carried in multiple mapped files or multiple data messages and is sent to the video quality assessment device, this hair
Bright embodiment is not construed as limiting to this.
Alternatively, video quality assessment device receives the video flowing after can first receiving the configured information, this
Since sample, when the video quality assessment device obtains the video flowing, have been received that headend is sent out
The configured information sent, complete video flowing can be decoded according to the configured information, and if the video
Quality assessment device first receives the video flowing and receives the configured information again, then to before obtaining configured information
When the partial video stream received carries out video quality assessment, it may also need to obtain the part by estimation
The MOS-V values of video flowing, therefore, can be with using receiving the video flowing after first receiving the configured information
Improve the accuracy of video quality assessment.
S230, the video quality assessment device according to the video flowing of the video to be assessed and the configured information,
Determine the video quality of the video to be assessed.
Alternatively, before S230, the video quality assessment device can by the control centre to this
Headend sends the request message for asking the configured information, and the headend can be according to the request
Message sends the configured information by the control centre to the video quality assessment device.
Alternatively, the video quality assessment device can be in some video segment in calculating whole video
The request message is sent to the headend, or can be sent out before whole video is assessed to the headend
The request message is given, the embodiment of the present invention is not construed as limiting to this.
Alternatively, after S230, the video quality assessment device can be periodically to be assessed by this
The video quality of video reports to control centre, in order to which control centre is carried out to the video quality in network
Unified monitoring and management, once and Network Abnormal occurs in the transmitting procedure of the video flowing, in control
The heart can quickly be known.
It should be understood that industry typically assesses IPTV by video mean opinion score MOS-V values at present
The quality of video traffic, as an alternative embodiment, in International Telecommunication Union's telecommunication standards group
Knit (English：Telecommunication standardization sector, referred to as：ITU-T) H.264 mark
In standard, calculate the MOS-V parameters that mainly consider of MOS-V values for often pixel bit rate, content when
Between and complexity spatially, packet loss caused by frame information Loss Rate caused by freeze frame rate, packet loss, with
And coded system, resolution ratio and the error concealing method of video to be assessed.Wherein, the volume of video to be assessed
Code mode, resolution ratio and error concealing method are static parameter, and per pixel bit rate, content in the time
The meter of frame information Loss Rate caused by freeze frame rate caused by complexity spatially, packet loss and packet loss
Calculate the whole GOP structure for then depending on video to be assessed.
Specifically, the video quality assessment device can obtain the video to be assessed according to the configured information
Including multiple frame of video in each frame of video frame type, and the video bag of the carrying frame of video
Bag sequence number, so as to analyze complete gop structure in the video flowing of the video to be assessed, obtain
The parameter of MOS-V values is calculated, finally gives accurate MOS-V values.
Alternatively, when in the case of frame encryption or LOF, the video quality assessment device can basis
The video flowing obtains the packet loss information of the video flowing, and the packet loss information is used to indicate that this to be regarded in transmitting procedure
Frequency stream lose at least one video bag, the video quality assessment device can according to the packet loss information and should
The frame of video belonging to video bag that configured information determination is each lost, and the frame type of the frame of video, from
And the whole GOP structure of the video flowing of the video to be assessed can be analyzed, obtain calculating MOS-V values
Parameter, finally give accurate MOS-V values, but not limited to this of the embodiment of the present invention.
Alternatively, the video quality assessment device can by receive carrying the video flowing video bag
Bag sequence number continuity, determine that the video to be assessed which video bag in transmitting procedure is lost
Lose, can either obtain the packet loss information that the packet loss detection device of terminal device or network node reports,
The embodiment of the present invention is not construed as limiting to this.
For example, it is assumed that the video flowing of video to be assessed is carried on bag serial number 10000-20000 video bag
In, and video quality assessment device determines bag serial number 10000,11000,16692,19999
Video packet loss, if the video bag for the bag serial number 10000 and 11000 lost is border frame of video, take
With the frame type of frame of video, in the case of frame encryption or LOF, video quality assessment device can not
The frame type of the frame of video of the video bag carrying received, cannot also analyze the complete of the video flowing
Whole gop structure.
In the appraisal procedure of prior art, video quality assessment device can only be had been received by by analysis
Video flowing, estimate the size of each type of frame of video in the video flowing, and then determine each type
Video frame size estimate, determine each loss video bag carrying frame of video frame type,
Finally estimate the whole GOP structure of the video flowing of the video to be assessed, obtain calculating the ginseng of MOS-V values
Number, and the MOS-V values of the video to be assessed are calculated, accuracy is not high.
The appraisal procedure of the video quality of the embodiment of the present invention, video quality assessment device can be according to be evaluated
Estimate the configured information that the video flowing of video and headend are sent, obtain carrying all videos of the video flowing
The frame type of the frame of video of each video bag carrying in bag, and then obtain the complete GOP of the video to be assessed
Structure, obtain calculating the parameter of MOS-V values, finally give the accurate MOS-V of the video to be assessed
Value.
Fig. 3 shows the indicative flowchart of the method 300 of the video quality assessment of the embodiment of the present invention,
This method 300 is applied in the system of the video quality assessment of the embodiment of the present invention as shown in Figure 1, and
And describe in detail in video network transmitting procedure, to the video matter at network node and terminal device
The method flow assessed respectively is measured, specifically, the network node and the terminal device can pass through figure
Video quality assessment device in 1 is assessed video quality.
S301, headend send video flowing to network node.
Specifically, the video flowing includes multiple frame of video, each frame of video carrying in the plurality of frame of video
In at least one video bag.
S302, the headend send configured information by control centre to the network node.
Specifically, the configured information be used to indicating the frame type of each frame of video in the plurality of frame of video with
Mapping relations between video bag corresponding to the frame of video.
Alternatively, the headend can by control centre to the target node configured information,
Or the configured information directly can be sent to the network node, the embodiment of the present invention is not construed as limiting to this.
S303, the network node determine the first MOS-V parameters according to the video flowing and the configured information.
Specifically, the MOS-V parameters can include every pixel bit rate, the content of the video to be assessed
Frame information caused by freeze frame rate caused by complexity over time and space, packet loss and packet loss is lost
Rate.
S304, the network node calculate the first MOS-V values according to the first MOS-V parameters.
S305, the network node report the first MOS-V values to the control centre.
S306, the network node send the video flowing to terminal device.
Specifically, the video flowing includes multiple frame of video, each frame of video carrying in the plurality of frame of video
In at least one video bag.
S307, the headend send the configured information by the control centre to the terminal device.
Specifically, the configured information be used to indicating the frame type of each frame of video in the plurality of frame of video with
Mapping relations between video bag corresponding to the frame of video.
Alternatively, the headend can forward the configured information by control centre to the terminal device,
Or the configured information directly can be sent to the terminal device, the embodiment of the present invention is not construed as limiting to this.
S308, the terminal device determine the 2nd MOS-V parameters according to the video flowing and the configured information.
S309, the terminal device calculate the 2nd MOS-V values according to the 2nd MOS-V parameters.
S310, the terminal device report the 2nd MOS-V values to the control centre.
Alternatively, control centre can receive what all-network node and terminal device in video network reported
MOS-V values, reflect the video quality situation at each network node and terminal device, so as to the control
Center carries out unified monitoring and management to the video quality of whole net, once and video flowing transmission mistake
Network Abnormal occurs in journey, control centre can quickly know.
It should be understood that the size of the sequence number of said process is not meant to the priority of execution sequence, each process
Execution sequence should be determined with its function and internal logic, without the implementation process structure of the reply embodiment of the present invention
Into any restriction.
Above in conjunction with Fig. 1 to Fig. 3, video quality assessment according to embodiments of the present invention is described in detail
Method, below in conjunction with Fig. 4 to Fig. 7, video quality according to embodiments of the present invention is described in detail and comments
The device and headend estimated.
Fig. 4 shows the device 400 of video quality assessment provided in an embodiment of the present invention, the device 400
Including：
Receiving unit 410, for receiving the video flowing of video to be assessed, the video flowing includes multiple videos
Frame, each frame of video in the plurality of frame of video are carried at least one video bag；
The receiving unit 410 is additionally operable to receive the configured information that headend is sent, and the configured information is used for
Between the frame type video bag corresponding with the frame of video for indicating each frame of video in the plurality of frame of video
Mapping relations；
Determining unit 420, for the video flowing of the video to be assessed received according to the receiving unit 410
With the configured information, the video quality evaluation of the video to be assessed is determined.
Alternatively, the determining unit 420 is specifically used for according to the video flowing and the configured information, it is determined that regarding
Frequency mean opinion score MOS-V parameters, the MOS-V parameters include every pixel of the video to be assessed
Freeze frame rate and packet loss cause caused by bit rate, content complexity over time and space, packet loss
Frame information Loss Rate in it is at least one；According to the MOS-V parameters, the video to be assessed is determined
MOS-V values.
Alternatively, the receiving unit 410 is specifically used for receiving what the headend was forwarded by control centre
The configured information.
Alternatively, the receiving unit 410 is specifically used for receiving at least one mapped file or at least one number
According to message, the configured information is carried at least one mapped file or at least one data message.
Alternatively, the receiving unit 410 is specifically used for receiving the configured information of headend transmission
And then receive the video flowing of the video to be assessed.
It should be understood that the device 400 of video quality assessment here is embodied in the form of functional unit.Here
Term " unit " can refer to application specific integrated circuit (English：application-specific integrated
Circuit, referred to as：ASIC), electronic circuit, for performing one or more softwares or firmware program
Processor (such as shared processor, proprietary processor or group processor etc.) and memory, merge logic
The suitable assembly of function described by circuit and/or other supports.In an optional example, this area skill
Art personnel are appreciated that the device 400 of video quality assessment can be specially the network in above-described embodiment
Node, the device 400 of video quality assessment can be used for performing in above method embodiment with video quality
Each flow and/or step, to avoid repeating, will not be repeated here corresponding to apparatus for evaluating.
Fig. 5 shows headend 500 provided in an embodiment of the present invention, and the headend 500 includes：
First transmitting element 510, for sending the video flowing of video to be assessed to video quality assessment device,
The video flowing includes multiple frame of video, and each frame of video in the plurality of frame of video is carried at least one regard
During frequency wraps；
Second transmitting element 520, for sending configured information, the instruction to the video quality assessment device
Information is used to indicating that the frame type of each frame of video in the plurality of frame of video is corresponding with the frame of video regarding
Mapping relations between frequency bag, in order to which the video quality assessment device is sent according to first transmitting element
The video flowing and the configured information that sends of second transmitting element determine the video of the video to be assessed
Quality assessment result.
Alternatively, second transmitting element 520 is specifically used for passing through control centre to the video quality assessment
Device forwards the configured information.
Alternatively, second transmitting element 520 is specifically used for sending at least to the video quality assessment device
One mapped file or at least one data message, at least one mapped file or at least one data
The configured information is carried in message.
Alternatively, first transmitting element 510 is specifically used in second transmitting element to the video quality
After apparatus for evaluating sends the configured information, the video flowing is sent.
It should be understood that headend 500 here is embodied in the form of functional unit.Here term is " single
Member " can refer to application-specific integrated circuit ASIC, electronic circuit, for performing one or more softwares or solid
The processor (such as shared processor, proprietary processor or group processor etc.) and memory of part program,
The suitable assembly of function described by merging logic circuit and/or other supports.In an optional example,
It will be understood by those skilled in the art that headend 500 can be used for perform above method embodiment in
Each flow and/or step, to avoid repeating, will not be repeated here corresponding to headend.
Fig. 6 shows the device 600 of video quality assessment provided in an embodiment of the present invention, the device 600
Including：Processor 610, transmitter 620, receiver 630, memory 640 and bus system 650.
Wherein, processor 610, transmitter 620, receiver 630 and memory 640 pass through bus system 650
It is connected, the memory 640 is used for store instruction, and the processor 610 is deposited for performing the memory 640
The instruction of storage, to control the transmitter 620 to send signal.Transmitter 620 and receiver 630 can be
Communication interface, specific transmitter 620 can be the interfaces for receiving data and/or instruction, receiver
630 can be the interface for sending data and/or instruction, herein no longer to transmitter 620 and receiver
630 concrete form is illustrated.
It should be understood that device 600 can be specially the video quality assessment device in above-described embodiment, and
Can be used for perform above method embodiment in each step corresponding with video quality assessment device and/or
Flow.Alternatively, the memory 640 can include read-only storage and random access memory, and to
Processor provides instruction and data.The a part of of memory can also include non-volatile random access storage
Device.For example, memory can be with the information of storage device type.The processor 610 can be used for performing
The instruction stored in memory, and during the computing device instruction, the processor can perform above-mentioned
Each step corresponding with video quality assessment device in embodiment of the method.
It should be understood that in embodiments of the present invention, the processor can be CPU (English：central
Processing unit, referred to as：CPU), the processor can also be other general processors, numeral letter
Number processor (English：Digital signal processing, referred to as：DSP), application-specific integrated circuit ASIC,
Ready-made programmable gate array (English：Field programmable gate array, referred to as：FPGA) or
Person other PLDs, discrete gate or transistor logic, discrete hardware components etc..It is logical
It can be microprocessor with processor or the processor can also be any conventional processor etc..
Fig. 7 shows headend 700 provided in an embodiment of the present invention, and the headend 700 includes：
Processor 710, transmitter 720, receiver 730, memory 740 and bus system 750.Wherein,
Processor 710, transmitter 720, receiver 730 and memory 740 are connected by bus system 750,
The memory 740 is used for store instruction, and the processor 710 is used for the finger for performing the memory 740 storage
Order, to control the transmitter 720 to send signal.Transmitter 720 and receiver 730 can be that communication connects
Mouthful, specific transmitter 720 can be the interface for receiving data and/or instruction, and receiver 730 can be with
It is the interface for sending data and/or instruction, herein no longer to transmitter 720 and the tool of receiver 730
Body form is illustrated.
It should be understood that headend 700 can be used for perform above method embodiment in it is corresponding with headend
Each step and/or flow.Alternatively, the memory 740 can include read-only storage and deposit at random
Access to memory, and provide instruction and data to processor.Memory it is a part of can also include it is non-volatile
Property random access memory.For example, memory can be with the information of storage device type.The processor 710
It can be used for performing the instruction stored in memory, and during the computing device instruction, the processor
Each step corresponding with headend in above method embodiment can be performed.
It should be understood that in embodiments of the present invention, the processor can be central processing unit CPU, at this
Reason device can also be other general processors, digital signal processor DSP, application-specific integrated circuit ASIC,
Ready-made programmable gate array FPGA either other PLDs, discrete gate or transistor logic
Device, discrete hardware components etc..General processor can be microprocessor or the processor can also be
Any conventional processor etc..
In implementation process, each step of the above method can pass through the integration logic of the hardware in processor
The instruction of circuit or software form is completed.The step of method with reference to disclosed in the embodiment of the present invention, can be with
It is embodied directly in hardware processor and performs completion, or is held with the hardware in processor and software module combination
Row is completed.Software module can be located at random access memory, flash memory, read-only storage, may be programmed read-only deposit
In the ripe storage medium in this area such as reservoir or electrically erasable programmable memory, register.This is deposited
Storage media is located at memory, the instruction in computing device memory, and the above method is completed with reference to its hardware
The step of.To avoid repeating, it is not detailed herein.
Those of ordinary skill in the art are it is to be appreciated that with reference to described in the embodiments described herein
Various method steps and unit, it can be realized with electronic hardware, computer software or the combination of the two,
It is general according to function in the above description in order to clearly demonstrate the interchangeability of hardware and software
Ground describes the step of each embodiment and composition.These functions are held with hardware or software mode actually
OK, the application-specific and design constraint depending on technical scheme.Those of ordinary skill in the art can be with
Described function is realized using distinct methods to each specific application, but this realization should not
Think beyond the scope of this invention.
It is apparent to those skilled in the art that for convenience of description and succinctly, it is above-mentioned
The specific work process of the system of description, device and unit, may be referred to pair in preceding method embodiment
Process is answered, will not be repeated here.
In several embodiments provided herein, it should be understood that disclosed system, device and
Method, it can realize by another way.For example, device embodiment described above is only to show
Meaning property, for example, the division of the unit, only a kind of division of logic function can when actually realizing
To there is other dividing mode, such as multiple units or component can combine or be desirably integrated into another
System, or some features can be ignored, or not perform.It is in addition, shown or discussed mutual
Coupling or direct-coupling or communication connection can be by the INDIRECT COUPLING of some interfaces, device or unit or
Communication connection or electricity, the connection of mechanical or other forms.
The unit illustrated as separating component can be or may not be it is physically separate, make
It can be for the part that unit is shown or may not be physical location, you can with positioned at a place,
Or it can also be distributed on multiple NEs.Can select according to the actual needs part therein or
Person's whole unit realizes the purpose of scheme of the embodiment of the present invention.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit
In or unit is individually physically present or two or more units are integrated in
In one unit.Above-mentioned integrated unit can both be realized in the form of hardware, can also use software
The form of functional unit is realized.
If the integrated unit is realized in the form of SFU software functional unit and is used as independent product pin
Sell or in use, can be stored in a computer read/write memory medium.Based on such understanding,
The part that technical scheme substantially contributes to prior art in other words, or the technical side
The all or part of case can be embodied in the form of software product, and the computer software product is stored in
In one storage medium, including some instructions are make it that a computer equipment (can be individual calculus
Machine, server, or network equipment etc.) perform whole or the portion of each embodiment methods described of the present invention
Step by step.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (English：read-only
Memory, referred to as：ROM), random access memory (random access memory, abbreviation：
RAM), magnetic disc or CD etc. are various can be with the medium of store program codes.
The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited to
In this, any one skilled in the art the invention discloses technical scope in, can be easily
Expect various equivalent modifications or substitutions, these modifications or substitutions should all cover in protection scope of the present invention
Within.Therefore, protection scope of the present invention should be defined by scope of the claims.
Claims (18)
- A kind of 1. method of video quality assessment, it is characterised in that including：The video flowing of video to be assessed is received, the video flowing includes multiple frame of video, the multiple video Each frame of video in frame is carried at least one video bag；The configured information that headend is sent is received, the configured information is used to indicate the multiple frame of video In each frame of video frame type video bag corresponding with the frame of video between mapping relations；According to the video flowing of the video to be assessed and the configured information, the video to be assessed is determined Video quality evaluation.
- 2. according to the method for claim 1, it is characterised in that described to be assessed to be regarded according to described The video flowing of frequency and the configured information, the video quality evaluation of the video to be assessed is determined, wrapped Include：According to the video flowing and the configured information, the average opinion of video of the video to be assessed is determined Score MOS-V parameters, every pixel bit rate of the MOS-V parameters including the video to be assessed, Frame information caused by freeze frame rate caused by content complexity over time and space, packet loss and packet loss It is at least one in Loss Rate；According to the MOS-V parameters, the MOS-V values of the video to be assessed are determined.
- 3. method according to claim 1 or 2, it is characterised in that the reception headend The configured information of transmission, including：Receive the configured information that the headend is forwarded by control centre.
- 4. according to the method in any one of claims 1 to 3, it is characterised in that the reception The configured information that headend is sent, including：Receive at least one mapped file or at least one data message, at least one mapped file or The configured information is carried at least one data message.
- 5. method according to any one of claim 1 to 4, it is characterised in that the reception The video flowing of video to be assessed, including：After the configured information that the headend is sent is received, the video to be assessed is received Video flowing.
- A kind of 6. method of video quality assessment, it is characterised in that including：The video flowing of video to be assessed is sent to video quality assessment device, the video flowing includes multiple regard Frequency frame, each frame of video in the multiple frame of video are carried at least one video bag；Configured information is sent to the video quality assessment device, the configured information is described more for indicating Mapping in individual frame of video between the frame type video bag corresponding with the frame of video of each frame of video is closed System, in order to which the video quality assessment device is according to determining the video flowing and the configured information The video quality evaluation of video to be assessed.
- 7. according to the method for claim 6, it is characterised in that described to be commented to the video quality Estimate device and send configured information, including：The configured information is forwarded to the video quality assessment device by control centre.
- 8. the method according to claim 6 or 7, it is characterised in that described to the video matter Measure apparatus for evaluating and send configured information, including：At least one mapped file or at least one data message are sent to the video quality assessment device, The configured information is carried at least one mapped file or at least one data message.
- 9. the method according to any one of claim 6 to 8, it is characterised in that it is described to regarding Frequency quality assessment device sends the video flowing of video to be assessed, including：After the configured information is sent to the video quality assessment device, the video flowing is sent.
- A kind of 10. device of video quality assessment, it is characterised in that including：Receiving unit, for receiving the video flowing of video to be assessed, the video flowing includes multiple frame of video, Each frame of video in the multiple frame of video is carried at least one video bag；The receiving unit is additionally operable to receive the configured information that headend is sent, and the configured information is used for Indicate each frame of video in the multiple frame of video frame type video bag corresponding with the frame of video it Between mapping relations；Determining unit, for the video flowing of the video to be assessed received according to the receiving unit and institute Configured information is stated, determines the video quality evaluation of the video to be assessed.
- 11. device according to claim 10, it is characterised in that the determining unit is specifically used In：According to the video flowing and the configured information, the average opinion of video of the video to be assessed is determined Score MOS-V parameters, every pixel bit rate of the MOS-V parameters including the video to be assessed, Frame information caused by freeze frame rate caused by content complexity over time and space, packet loss and packet loss It is at least one in Loss Rate；According to the MOS-V parameters, the MOS-V values of the video to be assessed are determined.
- 12. the device according to claim 10 or 11, it is characterised in that the receiving unit tool Body is used for：Receive the configured information that the headend is forwarded by control centre.
- 13. the device according to any one of claim 10 to 12, it is characterised in that described to connect Unit is received to be specifically used for：Receive at least one mapped file or at least one data message, at least one mapped file or The configured information is carried at least one data message.
- 14. the device according to any one of claim 10 to 13, it is characterised in that described to connect Unit is received to be specifically used for：Receiving the configured information and then the reception video to be assessed that the headend is sent Video flowing.
- A kind of 15. headend, it is characterised in that including：First transmitting element, for sending the video flowing of video to be assessed, institute to video quality assessment device Stating video flowing includes multiple frame of video, and each frame of video in the multiple frame of video is carried at least one In video bag；Second transmitting element, for sending configured information, the instruction to the video quality assessment device Information is used to indicate that the frame type of each frame of video in the multiple frame of video is corresponding with the frame of video Mapping relations between video bag, in order to which the video quality assessment device sends list according to described first The configured information that the video flowing and second transmitting element that member is sent are sent is treated described in determining Assess the video quality evaluation of video.
- 16. headend according to claim 15, it is characterised in that described second sends list Member is specifically used for：The configured information is forwarded to the video quality assessment device by control centre.
- 17. the headend according to claim 15 or 16, it is characterised in that second hair Unit is sent to be specifically used for：At least one mapped file or at least one data message are sent to the video quality assessment device, The configured information is carried at least one mapped file or at least one data message.
- 18. the headend according to any one of claim 15 to 17, it is characterised in that institute The first transmitting element is stated to be specifically used for：After second transmitting element sends the configured information to the video quality assessment device, Send the video flowing.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610338793.7A CN107404646B (en) | 2016-05-20 | 2016-05-20 | The method, apparatus and headend of video quality assessment |
| PCT/CN2017/085140 WO2017198223A1 (en) | 2016-05-20 | 2017-05-19 | Video quality evaluation method, device and remote radio head |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610338793.7A CN107404646B (en) | 2016-05-20 | 2016-05-20 | The method, apparatus and headend of video quality assessment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107404646A true CN107404646A (en) | 2017-11-28 |
| CN107404646B CN107404646B (en) | 2019-11-29 |
Family
ID=60325709
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610338793.7A Active CN107404646B (en) | 2016-05-20 | 2016-05-20 | The method, apparatus and headend of video quality assessment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107404646B (en) |
| WO (1) | WO2017198223A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108200471A (en) * | 2018-01-08 | 2018-06-22 | 中国科学技术大学 | A kind of construction method for the standard data set for evaluating and testing encrypted video QoE |
| CN109089153A (en) * | 2018-08-31 | 2018-12-25 | 平安科技（深圳）有限公司 | PS data stream method, apparatus, computer equipment and storage medium |
| CN111866583A (en) * | 2019-04-24 | 2020-10-30 | 北京京东尚科信息技术有限公司 | Video monitoring resource adjusting method, device, medium and electronic equipment |
| CN112584341A (en) * | 2019-09-30 | 2021-03-30 | 华为技术有限公司 | Communication method and device |
| CN114611637A (en) * | 2022-05-11 | 2022-06-10 | 腾讯科技（深圳）有限公司 | Data processing method, device, equipment and readable storage medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113923441B (en) * | 2020-07-08 | 2023-10-20 | 钉钉控股（开曼）有限公司 | Video quality assessment method and device and electronic equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101626507A (en) * | 2008-07-07 | 2010-01-13 | 华为技术有限公司 | Method, device and system for identifying frame type of RTP package |
| CN102257831A (en) * | 2011-06-09 | 2011-11-23 | 华为技术有限公司 | Method and network node for video quality evaluation |
| CN102611894A (en) * | 2012-03-02 | 2012-07-25 | 华为技术有限公司 | Method, device and system for detecting video transmission packet loss |
| CN102651821A (en) * | 2011-02-28 | 2012-08-29 | 华为技术有限公司 | Method and device for evaluating quality of video |
| CN103634594A (en) * | 2012-08-21 | 2014-03-12 | 华为技术有限公司 | Method and apparatus for obtaining video coding compression quality |
| CN105049930A (en) * | 2015-08-14 | 2015-11-11 | 浙江大学 | Wireless video streaming service QoE estimation method based on support vector machine |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011114444A (en) * | 2009-11-25 | 2011-06-09 | Fujitsu Ltd | Information processor, method of generating information, and program |
-
2016
- 2016-05-20 CN CN201610338793.7A patent/CN107404646B/en active Active
-
2017
- 2017-05-19 WO PCT/CN2017/085140 patent/WO2017198223A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101626507A (en) * | 2008-07-07 | 2010-01-13 | 华为技术有限公司 | Method, device and system for identifying frame type of RTP package |
| CN102651821A (en) * | 2011-02-28 | 2012-08-29 | 华为技术有限公司 | Method and device for evaluating quality of video |
| CN102257831A (en) * | 2011-06-09 | 2011-11-23 | 华为技术有限公司 | Method and network node for video quality evaluation |
| CN102611894A (en) * | 2012-03-02 | 2012-07-25 | 华为技术有限公司 | Method, device and system for detecting video transmission packet loss |
| CN103634594A (en) * | 2012-08-21 | 2014-03-12 | 华为技术有限公司 | Method and apparatus for obtaining video coding compression quality |
| CN105049930A (en) * | 2015-08-14 | 2015-11-11 | 浙江大学 | Wireless video streaming service QoE estimation method based on support vector machine |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108200471A (en) * | 2018-01-08 | 2018-06-22 | 中国科学技术大学 | A kind of construction method for the standard data set for evaluating and testing encrypted video QoE |
| CN108200471B (en) * | 2018-01-08 | 2019-08-16 | 中国科学技术大学 | A kind of construction method of standard data set that evaluating and testing encrypted video QoE |
| CN109089153A (en) * | 2018-08-31 | 2018-12-25 | 平安科技（深圳）有限公司 | PS data stream method, apparatus, computer equipment and storage medium |
| CN109089153B (en) * | 2018-08-31 | 2022-08-19 | 平安科技（深圳）有限公司 | PS data stream decoding method, device, computer equipment and storage medium |
| CN111866583A (en) * | 2019-04-24 | 2020-10-30 | 北京京东尚科信息技术有限公司 | Video monitoring resource adjusting method, device, medium and electronic equipment |
| CN111866583B (en) * | 2019-04-24 | 2024-04-05 | 北京京东尚科信息技术有限公司 | Video monitoring resource adjusting method, device, medium and electronic equipment |
| CN112584341A (en) * | 2019-09-30 | 2021-03-30 | 华为技术有限公司 | Communication method and device |
| CN112584341B (en) * | 2019-09-30 | 2022-12-27 | 华为云计算技术有限公司 | Communication method and device |
| CN114611637A (en) * | 2022-05-11 | 2022-06-10 | 腾讯科技（深圳）有限公司 | Data processing method, device, equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2017198223A1 (en) | 2017-11-23 |
| CN107404646B (en) | 2019-11-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107404646A (en) | The method, apparatus and headend of video quality assessment | |
| JP5302342B2 (en) | Method, apparatus and system for evaluating the quality of a video code stream | |
| EP2364540B1 (en) | Method for estimating the 'quality of experience' of a user in respect of audio and/or video contents distributed through telecommunications networks | |
| US9723329B2 (en) | Method and system for determining a quality value of a video stream | |
| CN103119895A (en) | Method of and system for measuring quality of audio and video bit stream transmissions over a transmission chain | |
| CN108809893A (en) | A kind of video quality evaluation method and equipment | |
| JP2011071956A (en) | Policy-based video quality assessment | |
| CN109981382B (en) | Method and device for detecting error code | |
| EP3491784B1 (en) | Estimation of losses in a video stream | |
| KR100728622B1 (en) | System, Set-Top Box and Method for Providing Quality Information of TV Service for Use in Internet Protocol Networks | |
| CN106330713A (en) | Message transmission method and device | |
| JP7105838B2 (en) | Video quality evaluation method and device | |
| US9203708B2 (en) | Estimating user-perceived quality of an encoded stream | |
| US20120297433A1 (en) | Method and arrangement for supporting quality estimation of streamed video | |
| EP1993233B1 (en) | Method of evaluating a transmission quality by injecting meta-information | |
| Zhang et al. | Efficient streaming packet video over differentiated services networks | |
| Exarchakos et al. | Can Skype be used beyond video calling? | |
| JP2010063004A (en) | Video data transmission apparatus, video distribution system, video quality evaluation method and program | |
| Msakni et al. | Provisioning QoE over converged networks: Issues and challenges | |
| Ma et al. | Model-based QoE prediction to enable better user experience for video teleconferencing | |
| CN110691233B (en) | Method and device for evaluating concurrency performance of video forwarding server | |
| CN110708604B (en) | Method and device for adapting IP channel bandwidth of video forwarding server | |
| JP2011004354A (en) | Video quality estimating device, video quality estimation method, and control program for the video quality estimating device | |
| Kollar et al. | A method of MOS evaluation for video based services | |
| Karacali | Network assessment for low bitrate video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |