CN116567364A - Network quality determining method and communication device - Google Patents
Network quality determining method and communication device Download PDFInfo
- Publication number
- CN116567364A CN116567364A CN202210105306.8A CN202210105306A CN116567364A CN 116567364 A CN116567364 A CN 116567364A CN 202210105306 A CN202210105306 A CN 202210105306A CN 116567364 A CN116567364 A CN 116567364A
- Authority
- CN
- China
- Prior art keywords
- frame
- video
- type
- video frame
- time period
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 103
- 238000004891 communication Methods 0.000 title claims abstract description 57
- 230000005540 biological transmission Effects 0.000 claims abstract description 49
- 230000006735 deficit Effects 0.000 claims description 49
- 238000012545 processing Methods 0.000 claims description 38
- 238000011156 evaluation Methods 0.000 claims description 23
- 238000013441 quality evaluation Methods 0.000 claims description 23
- 230000015654 memory Effects 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 10
- 230000009286 beneficial effect Effects 0.000 abstract description 13
- 230000006870 function Effects 0.000 description 33
- 235000008694 Humulus lupulus Nutrition 0.000 description 13
- 230000000875 corresponding effect Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 238000013461 design Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000007726 management method Methods 0.000 description 6
- 239000004065 semiconductor Substances 0.000 description 6
- 230000003190 augmentative effect Effects 0.000 description 5
- 229910044991 metal oxide Inorganic materials 0.000 description 5
- 150000004706 metal oxides Chemical class 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 229910000577 Silicon-germanium Inorganic materials 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000000737 periodic effect Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000005641 tunneling Effects 0.000 description 2
- JBRZTFJDHDCESZ-UHFFFAOYSA-N AsGa Chemical compound [As]#[Ga] JBRZTFJDHDCESZ-UHFFFAOYSA-N 0.000 description 1
- LEVVHYCKPQWKOP-UHFFFAOYSA-N [Si].[Ge] Chemical compound [Si].[Ge] LEVVHYCKPQWKOP-UHFFFAOYSA-N 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012417 linear regression Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Databases & Information Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The application provides a network quality determining method and a communication device, wherein the method comprises the following steps: determining an ideal transmission moment of the video frame in the first time period; if the actual sending time of the video frame is before the ideal sending time of the video frame, the video frame is not the first type of frame skipping; if the actual sending time of the video frame is after the ideal sending time of the video frame, the video frame is a first type of skip frame; a first frame skipping network quality score is determined based on whether each video frame is a first type of frame skipping within the first time period. Based on the method described in the application, the network quality score can be determined based on the granularity of the frame, which is beneficial to enabling the determined network quality score to be more consistent with user experience.
Description
Technical Field
The present disclosure relates to the field of communications technologies, and in particular, to a network quality determining method and a communications device.
Background
Augmented reality (XR) is a generic term for Virtual Reality (VR), augmented reality (augmented reality, AR), and Mixed Reality (MR). VR is a technology that can create a virtual world, giving an immersive experience, by generating sounds, images, etc. through a headset that a human body can perceive. AR is capable of superimposing computer-generated virtual information (e.g., objects, pictures, videos, sounds, system cues, etc.) into a real scene and interacting with a person. Cell phones, tablets, and head mounted AR glasses are currently the most popular AR devices. Mixed Reality (MR) refers to a new visual environment created after the fusion of the real world and the virtual world, in which real and data entities coexist while being able to interact in real time. That is, the "images" are placed in real space while they interact to some extent with what we are familiar with. A key feature of MR is the ability of a synthetic object and a real object to interact in real time.
Video transmission is a core of XR services, and XR video consists of multiple frames. An XR video frame compressed by a source compression standard typically consists of a plurality of data packets. In the transmission of XR video frames, the cliff effect exists. The cliff effect refers to the phenomenon that bit-level errors spread within an XR video frame, and single bit errors can lead to a dramatic drop in picture quality across the XR video frame. This means that only the entire data packet of the XR video frame is received, the picture of the XR video frame can be played normally.
In existing network quality determination systems, network quality is determined primarily based on packet granularity. For example, network devices typically have packet loss rate (packet error rate, PER) as a network quality indicator. However, for XR video transmission service, due to cliff effect, different packet loss positions have great difference on the frame loss effect of XR video service under the same packet loss rate. For example, assuming that the number of dropped packets is 100, if these 100 data packets are all included in 1 XR video frame, the number of dropped frames is 1. If all of these 100 data packets are included in 100 XR video frames, the number of dropped frames is 100. The different number of lost frames results in different experience impairments for the user. Therefore, for XR video transport services, the network quality indicator determined based on packet granularity does not conform to the user experience.
Disclosure of Invention
The network quality determining method and the communication device are beneficial to determining network quality indexes meeting user experience.
In a first aspect, the present application provides a method for determining network quality, where the method may be performed by an access network device, may be performed by a component (such as a processor, a chip, or a chip system) of the access network device, or may be implemented by a logic module or software that can implement all or part of the functions of the access network device. The method comprises the following steps: determining an ideal transmission moment of the video frame in the first time period; if the actual sending time of the video frame is before the ideal sending time of the video frame, the video frame is not the first type of frame skipping; if the actual sending time of the video frame is after the ideal sending time of the video frame, the video frame is a first type of skip frame; a first frame skipping network quality score is determined based on whether each video frame is a first type of frame skipping within the first time period.
Based on the method described in the first aspect, the network quality score can be determined based on the granularity of the frame, which is beneficial to making the determined network quality score more consistent with the user experience.
Optionally, the actual sending time of the video frame may be the actual sending time of the tail packet of the video frame, the actual sending time of the middle packet of the video frame, or the actual sending time of the first packet of the video frame. The ideal sending time of the video frame can be the ideal sending time of the tail packet of the video frame, the ideal sending time of the middle packet of the video frame and the ideal sending time of the first packet of the video frame.
In one possible implementation, based on whether each video frame is a first type of frame skip in the first period, determining the first frame skip network quality score is implemented by: based on whether each video frame in the first time period is a first type of frame skipping, determining user experience damage h of the first type of frame skipping occurring continuously x times in the first time period x X=1, …, n, n is the maximum number of consecutive occurrences of the first type skip frame in the first time period; based on user experience damage h x A first frame hopping network quality score is determined. Based on this possible implementation, the network quality score can be determined based on the user experience loss in different consecutive frame skip situations, i.e. the network quality score can be determined based on finer granularity frame skip situationsThis is advantageous in making the determined network quality score more user experience compliant.
In one possible implementation, based on whether each video frame is a first type of frame skip within a first period of time, a user experience impairment h for which the first type of frame skip occurs x consecutive times within the first period of time is determined x The specific implementation mode of the method is as follows: determining a proportion w based on whether each video frame in the first time period is a first type skip frame x Ratio w x The ratio of the total frame number of the first type skip frames to the total number of the video frames transmitted in the first time period is continuously x times in the first time period; based on the proportion w x Determining user experience impairment h x . Based on the possible implementation manner, the user experience loss h can be accurately determined x 。
In one possible implementation, the ratio w is determined based on whether each video frame is a first type of skip frame during the first period of time x The specific implementation mode of the method is as follows: determining a first frame skipping rate in the first time period based on whether each video frame in the first time period is a first type of frame skipping, wherein the first frame skipping rate is the ratio of the total number of the first type of frame skipping in the first time period to the total number of the video frames transmitted in the first time period; determining a ratio w based on the first frame rate x . Based on the possible implementation manner, the proportion w can be determined by only counting the total number of the first type of frame skipping in the first time period without counting the total number of the first type of frame skipping continuously x times in the first time period x And the power consumption is saved.
In another possible implementation, the ratio w is determined based on whether each video frame is a first type of skip frame during the first period of time x The specific implementation mode of the method is as follows: based on whether each video frame in the first time period is a first type of frame, counting total frames of the first type of frame occurring continuously x times in the first time period, and determining a proportion w based on the total frames of the first type of frame occurring continuously x times in the first time period x . Based on this possible implementation, the first frame rate and the ratio w do not need to be stored in advance x The corresponding relation between the two is beneficial to saving storage resources.
In one possible implementation, h x The following formula is satisfied:
h x ＝MAX(MIN(H，1/(a x +b x *exp(c x *(w x -d x ))))，1)
throughout the present application, H is the maximum value of the network quality score. For example, H may be 5 or 10 or 100. Throughout this application, a x 、b x 、c x 、d x Is the fitting coefficient.
In another possible implementation, h x The following formula is satisfied:
h x ＝MAx(MIN(H，1/(a x +b x *w x )+c x )，1)
in one possible implementation, assume that the first frame hopping network quality score is XQI Frame-out skip ，XQI Frame-out skip The following formula is satisfied:
in one possible implementation, the method may further include: determining a video image quality evaluation score and a video group delay evaluation score; and determining a target network quality score based on the first frame skipping network quality score, the video image quality evaluation score and the video group delay evaluation score. Based on the possible implementation manner, the network quality score can be comprehensively determined based on scores of multiple dimensions, so that the determined network quality score is beneficial to being more in line with user experience.
Assuming that the target network quality score is XQI, the first frame-skip network quality score is XQI Frame-out skip The video image quality evaluation score was XQI Image quality The video group delay evaluation score is XQI Group delay . In one possible implementation, XQI satisfies the following formula:
XQI＝min(max((XQI image quality -1)*(1-c1*(H-XQI Frame-out skip )-c2*(H-XQI Group delay )-c3*|XQI Frame-out skip -XQI Group delay |)+1，1)，XQI Frame-out skip ，XQI Image quality ，XQI Group delay ，H)
Wherein, throughout this application, c1, c2 or c3 is the fitting coefficient.
In another possible implementation, XQI satisfies the following formula:
XQI＝min(max(c1*XQI image quality +c2*XQI Frame-out skip +c3*XQI Group delay ，1)，XQI Frame-out skip ，XQI Image quality ，XQI Group delay ，H)
In one possible implementation, an ideal arrival time of a video frame within a first time period is determined; if the actual arrival time of the video frame is before the ideal arrival time of the video frame, the video frame is not a second type of frame skipping; if the actual arrival time of the video frame is after the ideal arrival time of the video frame, the video frame is a second type of skip frame; and determining a second frame skipping network quality score based on whether each video frame in the first time period is a second type of frame skipping. Based on the possible implementation manner, the transmission quality of the front-end network of the access network equipment can be determined, so that the position where the network problem occurs can be conveniently positioned, and the position where the network problem occurs can be prevented from being misjudged.
Optionally, the actual arrival time of the video frame may be the actual arrival time of the first packet of the video frame, the actual arrival time of the middle packet of the video frame, or the actual arrival time of the last packet of the video frame. The ideal arrival time of the video frame can be the ideal arrival time of the first packet of the video frame, the ideal arrival time of the middle packet of the video frame and the ideal arrival time of the tail packet of the video frame.
In one possible implementation, based on whether each video frame in the first period is a frame of a second type, determining the quality score of the second frame-skipping network is implemented by: determining user experience damage h of the second type of frame skipping continuously y times in the first time period based on whether each video frame in the first time period is the second type of frame skipping y Y=1, …, m, m is the maximum number of consecutive occurrences of the second type of frame skip in the first period; based on user experience damage h y And determining the quality fraction of the second frame-skipping network. Based on this possible implementation, the network quality score can be determined based on the user experience loss in different successive frame hops, i.e. finer grain basedThe network quality score is determined according to the frame skip condition, so that the determined network quality score is more in line with user experience.
In one possible implementation, based on whether each video frame is a second type of frame skip in a first period of time, determining a user experience impairment h for which the second type of frame skip occurs y consecutive times in the first period of time y The specific implementation mode of the method is as follows: determining a proportion w based on whether each video frame in the first time period is a second type skip frame y Ratio w y The ratio of the total frame number of the second type of skip frames to the total number of video frames received in the first time period is that the second type of skip frames continuously appear y times in the first time period; based on the proportion w y Determining user experience impairment h y . Based on the possible implementation manner, the user experience loss h can be accurately determined y 。
In one possible implementation, the ratio w is determined based on whether each video frame is a second type of frame skip during the first period of time y The specific implementation mode of the method is as follows: determining a second frame skipping rate in the first time period based on whether each video frame in the first time period is a second type of frame skipping, wherein the second frame skipping rate is a ratio of the total number of the second type of frame skipping in the first time period to the total number of the video frames received in the first time period; determining the ratio w based on the second frame-skip rate y . Based on the possible implementation manner, the proportion w can be determined by only counting the total number of the second type of frame skipping in the first time period without counting the total number of the second type of frame skipping continuously for y times in the first time period y And the power consumption is saved.
In one possible implementation, the ratio w is determined based on whether each video frame is a second type of frame skip during the first period of time y The specific implementation mode of the method is as follows: based on whether each video frame in the first time period is a second type of frame, counting total frames of the second type of frame occurring continuously y times in the first time period, and determining a proportion w based on the total frames of the second type of frame occurring continuously y times in the first time period y . Based on this possible implementation, the second frame-skip rate and the ratio w do not need to be stored in advance y The corresponding relation between the two is beneficial to saving storage resources.
In one possible implementation, h y The following formula is satisfied:
h y ＝MAX(MIN(H，1/(a y +b y *exp(c y *(w y -d y ))))，1)
wherein, throughout this application, a y 、b y 、c y 、d y Is the fitting coefficient.
In another possible implementation, h y The following formula is satisfied:
h y ＝MAX(MIN(H，1/(a y +b y *w y )+c y )，1)
optionally, assume that the second frame-skipping network quality score is XQI Frame-skip-in ，XQI Frame-skip-in The following formula is satisfied:
in one possible implementation, the third frame-skipping network quality score may also be determined based on the first frame-skipping network quality score and the second frame-skipping network quality score. Based on this possible implementation, the determined network quality score can be made more accurate.
Optionally, assume that the third frame hopping network quality score is XQI Frame skip ，XQI Frame skip The following formula is satisfied:
XQI frame skip ＝H-(XQI Frame-skip-in -XQI Frame-out skip )
In one possible implementation, a video quality evaluation score and a video group delay evaluation score may also be determined, and a target network quality score is determined based on the third frame skipping network quality score, the video quality evaluation score, and the video group delay evaluation score. Based on the possible implementation manner, the network quality score can be comprehensively determined based on scores of multiple dimensions, so that the determined network quality score is beneficial to being more in line with user experience.
Assuming that the quality score of the target network is XQI, the quality score of the third frame-skip network is XQI Frame skip Video frequencyImage quality evaluation score of XQI Image quality The video group delay evaluation score is XQI Group delay . In one possible implementation, XQI satisfies the following formula:
XQI＝min(max((XQI image quality -1)*(1-c1*(H-XQI Frame skip )-c2*(H-XQI Group delay )-c3*|XQI Frame skip -XQI Group delay |+1，1)，XQI Frame skip ，XQI Image quality ，XQI Group delay ，H)
Wherein, throughout this application, c1, c2 or c3 is the fitting coefficient.
In another possible implementation, XQI satisfies the following formula:
XQI＝min(max(c1*XQI image quality +c2*XQI Frame skip +c3*XQI Group delay ，1)，XQI Frame skip ，XQI Image quality ，XQI Group delay ，H)
In one possible implementation, the ideal transmission time of the video frame is a sum of an ideal arrival time of the video frame and a frame delay budget time, the ideal arrival time of the video frame being determined based on the actual arrival time of the video frame and the actual arrival times of a plurality of video frames preceding the video frame. Based on the possible implementation manner, the ideal arrival time of the video frame can be learned online based on the actual arrival time of the video frame and the actual arrival time of a plurality of video frames before the video frame, so that the ideal arrival time of the video frame can be more accurate.
In a second aspect, the present application provides a communication apparatus, which may be an access network device, or an apparatus in an access network device, or an apparatus that can be used in a matching manner with an access network device. The communication device may also be a chip system. The communication device may perform the method of the first aspect. The functions of the communication device can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes one or more units or modules corresponding to the functions described above. The unit or module may be software and/or hardware. The operations and advantages performed by the communication device may be seen in the method and advantages of the first aspect described above.
In a third aspect, the present application provides a communications apparatus comprising a processor, the method as in the first aspect being performed when the processor invokes a computer program in memory.
In a fourth aspect, the present application provides a communication device comprising a processor and a memory, the processor and the memory coupled; the processor is for implementing the method as in the first aspect.
In a fifth aspect, the present application provides a communication device comprising a processor, a memory, and a transceiver, the processor and the memory coupled; the transceiver is for receiving and transmitting data and the processor is for implementing the method as in the first aspect.
In a sixth aspect, the present application provides a communications device comprising a processor for receiving or outputting signals and an interface for implementing a method as in the first aspect by logic circuitry or executing code instructions.
In a seventh aspect, the present application provides a computer readable storage medium having stored therein a computer program or instructions which, when executed by a communication device, implement a method as in the first aspect.
In an eighth aspect, the present application provides a computer program product comprising instructions which, when read and executed by a computer, cause the computer to perform the method as in the first aspect.
Drawings
FIG. 1 is a schematic diagram of a system architecture provided herein;
fig. 2 is a schematic diagram of a frame skip provided in the present application;
fig. 3 is a flow chart of a network quality determining method provided in the present application;
FIG. 4 is a schematic diagram of another frame skip provided herein;
fig. 5 is a flow chart of another network quality determining method provided in the present application;
FIG. 6 is a schematic diagram of another frame skip provided herein;
fig. 7 is a schematic structural diagram of a communication device provided in the present application;
fig. 8 is a schematic structural diagram of another communication device provided in the present application;
fig. 9 is a schematic structural diagram of a chip provided in the present application.
Detailed Description
Specific embodiments of the present application are described in further detail below with reference to the accompanying drawings.
The terms first and second and the like in the description, in the claims and in the drawings, are used for distinguishing between different objects and not for describing a particular sequential order. Furthermore, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those listed steps or elements but may include other steps or elements not listed or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the present application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments.
In the present application, "at least one (item)" means one or more, "a plurality" means two or more, and "at least two (items)" means two or three or more, and/or "for describing an association relationship of an association object, three kinds of relationships may exist, for example," a and/or B "may represent: only a, only B and both a and B are present, wherein a, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "at least one of" or the like means any combination of these items, including any combination of single item(s) or plural items(s). For example, at least one (one) of a, b or c may represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", wherein a, b, c may be single or plural.
In order to determine a network quality index meeting user experience, the application provides a network quality determining method and a communication device. For a better understanding of the embodiments of the present application, the following first describes a system architecture related to the embodiments of the present application:
the technical solution of the embodiment of the application can be applied to various communication systems, for example: global system for mobile communications (global system of mobile communication, GSM), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA) systems, general packet radio service (general packet radio service, GPRS), long term evolution (long term evolution, LTE) systems, LTE frequency division duplex (frequency division duplex, FDD) systems, LTE time division duplex (time division duplex, TDD), universal mobile telecommunications system (universal mobile telecommunication system, UMTS), worldwide interoperability for microwave access (worldwide interoperability for microwave access, wiMAX) communication systems, fifth generation (5th generation,5G) systems or new radio, NR) future communication systems, and the like.
Referring to fig. 1, fig. 1 is a schematic diagram of a system architecture according to an embodiment of the present application. As shown in fig. 1, the system architecture includes a media server, a Core Network (CN), a radio access network (R AN), and a terminal.
The media server, the core network, the access network and the terminal related to the system architecture in fig. 1 are described in detail below.
1. Media server
A device that provides computing or application services. In a peer-to-peer (RAN-application coordination) scenario, a media server may encapsulate a media information field and send the media information field to a core network via a protocol. The media information field includes media information indicating which packets belong to which video frames. For example, the media information indicates that the packet with the packet sequence number {1,2,4, …,60} belongs to the j-th frame of the i-th user, i is greater than or equal to 0, and j is greater than or equal to 0.
2. Core network
The three functions of registration, connection and session management are completed. Network opening function module: exposing services and capabilities of the 3GPP network functions to the application functions (application function, AF), while also allowing the AF to provide information to the 3GPP network functions; policy charging function module: policy management of charging policy and service quality policy is carried out; session management function (session management function, SMF): completing UE IP address allocation, user plane function selection, charging and service quality policy control and other session management functions; user plane function module (user plane function, UPF): and forwarding the user plane specific data, and generating a ticket based on the traffic condition. And simultaneously, the function of a data plane anchor point is realized.
In the end-management collaboration scenario, the core network is responsible for parsing the media information field and informing the access network device of the media information in the media information field through the GPRS tunneling protocol (GPRS tunneling protocol for the user plane, GTP-U) of the user plane. If the core network cannot obtain the media information, the core network can also perform video frame identification according to the packet characteristics, identify the data packets belonging to the same video frame, and then notify the access network device of the media information.
3. Access network
One or more access network devices (or network devices) may be included in the access network, and an interface between the access network device and the terminal may be a Uu interface (or referred to as a null interface). Of course, in future communications, the names of these interfaces may be unchanged or may be replaced with other names, which are not limited in this application.
The access network device is a node or device for accessing the terminal to the wireless network. The access network device may be any device having a wireless transceiver function, including but not limited to: an evolved base station (NodeB or eNB or e-NodeB, evolutional Node B) in LTE, a base station (gnnodeb or gNB) in NR, or a transmission reception point (transmission receptionpoint, TRP), a base station for 3GPP subsequent evolution, an access node in a WiFi system, a wireless relay node, a wireless backhaul node, etc. The base station may be: macro base station, micro base station, pico base station, small station, relay station, or balloon station, etc. Multiple base stations may support networks of the same technology as mentioned above, or may support networks of different technologies as mentioned above. A base station may contain one or more co-sited or non-co-sited TRPs. The access network device may also be a radio controller, a Central Unit (CU), and/or a Distributed Unit (DU) in the context of a cloud radio access network (cloud radio access network, CRAN). The access network device may also be a server, a wearable device, or an in-vehicle device, etc. The following description will take an access network device as a base station as an example. The access network devices may be the same type of base station, or may be different types of base stations. The base station may communicate with the terminal or may communicate with the terminal through a relay station. The terminal may communicate with a plurality of base stations of different technologies, for example, the terminal may communicate with a base station supporting an LTE network, may communicate with a base station supporting a 5G network, and may support dual connectivity with the base station of the LTE network and the base station of the 5G network.
4. Terminal
Terminals include devices that provide voice and/or data connectivity to a user, e.g., a terminal is a device with wireless transceiver capabilities that may be deployed on land, including indoors or outdoors, hand-held, wearable or vehicle-mounted; can also be deployed on the water surface (such as ships, etc.); but may also be deployed in the air (e.g., on aircraft, balloon, satellite, etc.). The terminal may be a mobile phone, a tablet (Pad), a computer with wireless transceiving function, a Virtual Reality (VR) terminal, an Augmented Reality (AR) terminal, a Mixed Reality (MR) terminal, an augmented reality (XR) terminal, a wireless terminal in industrial control (industrial control), a vehicle-mounted terminal, a wireless terminal in unmanned (self driving), a wireless terminal in remote medical (remote medical), a wireless terminal in smart grid (smart grid), a wireless terminal in transportation security (transportation safety), a wireless terminal in smart city, a wireless terminal in smart home (smart home), a wearable terminal, and the like. The embodiments of the present application are not limited to application scenarios. A terminal may also be referred to as a terminal device, user Equipment (UE), access terminal, vehicle terminal, industrial control terminal, UE unit, UE station, mobile station, remote terminal, mobile device, UE terminal, wireless communication device, UE agent, UE apparatus, or the like. The terminal may also be fixed or mobile.
In order to facilitate understanding of the technical solution of the present invention, some terms or terms used in the embodiments of the present application are explained below.
1. Video frame
The video frame in the embodiment of the application may be a video frame of an XR service, or a video frame of a cloud service, etc. Such as cloud services may be cloud games, cloud video, etc. A video frame comprises a plurality of data packets, and after receiving all the data packets of the video frame, the terminal can normally play the picture corresponding to the video frame. And the terminal does not delay playing of the video frames, if a certain video frame misses the playing window, the video frame is discarded by the terminal.
2. Frame skip
If the terminal receives a certain video frame, but the terminal does not display the video frame because the video frame misses the playing window, the frame is jumped. For example, as shown in fig. 2, assume that a rectangular block length represents a continuous transmission time of a video frame from a first packet transmission to a last packet transmission. The first packet of a video frame represents the first packet of the video frame and the last packet of the video frame represents the last packet of the video frame. The time interval during which the end packets of the video frames are sent out from the access network device does not follow a strict periodicity, but rather jitter is present. In fig. 2, a strict cycle is indicated by a dotted line. It can be seen that the tail packet of video frame 2 is transmitted in the same time interval as the tail packet of video frame 3, which would collide when the display is refreshed. When the video is played, the latest frame is always displayed, namely the video frame 3 is played, and then the frame skipping occurs in the video frame 2. The frame skip occupies air interface resources, and although the frame skip cannot be finally displayed, decoding rendering can be assisted at the terminal. But from the display refresh point of view cannot be played within a specific time window.
The network quality determining method and the communication device provided by the application are further described below with reference to the accompanying drawings:
referring to fig. 3, fig. 3 is a flowchart of a network quality determining method according to an embodiment of the present application. In fig. 3, the access network device is taken as an example of the implementation body of the method, which is not limited in the application. For example, the access network device in fig. 3 may also be a chip, a chip system, or a processor that supports the access network device to implement the method, or may be a logic module or software that can implement all or part of the functions of the access network device. Alternatively, the execution body of the method may be other network devices, which is not limited in the embodiments of the present application. Wherein:
301. the access network device determines an ideal transmission instant of the video frame within the first time period.
In the embodiment of the application, the access network device may send a plurality of video frames to the terminal in the first period. The first period of time may be a preset period of time, for example, may be 50ms (milliseconds), 100ms, 200ms, or the like.
The ideal transmission time of the video frame refers to the time when the access network device transmits the video frame to the terminal in an ideal case. In the existing network, due to the uncertainty of time jitter and scheduling delay of video frames reaching the access network equipment, the time of sending the video frames to the terminal by the access network equipment is quasi-periodic, and the time of sending the video frames to the terminal by the access network equipment is shown to fluctuate near ideal sending time. The ideal transmission time is periodic, the period being the inverse of the video frame rate. The ideal transmission time of the video frame can be specifically the ideal transmission time of the tail packet of the video frame, the ideal transmission time of the middle packet of the video frame or the ideal transmission time of the first packet of the video frame. The first packet of a video frame is the first packet of the video frame. The end packet of the video frame is the last packet of the video frame. The middle packet of a video frame is the packet of the video frame except for the first packet and the last packet.
In one possible implementation, the ideal transmission time of the video frame is the sum of the ideal arrival time of the video frame and the frame delay budget time.
The frame delay budget time may be a preset time. The ideal arrival time of a video frame refers to the time at which the access network device receives the video frame from the core network in an ideal situation. In the existing network, due to the existence of network jitter, the time of the video frame reaching the access network device is quasi-periodic, which is represented by the fact that the time of the video frame reaching the access network device fluctuates around the ideal arrival time. The ideal arrival time of a video frame is periodic, with the period being the inverse of the video frame rate. The ideal arrival time of the video frame may specifically be the first packet ideal arrival time of the video frame, the middle packet ideal arrival time of the video frame, or the last packet ideal arrival time of the video frame.
For example, the ideal receiving time of the video frame is 30.34ms, the frame delay budget time is 3ms, and the ideal transmitting time of the video frame is 33.34ms.
In one possible implementation, the ideal arrival time of a video frame is determined based on the actual arrival time of the video frame and the actual arrival times of a plurality of video frames preceding the video frame. The actual arrival time of a video frame refers to the actual time at which the access network device receives the video frame from the core network. The actual arrival time of the video frame may specifically be the actual arrival time of the first packet of the video frame, the actual arrival time of the middle packet of the video frame, or the actual arrival time of the last packet of the video frame. Based on the possible implementation manner, the ideal arrival time of the video frame can be learned online based on the actual arrival time of the video frame and the actual arrival time of a plurality of video frames before the video frame, so that the ideal arrival time of the video frame can be more accurate.
If the ideal arrival time of the video frame is the first packet ideal arrival time of the video frame, the first packet ideal arrival time of the video frame is determined based on the first packet actual arrival time of the video frame and the first packet actual arrival times of a plurality of video frames preceding the video frame.
If the ideal arrival time of a video frame is a tundish ideal arrival time of a video frame, the tundish ideal arrival time of the video frame is determined based on the actual arrival time of the tundish of the video frame and the actual arrival times of the tundish of a plurality of video frames preceding the video frame.
If the ideal arrival time of the video frame is the ideal arrival time of the tail packet of the video frame, the ideal arrival time of the tail packet of the video frame is determined based on the actual arrival time of the tail packet of the video frame and the actual arrival times of the tail packets of a plurality of video frames preceding the video frame.
The access network device may also receive media information sent by the core network via the GTP-U, where the media information is used to indicate a sequence number of a data packet included in the video frame. After the access network device receives the media information, it can determine a first packet, a middle packet, or a last packet of the video frame based on the media information.
The access network device records the actual arrival time of the video frame after receiving the video frame, so that the recorded actual arrival time of the video frame can be used to determine the ideal arrival time of the subsequently received video frame. For example, taking the ideal arrival time of the video frame as the ideal arrival time of the first packet of the video frame, the actual arrival time of the video frame is exemplified by the actual arrival time of the first packet of the video frame. Assuming that the access network device receives the 100 th video frame, the access network device can record the actual arrival time of the first packet of the 100 th video frame, and learn the ideal arrival time of the first packet of the 100 th video frame on line based on the actual arrival time of the first packet of the 100 th video frame and the actual arrival time of the first packet of the 1 st video frame to the 99 th video frame recorded before.
For example, vectorsThe actual arrival time of the first packet of the 1 st video frame is 0 to the actual arrival time t-1 of the first packet of the 99 th video frame. Vector->Ideal including video frame 1Arrival time T (0) to ideal arrival time T (T-1) of the 99 th video frame. The access network device may employ a linear least squares estimation based on +.>And the actual arrival time T of the 100 th video frame, the ideal arrival time T (T) of the 100 th video frame is determined. For example, assume +.>By linear regression +.>T(t)＝kt+b。
302. The access network device determines a first frame hopping network quality score based on whether each video frame is a first type of frame hopping within the first time period.
In the embodiment of the present application, after determining the ideal transmission time of the video frame, the access network device may determine whether the video frame is a first type of frame skip based on the actual transmission time of the video frame and the ideal transmission time of the video frame. If the actual sending time of the video frame is before the ideal sending time of the video frame, the video frame is not the first type of frame skipping; if the actual sending time of the video frame is after the ideal sending time of the video frame, the video frame is a first type of skip frame. The access network device determines a first frame-skipping network quality score based on the determination result of the first type of frame-skipping of each video frame in the first time period.
The actual sending time of the video frame refers to the actual sending time of the video frame sent by the access network device to the terminal. The actual sending time of the video frame may be the actual sending time of the tail packet of the video frame, the actual sending time of the middle packet of the video frame or the actual sending time of the first packet of the video frame.
If the actual sending time of the video frame is the actual sending time of the tail packet of the video frame, the ideal sending time of the video frame is the ideal sending time of the tail packet of the video frame. If the actual sending time of the video frame is the actual sending time of the tundish of the video frame, the ideal sending time of the video frame is the ideal sending time of the tundish of the video frame. If the actual sending time of the video frame is the actual sending time of the first packet of the video frame, the ideal sending time of the video frame is the ideal sending time of the first packet of the video frame.
For example, taking the ideal transmission time of the video frame as the ideal transmission time of the tail packet of the video frame, the actual transmission time of the video frame is taken as an example. As shown in fig. 4, assume that 6 video frames are transmitted in the first period. The access network device determines whether the video frame 1 is a first type frame skip based on the actual transmission time of the tail packet of the video frame 1 and the ideal transmission time of the tail packet of the video frame 1. The access network device determines whether the video frame 2 is a first type frame skip based on the actual transmission time of the tail packet of the video frame 2 and the ideal transmission time of the tail packet of the video frame 2. And so on, the access network device determines whether the video frame 6 is a first type frame skip based on the actual sending time of the tail packet of the video frame 6 and the ideal sending time of the tail packet of the video frame 6. The access network device may determine an ideal transmission time of the tail packet of the video frame immediately after the video frame is transmitted, and determine whether the video frame is a first type frame skip based on the actual transmission time of the tail packet of the video frame and the ideal transmission time of the tail packet of the video frame. Or, the access network device may determine, after all the video frames in the first period are transmitted, an ideal transmission time of a tail packet of the video frame, and determine whether the video frame is a first type skip frame based on an actual transmission time of the tail packet of the video frame and the ideal transmission time of the tail packet of the video frame. As shown in fig. 4, since the actual transmission time of the tail packet of the video frame 1 is before the ideal transmission time of the tail packet of the video frame 1, the video frame 1 is not a first type skip frame. Since the actual transmission time of the tail packet of the video frame 2 is located after the ideal transmission time of the tail packet of the video frame 2, the video frame 2 is a first type frame skip. Similarly, video frames 3-5 are first class skip frames, and video frame 6 is not a first class skip frame. After the access network device determines whether all video frames in the first time period are the first type of frame skipping, the first frame skipping network quality score is determined based on the determination result of the first type of frame skipping of each video frame in the first time period. The quality score of the first frame-skipping network defines an index of video frame transmission of access network equipment, so that an operator can be guided to build a network, the performance of the network on the influence of user experience is measured, and the network upgrading and updating are pulled. The method can be used for network problem positioning, delimiting, guidance algorithm design or network planning and planning.
In one possible implementation, the specific implementation of the access network device to determine the quality score of the first frame-skipping network based on whether each video frame is a first type of frame-skipping in the first period of time may include the following steps 11) and 12):
11 Based on whether each video frame in the first time period is a first type of frame, the access network device determines that the user experience damage h of the first type of frame occurs continuously x times in the first time period x X=1, …, n, n is the maximum number of consecutive occurrences of the first type skip frame in the first time period.
Wherein n may be a preset value, or n may be the actual maximum number of consecutive occurrences of the first type of frame skip in the first period of time.
For example, assume n is 3. The access network equipment determines user experience damage h of the first type of frame skipping continuously for 1 time in the first time period based on whether each video frame in the first time period is the first type of frame skipping or not 1 And determining user experience impairment h for the occurrence of the first type of frame hops 2 times in succession within the first period of time 2 And determining user experience impairment h for the first type of frame skip occurring 3 times continuously in the first time period 3 The method comprises the steps of carrying out a first treatment on the surface of the Access network equipment is based on user experience damage h 1 User experience impairment h 2 And user experience impairment h 3 A first frame hopping network quality score is determined.
Optionally, the access network device determines, based on whether each video frame in the first period is a first type of frame, user experience impairment h in which the first type of frame is continuously generated x times in the first period x The specific implementation mode of the method is as follows: the access network equipment determines a proportion w based on whether each video frame in the first time period is a first type skip frame x The ratio w x The ratio of the total frame number of the first type skip frames to the total number of the video frames transmitted in the first time period is continuously x times in the first time period; the access network device is based on the ratio w x Determining user experience lossInjury h x . Based on the possible implementation manner, the user experience loss h can be accurately determined x 。
For example, if the case where the first type skip frame occurs 3 times in 1 time in succession within the first period, the total number of frames where the first type skip frame occurs 1 time in succession within the first period is 3. If the first type skip frame occurs 3 times in 2 consecutive times in the first period, the total number of frames in which the first type skip frame occurs 2 consecutive times in the first period is 6. If the first type skip frame occurs 1 time in 3 consecutive occurrences within the first period, the total number of frames in which the first type skip frame occurs 3 consecutive occurrences within the first period is 3. Assume that the total number of video frames transmitted during the first period is 24.w (w) 1 ＝3/24。w 2 ＝6/24。w 3 =3/24. Access network equipment is based on w 1 Determining user experience impairment h 1 And based on w 2 Determining user experience impairment h 2 And based on w 3 Determining user experience impairment h 3 . Access network equipment is based on user experience damage h 1 User experience impairment h 3 A first frame hopping network quality score is determined.
The access network device determines the proportion w based on whether each video frame in the first time period is a first type skip frame x Is presented in terms of two specific embodiments:
the first mode is that the access network equipment determines a first frame-skipping rate in a first time period based on whether each video frame in the first time period is a first type of frame-skipping, wherein the first frame-skipping rate is the ratio of the total number of the first type of frame-skipping in the first time period to the total number of the video frames sent in the first time period; the access network equipment determines a proportion w based on the first frame-skipping rate x 。
For example, assume that a total of 12 first type skip frames occur within a first time period, the total number of video frames transmitted within the first time period being 24. Then the first frame rate is 12/24.
In this way, the first frame rate and w are pre-stored in the access network device x Corresponding relation of (3). n is a preset value. For example, taking n as 5, the first frame rate and w x Corresponding relation of (3) Can be seen in table 1 below. Assuming that the first frame-hopping rate is 10%, the access network device determines w based on the first frame-hopping rate 1 0.09333, w 2 0.006667, w 3 0,w of a shape of 0,w 4 0,w of a shape of 0,w 5 Is 0. Assuming that the first frame-hopping rate is 50%, the access network device determines w based on the first frame-hopping rate 1 Is 0.10667, w 2 0.16666, w 3 Is 0.09, w 4 Is 0.12, w 5 0.016667. Access network equipment is based on w 1 Determining user experience impairment h 1 And based on w 2 Determining user experience impairment h 2 And based on w 3 Determining user experience impairment h 3 And based on w 4 Determining user experience impairment h 4 And based on w 5 Determining user experience impairment h 5 . Access network equipment is based on user experience damage h 1 User experience impairment h 5 A first frame hopping network quality score is determined.
TABLE 1
| First frame rate | w 1 | w 2 | w 3 | w 4 | w 5 |
| 0％ | 0 | 0 | 0 | 0 | 0 |
| 5％ | 0.036663 | 0.013333 | 0 | 0 | 0 |
| 10％ | 0.09333 | 0.006667 | 0 | 0 | 0 |
| 15％ | 0.09333 | 0.033333 | 0.01 | 0.013333 | 0 |
| 20％ | 0.13666 | 0.053333 | 0.01 | 0 | 0 |
| 25％ | 0.15 | 0.08 | 0.02 | 0 | 0 |
| 30％ | 0.12 | 0.11999 | 0.06 | 0 | 0 |
| 35％ | 0.12333 | 0.11333 | 0.07 | 0.026667 | 0.016667 |
| 40％ | 0.09333 | 0.12667 | 0.12 | 0.026667 | 0.033333 |
| 45％ | 0.13 | 0.14 | 0.07 | 0.04 | 0.07 |
| 50％ | 0.10667 | 0.16666 | 0.09 | 0.12 | 0.016667 |
Based on the first mode, the proportion w can be determined by only counting the total number of the first type of frame hops in the first time period without counting the total number of the first type of frame hops continuously occurring for x times in the first time period x And the power consumption is saved. And experiments prove that the proportion w calculated based on the mode one x To determine a network quality score, which may be up to 96.2017% correlated to the measured user experience score.
Based on whether each video frame in the first time period is a first type of frame, the access network equipment counts the total frame number of the first type of frame continuously appearing for x times in the first time period, and determines the proportion w based on the total frame number of the first type of frame continuously appearing for x times in the first time period x . Based on the second mode, the first frame-skip rate and the proportion w are not stored in advance x The corresponding relation between the two is beneficial to saving storage resources.
For example, assume that the total number of video frames transmitted in the first period is 24, and the positions of the first type of skip frames in the first period are video frame 3, video frame 5, video frame 7, video frame 9, video frame 10, video frame 12, video frame 13, video frame 15, video frame 16, and video frame 17, respectively. The access network device determines that the total frame number of the first type of frame hops is 3 in 1 time period, and the total frame number of the first type of frame hops is 4 in 2 time periods, and determines that the total frame number of the first type of frame hops is 3 in 3 time periods. Thus, the access network device determines w 1 ＝3/24。w 2 ＝4/24。w 3 ＝3/24。
That is, in the second mode, the access network device does not need to determine the first frame rate first, and then determine w based on the first frame rate x . The access network device may directly count the total number of frames of the first type of frame hops occurring continuously x times in the first period of time, and determine w based on the total number of frames of the first type of frame hops occurring continuously x times in the first period of time x 。
The following is based on the ratio w for the access network device x Determining user experience impairment h x The description is given of the specific embodiments of (a):
In one possible implementation, h x The following formula is satisfied:
h x ＝MAX(MIN(H，1/(a x +b x *exp(c x *(w x -d x ))))，1)
in the embodiment of the present application, H is the maximum value of the network quality score, which will not be described in detail later. For example, H may be 5 or 10 or 100. Throughout the examples of this application, a x 、b x 、c x 、d x For the fitting coefficients, the description will not be repeated.
In another possible implementation, h x The following formula is satisfied:
h x ＝MAx(MIN(H，1/(a x +b x *w x )+c x )，1)
12 Access network device based on user experience impairment h x A first frame hopping network quality score is determined.
For example, assume that the first frame-skip network quality score is XQI Frame-out skip ，XQI Frame-out skip The following formula is satisfied:
based on steps 11) and 12), the network quality score can be determined based on the user experience loss in different continuous frame skip situations, i.e. the network quality score can be determined based on the frame skip situations with finer granularity, which is beneficial to enabling the determined network quality score to more accord with the user experience.
Alternatively, the access network device may determine the first frame-skipping network quality score without performing the steps 11) and 12) above, and the access network device may determine the first frame-skipping network quality score by other manners based on whether each video frame in the first period is a first type of frame-skipping frame, which is not limited in the embodiment of the present application.
In one possible implementation, the access network device may also determine a video quality evaluation score and a video group delay evaluation score, and determine a target network quality score based on the first frame skipping network quality score, the video quality evaluation score, and the video group delay evaluation score. Based on the possible implementation manner, the network quality score can be comprehensively determined based on scores of multiple dimensions, so that the determined network quality score is beneficial to being more in line with user experience.
The video image quality evaluation score is used for evaluating the picture quality of the video service, wherein the higher the video image quality evaluation score is, the higher the picture quality of the video service is, and the lower the video image quality evaluation score is, the lower the picture quality of the video service is. The video group delay evaluation score is used for evaluating the delay of the video service, and the higher the video group delay evaluation score is, the smaller the delay of the video service is, and the lower the video group delay evaluation score is, the larger the delay of the video service is.
Assuming that the target network quality score is XQI, the first frame-skip network quality score is XQI Frame-out skip The video image quality evaluation score was XQI Image quality The video group delay evaluation score is XQI Group delay . In one possible implementation, XQI satisfies the following formula: XQI =min (max ((XQI) Image quality -1)*(1-c1*(H-XQI Frame-out skip )-c2*(H-XQI Group delay )-c3*|XQI Frame-out skip -XQI Group delay |)+1，1)，XQI Frame-out skip ，XQI Image quality ，XQI Group delay ，H)
Throughout the embodiments of the present application, c1, c2 or c3 are fitting coefficients, which will not be described in detail later.
In another possible implementation, XQI satisfies the following formula:
XQI＝min(max(c1*XQI image quality +c2*XQI Frame-out skip +c3*XQI Group delay ，1)，XQI Frame-out skip ，XQI Image quality ，XQI Group delay ，H)
The quality score of the target network can guide an operator to build a network, the performance of the network on the influence of user experience is measured, and the network upgrading and updating are pulled. The method can be used for positioning and delimiting network problems, guiding algorithm design or network planning and planning, and the like.
Based on the method described in fig. 3, a network quality score can be determined based on the granularity of the frames, which is advantageous to make the determined network quality score more consistent with the user experience.
Referring to fig. 5, fig. 5 is a flowchart of a network quality determining method according to an embodiment of the present application. In fig. 5, the access network device is taken as an example of the implementation body of the method, which is not limited in the application. For example, the access network device in fig. 5 may also be a chip, a chip system, or a processor that supports the access network device to implement the method, or may be a logic module or software that can implement all or part of the functions of the access network device. Alternatively, the execution body of the method may be other network devices, which is not limited in the embodiments of the present application. Wherein:
501. The access network device determines an ideal transmission instant of the video frame within the first time period.
502. The access network device determines a first frame hopping network quality score based on whether each video frame is a first type of frame hopping within the first time period.
The specific implementation manner of step 501 to step 502 may refer to the specific implementation manner of step 301 to step 302, which is not described herein.
503. The access network device determines an ideal arrival time of the video frame within the first time period.
Wherein, step 501 and step 502 may be performed before step 503 and step 504, or after step 503 and step 504, without limitation in this application.
In one possible implementation, the access network device may also perform steps 503 and 504 separately, without performing steps 501 and 502. Fig. 5 exemplifies that the access network device performs both steps 501 and 502 and steps 503 and 504.
For an introduction of the ideal arrival time of the video frame and how to determine the ideal arrival time of the video frame, reference is made to the description of step 301 hereinabove, and details thereof are omitted here.
504. The access network device determines a second frame hopping network quality score based on whether each video frame in the first time period is a second type of frame hopping.
In the embodiment of the present application, after determining the ideal arrival time of the video frame, the access network device may determine whether the video frame is a second type of frame skip based on the actual arrival time of the video frame and the ideal arrival time of the video frame. If the actual arrival time of the video frame is before the ideal arrival time of the video frame, the video frame is not a second type of frame skipping; if the actual arrival time of the video frame is after the ideal arrival time of the video frame, the video frame is a second type of frame skip. The access network equipment determines the network quality score of the second frame skipping based on the judging result of the second type frame skipping of each video frame in the first time period.
For example, taking the ideal arrival time of the video frame as the ideal arrival time of the first packet of the video frame, the actual arrival time of the video frame is the actual arrival time of the first packet of the video frame as an example. As shown in fig. 6, assume that 6 video frames are transmitted in the first period. The access network device determines whether the video frame 1 is a second type of frame skipping based on the actual arrival time of the first packet of the video frame 1 and the ideal arrival time of the first packet of the video frame 1. The access network device determines whether the video frame 2 is a second type of frame skipping based on the actual arrival time of the first packet of the video frame 2 and the ideal arrival time of the first packet of the video frame 2. And so on, the access network device determines whether the video frame 6 is a second type of frame skip based on the actual arrival time of the first packet of the video frame 6 and the ideal arrival time of the first packet of the video frame 6. The access network device may determine an ideal arrival time of the video frame immediately after the video frame arrives at the access network device, and determine whether the video frame is a second type of frame hop based on the actual arrival time of the first packet of the video frame and the ideal arrival time of the first packet of the video frame. Or, the access network device may determine the ideal arrival time of the first packet of the video frame after all the video frames in the first period reach the access network device, and determine whether the video frame is a second type frame skip based on the actual arrival time of the first packet of the video frame and the ideal arrival time of the first packet of the video frame. As shown in fig. 6, since the actual arrival time of the first packet of the video frame 1 is before the ideal arrival time of the first packet of the video frame 1, the video frame 1 is not a second type of frame skip. Since the actual arrival time of the first packet of the video frame 2 is located after the ideal arrival time of the first packet of the video frame 2, the video frame 2 is a second type of frame skip. Similarly, video frames 3-5 are the second type of skipped frames, and video frame 6 is not the second type of skipped frames. After the access network device determines whether all video frames in the first time period are the second type of frame skipping, the second frame skipping network quality score is determined based on the determination result of the second type of frame skipping of each video frame in the first time period. The quality score of the second frame-skipping network can be used for guiding an operator to build a network, measuring the performance of the network on the influence of user experience and pulling the network to upgrade and update. The method can be used for positioning and delimiting network problems, guiding algorithm design or network planning and planning, and the like.
In one possible implementation, the specific implementation of the access network device to determine the quality score of the second frame-skipping network based on whether each video frame is a frame-skipping frame of the second type in the first period may include the following steps 21) and 22):
21 Based on whether each video frame in the first time period is a second type of frame, the access network device determines user experience damage h of the second type of frame occurring continuously y times in the first time period y Y=1, …, m, m is the maximum number of consecutive occurrences of the second type of frame skip in the first period.
Wherein m may be a preset value, or m may also be an actual maximum number of consecutive occurrences of the second type of frame hops in the first period.
For example, assume that m is 3. The access network equipment determines user experience damage h of the second type of frame skipping continuously 1 time in the first time period based on whether each video frame in the first time period is the second type of frame skipping or not 1 And determining user experience impairment h for the second type of frame skip occurring 2 consecutive times within the first period 2 And determining user experience impairment h for the second type of frame skip occurring 3 times continuously in the first time period 3 The method comprises the steps of carrying out a first treatment on the surface of the Access network equipment is based on user experience damage h 1 User experience impairment h 2 And user experience impairment h 3 And determining the quality fraction of the second frame-skipping network.
Optionally, the access network device determines, based on whether each video frame in the first period is a second type of frame, user experience impairment h in which the second type of frame occurs continuously y times in the first period y The specific implementation mode of the method is as follows: the access network equipment determines a proportion w based on whether each video frame in the first time period is a second type of frame skipping y Ratio w y The ratio of the total frame number of the second type of skip frames to the total number of video frames received in the first time period is that the second type of skip frames continuously appear y times in the first time period; the access network device is based on the ratio w y Determining user experience impairment h y . Based on the possible implementation manner, the user experience loss h can be accurately determined y 。
For example, if the case where the second type skip frame occurs 3 times in 1 time in succession within the first period, the total number of frames where the second type skip frame occurs 1 time in succession within the first period is 3. If the second type skip frame occurs 3 times in 2 consecutive times in the first period, the total number of frames in which the second type skip frame occurs 2 consecutive times in the first period is 6. If the second type skip frame occurs 1 time in 3 consecutive occurrences within the first period, the total number of frames in which the second type skip frame occurs 3 consecutive occurrences within the first period is 3. Assume that the total number of video frames received during the first period is 24.w (w) 1 ＝3/24。w 2 ＝6/24。w 3 =3/24. Access network equipment is based on w 1 Determining user experience impairment h 1 And based on w 2 Determining user experience impairment h 2 And based on w 3 Determining user experience impairment h 3 . Access network equipment is based on user experience damage h 1 User experience impairment h 3 And determining a second frame-skipping network quality score.
The access network device determines the proportion w based on whether each video frame in the first time period is a second type of frame skipping y Is presented in terms of two specific embodiments:
the first mode, the access network equipment determines a second frame-skipping rate in the first time period based on whether each video frame in the first time period is a second type frame-skipping frame, wherein the second frame-skipping rate is the ratio of the total number of the second type frame-skipping frames in the first time period to the total number of the video frames received in the first time period; the access network equipment determines the proportion w based on the second frame-skipping rate y . Based on the first mode, the proportion w can be determined by only counting the total number of the second type of frame hops in the first time period without counting the total number of the second type of frame hops in the first time period continuously y times y Is favorable for savingAnd power consumption is saved.
The access network equipment determines the proportion w based on the second frame-skipping rate y The implementation principle of the method and the access network equipment in the previous step determines w based on the first frame hopping rate x The implementation principle of (c) is similar and is not described in detail herein.
Based on whether each video frame in the first time period is a second type of frame, the access network equipment counts the total frame number of the second type of frame continuously appearing y times in the first time period, and determines the proportion w based on the total frame number of the second type of frame continuously appearing y times in the first time period y . Based on the second mode, the second frame-skip rate and the proportion w are not stored in advance y The corresponding relation between the two is beneficial to saving storage resources. Mode two implementation principle, and the previous determination of the ratio w based on the total frame number of the first type of frame hops occurring continuously x times in the first period x The implementation principle of (c) is similar and is not described in detail herein.
The following is based on the ratio w for the access network device y Determining user experience impairment h y The description is given of the specific embodiments of (a):
alternatively, h y The following formula is satisfied:
h y ＝MAX(MIN(H，1/(a y +b y *exp(c y *(w y -d y ))))，1)
throughout the examples of the present application, a y 、b y 、c y 、d y For the fitting coefficients, the description will not be repeated.
Alternatively, h y The following formula is satisfied:
h y ＝MAX(MIN(H，1/(a y +b y *w y )+c y )，1)
22 Based on user experience impairment h) y And determining the quality fraction of the second frame-skipping network.
For example, assume that the second frame-skip network quality score is XQI Frame-skip-in ，XQI Frame-skip-in The following formula is satisfied:
based on step 21) and step 22), the network quality score can be determined based on the user experience loss in different continuous frame skip situations, i.e. the network quality score can be determined based on the frame skip situations with finer granularity, which is beneficial to enabling the determined network quality score to more accord with the user experience.
In one possible implementation, the access network device may also determine a third frame-skip network quality score based on the first frame-skip network quality score and the second frame-skip network quality score. Based on this possible implementation, the determined network quality score can be made more accurate.
For example, assume that the third-hop network quality score is XQI Frame skip ，XQI Frame skip The following formula is satisfied:
XQI frame skip ＝H-(XQI Frame-skip-in -XQI Frame-out skip )
In one possible implementation, the access network device may further determine a video quality evaluation score and a video group delay evaluation score, and determine a target network quality score based on the third frame skipping network quality score, the video quality evaluation score, and the video group delay evaluation score. Based on the possible implementation manner, the network quality score can be comprehensively determined based on scores of multiple dimensions, so that the determined network quality score is beneficial to being more in line with user experience.
For relevant descriptions of the video quality score and the video group delay score, reference is made to the foregoing description, and details thereof are omitted herein.
Assuming that the quality score of the target network is XQI, the quality score of the third frame-skip network is XQI Frame skip The video image quality evaluation score was XQI Image quality The video group delay evaluation score is XQI Group delay . In one possible implementation, XQI satisfies the following formula:
XQI＝min(max((XQI image quality -1)*(1-c1*(H-XQI Frame skip )-c2*(H-XQI Group delay )-c3*|XQI Frame skip -XQI Group delay |)+1，1)，XQI Frame skip ，XQI Image quality ，XQI Group timeDelay line ，H)
In another possible implementation, XQI satisfies the following formula:
XQI＝min(max(c1*XQI image quality +c2*XQI Frame skip +c3*XQI Group delay ，1)，XQI Frame skip ，XQI Image quality ，XQI Group delay ，H)
Based on the method described in fig. 5, the transmission quality of the front network of the access network device can also be determined, so that the position where the network problem occurs can be conveniently located, and the position where the network problem occurs can be prevented from being misjudged.
Referring to fig. 7, fig. 7 shows a schematic structural diagram of a communication device according to an embodiment of the present application. The communication device shown in fig. 7 may be used to perform some or all of the functions of the access network device in the method embodiments described in fig. 3 and 5. The device may be an access network device, a device in an access network device, or a device that can be used in a matching manner with an access network device. The communication device may also be a chip system. The communication apparatus shown in fig. 7 may include a communication unit 701 and a processing unit 702. The processing unit 702 is configured to perform data processing. The communication unit 701 is integrated with a receiving unit and a transmitting unit. The communication unit 701 may also be referred to as a transceiving unit. Alternatively, the communication unit 701 may be split into a receiving unit and a transmitting unit. Wherein:
A processing unit 702, configured to determine an ideal transmission time of the video frame in the first period; if the actual sending time of the video frame is before the ideal sending time of the video frame, the video frame is not the first type of frame skipping; if the actual sending time of the video frame is after the ideal sending time of the video frame, the video frame is a first type of skip frame; the processing unit 702 is further configured to determine a first frame-skipping network quality score based on whether each video frame in the first time period is a first type of frame-skipping.
In one possible implementation, the processing unit 702 determines the quality score of the first frame-skipping network based on whether each video frame is a first type of frame-skipping in the first period of time specifically by: determining to go out x consecutive times in the first time period based on whether each video frame in the first time period is a first type skip frameUser experience damage h of current first-class frame skipping x X=1, …, n, n is the maximum number of consecutive occurrences of the first type skip frame in the first time period; based on user experience damage h x A first frame hopping network quality score is determined.
In one possible implementation, the processing unit 702 determines, based on whether each video frame is a first type of frame-skip during the first period, a user experience impairment h for which the first type of frame-skip occurs x consecutive times during the first period x The method comprises the following steps: determining a proportion w based on whether each video frame in the first time period is a first type skip frame x Ratio w x The ratio of the total frame number of the first type skip frames to the total number of the video frames transmitted in the first time period is continuously x times in the first time period; based on the proportion w x Determining user experience impairment h x 。
In one possible implementation, the processing unit 702 determines the ratio w based on whether each video frame is a first type of skip frame during the first period of time x The method comprises the following steps: determining a first frame skipping rate in the first time period based on whether each video frame in the first time period is a first type of frame skipping, wherein the first frame skipping rate is the ratio of the total number of the first type of frame skipping in the first time period to the total number of the video frames transmitted in the first time period; determining a ratio w based on the first frame rate x 。
In a possible implementation, the processing unit 702 is further configured to determine a video image quality evaluation score and a video group delay evaluation score; the processing unit 702 is further configured to determine a target network quality score based on the first frame skipping network quality score, the video image quality score, and the video group delay score.
In a possible implementation, the processing unit 702 is further configured to determine an ideal arrival time of the video frame in the first period; if the actual arrival time of the video frame is before the ideal arrival time of the video frame, the video frame is not a second type of frame skipping; if the actual arrival time of the video frame is after the ideal arrival time of the video frame, the video frame is a second type of skip frame; the processing unit 702 is further configured to determine a second frame-skipping network quality score based on whether each video frame in the first period is a second type of frame-skipping.
In one possible implementation, the processing unit 702 determines, based on whether each video frame in the first period is a frame of a second type, a quality score of the second frame-skip network specifically by: determining user experience damage h of the second type of frame skipping continuously y times in the first time period based on whether each video frame in the first time period is the second type of frame skipping y Y=1, …, m, m is the maximum number of consecutive occurrences of the second type of frame skip in the first period; based on user experience damage h y And determining the quality fraction of the second frame-skipping network.
In one possible implementation, the processing unit 702 determines, based on whether each video frame is a second type of frame-skip during the first period, a user experience impairment h for which the second type of frame-skip occurs y consecutive times during the first period y The method comprises the following steps: determining a proportion w based on whether each video frame in the first time period is a second type skip frame y Ratio w y The ratio of the total frame number of the second type of skip frames to the total number of video frames received in the first time period is that the second type of skip frames continuously appear y times in the first time period; based on the proportion w y Determining user experience impairment h y 。
In one possible implementation, the processing unit 702 determines the ratio w based on whether each video frame is a second type of skip frame during the first period of time y The method comprises the following steps: determining a second frame skipping rate in the first time period based on whether each video frame in the first time period is a second type of frame skipping, wherein the second frame skipping rate is a ratio of the total number of the second type of frame skipping in the first time period to the total number of the video frames received in the first time period; determining the ratio w based on the second frame-skip rate y 。
In a possible implementation, the processing unit 702 is further configured to determine a third frame-skipping network quality score based on the first frame-skipping network quality score and the second frame-skipping network quality score.
In a possible implementation, the processing unit 702 is further configured to determine a video image quality evaluation score and a video group delay evaluation score; the processing unit 702 is further configured to determine a second target network quality score based on the third frame skipping network quality score, the video image quality score, and the video group delay score.
In one possible implementation, the ideal transmission time of the video frame is a sum of an ideal arrival time of the video frame and a frame delay budget time, the ideal arrival time of the video frame being determined based on the actual arrival time of the video frame and the actual arrival times of a plurality of video frames preceding the video frame.
Fig. 8 shows a schematic structure of a communication device. The communication apparatus 800 may be an access network device in the above method embodiment, or may be a chip, a chip system, or a processor that supports the access network device to implement the above method. The communication device may be used to implement the method described in the above method embodiments, and reference may be made in particular to the description of the above method embodiments.
The communication device 800 may include one or more processors 801. The processor 801 may be a general purpose processor or a special purpose processor, etc. For example, a baseband processor or a central processing unit. The baseband processor may be used to process communication protocols and communication data, and the central processor may be used to control communication devices (e.g., base stations, baseband chips, terminals, terminal chips, DUs or CUs, etc.), execute software programs, and process data of the software programs.
Optionally, the communication device 800 may include one or more memories 802, on which instructions 804 may be stored, which may be executed on the processor 801, to cause the communication device 800 to perform the methods described in the method embodiments above. Optionally, the memory 802 may also store data therein. The processor 801 and the memory 802 may be provided separately or may be integrated.
Optionally, the communication device 800 may further include a transceiver 805, an antenna 806. The transceiver 805 may be referred to as a transceiver unit, a transceiver circuit, or the like, for implementing a transceiver function. The transceiver 805 may include a receiver, which may be referred to as a receiver or a receiving circuit, etc., for implementing a receiving function, and a transmitter; the transmitter may be referred to as a transmitter or a transmitting circuit, etc., for implementing a transmitting function. The processing unit 702 shown in fig. 7 may be the processor 801. The communication unit 701 may be a transceiver 805.
The processor 801 is configured to perform the data processing operations of the access network device in the above-described method embodiment. The transceiver 805 is configured to perform the data transceiving operation of the access network device in the method embodiment described above.
In another possible design, processor 801 may include a transceiver to implement the receive and transmit functions. For example, the transceiver may be a transceiver circuit, or an interface circuit. The transceiver circuitry, interface or interface circuitry for implementing the receive and transmit functions may be separate or may be integrated. The transceiver circuit, interface or interface circuit may be used for reading and writing codes/data, or the transceiver circuit, interface or interface circuit may be used for transmitting or transferring signals.
In yet another possible design, the processor 801 may store instructions 803, where the instructions 803 run on the processor 801, may cause the communication device 800 to perform the method described in the method embodiments above. Instructions 803 may be solidified in processor 801, in which case processor 801 may be implemented in hardware.
In yet another possible design, communication device 800 may include circuitry that may implement the functions of transmitting or receiving or communicating in the foregoing method embodiments. The processors and transceivers described in embodiments of the present application may be implemented on integrated circuits (integrated circuit, ICs), analog ICs, radio frequency integrated circuits RFICs, mixed signal ICs, application specific integrated circuits (application specific integrated circuit, ASIC), printed circuit boards (printed circuit board, PCB), electronics, and the like. The processor and transceiver may also be fabricated using a variety of IC process technologies such as complementary metal oxide semiconductor (complementary metal oxide semiconductor, CMOS), N-type metal oxide semiconductor (NMOS), P-type metal oxide semiconductor (positive channel metal oxide semiconductor, PMOS), bipolar junction transistor (Bipolar Junction Transistor, BJT), bipolar CMOS (BiCMOS), silicon germanium (SiGe), gallium arsenide (GaAs), etc.
The communication apparatus described in the above embodiment may be an access network device, but the scope of the communication apparatus described in the embodiment of the present application is not limited thereto, and the structure of the communication apparatus may not be limited by fig. 8. The communication means may be a stand-alone device or may be part of a larger device. For example, the communication device may be:
(1) A stand-alone integrated circuit IC, or chip, or a system-on-a-chip or subsystem;
(2) A set of one or more ICs, optionally including storage means for storing data, instructions;
(3) An ASIC, such as a modem (MSM);
(4) Modules that may be embedded within other devices;
(5) Receivers, terminals, smart terminals, cellular telephones, wireless devices, handsets, mobile units, vehicle devices, network devices, cloud devices, artificial intelligence devices, etc.;
(6) Others, and so on.
For the case where the communication device may be a chip or a chip system, reference may be made to the schematic structural diagram of the chip shown in fig. 9. The chip 900 shown in fig. 9 includes a processor 901 and an interface 902. Optionally, a memory 903 may also be included. Wherein the number of processors 901 may be one or more, and the number of interfaces 902 may be a plurality.
In one design, for the case where the chip is used to implement the function of the access network device in the embodiments of the present application:
the interface 902 is configured to receive or output a signal; for example, the interface 902 may be configured to perform the signal receiving or outputting operations of the access network device in the method embodiment described above.
The processor 901 is configured to perform data processing operations. For example, the processor 901 may be configured to perform the data processing operations of the access network device in the above-described method embodiment.
It can be understood that some optional features in the embodiments of the present application may be implemented independently in some scenarios, independent of other features, such as the scheme on which they are currently based, so as to solve corresponding technical problems, achieve corresponding effects, or may be combined with other features according to requirements in some scenarios. Accordingly, the communication device provided in the embodiments of the present application may also implement these features or functions accordingly, which will not be described herein.
It should be appreciated that the processor in the embodiments of the present application may be an integrated circuit chip with signal processing capabilities. In implementation, the steps of the above method embodiments may be implemented by integrated logic circuits of hardware in a processor or instructions in software form. The processor may be a general purpose processor, a digital signal processor (digital signal processor, DSP), an application specific integrated circuit (application specific integrated circuit, ASIC), a field programmable gate array (field programmable gate array, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components.
It will be appreciated that the memory in embodiments of the present application may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The nonvolatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an electrically Erasable EPROM (EEPROM), or a flash memory. The volatile memory may be random access memory (random access memory, RAM) which acts as an external cache. By way of example, and not limitation, many forms of RAM are available, such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous DRAM (SLDRAM), and direct memory bus RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to comprise, without being limited to, these and any other suitable types of memory.
The present application also provides a computer readable medium having stored therein a computer program or instructions which, when executed by a communication device, implement the functions of any of the method embodiments described above.
The present application also provides a computer program product comprising instructions which, when read and executed by a computer, cause the computer to carry out the functions of any of the method embodiments described above.
In the above embodiments, the implementation may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the processes or functions described in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a high-density digital video disc (digital video disc, DVD)), or a semiconductor medium (e.g., a Solid State Disk (SSD)), or the like.
The foregoing is merely specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and the changes and substitutions are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (28)
1. A method of network quality determination, the method comprising:
determining an ideal transmission moment of the video frame in the first time period; if the actual sending time of the video frame is before the ideal sending time of the video frame, the video frame is not a first type skip frame; if the actual sending time of the video frame is after the ideal sending time of the video frame, the video frame is a first type skip frame;
and determining a first frame skipping network quality score based on whether each video frame in the first time period is a first type of frame skipping.
2. The method of claim 1, wherein determining a first frame hopping network quality score based on whether each video frame in the first time period is a first type of frame hopping comprises:
Determining user experience damage h of the first type of frame skipping continuously x times in the first time period based on whether each video frame in the first time period is the first type of frame skipping x X=1, …, n, where n is the maximum number of consecutive occurrences of the first type frame skip in the first period;
based on the user experience impairment h x A first frame hopping network quality score is determined.
3. The method of claim 2, wherein the determining the user experience impairment h for the first type of frame skip occurs x consecutive times during the first period is based on whether each video frame during the first period is a first type of frame skip x Comprising:
determining a proportion w based on whether each video frame in the first time period is a first type skip frame x The ratio w x The ratio of the total frame number of the first type skip frames to the total number of the video frames sent in the first time period is that the first type skip frames appear for x times continuously in the first time period;
based on the ratio w x Determining user experience impairment h x 。
4. A method according to claim 3, wherein the ratio w is determined based on whether each video frame in the first period is a first type of frame skip x Comprising:
determining a first frame-skipping rate in the first time period based on whether each video frame in the first time period is a first type of frame-skipping, wherein the first frame-skipping rate is a ratio of the total number of the first type of frame-skipping in the first time period to the total number of the video frames transmitted in the first time period;
Determining a ratio w based on the first frame skip rate x 。
5. The method according to any one of claims 1 to 4, further comprising:
determining a video image quality evaluation score and a video group delay evaluation score;
and determining a target network quality score based on the first frame skipping network quality score, the video image quality evaluation score and the video group delay evaluation score.
6. The method according to any one of claims 1 to 4, further comprising:
determining an ideal arrival time of a video frame in a first time period; if the actual arrival time of the video frame is before the ideal arrival time of the video frame, the video frame is not a second type of skip frame; if the actual arrival time of the video frame is after the ideal arrival time of the video frame, the video frame is a second type of skip frame;
and determining a second frame skipping network quality score based on whether each video frame in the first time period is a second type frame skipping.
7. The method of claim 6, wherein determining a second frame hopping network quality score based on whether each video frame in the first time period is a second type of frame hopping comprises:
Determining user experience damage h of the second type of frame skipping continuously y times in the first time period based on whether each video frame in the first time period is the second type of frame skipping y Y=1, …, m, where m is the maximum number of consecutive occurrences of the second type of frame skip in the first period;
based on the user experience impairment h y And determining the quality fraction of the second frame-skipping network.
8. The method of claim 7, wherein the determining the user experience impairment h for the second type of frame skip occurs y consecutive times during the first time period based on whether each video frame during the first time period is a second type of frame skip y Comprising:
determining a proportion w based on whether each video frame in the first time period is a second type skip frame y The ratio w y The ratio of the total frame number of the second type of skip frames to the total number of the video frames received in the first time period is that the second type of skip frames continuously appear y times in the first time period;
based on the ratio w y Determining user experience impairment h y 。
9. The method of claim 8, wherein the determining the ratio w is based on whether each video frame in the first period of time is a second type of frame skip y Comprising:
determining a second frame-skipping rate in the first time period based on whether each video frame in the first time period is a second type of frame-skipping frame, wherein the second frame-skipping rate is a ratio of the total number of the second type of frame-skipping frames in the first time period to the total number of the video frames received in the first time period;
Determining based on the second frame skip rateRatio w y 。
10. The method according to any one of claims 6 to 9, characterized in that the method further comprises:
a third frame-skipping network quality score is determined based on the first frame-skipping network quality score and the second frame-skipping network quality score.
11. The method according to claim 10, wherein the method further comprises:
determining a video image quality evaluation score and a video group delay evaluation score;
and determining a target network quality score based on the third frame skipping network quality score, the video image quality evaluation score and the video group delay evaluation score.
12. The method according to any of claims 1-11, wherein the ideal transmission time of the video frame is a sum of an ideal arrival time of the video frame and the frame delay budget time, the ideal arrival time of the video frame being determined based on an actual arrival time of the video frame and an actual arrival time of a plurality of video frames preceding the video frame.
13. A communication device, the communication device comprising:
a processing unit, configured to determine an ideal transmission time of the video frame in the first period; if the actual sending time of the video frame is before the ideal sending time of the video frame, the video frame is not a first type skip frame; if the actual sending time of the video frame is after the ideal sending time of the video frame, the video frame is a first type skip frame;
The processing unit is further configured to determine a first frame skipping network quality score based on whether each video frame in the first time period is a first type of frame skipping.
14. The apparatus of claim 13, wherein the processing unit determines the first frame hopping network quality score based on whether each video frame is a first type of frame hopping within the first time period by:
determining user experience damage h of the first type of frame skipping continuously x times in the first time period based on whether each video frame in the first time period is the first type of frame skipping x X=1, …, n, where n is the maximum number of consecutive occurrences of the first type frame skip in the first period;
based on the user experience impairment h x A first frame hopping network quality score is determined.
15. The apparatus of claim 14, wherein the processing unit determines the user experience impairment h for the first type of frame skip occurring x consecutive times during the first time period based on whether each video frame is the first type of frame skip during the first time period x The method comprises the following steps:
determining a proportion w based on whether each video frame in the first time period is a first type skip frame x The ratio w x The ratio of the total frame number of the first type skip frames to the total number of the video frames sent in the first time period is that the first type skip frames appear for x times continuously in the first time period;
based on the ratio w x Determining user experience impairment h x 。
16. The apparatus of claim 15, wherein the processing unit determines the ratio w based on whether each video frame in the first time period is a first type skip frame x The method comprises the following steps:
determining a first frame-skipping rate in the first time period based on whether each video frame in the first time period is a first type of frame-skipping, wherein the first frame-skipping rate is a ratio of the total number of the first type of frame-skipping in the first time period to the total number of the video frames transmitted in the first time period;
determining a ratio w based on the first frame skip rate x 。
17. The device according to any one of claims 13 to 16, wherein,
the processing unit is also used for determining video image quality evaluation scores and video group delay evaluation scores;
the processing unit is further configured to determine a target network quality score based on the first frame skipping network quality score, the video image quality score, and the video group delay score.
18. The device according to any one of claims 13 to 16, wherein,
The processing unit is further configured to determine an ideal arrival time of the video frame in the first period; if the actual arrival time of the video frame is before the ideal arrival time of the video frame, the video frame is not a second type of skip frame; if the actual arrival time of the video frame is after the ideal arrival time of the video frame, the video frame is a second type of skip frame;
the processing unit is further configured to determine a second frame skipping network quality score based on whether each video frame in the first time period is a second type frame skipping.
19. The apparatus of claim 18, wherein the processing unit determines the second frame hopping network quality score based on whether each video frame is a second type of frame hopping during the first time period by:
determining user experience damage h of the second type of frame skipping continuously y times in the first time period based on whether each video frame in the first time period is the second type of frame skipping y Y=1, …, m, where m is the maximum number of consecutive occurrences of the second type of frame skip in the first period;
based on the user experience impairment h y And determining the quality fraction of the second frame-skipping network.
20. The apparatus of claim 19, wherein the process recipeDetermining user experience damage h of second type frame skipping continuously y times in the first time period based on whether each video frame in the first time period is the second type frame skipping or not y The method comprises the following steps:
determining a proportion w based on whether each video frame in the first time period is a second type skip frame y The ratio w y The ratio of the total frame number of the second type of skip frames to the total number of the video frames received in the first time period is that the second type of skip frames continuously appear y times in the first time period;
based on the ratio w y Determining user experience impairment h y 。
21. The apparatus of claim 20, wherein the processing unit determines the ratio w based on whether each video frame in the first time period is a second type of frame skip y The method comprises the following steps:
determining a second frame-skipping rate in the first time period based on whether each video frame in the first time period is a second type of frame-skipping frame, wherein the second frame-skipping rate is a ratio of the total number of the second type of frame-skipping frames in the first time period to the total number of the video frames received in the first time period; determining a ratio w based on the second frame skip rate y 。
22. The apparatus of any of claims 18-21, wherein the processing unit is further configured to determine a third frame-skipping network quality score based on the first frame-skipping network quality score and the second frame-skipping network quality score.
23. The apparatus of claim 22, wherein the device comprises a plurality of sensors,
the processing unit is also used for determining video image quality evaluation scores and video group delay evaluation scores;
the processing unit is further configured to determine a second target network quality score based on the third frame skipping network quality score, the video image quality score, and the video group delay score.
24. The apparatus of any of claims 13-23, wherein the ideal transmission time of the video frame is a sum of an ideal arrival time of the video frame and the frame delay budget time, the ideal arrival time of the video frame being determined based on an actual arrival time of the video frame and actual arrival times of a plurality of video frames preceding the video frame.
25. A communication device comprising a processor and a memory, the processor and the memory being coupled, the processor being configured to implement the method of any of claims 1-12.
26. A chip comprising a processor and an interface, the processor and the interface being coupled; the interface being for receiving or outputting signals, the processor being for executing code instructions to cause the method of any one of claims 1 to 12 to be performed.
27. A computer readable storage medium having stored therein computer executable instructions which when invoked by the computer cause the computer to perform the method of any of the preceding claims 1-12.
28. A computer program product, the computer program product comprising: computer program code which, when run by a computer, causes the computer to perform the method of any one of claims 1 to 12.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210105306.8A CN116567364A (en) | 2022-01-28 | 2022-01-28 | Network quality determining method and communication device |
| PCT/CN2022/136169 WO2023142681A1 (en) | 2022-01-28 | 2022-12-02 | Network quality determining method and communication device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210105306.8A CN116567364A (en) | 2022-01-28 | 2022-01-28 | Network quality determining method and communication device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116567364A true CN116567364A (en) | 2023-08-08 |
Family
ID=87470324
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210105306.8A Pending CN116567364A (en) | 2022-01-28 | 2022-01-28 | Network quality determining method and communication device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN116567364A (en) |
| WO (1) | WO2023142681A1 (en) |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007329778A (en) * | 2006-06-08 | 2007-12-20 | Nippon Telegr & Teleph Corp <Ntt> | Apparatus, method and program for estimating user's sensory quality |
| CN101969372B (en) * | 2010-10-29 | 2012-11-28 | 上海交通大学 | Frame loss prediction based cellular network uplink video communication QoS (Quality of Service) optimization method |
| CN102158881B (en) * | 2011-04-28 | 2013-07-31 | 武汉虹信通信技术有限责任公司 | Method and device for completely evaluating 3G visual telephone quality |
| CN108650550B (en) * | 2018-07-05 | 2021-06-25 | 平安科技（深圳）有限公司 | Network transmission quality analysis method and device, computer equipment and storage medium |
| CN112511848B (en) * | 2020-11-09 | 2023-06-20 | 网宿科技股份有限公司 | Live broadcast method, server side and computer readable storage medium |
-
2022
- 2022-01-28 CN CN202210105306.8A patent/CN116567364A/en active Pending
- 2022-12-02 WO PCT/CN2022/136169 patent/WO2023142681A1/en unknown
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023142681A1 (en) | 2023-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107689820A (en) | Electronic equipment and server and wireless communications method in wireless communication system | |
| CN111512685B (en) | Channel state information measuring method, device and computer storage medium | |
| KR20180059457A (en) | Electronic device and method | |
| WO2022036870A1 (en) | Data transmission method and apparatus | |
| WO2021159252A1 (en) | Transmission scheduling method and apparatus, communication device, and storage medium | |
| CN116567364A (en) | Network quality determining method and communication device | |
| KR102353339B1 (en) | Online advertising system and method using video platform | |
| CN114731486A (en) | Method and device for reporting position information | |
| CN114051743A (en) | Resource selection method, device and storage medium | |
| WO2022152305A1 (en) | Extended reality data transmission method and apparatus | |
| WO2022188634A1 (en) | Communication method and apparatus | |
| WO2024031273A1 (en) | Method and apparatus for conditional primary secondary cell (pscell) addition or change | |
| WO2023245685A1 (en) | Indication information configuration methods and apparatuses, and device and storage medium | |
| WO2024087116A1 (en) | Communication method and apparatus | |
| RU2806449C1 (en) | Method and device for channel transmission and data medium | |
| CN112584483B (en) | Timing advance indicating method, communication device and storage medium | |
| WO2023184452A1 (en) | Method and apparatus for determining model used by terminal device | |
| WO2023124606A1 (en) | Uplink timing method and related apparatus | |
| WO2024103409A1 (en) | Pucch-sri indication method and apparatus | |
| WO2023138424A1 (en) | Inter-frequency measurement resource and/or time determination method and apparatus | |
| US20240172015A1 (en) | Start control method for measurement for non-serving cell, communication device, and storage medium | |
| WO2023011292A1 (en) | Mobility-restricted communication method, apparatus, and system | |
| WO2022126322A1 (en) | Method for generating evaluation information and related device | |
| US20150181437A1 (en) | System and Method for Reception Adaption to Reduce Transmission Interference in a Device That Implements More Than One Wireless Technology | |
| CN117836785A (en) | Model generation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |