TW202023275A - Detection method - Google Patents

Abstract

A detection method is to collect a video delivery record, and then integrate the video delivery record into playback events to analyze the number of times that the quality of the playback events is poor, wherein the playback event has all of network transmission requires, and the measurement method changes the bit-rate through the video delivery to count the number of times that the quality of the video is not good, so a network system management terminal can periodically integrate multiple play events to analyze the poor quality playback events through time segment, so that it can quickly and/or effectively gain reasons for poor quality of the video delivery.

Description

Detection method

The present invention relates to a detection method, in particular to a detection method for the quality of network video and audio delivery.

The transmission traffic of audio and video files on the Internet is quite huge. Early audio and video files were downloaded to the demand side mainly in the form of packets through the supply address. However, because the capacity of audio and video files is sometimes quite large, they are downloaded at the same time. The demand side may not be rare. When each demand side downloads audio and video files from the supply address at the same time, the transmission speed is often too slow, resulting in poor transmission quality, causing troubles on each demand side, and the system maintenance side cannot actually understand the network audio and video The exact reason for the poor delivery quality cannot be known immediately and surely about the solution to the poor delivery quality of video and audio, and this may even increase the labor cost of system management and maintenance.

In response to the above problems, the industry has proposed a segmented streaming method. As shown in Figure 1, the content server 10 of the audio-visual supply end divides the audio-visual files into a plurality of audio-visual fragments M to be transmitted from the content server 10 of the audio-visual supply end to the multiple delivery servers 11 in the network system computer room. The delivery server 11 is then delivered to the electronic device 12 (such as a personal computer, a smart phone or others) on the demand side to achieve the effect of load balancing and to solve a single The transmission end may cause congestion.

However, the network transmission system operated by the conventional segmented streaming method is limited by the influence of the existing network transmission rate. Therefore, the audio and video quality presented by the electronic device 12 on the demand side will be unstable, and the network system The industry can only detect the current network status based on the notification from the demand side or the use time notified by the demand side to estimate the cause of the unstable audio and video quality, so it can only use the delivery server set up by the network system provider 11. The base station or line inspection cannot be performed on the electronic device 12 on the demand side or the audio-visual supply end (the original audio-visual file and the content server), so that the real reason for the unstable audio-visual quality cannot be known, or even A large amount of manpower needs to be sent to inspect lines or machines, resulting in a substantial increase in inspection costs.

Therefore, how to overcome the above-mentioned problems of the conventional technology has become an urgent problem to be solved at present.

In order to solve the aforementioned problem, the present invention provides a detection method, which includes: collecting video and audio delivery records, wherein the video and audio delivery record is a content server of a supply end that transmits at least one video and audio information to at least one delivery server. The status of at least one end-user device, and the audio-visual information is a plurality of audio-visual fragments divided from an audio-visual file; the audio-visual delivery record is integrated into a playback event; and the number of times of poor quality in the playback event is analyzed, where, The playback event has the total number of network transmission requirements, and the number of times of poor quality of the video clips can be counted by replacing the bit rate through the video delivery record.

In the aforementioned detection method, it further includes connecting the The audio and video quality measuring device of the delivery server collects the audio and video delivery records of each delivery server.

In the foregoing detection method, the playback event includes the specification and source address of the client device, the name of the video clip, the transmission speed of the video information transmitted by the delivery server, and/or the destination address of the delivery server .

In the foregoing detection method, the number of times of poor quality is determined by the change in bit rate caused by the transmission quality of each video and audio delivery record of the video and audio information transmitted by the delivery server to identify the total network transmission demand. The number of times of poor quality.

The aforementioned detection method further includes outputting analysis data for the number of times of poor quality according to the playback event to generate a statistical report. Furthermore, it includes the use of the playback event and the data content of at least one database to learn the reason for the poor quality, wherein the data content of the database corresponds to the data content of the playback event.

In the aforementioned detection method, the number of times of poor quality in the playback event excludes or does not include the first drop in the bit rate.

To sum up, the detection method of the present invention mainly utilizes the characteristics of analyzing the bit rate of video and audio delivery, and measures the delivery status of the delivery server through the video and audio quality measurer, and uses segmented discrimination and statistics of the video and audio information The number of times the delivery quality is poor, so statistical reports can be provided regularly and periodically to the system management terminal for inspection. Therefore, the detection method of integrating playback events to check the bit rate adopted by the present invention can not only systematically classify the video clips for statistical analysis, but also shorten the detection time of the system management terminal. In order to greatly reduce the labor cost consumed by the system management side, it can further quickly and/or effectively understand the reasons for the poor quality of network audio and video delivery.

10,101‧‧‧Content server

11,103‧‧‧Delivery server

12‧‧‧Electronic device

102‧‧‧Video information

104‧‧‧A/V Quality Measurer

9a~9d‧‧‧User end device

M‧‧‧Video clips

S100~S600‧‧‧Step

S40~S51‧‧‧Step

Figure 1 is a network transmission system architecture diagram of the conventional segmented streaming method; Figure 2A is a flowchart of the detection method of the present invention; Figure 2B is a schematic diagram of the system architecture of the detection method of the present invention; Figures 2C-1 and 2C-2 are diagrams of the data content of the audio-visual delivery record of the detection method of the present invention; Figure 2D is a diagram of the data content of the two playback events of the detection method of the present invention; Figure 2E Figure 2D is the analysis result of the number of times of poor quality; Figure 2F is a chart of the analysis results of the six playback events of the detection method of the present invention and the number of times of poor quality; 2G-1, 2G-2 and Figure 2G-3 is a chart of the database of the detection method of the present invention; Figures 3A-1 and 3A-2 are the packet information table of the playback event of the detection method of the present invention; Figure 3B is the detection of the present invention The graph of the bit rate of the method and the packet sequence number; Figure 4 is the flow chart of analyzing whether the bit rate of the detection method of the present invention is updated; Figure 5 is the flow chart of another embodiment of the detection method of the present invention Figure.

In order to make the objectives, technical solutions and advantages of the present invention clearer, the following further describes the present invention in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not used to limit the present invention.

It should be noted that the structure, ratio, size, etc. shown in the drawings in this specification are only used to match the contents disclosed in the specification, for those who are familiar with this skill to understand and read, not to limit the creation of this creation. The limited conditions, so it does not have the technical significance, any modification of structure, change of proportional relationship or adjustment of size, should not fall under this principle without affecting the efficacy and purpose of this creation. The technical content revealed by the creation must be within the scope. At the same time, the terms such as "上" and "一" quoted in this manual are only for the convenience of description, not to limit the scope of this creation can be implemented, and the relative relationship is changed or adjusted. Substantial changes in the technical content should also be regarded as the scope of this creation.

Figures 2A and 2B are schematic diagrams of the method for detecting the quality of network video and audio delivery of the present invention. As shown in Figure 2A, the detection method includes the following steps S100~S400.

In step S100, the video and audio delivery records within a predetermined time are collected. Specifically, as shown in Figures 2A and 2B, through the network computer room established by the system management terminal, a plurality of delivery servers 103 (such as Edge type) are set in it, and a content server of an audio-visual supply terminal 101 Send at least one piece of audio-visual information 102 to each of the delivery servers 103, and then transmit the audio-visual information 102 through the delivery server 103 to the client device that issued the demand command 9a, 9b, 9c, 9d (such as personal computers, smart phones or other electronic devices, etc.), at this time, through an electrical or communication connection (such as wireless or wired) the audio and video of the server 103 The quality measurer 104 collects the video and audio delivery records of each delivery server 103. For example, the audio-visual information 102 is a plurality of audio-visual fragments divided from an audio-visual file, and the content size of the audio-visual fragment can be in seconds (such as a few seconds of audio and video fragments) or sub-unit (such as a few minutes of audio and video fragments). Or other length of audio and video content.

In step S200, the integrated playback event is performed. Specifically, the audio-visual delivery records of each delivery server 103 collected by the audio-visual quality measurer 104 are processed to form a plurality of packets, and then the packets are used to sort out the required playback events. In this embodiment, the packet defines a play event list, as shown in Figures 2C-1 and 2C-2, which lists multiple audiovisual delivery records (such as numbers 1-13), and the audiovisual delivery record is Including the source address (IP) of the client device 9a-9d or the subnet, the name of the video clip (such as M3U8 file), the playback device of the demand side, the transmission speed (such as TS) and the The destination address (IP) of the delivery server 103, etc., is used to obtain at least one playback event in the subsequent sorting and statistic operations. For example, the first playback event (10 groups, numbered 1, 2, 4, 6, 7, 9-13) includes the source address [17.12.53.74], the playback device [IOS], and the name of the watched video [Videol.m3u8] , And the second playback event (3 groups, numbered 3, 5, 8) includes the source address [210.44.73.189], the playback device [PC], and the name of the watched movie [Moviel.m3u8], as shown in Figure 2D.

In step S300, the audio-visual quality measurer 104 is used to analyze the number of poor quality of the audio-visual clips received by the demand end. Specifically, single A playback event has the total number of network transmission requirements (Request) (as shown in Figure 2D), and through the characteristics of the bit rate (BitRate) of the video delivery, the number of poor video clips can be counted (as shown in the following As described in Figures 3A and 3B), all play events on the play event list will be processed in step S300. For example, for the second playback event shown in Figure 2D, the TS field in Figures 2C-1 and 2C-2 are both 5M, and there is no problem of poor transmission quality, so the number of requests and poor rate of poor quality Both are 0, as shown in Figure 2E; on the other hand, the TS field of the first playback event shown in Figure 2D in Figures 2C-1 and 2C-2 is 1M, 5M, and 8M, so There is a problem of poor transmission quality, so the number of requests with poor quality shown in Figure 2E is 3 and the poor rate is 30.0%. Therefore, the change in the bit rate caused by the quality of each video and audio delivery is used to identify the number of poor quality in the video and audio delivery requirements.

In step S400, the audio-visual quality measurer 104 outputs a statistical report. Specifically, according to the attributes of the fields of the playback events, an analysis data is formed by integrating and ranking the bad times. As shown in Figure 2F, the audio-visual quality measurer 104 uses multiple playback events and cooperates with the information in the database (as shown in Figures 2G-1 to 2G-3) to know that the demand side receives audio and video The reasons for the quality of the clips, such as which computer room (as shown in Figure 2G-1), which delivery server (as shown in Figure 2G-2), and which audio and video provider channel (as shown in Figure 2G-3) As shown in the figure) or other factors.

Figures 3A-1 and 3A-2 are the packet information table of the aforementioned first play event, and Figure 3B is the relationship diagram between the bit rate and the packet sequence number (or network transmission requirement) of the present invention to determine Transmission quality, as shown in Figure 3B The three times indicated poor quality (such as packet serial numbers No. 5 to 7).

In this embodiment, based on the operating mode of most existing players, according to the HLS (HTTP Live Streaming) protocol, the client device 9a-9d downloads and obtains a plurality of video clips from the delivery server 103 (the video clips It can be M3U8 file), the player or playback software of the end device 9a-9d will request the appropriate bit rate video clip according to the device specification and its operating system, but the video clip will normally be played before the video clip has never been played. In the initial stage, the video and audio clips will be played at the highest bit rate to evaluate the current network bandwidth, equipment specifications and operating system of the client device 9a-9d, and the subsequent video clips will be requested to be suitable Play at the current bit rate.

Specifically, if the bit rate drops for the first time (packet sequence numbers 2 to 3 shown in Figure 3A-1), it will be recorded as the player of the client device 9a-9d adapts to the current environment The changes made will not be recorded as the cause of poor audio and video delivery quality, so the first bit rate drop will not be included in the number of effective network requirements for poor audio and video delivery quality. Then, in packet No. 5, the bit rate drops again. This is not the first time the bit rate drops, so the audio-visual quality measurer 104 records the status as "poor quality" and starts Accumulate the number of network transmission requests with poor quality until the packet sequence number is No. 7, a total of three times. After that, in the packet sequence No. 8 where the bit rate increases, the audio-visual quality measurer 104 will change the status to “normal” to stop accumulating the number of times of network transmission requests with poor quality.

Furthermore, the detection method further includes a threshold for customizing state adjustment, which is Based on whether the percentage of the difference between the previous rising or falling bit rate exceeds the threshold, the adjustment of the status stage is determined. Specifically, as shown in Figure 3B, if the threshold is 30%, the change point of the second bit rate is 5M to 1M (that is, packet sequence numbers 4 to 5), and the difference between the two is 4M. That is, the percentage difference between the two is 80% (which is greater than 30%), and the audiovisual quality measurer 104 adjusts the status information. Similarly, the third bit rate change point is 1M to 8M (ie packet sequence numbers 7 to 8), the difference between the two is 7M, that is, the percentage difference between the two is 700% (which is greater than 30%), Therefore, the audio-visual quality measurer 104 also adjusts the status information. On the other hand, if the percentage difference between the two is less than or equal to 30% (for example, the change point of the bit rate is 5M to 4M, the difference between the two is 1M, that is, the percentage difference between the two is 20%), then the audio and video quality The measuring device 104 does not adjust the status information.

Therefore, as shown in FIG. 4, the analysis flow chart of the audio-visual quality measurer 104 to determine whether the bit rate needs to be updated is compiled.

In this embodiment, for a single playback event, the collected video delivery records (demand records for network transmission) are first analyzed according to the time sequence (step S40). After the demand record is input (step S41), It will search for the record of its bit rate (step S42). If there is a record of it, it will judge whether the video and audio delivery is of poor quality according to the bit rate judgment method shown in Figure 3B (step S43) , To determine whether the current state is converted to normal or poor. If it is judged that the video and audio delivery is in a poor quality state, it is judged whether the bit rate of this time has increased compared with the previous bit rate (step S44), that is, whether the bit rate has increased according to the current bit rate, so If it is, it means that the poor quality state has ended and the state needs to be Change to normal to get out of the state of poor quality (step S45), and if not (that is, if there is no increase in the bit rate compared to the previous time), the number of network transmission requests with poor quality will be accumulated (step S46) , And update the current bit rate (step S47).

On the contrary, in step S43, if there is no poor quality status, it is judged whether the bit rate has decreased (step S48), so if not, then go to step S47 to update the current bit rate, and if yes, it means Knowing the poor quality network transmission requirements, the operation of step S49 is further executed, that is, it is judged whether it is the first time that the drop has occurred. Therefore, in step S49, if not, the number of times of poor quality needs to be accumulated to enter step S47 to update the current bit rate; if yes, go directly to step S47 to update the current bit rate.

On the other hand, in step S42, if there is no bit rate record for this video and audio delivery, the current bit rate can be directly updated (step S47).

Finally, after step S47, step S50 will be entered to determine the end of the playback event, that is, to detect whether it is the last network transmission requirement of the playback event, so when the playback event ends (step S51), you can Obtain and output a statistical report (as shown in Figure 2F) of the analysis of this playback event (including the number of times of poor quality network transmission requirements). If it is determined in step S50 that the playback event has not ended, return to the initial step S40 to continue the detection of the playback event.

As shown in Fig. 5, the statistical report of step S400 in Fig. 2A can be counted according to the customized selected output time segment (such as step S500) to create a corresponding table (such as step S600). Specifically, when the system administrator enters When performing measurement, before step S400 shown in Figure 2A, select the output time segment based on the information in step S300 (as shown in Figures 2C to 2E), and then search the pre-established correspondence table ( Such as the database in Figures 2G-1 to 2G-3) to generate report information to be aggregated, for example, based on the corresponding source IP, M3U8 file type, device used by the player, delivery server 103, and obtained through the analysis process Know the number of poor quality, the number of network transmission requests (Request), and the poor quality rate, etc., to create a correspondence table so that the system administrator can quickly grasp the delivery quality of the audio-visual information 102.

In summary, the system administrator of the network operator can easily know the network transmission status of the client device 9a, 9b, 9c, 9d through the output statistical report, so it can know the client device 9a, 9b, Factors of unstable audio and video quality presented by 9c and 9d, such as the computer room of the network operator, the delivery server of the network operator, the channel of the audio and video supplier, the system specifications of the client device 9a, 9b, 9c, 9d or Other factors can greatly reduce the cost of inspection, and further quickly and/or effectively know the reasons for the poor quality of online audio and video delivery, and is different from the previous use of Hash (Hash method) to identify anonymous URLs. The present invention The detection method can further improve its cache efficiency through effectiveness analysis and regression discrimination.

The above embodiments are used to exemplify the principles and effects of the present invention, rather than to limit the present invention. Anyone who is familiar with this skill can modify the above embodiments without violating the spirit and scope of the present invention. Therefore, the scope of protection of the rights of the present invention should be as listed in the scope of patent application mentioned later.

S100~S400‧‧‧Step

Claims (7)

A detection method includes: collecting video and audio delivery records, wherein the video and audio delivery records are the status of a content server of a supplier transmitting at least one audio-visual information to at least one user-end device via at least one delivery server, and the video and audio The information is a plurality of audiovisual fragments divided from an audiovisual file; the audiovisual delivery record is integrated into a playback event; and the number of times of poor quality in the playback event is analyzed, where the playback event has the number of total network transmission requirements Calculate the number of times of poor quality of these video clips by replacing the bit rate through the video delivery record. The detection method described in item 1 of the scope of patent application further includes collecting the video and audio delivery records of each delivery server through a video and audio quality measuring device connected to the delivery server electrically or by communication. Such as the detection method described in item 1 of the scope of patent application, wherein the playback event includes the specification and source address of the client device, the name of the video clip, the transmission speed of the video information transmitted by the delivery server, and/ Or the destination address of the delivery server. The detection method described in item 1 of the scope of patent application, wherein the number of times of poor quality is the change in bit rate caused by the transmission quality of each audio and video delivery record of the audio and video information transmitted by the delivery server, based on Identify the number of times of poor quality in the total network transmission demand. For example, the detection method described in item 1 of the scope of patent application includes outputting analysis data for the times of poor quality based on the playback event to generate Statistical report. For example, the detection method described in item 5 of the scope of patent application includes the use of the playback event and the data content of at least one database to know the reason for the poor quality, wherein the data content of the database corresponds to Play the data content of the event. The detection method described in item 1 of the scope of patent application, wherein the number of times of poor quality in the playback event excludes or does not include the first drop in the bit rate.

Images