CN113727100A - Method and device for diagnosing audio and video communication quality - Google Patents
Method and device for diagnosing audio and video communication quality Download PDFInfo
- Publication number
- CN113727100A CN113727100A CN202111163660.8A CN202111163660A CN113727100A CN 113727100 A CN113727100 A CN 113727100A CN 202111163660 A CN202111163660 A CN 202111163660A CN 113727100 A CN113727100 A CN 113727100A
- Authority
- CN
- China
- Prior art keywords
- information
- audio
- video call
- quality
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004891 communication Methods 0.000 title claims abstract description 63
- 238000000034 method Methods 0.000 title claims abstract description 27
- 238000004458 analytical method Methods 0.000 claims abstract description 55
- 238000003745 diagnosis Methods 0.000 claims abstract description 47
- 238000013507 mapping Methods 0.000 claims abstract description 25
- 238000004364 calculation method Methods 0.000 claims abstract description 18
- 230000005856 abnormality Effects 0.000 claims description 28
- 230000002159 abnormal effect Effects 0.000 claims description 18
- 230000004044 response Effects 0.000 claims description 11
- 238000002405 diagnostic procedure Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/04—Diagnosis, testing or measuring for television systems or their details for receivers
- H04N17/045—Self-contained testing apparatus
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Telephonic Communication Services (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The disclosure relates to a method and a device for diagnosing audio and video communication quality. The diagnosis method of the audio and video communication quality comprises the following steps: acquiring information related to audio and video call quality, wherein the information comprises at least one of equipment information, calculation parameter information, network information and performance information; obtaining a diagnosis result of the audio and video communication quality by analyzing information related to the audio and video call quality based on a predetermined anomaly analysis rule, wherein the anomaly analysis rule is obtained by: acquiring various anomalies related to audio and video call quality, constructing a mapping relation between the information and the various anomalies, and taking the mapping relation as an anomaly analysis rule. According to the method and the device for diagnosing the audio and video communication quality, the automatic diagnosis of the audio and video communication quality can be realized, and the diagnosis efficiency of the audio and video communication quality is improved.
Description
Technical Field
The present disclosure relates to the field of video technology. More particularly, the present disclosure relates to a method and an apparatus for diagnosing audio/video communication quality.
Background
In the related art, due to the complexity of an audio hardware process, the complexity of an operating system, the complexity of driving and the like, the problems of noise, blocking, silence and the like occur in many scenes, all key information of the problems is dispersed in all modules, log active collection is needed for analyzing the problems, all key word information is manually searched, and the efficiency is low.
In summary, the analysis problem of the mainstream audio and video call software is basically manually analyzed. Because of the need for manual analysis of the problem, the efficiency is low, and depending on the experience level of the analyst, if the analyst has no corresponding experience, the problem sometimes cannot be analyzed.
Disclosure of Invention
An exemplary embodiment of the present disclosure is to provide a method and an apparatus for diagnosing audio/video communication quality, so as to solve at least the problem of diagnosing audio/video communication quality in the related art, and may not solve any of the above problems.
According to an exemplary embodiment of the present disclosure, there is provided a method for diagnosing audio/video communication quality, including: acquiring information related to audio and video call quality, wherein the information comprises at least one of equipment information, calculation parameter information, network information and performance information, the equipment information comprises at least one of equipment energy information and equipment volume setting, the calculation parameter information comprises at least one of echo cancellation delay estimation information and signal-to-noise ratio information, the network information comprises at least one of uplink packet loss rate information and downlink packet loss rate information, and the performance information comprises at least one of local memory use information and local CPU information; obtaining a diagnosis result of the audio-video communication quality by analyzing the information based on a predetermined abnormality analysis rule, wherein the abnormality analysis rule is obtained by: acquiring various anomalies related to audio and video call quality, constructing a mapping relation between the information and the various anomalies, and taking the mapping relation as an anomaly analysis rule.
Optionally, the step of acquiring information related to the audio/video call quality may include: and responding to the fact that the audio and video call quality of the current audio and video call meets a preset abnormal analysis condition, and acquiring information related to the audio and video call quality of the current audio and video call as the information, wherein the abnormal analysis condition comprises a condition influencing the audio and video call quality.
Optionally, the step of acquiring information related to the audio/video call quality may include: in response to receiving the user identification information, determining an audio-video call related to the user identification information; and acquiring information related to the determined audio and video call quality of the audio and video call as the information.
Optionally, the step of determining the audio-video call related to the user identification information may include: determining a preset number of audio-video calls prior to a time associated with the user identification information based on the time the user identification information was received.
Optionally, the step of determining the audio-video call related to the user identification information may include: displaying an audio-video call related to the user identification information; in response to a user selection input for an audio-video call, the audio-video call selected by the selection input is treated as an audio-video call associated with the user identification information.
Alternatively, the information may be stored in a database of key-value storage types.
Alternatively, the step of analyzing the information by based on a predetermined anomaly analysis rule may include: acquiring an exception having a mapping relation with the information from the preset exception analysis rule; and taking the information and the abnormality which has a mapping relation with the information as at least one part of the diagnosis result.
According to an exemplary embodiment of the present disclosure, there is provided an apparatus for diagnosing quality of audio-video communication, including: the information acquisition unit is configured to acquire information related to audio/video call quality, wherein the information includes at least one of device information, calculation parameter information, network information and performance information, the device information includes at least one of device energy information and device volume setting, the calculation parameter information includes at least one of echo cancellation delay estimation information and signal-to-noise ratio information, the network information includes at least one of uplink packet loss rate information and downlink packet loss rate information, and the performance information includes at least one of local memory usage information and local CPU information; and a quality diagnosis unit configured to obtain a diagnosis result of the audio-video communication quality by analyzing the information based on a predetermined abnormality analysis rule; and a rule forming unit configured to obtain the abnormality analysis rule by: acquiring various anomalies related to audio and video call quality, constructing a mapping relation between the information and the various anomalies, and taking the mapping relation as an anomaly analysis rule.
Alternatively, the information acquisition unit may be configured to: and responding to the fact that the audio and video call quality of the current audio and video call meets a preset abnormal analysis condition, and acquiring information related to the audio and video call quality of the current audio and video call as the information, wherein the abnormal analysis condition comprises a condition influencing the audio and video call quality.
Alternatively, the information acquisition unit may include: a call determination unit configured to determine, in response to receiving the user identification information, an audio-video call related to the user identification information; and an acquisition unit configured to acquire information relating to the determined audio-video call quality of the audio-video call as the information.
Alternatively, the call determination unit may be configured to: determining a preset number of audio-video calls prior to a time associated with the user identification information based on the time the user identification information was received.
Alternatively, the call determination unit may be configured to: displaying an audio-video call related to the user identification information; in response to a user selection input for an audio-video call, the audio-video call selected by the selection input is treated as an audio-video call associated with the user identification information.
Alternatively, the information may be stored in a database of key-value storage types.
Optionally, the rule forming unit may be configured to: acquiring an exception having a mapping relation with the information from the preset exception analysis rule; and taking the information and the abnormality which has a mapping relation with the information as at least one part of the diagnosis result.
According to an exemplary embodiment of the present disclosure, there is provided an electronic apparatus including: a processor; a memory for storing the processor-executable instructions; wherein the processor is configured to execute the instructions to implement a diagnostic method of audio-video communication quality according to an exemplary embodiment of the present disclosure.
According to an exemplary embodiment of the present disclosure, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor of an electronic device, causes the electronic device to execute a diagnosis method of audio-video communication quality according to an exemplary embodiment of the present disclosure.
According to an exemplary embodiment of the present disclosure, a computer program product is provided, comprising computer programs/instructions which, when executed by a processor, implement a method of diagnosing audio video communication quality according to an exemplary embodiment of the present disclosure.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
the automatic diagnosis of the audio and video communication quality is realized;
the diagnosis efficiency of the audio and video communication quality is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
Fig. 1 illustrates an exemplary system architecture 100 in which exemplary embodiments of the present disclosure may be applied.
Fig. 2 illustrates a flowchart of a method of diagnosing audio-video communication quality according to an exemplary embodiment of the present disclosure.
Fig. 3 shows a flowchart of a method of diagnosing audio-video communication quality according to another exemplary embodiment of the present disclosure.
Fig. 4 illustrates a system architecture diagram for diagnosing audiovisual communication quality in accordance with an exemplary embodiment of the present disclosure.
Fig. 5 illustrates a block diagram of a diagnosis apparatus of audio-video communication quality according to an exemplary embodiment of the present disclosure.
Fig. 6 illustrates a block diagram of an audio-video communication quality diagnosis apparatus according to another exemplary embodiment of the present disclosure.
Fig. 7 is a block diagram of an electronic device 700 according to an example embodiment of the present disclosure.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The embodiments described in the following examples do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
In this case, the expression "at least one of the items" in the present disclosure means a case where three types of parallel expressions "any one of the items", "a combination of any plural ones of the items", and "the entirety of the items" are included. For example, "include at least one of a and B" includes the following three cases in parallel: (1) comprises A; (2) comprises B; (3) including a and B. For another example, "at least one of the first step and the second step is performed", which means that the following three cases are juxtaposed: (1) executing the step one; (2) executing the step two; (3) and executing the step one and the step two.
At present, the analysis problem of mainstream audio and video call software is basically manual analysis. During manual analysis, a user is required to search key information and analyze corresponding problems.
In the disclosure, the server determines the rule by reporting the key information, analyzes the data by the rule, and gives a conclusion by one key. Hereinafter, a diagnosis method and apparatus of audio-video communication quality according to an exemplary embodiment of the present disclosure will be described in detail with reference to fig. 1 to 7.
Fig. 1 illustrates an exemplary system architecture 100 in which exemplary embodiments of the present disclosure may be applied.
As shown in fig. 1, the system architecture 100 may include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 serves as a medium for providing communication links between the terminal devices 101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few. A user may use the terminal devices 101, 102, 103 to interact with the server 105 over the network 104 to receive or send messages (e.g., critical information regarding audio-video call quality), etc. Various audio and video communication client applications, such as audio and video call software, audio and video recording software, instant messaging software, conference software, social platform software, and the like, may be installed on the terminal devices 101, 102, and 103. The terminal apparatuses 101, 102, and 103 may be hardware or software. When the terminal devices 101, 102, 103 are hardware, they may be various electronic devices having a display screen and capable of audio-video calls, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like. When the terminal device 101, 102, 103 is software, it may be installed in the electronic devices listed above, it may be implemented as a plurality of software or software modules (for example, to provide distributed services), or it may be implemented as a single software or software module. And is not particularly limited herein.
The terminal devices 101, 102, 103 may be equipped with an image capture device (e.g., a camera) to conduct a video call. Further, the terminal apparatuses 101, 102, 103 may also be mounted with a component (e.g., a speaker) for converting an electric signal into sound to play the sound, and may also be mounted with a device (e.g., a microphone) for converting an analog audio signal into a digital audio signal to pick up the sound.
The server 105 may be a server providing various services, such as a background server providing support for an audiovisual communication client application installed on the terminal device 101, 102, 103.
The server may be hardware or software. When the server is hardware, it may be implemented as a distributed server cluster formed by multiple servers, or may be implemented as a single server. When the server is software, it may be implemented as multiple pieces of software or software modules (e.g., to provide distributed services), or as a single piece of software or software module. And is not particularly limited herein.
It should be noted that the diagnostic method for the audio-video communication quality provided by the embodiment of the present disclosure is generally executed by a terminal device, but may also be executed by a server, or may also be executed by cooperation of the terminal device and the server. Accordingly, the diagnosis means of the audio-video communication quality may be provided in the terminal device, in the server, or in both the terminal device and the server.
It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation, and the disclosure is not limited thereto.
Fig. 2 illustrates a flowchart of a method of diagnosing audio-video communication quality according to an exemplary embodiment of the present disclosure.
Referring to fig. 2, in step S201, information on the audio-video call quality is acquired.
In an exemplary embodiment of the present disclosure, when information related to the audio/video call quality is acquired, information related to the audio/video call quality of the current audio/video call may be acquired as the information related to the audio/video call quality in response to the audio/video call quality of the current audio/video call satisfying a preset abnormality analysis condition. Here, the abnormality analysis condition may include a condition that affects the quality of the audio-video call. As an example, the abnormal analysis condition may include, but is not limited to, the collected sound is smaller than a preset collected sound threshold, the played sound is smaller than a preset played sound threshold, the playing device is in a mute mode, the volume value of the playing device is smaller than a preset volume threshold, the echo cancellation delay estimation suddenly changes to 0, the signal-to-noise ratio is smaller than a preset lower limit, the downlink packet loss rate is larger than a preset downlink packet loss rate threshold, the uplink packet loss rate is larger than a preset uplink packet loss rate threshold, the memory usage rate exceeds a preset memory usage rate threshold, the CPU usage rate exceeds a preset CPU usage rate threshold, and the like.
In an exemplary embodiment of the present disclosure, the information related to the audio video call quality may include at least one of device information, calculation parameter information, network information, and performance information. The device information may include at least one of device energy information and device volume settings. The calculation parameter information may include at least one of echo cancellation delay estimation information and signal-to-noise ratio information. The network information may include at least one of uplink packet loss rate information and downlink packet loss rate information. The performance information may include at least one of local memory usage information and local CPU information.
In step S202, a diagnosis result of the audio/video communication quality is obtained by analyzing the information about the audio/video call quality based on a predetermined abnormality analysis rule.
In an exemplary embodiment of the present disclosure, information related to audio video call quality may be stored in a key value storage type database (e.g., without limitation, kibana).
In an exemplary embodiment of the present disclosure, the anomaly analysis rule may be obtained in advance. When the anomaly analysis rule is obtained, various anomalies related to the audio and video call quality can be obtained firstly, then a mapping relation between information related to the audio and video call quality and the various anomalies related to the audio and video call quality is constructed, and the constructed mapping relation is used as the anomaly analysis rule.
In an exemplary embodiment of the present disclosure, when the information related to the audio/video call quality is analyzed based on the predetermined abnormality analysis rule, the abnormality to which the information related to the audio/video call quality is mapped may be first acquired from the mapping relation as the predetermined abnormality analysis rule, and then the information related to the audio/video call quality and the abnormality mapped thereof may be used as at least a part of the diagnosis result. Further, the diagnosis result may further include, for example, but not limited to, an ID of the user, a time of the audio-video call (at least one of a start time, an end time, and a time at which a problem occurs), an ID of a counterpart user participating in the audio-video call, a type of the audio-video call (audio call or video call), and the like.
The anomaly analysis rules may include, for example, but are not limited to, the following rules:
the collected sound is smaller than a preset collected sound threshold value, and the receiver probably hears less sound;
the played sound is smaller than a preset played sound threshold value, which represents that the sender does not speak or the collected sound is small;
the playing device is in a mute mode, and no sound can be heard by the local terminal;
the volume value of the playing device is smaller than a preset volume threshold value, which represents that the local terminal cannot hear the sound possibly;
the echo cancellation delay estimate suddenly changes to 0, representing the possible occurrence of echo;
the signal-to-noise ratio is smaller than a preset lower limit value, and represents that the environment is very noisy;
if the downlink packet loss rate is greater than a preset downlink packet loss rate threshold value, it means that a noise or a stuck noise may be heard;
the uplink packet loss rate is greater than a preset uplink packet loss rate threshold value, and represents that a receiver possibly hears a noise or is stuck;
the memory utilization rate exceeds a preset memory utilization rate threshold value, which represents that the memory is in use tension and causes abnormal sound;
the CPU utilization rate exceeds a preset CPU utilization rate threshold value, which represents that the CPU is in use tension and causes abnormal sound.
Fig. 3 shows a flowchart of a method of diagnosing audio-video communication quality according to another exemplary embodiment of the present disclosure.
Referring to fig. 3, in response to receiving user identification information, an audio-video call related to the user identification information is determined at step S301.
In an exemplary embodiment of the present disclosure, when determining the audio and video calls related to the user identification information, a preset number of audio and video calls before the time related to the user identification information may be determined based on the time at which the user identification information is received. Here, the preset number of audio/video calls may be before the time when the user identification information is received, for example, but not limited to, 1, 2, 3, 4, 5, 10, 20, etc. audio/video calls.
In an exemplary embodiment of the present disclosure, when determining an audio/video call related to user identification information, the audio/video call related to the user identification information may be first displayed, and then in response to a selection input of the user to the audio/video call, the audio/video call selected by the selection input may be taken as the audio/video call related to the user identification information.
In step S302, information about the determined audio/video call quality of the audio/video call is acquired.
In step S303, a diagnosis result of the audio/video communication quality is obtained by analyzing the information about the audio/video call quality based on a predetermined abnormality analysis rule.
The information about the audio-video call quality and the predetermined abnormality analysis rule have been described in detail in the embodiment related to fig. 2, and will not be explained in detail here.
Fig. 4 illustrates a system architecture diagram for diagnosing audiovisual communication quality in accordance with an exemplary embodiment of the present disclosure. As shown in fig. 4, first, device information, calculation parameter information, network information, and performance information are obtained, and the device information, the calculation parameter information, the network information, and the performance information are stored in a database of a server, then, which information of the device information, the calculation parameter information, the network information, and the performance information causes which abnormal problems in audio/video calls through a predetermined rule (i.e., an abnormal analysis rule), and which determined information causes which abnormal problems in audio/video calls are displayed to a user as a diagnosis result of audio/video communication quality, so that the user can know the reason of the abnormal problems in audio/video calls, and thus the user can remove the abnormality of the audio/video calls in time according to the diagnosis result.
The diagnosis method of audio-video communication quality according to the exemplary embodiment of the present disclosure has been described above with reference to fig. 2 to 4. Hereinafter, a diagnosis device of audio-video communication quality and units thereof according to an exemplary embodiment of the present disclosure will be described with reference to fig. 5 and 6.
Fig. 5 illustrates a block diagram of a diagnosis apparatus of audio-video communication quality according to an exemplary embodiment of the present disclosure.
Referring to fig. 5, the diagnosis apparatus of audio-video communication quality includes an information acquisition unit 51 and a quality diagnosis unit 52.
The information acquisition unit 51 is configured to acquire information relating to the audio-video call quality.
In an exemplary embodiment of the present disclosure, the information obtaining unit 51 may be configured to: and responding to the fact that the audio and video call quality of the current audio and video call meets a preset abnormal analysis condition, and acquiring information related to the audio and video call quality of the current audio and video call as information related to the audio and video call quality. Here, the abnormality analysis condition may include a condition that affects the quality of the audio-video call.
In an exemplary embodiment of the present disclosure, the information related to the audio/video call quality may include at least one of device information, calculation parameter information, network information, and performance information, the device information may include at least one of device energy information and device volume setting, the calculation parameter information may include at least one of echo cancellation delay estimation information and signal-to-noise ratio information, the network information may include at least one of uplink packet loss rate information and downlink packet loss rate information, and the performance information may include at least one of local memory usage information and local CPU information.
In an exemplary embodiment of the present disclosure, information related to the audio video call quality may be stored in a database of key value storage types.
The quality diagnosis unit 52 is configured to obtain a diagnosis result of the audio-video communication quality by analyzing the information on the audio-video call quality based on a predetermined abnormality analysis rule.
In an exemplary embodiment of the present disclosure, the diagnostic apparatus may further include: a rule forming unit (not shown) configured to obtain an anomaly analysis rule by: acquiring various anomalies related to the audio and video call quality; constructing a mapping relation between information related to audio and video call quality and various anomalies related to the audio and video call quality; and taking the constructed mapping relation as an abnormal analysis rule.
In an exemplary embodiment of the present disclosure, the rule forming unit may be configured to: acquiring the abnormality mapped by the information related to the audio and video call quality from the mapping relation serving as a preset abnormality analysis rule; and taking the information related to the audio and video call quality and the mapped abnormity as at least one part of the diagnosis result.
Fig. 6 illustrates a block diagram of an audio-video communication quality diagnosis apparatus according to another exemplary embodiment of the present disclosure.
Referring to fig. 6, the diagnosis apparatus of audio-video communication quality includes a call determination unit 61, an acquisition unit 62, and a quality diagnosis unit 63.
The call determination unit 61 is configured to determine an audio-video call related to the user identification information in response to receiving the user identification information.
In an exemplary embodiment of the present disclosure, the call determination unit 61 may be configured to: determining a preset number of audio-video calls prior to a time associated with the user identification information based on the time the user identification information was received.
In an exemplary embodiment of the present disclosure, the call determination unit 61 may be configured to: displaying an audio-video call related to the user identification information; in response to a user selection input for an audio-video call, the audio-video call selected by the selection input is treated as an audio-video call associated with the user identification information.
The acquisition unit 62 is configured to acquire information related to the determined audio-video call quality of the audio-video call.
In an exemplary embodiment of the present disclosure, the obtained information may include at least one of device information, calculation parameter information, network information, and performance information, the device information may include at least one of device energy information and device volume setting, the calculation parameter information may include at least one of echo cancellation delay estimation information and signal-to-noise ratio information, the network information may include at least one of uplink packet loss rate information and downlink packet loss rate information, and the performance information may include at least one of local memory usage information and local CPU information.
The quality diagnosis unit 63 is configured to obtain a diagnosis result of the audio-video communication quality by analyzing information related to the audio-video call quality based on a predetermined abnormality analysis rule.
In an exemplary embodiment of the present disclosure, information related to the audio video call quality may be stored in a database of key value storage types.
In an exemplary embodiment of the present disclosure, the diagnostic apparatus may further include: a rule forming unit (not shown) configured to obtain an anomaly analysis rule by: acquiring various anomalies related to the audio and video call quality; constructing a mapping relation between information related to audio and video call quality and various anomalies related to the audio and video call quality; and taking the constructed mapping relation as an abnormal analysis rule.
In an exemplary embodiment of the present disclosure, the rule forming unit may be configured to: acquiring the abnormality mapped by the information related to the audio and video call quality from the mapping relation serving as a preset abnormality analysis rule; and taking the information related to the audio and video call quality and the mapped abnormity as at least one part of the diagnosis result.
With regard to the apparatus in the above-described embodiment, the specific manner in which each unit performs the operation has been described in detail in the embodiment related to the method, and will not be described in detail here.
The diagnosis device of audio-video communication quality according to the exemplary embodiment of the present disclosure has been described above with reference to fig. 5 and 6. Next, an electronic apparatus according to an exemplary embodiment of the present disclosure is described with reference to fig. 7.
Fig. 7 is a block diagram of an electronic device 700 according to an example embodiment of the present disclosure.
Referring to fig. 7, an electronic device 700 includes at least one memory 701 and at least one processor 702, the at least one memory 701 having stored therein a set of computer-executable instructions, which when executed by the at least one processor 702, performs a method of diagnosing audio-visual communication quality according to an exemplary embodiment of the present disclosure.
In an exemplary embodiment of the present disclosure, the electronic device 700 may be a PC computer, a tablet device, a personal digital assistant, a smartphone, or other device capable of executing the above-described set of instructions. Here, the electronic device 700 need not be a single electronic device, but can be any collection of devices or circuits that can execute the above instructions (or sets of instructions) either individually or in combination. The electronic device 700 may also be part of an integrated control system or system manager, or may be configured as a portable electronic device that interfaces with local or remote (e.g., via wireless transmission).
In the electronic device 700, the processor 702 may include a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a programmable logic device, a special purpose processor system, a microcontroller, or a microprocessor. By way of example, and not limitation, processors may also include analog processors, digital processors, microprocessors, multi-core processors, processor arrays, network processors, and the like.
The processor 702 may execute instructions or code stored in the memory 701, wherein the memory 701 may also store data. The instructions and data may also be transmitted or received over a network via a network interface device, which may employ any known transmission protocol.
The memory 701 may be integrated with the processor 702, for example, by having RAM or flash memory disposed within an integrated circuit microprocessor or the like. Further, memory 701 may comprise a stand-alone device, such as an external disk drive, storage array, or any other storage device usable by a database system. The memory 701 and the processor 702 may be operatively coupled or may communicate with each other, such as through I/O ports, network connections, etc., so that the processor 702 can read files stored in the memory.
In addition, the electronic device 700 may also include a video display (such as a liquid crystal display) and a user interaction interface (such as a keyboard, mouse, touch input device, etc.). All components of the electronic device 700 may be connected to each other via a bus and/or a network.
There is also provided, in accordance with an example embodiment of the present disclosure, a computer-readable storage medium, such as a memory 701, including instructions executable by a processor 702 of a device 700 to perform the above-described method. Alternatively, the computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
According to an exemplary embodiment of the present disclosure, there may also be provided a computer program product comprising computer programs/instructions which, when executed by a processor, implement a method of diagnosis of audio-video communication quality according to an exemplary embodiment of the present disclosure.
The diagnosis method and apparatus of audio-video communication quality according to the exemplary embodiment of the present disclosure have been described above with reference to fig. 1 to 7. However, it should be understood that: the diagnosis apparatus of audio-video communication quality and units thereof shown in fig. 5 and 6 may be respectively configured as software, hardware, firmware, or any combination thereof to perform a specific function, the electronic device shown in fig. 7 is not limited to include the above-shown components, but some components may be added or deleted as needed, and the above components may also be combined.
According to the method and the device for diagnosing the audio and video communication quality, the information related to the audio and video communication quality is firstly acquired, and then the information related to the audio and video communication quality is analyzed based on the preset abnormal analysis rule to obtain the diagnosis result of the audio and video communication quality, so that the automatic diagnosis of the audio and video communication quality is realized, and the diagnosis efficiency of the audio and video communication quality is improved.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. A method for diagnosing audio/video communication quality is characterized by comprising the following steps:
acquiring information related to audio and video call quality, wherein the information comprises at least one of equipment information, calculation parameter information, network information and performance information, the equipment information comprises at least one of equipment energy information and equipment volume setting, the calculation parameter information comprises at least one of echo cancellation delay estimation information and signal-to-noise ratio information, the network information comprises at least one of uplink packet loss rate information and downlink packet loss rate information, and the performance information comprises at least one of local memory use information and local CPU information;
obtaining a diagnosis result of the audio-video communication quality by analyzing the information based on a predetermined abnormality analysis rule, wherein the abnormality analysis rule is obtained by: acquiring various anomalies related to audio and video call quality, constructing a mapping relation between the information and the various anomalies, and taking the mapping relation as an anomaly analysis rule to calculate parameter information.
2. The diagnostic method of claim 1, wherein the step of obtaining information related to audio-video call quality comprises:
responding to the audio and video call quality of the current audio and video call meeting the preset abnormal analysis condition, acquiring information related to the audio and video call quality of the current audio and video call as the information,
wherein the abnormal analysis condition comprises a condition which influences the audio and video call quality.
3. The diagnostic method of claim 1, wherein the step of obtaining information related to audio-video call quality comprises:
in response to receiving the user identification information, determining an audio-video call related to the user identification information;
and acquiring information related to the determined audio and video call quality of the audio and video call as the information.
4. The diagnostic method of claim 3, wherein the step of determining an audio-video call associated with the user identification information comprises:
determining a preset number of audio-video calls prior to a time associated with the user identification information based on the time the user identification information was received.
5. The diagnostic method of claim 4, wherein the step of determining an audio-video call associated with the user identification information comprises:
displaying an audio-video call related to the user identification information;
in response to a user selection input for an audio-video call, the audio-video call selected by the selection input is treated as an audio-video call associated with the user identification information.
6. The diagnostic method of claim 1, wherein the information is stored in a database of key-value storage types.
7. The diagnostic method according to claim 1, wherein the step of analyzing the information by based on a predetermined anomaly analysis rule comprises:
acquiring an exception having a mapping relation with the information from the preset exception analysis rule;
and taking the information and the abnormality which has a mapping relation with the information as at least one part of the diagnosis result.
8. An apparatus for diagnosing quality of audio-video communication, comprising:
the information acquisition unit is configured to acquire information related to audio/video call quality, wherein the information includes at least one of device information, calculation parameter information, network information and performance information, the device information includes at least one of device energy information and device volume setting, the calculation parameter information includes at least one of echo cancellation delay estimation information and signal-to-noise ratio information, the network information includes at least one of uplink packet loss rate information and downlink packet loss rate information, and the performance information includes at least one of local memory usage information and local CPU information;
a quality diagnosis unit configured to obtain a diagnosis result of the audio-video communication quality by analyzing the information based on a predetermined abnormality analysis rule; and
a rule forming unit configured to obtain an anomaly analysis rule by:
various abnormalities related to the audio and video call quality are acquired,
constructing a mapping between the information and the various anomalies,
and taking the mapping relation as an abnormal analysis rule.
9. An electronic device, comprising:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the method of diagnosing audio-visual communication quality as claimed in any one of claims 1 to 7.
10. A computer-readable storage medium storing a computer program, which when executed by a processor of an electronic device causes the electronic device to execute the method of diagnosing audio-visual communication quality according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111163660.8A CN113727100A (en) | 2021-09-30 | 2021-09-30 | Method and device for diagnosing audio and video communication quality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111163660.8A CN113727100A (en) | 2021-09-30 | 2021-09-30 | Method and device for diagnosing audio and video communication quality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113727100A true CN113727100A (en) | 2021-11-30 |
Family
ID=78685544
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111163660.8A Pending CN113727100A (en) | 2021-09-30 | 2021-09-30 | Method and device for diagnosing audio and video communication quality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113727100A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005244321A (en) * | 2004-02-24 | 2005-09-08 | Nippon Telegr & Teleph Corp <Ntt> | Method for estimating quality of audio video communication service and apparatus thereof |
| CN112261437A (en) * | 2020-11-19 | 2021-01-22 | 贝壳技术有限公司 | Audio and video quality evaluation method and device, readable storage medium and electronic equipment |
| CN112822482A (en) * | 2020-12-31 | 2021-05-18 | 上海掌门科技有限公司 | Method and equipment for determining evaluation score of audio and video call |
| CN113382232A (en) * | 2021-08-12 | 2021-09-10 | 北京微吼时代科技有限公司 | Method, device and system for monitoring audio and video quality and electronic equipment |
| CN113411672A (en) * | 2021-06-15 | 2021-09-17 | 北京房江湖科技有限公司 | Communication quality evaluation method and device, readable storage medium and electronic equipment |
-
2021
- 2021-09-30 CN CN202111163660.8A patent/CN113727100A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005244321A (en) * | 2004-02-24 | 2005-09-08 | Nippon Telegr & Teleph Corp <Ntt> | Method for estimating quality of audio video communication service and apparatus thereof |
| CN112261437A (en) * | 2020-11-19 | 2021-01-22 | 贝壳技术有限公司 | Audio and video quality evaluation method and device, readable storage medium and electronic equipment |
| CN112822482A (en) * | 2020-12-31 | 2021-05-18 | 上海掌门科技有限公司 | Method and equipment for determining evaluation score of audio and video call |
| CN113411672A (en) * | 2021-06-15 | 2021-09-17 | 北京房江湖科技有限公司 | Communication quality evaluation method and device, readable storage medium and electronic equipment |
| CN113382232A (en) * | 2021-08-12 | 2021-09-10 | 北京微吼时代科技有限公司 | Method, device and system for monitoring audio and video quality and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108900776B (en) | Method and apparatus for determining response time | |
| CN110177300B (en) | Program running state monitoring method and device, electronic equipment and storage medium | |
| JP2018093466A (en) | Telephone network and two-way audio generation device for voice quality evaluation of voice codec | |
| CN113973103B (en) | Audio processing method, device, electronic equipment and storage medium | |
| CN113709151A (en) | Method, apparatus, device, medium and product for logging in cloud application | |
| CN113144620B (en) | Method, device, platform, readable medium and equipment for detecting frame synchronous game | |
| US10277733B1 (en) | Single window testing of an interactive contact workflow | |
| CN114155852A (en) | Voice processing method and device, electronic equipment and storage medium | |
| CN113612680B (en) | Suppressing indication of incoming communications in a user interface | |
| CN112800363A (en) | Page display method and device, electronic equipment and computer readable medium | |
| CN113727100A (en) | Method and device for diagnosing audio and video communication quality | |
| CN114363704B (en) | Video playing method, device, equipment and storage medium | |
| CN116016468A (en) | Session problem diagnosis method, device, medium and electronic equipment | |
| CN115857865A (en) | Play crosstalk detection method, device, equipment and storage medium | |
| CN113113046B (en) | Performance detection method and device for audio processing, storage medium and electronic equipment | |
| EP3984190B1 (en) | Dynamic modification of functionality of a real-time communications session | |
| US20220030302A1 (en) | Automatic media control | |
| CN112241372A (en) | Terminal testing method and device and electronic equipment | |
| US20240129436A1 (en) | Automatic engagement analytics in collaboration and conferencing | |
| CN111290873A (en) | Fault processing method and device | |
| CN115174283B (en) | Hosting authority configuration method and equipment | |
| CN113824726B (en) | Online conference method, device and system | |
| CN113138919B (en) | Multi-client testing system and method | |
| CN114219369B (en) | Prediction model training method and device, and user category prediction method and device | |
| CN117668404A (en) | Data processing method and device, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211130 |
|
| RJ01 | Rejection of invention patent application after publication |