CN105703977B - Audio and video quality monitoring method, device and system - Google Patents
Audio and video quality monitoring method, device and system Download PDFInfo
- Publication number
- CN105703977B CN105703977B CN201610287228.2A CN201610287228A CN105703977B CN 105703977 B CN105703977 B CN 105703977B CN 201610287228 A CN201610287228 A CN 201610287228A CN 105703977 B CN105703977 B CN 105703977B
- Authority
- CN
- China
- Prior art keywords
- client
- audio
- data
- call
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Computer Networks & Wireless Communication (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Telephonic Communication Services (AREA)
Abstract
The application discloses a method, a device and a system for monitoring audio and video quality, wherein the method comprises the following steps: acquiring call data sent by a source client, wherein the source client is a client in the same session group with the client; processing the call data sent by the source client to determine call quality data; and sending the call quality data and a first identifier corresponding to the client or the session group to a monitoring server so that the monitoring server can monitor the call quality of the client or the session group according to the call quality data and the first identifier. According to the method and the device, the background monitoring server can intuitively feel the audio and video experience of each client in the talk group, and data are accumulated for providing better audio and video services.
Description
Technical Field
The present application relates to the field of internet technologies, and in particular, to a method, an apparatus, and a system for monitoring audio and video quality.
Background
With the development of mobile internet, users not only meet the requirements of text communication and social contact, but also have stronger and stronger requirements for real-time voice and video. For this reason, numerous audio-video service applications have emerged.
Due to the diversity of terminals used by users and network operators and the like, the problems of blockage and the like easily occur in the audio and video call process of the users, and the audio and video call experience of the users is reduced.
In the prior art, when a client has an audio and video quality problem, a user needs to notify a background maintainer in the forms of mails, telephones and the like and report a fault description, and then the background maintainer determines the fault problem according to the fault description and carries out fault removal. Obviously, in the prior art, the background cannot know the conversation quality of the client in time, so that the problem of the conversation quality of the client cannot be solved in time.
Disclosure of Invention
In view of this, the present application provides an audio and video quality monitoring method, apparatus, and system to monitor the call quality of a client, so as to achieve a user's audio and video experience visually experienced in a background.
In order to achieve the above object, the following solutions are proposed:
an audio and video quality monitoring method is applied to a client, and comprises the following steps:
acquiring call data sent by a source client, wherein the source client is a client in the same session group with the client;
processing the call data sent by the source client to determine call quality data;
and sending the call quality data and the first identifier to a monitoring server so that the monitoring server can monitor the call quality of the client or the conversation group according to the call quality data and the first identifier, wherein the first identifier corresponds to the client or the conversation group.
An audio and video quality monitoring method is applied to a monitoring server and comprises the following steps:
receiving call quality data and a first identifier sent by a client; the conversation quality data is obtained after the client processes the received conversation data sent by the source client in the same conversation group; the first identifier corresponds to the client or the session group;
and monitoring the call quality of the client or the session group corresponding to the first identifier according to the call quality data.
An audio and video quality monitoring device is applied to a client, and comprises:
the system comprises a call data acquisition unit, a session data acquisition unit and a session data acquisition unit, wherein the call data acquisition unit is used for acquiring call data sent by a source client, and the source client is a client in the same session group with the client;
the first call data processing unit is used for processing the call data sent by the source client and determining call quality data;
and the monitoring data sending unit is used for sending the call quality data and the first identifier to a monitoring server so that the monitoring server can monitor the call quality of the client or the conversation group according to the call quality data and the first identifier, and the first identifier corresponds to the client or the conversation group.
An audio and video quality monitoring device is applied to a monitoring server, and comprises:
the monitoring data receiving unit is used for receiving the call quality data and the first identifier sent by the client; the conversation quality data is obtained after the client processes the received conversation data sent by the source client in the same conversation group; the first identifier corresponds to the client or the session group;
and the call quality monitoring unit is used for monitoring the call quality of the client or the session group corresponding to the first identifier according to the call quality data.
An audio-video quality monitoring system comprising: client, central server, audio and video engine and monitoring server, wherein:
the client sends an audio and video request to the central server and receives the identifier of the audio and video engine and the identifier of the conversation group returned by the central server in response to the audio and video request;
the client accesses the audio and video engine based on the identification of the audio and video engine, and joins a conversation group based on the identification of the conversation group to carry out audio and video conversation;
in the process of audio and video conversation, the client acquires conversation data transmitted by a source client forwarded by the audio and video engine, wherein the source client is a client which is in the conversation group together with the client; the client processes the call data sent by the source client, determines call quality data, sends the call quality data and a first identifier to the audio and video engine, and forwards the call quality data and the first identifier to the monitoring server, wherein the first identifier corresponds to the client or the session group;
and the monitoring server monitors the call quality of the client or the session group corresponding to the first identifier according to the call quality data.
According to the audio and video quality monitoring method provided by the embodiment of the application, the client side acquires the call data sent by the source client side, the source client side is the client side which is in the same session group with the client side, the call data sent by the source client side is further processed, the call quality data is determined, the call quality data and the first identification corresponding to the client side or the session group are sent to the monitoring server, and therefore the monitoring server can monitor the call quality of the client side or the session group according to the call quality data and the first identification. According to the method and the device for monitoring the conversation quality, after the client side acquires the conversation data sent by the source client side in the same conversation group, the conversation data are processed to obtain the conversation quality data, then the conversation quality data and the first identification are sent to the monitoring server, the monitoring server utilizes the conversation quality data to monitor the conversation quality of the client side or the conversation group, the monitoring server can visually sense the audio and video experience of each client side in the conversation group, and the data are accumulated for providing better audio and video services.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic diagram of an architecture of an audio/video call system disclosed in an embodiment of the present application;
fig. 2 is a schematic diagram of an audio and video quality monitoring system disclosed in an embodiment of the present application;
fig. 3a is a schematic diagram of access basic information of an example of the present application;
fig. 3b-3f are graphs showing the network delay, the video downlink packet loss rate, the video downlink code rate, the audio downlink packet loss rate, and the audio downlink code rate varying with time, respectively, according to the example of the present application;
fig. 3g-3h are partial enlarged views of curves of total downlink packet loss rate and video blocking times along with time according to an example of the present application;
FIG. 3i is a partial magnified view of the time-dependent capacity curve on an exemplary atrial access belt of the present application;
fig. 4 is a flowchart of an audio and video quality monitoring method disclosed from the perspective of a client in the embodiment of the present application;
fig. 5 is a flowchart of another audio and video quality monitoring method disclosed from the perspective of a client in the embodiment of the present application;
fig. 6 is a flowchart of another audio and video quality monitoring method disclosed from the perspective of a client in the embodiment of the present application;
fig. 7 is a flowchart of another audio and video quality monitoring method disclosed from the perspective of a client in the embodiment of the present application;
fig. 8 is a flowchart of an audio and video quality monitoring method disclosed from the perspective of a monitoring server in the embodiment of the present application;
fig. 9 is a schematic structural diagram of an audio and video quality monitoring apparatus disclosed from a client perspective in an embodiment of the present application;
fig. 10 is a schematic structural diagram of an audio and video quality monitoring device disclosed from the perspective of a monitoring server in the embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In order to realize the audio and video quality monitoring scheme, the application provides an audio and video call system architecture. The system architecture may be referred to in fig. 1.
As shown in fig. 1, the audio/video call system architecture includes: the system comprises a client 1, a login server 2, a policy server 3, a central server 4, a plurality of audio and video engines 5 and a plurality of interface machines 6.
The functions of the units are as follows:
the client side 1: the client 1 initiates an audio-video session request, which may be to create a session group for performing an audio-video session, or to join a session group.
The login server 2: and transmitting the audio and video session request of the client 1 to the policy server 3.
The policy server 3: and the system is responsible for services such as requested authentication, signature encryption, security confirmation and the like.
The center server 4: the central server is responsible for the management of conversation groups and the distribution of the audio and video engine and the interface machine. In this embodiment, after the policy server 3 completes the confirmation of the request, the central server 4 allocates the audio/video engine and the interface machine, and allocates the session group, in the near vicinity according to the location and the load information of the client.
The audio and video engine 5: the audio and video engine comprises a voice engine and a video engine, and can realize rich video application based on a video call service channel. In this embodiment, the audio/video engine 5 receives an audio/video session request forwarded by the client 1 through the interface machine 6, and creates a session group according to a session group identifier in the request, or joins the client 1 to the session group. In the process of the audio/video session, the audio/video engine 5 is responsible for forwarding the call data uploaded by the client to other clients in the session group.
It should be noted that the login server 2 and the policy server 3 are required for service improvement, and if the requirements such as request authentication are not considered, the client 1 may directly send a request to the central server 4. Further, the interface machine 6 only plays a role in instruction forwarding, and the interface machine 6 can be removed if necessary, and the client 1 directly communicates with the audio/video engine 5.
Based on the above disclosed audio and video call system architecture, the present application further provides an audio and video quality monitoring system, see fig. 2.
As shown in fig. 2, the monitoring system includes:
the client 1 sends an audio and video request to the central server 4 and receives the identifier of the audio and video engine 5 and the identifier of the conversation group returned by the central server 4 in response to the audio and video request;
the client 1 accesses the audio and video engine 5 based on the identification of the audio and video engine 5, and joins a conversation group based on the identification of the conversation group to perform audio and video conversation;
in the process of audio and video conversation, the client 1 acquires conversation data transmitted by a source client forwarded by the audio and video engine 5, wherein the source client is a client which is in the conversation group together with the client; the client processes the call data sent by the source client, determines the call quality data, sends the call quality data and a first identifier to the audio/video engine 5, and forwards the call quality data and the first identifier to the monitoring server 7, wherein the first identifier corresponds to the client 1 or the session group;
and the monitoring server 7 monitors the call quality of the client 1 or the session group corresponding to the first identifier according to the call quality data.
According to the monitoring system, the client 1 processes the call data sent by the source client to obtain the call quality data, and the call quality data is sent to the monitoring server 7 through the audio and video engine 5, so that the call quality monitoring can be carried out on the client or a conversation group where the client is located through the background monitoring server 7.
Optionally, the monitoring server 7 may perform exception filtering on the received call quality data. Further, the monitoring server 7 may persist the call quality data with the first identification correspondence in a database. The data is persisted in the database, the database can be accessed in a webpage mode and the like subsequently, the audio and video quality data of the corresponding client or the corresponding talk group are inquired from the database according to the first identification, and the audio and video quality data are processed and displayed in a front-end page. The content displayed in the front-end page may include basic information of access, such as user service type, session group number, client IP, audio/video engine IP, etc., as shown in fig. 3 a. The content displayed in the front-end page may further include network basic monitoring data, such as time delay, jitter, and the like, as well as audio/video packet loss rate, bit rate, frame rate, audio/video blocking times, and the like. Referring to fig. 3b-3f, fig. 3b-3f are graphs of network delay, video downlink packet loss rate, video downlink bit rate, audio downlink packet loss rate, and audio downlink bit rate varying with time, respectively, according to an example of the present application.
Further, when the user moves the focus to a certain point on the graph, first detailed information corresponding to the current point, such as time corresponding to the current point, an audio/video quality value (for example, a downlink total packet loss rate) corresponding to the current point, and the like, can also be displayed, as shown in fig. 3g to 3h, where fig. 3g to 3h are partial enlarged views of curves of the downlink total packet loss rate and the video blocking times changing with time according to the example of the present application.
Still further, when the user focus moves to a certain point on the graph and performs a corresponding click operation, second detail information corresponding to the current point can be further popped up, the second detail information is further refined of the first detail information, as shown in fig. 3i, and fig. 3i is a partial enlarged view of a time-varying curve of the capacity on the room entrance zone according to the example of the present application. The capacity of the room entering zone is a processing capacity parameter of the client, such as a CPU performance parameter.
To facilitate an understanding of the present application, the following examples are set forth.
The user uses the client A to send a request for applying for creating the session group to the central server, and the central server distributes the audio and video engine B and the session group X to the client A.
The client A accesses the audio and video engine B, and sends a request for applying for creating the session group to the audio and video engine B, and requests for creating the session group X. And the audio and video engine B creates a session group X and adds the client A into the created session group X.
The client a may invite other friends to join the conversation group X, and perform an audio-video conversation in the conversation group X.
In the process of audio and video conversation, any client in the conversation group X reports the conversation quality data per se to the audio and video engine B every 2s, wherein the conversation quality data can be obtained after the client processes the received conversation data. The call quality data reported by the client carries a first identifier, where the first identifier may be an identifier of the client or an identifier of a session group.
And the audio and video engine B sends the call quality data reported by each client and the first identifier to the monitoring server, and the monitoring server monitors the call quality of the client or the session group corresponding to the first identifier by using the call quality data.
Next, the present application introduces the scheme from the perspective of the client. Referring to fig. 4, fig. 4 is a flowchart of an audio and video quality monitoring method disclosed from the perspective of a client in the embodiment of the present application.
As shown in fig. 4, the method includes:
step S100, obtaining call data sent by a source client, wherein the source client is a client in the same session group with the client;
specifically, the client and the source client are in the same session group, and the client may obtain the call data sent by the source client.
Based on the above introduced audio/video call system architecture, the call data acquired by the client may be the call data transmitted by the source client forwarded by the audio/video engine.
Step S110, processing the call data sent by the source client to determine call quality data;
specifically, after the client acquires the call data, the client may process the call data according to a preset processing policy, and determine the call quality data of the client based on the call data. The call quality data indicates the quality of the call that the user of the client is able to experience. The call quality data can be represented by parameters such as packet loss rate.
Step S120, the call quality data and the first identifier are sent to a monitoring server, so that the monitoring server can monitor the call quality of the client or the conversation group according to the call quality data and the first identifier, and the first identifier corresponds to the client or the conversation group.
Specifically, the first identifier may correspond to the client, or may correspond to the session group. If the first identifier corresponds to the client, the first identifier may be an identifier of the client; if the first identifier corresponds to the session group, the first identifier may be an identifier of the session group.
The client sends the call quality data and the first identifier to the monitoring server, so that the monitoring server monitors the call quality of the client or the session group by using the call quality data.
In specific implementation, the client may send the call quality data and the first identifier to the audio/video engine, and the audio/video engine forwards the call quality data and the first identifier to the monitoring server.
According to the audio and video quality monitoring method provided by the embodiment of the application, the client side acquires the call data sent by the source client side, the source client side is the client side which is in the same session group with the client side, the call data sent by the source client side is further processed, the call quality data is determined, the call quality data and the first identification corresponding to the client side or the session group are sent to the monitoring server, and therefore the monitoring server can monitor the call quality of the client side or the session group according to the call quality data and the first identification. According to the method and the device for monitoring the conversation quality, after the client side acquires the conversation data sent by the source client side in the same conversation group, the conversation data are processed to obtain the conversation quality data, then the conversation quality data and the first identification are sent to the monitoring server, the monitoring server utilizes the conversation quality data to monitor the conversation quality of the client side or the conversation group, the monitoring server can visually sense the audio and video experience of each client side in the conversation group, and the data are accumulated for providing better audio and video services.
Referring to fig. 5, fig. 5 is a flowchart of another audio and video quality monitoring method disclosed from the perspective of a client in the embodiment of the present application.
As shown in fig. 5, the method includes:
step S200, sending an audio and video session request to an audio and video engine to request to join the session group;
specifically, based on the architecture of the audio/video call system introduced in the foregoing embodiment, the client may send an audio/video session request to the audio/video engine to request to join a session group.
It can be understood that if the session group requested to join has not been created, the audiovisual engine first creates the session group and then joins the client to the created session group. Further, if the session group requested to be joined already exists, the audio/video engine may directly join the client to the corresponding session group.
The process of how the client determines the target audio/video engine sending the audio/video session request may specifically be:
1. the client sends an audio and video request to the central server;
2. the client receives the identification of the audio and video engine and the identification of the conversation group returned by the central server;
3. the client accesses the audio and video engine based on the identification of the audio and video engine;
4. and the client joins the conversation group based on the identification of the conversation group to carry out audio and video conversation.
Step S210, after the conversation group is determined to be added, obtaining conversation data transmitted by a source client and forwarded by the audio and video engine;
specifically, the client and the source client are in the same session group, and the client may obtain the call data sent by the source client.
Step S220, processing the call data sent by the source client to determine call quality data;
specifically, after the client acquires the call data, the client may process the call data according to a preset processing policy, and determine the call quality data of the client based on the call data. The call quality data indicates the quality of the call that the user of the client is able to experience. The call quality data can be represented by parameters such as packet loss rate.
Step S230, sending the call quality data and the first identifier to a monitoring server, so that the monitoring server monitors the call quality of the client or the session group according to the call quality data and the first identifier, where the first identifier corresponds to the client or the session group.
Referring to fig. 6, fig. 6 is a flowchart of another audio and video quality monitoring method disclosed from the perspective of the client in the embodiment of the present application.
As shown in fig. 6, the method includes:
step S300, sending an audio and video session request to an audio and video engine to request to join the session group;
specifically, based on the architecture of the audio/video call system introduced in the foregoing embodiment, the client may send an audio/video session request to the audio/video engine to request to join a session group.
Step S310, after the conversation group is determined to be added, obtaining conversation data transmitted by a source client and forwarded by the audio and video engine;
specifically, the client and the source client are in the same session group, and the client may obtain the call data sent by the source client.
Step S320, acquiring a processing capacity parameter of the client;
specifically, the processing capability parameter of the client may include a codec capability parameter of the client, a processor CPU performance parameter of the client, and the like.
Step S330, determining downlink call quality data of the client according to the processing capacity parameter and the call data sent by the source client;
specifically, the call quality data may be divided into downlink call quality data and up-down call quality data according to the data flow direction. In this step, the downlink call quality data of the client can be determined according to the processing capability parameter of the client and the call data sent by the source client.
The downlink call quality data may indicate the quality of the call data received by the client, for example, the downlink call quality data may include: downlink packet loss rate, audio and video code rate, frame rate and the like.
Step S340, sending the downlink call quality data and the first identifier to a monitoring server, so that the monitoring server monitors the call quality of the client or the session group according to the downlink call quality data and the first identifier, where the first identifier corresponds to the client or the session group.
In this embodiment, a specific implementation manner for determining downlink call quality data by a client is introduced, and further, the client may also determine uplink call quality data, referring to the following embodiments.
Referring to fig. 7, fig. 7 is a flowchart of another audio and video quality monitoring method disclosed from the perspective of a client in the embodiment of the present application.
As shown in fig. 7, the method includes:
step S400, sending an audio and video session request to an audio and video engine to request to join the session group;
specifically, based on the architecture of the audio/video call system introduced in the foregoing embodiment, the client may send an audio/video session request to the audio/video engine to request to join a session group.
Step S410, after the conversation group is determined to be added, obtaining conversation data transmitted by a source client and forwarded by the audio and video engine;
specifically, the client and the source client are in the same session group, and the client may obtain the call data sent by the source client.
Step S420, acquiring a processing capacity parameter of the client;
specifically, the processing capability parameter of the client may include a codec capability parameter of the client, a processor CPU performance parameter of the client, and the like.
Step S430, determining downlink call quality data of the client according to the processing capacity parameter and the call data sent by the source client;
specifically, the call quality data may be divided into downlink call quality data and up-down call quality data according to the data flow direction. In this step, the downlink call quality data of the client can be determined according to the processing capability parameter of the client and the call data sent by the source client.
The downlink call quality data may indicate the quality of the call data received by the client, for example, the downlink call quality data may include: downlink packet loss rate, audio and video code rate, frame rate and the like.
Step S440, receiving uplink quality parameters returned by the audio and video engine in response to the call data uploaded by the client;
specifically, the uplink quality parameter is used to indicate a transmission difference between the transmission of the call data from the client to the reception of the audio/video engine.
It can be understood that, for the call data sent by the client to the audio/video engine, because the phenomena of packet loss, time delay and the like occur in the transmission process, the uplink quality parameter of the call data uploaded by the client needs to be determined after the audio/video engine receives the call data, and then the uplink quality parameter is returned to the client.
The uplink quality parameters may include an uplink packet loss rate, a time for receiving call data, and the like.
Step S450, determining uplink call quality data of the client according to the uplink quality parameters;
specifically, the uplink packet loss rate can be directly obtained from the uplink quality parameter, and the uplink call quality data such as the time delay needs to be calculated by the client according to the time for receiving the call data returned by the audio/video engine and the time for sending the call data by the client. Other upstream call quality data are similar.
Step S460, sending the call quality data and the first identifier to a monitoring server, so that the monitoring server monitors the call quality of the client or the session group according to the call quality data and the first identifier, where the first identifier corresponds to the client or the session group.
The call quality data sent to the monitoring server comprises uplink call quality data and downlink call quality data.
Compared with the previous embodiment, the present embodiment further adds a process of determining the uplink call quality data by the client.
Optionally, on the basis of the above embodiment, the client may also report the acquired processing capability parameter to the audio/video engine, and the audio/video engine forwards the processing capability parameter to the monitoring server, and the monitoring server may monitor the processing capability parameter of the client.
Further optionally, the audio/video engine may issue a corresponding regulation and control instruction according to the call quality data uploaded by the client, such as controlling an acquisition frame rate, a code rate, an encoding and decoding manner, and the like of the client.
Next, the present application introduces the scheme in the perspective of the monitoring server. Referring to fig. 8, fig. 8 is a flowchart of an audio and video quality monitoring method disclosed from the perspective of a monitoring server in the embodiment of the present application.
As shown in fig. 8, the method includes:
step S500, receiving call quality data and a first identifier sent by a client;
the conversation quality data is obtained by processing the conversation data sent by the source client in the same conversation group by the client.
The first identifier corresponds to the client or the session group.
Optionally, the client may send the call quality data and the first identifier to the audio/video engine, and the audio/video engine forwards the call quality data and the first identifier to the monitoring server.
Step S510, monitoring the call quality of the client or the session group corresponding to the first identifier according to the call quality data.
In this embodiment, the monitoring server monitors the call quality of the client or the session group corresponding to the first identifier according to the call quality data and the first identifier reported by the client. The background monitoring server can intuitively feel the audio and video experience of each client in the talk group, and data are accumulated for providing better audio and video service.
Optionally, on the basis of the above embodiment, the monitoring server may further receive a regulation instruction sent by the audio/video engine. The regulation and control instruction is generated by the audio and video engine according to the call quality data reported by the client and is sent to the client.
According to the method and the device, each regulation and control instruction issued by the audio and video engine to the client can be set and needs to be uploaded to the monitoring server. Or, the monitoring server can be set to request the regulation and control instruction from the audio/video engine periodically, and the monitoring server uploads the regulation and control instruction generated in the period to the monitoring server.
Optionally, on the basis of the foregoing embodiment, the monitoring server may further receive allocation information sent by the central server. The distribution information comprises the identification of the audio and video engine and the identification of the conversation group, which are returned by the central server in response to the audio and video request of the client.
According to the method and the system, each piece of distribution information issued to the client by the central server can be uploaded to the monitoring server. Alternatively, the monitoring server may be configured to request the central server for the allocation information periodically, and the monitoring server uploads the allocation information generated in the period to the monitoring server.
The following describes the audio/video quality monitoring device provided in the embodiment of the present application, and the audio/video quality monitoring device described below and the audio/video quality monitoring method described above may be referred to in a corresponding manner.
Firstly, an audio and video quality monitoring device of a client is introduced. Referring to fig. 9, fig. 9 is a schematic structural diagram of an audio and video quality monitoring apparatus disclosed from a client perspective in the embodiment of the present application.
As shown in fig. 9, the audio/video quality monitoring apparatus includes:
a call data obtaining unit 10, configured to obtain call data sent by a source client, where the source client is a client in the same session group as the client;
a first call data processing unit 11, configured to process the call data sent by the source client, and determine call quality data;
a monitoring data sending unit 12, configured to send the call quality data and the first identifier to a monitoring server, so that the monitoring server monitors the call quality of the client or the session group according to the call quality data and the first identifier, where the first identifier corresponds to the client or the session group.
According to the audio and video quality monitoring device applied to the client side, after the call data sent by the source client side in the same conversation group is obtained, the call data is processed to obtain the call quality data, the call quality data and the first identifier are sent to the monitoring server, the monitoring server monitors the call quality of the client side or the conversation group through the call quality data, the background monitoring server can visually experience audio and video experience of each client side in the conversation group, and data are accumulated for providing better audio and video services.
Optionally, the audio/video quality monitoring apparatus of this embodiment may further include:
the audio and video session request unit is used for sending an audio and video session request to an audio and video engine before the call data acquisition unit so as to request to join the session group;
based on this, the call data acquisition unit may include:
and the conversation data acquisition subunit is used for acquiring the conversation data transmitted by the source client and forwarded by the audio and video engine after determining to join the conversation group.
Optionally, the first call data processing unit may include:
a capability parameter obtaining unit, configured to obtain a processing capability parameter of the client;
and the downlink call quality data determining unit is used for determining the downlink call quality data of the client according to the processing capacity parameter and the call data sent by the source client.
Optionally, the audio/video quality monitoring apparatus of this embodiment may further include:
the second communication data processing unit is used for determining the uplink communication quality data of the client;
the second communication data processing unit may include:
the uplink quality parameter receiving unit is used for receiving uplink quality parameters returned by the audio and video engine in response to the call data uploaded by the client, and the uplink quality parameters are used for indicating the transmission difference between the call data sent from the client to the audio and video engine;
and the uplink call quality data determining unit is used for determining the uplink call quality data of the client according to the uplink quality parameters.
Further, an audio and video quality monitoring device on the monitoring server side is introduced. Referring to fig. 10, fig. 10 is a schematic structural diagram of an audio and video quality monitoring device disclosed from the perspective of a monitoring server in the embodiment of the present application.
As shown in fig. 10, the audio-video quality monitoring apparatus includes:
a monitoring data receiving unit 71, configured to receive the call quality data and the first identifier sent by the client; the conversation quality data is obtained after the client processes the received conversation data sent by the source client in the same conversation group; the first identifier corresponds to the client or the session group;
a call quality monitoring unit 72, configured to monitor, according to the call quality data, the call quality of the client or the session group corresponding to the first identifier.
The audio and video quality monitoring device applied to the monitoring server provided by this embodiment receives call quality data sent by a client and a first identifier corresponding to the client or a session group in which the client is located, and monitors the call quality of the client or the session group corresponding to the first identifier according to the call quality data. The audio and video experience of each client in the talk group can be intuitively experienced in the background, and data are accumulated for providing better audio and video service.
Optionally, the monitoring data receiving unit may be specifically configured to receive the call quality data and the first identifier, which are transmitted by the client and forwarded by the audio/video engine.
Based on this, the device for monitoring audio and video quality of the application may further include:
and the regulation and control instruction receiving unit is used for receiving the regulation and control instruction sent by the audio and video engine, and the regulation and control instruction is generated by the audio and video engine according to the call quality data reported by the client and is issued to the client.
Optionally, the apparatus for monitoring audio/video quality according to the present application may further include:
and the distribution information receiving unit is used for receiving distribution information sent by a central server, and the distribution information comprises the identification of the audio/video engine and the identification of the conversation group, which are returned by the central server in response to the audio/video request of the client.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (15)
1. The audio and video quality monitoring method is applied to a client, and comprises the following steps:
acquiring call data sent by a source client, wherein the source client is a client in the same session group with the client;
processing the call data sent by the source client to determine the call quality data of the client;
periodically sending the call quality data and the first identifier to an audio and video engine, and forwarding the call quality data and the first identifier to a monitoring server by the audio and video engine, so that the monitoring server monitors the call quality of the client or the session group according to the call quality data and the first identifier, and visually displays the call quality data on a front page, wherein the first identifier corresponds to the client or the session group;
receiving a regulation and control instruction issued by the audio and video engine according to the call quality data reported by the client to control the data transmission parameters of the client; the audio and video engine is also used for uploading the regulation and control instruction issued to the client to the monitoring server;
the visually displaying the call quality data on the front-end page comprises: displaying a curve graph of network basic monitoring data changing along with time in the front-end page;
and when the user moves the focus to the current point on the curve graph, displaying the detailed information corresponding to the current point.
2. The method of claim 1, wherein before the obtaining the call data sent by the source client, the method further comprises:
sending an audio and video session request to the audio and video engine to request to join the session group;
the obtaining of the call data sent by the source client includes:
and after the conversation group is determined to be added, acquiring the conversation data transmitted by the source client and forwarded by the audio and video engine.
3. The method of claim 2, wherein the processing the call data sent by the source client to determine the call quality data comprises:
acquiring a processing capacity parameter of the client;
and determining downlink call quality data of the client according to the processing capacity parameter and the call data sent by the source client.
4. The method of claim 3, further comprising:
receiving an uplink quality parameter returned by the audio and video engine in response to the call data uploaded by the client, wherein the uplink quality parameter is used for indicating the transmission difference between the call data sent from the client and the call data received by the audio and video engine;
and determining the uplink call quality data of the client according to the uplink quality parameters.
5. The method of claim 2, wherein sending an audio-video session request to an audio-video engine to request to join the session group comprises:
sending an audio and video request to a central server;
receiving the identification of the audio and video engine and the identification of the conversation group returned by the central server;
accessing the audio and video engine based on the identification of the audio and video engine;
and adding the conversation group based on the identification of the conversation group to carry out audio and video conversation.
6. An audio and video quality monitoring method is applied to a monitoring server, and comprises the following steps:
receiving call quality data and a first identifier periodically sent by a client, wherein the call quality data and the first identifier comprise: receiving the call quality data and the first identification forwarded by the audio and video engine; the conversation quality data is obtained by processing the conversation data sent by the source client in the same conversation group by the client; the first identifier corresponds to the client or the session group;
receiving a regulation and control instruction sent by the audio and video engine, wherein the regulation and control instruction is generated by the audio and video engine according to the call quality data reported by the client and is issued to the client, and the regulation and control instruction is used for controlling data transmission parameters of the client;
monitoring the conversation quality of the client or the conversation group corresponding to the first identifier according to the conversation quality data, and visually displaying the conversation quality data on a front page;
the visually displaying the call quality data on the front-end page comprises: displaying a curve graph of network basic monitoring data changing along with time in the front-end page;
and when the user moves the focus to the current point on the curve graph, displaying the detailed information corresponding to the current point.
7. The method of claim 6, further comprising:
and receiving distribution information sent by a central server, wherein the distribution information comprises the identification of the audio and video engine and the identification of the conversation group, which are returned by the central server in response to the audio and video request of the client.
8. An audio and video quality monitoring device is characterized in that the device is applied to a client side and comprises:
the system comprises a call data acquisition unit, a session data acquisition unit and a session data acquisition unit, wherein the call data acquisition unit is used for acquiring call data sent by a source client, and the source client is a client in the same session group with the client;
the first call data processing unit is used for processing the call data sent by the source client and determining the call quality data of the client;
the monitoring data sending unit is used for periodically sending the call quality data and the first identifier to an audio and video engine, and the audio and video engine forwards the call quality data and the first identifier to a monitoring server, so that the monitoring server monitors the call quality of the client or the conversation group according to the call quality data and the first identifier and visually displays the call quality data on a front page, wherein the first identifier corresponds to the client or the conversation group;
the device is also used for receiving a regulation and control instruction issued by the audio and video engine according to the call quality data reported by the client so as to control the data transmission parameters of the client; the audio and video engine is also used for uploading the regulation and control instruction issued to the client to the monitoring server;
the visually displaying the call quality data on the front-end page comprises: displaying a curve graph of network basic monitoring data changing along with time in the front-end page;
and when the user moves the focus to the current point on the curve graph, displaying the detailed information corresponding to the current point.
9. The apparatus of claim 8, further comprising:
the audio and video session request unit is used for sending an audio and video session request to the audio and video engine before the call data acquisition unit so as to request to join the session group;
the call data acquisition unit includes:
and the conversation data acquisition subunit is used for acquiring the conversation data transmitted by the source client and forwarded by the audio and video engine after determining to join the conversation group.
10. The apparatus of claim 9, wherein the first call data processing unit comprises:
a capability parameter obtaining unit, configured to obtain a processing capability parameter of the client;
and the downlink call quality data determining unit is used for determining the downlink call quality data of the client according to the processing capacity parameter and the call data sent by the source client.
11. The apparatus of claim 10, further comprising: the second communication data processing unit is used for determining the uplink communication quality data of the client;
the second communication data processing unit includes:
the uplink quality parameter receiving unit is used for receiving uplink quality parameters returned by the audio and video engine in response to the call data uploaded by the client, and the uplink quality parameters are used for indicating the transmission difference between the call data sent from the client to the audio and video engine;
and the uplink call quality data determining unit is used for determining the uplink call quality data of the client according to the uplink quality parameters.
12. An audio and video quality monitoring device is characterized by being applied to a monitoring server and comprising:
the monitoring data receiving unit is used for periodically receiving the call quality data and the first identifier sent by the client, and comprises: receiving the conversation quality data and the first identification which are transmitted by the client and forwarded by the audio and video engine; the conversation quality data is obtained by processing the conversation data sent by the source client in the same conversation group by the client; the first identifier corresponds to the client or the session group;
the regulation and control instruction receiving unit is used for receiving a regulation and control instruction sent by the audio and video engine, wherein the regulation and control instruction is generated by the audio and video engine according to the call quality data reported by the client and is issued to the client;
the call quality monitoring unit is used for monitoring the call quality of the client or the conversation group corresponding to the first identifier according to the call quality data and visually displaying the call quality data on a front page;
the visually displaying the call quality data on the front-end page comprises: displaying a curve graph of network basic monitoring data changing along with time in the front-end page;
and when the user moves the focus to the current point on the curve graph, displaying the detailed information corresponding to the current point.
13. The apparatus of claim 12, further comprising:
and the distribution information receiving unit is used for receiving distribution information sent by a central server, and the distribution information comprises the identification of the audio/video engine and the identification of the conversation group, which are returned by the central server in response to the audio/video request of the client.
14. An audio-video quality monitoring system, comprising: client, central server, audio and video engine and monitoring server, wherein:
the client sends an audio and video request to the central server and receives the identifier of the audio and video engine and the identifier of the conversation group returned by the central server in response to the audio and video request;
the client accesses the audio and video engine based on the identification of the audio and video engine, and joins a conversation group based on the identification of the conversation group to carry out audio and video conversation;
in the process of audio and video conversation, the client acquires conversation data transmitted by a source client forwarded by the audio and video engine, wherein the source client is a client which is in the conversation group together with the client; the client processes the call data sent by the source client, determines the call quality data of the client, periodically sends the call quality data and a first identifier to the audio and video engine, and forwards the call quality data and the first identifier to the monitoring server, wherein the first identifier corresponds to the client or the session group;
the monitoring server monitors the conversation quality of the client or the conversation group corresponding to the first identification according to the conversation quality data, and visually displays the conversation quality data on a front page; acquiring a regulation and control instruction sent by the audio and video engine, wherein the regulation and control instruction is generated by the audio and video engine according to the call quality data reported by the client and is issued to the client, and the regulation and control instruction is used for controlling data transmission parameters of the client;
the visually displaying the call quality data on the front-end page comprises: displaying a curve graph of network basic monitoring data changing along with time in the front-end page;
and when the user moves the focus to the current point on the curve graph, displaying the detailed information corresponding to the current point.
15. The system according to claim 14, wherein the monitoring server is further configured to obtain distribution information uploaded by the central server, where the distribution information includes an identifier of the audio/video engine and an identifier of the session group, which are returned by the central server in response to an audio/video request from the client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610287228.2A CN105703977B (en) | 2016-04-29 | 2016-04-29 | Audio and video quality monitoring method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610287228.2A CN105703977B (en) | 2016-04-29 | 2016-04-29 | Audio and video quality monitoring method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105703977A CN105703977A (en) | 2016-06-22 |
| CN105703977B true CN105703977B (en) | 2020-07-24 |
Family
ID=56217939
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610287228.2A Active CN105703977B (en) | 2016-04-29 | 2016-04-29 | Audio and video quality monitoring method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105703977B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107733732B (en) * | 2017-08-22 | 2021-03-05 | 贵阳朗玛信息技术股份有限公司 | Method and device for judging network condition |
| CN109428763B (en) * | 2017-09-05 | 2021-11-19 | 华为技术有限公司 | Fault measurement method and device |
| CN109451297A (en) * | 2018-10-23 | 2019-03-08 | 平安科技（深圳）有限公司 | Voice and video telephone mass analysis method and device, electronic equipment, storage medium |
| CN111669468B (en) * | 2020-06-05 | 2021-10-29 | 平安科技（深圳）有限公司 | Network state display method and device in call process, computer equipment and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101199194A (en) * | 2005-04-21 | 2008-06-11 | 高通股份有限公司 | Methods and apparatus for monitoring voice quality on a wireless communication device |
| CN101601266A (en) * | 2007-02-02 | 2009-12-09 | 艾利森电话股份有限公司 | The method and apparatus that is used for video telephony quality assessment |
| CN103152470A (en) * | 2011-12-07 | 2013-06-12 | 广州三星通信技术研究有限公司 | Method and communication terminal capable of providing conversation quality information in communication terminal |
| CN103944752A (en) * | 2004-08-20 | 2014-07-23 | 意大利电信股份公司 | Service quality monitoring method and system in networks based on grouping |
-
2016
- 2016-04-29 CN CN201610287228.2A patent/CN105703977B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103944752A (en) * | 2004-08-20 | 2014-07-23 | 意大利电信股份公司 | Service quality monitoring method and system in networks based on grouping |
| CN101199194A (en) * | 2005-04-21 | 2008-06-11 | 高通股份有限公司 | Methods and apparatus for monitoring voice quality on a wireless communication device |
| CN101601266A (en) * | 2007-02-02 | 2009-12-09 | 艾利森电话股份有限公司 | The method and apparatus that is used for video telephony quality assessment |
| CN103152470A (en) * | 2011-12-07 | 2013-06-12 | 广州三星通信技术研究有限公司 | Method and communication terminal capable of providing conversation quality information in communication terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105703977A (en) | 2016-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9235844B2 (en) | Method and system for providing real-time communications services | |
| CN105703977B (en) | Audio and video quality monitoring method, device and system | |
| CN104471895B (en) | A kind of method for supporting Streaming Media to carry out multicast and relevant apparatus and system | |
| US9559867B2 (en) | Contact group dynamics in networked communication devices | |
| US9661269B2 (en) | System for enabling communications and conferencing between dissimilar computing devices including mobile computing devices | |
| US20130282820A1 (en) | Method and System for an Optimized Multimedia Communications System | |
| EP2787695A1 (en) | Subscriber bandwidth notification method | |
| CN108347337B (en) | Conference communication method and device | |
| US9521262B2 (en) | Method and apparatus for calling terminal to join conference | |
| US20230083688A1 (en) | Sharing and collaborating on content objects during a video conference | |
| WO2016003344A1 (en) | Priority of uplink streams in video switching | |
| US20130275504A1 (en) | Community of interest networks | |
| CA2723945C (en) | Method of establishing parallel group services over disparate communication networks | |
| US10693924B2 (en) | Method and system for connecting electronic devices | |
| EP2088720A1 (en) | A method and system for discovering the flow media service and an apparatus for discovering service | |
| US20230247177A1 (en) | Bridging video conference connections | |
| EP2178247B1 (en) | Sharing status information across a pluarlity of communication networks | |
| EP3451609B1 (en) | A method and a system to deliver multimedia content in a downstream network | |
| US10129320B2 (en) | QoS improvement method, apparatus, and system | |
| CN105979225A (en) | Monitoring method and device for group video room | |
| US20090319666A1 (en) | Method and Apparatus for Session Initiated Protocol (SIP) Based Information Uploading from an Optical Network Terminal (ONT) | |
| JP2021527351A (en) | Network-controlled uplink media transmission for collaborative media production in scenarios with limited network capacity | |
| CN113259618B (en) | Audio and video session method and device, first terminal and session server | |
| EP3841753B1 (en) | Method and system for network controlled media upload of stored content | |
| EP2178269A1 (en) | Monitoring the content of communications to a user gateway |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |