CN112333414A

CN112333414A - Video call method and device, electronic equipment and readable storage medium

Info

Publication number: CN112333414A
Application number: CN202011193832.1A
Authority: CN
Inventors: 黄江民
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2020-10-30
Filing date: 2020-10-30
Publication date: 2021-02-05

Abstract

The embodiment of the application discloses a video call method, a video call device, electronic equipment and a readable storage medium, wherein the method comprises the following steps: under the condition of receiving first request information sent by a second video call device, determining a first video parameter according to first network quality data of the network environment; the first request information comprises a video call request and a second video parameter; the second video parameter is determined by the second video call device according to second network quality data of the network environment; determining a first target video parameter according to the first video parameter and the second video parameter; and under the condition of accepting the video call request, establishing a video call with the second video call device based on the first target video parameter. According to the embodiment of the invention, the problems of black screen, screen splash and blockage of the video call picture displayed by the electronic equipment caused by poor network quality of the environment where the user is in the video call can be solved.

Description

Video call method and device, electronic equipment and readable storage medium

Technical Field

The embodiment of the application relates to the technical field of communication, in particular to a video call method, a video call device, electronic equipment and a readable storage medium.

Background

In modern life, people often use the video call function of electronic equipment in both working environment and life and leisure environment.

In carrying out the present application, the applicant has found that there are at least the following problems in the related art:

at present, when a user uses electronic equipment to carry out video call, the problems of black screen, screen splash and blockage of a video call picture displayed by the electronic equipment can be caused due to poor network quality of the current environment.

Disclosure of Invention

The embodiment of the application provides a video call method, a video call device, an electronic device and a readable storage medium, which can solve the problems that a video call picture displayed by the electronic device is black, large and unsmooth due to poor network quality of an environment where a user is in a video call.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides a video call method, which is applied to a first video call device, and the method may include:

under the condition of receiving first request information sent by a second video call device, determining a first video parameter according to first network quality data of the network environment; the first request information comprises a video call request and a second video parameter; the second video parameter is determined by the second video call device according to second network quality data of the network environment;

determining a first target video parameter according to the first video parameter and the second video parameter;

and under the condition of accepting the video call request, establishing a video call with the second video call device based on the first target video parameter.

In a second aspect, an embodiment of the present application provides a video call method, which is applied to a second video call device, and the method may include:

determining a second video parameter according to second network quality data of the network environment;

sending first request information to the first video call device, wherein the first request information comprises second video parameters;

receiving second request information sent by the first video call device, wherein the second request information comprises a first target video parameter and video receiving request information; the first target video parameter is determined by the first video call device according to the first video parameter and the second video parameter;

and establishing a video call with the first video call device based on the first target video parameter.

In a third aspect, an embodiment of the present application provides a video call apparatus, where the apparatus may include:

the first determining module is used for determining a first video parameter according to first network quality data of the network environment under the condition of receiving first request information sent by the second video call device; the first request information comprises a video call request and a second video parameter; the second video parameter is determined by the second video call device according to second network quality data of the network environment;

the second determining module is used for determining a first target video parameter according to the first video parameter and the second video parameter;

and the first establishing module is used for establishing the video call with the second video call device based on the first target video parameter under the condition of receiving the video call request.

In a fourth aspect, an embodiment of the present application provides a video call apparatus, which may include:

the fifth determining module is used for determining a second video parameter according to second network quality data of the network environment;

the second sending module is used for sending first request information to the first video call device, wherein the first request information comprises a second video parameter;

the receiving module is used for receiving second request information sent by the first video call device, wherein the second request information comprises a first target video parameter and video receiving request information; the first target video parameter is determined by the first video call device according to the first video parameter and the second video parameter;

and the second establishing module is used for establishing the video call with the first video call device based on the first target video parameter.

In a fifth aspect, embodiments of the present application provide an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, where the program or instructions, when executed by the processor, implement the steps of the method according to the first aspect or the second aspect.

In a sixth aspect, embodiments of the present application provide a readable storage medium on which a program or instructions are stored, which when executed by a processor, implement the steps of the method according to the first or second aspect.

In a seventh aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect or the second aspect.

In the embodiment of the application, under the condition that first request information sent by a second video call device is received, a first video parameter is determined according to first network quality data of a network environment, then a first target video parameter is determined according to the first video parameter and a second video parameter in the first request information, and then a video call with the second video call device is established according to the first target video parameter. The first video parameter and the second video parameter are respectively determined by the first video call device and the second video call device according to the network quality data, namely, in an environment with good network quality, the electronic equipment can use the high-quality video parameters; in an environment with poor network, the electronic equipment can use video parameters with lower quality, so that after the video call is connected, because the video parameters are more suitable for the network environment where the electronic equipment is currently located, the stable transmission of video data can be ensured, and the display effect of video pictures is further improved.

Drawings

The present application may be better understood from the following description of specific embodiments of the application taken in conjunction with the accompanying drawings, in which like or similar reference numerals identify like or similar features.

Fig. 1 is a schematic view of an application scenario of a video call method according to an embodiment of the present application;

fig. 2 is a flowchart of a video call method according to an embodiment of the present application;

fig. 3 is a flowchart of another video call method according to an embodiment of the present application;

fig. 4 is a flowchart of a method for implementing a video call according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of a video call device according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of another video call device according to an embodiment of the present application;

fig. 7 is a schematic hardware structure diagram of an electronic device according to an embodiment of the present disclosure;

fig. 8 is a schematic hardware structure diagram of another electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or described herein. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

The video call method provided by the embodiment of the present application can be applied to the following application scenarios, which are described below.

With the popularization of electronic devices and 4G and 5G networks thereof, people have higher and higher requirements on detail optimization and experience of the electronic devices. During the use of the electronic device, the video call function is often used by users, and the video call function in the IP Multimedia System (IMS) is often used during the use of the electronic device by people. The network bandwidth occupied in the IMS video call process is relatively high, and the uplink bandwidth resource of the network service cell is limited, so that in the video call use process, the problem of image abnormality (such as screen splash, screen blockage, screen blackness, etc.) often occurs due to the influence of insufficient uplink network bandwidth resource.

As shown in fig. 1, in the related art, a negotiation process of video media parameters for IMS video call setup of two electronic devices is as follows:

in step 110, the electronic device a determines a default video parameter a.

Step 120, a SIP message including default video parameters a is sent.

The electronic device a initiates a Session Initiation Protocol (SIP) message for establishing a video call, and a Session Description Protocol (SDP) of the SIP message carries video media parameter information. The video media parameters include a video parameter set supported by the electronic device and default video parameters, and the default video parameters are generally the highest level of the video parameter set supported by the electronic device.

SDP is mainly used for media negotiation between two session entities. A session, such as a network telephone, a conference call, a video chat, may be referred to as a session. SDP is mainly intended to solve the problem of unequal capabilities between electronic devices participating in a session.

SDP protocol structure, SDP description consists of many text lines, the format of which is < type > < value >, < type > is a letter, and < value > is a structured text string, the format of which depends on < type >.

The text information of SDP includes: session name and intent, session duration, media comprising the session, and information about the received media.

In step 130, the electronic device B determines a default video parameter B.

In step 140, the electronic device B compares the default video parameter a with the default video parameter B to obtain the target default parameter.

The electronic equipment B receives the SIP message invited by the video call of the electronic equipment A, reads the video media parameter INFO _ A in the SDP message of the SIP message sent by the electronic equipment A, reads the video media parameter INFO _ B of the electronic equipment B, and compares the default video parameters of the INFO _ A and the INFO _ B to obtain the target default parameter. Assuming that the default video parameter a is INFO _ a _ default and the default video parameter B is INFO _ B _ default, the smaller one of them is taken as the FINAL selection (assumed to be FINAL) of the electronic device B, and FINAL is carried in SDP of the SIP message that the electronic device B responds to the electronic device a.

FINAL ═ min (INFO _ a _ default, INFO _ B _ default), i.e., the smaller of INFO _ a _ default and INFO _ B _ default.

Step 150, the SIP message including the target default parameters is sent.

In step 160, the electronic device B accepts the video invitation.

The electronic device B accepts the video invitation of the electronic device a, establishes a call with the electronic device a, and the electronic device a and the electronic device B perform a video call by using the previously negotiated video parameter (i.e. FINAL). The video parameter sets include resolutions (e.g., 720 × 1280, 480 × 640, 240 × 320, etc.), bit rates (e.g., 2048kbps, 960kbps, 64kbps, etc.), etc., and the default video parameters of the electronic device are generally 720 × 1280 and 2048kbps if the resolutions and bit rates corresponding to the highest levels of the video parameter sets supported by the electronic device are 720 × 1280 and 2048kbps, respectively.

And 170, coding and transmitting the video according to the target default parameters.

And step 180, coding the video according to the target default parameters and transmitting the video.

Based on the above process, the default of the video media parameter negotiation established by the IMS video call is to take the smaller value of the default video parameters at the two ends of the calling party and the called party, and the smaller value corresponds to the smaller highest-level parameter of the video parameter sets supported by the two ends of the calling party and the called party.

If the network environment is poor, the default video parameters are still used as the media parameters established by the video call, and due to the fact that the resolution and the bit rate of the default video parameters are high, the video image abnormity phenomenon of the first few seconds after the video call is connected can easily occur. The reason for this is that the current network resources cannot meet the video call with the default video quality, and the problem of data packet loss occurs in the transmission process. This phenomenon lasts for several seconds (e.g., 3-5 seconds), and cannot be recovered until the first rate negotiation after the video call is established.

The embodiment of the application provides a video call method, a video call device, an electronic device and a storage medium, which can solve the problem that in the related art, a video call picture displayed by the electronic device is black, large and unsmooth due to poor network quality of an environment where a user is in a video call.

According to the method provided by the embodiment of the application, under the condition that the first request information sent by the second video call device is received, the first video parameter is determined according to the first network quality data of the network environment, then the first target video parameter is determined according to the first video parameter and the second video parameter in the first request information, and then the video call with the second video call device is established according to the first target video parameter. Therefore, after the video call is connected, because the video parameters are more suitable for the current network environment of the electronic equipment, the stable transmission of the video data can be ensured, and the display effect of the video picture is further improved.

Based on the application scenario, the video call method provided in the embodiment of the present application is described in detail below.

Fig. 2 is a flowchart of a video call method according to an embodiment of the present application.

As shown in fig. 2, the video call method may include steps 210 to 230, and the method is applied to a video call device, and specifically as follows:

step 210, determining a first video parameter according to first network quality data of the network environment under the condition of receiving first request information sent by a second video call device; the first request information comprises a video call request and a second video parameter; the second video parameter is determined by the second video call device according to the second network quality data of the network environment.

Step 220, determining a first target video parameter according to the first video parameter and the second video parameter.

In step 230, in the case of accepting the video call request, a video call with the second video call device is established based on the first target video parameter.

In the video call method, under the condition that first request information sent by a second video call device is received, a first video parameter is determined according to first network quality data of a network environment, then a first target video parameter is determined according to the first video parameter and a second video parameter in the first request information, and then a video call with the second video call device is established according to the first target video parameter. Therefore, after the video call is connected, because the video parameters are more suitable for the current network environment of the electronic equipment, the stable transmission of the video data can be ensured, and the display effect of the video picture is further improved.

The contents of steps 210-230 are described below:

first, step 210 is involved.

Wherein the first network quality data referred to above comprises at least one of: reference signal received power, reference signal received quality, received signal strength indication, signal, interference plus noise ratio. These network quality data are described below:

the Signal to Interference plus Noise Ratio (SINR) is the Ratio of the received strength of a useful Signal to the received strength of an interfering Signal (Noise and Interference), and can be simply understood as "Signal to Noise Ratio".

Received Signal Strength Indication (RSSI), Received Signal Strength Indication, optional parts of the radio transmission layer to determine link quality, and whether to increase broadcast transmission Strength.

Reference Signal Receiving Quality (RSRQ) represents the Reference Signal Receiving Quality, and this metric mainly ranks different LTE candidate cells according to Signal Quality. This measurement is used as input for handover and cell reselection decisions.

Reference Signal Receiving Power (RSRP) is one of the key parameters in a network that can represent the wireless Signal strength and the physical layer measurement requirements, and is the average of the received Signal Power over all the resource elements that carry the Reference Signal within a certain symbol.

The second network quality data also includes at least one of a reference signal received power, a reference signal received quality, a received signal strength indicator, and a signal to interference plus noise ratio, which is not described herein again.

Wherein the first video parameter referred to above comprises bit rate and/or resolution; the second video parameter comprises a bit rate and/or a resolution.

Bit rate refers to the number of bits transmitted per second (bits). The amount of information transmitted over the channel per second is called the bit transmission rate, which is expressed in bits per second (b/s), or bit rate (bitrate). Bit rate is often used in the field of communications as a synonym for connection speed, transmission speed, channel capacity, maximum throughput and digital bandwidth capacity. The higher the bit rate, the larger the amount of data (number of bits) transmitted per unit time. The bit rate is often used to measure the quality of sound and video files.

Resolution is a parameter used to measure how much data is in an image. For example, a video with a resolution of 320 × 180 means that its effective pixels in the horizontal and vertical directions are 320 and 180, respectively, and the higher the resolution, the sharper the video.

The step of determining the first video parameter according to the first network quality data of the network environment may specifically include the following steps:

determining a first network quality level according to the first network quality data; and determining a first video parameter corresponding to the first network quality grade through a preset mapping relation between the network quality grade and the video parameter.

Specifically, according to the first network quality data, a first network quality level to which the first network quality data belongs can be determined, and the better the first network quality data is, the higher the corresponding first network quality level is.

The preset mapping relationship between the network quality level and the video parameter may be: under the condition that the network quality level corresponding to the first network quality data is one level, the first video parameter may be 2048 kbps; in the case that the network quality level corresponding to the first network quality data is two-level, the first video parameter may be 960 kbps; in the case where the network quality level corresponding to the first network quality data is three levels, 64 kbps.

In this way, the electronic device may use the high-quality video parameters in the case that the network quality level corresponding to the first network quality data is high (in an environment with good network quality); under the condition that the network quality level corresponding to the first network quality data is low (in a poor network environment), the electronic equipment can use the video parameters with low quality, so that after the video call is connected, the video parameters are more suitable for the network environment where the electronic equipment is currently located, the stable transmission of the video data can be ensured, and the display effect of the video picture is improved.

Next, step 220 is involved.

And under the condition that the first video parameter and the second video parameter are not consistent, determining the smaller value of the first video parameter and the second video parameter as the first target video parameter.

The first video call device and the second video call device may have different corresponding first video parameters and second video parameters due to different network environments, and when the first video parameters and the second video parameters are inconsistent, a smaller value of the first video parameters and the second video parameters needs to be determined, and the smaller value is determined as the first target video parameter.

Illustratively, in the case where the first video parameter is 2048kbps and the first video parameter is 960kbps, the smaller value of the first video parameter and the second video parameter may be determined as the first target video parameter, i.e., the first target video parameter is 960 kbps.

Here, the smaller value of the first video parameter and the second video parameter is determined as the first target video parameter, which can ensure that the end with poor network quality (the video parameter is smaller) can stably receive the video code stream sent by the other side, and ensure stable transmission of the video.

In the case where the first video parameter and the second video parameter coincide, any one of the first video parameter and the second video parameter is determined as a first target video parameter.

Exemplarily, in case that the first video parameter is 2048kbps and the first video parameter is also 2048kbps, either one of the first video parameter and the second video parameter may be determined as the first target video parameter, which is also 2048 kbps.

Finally, step 230 is involved.

The step of establishing a video call with the second video call device based on the first target video parameter in step 230 may specifically include: under the condition of receiving a video call request, carrying out video coding on the collected first video according to the first target video parameter to obtain a second video; and sending the second video to the second video call device.

Video coding refers to a mode of converting a file in an original video format into a file in another video format by a compression technology.

Generally, when a video phone is switched on, a video call established based on a first target video parameter may last for 3 to 5 seconds, that is, before a first rate negotiation after the call establishment is completed, both ends of the first video call device and the second video call device perform video coding transmission with the first target video parameter.

As another implementation manner of the present application, in order to enhance the user experience, before step 230, the following steps may be further included:

sending second request information to a second video call device, wherein the second request information comprises the first target video parameter; the second request information is used for the second video call device to establish a video call with the first video call device based on the first target video parameter.

The above step for the second video call device to establish a video call with the first video call device based on the first target video parameter may specifically include the following steps:

and sending second request information including the first target video parameter to a second video call device, so that the second video call device performs video coding on the acquired third video according to the first target video parameter to obtain a fourth video, and sends the fourth video to the first video call device.

In this way, by sending second request information including the first target video parameter to the second video call apparatus, the second request information is used for the second video call apparatus to establish a video call with the first video call apparatus based on the first target video parameter. On one hand, the problem of image abnormity at the moment of video call connection (for example, 3-5 seconds) caused by poor network quality can be avoided, and the user experience can be improved; on the other hand, because the video call is established based on the first target video parameter, rather than using the highest or default video parameter supported by the electronic equipment of both sides, the network resource can also be saved.

In one possible embodiment, in the case where the second request information is transmitted to the second video call apparatus a plurality of times, the video call with the second video call apparatus is established based on the first target video parameter in the second request information transmitted last time.

In the setup process of the video phone, the process of sending and receiving the first request message and the second request message may occur multiple times, and one complete process of sending the first request message and receiving the second request message may be referred to as one media negotiation.

That is, media negotiation between the first video call device and the second video call device may occur multiple times until the first video call device switches on accepting the video call request of the second video call device. And under the condition that the first video call device sends the second request information to the second video call device for a plurality of times, the first video call device and the second video call device use the first target video parameters confirmed by the last media negotiation to establish the video call.

As another implementation manner of the present application, in order to enhance the user experience, after step 230, the following steps may be further included:

under the condition that the first network quality data is updated to third network quality data, updating the first target video parameter to a second target video parameter; wherein the second target video parameter is determined based on the third network quality data.

During the video call, the network environment may change continuously, which requires monitoring the network quality data and updating the first target video parameter according to the changed network quality data.

Specifically, when it is detected that the first network quality data is updated to the third network quality data, the second target video parameter is determined according to the third network quality data, and then the first target video parameter is updated to the second target video parameter.

The step and implementation manner of determining the second target video parameter according to the third network quality data are consistent with the above-mentioned step and implementation manner of determining the first target video parameter according to the first network quality data, and are not described herein again.

Here, when the first network quality data is updated to the third network quality data, the first target video parameter is updated to the second target video parameter determined based on the third network quality data, so that the video parameters in the video call can be dynamically updated according to changes in the network environment, and it is ensured that both videos can display stable video pictures on their electronic devices even when the network environment is unstable.

The step of updating the first target video parameter to the second target video parameter when the first network quality data is changed into the third network quality data may specifically include the following steps:

determining a third video parameter according to the third network quality data and the first feedback parameter of the video call; determining a second target video parameter according to the third video parameter and the fourth video parameter;

wherein the first feedback parameter comprises at least one of: peak signal-to-noise ratio, structural similarity, time delay feedback and frame loss feedback of the video call pictures;

the fourth video parameter is determined by the second video call device according to the fourth network quality data of the network environment and the second feedback parameter.

After the first video call device receives a video call establishment requirement of the second video call device, both ends of the first video call device and the second video call device carry out video coding transmission according to the first target video parameter. And switching the first video call device and the second video call device to the second target video parameter after the code rate negotiation to perform video coding transmission until the first code rate negotiation after the call establishment is completed.

The video code rate is the number of data bits transmitted per unit time during data transmission, and is generally kbps, i.e., kilobits per second. The popular understanding is that the sampling rate is higher, the higher the sampling rate in unit time is, the higher the precision is, and the closer the processed file is to the original file.

The above-mentioned code rate negotiation can evaluate the proper video quality according to the first feedback parameters such as the network environment and the data packet receiving condition.

The first feedback parameter may specifically comprise at least one of: peak signal-to-noise ratio, structural similarity, delay feedback and frame loss feedback of the video call pictures. The following is specifically explained:

a larger peak signal-to-noise ratio value indicates a smaller distortion; the structural similarity can measure the image similarity from three aspects of brightness, contrast and structure, and the larger the picture structural similarity of the video call in the preset time is, the more stable the video is; the time delay feedback is used for indicating whether the data packet is received timely or not; and whether the receiving of the frame loss feedback data packet is complete or not is judged.

After the first feedback parameter is determined, a third video parameter of the first video call device may be determined based on the third network quality data and the first feedback parameter of the video call; and then determining a second target video parameter according to the third video parameter and a fourth video parameter determined by the second video call device according to fourth network quality data of the network environment and the second feedback parameter.

After the code rate negotiation is finished, the two communication parties can carry out video call according to the second target video parameter determined in the code rate negotiation process.

Here, the third video parameter is determined by the first feedback parameter based on the third network quality data and the video call; and then determining a second target video parameter for the video call according to the third video parameter and the fourth video parameter determined by the second video call device. Under the condition that the network environment changes, besides the network quality data, feedback parameters (such as frame loss, time delay and the like) in the video call are also considered to determine the third video parameter, so that the updated video parameter can be more accurately and comprehensively determined, and the video picture of the video call is more stable and smooth.

In summary, in the embodiment of the present application, when first request information sent by a second video call device is received, a first video parameter is determined according to first network quality data of a network environment where the first video call device is located, then a first target video parameter is determined according to the first video parameter and a second video parameter in the first request information, and then a video call with the second video call device is established according to the first target video parameter. The first video parameter and the second video parameter are respectively determined by the first video call device and the second video call device according to the network quality data, namely, in an environment with good network quality, the electronic equipment can use the high-quality video parameters; in an environment with poor network, the electronic equipment can use video parameters with lower quality, so that after the video call is connected, because the video parameters are more suitable for the network environment where the electronic equipment is currently located, the stable transmission of video data can be ensured, and the display effect of video pictures is further improved.

In addition, based on the above video call method, an embodiment of the present application further provides another video call method, which is applied to a second video call device, and is specifically described in detail with reference to fig. 3.

The following describes the video call method provided in the embodiment of the present application in detail.

Fig. 3 is a flowchart of another video call method according to an embodiment of the present application.

As shown in fig. 3, the video call method may include steps 310 to 330, and the method is applied to a video call device, and specifically as follows:

step 310, determining a second video parameter according to a second network quality data of the network environment.

Wherein, step 310 may specifically include: determining a second network quality level according to the second network quality data; and determining a second video parameter corresponding to the second network quality grade through a preset mapping relation between the network quality grade and the video parameter.

Step 320, sending a first request message to the first video call device, where the first request message includes the second video parameter.

And sending first request information to the first video call device, wherein the first request information may include a video call request and a second video parameter, the video call request is used for requesting a video call from the first video call device, and the second video parameter is used for determining the first target video parameter by the first video call device. After the first video call device determines the first target video parameter, second request information is returned to the second video call device.

Step 330, receiving second request information sent by the first video call device, wherein the second request information comprises a first target video parameter and video request receiving information; the first target video parameter is determined by the first video call device according to the first video parameter and the second video parameter.

And receiving second request information sent by the first video call device, wherein the second request information may include a first target video parameter and video request receiving information, the video request receiving information is used for indicating that a video call can be established between the first video call device and the second video call device, and the first target video parameter is determined by the first video call device according to the first video parameter and a second video parameter in the first request information sent by the second video call device.

Step 340, establishing a video call with the first video call device based on the first target video parameter.

After receiving the second request message sent by the first video call device, the video call with the first video call device can be established according to the first target video parameter in the second request message.

As another implementation manner of the present application, in order to ensure stability and smoothness of a video frame in a changing network environment, after step 330, the following steps may be further included:

under the condition that the second network quality data is updated to fourth network quality data, determining a fourth video parameter according to the fourth network quality data; sending third request information to the first video call device, wherein the third request information comprises a fourth video parameter; and the third request information is used for the first video call device to update the first target video parameter according to the fourth video parameter.

Specifically, when it is detected that the second network quality data is updated to the fourth network quality data, the fourth video parameter is determined according to the fourth network quality data, and then third request information including the fourth video parameter is sent to the first video call device to inform the first video call device that the second video call device has changed the network quality data, and the video parameter needs to be updated accordingly.

Here, by updating the first target video parameter to the second target video parameter determined based on the fourth video parameter when the second network quality data is updated to the fourth network quality data, the video parameters in the video call can be dynamically updated according to the change of the network environment, and it is ensured that both the videos can display a stable video picture on the electronic devices of both the videos even when the network environment changes.

In summary, in the embodiment of the present application, a second video parameter is determined according to second network quality data of a network environment, then first request information including the second video parameter is sent to a first video call device, and then a video call with the first video call device is established based on a first target video parameter in the second request information sent by the first video call device. The first target video parameter is determined by the first video call device according to the first video parameter and the second video parameter, and the first video parameter and the second video parameter are determined by the first video call device and the second video call device according to the network quality data. Therefore, after the video call is connected, because the video parameters are more suitable for the current network environment of the electronic equipment, the stable transmission of the video data can be ensured, and the display effect of the video picture is further improved.

In addition, based on the above video call method, an embodiment of the present application further provides a method for implementing a video call, which is applied to a first video call device and a second video call device, and is specifically described in detail with reference to fig. 4.

As shown in fig. 4, the method for implementing video call may include steps 410 to 480, and the method is applied to a video call device, and specifically as follows:

at step 410, second video parameters are determined.

The second video call device initiates a video call to the first video call device, before the first video call device connects the video incoming call of the second video call device, the second video call device initiates multiple media negotiations to the first video call device, and the media information of the second video call device is in the SDP content of the SIP message corresponding to the media negotiations.

If the second video call device triggers an SIP message containing media negotiation during the video call, the second video call device may match the suggested video media parameters, i.e., the second video parameters, according to the current network conditions.

When the network is good, the second video parameters use default video parameters (which are also the highest-level video parameters of the second video call device video quality parameter set), for example, corresponding to a bit rate of 2052kbps, and a resolution of 1280 × 720; in case of network difference, i.e. the second video parameter, the lower ranked video media parameters are used, e.g. corresponding to a bit rate of 400kbps and a resolution of 320 x 240.

The second video parameter may be represented by a single extension line in the SDP line of the SIP message, or by an extension line in the existing SDP video media parameter line, that is, the content representation manner in the SDP is not specified in the present application, as long as the second video parameter can carry this information.

Step 420, the SIP message including the second video parameter is sent.

The second video call device carries the second video parameters in SDP information of an SIP message of calling the first video call device by the second video call device, and then sends the SDP information to the first video call device through the network.

In step 430, a first video parameter is determined.

If the first video call device receives the SIP message containing the media negotiation (i.e. receives the SIP message containing the SDP Offer), the first video call device also matches the first video parameter according to the current network condition, and if the network is normal, the first video parameter is equal to the default video parameter.

Step 440, determining a first target video parameter according to the first video parameter and the second video parameter.

And when the first video parameter and the second video parameter are different, determining the smaller value of the first video parameter and the second video parameter as the first target video parameter.

And determining any one of the first video parameter and the second video parameter as the first target video parameter when the first video parameter and the second video parameter are the same.

Step 450, sending a SIP message including the first target video parameter.

After obtaining the first target video parameter, the first video call device carries the first target video parameter in SDP information (i.e., SDP Answer) of an SIP response message that the first video call device replies to the second video call device.

The process of steps 410-450 may be triggered multiple times during the setup of a videophone until the videophone is connected.

Step 460, accept video invitation.

The first video call device is used as a video incoming call called party to connect the video call.

And 470, coding the video according to the first target video parameter and transmitting.

And the first video call device takes the video media parameters corresponding to the first target video parameters as parameters needed to be used after the first video call device establishes the video call, encodes the video stream according to the first target video parameters, and sends the video stream to the second video call device.

And step 480, encoding the video according to the first target video parameter and transmitting.

The second video call device receives the SIP response message (containing the SDP answer) of the first video call device, takes the video media parameters corresponding to the first target video parameters as the parameters needed to be used after the second video call device establishes the video call, encodes the video stream according to the first target video parameters, and sends the video stream to the first video call device.

Therefore, when the video call is connected, the bit rates of the video streams coded by the first video call device and the second video call device are more suitable for the current network, the packet loss rate of video stream transmission after the video call is connected is greatly reduced, the problem of abnormal pictures is avoided, and the improvement is more obvious especially in the environment with poorer network.

Here, with the method provided by the embodiment of the present application, in the case of receiving the first request information sent by the second video call device, the first video parameter is determined according to the first network quality data of the network environment where the first video call device is located, then the first target video parameter is determined according to the first video parameter and the second video parameter in the first request information, and then a video call with the second video call device is established according to the first target video parameter. The first video parameter and the second video parameter are respectively determined by the first video call device and the second video call device according to the network quality data, namely, in an environment with good network quality, the electronic equipment can use the high-quality video parameters; in an environment with poor network, the electronic equipment can use video parameters with lower quality, so that after the video call is connected, because the video parameters are more suitable for the network environment where the electronic equipment is currently located, the stable transmission of video data can be ensured, and the display effect of video pictures is further improved.

It should be noted that, in the video call method provided in the embodiment of the present application, the execution main body may be a video call device, or a control module in the video call device, which is used for executing the loading video call method. In the embodiment of the present application, a video call device is taken as an example to execute a method for loading a video call, and the video call method provided in the embodiment of the present application is described.

In addition, based on the video call method shown in fig. 2, an embodiment of the present application further provides a video call device, which is specifically described in detail with reference to fig. 5.

Fig. 5 is a schematic structural diagram of a video call device according to an embodiment of the present application.

As shown in fig. 5, the video call apparatus 500 may include:

a first determining module 510, configured to determine a first video parameter according to first network quality data of a network environment where the first video parameter is located when first request information sent by a second video call device is received; the first request information comprises a video call request and a second video parameter; the second video parameter is determined by the second video call device according to the second network quality data of the network environment.

A second determining module 520, configured to determine the first target video parameter according to the first video parameter and the second video parameter.

A first establishing module 530, configured to establish a video call with a second video call device based on the first target video parameter when the video call request is accepted.

In a possible embodiment, the first determining module 510 is specifically configured to:

In a possible embodiment, the second determining module 520 is specifically configured to:

In a possible embodiment, the video call device 500 may further include:

and the first sending module is used for sending second request information to the second video call device, wherein the second request information comprises the first target video parameter.

The second request information is used for the second video call device to establish a video call with the first video call device based on the first target video parameter.

In a possible embodiment, the video call device 500 may further include:

and the updating module is used for updating the first target video parameter to the second target video parameter under the condition that the first network quality data is updated to the third network quality data.

Wherein the second target video parameter is determined based on the third network quality data.

In a possible embodiment, the first video parameter comprises at least one of a bit rate and a resolution; the second video parameter comprises at least one of a bit rate and a resolution;

the first network quality data comprises at least one of: reference signal received power, reference signal received quality, received signal strength indication, signal, interference plus noise ratio.

In one possible embodiment, the update module includes:

and the third determining module is used for determining a third video parameter according to the third network quality data and the first feedback parameter of the video call.

And the fourth determining module is used for determining the second target video parameter according to the third video parameter and the fourth video parameter.

Wherein the first feedback parameter involved comprises at least one of: peak signal-to-noise ratio, structural similarity, delay feedback, frame loss feedback of the video call pictures.

And the related fourth video parameter is determined by the second video call device according to the fourth network quality data of the network environment and the second feedback parameter.

To sum up, the video call device provided in the embodiment of the present application, when receiving the first request information sent by the second video call device, determines the first video parameter according to the first network quality data of the network environment where the video call device is located, then determines the first target video parameter according to the first video parameter and the second video parameter in the first request information, and then establishes a video call with the second video call device according to the first target video parameter. The first video parameter and the second video parameter are respectively determined by the first video call device and the second video call device according to the network quality data, namely, in an environment with good network quality, the electronic equipment can use the high-quality video parameters; in an environment with poor network, the electronic equipment can use video parameters with lower quality, so that after the video call is connected, because the video parameters are more suitable for the network environment where the electronic equipment is currently located, the stable transmission of video data can be ensured, and the display effect of video pictures is further improved.

In addition, based on the video call method shown in fig. 3, an embodiment of the present application further provides a video call device, which is specifically described in detail with reference to fig. 6.

Fig. 6 is a schematic structural diagram of a video call device according to an embodiment of the present application.

As shown in fig. 6, the video call apparatus 600 may include:

a fifth determining module 610, configured to determine a second video parameter according to second network quality data of the network environment.

The second sending module 620 is configured to send first request information to the first video call device, where the first request information includes the second video parameter.

A receiving module 630, configured to receive second request information sent by the first video call device, where the second request information includes a first target video parameter and video request receiving information; the first target video parameter is determined by the first video call device according to the first video parameter and the second video parameter.

A second establishing module 640, configured to establish a video call with the first video call device based on the first target video parameter.

In a possible embodiment, the video call device 600 may further include:

and the sixth determining module is used for determining a fourth video parameter according to the fourth network quality data under the condition that the second network quality data is updated to the fourth network quality data.

And the third sending module is used for sending third request information to the first video call device, wherein the third request information comprises a fourth video parameter.

And the third request information is used for the first video call device to update the first target video parameter according to the fourth video parameter.

To sum up, the video call device provided in the embodiment of the present application determines the second video parameter according to the second network quality data of the network environment, then sends the first request information including the second video parameter to the first video call device, and then establishes a video call with the first video call device based on the first target video parameter in the second request information sent by the first video call device. The first target video parameter is determined by the first video call device according to the first video parameter and the second video parameter, and the first video parameter and the second video parameter are determined by the first video call device and the second video call device according to the network quality data. Therefore, after the video call is connected, because the video parameters are more suitable for the current network environment of the electronic equipment, the stable transmission of the video data can be ensured, and the display effect of the video picture is further improved.

The video call device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.

The video call device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The video call device provided in the embodiment of the present application can implement each process implemented by the video call device in the method embodiments of fig. 2 to fig. 4, and is not described herein again to avoid repetition.

Optionally, as shown in fig. 7, an electronic device 700 is further provided in this embodiment of the present application, and includes a processor 701, a memory 702, and a program or an instruction stored in the memory 702 and executable on the processor 701, where the program or the instruction is executed by the processor 701 to implement each process of the above-mentioned chat group creation method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and the non-mobile electronic devices described above.

The electronic device 800 includes, but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, a processor 810, and a power supply 811. Among other things, input unit 804 may include a graphics processor 8041 and a microphone 8042; the display unit 806 may include a display panel 8061; the user input unit 807 may include a touch panel 8071 and other input devices 8072; the memory 809 may include application programs and an operating system.

Those skilled in the art will appreciate that the electronic device 800 may further comprise a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 810 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system. The electronic device structure shown in fig. 8 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.

The processor 810 is configured to determine a first video parameter according to first network quality data of a network environment where the first video parameter is located when first request information sent by the second video call device is received; the first request information comprises a video call request and a second video parameter; the second video parameter is determined by the second video call device according to the second network quality data of the network environment.

A processor 810 is configured to determine a first target video parameter according to the first video parameter and the second video parameter.

The network module 802 is configured to establish a video call with a second video call device based on the first target video parameter when the video call request is accepted.

Optionally, the processor 810 is configured to determine a first network quality level according to the first network quality data; and determining a first video parameter corresponding to the first network quality grade through a preset mapping relation between the network quality grade and the video parameter.

Optionally, the processor 810 determines a smaller value of the first video parameter and the second video parameter as the first target video parameter in case that the first video parameter and the second video parameter are not identical.

Optionally, the processor 810 determines any one of the first video parameter and the second video parameter as the first target video parameter in case that the first video parameter and the second video parameter are identical.

Optionally, the network module 802 is configured to send second request information to the second video call device, where the second request information includes the first target video parameter.

Optionally, the processor 810 is configured to update the first target video parameter to the second target video parameter if the first network quality data is updated to the third network quality data.

Optionally, the processor 810 is configured to determine a third video parameter according to the third network quality data and the first feedback parameter of the video call.

Optionally, the processor 810 is configured to determine a second target video parameter according to the third video parameter and the fourth video parameter.

In the embodiment of the application, under the condition that first request information sent by a second video call device is received, a first video parameter is determined according to first network quality data of a network environment, then a first target video parameter is determined according to the first video parameter and a second video parameter in the first request information, and then a video call with the second video call device is established according to the first target video parameter. The first video parameter and the second video parameter are respectively determined by the first video call device and the second video call device according to the network quality data, namely, in an environment with good network quality, the electronic equipment can use the high-quality video parameters; in an environment with poor network, the electronic equipment can use video parameters with lower quality, so that after the video call is connected, because the video parameters are more suitable for the network environment where the electronic equipment is currently located, the stable transmission of video data can be ensured, and the display effect of video pictures is further improved. Or,

a processor 810 for determining a second video parameter according to a second network quality data of the network environment.

The network module 802 is configured to send first request information to the first video call device, where the first request information includes the second video parameter.

A network module 802, configured to receive second request information sent by the first video call device, where the second request information includes a first target video parameter and video request receiving information; the first target video parameter is determined by the first video call device according to the first video parameter and the second video parameter.

A network module 802, configured to establish a video call with a first video call device based on the first target video parameter.

Optionally, the processor 810 determines the fourth video parameter according to the fourth network quality data in case that the second network quality data is updated to the fourth network quality data.

Optionally, the network module 802 is configured to send third request information to the first video call device, where the third request information includes a fourth video parameter.

In the embodiment of the application, a second video parameter is determined according to second network quality data of a network environment, then first request information including the second video parameter is sent to a first video call device, and then a video call with the first video call device is established based on a first target video parameter in the second request information sent by the first video call device. The first target video parameter is determined by the first video call device according to the first video parameter and the second video parameter, and the first video parameter and the second video parameter are determined by the first video call device and the second video call device according to the network quality data. Therefore, after the video call is connected, because the video parameters are more suitable for the current network environment of the electronic equipment, the stable transmission of the video data can be ensured, and the display effect of the video picture is further improved.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the video call method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement each process of the above video call method embodiment, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A video call method is applied to a first video call device, and is characterized by comprising the following steps:

2. The method of claim 1, wherein determining the first video parameter based on the first network quality data of the network environment comprises:

determining a first network quality level according to the first network quality data;

and determining the first video parameter corresponding to the first network quality grade through a preset mapping relation between the network quality grade and the video parameter.

3. The method of claim 1, wherein determining the first target video parameter from the first video parameter and the second video parameter comprises:

4. The method of claim 1, wherein determining the first target video parameter from the first video parameter and the second video parameter comprises:

determining any one of the first video parameter and the second video parameter as the first target video parameter if the first video parameter and the second video parameter are identical.

5. The method of claim 1, wherein prior to said establishing a video call with the second video call device based on the first target video parameters, the method further comprises:

sending second request information to the second video call device, wherein the second request information comprises the first target video parameter;

wherein the second request information is used for the second video call device to establish a video call with the first video call device based on the first target video parameter.

6. The method of claim 1, wherein after determining the first target video parameter based on the first video parameter and the second video parameter, the method further comprises:

updating the first target video parameter to a second target video parameter when the first network quality data is updated to a third network quality data;

wherein the second target video parameter is determined from the third network quality data.

7. The method of claim 1, wherein the first video parameter comprises at least one of a bit rate and a resolution; the second video parameter comprises at least one of a bit rate and a resolution;

the first network quality data comprises at least one of: reference signal received power, reference signal received quality, received signal strength indication, signal to interference plus noise ratio.

8. The method of claim 6, wherein updating the first target video parameter to a second target video parameter when the first network quality data changes to a third network quality data comprises:

determining a third video parameter according to the third network quality data and the first feedback parameter of the video call;

determining the second target video parameter according to the third video parameter and the fourth video parameter;

wherein the first feedback parameter comprises at least one of: peak signal-to-noise ratio, structural similarity, delay feedback and frame loss feedback of the video call picture;

the fourth video parameter is determined by the second video call device according to fourth network quality data of the network environment where the second video call device is located and the second feedback parameter.

9. A video call method is applied to a second video call device, and is characterized by comprising the following steps:

sending the first request information to a first video call device, wherein the first request information comprises the second video parameter;

10. The method according to claim 9, wherein after the receiving the second request information sent by the first video call device, the method further comprises:

under the condition that the second network quality data is updated to fourth network quality data, determining a fourth video parameter according to the fourth network quality data;

sending third request information to the first video call device, wherein the third request information comprises the fourth video parameter;

wherein the third request information is used for the first video call device to update the first target video parameter according to the fourth video parameter.

11. A video call apparatus, comprising:

and the first establishing module is used for establishing the video call with the second video call device based on the first target video parameter under the condition of accepting the video call request.

12. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the video telephony method of any of claims 1-10.

13. A readable storage medium, on which a program or instructions are stored, which when executed by a processor, carry out the steps of the video call method according to any one of claims 1 to 10.