CN112653865A

CN112653865A - Video call processing method and device and electronic equipment

Info

Publication number: CN112653865A
Application number: CN202011551485.5A
Authority: CN
Inventors: 孙启明
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2020-12-24
Filing date: 2020-12-24
Publication date: 2021-04-13
Also published as: WO2022135291A1

Abstract

The application discloses a video call processing method and device and electronic equipment, belongs to the technical field of communication, and can solve the problem that the efficiency of video communication performed by a user through the electronic equipment can be reduced because the call process of the user can be influenced when the network quality is poor by the existing video communication technology. The application is applied to a first electronic device, and the method comprises the following steps: the first electronic equipment stops sending the video picture content of the first electronic equipment and sends first information to the second electronic equipment if the network connection parameter of the first electronic equipment meets a first condition under the condition that the first electronic equipment carries out video call with the second electronic equipment; the first information is information matched with real-time voice content collected by the first electronic equipment in the video call.

Description

Video call processing method and device and electronic equipment

Technical Field

The application belongs to the technical field of communication, and particularly relates to a video call processing method and device and electronic equipment.

Background

With the development of communication technology of electronic devices, electronic devices can establish calls with other electronic devices through networks by using more and more call modes, for example, sending instant voice messages or text messages through the networks, or performing voice calls through the networks, or performing video calls through the networks.

In the process of establishing a call with other electronic devices through a network, the call process can be guaranteed to be smooth only when the network quality reaches a predetermined requirement (for example, the network transmission speed is stable and the network bandwidth is sufficient), otherwise, the call quality cannot be maintained. Taking the video call as an example, in the process of using the network to perform the video call with the electronic device 2 by the electronic device 1, if the data transmission speed of the network is low, a video image may be blocked, and the electronic device 2 may not receive the video information and the voice information in the video information of the user of the electronic device 1 in time, even resulting in interruption of the video call.

According to the process, the existing video call technology can influence the call process of the user when the network quality is poor, so that the efficiency of the user for carrying out video call by using the electronic equipment can be reduced.

Disclosure of Invention

The embodiment of the application aims to provide a video call processing method, a video call processing device and electronic equipment, and the video call processing method, the video call processing device and the electronic equipment can solve the problem that the efficiency of video communication performed by a user by using the electronic equipment is reduced because the existing video communication technology can influence the call process of the user when the network quality is not good.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides a video call processing method, which is applied to a first electronic device, and the method includes: the first electronic equipment stops sending the video picture content of the first electronic equipment and sends first information to the second electronic equipment if the network connection parameter of the first electronic equipment meets a first condition under the condition that the first electronic equipment carries out video call with the second electronic equipment; the first information is information matched with real-time voice content collected by the first electronic equipment in the video call.

In a second aspect, an embodiment of the present application provides a video call processing apparatus, where the apparatus includes: a sending module; the sending module is configured to, when a video call is performed between the first electronic device and a second electronic device, stop sending video frame content of the first electronic device and send first information to the second electronic device if a network connection parameter of the first electronic device meets a first condition; the first information is information matched with real-time voice content collected by the first electronic equipment in the video call.

In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.

In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.

In this embodiment of the application, when a video call is performed between a first electronic device and a second electronic device, if a network connection parameter of the first electronic device meets a first condition, the first electronic device stops sending video picture content of the first electronic device, and sends information (i.e., first information) matching real-time voice content collected by the first electronic device in the video call to the second electronic device. Therefore, under the condition that the network connection parameters of the first electronic equipment are not enough to support and transmit the video picture content, the video call can be maintained firstly, and the continuous transmission of the call information content in the video call process is ensured by stopping transmitting the video picture content and simultaneously transmitting the first information matched with the real-time voice content in the video call, so that the problems of delayed receiving and blockage of the video call information content and reconnection required for automatic hanging up of the video call caused by poor network quality in the video call of a user are solved, the video call efficiency is improved in an auxiliary manner, and the information transmission efficiency, the use smoothness and the use experience of the user in using the video call are improved.

Drawings

Fig. 1 is a schematic diagram of a communication system of a first electronic device and a second electronic device according to an embodiment of the present application;

fig. 2 is a schematic structural diagram of a first electronic device according to an embodiment of the present application;

fig. 3 is a schematic flowchart of a video call processing method according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of a video call processing apparatus according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;

fig. 6 is a second schematic structural diagram of an electronic device according to an embodiment of the present disclosure.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

The terms in the embodiments of the present application are explained below as follows:

1. video call

In the related art, as shown in fig. 1, when electronic devices are in a video call, the electronic devices need to be connected to a server, and then video content to be sent is sent through a base station, and then sent to other electronic devices by the base station, and the video content sent by other electronic devices is received from the base station, so as to view the video content sent by other electronic devices.

As shown in fig. 1, in a case where the electronic device includes an electronic device 1 and an electronic device, the electronic device 1 is connected to a base station a within a signal coverage of the base station a, the electronic device 2 is connected to the base station B within a signal coverage of the base station B, and the base station a and the base station B can transmit communication data to each other. In the process that the electronic device 1 is connected to the base station a, the electronic device 1 includes an uplink transmission link 11 (hereinafter, referred to as a "link 11") and a downlink transmission link 12 (hereinafter, referred to as a "link 12"), and similarly, in the process that the electronic device 2 is connected to the base station B, the electronic device 2 includes an uplink transmission link 13 (hereinafter, referred to as a "link 13") and a downlink transmission link 14 (hereinafter, referred to as a "link 14"), and in the data transmission process of the above-mentioned link 11, link 12, link 13, and link 14, if any link is not smooth, for example, when the network transmission speed is reduced and the link 11 cannot upload enough video data in unit time, the base station a of the electronic device 1 will not receive complete video data, and the base station B and the electronic device 2 will also not receive complete video data. That is, the video call between the electronic device 1 and the electronic device 2 can be ensured to be continuous only when the data transmission process of the link 11, the link 12, the link 13 and the link 14 is smooth and has no abnormality.

It is understood that the base station a and the base station B may be different base stations, for example, in a case where the distance between the electronic device 1 and the electronic device 2 is long, video data needs to be transmitted through different base stations; the base station a and the base station B may be the same base station, for example, the electronic device 1 and the electronic device 2 may be close to each other, and when the video data is under the coverage of the same base station, the video data may be transmitted through the same base station.

It should be noted that, in the following embodiments in the present application, when data information is transmitted between electronic devices through different base stations, it is default that network connection between the base stations is normal, that is, data information between the base stations can be normally transmitted, and there is no abnormality, for example, data information cannot be transmitted due to a low network speed.

2. Electronic device comprising a first screen and a second screen

The embodiment of the application is applied to the electronic equipment comprising the first screen and the second screen. The two screens may be two screens formed by foldable electronic equipment, and specifically, the foldable electronic equipment may be foldable electronic equipment formed by two pieces of electronic equipment in a hinged manner, or foldable electronic equipment including a foldable display screen; the two screens may also be two screens included in the electronic device with dual screens, specifically, the dual screens may be two screens located on the same side of the electronic device, may also be two screens located on the front side and the back side of the electronic device respectively, and may also be one screen located on the front side of the electronic device and one screen embedded in the electronic device and capable of displaying in a telescopic manner relative to the electronic device.

Illustratively, as shown in fig. 2 (a), the electronic device may include a first screen 21 and a retractable screen 22 disposed at the back of the first screen, and the retractable screen 22 may have a function of extending and retracting from the electronic device. In an example, a telescopic motor and a telescopic slide rail may be provided in the electronic device, and when the electronic device needs to control the extension and retraction of the telescopic screen 22, the telescopic screen 22 may be controlled to perform the extending and retracting actions along the track of the telescopic slide rail.

For example, as shown in fig. 2 (b), the electronic device may send an extension command to the retractable screen to control the retractable screen 22 to rise, may send a retraction command to the retractable screen 22 to control the retractable screen to retract to the electronic device, may send an open command to the retractable screen 22 to control the retractable screen 22 to open a display function, and may send a display command to the retractable screen 22 to control the retractable screen 22 to display specific display contents.

3. Request To Send (RTS) and Clear To Send (CTS)

RTS and CTS are two signals in the hardware flow control of MODEM, and RTS and CTS are independent signals. Wherein, RTS is the input end of the module, is used for the Micro Control Unit (MCU) to notify the module, whether MCU is ready, whether the module can send information to MCU, the effective level of RTS is low; the CTS is the output end of the module and is used for the module to inform the MCU whether the module is ready or not, whether the MCU can send information to the module or not, and the effective level of the CTS is low.

The following describes in detail the video call processing provided by the embodiments of the present application through specific embodiments and application scenarios thereof with reference to the accompanying drawings.

The video call processing method provided by the embodiment of the application can be applied to a scene of video call between the first electronic device and other electronic devices.

In a scenario of performing a video call between a first electronic device and another electronic device, assuming that the first electronic device is the electronic device 1 and the other electronic devices are the electronic devices 2, when the electronic device 1 performs a video call with the electronic device 2, if a network connection parameter of the electronic device 1, that is, a network transmission speed is lower than a minimum transmission speed required for transmitting video content, the video content cannot be continuously uploaded to a server or continuously received from the server to the electronic device 2, so that a video content jam occurs in a display screen of the electronic device 1, and a video connection with the electronic device 2 is forced to be interrupted. Therefore, under the condition that the network connection parameters do not meet the requirement of transmitting the complete content of the video, the user can use the electronic equipment to carry out video call discontinuously, and the problems of low efficiency and poor use experience are solved.

In the video call processing method provided in the embodiment of the present application, when a video call is performed between the electronic device 1 and the electronic device 2, if a network connection parameter of the electronic device 1 meets a first condition, for example, a network transmission speed is lower than a predetermined threshold, the electronic device 1 stops sending video picture content of the electronic device 1, and sends information (that is, first information) matching real-time voice content collected by the electronic device 1 in the video call to the electronic device 2. Therefore, under the condition that the network connection parameters of the electronic equipment 1 are not enough to support and transmit the video picture content, the video call can be maintained firstly, and the continuous transmission of the call information content in the video call process is ensured by stopping transmitting the video picture content and simultaneously transmitting the information (namely the first information) matched with the real-time voice content in the video call, so that the problems that the video call information content is delayed and blocked due to poor network quality in the video call of a user and the video call is automatically hung up and needs to be reconnected are solved, the video call efficiency is improved in an auxiliary manner, and the information transmission efficiency, the use smoothness and the use experience of the user in using the video call are improved.

As shown in fig. 3, the present embodiment is applied to a first electronic device, and the method for positioning an electronic device includes the following steps 201:

step 201: the video call processing device stops sending the video picture content of the first electronic equipment and sends first information to the second electronic equipment if the network connection parameter of the first electronic equipment meets a first condition under the condition of carrying out video call between the first electronic equipment and the second electronic equipment.

In an embodiment of the application, the first information is information matched with real-time voice content collected by the first electronic device in the video call.

In this embodiment, the first information may be text information or voice information, where the voice information may be real-time voice information.

In this embodiment of the application, the video call may be a video call between the first electronic device and the second electronic device using any application. The application of the video call can transmit the video call content of the user of the first electronic device and the user of the second electronic device in real time, wherein the video call content comprises real-time voice call content and real-time video picture content, the electronic devices can synchronously transmit the real-time voice call content and the real-time video picture content, the real-time voice call content is acquired by the electronic devices through the microphones, and the real-time video picture content is acquired by the electronic devices through the cameras.

In this embodiment of the application, the network connection parameter may be a parameter that can affect video data transmission after the first electronic device establishes a network connection with the second electronic device.

In one example, the network connection parameter may be a network transmission speed, a network stability, a network bandwidth, and the like.

In an embodiment of the present application, the first condition may be that the network connection parameter of the first electronic device is insufficient to support video data transmission.

In an embodiment of the present application, the first condition may be a preset threshold. The preset threshold may be preset by the electronic device or may be set by a user in a self-defined manner, which is not limited in the embodiment of the present application.

It is understood that the preset threshold may be set in the electronic device directly when the electronic device leaves the factory after being obtained through a data simulation experiment in a laboratory.

In an example, when the network connection parameter is a network transmission speed, if the network transmission speed of the first electronic device is lower than a preset network transmission speed threshold, the first condition is satisfied, the electronic device is triggered to stop sending the video frame content of the first electronic device, and first information is sent to the second electronic device.

In an example, when the network connection parameter is network stability, if the network stability of the first electronic device is lower than a preset stability threshold, the first condition is satisfied, the electronic device is triggered to stop sending the video frame content of the first electronic device, and first information is sent to the second electronic device.

In an example, when the network connection parameter is a network bandwidth, if the network bandwidth of the first electronic device is lower than a preset network bandwidth threshold, the first condition is satisfied, the electronic device is triggered to stop sending the video frame content of the first electronic device, and first information is sent to the second electronic device.

It can be understood that, if any one of the network connection parameters satisfies the first condition, the first electronic device is triggered to stop sending the video frame content of the first electronic device, and send the first information to the second electronic device.

In this embodiment of the application, the first electronic device may stop sending the video picture content of the first electronic device by not capturing the video picture any more.

In one example, when the network connection parameter of the first electronic device meets a first condition, the first electronic device will be triggered to stop capturing video pictures through the camera while maintaining the current video call connection. In the process of maintaining the video call connection, a still picture captured by the first electronic device in the last frame before the video picture capture is stopped may be displayed on the display interface of the first electronic device. It can be understood that the user may perform the same partial operation on the interface where the still picture is located as the call interface of the video call, for example, drag the interface where the still picture is located to move to any position of the display interface of the electronic device, and scale down or scale up the interface where the still picture is located.

It is understood that, in the case where the first electronic device stops transmitting the video picture content of the first electronic device, there is a case where the network connection parameter thereof cannot receive the video picture content of the second electronic device to which the base station transmits, and therefore, in this case, the first electronic device will be forced to stop receiving the video picture content at the same time. Meanwhile, there is also a case where the network connection parameter can only be used to support unidirectional transmission of the video picture content, in which case the first electronic device selects to stop transmitting the video picture content of the first electronic device and only receives the video picture content transmitted by the second electronic device.

In this embodiment of the application, the first electronic device may send the first information to the second electronic device in real time, or may send the first information in non-real time. The manner of sending the first information depends on the specific situation of the network connection, and generally, the specific situation of the network connection can be judged through the network connection parameters. For example, the first information is sent in non-real time when the network connection parameter is lower than a first threshold set by a user, and the first information is sent in real time when the network connection parameter is lower than the first threshold set by the user and higher than a second threshold set by the user.

Example 1: assuming that the first electronic device is the electronic device 1 and the second electronic device is the electronic device 2, when the electronic device 1 and the electronic device 2 perform a video call, if the network transmission speed of the electronic device 1 is lower than a preset network transmission speed threshold, the electronic device 1 stops capturing video picture content and stops sending video picture content, maintains the current video call, keeps a last frame of image before the video picture content is stopped being captured on a display interface, and sends real-time voice content of the first electronic device to the second electronic device.

In the video call processing method provided in the embodiment of the present application, when a video call is performed between a video call processing apparatus and a second electronic device, if a network connection parameter of the video call processing apparatus satisfies a first condition, the video call processing apparatus stops sending video picture content of the video call processing apparatus, and sends first information indicating real-time voice content collected by the video call processing apparatus in the video call to the second electronic device. Therefore, under the condition that the network connection parameters of the video call processing device are not enough to support and transmit the video picture content, the video call can be maintained firstly, and the continuous transmission of the call information content in the video call process is ensured by stopping transmitting the video picture content and simultaneously transmitting the information (namely the first information) matched with the real-time voice content in the video call, so that the problems of delayed receiving and blocking of the video call information content and reconnection required for automatic hanging up of the video call caused by poor network quality in the video call of a user are solved, the video call efficiency is improved in an auxiliary manner, and the information transmission efficiency, the use smoothness and the use experience of the user in using the video call are improved.

Optionally, in this embodiment of the application, if the network connection parameter of the first electronic device satisfies the first condition, the video call processing method provided in this embodiment of the application may further include the following step 202:

step 202: and the video call processing device stops receiving the video picture content of the second electronic equipment and/or stops transmitting the real-time voice content in the video call between the first electronic equipment and the second electronic equipment.

For example, if the network connection parameter of the first electronic device satisfies the first condition, the first electronic device may stop receiving the video frame content of the second electronic device, and/or stop transmitting the real-time voice content in the video call between the first electronic device and the second electronic device.

Illustratively, in the case that the network connection parameter of the first electronic device can support that the transmission between the first electronic device and the second electronic device is real-time voice content, but the transmission of the video picture content cannot support, stopping receiving the video content of the second electronic device and transmitting the real-time voice content with the second electronic device; and under the condition that the network connection parameter of the first electronic equipment can not support that the transmission between the first electronic equipment and the second electronic equipment is real-time voice content, stopping transmitting the real-time voice content in the video call between the first electronic equipment and the second electronic equipment, and further transmitting the video call content in other modes.

In an example, the video call processing apparatus may determine that the first electronic device stops receiving the video frame content of the second electronic device and/or stops transmitting the real-time voice content in the video call between the first electronic device and the second electronic device by setting different preset thresholds for the network connection parameters.

For example, after determining that the first electronic device stops sending the video frame content of the second electronic device, stops receiving the video frame content of the second electronic device, and/or stops transmitting the real-time voice content in the video call between the first electronic device and the second electronic device, the video call processing apparatus may set a priority policy according To the traffic characteristics by controlling the serial port and the traffic priority according To the determination result of the video call processing apparatus, and implement hardware flow control by sending a request (request To Send, RTS) and a Clear To Send (CTS) To further control the content sent by the first electronic device in the video call. For example, when the video call processing apparatus determines to transmit only the real-time voice content in the video content, the first electronic device may set a priority policy for preferentially transmitting the real-time voice according to the traffic characteristics of the real-time voice by controlling the serial port and the traffic priority according to the determination result, and then implement hardware flow control by RTS and CTS, and finally implement transmission of only the real-time voice content in the video content during the video call.

Example 1, when the network connection parameter is a network transmission speed, a first threshold and a second threshold may be set for the network transmission speed, where the first threshold is greater than the second threshold, the first threshold is a lowest network transmission speed that satisfies transmission of real-time video content, and the second threshold is a lowest network transmission speed that satisfies transmission of real-time voice content, and when the first electronic device detects that the network transmission speed with the base station is lower than the first threshold and higher than the second threshold, the transmission of real-time video picture content is stopped, a video call state is maintained, and only real-time voice content is transmitted to the second electronic device; and when the first electronic equipment detects that the network transmission speed between the first electronic equipment and the base station is lower than a second threshold value, stopping transmitting the real-time video picture content and the real-time voice content, keeping the video call state, and transmitting only first information for indicating the real-time voice content to the second electronic equipment.

It can be understood that other network connection parameters, for example, the network stability and the network bandwidth are the same as the network transmission speed in example 1, the video call processing apparatus may set and divide two preset thresholds for the network stability and the network bandwidth, where the two preset thresholds are respectively capable of meeting the minimum network transmission speed for transmitting the real-time video content and the minimum network transmission speed for transmitting the real-time voice content, and determine the processing mode of the video call processing apparatus for the video call according to the relationship between the network connection parameter and the preset threshold when the network connection parameter of the first electronic device meets the first condition.

Therefore, the first electronic device and the second electronic device can be guaranteed to detect and trigger the first electronic device and the second electronic device to continuously transmit information under the condition of keeping the video call through other information transmission modes under the condition that the network connection parameters are abnormal, and the use experience and the use efficiency of the video call of a user are improved.

Optionally, in this embodiment of the application, before the step 201 of sending the first information to the second electronic device, the video call processing method provided in this embodiment of the application may further include the following steps 203 and 204:

step 203: the video call processing device acquires real-time voice content in the video call.

Step 204: and the video call processing device converts the real-time voice content into first target character information.

Illustratively, the first information is the first target character information.

For example, in the case that the network connection parameters of the video call processing device are not sufficient to support transmission of real-time voice content but can support transmission of real-time text information, the video call processing device may convert the acquired real-time voice content into the first target text information and send the first target text information to the second electronic device.

For example, the video call processing device may collect real-time voice content through a microphone in the electronic device, and then convert the real-time voice content into data information, so that the video call processing device obtains the real-time voice content in the video call.

For example, after the video call processing device obtains the real-time voice content in the video call, the real-time voice content may be converted into the first target text information through a voice recognition technology.

In an example, a voice database and semantic grammar rules corresponding to the voice recognition technology may be pre-stored in the electronic device, and after the real-time voice content is obtained, the video call processing device may obtain text information corresponding to the voice content in the voice database thereof, and process the obtained text information according to the semantic grammar rules, so as to finally form first target text information corresponding to the real-time voice content.

For example, after the step 204, the video call processing method provided in the embodiment of the present application may further include the following step 204 a:

step 204 a: and the video call processing device displays a character window on the current display interface.

Illustratively, the text window is used for displaying the first target text information.

Example 2: with reference to the foregoing example 1, in a case where the electronic device 1 and the electronic device 2 perform a video call, if the network transmission speed of the electronic device 1 is lower than a network transmission speed threshold that can support real-time transmission of real-time voice content but can support transmission of real-time text information, the electronic device 1 stops capturing video frame content and stops sending video frame content, and maintains the current video call. Meanwhile, the electronic device 1 collects real-time voice content of a user of the electronic device 1 in a video call through a microphone, converts the real-time voice content into first target character information corresponding to the real-time voice content, displays a character window for displaying characters in a suspension mode on a current display interface, and displays the first target character information sent to the electronic device 2 in real time in the character window.

Therefore, under the condition that the network connection parameters of the first electronic equipment are not enough to maintain video content transmission but can support real-time text transmission, real-time speech of a user can be converted into real-time text to be sent to the second electronic equipment through the speech recognition technology, so that the video call is kept without hang-up, the real-time transmission of information is ensured to be uninterrupted, and the efficiency of the user in using the video call is improved.

Optionally, in this embodiment of the present application, after the step 204, the video call processing method provided in this embodiment of the present application may further include the step 205:

step 205: the video call processing device caches the first target character information.

Further, on the basis of the step 205, in the video call processing method provided in the embodiment of the present application, the sending, by the video call processing apparatus in the step 201, the first information to the second electronic device may further include the following step 201 a:

step 201 a: and the video call processing device sends the first target character information to the second electronic equipment.

For example, if the network connection parameter of the first electronic device satisfies a second condition, the video call processing apparatus sends the first target text message to the second electronic device.

It is understood that the video processing apparatus may send the first target text information to the second electronic device when the second condition is satisfied and the first condition is not satisfied. Wherein the first condition is: the network connection parameters can support real-time voice transmission and meet the requirement of real-time text transmission; the second condition is: the second condition may be that the network connection parameter can support sending real-time text messages.

Further, when the network connection parameter of the video processing apparatus can only be used to support the transmission of the implementation text, the first target text information may be sent to the second electronic device. For example, when the network connection parameter is a network transmission speed, the network transmission speed can only satisfy the requirement of transmitting real-time text information but cannot transmit real-time voice information, and the first information is first target text information corresponding to real-time voice content.

Illustratively, under the condition that the network connection parameters of the video call processing device are not enough to support transmission of real-time text information, the video call processing device may convert the acquired real-time voice content into first target text information, temporarily cache the first target text information in the first electronic device, and send the cached first target text information to the second electronic device under the condition that the network connection parameters can support transmission of the real-time text information, so as to assist in improving the video call efficiency and ensure the continuity of video call and information transmission.

Illustratively, after step 201a, the same steps as step 204a in the foregoing may be included.

Example 3: with reference to the foregoing example 2, when the electronic device 1 and the electronic device 2 perform a video call, and if the network transmission speed of the electronic device 1 is lower than the network transmission speed threshold capable of supporting transmission of real-time text information, the electronic device 1 converts the real-time voice content into first target text information corresponding to the real-time voice content, and then caches the first target text information in the electronic device 1, and when the network transmission speed is recovered to the network transmission speed threshold capable of supporting transmission of real-time text information, displays a text window for displaying text in a floating manner on the current display interface, and displays the first target text information sent to the electronic device 2 in the text window.

Therefore, if the user cannot receive the network in a short time (for example, the video call is carried out in an elevator) in the process of carrying out the video call by using the electronic equipment, the video call can be maintained firstly, simultaneously, the real-time voice content of the user is completely converted into text information to be cached in the electronic equipment, and the text information is sent after the network is recovered, so that the video call can be maintained without hanging up the video call, the user does not need to repeatedly narrate the narrated content, the video call efficiency is improved in an auxiliary manner, and the user experience of the user in using the video call is improved.

Optionally, in this embodiment of the application, if the network connection parameter of the first electronic device meets the first condition, the video call processing method provided in this embodiment of the application may further include the following step 206:

step 206: and the video call processing device receives second information sent by the second electronic equipment.

Illustratively, the second information is used to indicate real-time voice content collected by the second electronic device in the video call.

For example, the second information may be text information or voice information, which is not limited in this embodiment of the application.

Optionally, in this embodiment of the application, if the network connection parameter of the first electronic device meets the first condition, the video call processing method provided in this embodiment of the application may further include the following step 207:

step 207: and the video call processing device receives the second target character information sent by the second electronic equipment.

Illustratively, the second target text information is used to represent real-time voice content collected by the second electronic device in the video call.

In an example, when the network connection parameter of the first electronic device meets the first condition and sends the first target text information to the second electronic device, the second electronic device also correspondingly switches the video call mode to the same video call mode as the first electronic device, that is, to convert the real-time voice content into text information and send the text information to the first electronic device, and then the video call processing device receives the second target text information sent by the second electronic device.

For example, the first target text information and the second target text information may be displayed in a text window for displaying text information on the current display interface.

Example 4: with reference to the foregoing example 2, when the electronic device 1 converts the real-time voice content into the first target text information corresponding to the real-time voice content, and displays a text window for displaying text in a floating manner on the current display interface, and displays the received second target text information sent by the electronic device 2 in the text window when the first target text information sent to the electronic device 2 in real time is displayed in the text window.

Therefore, under the condition that the network connection parameters are not enough to support video content transmission, the information transmission of the video call can be completed in an auxiliary mode through character information transmission, so that the use experience of the user in using the video call is improved, and the efficiency of the user in using the electronic equipment is improved.

Optionally, in this embodiment of the present application, the first electronic device includes a first screen and a second screen, and the video call processing method provided in this embodiment of the present application may further include the following steps 208 and 209:

step 208: and the video call processing device starts a second screen if the network connection parameter of the first electronic equipment meets the first condition under the condition that the first screen displays the call interface of the video call.

Step 209: and the video call processing device displays the first target character information or the second target character information on the second screen.

For example, the foregoing detailed description of the electronic device including the first screen and the second screen may refer to the foregoing contents, and will not be described herein again.

Illustratively, the above: the video call processing apparatus may start the display function of the second screen.

In an example, when a first electronic device includes two display screens on the same side or different sides, and the second screen is one of the display screens, if a network connection parameter of the first electronic device does not satisfy the first condition, the second screen is in a screen-off state, and if the network connection parameter of the first electronic device does not satisfy the first condition, the second screen is started to display the first target text information and the second target text information.

In another example, when the first electronic device includes a front first screen and a second screen embedded in the first electronic device, if the network connection parameter of the first electronic device does not satisfy the first condition, the second screen is in a screen-off state and an embedded state in the electronic device, and if the network connection parameter of the first electronic device does not satisfy the first condition, the second screen is activated, extends out from the first electronic device, and receives the first target text message or the second target text message.

Therefore, the first electronic equipment can display the text information in the second screen of the first electronic equipment under the condition that the first electronic equipment meets the first condition and cannot send real-time voice content and real-time video picture content, so that under the condition that a user can check real-time information in a video call, the first screen can be used for executing other required operations, the use experience of the user is enriched, and the first electronic equipment is better assisted to complete information transmission in the video call.

It should be noted that, in the video call processing method provided in the embodiment of the present application, the execution main body may be a video call processing apparatus, or a control module in the video call processing apparatus for executing the video call processing method. In the embodiment of the present application, a video call processing apparatus is taken as an example to execute a video call processing method, and the video call processing apparatus provided in the embodiment of the present application is described.

Fig. 4 is a schematic structural diagram of a video call processing apparatus according to an embodiment of the present application. As shown in fig. 4, the apparatus 600 includes: a sending module 601; the sending module 601 is configured to, when a video call is performed between the first electronic device and the second electronic device, stop sending video frame content of the first electronic device and send first information to the second electronic device if a network connection parameter of the first electronic device meets a first condition; the first information is information matched with real-time voice content collected by the first electronic equipment in the video call.

In the video call processing apparatus provided in the embodiment of the present application, when a video call is performed between the video call processing apparatus and a second electronic device, if a network connection parameter of the video call processing apparatus satisfies a first condition, the video call processing apparatus stops sending video picture content of the video call processing apparatus, and sends information (i.e., first information) matching real-time voice content collected by the video call processing apparatus in the video call to the second electronic device. Therefore, under the condition that the network connection parameters of the video call processing device are not enough to support and transmit the video picture content, the video call can be maintained firstly, and the continuous transmission of the call information content in the video call process is ensured by stopping transmitting the video picture content and simultaneously transmitting the first information matched with the real-time voice content in the video call, so that the problems of delayed receiving and blocking of the video call information content and reconnection required for automatic hanging up of the video call caused by poor network quality in the video call of a user are solved, the video call efficiency is improved in an auxiliary manner, and the information transmission efficiency, the use smoothness and the use experience of the video call of the user are improved.

Optionally, in this embodiment of the application, if the network connection parameter of the first electronic device satisfies the first condition, the apparatus 600 further includes: an execution module 602; the execution module 602 is configured to stop receiving the video frame content of the second electronic device, and/or stop transmitting the real-time voice content in the video call between the first electronic device and the second electronic device.

Optionally, in this embodiment of the present application, the apparatus 600 further includes: an acquisition module 603 and a conversion module 604; the obtaining module 603 is configured to obtain real-time voice content in the video call; the converting module 604 is configured to convert the real-time speech content acquired by the acquiring module 603 into first target text information; wherein the first information is the first target character information.

Optionally, in this embodiment of the application, the apparatus 600 further includes a cache module 605; the cache module 605 is specifically configured to cache the first target text information; the sending module 601 is specifically configured to send the first target text information cached by the caching module 605 to the second electronic device.

Optionally, in this embodiment of the application, the apparatus 600 further includes a receiving module 606, if the network connection parameter of the first electronic device meets the first condition; the receiving module 606 is configured to receive second target text information sent by the second electronic device; the second target text information is used for representing real-time voice content collected by the second electronic equipment in the video call.

Optionally, in this embodiment of the application, the apparatus 600 further includes a starting module 607 and a display module 608, and the first electronic device includes a first screen and a second screen; the starting module 607 is configured to, when the first screen displays a call interface of the video call, start a second screen if the network connection parameter of the first electronic device meets the first condition; the display module 608 is configured to display the first target text message or the second target text message on the second screen after the starting module 607 is started.

The video call processing apparatus in the embodiment of the present application may be an apparatus, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.

The video call processing apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The video call processing apparatus provided in the embodiment of the present application can implement each process implemented by the method embodiments of fig. 1 to fig. 3, and is not described herein again to avoid repetition.

It should be noted that, as shown in fig. 4, modules that are necessarily included in the video call processing apparatus 600 are illustrated by solid line boxes, such as a sending module 601; modules that may or may not be included in the video call processing apparatus 600 are illustrated with dashed boxes, as is the execution module 602.

Optionally, as shown in fig. 5, an electronic device 500 is further provided in this embodiment of the present application, and includes a processor 501, a memory 502, and a program or an instruction stored in the memory 502 and executable on the processor 501, where the program or the instruction is executed by the processor 501 to implement each process of the video call processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.

Fig. 6 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 100 includes, but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110. Wherein the user input unit 107 includes: touch panel 1071 and other input devices 1072, display unit 106 including display panel 1061, input unit 104 including image processor 1041 and microphone 1042, memory 109 may be used to store software programs (e.g., an operating system, application programs needed for at least one function), and various data.

Those skilled in the art will appreciate that the electronic device 100 may further comprise a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 6 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.

When the electronic device 100 is a first electronic device, the radio frequency unit 101 is configured to, when a video call is performed between the first electronic device 100 and a second electronic device, stop sending video screen content of the first electronic device 100 and send first information to the second electronic device if a network connection parameter of the first electronic device 100 meets a first condition; the first information is used to indicate real-time voice content collected by the first electronic device 100 in the video call.

In this embodiment of the present application, when a video call is performed between a first electronic device and a second electronic device, if a network connection parameter of the first electronic device meets a first condition, the first electronic device stops sending video picture content of the first electronic device, and sends information (first information) matching real-time voice content collected by the first electronic device in the video call to the second electronic device. Therefore, under the condition that the network connection parameters of the first electronic equipment are not enough to support and transmit the video picture content, the video call can be maintained firstly, and the continuous transmission of the call information content in the video call process is ensured by stopping transmitting the video picture content and simultaneously transmitting the first information matched with the real-time voice content in the video call, so that the problems of delayed receiving and blocking of the video call information content and reconnection required for automatic hanging up of the video call caused by poor network quality in the video call of a user are solved, the video call efficiency is improved in an auxiliary manner, and the information transmission efficiency, the use smoothness and the use experience of the user in using the video call are improved.

Optionally, if the network connection parameter of the first electronic device 100 meets the first condition, the processor 110 is configured to stop receiving the video frame content of the second electronic device, and/or stop transmitting the real-time voice content in the video call between the first electronic device and the second electronic device.

Optionally, the processor 110 is further configured to obtain real-time voice content in the video call; the processor 110 is further configured to convert the real-time voice content into first target text information; wherein the first information is the first target character information.

Optionally, the processor 110 is further configured to cache the first target text information; the radio frequency unit 101 is specifically configured to send the first target text message to the second electronic device if the network connection parameter of the first electronic device meets a second condition.

Optionally, if the network connection parameter of the first electronic device meets the first condition, the user input unit 107 is configured to receive second target text information sent by the second electronic device; the second target text information is used for representing real-time voice content collected by the second electronic equipment in the video call.

Optionally, the first electronic device includes a first screen and a second screen, and the processor 110 is further configured to, when the first screen displays a call interface of the video call, start the second screen if the network connection parameter of the first electronic device meets the first condition; a display unit 106, configured to display the first target text information or the second target text information on the second screen.

It should be understood that, in the embodiment of the present application, the input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the Graphics Processing Unit 1041 processes image data of a still picture or a video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 107 includes a touch panel 1071 and other input devices 1072. The touch panel 1071 is also referred to as a touch screen. The touch panel 1071 may include two parts of a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 109 may be used to store software programs as well as various data including, but not limited to, application programs and an operating system. The processor 110 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the video call processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement each process of the above video call processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, the description is omitted here.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A video call processing method is applied to a first electronic device, and is characterized by comprising the following steps:

under the condition of video call between the first electronic equipment and the second electronic equipment, if the network connection parameter of the first electronic equipment meets a first condition, stopping sending the video picture content of the first electronic equipment to the second electronic equipment, and sending first information to the second electronic equipment;

the first information is information matched with real-time voice content collected by the first electronic equipment in the video call.

2. The method of claim 1, wherein if the network connection parameter of the first electronic device satisfies the first condition, the method further comprises:

and stopping receiving the video picture content of the second electronic equipment, and/or stopping transmitting the real-time voice content in the video call between the first electronic equipment and the second electronic equipment.

3. The method of claim 1, wherein prior to sending the first information to the second electronic device, the method further comprises:

acquiring real-time voice content in the video call;

converting the real-time voice content into first target character information;

wherein the first information is the first target character information.

4. The method of claim 3, wherein after converting the real-time speech content into the first target text message, the method further comprises:

caching the first target character information;

the sending of the first information to the second electronic device includes:

and sending the first target text message to the second electronic equipment.

5. The method of claim 1, further comprising:

receiving second target text information sent by the second electronic equipment;

the second target text information is used for representing real-time voice content collected by the second electronic equipment in the video call.

6. The method of claim 3 or 5, wherein the first electronic device comprises a first screen and a second screen, the method further comprising:

starting a second screen under the condition that the first screen displays a call interface of the video call;

and displaying the first target text information or the second target text information on the second screen.

7. A video call processing apparatus, comprising: a sending module;

the sending module is used for stopping sending the video picture content of the first electronic equipment and sending first information to the second electronic equipment if the network connection parameter of the first electronic equipment meets a first condition under the condition of video call between the first electronic equipment and the second electronic equipment;

8. The apparatus of claim 7, wherein if the network connection parameter of the first electronic device satisfies the first condition, the apparatus further comprises: an execution module;

the execution module is configured to stop receiving the video picture content of the second electronic device, and/or stop transmitting the real-time voice content in the video call between the first electronic device and the second electronic device.

9. The apparatus of claim 7, further comprising: the device comprises an acquisition module and a conversion module;

the acquisition module is used for acquiring real-time voice content in the video call;

the conversion module is used for converting the real-time voice content acquired by the acquisition module into first target character information;

wherein the first information is the first target character information.

10. The apparatus of claim 9, further comprising a caching module;

the cache module is used for caching the first target character information;

the sending module is specifically configured to send the first target text information cached by the caching module to the second electronic device.

11. The apparatus of claim 7, further comprising a receiving module, configured to, if the network connection parameter of the first electronic device satisfies the first condition;

the receiving module is used for receiving second target character information sent by the second electronic equipment;

12. The apparatus of claim 9 or 11, further comprising an activation module and a display module, wherein the first electronic device comprises a first screen and a second screen;

the starting module is used for starting a second screen if the network connection parameter of the first electronic equipment meets the first condition under the condition that the first screen displays the call interface of the video call;

and the display module is used for displaying the first target character information or the second target character information on the second screen after the starting module is started.

13. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the video call processing method of any of claims 1-6.

14. A readable storage medium, on which a program or instructions are stored, which when executed by a processor, implement the steps of the video call processing method according to any one of claims 1 to 6.