CN117041465A

CN117041465A - Video call optimization method, electronic equipment and storage medium

Info

Publication number: CN117041465A
Application number: CN202310887032.7A
Authority: CN
Inventors: 金娇娇
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2023-07-18
Filing date: 2023-07-18
Publication date: 2023-11-10

Abstract

The application provides a video call optimization method, electronic equipment and a storage medium, and relates to the technical field of terminals. Wherein the method comprises the following steps: firstly, after a first terminal device of a first user receives an incoming call of a second terminal device of a second user, establishing a video call between the first user and the second user; displaying video call pictures corresponding to the first user and the second user on a screen interface of the first terminal device; then when the first user exits the video call interface to the desktop and returns to the video call interface, acquiring the call state of the current first terminal device; judging whether the call state is an incoming call state or not; if not, issuing an instruction for recovering the video stream so as to acquire video call pictures corresponding to the current first user and the second user respectively based on the instruction, and displaying the video call pictures and the video call pictures on a screen interface of the first terminal device, thereby avoiding the loss of the video picture of the second user and improving the video call experience of the first user.

Description

Video call optimization method, electronic equipment and storage medium

Technical Field

The present application relates to the field of terminal technologies, and in particular, to a method for optimizing a video call, an electronic device, and a storage medium.

Background

With the continuous breakthrough of artificial intelligence technology and the increasing popularization of various terminal devices, mobile communication plays an important role in daily work and life of people. People can conduct video call through terminal equipment more.

However, at present, after a user receives a video call through a terminal device, a video color vibration picture is usually played first, then when a situation that a call interface is exited to a desktop and then a call interface is returned occurs after the video call is answered, the video picture of an opposite-end user performing video call with the user disappears, and the video call experience of the user is affected.

Disclosure of Invention

In order to solve the problems, the application provides a video call optimizing method, electronic equipment and a storage medium, and aims to avoid the situation that a video picture disappears when a user performs video call so as to improve the video call experience of the user.

In a first aspect, the present application provides a method for optimizing a video call, the method comprising: firstly, after a first terminal device of a first user receives an incoming call of a second terminal device of a second user, establishing a video call between the first user and the second user; displaying video call pictures corresponding to the first user and the second user on a screen interface of the first terminal device; then when the first user exits the video call interface to the desktop (performs operations such as checking weather or short messages, etc.), and returns to the video call interface, the call state of the current first terminal device is obtained; judging whether the call state is an incoming call state, if so, judging whether the call state is ringing; if not, the first terminal equipment is in the non-video color vibration mode, an instruction for recovering the video stream can be issued, so that video call pictures corresponding to the current first user and the second user are obtained based on the instruction, and the obtained video call pictures corresponding to the current first user and the second user are displayed on a screen interface of the first terminal equipment.

In the method for optimizing video call, when the first user exits the video call interface to the desktop (performs operations such as viewing weather or short messages, etc.), and returns to the video call interface, the embodiment does not directly read the value corresponding to the video color vibration capability (extra_crs_type) in framework telecomcall, but obtains the current call state of the first electronic device from framework telecom call, and when it is determined that the call state is not incoming call (such as not ringing), issues an instruction for recovering the video stream to the bottom modem, so as to recover and display the video call picture of the second user at the opposite end on the screen interface of the first electronic device, thereby avoiding the situation that the video picture of the second user disappears, and further improving the video call experience of the first user.

In one possible implementation manner, the first terminal device and the second terminal device are both provided with SIM cards for starting the video color vibration function, so that the first terminal device and the second terminal device can realize the video color vibration when in incoming call.

In one possible implementation manner, after the first terminal device of the first user receives the incoming call of the second terminal device of the second user, the method further includes: the SIM card carried by the first terminal equipment has video color vibration capability, which is reported to a protocol layer modem of the first terminal equipment through an operator network; and then reporting the video color vibration capability of the SIM card carried by the first terminal equipment layer by layer to the application side of the first terminal equipment through the modem so as to realize the video color vibration of the first terminal equipment when an incoming call is received.

In one possible implementation, after the first user exits the video call interface to the desktop, the method further includes: and issuing a command for suspending the video stream so as to stop the transmission of the video stream of the video call corresponding to each of the first user and the second user based on the suspension command, thereby ensuring that the video call pictures corresponding to each of the first user and the second user are not displayed on the screen interface of the first terminal device at the moment, further not influencing other operations (such as short message reply and the like) performed by the first user when the first user exits from the video call interface to the desktop, and improving the operation experience of the first user.

In one possible implementation, the incoming call state may be a ringing state; and, the incoming call state may be used to indicate that the first terminal device is in the video color vibration mode.

On this basis, in one possible implementation manner, determining whether the call state is an incoming call state may include: judging whether the call state of the first terminal equipment is a ringing state or not; if not, the first terminal equipment is not in the video color vibration mode; if yes, the first terminal equipment is in the video color vibration mode, and corresponding video stream processing instructions can be respectively issued to optimize the video call effect.

In one possible implementation manner, issuing an instruction for recovering the video stream to obtain video call frames corresponding to the current first user and the second user respectively based on the instruction, and displaying the video call frames corresponding to the current first user and the second user respectively on a screen interface of the first terminal device includes: the instruction of recovering the video stream is issued to the modem at the bottom layer by layer through the functional module incalling of the application layer (the main function is to display and update the content of the call interface and the like on the interface of the electronic equipment), so that the video call pictures corresponding to the current first user and the second user are obtained through the information interaction between the modem and the operator network, and the obtained video call pictures corresponding to the current first user and the second user are displayed on the screen interface of the first terminal equipment, so that the video call picture of the second user at the opposite end can be recovered and displayed on the screen interface of the first electronic equipment, and the video call effects of the first user and the second user are optimized.

In one possible implementation manner, an instruction to pause the video stream is issued to stop the delivery of the video stream of the video call corresponding to each of the first user and the second user based on the instruction, and the video call frames corresponding to each of the first user and the second user are not displayed on the screen interface of the first terminal device, including: and issuing an instruction for suspending the video stream layer by layer to the modem at the bottom layer through a functional module incalling of the application layer so as to stop the transmission of the video stream of the video call corresponding to each of the first user and the second user through the information interaction between the modem and the operator network, and not displaying the video call pictures corresponding to each of the first user and the second user on a screen interface of the first terminal device so as to ensure that other operations performed by the first user from exiting the video call interface to the desktop are not influenced.

In a second aspect, the present application provides an electronic device, the electronic device comprising a memory and a processor, the memory storing a computer program, the processor being configured to invoke and execute the computer program to implement the method for optimizing a video call according to any of the first aspects above.

In a third aspect, the present application provides a computer readable storage medium having stored thereon a computer program for implementing the method of optimizing a video call according to any one of the above first aspects when being executed by a processor of an electronic device.

In a fourth aspect, the present application provides a computer program product for, when run on a computer, causing the computer to perform the method of optimizing a video call as claimed in any one of the first aspects.

Drawings

FIG. 1 is a schematic view of a scene provided in an embodiment of the present application;

fig. 2 is a schematic diagram of an electronic device according to an embodiment of the present application;

fig. 3 is a software structure block diagram of an electronic device according to an embodiment of the present application;

FIG. 4 is a second schematic view of a scene provided in an embodiment of the present application;

fig. 5 is a signaling diagram of an incoming call optimizing method for a video call according to an embodiment of the present application;

Fig. 6 is a signaling diagram after a video call according to an embodiment of the present application;

fig. 7 is a signaling diagram of a method for optimizing a video call according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. The terminology used in the following examples is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the application and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include, for example, "one or more" such forms of expression, unless the context clearly indicates to the contrary. It should also be understood that in embodiments of the present application, "one or more" means one, two, or more than two; "and/or", describes an association relationship of the association object, indicating that three relationships may exist; for example, a and/or B may represent: a alone, a and B together, and B alone, wherein A, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship.

Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.

The plurality of the embodiments of the present application is greater than or equal to two. It should be noted that, in the description of the embodiments of the present application, the terms "first," "second," and the like are used for distinguishing between the descriptions and not necessarily for indicating or implying a relative importance, or alternatively, for indicating or implying a sequential order.

Before describing embodiments of the present application, some terms or concepts related to the embodiments of the present application will be explained first. It is to be understood that the terminology which follows is not intended to be limiting. Other designations are possible for the following terms. The renamed terms still satisfy the following related term explanations.

1) The video color vibration refers to that when a terminal device (such as a mobile phone) calls, not only ringing and/or vibration occurs, but also a video or animation can be displayed on the device interface as an incoming call display. So that the incoming call display is more vivid and interesting. That is, after the operator network and the terminal device of the user can both support the video color vibration, when the user starts the video color vibration function, after the incoming call, the terminal device of the user can play the video or animation picture preset by the operator, and the video or animation picture (i.e. the video color vibration picture) can be customized by the user, and the specific content and the setting mode are not limited. Generally, some video color ring and animation are pre-built in the system of the terminal device for the user to select.

2) Video calls, also known as videophones, generally refer to a communication mode for transmitting voice and image (such as a user's statue, photos, objects, etc.) of a person in real time between terminal devices (such as mobile phones) based on the internet and mobile internet (such as 3G, 4G, 5G internet) terminals. This can be achieved typically by both IP lines or ordinary telephone lines.

In order to make the technical personnel in the technical field more clearly understand the scheme of the application, the application scenario of the technical scheme of the application is firstly described.

Referring to fig. 1, a schematic view of a scenario provided by an embodiment of the present application is shown.

In this example scenario, after a terminal device used by a certain user inserts a SIM card capable of starting a video color vibration, when a video call is received, an interface of the terminal device may display a video color vibration picture preset by an operator (the video color vibration picture may also be customized by the user, and neither specific content nor setting mode is defined), as shown in fig. 1 (a), and at the same time, functional icons such as "short message", "voice call", "reminding", "hang-up", "video answer" may also be displayed on the interface of the terminal device for the user to select. Then, after the user listens to the video call, the video picture of the user and the video picture of the opposite terminal user can be displayed on the interface of the terminal device, as shown in fig. 1 (b), and at the same time, functional icons such as "close my video", "mute", "cut to voice call", "hang up", "speaker" and the like can be displayed on the interface of the terminal device for the user to select.

Then, when the user exits the call interface to the desktop, as shown in fig. 1 (c), the video call duration between the user and the opposite-end user may be displayed at the upper left corner of the interface of the terminal device, and at the same time, the user may perform other operations on the desktop, such as viewing weather and information. When the user clicks the icon of "video call duration" displayed in the upper left corner of the interface, the user can return to the video call interface with the opposite terminal user, as shown in fig. 1 (d), at this time, only the video picture of the user can be displayed on the interface of the terminal device of the user, and the video picture of the opposite terminal user who performs video call with the user disappears, thereby affecting the video call experience of the user.

In order to overcome the technical problems, the application provides a video call optimization method, electronic equipment and a storage medium. The situation that the video picture of the opposite terminal user disappears when the user performs video call can be avoided, and therefore video call experience of the user is improved.

The method for optimizing the video call provided by the embodiment of the application can be applied to electronic equipment such as mobile phones, tablet computers, personal digital assistants (Personal Digital Assistant, PDA), desktop, laptop, notebook computers, ultra-mobile personal computers (UMPC), handheld computers, netbooks, wearable equipment and the like.

In order to make the person skilled in the art more clearly understand the method for optimizing video call provided by the present application, the hardware architecture and the software system architecture of the electronic device will be described in detail below.

Referring to fig. 2, a schematic diagram of an electronic device provided by an embodiment of the present application is shown.

As shown in fig. 2, the electronic device 200 may include a processor 210, a mobile communication module 220, a wireless communication module 230, a sensor module 240, an internal memory 241, a SIM card interface 242, an external memory interface 243, a motor 244, keys 245, a power management module 246, a battery 247, a charge management module 248, a universal serial bus (universal serial bus, USB) interface 249, an indicator 250, a camera 251, a display 252, an audio module 253, a speaker 253A, a receiver 253B, a microphone 253C, an earphone interface 253D, an antenna group 1, and an antenna group 2.

It should be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 200. In other embodiments of the application, electronic device 200 may include more or fewer components than shown, or certain components may be combined, or certain components may be separated, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 210 may include one or more processing units such as, for example: the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may hold instructions or data that the processor 210 has just used or recycled. If the processor 210 needs to reuse the instruction or data, it may be called directly from the memory. Repeated accesses are avoided and the latency of the processor 210 is reduced, thereby improving the efficiency of the system.

In some embodiments, processor 210 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

The internal memory 241 may be used to store computer executable program code that includes instructions. The internal memory 241 may include a stored program area and a stored data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 200 (e.g., audio data, phonebook, etc.), and so on. In addition, the internal memory 241 may include a high-speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like. The processor 210 performs various functional applications of the electronic device 200 and data processing by executing instructions stored in the internal memory 241 and/or instructions stored in a memory provided in the processor.

The SIM card interface 242 is used to connect a SIM card. The SIM card may be inserted into the SIM card interface 242 or removed from the SIM card interface 242 to enable contact and separation with the electronic device 200. The electronic device 200 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 242 may support Nano SIM cards, micro SIM cards, and the like. The same SIM card interface 242 may be used to insert multiple cards simultaneously. The types of the plurality of cards may be the same or different. SIM card interface 242 may also be compatible with different types of SIM cards. SIM card interface 242 may also be compatible with external memory cards. The electronic equipment 200 realizes the data communication functions such as video call and the like by starting the SIM card of the video color vibration and interacting with the network. In some embodiments, the electronic device 200 employs esims, namely: an embedded SIM card. The eSIM card can be embedded in the electronic device 200 and cannot be separated from the electronic device 200.

The external memory interface 243 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 200. The external memory card communicates with the processor 210 through an external memory interface 243 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

The motor 244 may generate a vibration alert. The motor 244 may be used for incoming call vibration alerting as well as for touch vibration feedback. For example, touch operations acting on different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

The keys 245 include a power on key, a volume key, etc. The keys 245 may be mechanical keys. Or may be a touch key. The electronic device 200 may receive key inputs, generating key signal inputs related to user settings and function controls of the electronic device 200.

The USB interface 249 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 249 may be used to connect a charger to charge the electronic device 200, or may be used to transfer data between the electronic device 200 and a peripheral device. And the method can also be used for connecting headphones, and playing the audio of the video call through the headphones. The interface may also be used to connect other electronic devices, such as AR devices, etc.

The charge management module 248 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charge management module 248 may receive a charging input of the wired charger through the USB interface 249. In some wireless charging embodiments, the charge management module 248 may receive wireless charging input through a wireless charging coil of the electronic device 200. The charging management module 248 may also provide power to the electronic device 200 through the power management module 246 while charging the battery 247.

The power management module 246 is used to connect the battery 247, and the charge management module 248 is connected to the processor 210. The power management module 246 receives input from the battery 247 and/or the charge management module 248 and provides power to the processor 210, the internal memory 241, the display 252, the camera 251, the wireless communication module 230, and the like. The power management module 246 may also be used to monitor battery capacity, battery cycle times, battery health (leakage, impedance) and like parameters. In other embodiments, the power management module 246 may also be disposed in the processor 210. In other embodiments, the power management module 246 and the charge management module 248 may be disposed in the same device.

The display screen 252 is used for displaying images, videos, etc., and may be used for displaying video color vibration pictures preset by an operator when an incoming call is coming. The display 252 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emittingdiode), a flexible light-emitting diode (FLED), a mini, a Micro led, a Micro-OLED, a quantum dot light-emitting diode (quantumdot light emitting diodes, QLED), or the like. In some embodiments, the electronic device 200 may include 1 or N display screens 252, N being a positive integer greater than 1.

The camera 251 is used to capture still images or video, such as may be used to capture video pictures of the user himself when the video call is in progress. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the electronic device 200 may include 1 or N cameras 251, N being a positive integer greater than 1.

The electronic device 200 implements display functions through a GPU, a display screen 252, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 252 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or change display information.

The electronic device 200 may implement audio functions through an audio module 253, a speaker 253A, a receiver 253B, a microphone 253C, an earphone interface 253D, an application processor, and the like. Such as music playing, recording, voice input and output for video calls, etc.

The audio module 253 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 253 can also be used to encode and decode audio signals. In some embodiments, the audio module 253 may be provided in the processor 210, or a part of functional modules of the audio module 253 may be provided in the processor 210.

The speaker 253A, also called "horn", is used to convert an audio electric signal into a sound signal. The electronic device 200 may listen to music, or to handsfree calls, through the speaker 253A.

The receiver 253B, also called "earpiece", is used to convert the audio electrical signal into a sound signal. When the electronic apparatus 200 receives a telephone call or voice information, the voice can be received by bringing the receiver 253B close to the human ear.

The microphone 253C, also called "microphone", is used to convert a sound signal into an electrical signal. When making a call or transmitting voice information, the user can sound near the microphone 253C through the mouth, inputting a sound signal to the microphone 253C. The electronic device 200 may be provided with at least one microphone 253C. In other embodiments, the electronic device 200 may be provided with two microphones 253C, and may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 200 may further be provided with three, four or more microphones 253C to enable collection of sound signals, noise reduction, identification of sound sources, directional recording, etc.

The earphone interface 253D is used to connect a wired earphone. The earphone interface 253D may be a USB interface 249, or may be a 3.5mm open mobile electronic platform (open mobile terminal platform, OMTP) standard interface, a american cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

It should be understood that the connection relationship between the modules illustrated in the embodiment of the present application is only illustrative, and does not limit the structure of the electronic device 200. In other embodiments of the present application, the electronic device 200 may also employ different interfacing manners, or a combination of interfacing manners, as in the above embodiments.

The wireless communication function of the electronic device 200 can be implemented by the antenna 1, the antenna 2, the mobile communication module 220, the wireless communication module 230, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 200 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 220 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied on the electronic device 200. The mobile communication module 220 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 220 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 220 may amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate the electromagnetic waves. In some embodiments, at least some of the functional modules of the mobile communication module 220 may be disposed in the processor 210. In some embodiments, at least some of the functional modules of the mobile communication module 220 may be provided in the same device as at least some of the modules of the processor 210.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 253A, the receiver 253B, etc.), or displays images or videos through the display screen 252. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 220 or other functional module, independent of the processor 210.

The wireless communication module 230 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., as applied on the electronic device 200. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 230 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 210. The wireless communication module 230 may also receive a signal to be transmitted from the processor 210, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation via the antenna 2.

In some embodiments, antenna 1 and mobile communication module 220 of electronic device 200 are coupled, and antenna 2 and wireless communication module 230 are coupled, such that electronic device 200 may communicate with a network and other devices via wireless communication techniques. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a beidou satellite navigation system (beidou navigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellite system, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).

In addition, above the above components, the electronic device 200 runs an operating system. Such as iOS operating systems, android operating systems, windows operating systems, etc. Running applications may be installed on the operating system.

Referring to fig. 3, a software structure schematic diagram of an electronic device according to an embodiment of the present application is shown.

The software system of the electronic device 200 may employ a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the application, taking an Android system with a layered architecture as an example, a software structure of the electronic device 200 is illustrated.

The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun row (Android run) and system libraries, and a kernel layer, respectively.

The application layer may include a series of application packages. As shown in fig. 3, the application package may include applications such as camera, phone call, sms, music, video, WLAN, bluetooth, etc.

The application framework layer (framework layer) provides an application programming interface (application programming interface, API) and programming framework for the application of the application layer. The application framework layer includes a number of predefined functions. As shown in FIG. 3, the application framework layer may include a window manager, notification manager, phone manager, resource manager, view system, and the like.

Wherein the window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The telephony manager is used to provide the communication functions of the electronic device 200. For example, management of call status (including connection, hang-up, etc. of a video call) may include framework telecom call, etc. modules that provide various call functions, which may include, but are not limited to, learning of video color capabilities of the electronic device, call status, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.

Android run time includes a core library and virtual machines. Android run time is responsible for scheduling and management of the Android system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The technical solutions involved in the following embodiments may be implemented in an electronic device having the above hardware architecture and software architecture.

Next, the implementation procedure of the video call optimizing method provided by the application will be described in detail:

in some embodiments, in order to solve the problem of disappearance of the video picture of the opposite user caused by the conflict between the video color vibration and the video call function as shown in fig. 1, in the process of optimizing the video call, there is often a scene as shown in fig. 4. That is, after the mobile phone 2 (such as 157 xxxxxxx) held by the user 2 inserts the SIM card capable of turning on the video color vibration, after receiving the incoming call of the mobile phone 1 (such as 139 xxxxxxx) held by the user 1 and answering the incoming call, the mobile phone 1 will receive an invitation asking whether to upgrade the video call as shown in fig. 4, but in fact, the mobile phone 2 does not initiate the upgrade invitation. The mobile phone 2 starts the video color vibration, and is in the color vibration mode after receiving the incoming call, so that the mobile phone enters a process of creating a surface for displaying the video color vibration picture, and an instruction for recovering the video stream is issued in the process, thereby causing the voice call to be upgraded into the video call, and sending an upgrading invitation of the video call to the mobile phone 1. But in reality the user 2 does not want to initiate the upgrade invitation to the mobile phone 1 to make a video call with the user 1 via the mobile phone 2, which may affect the call experience of both.

Therefore, in order to solve the above-mentioned problem and avoid that the mobile phone 1 receives the invitation for inquiring whether to upgrade the video call as shown in fig. 4, the embodiment of the application provides an incoming call optimizing method for the video call, so that when judging that the video call is in the video color vibration mode, an instruction for recovering the video stream will not be issued. As shown in fig. 5, the specific implementation process of the incoming call optimization method for a video call may include the following steps S501 to S509:

s501: the operator detects that the SIM card for opening the video color vibration is inserted into the electronic equipment supporting the video and the incoming calls of other electronic equipment.

In this embodiment, when a user inserts a SIM card capable of opening a video color vibration into an electronic device supporting video, an operator network may detect that the SIM card capable of opening the video color vibration is inserted into the electronic device supporting video, and may detect an incoming call of other electronic devices on the electronic device.

S502: the operator network reports the video color vibration capability of the SIM card to a protocol layer (modem).

When the operator network detects that the SIM card for starting the video color vibration is inserted into the electronic equipment supporting the video and the incoming call of other electronic equipment occurs, the SIM card with the video color vibration capability can be reported to a protocol layer (modem) when the network communication capability can be ensured.

S503: the modem receives video color vibration capability of the SIM card reported by an operator network.

S504: the modem reports the video color vibration capability of the SIM card to an Android application program package (Android applicationpackage, apk) of an IP multimedia system (IP Multimedia Subsystem, ims) at the application side (or a vendor layer of other system platforms).

Wherein, the vendor or ims apk mainly can comprise an implementation class of ImsService to provide ims related services. Is responsible for data interaction with the modem and media. This functional module is typically customized by each chip vendor, although the implementation may vary from chip vendor to chip vendor. But there will be a class that implements ImsService.

S505: and the vendor or the ims apk receives the video color vibration capability reported by the modem and writes the corresponding numerical value into the ims call.

The IMS call is used for handling connection of IMS voice and video calls, and is usually created by imssmanager. The imsfanager can provide IMS services APIs.

The specific expression form of the numerical value corresponding to the video color vibration capability is not limited, and the video color vibration capability can be represented by using the extra_crs_type, that is, the ims call can write the value of the video color vibration capability extra_crs_type into the ims call.

S506: the vendor or ims apk reports the video color vibration capability of the SIM card to framework telecomcall.

S507: and writing a value corresponding to the video color vibration capability EXTRA_CRS_TYPE in framework telecom call.

The function of the framework layer may include, but is not limited to, knowing the color vibration capability and the call state of the electronic device.

S508: framework telecom call reports the video color rendering capability to the incallui of the application layer.

S509: the incallui reads the value corresponding to the video color vibration capability extra_crs_type in framework telecom call to judge whether the current color vibration exists or not, and if yes, an instruction for recovering the video stream is not issued.

The incallui apk is located at an application layer, and its main function may be, but is not limited to, displaying and updating the content of a call interface on an interface of the electronic device (for example, displaying a video color vibration screen on the interface of the electronic device).

Thus, when the user starts the video color vibration function of the electronic device, the operator network can report to the modem that the SIM card carried by the electronic device has video color vibration capability when the electronic device receives an incoming call, and after the incapability judges that video color vibration occurs, an instruction for recovering the video stream is not issued by executing the steps S501-S509.

Further, after the video call is received, although the video color vibration state is no longer the video call state at this time, the operator network or the system platform does not report to the modem that the video color vibration mode is no longer currently available, so that the modem and above framework layers (such as the vendor or ims apk, framework telecom call and incapacity) cannot perceive the change, and consider that the video color vibration mode is still available at this time. In this way, after the video call is answered, when the incall exits the call interface to the desktop, an instruction to pause the video stream is issued, and when the incall returns to the call interface, a resume video stream is issued again, but at this time, the incall still judges that the incall is the video color vibration mode because the foregoing carrier network does not report that the incall is no longer the video color vibration mode, which results in that the resume video stream will not be issued, so that the video picture of the opposite terminal user disappears as shown in (d) in fig. 1, as shown in fig. 6, the specific implementation process after the video call may include the following steps S601-S618:

s601: after the video call is established, when the incallui exits the call interface to the desktop, an instruction to pause the video stream is issued.

S602: the incallui issues an instruction to pause the video stream to framework telecom call.

S603: framework telecom call receives an instruction issued by incallui to pause the video stream.

S604: framework telecom call issues an instruction to pause the video stream to the vendor or ims apk.

S605: the vendor or ims apk receives framework telecom call issued instructions to pause the video stream.

S606: the vendor or ims apk issues an instruction to pause the video stream to the modem.

S607: the modem receives an instruction of suspending the video stream issued by the vendor or the ims apk.

S608: the modem issues an instruction to pause the video stream to the carrier network.

S609: and the operator network receives an instruction of suspending the video stream issued by the modem to stop the transmission of the video stream, and the video call picture is not displayed on the interface of the electronic equipment.

S610: when the call interface is returned, the incallui issues an instruction to resume the video stream in order to expect to resume displaying the video call screen on the electronic device interface.

S611: the incallui issues an instruction to resume the video stream to framework telecom call.

S612: framework telecom call receives an instruction for recovering the video stream, but after reading the value corresponding to the video color vibration capability (extra_crs_type) in framework telecom call based on the instruction, the instruction still determines that the video color vibration is video color vibration, and does not issue an instruction for recovering the video stream, i.e. issue an instruction for suspending the video stream.

S613: framework telecom call issues an instruction to pause the video stream to the vendor or ims apk.

S614: the vendor or ims apk receives framework telecom call issued instructions to pause the video stream.

S615: the vendor or ims apk issues an instruction to pause the video stream to the modem.

S616: the modem receives an instruction of suspending the video stream issued by the vendor or the ims apk.

S617: the modem issues an instruction to pause the video stream to the carrier network.

S618: the operator network receives the instruction of suspending the video stream issued by the modem, and still stops the transmission of the video stream, and still cannot resume the display of the video call picture of the opposite terminal user on the interface of the electronic equipment.

In order to solve the problem that the video picture of the opposite terminal user cannot be restored to display, in some embodiments, the embodiments of the present application provide an optimization method for video call, which fully considers that the video color vibration is only a scene when the call is received, because after the call is received, the operator network or the system platform cannot report to the modem and the upper layer thereof that the video color vibration mode is not currently available, the application side can autonomously judge according to the call state, if the call state is an incoming call, the video color vibration mode is not available, and therefore, after the call is received, the video color vibration mode can be determined through judging the call state, so that an instruction for restoring the video stream can be issued to the bottom modem to restore and display the video call picture of the opposite terminal user on the interface of the electronic device. As shown in fig. 7, the specific implementation process of the method for optimizing a video call may include the following steps S701 to S718:

S701: after the video call is established, when the incallui exits the call interface to the desktop, an instruction to pause the video stream is issued.

S702: the incallui issues an instruction to pause the video stream to framework telecom call.

S703: framework telecom call receives an instruction issued by incallui to pause the video stream.

S704: framework telecom call issues an instruction to pause the video stream to the vendor or ims apk.

S705: the vendor or ims apk receives framework telecom call issued instructions to pause the video stream.

S706: the vendor or ims apk issues an instruction to pause the video stream to the modem.

S707: the modem receives an instruction of suspending the video stream issued by the vendor or the ims apk.

S708: the modem issues an instruction to pause the video stream to the carrier network.

S709: and the operator network receives an instruction of suspending the video stream issued by the modem to stop the transmission of the video stream, and the video call picture is not displayed on the interface of the electronic equipment.

It should be noted that, the implementation process of steps S701-S709 is similar to the implementation process of steps S601-S609, and specific content can be found in steps S S-S609, which are not described herein.

S710: when the call interface is returned, the incallui issues an instruction to resume the video stream in order to expect to resume displaying the video call screen on the electronic device interface.

S711: the incallui issues an instruction to resume the video stream to framework telecom call.

S712: framework telecom call after receiving the instruction for recovering the video stream, the value corresponding to the video color vibration capability (extra_crs_type) in framework telecom call is not read any more, but the call State (State) of the current electronic device is obtained from framework telecom call based on the instruction, and when it is determined that the call State is not ringing (i.e. not incoming call), the instruction for recovering the video stream is issued.

S713: framework telecom call issues an instruction to restore the video stream to the vendor or ims apk.

S714: the vendor or ims apk receives framework telecom call issued instructions to resume the video stream.

S715: the vendor or ims apk issues instructions to the modem to resume the video stream.

S716: the modem receives an instruction for recovering the video stream issued by the vendor or the ims apk.

S717: the modem issues an instruction to the operator network to resume the video stream.

S718: and the operator network receives an instruction for recovering the video stream issued by the modem to recover the transmission of the video stream, and recovers and displays the video call picture of the opposite terminal user on the interface of the electronic equipment.

In addition, the embodiment of the application also provides the electronic equipment, and the hardware structure and the software framework of the electronic equipment can be referred to in the corresponding description of fig. 2 and 3. The electronic device comprises a memory storing a computer program and a processor for invoking and executing the computer program to implement the method of optimizing a video call provided in the above description.

Still another embodiment of the present application provides a computer-readable storage medium having stored thereon a computer program for implementing the method of optimizing a video call provided in the above description when executed by a processor of a terminal device.

The above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for optimizing a video call, the method comprising:

after a first terminal device of a first user receives an incoming call of a second terminal device of a second user, establishing a video call between the first user and the second user; displaying video call pictures corresponding to the first user and the second user on a screen interface of the first terminal device;

When the first user exits the video call interface to the desktop and returns to the video call interface, acquiring the current call state of the first terminal device; judging whether the call state is an incoming call state or not;

if not, issuing an instruction for recovering the video stream, so as to acquire video call pictures corresponding to the current first user and the second user respectively based on the instruction, and displaying the video call pictures corresponding to the current first user and the second user respectively on a screen interface of the first terminal device.

2. The method of claim 1, wherein the first terminal device and the second terminal device are each equipped with a SIM card for turning on a video color vibration function.

3. The method of claim 2, wherein after the first terminal device of the first user receives an incoming call from the second terminal device of the second user, the method further comprises:

reporting that the SIM card carried by the first terminal equipment has video color vibration capability to a protocol layer modem of the first terminal equipment through an operator network;

and reporting the video color vibration capability of the SIM card carried by the first terminal equipment to an application side of the first terminal equipment through the modem so as to realize the video color vibration of the first terminal equipment.

4. The method of claim 1, wherein after the first user exits the video call interface to the desktop, the method further comprises:

and issuing an instruction for suspending the video stream so as to stop the transmission of the video stream of the video call corresponding to each of the first user and the second user based on the instruction, and not displaying the video call picture corresponding to each of the first user and the second user on a screen interface of the first terminal device.

5. The method of any of claims 1-4, wherein the incoming call status is a ring status; the incoming call state is used for indicating that the first terminal equipment is in a video color vibration mode.

6. The method of claim 5, wherein the determining whether the call state is an incoming call state comprises:

judging whether the call state is a ringing state or not; if not, the first terminal equipment is not in the video color vibration mode; if yes, the first terminal device is in a video color vibration mode.

7. The method according to claim 1, wherein issuing the instruction to resume the video stream to obtain video call frames corresponding to the current first user and the second user based on the instruction, and displaying the video call frames corresponding to the current first user and the second user on the screen interface of the first terminal device, includes:

And issuing an instruction for recovering the video stream layer by layer to the modem through a functional module incallui of an application layer so as to acquire video call pictures corresponding to the current first user and the second user respectively through information interaction between the modem and the operator network, and displaying the video call pictures corresponding to the current first user and the second user respectively on a screen interface of the first terminal device.

8. The method according to claim 4, wherein issuing the instruction to pause the video stream to stop the delivery of the video stream of the video call corresponding to each of the first user and the second user based on the instruction, without displaying the video call screen corresponding to each of the first user and the second user on the screen interface of the first terminal device, comprises:

and issuing an instruction for suspending the video stream layer by layer to the modem through a functional module incalling of an application layer so as to stop the transmission of the video stream of the video call corresponding to each of the first user and the second user through the information interaction between the modem and the operator network, and not displaying the video call pictures corresponding to each of the first user and the second user on a screen interface of the first terminal device.

9. An electronic device comprising a memory storing a computer program and a processor for invoking and executing the computer program to implement the method of any of claims 1-8.

10. A computer readable storage medium, characterized in that it has stored thereon a computer program which, when executed by an electronic device, implements the method of any of claims 1-8.