CN112584251B

CN112584251B - Display method and electronic equipment

Info

Publication number: CN112584251B
Application number: CN201910944308.4A
Authority: CN
Inventors: 周蓉
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2019-09-30
Filing date: 2019-09-30
Publication date: 2022-09-02
Anticipated expiration: 2039-09-30
Also published as: CN112584251A

Abstract

A display method and electronic equipment relate to the technical field of terminals. Wherein, the method comprises the following steps: the method comprises the steps that the electronic equipment displays a video call interface on a display screen, wherein the video call interface comprises a first window and a second window; the first window is used for displaying a first video picture, the second window is used for displaying a second video picture, and the first window is suspended on the second window; when the first window covers the face in the second video picture, the electronic equipment adjusts the first window or the second window, so that the face in the second video picture is not covered by the first window. By the technical scheme, a user does not need to manually adjust the position of the first window when the first window blocks the second video picture, and the user experience is improved.

Description

Display method and electronic equipment

Technical Field

The present application relates to the field of terminal technologies, and in particular, to a display method and an electronic device.

Background

Currently, in a video call, when an electronic device (e.g., a mobile phone, a tablet computer, etc.) displays video screens of two parties of the call in a picture-in-picture manner, two windows, a large window and a small window, are generally displayed on a display screen. The small window is suspended over the large window. The large window is used for displaying the video picture of one calling party, and the small window is used for displaying the video picture of the other calling party. Therefore, the user can view the video pictures of the two parties of the call.

However, in a video call, a small window may block a face in a video frame displayed in a large window, especially when an area occupied by the face in the video frame displayed in the large window is large. In the prior art, when a user shields a face in a video picture displayed in a large window, the user moves the position of the small window through manual operation, so that the face in the video picture displayed in the large window is not shielded by the small window. However, the user cannot move the position of the small window under the condition that the activities of both hands are limited, and if the face of the person in the video picture displayed in the large window is blocked by the small window, the visual effect in the call process is easily influenced.

Disclosure of Invention

The embodiment of the application provides a display method and electronic equipment, which are beneficial to automatically reducing the possibility that a face displayed in a large window is blocked by a small window in a video call, so that the electronic equipment is more intelligent, a user can manually adjust the position of the small window without blocking the face displayed in the large window by the small window, and the user experience is improved.

In a first aspect, the present application is a display method, where the method includes:

the method comprises the steps that the electronic equipment displays a video call interface on a display screen, wherein the video call interface comprises a first window and a second window; the first window is used for displaying a first video picture, the second window is used for displaying a second video picture, and the first window is suspended on the second window; when the first window covers the face in the second video picture, the electronic equipment adjusts the first window or the second window, so that the face in the second video picture is not covered by the first window.

In the embodiment of the application, when the first window covers the face in the second video picture, the electronic device can automatically adjust the first window or the second window, which is beneficial to automatically reducing the possibility that the face displayed in the second window is covered by the first window in a video call, so that a user does not need to manually adjust the position of the first window when the first window covers the second video picture, and the user experience is improved.

In one possible design, the electronic device moves the position of the first window and/or adjusts the size of the first window so that the face in the second video picture is not occluded by the first window. Thereby facilitating adjustment of the first window.

In one possible design, the electronic device moves the position of the first window within the display area of the display screen until the face of the person moving the first window into the second video frame is not occluded by the first window. Thereby facilitating adjustment of the first window.

In one possible design, the electronic device moves the position of the first window along the boundary of the display screen within the display area of the display screen until the first window moves one circle along four sides of the display screen; taking the position where the face in the second video picture is not shielded in the moving process of the first window as an alternative position; and moving the position of the first window to enable the first window to be suspended on a first target alternative position selected from at least one alternative position.

In a possible design, the first target alternative position is a position, in the at least one alternative position, where a distance from a first position is smaller than a first threshold, where the first position is a center position of the first window when the first window blocks a face in the second video frame. Helping to reduce movement of the user's gaze.

In a possible design, the first window is a first rectangular frame, and when the first window blocks the face in the second video picture, the electronic device reduces the first rectangular frame until the face in the second video picture is not blocked, so as to obtain a second rectangular frame; moving the second rectangular frame until the second rectangular frame is moved to a position where the face in the second video picture is not shielded, and amplifying the second rectangular frame to a first value to obtain a third rectangular frame, wherein the face in the second video picture is not shielded by the third rectangular frame; when the first value is larger than or equal to the size of the first rectangular frame, stopping moving the third rectangular frame, moving the first window to the position of the third rectangular frame, and adjusting the size of the first window, so that the size of the first window after the position is moved is the same as the size of the third rectangular frame. The method is favorable for further reducing the possibility that the face displayed in the second window is blocked by the first window in the video call.

In a possible design, the first window is a first rectangular frame, and when the first window blocks the face in the second video picture, the electronic device reduces the first rectangular frame until the face in the second video picture is not blocked, so as to obtain a second rectangular frame; moving the second rectangular frame, and continuously moving the second rectangular frame when the second rectangular frame covers the face in the second video picture in the moving process; when the second rectangular frame does not shield the face in the second video picture, amplifying the second rectangular frame to a second value to obtain a third rectangular frame, wherein the third rectangular frame does not shield the face in the second video picture, and the second value is smaller than a second threshold value, wherein the second threshold value is the maximum value of the first window; moving the third rectangular frame, and when the third rectangular frame covers the face in the second video picture in the moving process, continuing to move the third rectangular frame; when the third rectangular frame does not shield the face in the second video picture, amplifying the third rectangular frame to the second threshold value to obtain a fourth rectangular frame, wherein the fourth rectangular frame does not shield the face in the second video picture; moving the fourth rectangular frame until the fourth rectangular frame moves around the four sides of the display screen for a circle, and taking the positions of the third rectangular frame and the fourth rectangular frame which do not shield the face in the second video picture as alternative positions; and moving the position of the first window so that the first window is suspended over a second target candidate position selected from the at least one candidate position. The method is favorable for further reducing the possibility that the face displayed in the second window is blocked by the first window in the video call.

In a possible design, the electronic device adjusts the transparency of the first window, so that a user can see a face, which is hidden by the first window, on the second video picture through the first window. The realization is convenient.

In one possible design, the electronic device moves the position of the second window and/or resizes the second window.

In one possible design, the electronic device moves the position of the second window in a target direction, where the target direction is a direction in which the center position of the first window points to the center position of the second window. Helping to simplify the implementation.

In a second aspect, an embodiment of the present application provides an electronic device, which includes a display screen; one or more processors; a memory; and one or more computer programs; wherein the one or more computer programs are stored in the memory, the one or more computer programs, when invoked by the one or more processors, cause the electronic device to perform the steps of:

displaying a video call interface on a display screen, wherein the video call interface comprises a first window and a second window; the first window is used for displaying a first video picture, the second window is used for displaying a second video picture, and the first window is suspended on the second window; when the first window covers the face in the second video picture, adjusting the first window or the second window to enable the face in the second video picture not to be covered by the first window.

In one possible design, the first window may be adjusted by:

and moving the position of the first window and/or adjusting the size of the first window so that the face in the second video picture is not shielded by the first window.

In one possible design, the first window may be adjusted by:

and moving the position of the first window in the display area of the display screen until the face of the first window moving to the second video picture is not shielded by the first window.

In one possible design, the position of the first window may be moved by:

in the display area of the display screen, moving the position of the first window along the boundary of the display screen until the first window moves for a circle along the four sides of the display screen; taking the position where the face in the second video picture is not shielded in the moving process of the first window as an alternative position; and moving the position of the first window so that the first window floats on a first target candidate position selected from at least one candidate position.

In a possible design, the first target alternative position is a position, in the at least one alternative position, where a distance from a first position is smaller than a first threshold, where the first position is a center position of the first window when the first window blocks a face in the second video frame.

In one possible design, the position of the first window may be moved and the size of the first window may be adjusted by:

the first window is a first rectangular frame, and when the first window covers the face in the second video picture, the first rectangular frame is reduced until the face in the second video picture is not covered, so that the second rectangular frame is obtained; moving the second rectangular frame until the second rectangular frame is moved to a position where the face in the second video picture is not shielded, and amplifying the second rectangular frame to a first value to obtain a third rectangular frame, wherein the face in the second video picture is not shielded by the third rectangular frame; when the first value is larger than or equal to the size of the first rectangular frame, stopping moving the third rectangular frame, moving the first window to the position of the third rectangular frame, and adjusting the size of the first window, so that the size of the first window after the position is moved is the same as the size of the third rectangular frame.

In one possible design, the position and size of the first window may be moved by:

the first window is a first rectangular frame, and when the first window covers the face in the second video picture, the first rectangular frame is reduced until the face in the second video picture is not covered, so that the second rectangular frame is obtained; moving the second rectangular frame, and continuously moving the second rectangular frame when the second rectangular frame covers the face in the second video picture in the moving process; when the second rectangular frame does not shield the face in the second video picture, amplifying the second rectangular frame to a second value to obtain a third rectangular frame, wherein the third rectangular frame does not shield the face in the second video picture, and the second value is smaller than a second threshold value; the second threshold is the maximum value of the first window, the third rectangular frame is moved, and in the moving process, when the third rectangular frame covers the face in the second video picture, the third rectangular frame is continuously moved; when the third rectangular frame does not shield the face in the second video picture, amplifying the third rectangular frame to the second threshold value to obtain a fourth rectangular frame, wherein the fourth rectangular frame does not shield the face in the second video picture; moving the fourth rectangular frame until the fourth rectangular frame moves around the four sides of the display screen for a circle, and taking the positions of the third rectangular frame and the fourth rectangular frame which do not shield the face in the second video picture as alternative positions;

and moving the position of the first window so that the first window is suspended on a second target alternative position selected from at least one alternative position.

In one possible design, the first window may be adjusted by:

and adjusting the transparency of the first window to enable a user to see the face, which is shielded by the first window, on the second video picture through the first window.

In one possible design, the second window may be adjusted by:

moving the position of the second window, and/or adjusting the size of the second window.

In one possible design, the position of the second window may be moved by:

and moving the position of the second window along a target direction, wherein the target direction is a direction in which the central position of the first window points to the central position of the second window.

In a third aspect, an electronic device provided in an embodiment of the present application includes an apparatus for performing the method according to the first aspect of the present application and any one of the possible designs related to the first aspect.

In a fourth aspect, a chip provided in this embodiment of the present application is configured to call and execute a program instruction stored in a memory, and execute the method according to any one of the above first aspect and the possible designs related to the first aspect of this embodiment of the present application.

In a fifth aspect, a computer storage medium of an embodiment of the present application stores program instructions, which, when executed on an electronic device, cause the electronic device to perform the method according to the first aspect of the embodiment of the present application and any one of the possible designs related to the first aspect.

In a sixth aspect, a computer program product according to this embodiment of the present application, when running on an electronic device, causes the electronic device to perform a method for implementing the first aspect of this embodiment and any possible design related to the first aspect.

In addition, the technical effects brought by any one of the possible design manners in the second aspect to the fifth aspect can be referred to the technical effects brought by different design manners in the association of the method part, and are not described herein again.

Drawings

FIG. 1 is a schematic diagram of a video call interface according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a video call scenario according to an embodiment of the present application;

FIG. 3 is a schematic view of an interface according to an embodiment of the present application;

FIG. 4 is a schematic view of another interface according to an embodiment of the present application;

FIG. 5 is a schematic view of another video call interface according to an embodiment of the present application;

FIG. 6 is a schematic view of another video call interface according to an embodiment of the present application;

fig. 7 is a schematic diagram of a hardware architecture of an electronic device according to an embodiment of the present application;

FIG. 8 is a flowchart illustrating a display method according to an embodiment of the present application;

fig. 9A is a schematic diagram of a face region in a video frame according to an embodiment of the present disclosure;

FIG. 9B is a schematic diagram of a face region in another video frame according to an embodiment of the present application;

FIG. 10 is a schematic view of different sized small windows according to an embodiment of the present application;

FIG. 11 is a schematic view of another video call interface according to an embodiment of the present application;

FIG. 12 is a diagram illustrating a small window moving track according to an embodiment of the present application;

FIG. 13 is a diagram illustrating another exemplary small window movement trace according to the present disclosure;

FIG. 14 is a schematic diagram of a position of a moving widget according to an embodiment of the present application;

FIG. 15 is a schematic diagram of the position of another moving widget according to an embodiment of the present application;

FIG. 16 is a diagram illustrating the position of another moving widget according to an embodiment of the present application;

FIG. 17 is a schematic view of adjusting the transparency of a small window according to an embodiment of the present application;

FIG. 18 is a schematic diagram of another display method according to an embodiment of the present application;

FIG. 19 is a diagram illustrating resizing of a large window according to an embodiment of the present application;

FIG. 20 is a schematic view of a position of a moving large window according to an embodiment of the present application;

FIG. 21 is a schematic diagram of another embodiment of the present application for shifting the position of a large window;

FIG. 22 is a schematic view of another interface according to an embodiment of the present application;

fig. 23 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 24 is a schematic structural diagram of another electronic device according to an embodiment of the present application.

Detailed Description

The user may use the electronic device for a video call. In video telephony, the electronic device typically presents video pictures to the user in a picture-in-picture format. Taking the video call between the two parties as an example, the electronic device displays a video call interface on the display screen. The video call interface includes two windows, a large window and a small window. The small window is suspended on the large window, which can be called as a suspended window, and the large window can be called as a main window. The large window is used for displaying the video picture of one calling party, and the small window is used for displaying the video picture of the other calling party. It should be noted that the position of the small window is movable in response to the user operation, and the electronic device may also exchange the video frames displayed in the small window and the large window in response to the user operation.

For example, a video call interface displayed on a display screen by an electronic device is shown in fig. 1 and includes a small window a and a large window B. The small window A is suspended at the upper left corner of the large window B, and the face of a video picture displayed in the large window B is shielded by the small window A. In the prior art, a user moves the position of the small window a, for example, moves the position of the small window a by performing manual operation on the small window a, so that the small window a is suspended at the lower right corner (shown as a shaded portion in fig. 1) of the large window B, thereby preventing a human face in a video picture displayed in the large window B from being blocked by the small window a.

However, when both hands of the user are limited, if the face of the user in the video image displayed in the large window is blocked by the small window, the visual effect of the user in the video call process can be affected, and the user experience is reduced.

In view of this, an embodiment of the present application provides a display method, so that in a process of a video call, an electronic device can adjust a large window or a small window (for example, automatically move a position of the small window, or adjust a size or a transparency of the small window, or automatically adjust a size of the large window, or move a position of the large window) by identifying a face in a video picture displayed in the large window, so as to prevent the small window from blocking the face in the video picture displayed in the large window, which is beneficial to making the electronic device more intelligent, liberating two hands of a user, and improving user experience.

It should be understood that in this application, "/" means "or" means "unless otherwise indicated. For example, A/B may represent A or B. In the present application, "and/or" is only one kind of association relation describing an association object, and means that there may be three kinds of relations. For example, a and/or B, may represent: a exists alone, A and B exist simultaneously, and B exists alone. "at least one" means one or more, "a plurality" means two or more.

In this application, "exemplary," "in some embodiments," "in other embodiments," and the like are used to mean serving as an example, illustration, or description. Any embodiment or design described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, the word using examples is intended to present concepts in a concrete fashion.

Furthermore, the terms "first," "second," and the like, as used herein, are used for descriptive purposes only and not for purposes of indicating or implying relative importance or implicit indication of a number of technical features being indicated or implied as well as the order in which such is indicated or implied.

The embodiment of the application can be applied to scenes of two-party and multi-party video calls. In the following, the two-party video call scenario is taken as an example for corresponding introduction, and for a three-party or multi-party video call scenario, reference may be made to the related introduction of the two-party video call scenario, which is not described herein again.

Fig. 2 is a schematic diagram of a video call scenario. Specifically, the user a uses the electronic device 100, the user B uses the electronic device 200, and the electronic device 100 and the electronic device 200 can communicate via a network, so that the user a and the user B can perform a video call. The network may be a mobile communication network, for example, a second generation communication (2G) network, a third generation communication (3 rd generation, 3G) network, a fourth generation communication (4 th generation, 4G) network, a fifth generation communication (5 th generation, 5G) network, or a future mobile communication network (e.g., a sixth generation communication (6 th generation, 6G) network). The network may also be a wireless communication network, such as a wireless fidelity (Wi-Fi) network.

The video call between the user a and the user B may be initiated by the user a to the user B using the electronic device 100, or initiated by the user B to the user a using the electronic device 200, which is not limited to this.

Taking the example that the user a uses the electronic device 100 to initiate a video call to the user B, in this case, the electronic device 100 is a calling end, and the electronic device 200 is a called end. User a may initiate a video call to user B through a communication-like Application (APP) installed on electronic device 100. For example, the communication-like application may be a telephone, WeChat, QQ, or the like.

Take the WeChat as an example. As an example, the electronic device 100 displays the interface shown in fig. 3A on a display screen. The interface shown in FIG. 3A, which may also be referred to as a home interface or desktop, includes icons for applications, such as a WeChat icon 301, a phone icon, a mail icon, and the like. The electronic device 100 displays an interface of the WeChat on the display screen in response to an operation of clicking the WeChat icon 301 by the user. For example, in response to the user clicking the wechat icon 301, the electronic device 100 displays the interface of the wechat on the display screen as the interface shown in fig. 3B. Where the interface shown in fig. 3B includes a user B option 302, the electronic device 100 may display a chat interface with the user B on the display screen in response to the user clicking the user B option 302. And the video call can be initiated to the user B by operating the chat interface of the user B. For example, a chat interface with user B may be as shown in fig. 3C, the electronic device 100 initiating a video call to user B in response to operation of the virtual key 303 for the video call. For example, the electronic apparatus 100 transmits a video call request to the electronic apparatus 200 through the network in response to the operation of the virtual key 303. For example, the electronic device 100 may further display an interface shown in fig. 3D on the display screen in response to an operation of the virtual key 303 for a video call. For the user B, the electronic apparatus 200 may display the interface shown in fig. 4 on the display screen after receiving the video call request from the electronic apparatus 100 through the network. The electronic apparatus 200 may display a video call interface on the display screen in response to an operation of the user clicking a virtual key for controlling the acceptance of the video call, and transmit a response to the electronic apparatus 100 of the acceptance of the video call request. The electronic apparatus 100 displays a video call interface on the display screen in response to receiving a response to accept the video call request from the electronic apparatus 200. Thereby realizing the video call between the user A and the user B.

Illustratively, the electronic device 100 displays the video call interface 1 on the display screen after receiving a response from the electronic device 200 to accept a video call. For example, the video call interface 1 may include a small window 11 and a large window 12 as shown in fig. 5A. The small window 11 is suspended in the upper left corner of the large window 12. The small window 11 is used for displaying the video pictures of the user a, and the large window 12 is used for displaying the video pictures of the user B. For the electronic device 100, the video picture of the user a is captured by the camera of the electronic device 100, and the video picture of the user B is sent to the electronic device 100 by the electronic device 200 through the network after being captured by the camera. The electronic apparatus 200 displays the video call interface 2 on the display screen in response to an operation of the user clicking a virtual key for controlling the answering of a video call. For example, the video call interface 2 may include a small window 21 and a large window 22 as shown in fig. 5B. The small window 21 floats in the upper left corner of the large window 12. The small window 21 is used to display the video pictures of user B and the large window 22 is used to display the video pictures of user a. For the electronic device 200, the video frame of the user a is sent to the electronic device 200 through the network after the electronic device 100 captures the video frame by the camera of the electronic device 200, and the video frame of the user B is captured by the camera of the electronic device 200.

When the electronic device 100 or the electronic device 200, that is, the electronic device, no matter being a calling terminal or a called terminal, is in a video call and can display a video call interface on a display screen, the display method in the embodiment of the present application is adopted to automatically adjust the small window or the large window, so as to prevent a human face in a video picture displayed in the large window from being blocked by the small window.

It should be noted that, taking the electronic device 100 as an example, in response to receiving a response sent by the electronic device 200 to accept a video call request, the video call interface 1 displayed on the display screen of the electronic device 100 may further include a virtual key, for example, a virtual key for controlling switching to a voice chat, a virtual key for controlling hanging up a video call, or a virtual key for switching over a camera. For example, as shown in fig. 5A. Alternatively, taking the electronic device 200 as an example, in response to the user clicking on a virtual key for controlling the video call reception, the electronic device 200 may further include a virtual key displayed on the display screen, for example, as shown in fig. 5B.

However, when the electronic device 100 or the electronic device 200 includes the virtual key on the video call interface, the user may operate the electronic device such that the virtual key on the video call interface is hidden by the electronic device. Or, the electronic device may further hide the virtual key after displaying the preset duration of the virtual key on the video call interface. For example, the preset duration may be 5 seconds(s), 10s, or the like, or may be configured in the electronic device according to a user requirement, or may be configured in the electronic device before the device leaves the factory, or may be automatically determined by the electronic device according to a preset policy, which is not limited to this. Generally, after the electronic device hides the virtual key on the video call interface, if the user does not operate the electronic device, the virtual key is not actively displayed on the video call interface, so that the video call interface only comprises a small window and a large window, and the user can conveniently view the video interfaces of both parties in the video call. For example, a video call interface displayed by the electronic device during a video call is shown in fig. 6, and includes a small window 601 and a large window 602.

Take the electronic device 100 as an example. The following describes electronic devices, and embodiments for using such electronic devices. The electronic device in the embodiment of the present application may be a portable electronic device, such as a mobile phone, a tablet computer, a wearable device, an Augmented Reality (AR)/Virtual Reality (VR) device, and the like. Specifically, the exemplary embodiments of the electronic device comprise, but are not limited to, loader IOS, Android, Microsoft ® Tofra or other operating systems. In other embodiments, the electronic device according to the embodiments of the present application may also be other electronic devices, such as a notebook computer.

For example, fig. 7 shows a hardware structure diagram of an electronic device according to an embodiment of the present application. As shown in fig. 7, the electronic device 100 includes a processor 110, an internal memory 121, an external memory interface 122, a camera 130, a display 140, a sensor module 150, an audio module 160, a speaker 161, a receiver 162, a microphone 163, an earphone interface 164, a Subscriber Identification Module (SIM) card interface 171, a Universal Serial Bus (USB) interface 172, a charging management module 180, a power management module 181, a battery 182, a mobile communication module 191, and a wireless communication module 192. In addition, in other embodiments, the electronic device 100 may further include a motor, an indicator, a button, and the like.

It should be understood that the hardware configuration shown in fig. 7 is only one example. The electronic devices of the embodiments of the application may have more or fewer components than the electronic devices shown in the figures, may combine two or more components, or may have different configurations of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

Processor 110 may include one or more processing units, among others. For example, the processor 110 may include an Application Processor (AP), a modem, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural Network Processor (NPU), and the like. In particular implementations, the different processing units may be separate devices or may be integrated in one or more devices.

In some embodiments, a buffer may also be provided in the processor 110 for storing programs and/or data. The programs in the embodiments of the present application may also be referred to as program instructions, computer programs, code instructions, and the like, and are not limited thereto. As an example, the cache in the processor 110 may be a cache memory. The buffer may be used to hold programs and/or data that have just been used, generated, or recycled by processor 110. If the processor 110 needs to use the program and/or data, it can be called directly from the cache. Which helps to reduce the time for the processor 110 to acquire programs or data, thereby increasing the efficiency of the system.

The internal memory 121 may be used to store programs and/or data. In some embodiments, the internal memory 121 includes a program storage area and a data storage area. The storage program area may be used to store an operating system (e.g., an operating system such as Android and IOS), a program required by at least one function (e.g., a video call function), and the like. The storage data area may be used for storing data created, preset, and/or acquired during the use of the electronic device 100 (e.g., images captured by a camera, images received through a network), and the like. For example, the processor 110 may implement one or more functions by calling programs and/or data stored in the internal memory 121 to cause the electronic device 100 to execute corresponding methods. For example, the processor 110 calls some programs and/or data in the internal memory, so that the electronic device 100 executes the display method provided in the embodiment of the present application, automatically moves the position of the small window, or moves the position of the large window, or adjusts the transparency of the small window, and the like, so as to automatically avoid the small window from blocking the face displayed in the large window, without manual operation by a user, which is beneficial to improving user experience. The internal memory 121 may be a high-speed random access memory, a nonvolatile memory, or the like. For example, the non-volatile memory may include at least one of one or more magnetic disk storage devices, flash memory devices, and/or universal flash memory (UFS), among others.

The external memory interface 122 may be used to connect an external memory card (e.g., a Micro SD card) to extend the memory capability of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 122 to implement a data storage function. For example, the electronic apparatus 100 may save contents of images, music, videos, documents, and the like in the external memory card through the external memory interface 122.

The camera 130 may be used to capture motion, still images, and the like. Typically, the camera 130 includes a lens and an image sensor. The optical image generated by the object through the lens is projected on the image sensor, and then is converted into an electric signal for subsequent processing. For example, the image sensor may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The image sensor converts the optical signal into an electrical signal and then transmits the electrical signal to the ISP to be converted into a digital image signal. It should be noted that, in the embodiment of the present application, the electronic device 100 may include one or more cameras 130, which is not limited thereto. Illustratively, the electronic device 100 includes 5 cameras 130, e.g., 3 rear cameras and 2 front cameras. As another example, the electronic device 100 includes 3 cameras 130, such as 2 rear cameras and 1 front camera.

The display screen 140 may include a display panel. The user can display different interfaces on the display screen 140 according to the needs of the user, so that the requirements of the user are met. Specifically, the display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro led, a quantum dot light-emitting diode (QLED), or the like. For example, the electronic device 100 may implement display functionality via a GPU, the display screen 140, an application processor, and/or the like. It should be noted that, in the embodiment of the present application, the electronic device 100 may include one or more display screens 140, which is not limited thereto. The display screen 140 may be a foldable screen or a non-foldable screen, which is not limited herein.

The sensor module 150 may include one or more sensors. For example, a touch sensor 150A, a pressure sensor 150B, etc. In other embodiments, the sensor module 150 may further include one or more of a gyroscope, an acceleration sensor, a fingerprint sensor, an ambient light sensor, a distance sensor, a proximity light sensor, a bone conduction sensor, a temperature sensor, a positioning sensor (e.g., a Global Positioning System (GPS) sensor), etc., without limitation.

The touch sensor 150A may also be referred to as a "touch panel". The touch sensor 150A may be provided to the display screen 140. When the touch sensor 150A is disposed on the display screen 140, the touch sensor 150A and the display screen 140 form a touch screen, which may also be referred to as a "touch screen". The touch sensor 150A is used to detect a touch operation applied thereto or nearby. The touch sensor 150A can communicate the detected touch operation to the application processor to determine the touch event type. The electronic apparatus 100 may provide visual output related to touch operation or the like through the display screen 140. For example, the electronic apparatus 100 may perform interface switching in response to the touch device 150A detecting a touch operation applied thereto or nearby, and display the switched interface on the display screen 140. In other embodiments, the touch sensor 150A may be disposed on a surface of the electronic device 100 at a different position than the display screen 140.

The pressure sensor 150B is used for sensing a pressure signal, and can convert the pressure signal into an electrical signal. For example, the pressure sensor 150B may be disposed on the display screen 140. The touch operations which act on the same touch position but have different touch operation strengths can correspond to different operation instructions.

The electronic device 100 may implement audio functions through the audio module 160, the speaker 161, the receiver 162, the microphone 163, the headphone interface 164, and the application processor, etc. Such as an audio play function, a recording function, a voice wake-up function, etc.

The audio module 160 may be used to perform digital-to-analog conversion, and/or analog-to-digital conversion on the audio data, and may also be used to encode and/or decode the audio data. For example, the audio module 160 may be disposed in the processor 110, or some functional modules of the audio module 160 may be disposed in the processor 110.

The speaker 161, also called a "speaker", converts audio data into sound and plays the sound. For example, the electronic device 100 may listen to music, listen to a speakerphone, or issue a voice prompt, etc. through the speaker 161.

A receiver 162, also called "earpiece", is used to convert audio data into sound and play the sound. For example, when the electronic device 100 answers a call, the answer can be made by placing the receiver 162 close to the ear of the person.

The microphone 163, also referred to as a "microphone" or "microphone", is used to collect sound (e.g., ambient sound, including human-generated sound, device-generated sound, etc.) and convert the sound into audio electrical data. When making a call or transmitting voice, the user can make a sound by approaching the microphone 163 through the mouth of the person, and the microphone 163 collects the sound made by the user. It should be noted that the electronic device 100 may be provided with at least one microphone 163. For example, two microphones 163 are provided in the electronic apparatus 100, and a noise reduction function may be implemented in addition to sound collection. For another example, three, four or more microphones 163 may be further disposed in the electronic device 100, so that, on the basis of implementing sound collection and noise reduction, identification of sound sources, or a directional recording function may also be implemented.

The earphone interface 164 is used to connect a wired earphone. The headset interface 164 may be a USB interface 170, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface, or the like.

The SIM card interface 171 is for connecting a SIM card. The SIM card can be brought into and out of contact with the electronic device 100 by being inserted into the SIM card interface 171 or being pulled out from the SIM card interface 115. The electronic device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 171 may support a Nano SIM card, a Micro SIM card, a SIM card, or the like. Multiple cards can be inserted into the same SIM card interface 171 at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 171 may also be compatible with different types of SIM cards. The SIM card interface 171 may also be compatible with an external memory card. The electronic device 100 interacts with the network through the SIM card to implement functions such as voice call, video call, and data communication. In some embodiments, the electronic device 100 employs esims, namely: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

The USB interface 172 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 172 may be used to connect a charger to charge the electronic device 100, and may also be used to transmit data between the electronic device 100 and a peripheral device. And the earphone can also be used for connecting an earphone and playing sound through the earphone. For example, the USB interface 172 may be used to connect other electronic devices, such as AR devices, computers, and the like, in addition to the headset interface 164.

The charge management module 180 is configured to receive a charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 180 may receive charging input from a wired charger via the USB interface 170. In some wireless charging embodiments, the charging management module 180 may receive a wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 180 charges the battery 182, the power management module 180 may also supply power to the electronic device 100.

The power management module 181 is used to connect the battery 182, the charging management module 180 and the processor 110. The power management module 181 receives input from the battery 182 and/or the charging management module 180 to power the processor 110, the internal memory 121, the camera 130, the display screen 140, and the like. The power management module 181 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), and the like. In some other embodiments, the power management module 181 may also be disposed in the processor 110. In other embodiments, the power management module 181 and the charging management module 180 may be disposed in the same device.

The mobile communication module 191 may provide a solution including 2G/3G/4G/5G wireless communication, etc. applied to the electronic device 100. The mobile communication module 191 may include a filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like.

The wireless communication module 192 may provide a solution for wireless communication applied to the electronic device 100, including Wireless Local Area Networks (WLANs), such as wireless fidelity (Wi-Fi) networks, Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 192 may be one or more devices that integrate at least one communication processing module.

In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 191 and antenna 2 is coupled to wireless communication module 192 so that electronic device 100 may communicate with other devices. Specifically, the mobile communication module 191 may communicate with other devices through the antenna 1, and the wireless communication module 191 may communicate with other devices through the antenna 2.

The display method according to the embodiment of the present application will be specifically described below with reference to the hardware configuration shown in fig. 7.

The first example is as follows:

fig. 8 is a schematic flow chart of a display method according to an embodiment of the present application, which includes the following steps.

Step 801, the electronic device 100 displays a video call interface on the display screen 140. The video call interface comprises a large window and a small window. The small window is suspended on the large window, the small window is used for displaying a first video picture, and the large window is used for displaying a second video picture.

The small window is suspended above the large window, and it can be understood that the small window is suspended above the second video frame for display, that is, the first video frame is suspended above a certain area in the second video frame for display, so that the first video frame can block an image displayed in the area of the second video frame.

Illustratively, the electronic device 100 displays a large window full screen. As another example, the electronic device 100 may also display the large window non-fullscreen.

Step 802, when the small window blocks the face in the second video image, the electronic device 100 adjusts the small window so that the face in the second video image is not blocked by the small window.

In some embodiments, the electronic device 100 may determine whether the small window obstructs a face in the second video picture by:

the electronic device 100 performs face recognition on the second video image and determines a target area in the second video image. The target area is used for displaying a human face, and may also be referred to as a human face area. Then, the electronic apparatus 100 determines whether there is an overlapping portion of the target area in the second video screen and the small window. If the target area in the second video image and the small window have an overlapping portion, the electronic device 100 determines that the small window blocks the face in the second video image. If there is no overlapping portion between the target area in the second video frame and the small window, the electronic device 100 determines that the small window does not block the face in the second video frame.

For example, the electronic device 100 performs face recognition on the second video frame based on the skin color model to determine the target region. For example, the electronic device 100 identifies regions in the second video picture where skin tones are relatively concentrated based on the skin tone model. Since the region with relatively concentrated skin color is usually displayed as a human face in the second video picture, the region with relatively concentrated skin color in the second video picture is determined as the target region. For example, the electronic device 100 converts the image in the second video frame into a grayscale image, divides the grayscale image into a skin color region and a non-skin color region based on a binarization algorithm (e.g., an Ostu algorithm), and determines that a region having an aspect ratio within a preset range in the skin color region is a region having relatively concentrated skin colors. The preset range may be [0.6, 2], and may be preset in the electronic device, or may be obtained from a server or a cloud. It should be noted that, in the embodiment of the present application, the above is only an exemplary description of a manner of face recognition, and the method is not limited thereto, and in the embodiment of the present application, the target area in the second video picture may also be determined by other manners, for example, a geometric feature method, a feature face method, and the like.

For example, the electronic device 100 determines whether there is an overlapping portion between the target area and the target window by determining whether the boundary of the target area falls within the small window. If the boundary of the target area falls within the small window, the electronic device 100 determines that there is an overlapping portion between the target area and the small window. If the boundary of the target area does not fall within the small window, the electronic device 100 determines that there is no overlapping portion between the target area and the small window. For example, a video call interface is shown in fig. 6, and includes a small window 601 and a large window 602. Wherein the boundary of the face region (i.e. the target region) in the second video picture falls within the small window 601. It should be noted that the above is only an exemplary illustration of a manner of determining whether there is an overlapping portion between the widget and the target area, and the present application is not limited to this, and in the embodiment of the present application, it may also be determined whether there is an overlapping portion between the widget and the target area by other manners, for example, a polygon intersection mesh algorithm, and the like.

Further, since the position, number, or the like of the faces in the second video frame may change during the video call, for example, the second video frame at time i in the video call is shown in fig. 9A, and the second video frame at time j in the video call is shown in fig. 9B, where the shaded portions shown in fig. 9A and 9B are used for displaying the faces in the second video frame, in order to reduce the possibility that the faces in the second video frame are blocked by the small window, in some embodiments, the electronic device 100 determines whether the small window blocks the faces in the second video frame every first time interval. The first duration may be 1 second, 2 seconds, 5 seconds, 15 seconds, or the like, and may be preset in the electronic device 100, or may be determined by the electronic device 100 according to a preset algorithm, which is not limited herein.

In some embodiments, when the small window blocks the face in the second video frame, the electronic device 100 may adjust the small window based on one or more of the following ways in combination so that the face in the second video frame is not blocked by the small window: moving the position of the small window, adjusting the size of the small window, adjusting the shape of the small window, adjusting the transparency of the small window and the like. It should be noted that the transparency of the small window can be understood as: transparency of a first video picture displayed within the small window. For example, if the transparency of the small window is set to the target value, the transparency of the first video image displayed in the small window is set to the target value.

The following describes a specific way for the electronic device to adjust the small window.

The first method is as follows: when the small window occludes the face in the second video picture, the electronic device 100 reduces the size of the small window so that the face in the second video picture is not occluded by the small window.

Illustratively, the electronic device 100 scales down the size of the window. Taking the shape of the small window as a rectangle as an example, the electronic device 100 reduces the size of the small window proportionally, which can be understood as: the aspect ratio of the small window after the adjustment is the same as the aspect ratio of the small window before the adjustment.

In some embodiments, the first video picture displayed within the widget is adapted to the widget. In other words, if the widget is reduced, the first video picture displayed within the widget is reduced in equal scale; and if the small window is enlarged, the first video picture displayed in the small window is enlarged in equal proportion. For example, as shown in fig. 10, when the small window a is reduced to the small window B, the first video picture displayed in the small window is also reduced in equal scale. Therefore, when the size of the small window is changed, the visual field range presented to the user by the video picture displayed in the small window is not reduced. It should be noted that, in other embodiments, if the small window is enlarged, the scale of the first video frame displayed in the small window remains unchanged, and since the size of the small window is enlarged and the scale of the video frame in the small window remains unchanged, the visual field of the video frame presented to the user in the small window is also enlarged accordingly.

Take fig. 11 as an example. The video call interface displayed by the electronic device 100 on the display screen 140 is shown in fig. 11A and includes a small window a and a large window B. The small window a blocks the human face area (i.e., the target area C) of the second video image displayed in the large window B, as shown by the shaded portion in fig. 11A. The electronic device 100 scales the small window a until there is no overlapping portion of the small window a and the target area C. For example, the electronic device 100 may have a size of the scaled-down small window a as shown by the shaded portion in fig. 11B.

In addition, since the video image is dynamically changed during the video call, in order to reduce the possibility that the face in the second video image is blocked by the small window during the video call, the electronic device 100 may determine whether the small window blocks the face in the second video image every first time period. And if the face in the second video picture is blocked by the small window, reducing the size of the small window. However, in a video call, the small window becoming smaller may affect the visual effect of the user, and therefore, in further another embodiment, the electronic device 100 determines whether the size of the small window is smaller than the default value 1 when determining that the face in the second video frame is not occluded by the small window, and when the size of the small window is smaller than the default value 1, the size of the small window is scaled up to X, and the small window does not occlude the face in the second video frame. Where X is not greater than threshold 1, or default value 1. Wherein the threshold value 1 may be N times the default value 1. For example, N is greater than or equal to 1 and not greater than 1.5, such as N being 1, 1.2, 1.5, and the like. For example, the electronic device 100 determines that the small window blocks a face in the second video frame at time T, and reduces the size of the small window to P, where P is smaller than the default value 1. However, after the first duration i, the electronic device 100 determines that the small window does not obscure the face in the second video picture at time (T + i), and further determines whether the size of the small window is smaller than the default value 1, because the size of the small window is P, and P is smaller than the default value 1, the electronic device 100 may enlarge the size of the small window to Q, where Q is greater than P, and Q is not greater than the threshold value 1. It should be noted that, after the size of the small window is enlarged to Q, the face in the second video image is not blocked by the small window.

The default value 1 may be the size of a small window preset in the electronic device 100, and may be set according to the needs of a user, or may be preset before the device leaves a factory, or the electronic device 100 may be determined according to a preset policy, which is not limited thereto. For example, the electronic apparatus 100 may set the size of the small window displayed on the display screen 140 to a default value of 1 in response to receiving a response to accept the video call request or an operation of the user clicking a virtual key for controlling the video call acceptance. For example, the electronic device 100 may receive a response accepting the video call request when the user a first initiates the video call request to the user B, and the size of the small window displayed on the display screen 140 is a default value of 1. For another example, the electronic apparatus 100 may set the size of the small window displayed on the display screen 140 to be a default value of 1 in response to the user's operation of clicking a virtual key for controlling the video call reception when the user B first initiates a video call request to the user a. For another example, the electronic device 100 may receive a response from the electronic device 200 to accept the video call request each time the user a initiates the video call request to the user B, and the size of the small window displayed on the display screen 140 is default 1. For another example, the electronic apparatus 100 may set the size of the small window displayed on the display screen 140 to a default value of 1 in response to the user's operation of clicking a virtual key for controlling the video call reception every time the user B initiates a video call request to the user a.

The second method comprises the following steps: when the small window blocks the face in the second video image, the electronic device 100 keeps the size of the small window unchanged, and moves the position of the small window in the display area of the display screen according to the first strategy until the position of the small window moves to a position where the face in the second video image is not blocked by the small window.

The first policy may be configured in the electronic device in advance, or may be determined by the electronic device based on the image layout in the second video screen, which is not limited to this. For example, the first policy may specify a movement trajectory or direction of the widget, and a movement step.

Take fig. 12 as an example. The second video picture is shown in fig. 12A, and includes a small window a and a large window B. In which the small window a and the large window B overlap each other as shown by the hatched portion in fig. 12A. The first strategy specifies the moving track and direction of the small window as shown in fig. 12A. For example, as shown in fig. 12B, when the small window a moves to the position 3, the human face in the second video picture is not blocked by the small window, and then the small window a stops moving.

As another example, the first policy may further specify that the movement trajectory and direction of the widget are as shown in fig. 13. As another example, the first policy may further specify that the movement trace of the widget is one circle along the four sides of the display screen. The embodiment of the present application does not limit the first policy.

It should be noted that the moving process of the widget a may not be visible to the user.

The third method comprises the following steps: when the small window blocks the face in the second video frame, the electronic device 100 keeps the size of the small window unchanged, and moves the position of the small window along the four sides of the display screen according to the second strategy until the small window moves for one circle along the four sides of the display screen. In the process that the small window moves for a circle along the four sides of the display screen, the electronic device 100 uses the position where the face in the second video picture is not occluded as the candidate position, and then the electronic device 100 moves the small window to the target candidate position in the at least one candidate position.

For example, when the small window is suspended on the area 1 in the second video image for display, and the small window blocks the face in the second video image, the target candidate position is an alternative position where a distance between the target candidate position and the center position of the area 1 is smaller than the threshold 2. Helping to reduce the line of sight movement of the user. As another example, the target candidate location may also be any one of the at least one candidate location, which is not limited herein.

The second policy may be configured in the electronic device in advance, or may be determined by the electronic device based on the image layout in the second video screen, which is not limited to this. For example, the second policy may specify a movement trajectory, direction, or movement step size of the widget.

Take fig. 14 as an example. The second video screen is shown in fig. 14A, and includes a small window a and a large window B. In which the small window a and the large window B overlap each other as shown by the hatched portion in fig. 14A. For example, as shown in fig. 14A, the small window a is moved clockwise by step 1 along the four sides of the display screen, and the movement is stopped after the small window a moves once along the four sides of the display screen. For example, as shown in fig. 14B, the area 3, the area 4, the area 5, the area 6, the area 7, the area 8, and the area 9 are positions that do not block the face in the second video frame during the small window a moves around along four sides of the display screen, and the areas 3 to 9 are alternative positions, where the area 1, the area 2, and the area 10 are positions that block the face in the video frame. For example, in the area 3 to the area 9, the center position of the area 3 is the closest candidate position to the center position of the area 1, and the electronic device 100 may move the position of the small window a so that the small window a is displayed in a floating manner on the area 3 in the second video picture.

It should be noted that the process of moving the small window a one-circle along the four sides of the display screen may not be visible to the user.

In addition, it should be noted that the electronic device 100 may also move the widget along other tracks, for example, the track shown in fig. 13 or the track shown in fig. 12A, which is not limited thereto.

The method is as follows: take the small window as a rectangle, the size of the small window in the video call interface is P, and the small window is displayed in the area 1 suspended in the second video picture as an example. When the small window occludes the face in the second video picture, the electronic device 100 constructs a rectangular frame 10 having a size P and being in equal proportion to the small window. Then, the electronic device 100 scales down the rectangular frame 10 on the area 1 until the rectangular frame does not block the face in the second video picture, resulting in a rectangular frame 20 with a size Q. The electronic device 100 moves the rectangular frame 20 within the display area of the display screen 140 starting from area 2 and following the third strategy until the rectangular frame is moved to area 3. In the area 3, the electronic device 100 may enlarge the size of the rectangular frame 20 to R in equal proportion to obtain the rectangular frame 30, where R is not less than P, and the rectangular frame 30 does not block the face in the second video frame. The electronic device 100 scales up the widget to R and moves the widget to the position of the rectangular frame 30.

Illustratively, R is not greater than the threshold 3, thereby avoiding the small window being too large and the area occluding the second video frame being too large. It should be noted that, the threshold 3 may refer to the related description of the threshold 1 in the first embodiment, and is not described herein again.

The third policy may also specify a moving track, a direction, a step length, and the like of the rectangular frame, for example, the moving track of the rectangular frame may be the periphery of the display screen, and the moving direction may be the clockwise direction. Specifically, the third policy may be configured in the electronic device 100 in advance, or the electronic device 100 may determine the third policy according to the image distribution in the second video frame, which is not limited to this.

Take fig. 15 as an example. The second video picture is shown in fig. 15A, and includes a small window a and a large window B. Wherein the small window a blocks the face in the second video frame displayed in the large window B, and the face area (i.e. the target area C) blocked by the small window a is shown by the shaded portion in fig. 15A. Taking the size of the small window a in fig. 15A as P and displaying on the area 1 in the second video frame as an example, as shown in fig. 15B, the electronic device 100 constructs a rectangular frame 10 with the size of P and in equal proportion to the small window a, and reduces the rectangular frame 10 on the area 1 in equal proportion to obtain a rectangular frame 20, wherein the rectangular frame 20 is suspended on the area 2 in the second video frame, and the face in the second video frame is not occluded by the rectangular frame 20. The electronic apparatus 100 moves the rectangular frame 20 by a certain step length in the positive direction of the horizontal X. For example, when the rectangular frame 20 moves to the area 3, the rectangular frame 20 overlaps the target area C, and the rectangular frame 20 continues to move. For another example, when the rectangular frame 20 moves to the area 4, there is no overlapping portion between the rectangular frame 20 and the target area C, and the electronic apparatus 100 enlarges the rectangular frames 20 to R in equal proportion to obtain the rectangular frame 30. There is no overlapping portion of the rectangular frame 30 with the target area C. The electronic device 100 enlarges the small window a to R in equal proportion, and moves to the position of the rectangular frame 30, so that the face in the second video picture is not blocked by the small window a.

The fifth mode is as follows: take the small window as a rectangle, the size of the small window in the video call interface is P, and the small window is displayed in the area 1 suspended in the second video picture as an example. When the small window blocks the face in the second video picture, the electronic device 100 constructs a rectangular frame 10 with a size P and in equal proportion to the small window. Then, the electronic device 100 scales down the rectangular frame 10 on the area 1 until the rectangular frame does not block the face in the second video picture, resulting in a rectangular frame 20 with a size Q. The electronic device 100 moves the rectangular frame 20 within the display area of the display screen 140 starting from area 2. If the rectangular frame 20 blocks the face in the second video picture after moving, the rectangular frame 20 is continuously moved, and if the rectangular frame 20 does not block the face in the second video picture after moving, the rectangular frames 20 to R are enlarged in equal proportion, and the rectangular frame enlarged to R does not block the face in the second video picture, so as to obtain the rectangular frame 30. The rectangular frame 30 is then moved. If the rectangular frame 30 blocks the face in the second video picture after moving, the rectangular frame 30 is continuously moved, and if the rectangular frame 30 does not block the face in the second video picture after moving, the rectangular frames 20 to S are enlarged in equal proportion, and the rectangular frame enlarged to S does not block the face in the second video picture, so as to obtain the rectangular frame 40. The rectangular frame 40, … … is then moved until it moves one revolution along the four sides of the display screen. It should be noted that, during the moving process of the rectangular frame, the size of the rectangular frame does not exceed the threshold 4 at most. And after the rectangular frame is enlarged to the threshold value 4, even if the rectangular frame does not shield the face in the second video picture in the moving process, the rectangular frame is not enlarged any more. Taking S as the threshold 4 as an example, after obtaining the rectangular frame 40, the electronic device 100 moves the rectangular frame 40, and if the rectangular frame 40 moves and blocks the face in the second video picture, the rectangular frame 40 continues to be moved; if the face in the second video picture is not occluded after the rectangular frame 40 is moved, the position of the rectangular frame 40 is taken as an alternative position, and then the rectangular frame 40 is continuously moved until the rectangular frame 40 moves for a circle along the four sides of the display screen. It should be noted that, the threshold 4 may refer to the description related to the threshold 1 in the first embodiment, and is not described herein again.

Further, in the case that the threshold 4 is greater than P, in other embodiments, after the size of the rectangular frame reaches the threshold 4, if the rectangular frame moves and blocks the face in the second video frame, the rectangular frame may be scaled down. For example, the rectangular frame may be reduced until the face in the second video frame is not occluded, resulting in the rectangular frame 50, and the size of the rectangular frame 50 is smaller than the threshold 4 and greater than or equal to P. For another example, the rectangular frame may be reduced to P, and the second video frame is still occluded, and then the rectangular frame is not reduced further, and then the rectangular frame with the size P is moved further until the rectangular frame moves for a circle along the four sides of the display screen.

In the process that the rectangular frame moves along the four sides of the display screen for one circle, the electronic device 100 uses the position of the rectangular frame which is not shielded by the human face in the second video picture as the alternative position. And the electronic equipment moves the small window to the target alternative position in the at least one alternative position, so that the small window does not shield the face in the second video picture.

Further, in some embodiments, the target candidate position is a candidate position having a distance from the center position of the area 1 smaller than the threshold 5 among the at least one candidate position. Thereby helping to reduce movement of the user's gaze. Or the target alternative position is an alternative position, of which the distance from the central position of the area 1 is smaller than a threshold value 5, of the at least one alternative position, and the size of the target alternative position is larger than a threshold value 6 of the at least one alternative position. The threshold 5 and the threshold 6 are preset in the electronic device, and may be set by the user according to the needs of the user, or may be set before the electronic device leaves the factory, and the like, which is not limited.

Take fig. 16 as an example. The second video screen is shown in fig. 16A, and includes a small window a and a large window B. In which there is an overlapping portion of the small window a and the target area C in the large window B, as shown by the hatched portion in fig. 16A. Taking the size of the small window a in fig. 16A as P, the small window is displayed floating on the area 1 in the second video frame as an example. As shown in fig. 16B, the electronic device 100 constructs a rectangular frame 10 of size P and in equal proportion to the small window a, and scales down the rectangular frame 10 equally on the area 1, resulting in a rectangular frame 20. The rectangular frame 20 is suspended on the area 2 in the second video picture, and the face in the second video picture is not occluded by the rectangular frame 20. Region 2 serves as an alternate location, such as alternate location 1. When the electronic apparatus 100 moves the rectangular frame 20 in the positive horizontal X direction from the area 2 by step 1 and the rectangular frame 20 is displayed in the area 3 and the rectangular frame 20 overlaps the target area C, the electronic apparatus continues to move the rectangular frame 20 in the positive horizontal X direction by step 1 from the area 3. If the rectangular frame 20 is displayed in the area 4 after the continuous movement, the electronic device 100 may enlarge the size of the rectangular frame to H in equal proportion to obtain the rectangular frame 30 since there is no overlapping portion between the area 4 and the target area C. Wherein there is just no overlap of the rectangular box 30 and the target area C, and H is not greater than the threshold 4. The area of the obtained rectangular frame 30 in the second video picture is taken as an alternative position, for example, alternative position 2. Then, the rectangular frame 30 is moved further in the positive horizontal X direction by step 2. However, if the rectangular frame 30 is moved in the positive direction of the horizontal X by step 2 starting from the alternative position 2, the boundary of the display screen is exceeded. Therefore, starting from candidate position 2, moving rectangular frame 30 in the positive direction of vertical Y by step 3, for example, moving rectangular frame 30 to area 5, and if there is just no overlapping portion between area 5 and target area C, then area 5 is regarded as a candidate position, for example, candidate position 3. The rectangular frame 30 continues to be moved in the positive vertical Y direction by step 2. For example, the rectangular frame 30 moves to the area 6, the area 6 does not have an overlapping portion with the target area C, and the electronic device 100 may enlarge the rectangular frame 30 to the threshold 4 in equal proportion, resulting in the rectangular frame 40, and the rectangular frame 40 still has no overlapping portion with the target area C. The resulting position of the rectangular frame 40 on the second video picture is therefore taken as an alternative position, for example alternative position 4. The rectangular box 40 continues to be moved in the positive vertical Y direction by step 4. However, starting from alternate position 4, moving rectangular box 40 in the positive vertical Y direction by step 4 exceeds the boundaries of the display screen, and so starting from alternate position 4, moving rectangular box 40 in the opposite horizontal X direction by step 5. Since the size of the rectangular box 40 is threshold 4, the rectangular box is not resized during subsequent movements. For example, when the rectangular frame 40 moves to the region 7, there is no overlapping portion between the rectangular frame 40 and the target region C, and therefore the region 7 may be used as an alternative position, for example, the alternative position 5. For example, the electronic device 100 may determine to move one circle along four sides of the display screen until the rectangular frame 40 is moved until there is an overlapping portion with the target area C. For example, when the rectangular frame 40 moves to the area 8, if there is an overlapping portion with the target area C, the movement of the rectangular frame is stopped. Step 1, step 2, step 3, step 4 and step 5 may be the same or different, and are not limited thereto. Therefore, as shown in fig. 16B, during the process that the rectangular frame moves one circle along the four sides of the display screen, the electronic device 100 finds at least one alternative location, such as area 1, area 5, area 7, and so on.

For example, in candidate positions 1 to 5, the area sizes of candidate position 4 and candidate position 5 are the largest, but the center position of candidate position 5 is closer to the center position of area 1, and therefore, electronic device 100 may zoom in widget a to threshold 4 in an equal scale and move widget a to candidate position 5 for display.

The method six: when the small window blocks the face in the second video image, the electronic device 100 adjusts the transparency of the small window, so that the user can see the face in the second video image blocked by the small window through the small window.

For example, the electronic device 100 may adjust the transparency of the widget by:

when the small window blocks the face in the second video image, the electronic device 100 determines whether the transparency of the small window is the target value, and if the transparency of the small window is not the target value, the transparency of the small window is adjusted to the target value.

For example, the target value may be preset by the user in the electronic device as needed, preset before the device is shipped, or the like, which is not limited thereto. For example, the target value is greater than or equal to 50%. Thereby being helpful to avoid the small window from blocking the face displayed in the large window. For example, the target value may be 80%, 90%, etc.

Take fig. 17 as an example. For example, as shown in fig. 17A, the small window a and the large window B have transparency of 0, that is, the first video frame displayed in the small window a is opaque. And the face in the second video picture displayed in the large window B is shielded by the small window A. The electronic device 100 adjusts the transparency of the small window to the target value, so that the first video image displayed in the small window a is transparent, and the user can see the face in the second video image blocked by the small window a through the small window a, as shown in fig. 17B, thereby being helpful to avoid the small window blocking the face displayed in the large window.

In some implementations, when the small window blocks the face in the second video frame, if the transparency of the small window is the target value, the electronic device 100 keeps the transparency of the small window unchanged.

In addition, since the video image is dynamically changed during the video call, in order to reduce the possibility that the face in the second video image is blocked by the small window during the video call, the electronic device 100 may determine whether the small window blocks the face in the second video image every first time period. And if the face in the second video picture is shielded by the small window, adjusting the transparency of the small window, so that the user can see the face in the second video picture shielded by the small window through the small window. However, in a video call, the transparency of the widget may affect the visual effect of the user, and therefore, in other embodiments, the electronic device 100 determines whether the transparency of the widget is the default value 2 when determining that the face of the person in the second video frame is not blocked by the widget. If the transparency of the widget is not the default value 2, the electronic device 100 adjusts the transparency of the widget to the default value 2. For example, the default value of 2 may be 0, i.e. the first video picture displayed within the small window is opaque. For example, if the transparency of the widget is a default value of 2, the electronic device 100 may keep the transparency of the widget unchanged. For example, the electronic device 100 determines that the small window blocks a face in the second video frame at time T, and adjusts the transparency of the small window to the target value. However, after the first duration i, the electronic device 100 determines that the small window does not block the face in the second video picture at the time (T + i), and further determines whether the transparency of the small window is smaller than the default value 2, and since the transparency of the small window is adjusted to the target value at the time T, the electronic device 100 may restore the transparency of the small window to the default value 2 when the small window does not block the face in the second video picture.

For example, electronic device 100 is an electronic device of an Andoid operating system, and electronic device 100 may adjust the transparency of the widget by adjusting the transparency of the widget in the layout file. For example, the transparency of the widget in the layout file is a target value, and after the transparency of the widget in the layout file is adjusted to be a default value 2, the transparency of the widget is the default value 2. For another example, the electronic device 100 is an electronic device of an IOS operating system, and the electronic device 100 can adjust the transparency of the small window by adjusting the color with Alpha Component. For example, color with Alpha Component is default 2, and after color with Alpha Component is adjusted to a target value, the transparency of the small window is the target value.

The above is merely an exemplary description of the manner of adjusting the widget, and does not constitute a limitation on the manner of adjusting the widget. For example, the electronic device 100 may also adjust the shape of a small window, and the like. For example, when the shape of the small window is rectangular, the face in the second video frame is occluded, and the electronic device 100 may adjust the small window to be an ellipse or other shape to avoid occluding the face in the second video frame.

Example two:

as shown in fig. 18, a schematic flow chart of another display method according to the embodiment of the present application specifically includes the following steps.

Step 1801, the electronic device 100 displays a video call interface on the display screen 140. The video call interface includes a small window and a large window. The small window is suspended on the large window, the small window is used for displaying a first video picture, and the large window is used for displaying a second video picture.

For step 1801, reference may be made to the related description of step 801 in example one, and details are not repeated here.

Step 1802, when the small window blocks the face in the second video frame, the electronic device 100 adjusts the large window so that the small window does not block the face in the second video frame.

It should be noted that, for the way that the electronic device 100 determines whether the small window blocks the face in the second video frame, reference may be made to relevant description in the first example, and details are not repeated here.

In some embodiments, when the small window occludes the face in the second video frame, the electronic device 100 may adjust the large window based on one or more of the following ways in combination so that the face in the second video frame is not occluded by the small window: moving the position of the large window, adjusting the size of the large window, etc.

The following describes a specific way for the electronic device to adjust the large window.

The method I comprises the following steps: when the small window blocks the face in the second video image, the electronic device 100 reduces the size of the large window, so that the face in the second video image is not blocked by the small window.

In some embodiments, the second video picture displayed within the large window is compatible with the large window. In other words, if the large window is reduced, the second video picture displayed within the large window is reduced in equal scale; if the large window is enlarged, the first image video picture displayed in the large window is enlarged in equal scale.

Take fig. 19 as an example. The video call interface is shown in fig. 19A, and includes a large window B and a small window a. The small window a blocks the face in the second video frame, and therefore, as shown in fig. 19B, the electronic device 100 reduces the large window B to a large window B' so that the small window a does not block the face in the second video frame.

In addition, since the video frame is dynamically changed during the video call, the electronic device 100 may determine whether the small window blocks the face in the second video frame at intervals of the first time period. Thereby helping to reduce the possibility that the face is occluded in the second video picture. If the face in the second video picture is shielded by the small window, the size of the large window is reduced, so that the small window does not shield the face in the second video picture. However, in the video call, the reduction of the large window may affect the visual effect of the user, and therefore, in another embodiment, when determining that the face in the second video frame is not blocked by the small window, the electronic device 100 may further determine whether the size of the large window is the default value 3, and enlarge the large window when the size of the large window is smaller than the default value 3, and after the large window is enlarged, the face in the second video frame is still not blocked by the small window. For example, the default value 3 may be a maximum value of the size of the large window, which may be preset in the electronic device 100.

For example, the electronic apparatus 100 determines that the small window blocks a face in the second video frame at time T, and reduces the size of the large window to a. However, after the first duration i, the electronic device 100 determines that the small window does not block the face in the second video frame at time (T + i), and further determines whether the size of the large window is smaller than the default value 3, because the size of the large window is reduced to a at time T, and a is smaller than the default value 3, the electronic device 100 may enlarge the large window until the face in the second video frame does not overlap with the small window exactly when the small window does not block the face in the second video frame.

The second method comprises the following steps: when the small window blocks the face in the second video image, the electronic device 100 moves the position of the large window along the target direction, so that the face in the second video image is not blocked by the small window.

For example, the target direction may be predefined, for example, the target direction is a direction in which the center position of the small window points to the center position of the large window. As another example, the target direction may also be determined by the electronic device 100 according to the position of the small window floating in the second video frame and the position of the human face in the second video frame, in combination with a preset algorithm.

Take fig. 20 as an example. For example, the second video screen is shown in fig. 20A, and includes a small window 1 and a large window 2. The small window 1 blocks the face in the second video picture. As shown in fig. 20B, the electronic apparatus 100 keeps the size of the large window unchanged, and moves the position of the large window in the vertical Y direction, so that the display screen 140 displays the large window in the area 2. In other embodiments, electronic device 100 displays a blank, or a pattern (e.g., a wallpaper pattern), or a desktop background, etc., within region 1 of display screen 140. It should be noted that the electronic device 100 may also be along a vector

Or the positive direction of the horizontal X, where B is the center position of the small window and a is the center position of the large window.

In addition, in some embodiments, after the electronic device 100 moves the position of the large window, if a part of the face in the second video picture is displayed on the display screen, the size of the second video picture may also be adjusted, so that after the position of the large window is moved, the face in the second video picture can be completely displayed on the display screen, and the visual effect of the user in the video call is not affected.

In addition, since the video frame is dynamically changed during the video call, the electronic device 100 may determine whether the small window blocks the face in the second video frame at intervals of the first time period. Thereby helping to reduce the possibility that the face is occluded in the second video picture. And if the face in the second video picture is shielded by the small window, moving the position of the large window to ensure that the small window does not shield the face in the second video picture. However, in the video call, in the case that the large window is displayed in a full screen by default, moving the position of the large window may cause that the complete large window cannot be displayed on the display screen, and may affect the visual effect of the user, and therefore, in some other embodiments, when determining that the face in the second video frame is not blocked by the small window, the electronic device 100 may further determine whether the large window is located in the default position. If the large window is not located at the default position, the position of the large window can be moved to the direction opposite to the target direction until the face in the second video picture is just not shielded by the small window before the large window is moved to the default position, or if the large window is moved to the default position, the face in the second video picture is not shielded by the small window, the large window is moved to the default position and then stops moving. The default position may be preset in the electronic device 100, and may be a position where the large window is displayed on the display screen 140 when the electronic device 100 responds to a response of receiving a video call request or a user clicks a virtual key for controlling video call reception.

For example, when the electronic device 100 determines that the small window blocks the face in the second video frame at the time T and the large window is located at the default position, the position of the large window is moved along the target direction, so that the small window does not block the face in the second video frame. However, after the first duration i, the electronic device 100 determines that the small window does not block the face in the second video frame at the time (T + i), and further determines whether the position of the large window is the default position, because the large window moves from the position at the time T to the default position, the electronic device 100 may move the position of the large window in the opposite direction of the target direction at the time (T + j) under the condition that the small window does not block the face in the second video frame, and move to the position where the large window does not block the face in the second video frame just before moving to the default position, or, if the large window moves to the default position, the small window does not block the face in the second video frame, and then the large window stops moving after moving to the default position.

Take the default position of the large window as full screen display as an example. The video call interface is shown in fig. 21 and includes a small window a and a large window B. The position of the large window B is not the default position, and the small window a does not occlude the face in the second video image, and the electronic device 100 may move the position of the large window in the opposite direction of the vertical Y until the small window a does not occlude the face in the second video image.

The above is merely an exemplary introduction of the manner of adjusting the large window, and does not constitute a limitation on the manner of adjusting the large window.

In some embodiments, when the intelligent anti-blocking function is turned on, the electronic device 100 executes the display method of the embodiment of the present application during a video call, so as to prevent a small window (floating window) from blocking a face in a video frame displayed in a large window (main window), thereby facilitating interaction between the electronic device and a user. Illustratively, the user can turn on the intelligent anti-blocking function through the video call setting interface. For example, the video call setup interface may include a virtual key 2201 for controlling turning on or off the smart anti-blocking function as shown in fig. 22A. The electronic device 100 may turn ON the smart anti-blocking function in response to an operation of the user setting the virtual key 2201 to ON (ON). The electronic apparatus 100 may turn OFF the smart anti-blocking function in response to an operation of the user setting the virtual key 2201 to OFF (OFF).

Additionally, in some embodiments, for example one and example two, determining whether the widget occludes a face in the second video frame may be performed by a server or a cloud, and sending the determination to the electronic device 100. For example, the electronic device 100 may send the video call interface to the server or the cloud end every preset time through the wireless communication module 192 and/or the mobile communication module 191, and determine whether the small window blocks the face in the second video frame based on the video call interface by the server or the cloud end.

In some embodiments, the electronic device 100 may report the video call interface to the cloud or the server after the user authorizes the electronic device in advance because of user privacy. For example, the user may authorize the electronic device in advance by performing corresponding setting on the video call setting interface, and allow the electronic device to report the video call interface to the cloud or the server.

In addition, in some embodiments, the electronic device 100 may further support local execution of the display method according to the embodiment of the present application, or support combination of a cloud or a server and the local execution of the display method according to the embodiment of the present application, and specifically which method is adopted may be used by a user to perform corresponding setting according to own needs.

Illustratively, the user may include a local option 2206 and a server option 2206, as shown in video channel 20A. The electronic device 100 detects that the local option 2205 is selected, and executes the display method of the embodiment of the present application through the processor 110. The electronic device 100 detects that the server option 2206 is selected, and performs the display method of the embodiment of the present application in a manner that the server and the processor 110 are combined. For example, when the user selects the server option 2206, the default user authorizes the electronic device, and may upload the video call interface to the cloud or the server as desired.

In some embodiments, the electronic device 100 supports multiple ways of preventing the floating window from obstructing a face in a video picture displayed within the main window (hereinafter referred to as an anti-obstructing way), such as moving the floating window, moving the main window, or reducing the transparency of the floating window. For example, the priority of the pre-configured anti-blocking mode from high to low is as follows: moving the floating window, moving the main window, and reducing transparency. For example, the electronic device 100 may move the floating window when the floating window blocks a face in a video frame displayed in the main window, move the main window if the floating window is reduced, and adjust the transparency of the floating window to the target value if the face in the main window displayed on the display screen is incomplete after the face displayed in the main window is moved.

For another example, when the electronic device 100 supports multiple anti-blocking modes, the corresponding method may be executed according to the anti-blocking mode selected by the user. For example, as shown in fig. 22A, the electronic device sets an anti-blocking manner option 2203 on the video call setting interface, and the user may operate the anti-blocking manner option 2203, so that the electronic device 100 displays an anti-blocking manner list on the display screen 140 in response to the above operation, and the user may select one from the anti-blocking manner list, as shown in fig. 22A, when the floating window is selected by the user, the electronic device 100 avoids the floating window blocking a face in a video picture displayed in the main window based on the manner of moving the floating window.

For example, the above embodiments may be applied to one application installed on the electronic device 100 for video call, and may also be applied to two or more applications installed on the electronic device 100 for video call, specifically, which applications may be configured according to user needs. For example, a user may set which applications installed in the electronic device 100 can be adapted to the display method according to the embodiment of the present application through the video call setting interface. For example, applications installed on the electronic device 100 that can be used for video telephony include telephony, WeChat, and QQ. With the video call setting interface as shown in fig. 22A, the user can cause the electronic apparatus 100 to display, on the display screen 140, a list of applications that can be used for video call, which includes a phone identification, a WeChat identification, and a QQ identification, installed on the electronic apparatus 100 in response to the operation described above by operating the application-adapted option 2201. When the user selects all the application identifiers in the list, the method of the embodiment of the present application can be automatically executed when the user uses the phone, the WeChat, or the QQ on the electronic device 100 to perform a video call, so as to avoid the floating window from blocking the video picture displayed in the main window. In addition, the user may select part of the application identifiers in the list according to the self-requirement, for example, when the user selects a phone identifier, and the user uses the phone to perform a video call, the electronic device 100 may automatically execute the method of the embodiment of the present application, so as to avoid the floating window from blocking the video picture displayed in the main window. However, when the user uses WeChat or QQ to perform a video call, the electronic device 100 does not perform the method of the embodiment of the present application. It is noted that in some embodiments, when electronic device 100 detects that a new application for video telephony is installed, such as a spike, electronic device 100 may automatically add a spike identification to the list of applications for video telephony. Alternatively, when detecting that a certain application installed for video call, such as WeChat, is uninstalled on the electronic device 100, the electronic device 100 may delete the WeChat identifier in the application list for video call.

In addition, in the video call, the implementation manner of avoiding the occlusion of other objects (such as clothes, animals, antiques, plants, and the like) in the video picture displayed in the main window by the floating window is similar to the implementation manner of avoiding the occlusion of the human face in the video picture displayed in the main window by the floating window. It should be noted that, the electronic device 100 may intelligently identify the target on the video call interface displayed in the main window according to different video call scenes, and determine whether the target in the main window is blocked by the floating window, and if the target in the main window is blocked by the floating window, the floating window may be moved, or the main window may be moved, or the transparency of the floating window may be reduced, and specifically, refer to an implementation manner for avoiding the floating window blocking the face in the video picture displayed in the main window, which is not described herein again. Alternatively, the electronic device 100 may also set an object to avoid being occluded by the floating window according to the user's needs. In an example, a user can set an interface setting for avoiding a target shielded by the floating window according to the user's own needs. For example, as shown in fig. 22A, the user may operate the anti-occlusion object option 2202 to cause the electronic device 100 to display an anti-occlusion object list on the display screen 140 in response to the operation, where the anti-occlusion object list includes one or more anti-occlusion objects, such as a human face, clothes, a cat, a dog, and the like. The user can select one or more anti-blocking targets from the anti-blocking target list according to the self requirement so as to avoid the floating window from blocking the anti-blocking target selected by the user in the video picture displayed in the main window, and therefore user experience is improved. Taking the anti-occlusion target list 2207 shown in fig. 22B as an example, a user can slide up and down in the anti-occlusion target list 2207, so that the user can view the anti-occlusion targets in the anti-occlusion target list 2207 and select one or more anti-occlusion targets from the anti-occlusion target list 2207 according to the needs of the user.

The above embodiments in the present application can be used alone or in combination with each other to achieve different technical effects.

In the embodiments provided in the present application, the method provided in the embodiments of the present application is described from the perspective of an electronic device as an execution subject. In order to implement the functions in the method provided by the embodiments of the present application, the electronic device may include a hardware structure and/or a software module, and the functions are implemented in the form of a hardware structure, a software module, or a hardware structure and a software module. Whether any of the above functions is implemented as a hardware structure, a software module, or a combination of a hardware structure and a software module depends upon the particular application and design constraints imposed on the technical solution.

Based on the same concept, fig. 23 illustrates an electronic device 2300 of the present application, where the electronic device 2300 includes a display 2310 and a de-occlusion module 2320. For example, the display screen 2310 may be used to display a video call interface. For example, the de-occlusion module 2320 may be configured to adjust the small window or the large window when the small window occludes a face in the second video picture.

In some embodiments, the electronic device 2300 further comprises a recognition decision module 2330, the recognition decision module 2330 to determine whether a small window occludes a face in the second video frame, and so forth.

In addition, each functional module in the embodiments of the present application may be integrated into one functional module, or each functional module may exist alone physically, or two or more functional modules may be integrated into one functional module.

Based on the same concept, as shown in fig. 24, an electronic device 2400 is further provided in the embodiments of the present application. By way of example, the electronic device 2400 includes a processor 2410, a memory 2420, and a display screen 2430. The processor 2410 is coupled to the memory 2420 and the display 2430, and in this embodiment, the coupling may be a communication connection, an electrical connection, or another connection.

The electronic device 2400 further includes one or more computer programs, where the one or more computer programs are stored in the memory, and when the computer programs are executed by the electronic device 2400, the electronic device 2400 is caused to execute the display method provided in the embodiment of the present application. It should be understood that the electronic device 2400 may be configured to implement the ranging method according to the embodiment of the present application, and reference may be made to the above for relevant features, which are not described herein again.

The processors referred to in the various embodiments above may be general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software modules may be located in a Random Access Memory (RAM), a flash memory, a read-only memory (ROM), a programmable ROM, an electrically erasable programmable memory, a register, or other storage media that are well known in the art. The storage medium is located in a memory, and a processor reads instructions in the memory and combines hardware thereof to complete the steps of the method.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one type of logical functional division, and other divisions may be realized in practice, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application shall be covered by the scope of the present application, and therefore the scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method of displaying, the method comprising:

the method comprises the steps that the electronic equipment displays a video call interface on a display screen, wherein the video call interface comprises a first window and a second window; the first window is used for displaying a first video picture, the second window is used for displaying a second video picture, and the first window is suspended on the second window;

when the first window obstructs the face of the person in the second video picture, executing the following steps to enable the face of the person in the second video picture not to be obstructed by the first window:

the first window is a first rectangular frame, and when the first window shields the face in the second video picture, the electronic equipment reduces the first rectangular frame until the face in the second video picture is not shielded, so that a second rectangular frame is obtained; the electronic equipment moves the second rectangular frame until the second rectangular frame is moved to a position where the face in the second video picture is not shielded, the second rectangular frame is amplified to a first value, a third rectangular frame is obtained, and the face in the second video picture is not shielded by the third rectangular frame; when the first value is larger than or equal to the size of the first rectangular frame, the electronic equipment stops moving the third rectangular frame, moves the first window to the position where the third rectangular frame is located, and adjusts the size of the first window, so that the size of the first window after the position is moved is the same as the size of the third rectangular frame; or

The first window is a first rectangular frame, and when the first window covers the face in the second video picture, the electronic equipment reduces the first rectangular frame until the face in the second video picture is not covered, so that a second rectangular frame is obtained; the electronic equipment moves the second rectangular frame, and when the second rectangular frame shields the face in the second video picture in the moving process, the second rectangular frame is continuously moved; when the second rectangular frame does not shield the face in the second video picture, amplifying the second rectangular frame to a second value to obtain a third rectangular frame, wherein the third rectangular frame does not shield the face in the second video picture, and the second value is smaller than a second threshold value, wherein the second threshold value is the maximum value of the first window; moving the third rectangular frame, and when the third rectangular frame covers the face in the second video picture in the moving process, continuing to move the third rectangular frame; when the third rectangular frame does not shield the face in the second video picture, amplifying the third rectangular frame to the second threshold value to obtain a fourth rectangular frame, wherein the fourth rectangular frame does not shield the face in the second video picture; moving the fourth rectangular frame until the fourth rectangular frame moves around the four sides of the display screen for a circle, and taking the positions of the third rectangular frame and the fourth rectangular frame which do not shield the face in the second video picture as alternative positions; the electronic device moves the position of the first window so that the first window is suspended on a second target alternative position selected from at least one alternative position.

2. The method of claim 1, wherein the steps further comprise:

the electronic equipment adjusts the transparency of the first window, so that a user can see the face, which is shielded by the first window, on the second video picture through the first window.

3. An electronic device, characterized in that the electronic device comprises a display screen; one or more processors; a memory; and one or more computer programs;

wherein the one or more computer programs are stored in the memory, the one or more computer programs, when invoked for execution by the one or more processors, cause the electronic device to perform the steps of:

displaying a video call interface on a display screen, wherein the video call interface comprises a first window and a second window; the first window is used for displaying a first video picture, the second window is used for displaying a second video picture, and the first window is suspended on the second window;

when the first window covers the face in the second video picture, executing the following steps to ensure that the face in the second video picture is not covered by the first window:

the first window is a first rectangular frame, and when the first window covers the face in the second video picture, the first rectangular frame is reduced until the face in the second video picture is not covered, so that a second rectangular frame is obtained; moving the second rectangular frame until the second rectangular frame is moved to a position where the face in the second video picture is not shielded, and amplifying the second rectangular frame to a first value to obtain a third rectangular frame, wherein the face in the second video picture is not shielded by the third rectangular frame; when the first value is larger than or equal to the size of the first rectangular frame, stopping moving the third rectangular frame, moving the first window to the position of the third rectangular frame, and adjusting the size of the first window to enable the size of the moved position of the first window to be the same as the size of the third rectangular frame; or

The first window is a first rectangular frame, and when the first window shields the face in the second video picture, the first rectangular frame is reduced until the face in the second video picture is not shielded, so that a second rectangular frame is obtained; moving the second rectangular frame, and continuously moving the second rectangular frame when the second rectangular frame covers the face in the second video picture in the moving process; when the second rectangular frame does not shield the face in the second video picture, amplifying the second rectangular frame to a second value to obtain a third rectangular frame, wherein the third rectangular frame does not shield the face in the second video picture, and the second value is smaller than a second threshold value; the second threshold is the maximum value of the first window, the third rectangular frame is moved, and in the moving process, when the third rectangular frame covers the face in the second video picture, the third rectangular frame is continuously moved; when the third rectangular frame does not shield the face in the second video picture, amplifying the third rectangular frame to the second threshold value to obtain a fourth rectangular frame, wherein the fourth rectangular frame does not shield the face in the second video picture; moving the fourth rectangular frame until the fourth rectangular frame moves around the four sides of the display screen for a circle, and taking the positions of the third rectangular frame and the fourth rectangular frame which do not shield the face in the second video picture as alternative positions; and moving the position of the first window so that the first window is suspended on a second target alternative position selected from at least one alternative position.

4. The electronic device of claim 3, wherein the steps further comprise:

and adjusting the transparency of the first window so that a user can see the face, which is shielded by the first window, on the second video picture through the first window.

5. A computer storage medium, comprising a computer program which, when run on an electronic device, causes the electronic device to perform the method of claim 1 or 2.

6. Program product, characterized in that it, when run on a computer, causes the computer to carry out the method according to claim 1 or 2.

7. A chip, characterized in that the chip is coupled with a memory in an electronic device, such that the chip, when running, invokes a computer program stored in the memory, implementing the method of claim 1 or 2.