CN114257670B

CN114257670B - Display method of electronic equipment with folding screen

Info

Publication number: CN114257670B
Application number: CN202210184577.7A
Authority: CN
Inventors: 吕建明; 冯帅
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-02-28
Filing date: 2022-02-28
Publication date: 2022-07-05
Anticipated expiration: 2042-02-28
Also published as: CN114257670A; CN116723256A

Abstract

A display method of electronic equipment with a folding screen relates to the technical field of terminals and can solve the problem that in the process of switching the screen state of the electronic equipment, displayed images sent by an inner screen and an outer screen are staggered. The electronic equipment comprises an inner screen and an outer screen, the camera of the electronic equipment comprises a first camera and a second camera, the first camera is a front camera of the inner screen, the second camera is a front camera of the outer screen, and the display method comprises the following steps: acquiring a first image acquired by a camera of electronic equipment; determining whether the first image meets a first preset condition or not in the process of changing the folded state of the screen by the electronic equipment; under the condition that the first image meets a first preset condition, a target display screen of the electronic equipment is controlled to present the first image, the first preset condition comprises that a camera acquiring the first image is matched with the target display screen, and the target display screen is a display screen of the current image displayed by the electronic equipment or a display screen of the current image to be displayed by the electronic equipment.

Description

Display method of electronic equipment with folding screen

Technical Field

The application relates to the technical field of terminals, in particular to a display method of electronic equipment with a folding screen.

Background

With the continuous development of electronic equipment and display screens and the improvement of the living demands of people, the electronic equipment with the folding function of the display screen is produced. At present, a camera function is a common function provided by electronic equipment, and a user can perform video call, photograph or video recording and the like through the electronic equipment. The inner and outer screen cameras of the electronic equipment with the foldable screen are dynamically switched along with the folding and unfolding of the screen. For example, when the user uses the inner screen, the inner screen presents a preview image acquired by a camera arranged on the inner screen; when the user uses the outer screen, the outer screen presents a preview image collected by a camera arranged on the outer screen. However, in the process of switching the internal and external screens of the electronic device, the screen-transmitted image may be misaligned. For example, the electronic device has switched from the outer screen display to the inner screen display, but the preview image displayed in the inner screen of the electronic device is still the image captured by the camera of the outer screen.

Disclosure of Invention

The embodiment of the application provides a display method of electronic equipment with a folding screen. From this, electronic equipment has ensured that the target display screen that shows the image and the camera phase-match that send the display image, for example, the image that the leading camera of outer screen display gathered, the image that the leading camera of inner screen display gathered in the outer screen display, when having solved the interior, the outer screen switching of folding screen, the problem that the screen sent the display image dislocation, has improved user and has used experience.

In order to achieve the purpose, the technical scheme is as follows:

in a first aspect, an embodiment of the present application provides a display method for an electronic device with a foldable screen, where the electronic device includes an inner screen and an outer screen, and a camera of the electronic device includes a first camera and a second camera, where the first camera is a front-facing camera of the inner screen and the second camera is a front-facing camera of the outer screen, and the display method includes: acquiring a first image acquired by a camera of electronic equipment; determining whether the first image meets a first preset condition or not in the process of changing the folded state of the screen by the electronic equipment; under the condition that the first image meets a first preset condition, a target display screen of the electronic equipment is controlled to present the first image, the first preset condition comprises that a camera acquiring the first image is matched with the target display screen, and the target display screen is a display screen of the current image displayed by the electronic equipment or a display screen of the current image to be displayed by the electronic equipment.

The first image may be an image captured by the first camera or an image captured by the second camera.

It is understood that the process of the electronic device changing the screen folding state may be that the electronic device gradually transits from the unfolded state to the folded state, or that the electronic device gradually transits from the folded state to the unfolded state.

In an embodiment, in the process that the electronic device is in the unfolded state to the folded state, the electronic device determines whether the first image meets a first preset condition, and if the electronic device determines that the first image is an image acquired by the second camera, that is, the first image is an image acquired by a front camera of the external screen, the electronic device determines that the first image meets the first preset condition, and the target display screen of the electronic device presents the first image, wherein the target display screen is the external screen of the electronic device.

In another embodiment, in the process that the electronic device is in the folded state to the unfolded state, the electronic device determines whether the first image meets a first preset condition, and if the electronic device determines that the first image is an image acquired by the first camera, that is, the first image is an image acquired by a front camera of the inner screen, the electronic device determines that the first image meets the first preset condition, and the target display screen of the electronic device presents the first image, wherein the target display screen is the inner screen of the electronic device.

In the embodiment of the application, in the process that the screen state of the electronic device changes, the electronic device determines that the camera acquiring the first image is matched with the target display screen, for example, the outer screen displays the image acquired by the front camera of the outer screen, and the inner screen displays the image acquired by the front camera of the inner screen, so that the problem that the screen transmits the display image to be staggered when the inner screen and the outer screen of the folding screen are switched is solved, and the user experience is improved.

In one possible implementation, determining whether the first image satisfies a first preset condition includes: under the condition that the first image is the image acquired by the first camera and the target display screen is the inner screen, the first image meets a first preset condition; or, the first image meets a first preset condition under the condition that the first image is an image acquired by the second camera and the target display screen is an outer screen.

It can be understood that, if the electronic device determines that the first image acquired by the camera is an image acquired by a front camera of the inner screen, and the target display screen is the inner screen, the electronic device determines that the camera of the acquired first image is matched with the target display screen, that is, the first image meets the first preset condition. If the electronic equipment determines that the first image collected by the camera is the image collected by the front camera of the outer screen and the target display screen is the outer screen, the electronic equipment determines that the camera of the collected first image is matched with the target display screen, namely the first image meets a first preset condition.

In another possible implementation manner, determining whether the first image satisfies a first preset condition includes: under the condition that the first image is the image acquired by the first camera and the target display screen is the outer screen, the first image does not meet a first preset condition; or, under the condition that the first image is the image acquired by the second camera and the target display screen is the inner screen, the first image does not meet the first preset condition.

It can be understood that if the electronic device determines that the first image collected by the camera is an image collected by a front camera of the inner screen and the target display screen is the outer screen, the electronic device determines that the camera of the collected first image is not matched with the target display screen, that is, the first image does not satisfy the first preset condition. If the electronic equipment determines that the first image collected by the camera is the image collected by the front camera of the outer screen and the target display screen is the inner screen, the electronic equipment determines that the camera of the collected first image is not matched with the target display screen, namely the first image does not meet a first preset condition.

In another possible implementation manner, the display method may further include: under the condition that the first image does not meet a first preset condition, controlling a target display screen of the electronic equipment to present a second image, wherein the second image is an image which is stored in the electronic equipment in advance and is acquired by a camera matched with the target display screen; or, under the condition that the first image does not meet the first preset condition, controlling the target display screen of the electronic equipment not to present the first image.

The second image may be a history image acquired by a camera matched with a target display screen pre-stored by the electronic device, for example, the second image may be an image acquired by a front camera of an external screen pre-stored by the electronic device under the condition that the target display screen is the external screen; in the case that the target display screen is an inner screen, the second image may be an image collected by a front camera of the inner screen, which is stored in advance by the electronic device.

In some embodiments, when a first image acquired by the electronic device and acquired by the camera does not satisfy a first preset condition, a pre-stored image acquired by the camera and matched with the target display screen may be displayed in the target display screen.

In other embodiments, when a first image acquired by the electronic device through the camera does not satisfy a first preset condition, the target display screen of the electronic device does not display the first image. In this case, the target display screen of the electronic device is a black screen, a white screen, or displays a specific image.

In another possible implementation manner, after acquiring a first image acquired by a camera of an electronic device, the display method may further include: determining that the image identifier of the first image is a first identifier under the condition that the first image is the image acquired by the first camera; determining the image identifier of the first image as a second identifier under the condition that the first image is the image acquired by the second camera; determining whether the first image satisfies a first preset condition, including: and determining whether the first image meets a first preset condition according to the image identifier of the first image and the target display screen.

It can be understood that the electronic device marks the identifier of the first image according to the camera that acquired the first image. For example, the image identifier of the first image acquired by the first camera is marked as a first identifier, and the image identifier of the first image acquired by the second camera is marked as a second identifier.

In another possible implementation manner, determining whether the first image satisfies a first preset condition according to the image identifier of the first image and the target display screen includes: under the condition that the target display screen is an inner screen and the image identifier of the first image is the first identifier, determining that the first image meets a first preset condition; and under the condition that the target display screen is an outer screen and the image identifier of the first image is the second identifier, determining that the first image meets a first preset condition.

It can be understood that the image identifier of the first image is the first identifier, that is, the first image is an image collected by the first camera, and when the target display screen is an inner screen, the electronic device determines that the first image meets the first preset condition. The image identification of the first image is the second identification, namely the first image is an image collected by the second camera, and when the target display screen is an outer screen, the electronic equipment determines that the first image meets a first preset condition.

Therefore, the electronic equipment can determine the camera for acquiring the first image according to the image identifier of the first image, and the electronic equipment determines that the camera for acquiring the first image is matched with the target display screen, so that the problem of dislocation in the process of screen switching of the electronic equipment due to the fact that the image acquired by the camera is sent and displayed is solved.

In another possible implementation manner, in a case that the first image satisfies a first preset condition, controlling a target display screen of the electronic device to present the first image includes: determining that the image identifier of the first image is a third identifier, wherein the third identifier is used for indicating that the first image is directly sent and displayed; and controlling the target display screen of the electronic equipment to present the first image with the third identifier.

In an embodiment, in the case that the electronic device determines that the camera acquiring the first image matches the target display screen, the electronic device may mark the image identifier of the first image as the third identifier. Therefore, when the electronic equipment determines that the image identifier of the first image is the third identifier, the electronic equipment can directly display the first image in the target display screen, so that the camera of the acquired first image is ensured to be matched with the target display screen, and the problem of misplacement display of the image acquired by the camera in the screen switching process of the electronic equipment is avoided.

In another possible implementation manner, the method further includes: and under the condition that the first image does not meet the first preset condition, determining that the image identifier of the first image is a fourth identifier, wherein the fourth identifier is used for indicating that the first image is discarded.

In an embodiment, in a case that the electronic device determines that the camera acquiring the first image does not match the target display screen, the electronic device may mark the image identifier of the first image as the fourth identifier. When the electronic equipment determines that the image identifier of the first image is the fourth identifier, the target display screen of the electronic equipment does not display the first image until the first image is displayed on the target display screen when the image identifier of the first image acquired by the electronic equipment is the third identifier.

When the target display screen of the electronic equipment does not display the first image, the target display screen of the electronic equipment can display a second image, wherein the second image is an image acquired by a camera matched with the target display screen and stored in the electronic equipment in advance.

In another possible implementation manner, the inner screen of the electronic device includes a first screen and a second screen, and before determining whether the first image satisfies the first preset condition, the method further includes: and determining that the electronic equipment is in the process of changing the folding state of the screen according to the included angle between the first screen and the second screen.

In one embodiment, when the electronic device determines that the included angle between the first screen and the second screen is gradually reduced, the electronic device determines that the screen state is changed from the unfolded state to the folded state; when the electronic equipment determines that the included angle between the first screen and the second screen is gradually increased, the electronic equipment determines that the screen state is changed from the folded state to the unfolded state.

In the process that the screen state of the electronic equipment is changed, the electronic equipment can acquire the included angle between the first screen and the second screen in real time, and then the electronic equipment judges the current screen state according to the included angle, so that the accuracy of determining the screen state of the electronic equipment is improved.

In a second aspect, the present application provides an electronic device, which includes an inner screen and an outer screen, and further includes a first camera and a second camera, wherein the first camera is a front camera of the inner screen, and the second camera is a front camera of the outer screen. The electronic device has the function of implementing the method according to the first aspect. The function can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above. For example, the electronic device includes a processing module for acquiring a first image acquired by a camera of the electronic device; determining whether a first image meets a first preset condition or not in the process of changing the folded state of the screen by the electronic equipment; under the condition that the first image meets a first preset condition, a target display screen of the electronic equipment is controlled to present the first image, the first preset condition comprises that a camera acquiring the first image is matched with the target display screen, and the target display screen is a display screen of the current image displayed by the electronic equipment or a display screen of the current image to be displayed by the electronic equipment.

In a third aspect, the present application provides an electronic device, comprising: the touch screen comprises a touch sensor and a display screen; one or more processors; a memory; wherein one or more computer programs are stored in the memory, the one or more computer programs comprising instructions which, when executed by the electronic device, cause the electronic device to perform the display method of the electronic device with a folding screen as described in any of the above first aspects.

In a fourth aspect, the present application provides a computer-readable storage medium, in which instructions are stored, and when the instructions are executed on an electronic device, the instructions cause the electronic device to perform the display method of the electronic device with a foldable screen according to any one of the first aspect.

In a fifth aspect, the present application provides a computer program product comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the display method of the electronic device with a foldable screen according to any one of the first aspect.

It is to be understood that the electronic device according to the second and third aspects, the computer storage medium according to the fourth aspect, and the computer program product according to the fifth aspect are all configured to execute the corresponding method provided above, and therefore, the beneficial effects achieved by the electronic device may refer to the beneficial effects in the corresponding method provided above, and are not described herein again.

Drawings

Fig. 1 is a schematic view of a folding screen mobile phone provided in an embodiment of the present application when folded;

fig. 2 is a schematic view of a foldable screen mobile phone according to an embodiment of the present disclosure when unfolded;

fig. 3 is a first schematic application scenario diagram of a display method according to an embodiment of the present application;

fig. 4 is a schematic view of an application scenario of a display method according to an embodiment of the present application;

fig. 5 is a schematic view of an application scenario of the display method according to the embodiment of the present application;

fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 7 is a schematic diagram illustrating a principle of calculating an included angle between a screen a and a screen B according to an embodiment of the present application;

FIG. 8 is a schematic diagram of an example of a geographic coordinate system provided by an embodiment of the present application;

fig. 9 is a software structure diagram of an electronic device according to an embodiment of the present application;

fig. 10 is a first flowchart illustrating a display method according to an embodiment of the present application;

fig. 11 is a schematic view of an application scenario of the display method according to the embodiment of the present application;

fig. 12 is an exemplary diagram of a cache structure provided in an embodiment of the present application;

fig. 13 is a second flowchart illustrating a display method according to an embodiment of the present application;

fig. 14 is a schematic view of an application scenario of the display method according to the embodiment of the present application;

fig. 15 is a schematic view six of an application scenario of a display method according to an embodiment of the present application;

fig. 16 is another schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments herein, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" herein is merely an association relationship describing an associated object, and means that there may be three relationships, for example, a and/or B, and may mean: a exists alone, A and B exist simultaneously, and B exists alone.

In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of the present application, "a plurality" means two or more unless otherwise specified.

In the embodiments of the present application, words such as "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "such as" is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.

The electronic device in the embodiment of the application comprises a foldable screen, wherein the foldable screen can be unfolded or folded along a folding axis, and different display areas can be presented in different states. Taking the electronic device as a folding screen mobile phone as an example, it is described that the electronic device presents different display areas in different states.

Fig. 1 is a schematic view of a folding screen mobile phone provided in an embodiment of the present application when folded. As shown in fig. 1 (a), when the folding screen mobile phone is in a fully folded state and the outer screen front camera 1 is opened, an image acquired by the outer screen front camera 1 is displayed by the outer screen 11. As shown in fig. 1 (b), when the folding screen mobile phone is in a folded state and the external screen rear camera 2 is used for showing, an image acquired by the external screen rear camera 2 is displayed by the external screen 11.

Fig. 2 is a schematic view of a mobile phone with a folding screen according to an embodiment of the present application when the mobile phone is unfolded. The unfolding process of the folding screen mobile phone is shown in fig. 2 (a) to 2 (b). As shown in fig. 2 (b), when the folding screen mobile phone is in the unfolded state and the inner screen front camera 3 is used for drawing, an image acquired by the inner screen front camera 3 is displayed by the inner screen 21 or the inner screen 22, or displayed by a large screen formed by the inner screen 21 and the inner screen 22. When the folding screen mobile phone in fig. 2 is in the fully unfolded state, for example, as shown in (b) in fig. 2, the screen included angle θ of the mobile phone may be 180 ° or approximately 180 °, so that large-screen display can be achieved, richer information can be provided for a user, and better use experience can be brought to the user. Wherein the screen angle θ may be an angle between the inner screen 21 and the inner screen 22. As shown in fig. 2 (c), the foldable screen presents an outer screen 23 as viewed from the outside of the foldable-screen handset. When the folding screen mobile phone is in an unfolded state and the outer screen rear camera 1 is used for showing pictures, images collected by the outer screen rear camera 1 are displayed by the outer screen 23. The outer screen 23 may be disposed on the back of the inner screen 21 or the inner screen 22, which is only illustrated in fig. 2 as an example and is not limited herein. When the folding screen mobile phone is in an unfolded state and the outer screen front camera 2 is used for drawing, images collected by the outer screen front camera 2 can be displayed by the inner screen 21 and/or the inner screen 22.

It should be noted that the included angle θ between the inner screen 21 and the inner screen 22 may be in a range of [0 °, 180 ° ]. In the embodiment of the application, if theta is in a range of [0 degrees and X ], it can be determined that the folding screen mobile phone is in a folding state, and if theta is in a range of (X, 180 degrees ], it can be determined that the folding screen mobile phone is in an unfolding state, where X is a preset angle threshold value, X can be set in the electronic device by a user, or can be determined by the electronic device according to a use habit of the user, a value of X is not limited in the embodiment of the application.

Illustratively, as shown in fig. 1 (a), when the folding-screen mobile phone is in a folded state and a user uses the outer-screen front camera 1 to perform a video call or a photo preview, the folding-screen mobile phone uses the outer-screen front camera 1 to capture an image, and the outer screen 11 displays the image captured by the outer-screen front camera 1. The folding screen mobile phone responds to the operation of manually opening the folding screen by a user, and the folding screen is switched from a folding state to an unfolding state. For example, the unfolded state of the folding screen mobile phone is shown in fig. 2 (b). The folding screen mobile phone uses the inner screen front-facing camera 3 to collect images, and the inner screen 21 and/or the inner screen 22 displays the images collected by the inner screen front-facing camera 3. Therefore, when the folding screen mobile phone is in a video or photographing scene, the camera of the folding screen mobile phone is switched along with the screen state, the process that the image is collected by the outer screen front camera 1 and is switched to the image is collected by the inner screen front camera 3 is realized, and the process that the image is displayed by the outer screen and is switched to the image displayed by the inner screen is realized.

Similarly, as shown in fig. 2 (b), when the folding-screen mobile phone is in the unfolded state and the user uses the inner-screen front camera 3 to perform a video call or a photo preview, the folding-screen mobile phone uses the inner-screen front camera 3 to capture an image, and the inner screen 21 and/or the inner screen 22 displays the image captured by the inner-screen front camera 3. The folding screen mobile phone responds to the operation of manually combining the folding screens by a user, and the folding screens are switched from an unfolding state to a folding state. For example, the folded state of the folding screen mobile phone is shown in fig. 1 (a). The folding screen mobile phone uses the front camera 1 of the outer screen to collect images, and the images collected by the front camera 1 of the outer screen are displayed by the outer screen 11. Therefore, when the folding screen mobile phone is in a video or photographing scene, the camera of the folding screen mobile phone is switched along with the screen state, the process of switching the image acquisition by the inner screen front camera to the image acquisition by the outer screen front camera is realized, and the process of switching the image display by the inner screen to the image display by the outer screen is realized.

It should be noted that the image mentioned in the embodiment of the present application may represent a photograph, and may also represent each frame of image in a video, which is not limited herein. However, in the related art, in the process of switching the screen of the foldable screen of the electronic device, when the screen state is switched, the switching of the camera corresponding to the image is not completed, or when the switching of the camera used for the image is completed, the switching of the screen used for displaying the image is not completed, so that the image display may be misaligned when the screen sends the image.

In some embodiments, as shown in fig. 3 (a), when the folding screen of the electronic device is switched from the screen 1 to the screen 2, the electronic device has completed switching of the cameras, that is, the camera used for capturing an image has been switched from the camera corresponding to the screen 1 to the camera corresponding to the screen 2. However, the screen 2 of the electronic device is not yet lighted, and at this time, the image displayed on the screen 1 is the image captured by the camera corresponding to the screen 2. The screen 1 may be an external screen of a folding screen of the electronic device. The screen 2 may be an internal screen of a folding screen of the electronic device. Of course, the screen 1 may also be an external screen of the electronic device, and the second screen is an internal screen of a foldable screen of the electronic device, which is not limited herein.

And if the screen 1 is an outer screen, the camera corresponding to the screen 1 is a front camera of the outer screen. If the screen 1 is an inner screen, the camera corresponding to the screen 1 is a front camera of the inner screen. Similarly, if the screen 2 is an outer screen, the camera corresponding to the screen 2 is a front camera of the outer screen. If the screen 2 is an inner screen, the camera corresponding to the screen 2 is a front camera of the inner screen. In the same way as above, the first and second,

still taking the above-mentioned fig. 1 and fig. 2 as an example for explanation, assuming that the screen 1 is the outer screen 11 of the folding-screen mobile phone shown in (a) of fig. 1, the camera corresponding to the screen 1 may be the outer-screen front-facing camera 1 shown in (a) of fig. 1. Assuming that the screen 2 is a large screen formed by the inner screen 21 and the inner screen 22 of the folding-screen mobile phone shown in (b) of fig. 2, the camera corresponding to the screen 2 may be the inner-screen front camera 3 shown in (b) of fig. 2.

Illustratively, as shown in fig. 4, when the electronic device is in a folded state, a camera application of the electronic device captures an image in response to a shooting operation of a user, and a screen 1 of the electronic device displays the image captured by an outer screen front camera 41, see (a) in fig. 4. In the process that the folding screen of the electronic equipment responds to the user to switch from the folding state to the unfolding state, a camera used for collecting images in the electronic equipment is switched to the front camera of the inner screen from the front camera of the outer screen. As shown in fig. 4, the camera of the electronic device that captures the image is switched from the outer screen front camera 41 to the inner screen front camera 42. However, when the camera switching in the electronic apparatus is completed, the screen 2 of the electronic apparatus is not yet lighted. I.e. the screen switching of the electronic device is not yet completed. In this case, the image captured by the internal front camera 42 of the electronic device is still displayed on the screen 1, and the screen 2 is in a black screen state, see (b) in fig. 4.

In other embodiments, as shown in fig. 3 (b), when the electronic device is switched from the screen 1 to the screen 2, the screen 2 of the electronic device is already lighted, but the camera corresponding to the screen 2 of the electronic device does not send an image (for example, the camera corresponding to the screen 2 is still in the initialization phase). In this case, the image displayed on the screen 2 of the electronic device is the image captured by the camera corresponding to the current screen 1.

Illustratively, as shown in fig. 5, when the electronic device is in a folded state, a camera application of the electronic device captures an image in response to a shooting operation of a user, and a screen 1 of the electronic device displays the image captured by an outer screen front camera 51, see (a) in fig. 5. The folding screen of the electronic apparatus switches the screen displaying images in the electronic apparatus from the screen 1 to the screen 2 in response to the user's operation to switch from the folded state to the unfolded state. As shown in fig. 5, the screen displaying an image in the electronic apparatus is switched from screen 1 to screen 2. However, when the screen switching in the electronic device is completed, the internal/external screen front-facing camera of the electronic device is not yet switched. I.e. the electronic device is not switched from the outer screen front camera 51 to the inner screen front camera 52. In this case, an image (for example, a balloon in the air) collected by the outer-screen front camera 51 when the foldable screen is in the unfolded state is displayed in the screen 2 of the electronic device, see (b) in fig. 5.

It should be noted that the outer screen of the folding screen in fig. 1 to 5 displays the image sent by the outer screen front-facing camera, and the inner screen displays the image sent by the inner screen front-facing camera, which are only described as examples. In the embodiment of the application, the outer screen can also display the image sent and displayed by the rear camera, and the inner screen can also display the image sent and displayed by the rear camera.

Therefore, the embodiment of the application provides a display method of an electronic device with a folding screen, and the method controls a target display screen of the electronic device to present an image acquired by a camera under the condition that the electronic device determines that the camera acquiring the image is matched with the target display screen. For example, the electronic device marks an image acquired by a camera according to the image acquired by the camera, and then a target display screen of the electronic device presents an image acquired by the camera matched with the target display screen, or the electronic device marks the image acquired by the camera according to whether the display screen of the current display image is matched with the camera of the acquired image, and then determines to display the image acquired by the camera matched with the display screen of the current display image. From this, electronic equipment has ensured that the target display screen of the display image of folding screen and the camera phase-match that send the display image, for example, the image that the leading camera of outer screen display gathered, the image that the leading camera of inner screen display gathered, when having solved the screen state switching of folding screen, the problem that the screen sent the display image dislocation has improved user and has used and experienced.

The folding screen of the electronic device may be a multi-screen folding screen. The multi-screen folding screen may include a plurality (two or more) of screens. The plurality of screens are a plurality of individual display screens. The plurality of screens may be connected in turn by a folding shaft. Each screen can rotate around a folding shaft connected with the screen, and folding of the multi-screen folding screen is achieved.

For example, the display method of the electronic device provided in the embodiment of the present application may be applied to an electronic device with a display screen, such as a mobile phone, a tablet computer, a Personal Computer (PC), a Personal Digital Assistant (PDA), a smart watch, a netbook, a wearable electronic device, an Augmented Reality (AR) device, a Virtual Reality (VR) device, an in-vehicle device, an intelligent vehicle, and an intelligent audio device, and the embodiment of the present application does not limit the electronic device.

As shown in fig. 6, fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a Subscriber Identification Module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It is to be understood that the illustrated structure of the embodiment of the present application does not specifically limit the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors.

The controller may be, among other things, a neural center and a command center of the electronic device 100. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

The I2C interface is a bi-directional synchronous serial bus that includes a serial data line (SDA) and a Serial Clock Line (SCL). In some embodiments, processor 110 may include multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces, respectively. For example: the processor 110 may be coupled to the touch sensor 180K via an I2C interface, such that the processor 110 and the touch sensor 180K communicate via an I2C bus interface to implement the touch functionality of the electronic device 100.

The I2S interface may be used for audio communication. The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals. The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication.

MIPI interfaces may be used to connect processor 110 with peripheral devices such as display screen 194, camera 193, and the like. The MIPI interface includes a Camera Serial Interface (CSI), a Display Serial Interface (DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the capture functionality of electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the electronic device 100.

In this embodiment of the application, the processor 110 may control the MIPI interface switch to close the inner screen front-facing camera and open the image showing path of the inner screen front-facing camera, or control the MIPI interface switch to close the outer screen front-facing camera and open the image showing path of the inner screen front-facing camera, thereby achieving the purpose of switching the image showing paths of the cameras.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal. The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transmit data between the electronic device 100 and a peripheral device. And the method can also be used for connecting a headset and playing audio through the headset. The interface may also be used to connect other electronic devices, such as AR devices and the like.

It should be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only an illustration, and does not limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The charging management module 140 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194.

The wireless communication module 160 may provide a solution for wireless communication applied to the electronic device 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.

The electronic device 100 implements display functions via the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, with N being a positive integer greater than 1.

In the embodiment of the present application, the display screen 194 of the electronic device 100 may be a flexible folding screen. The flexible folding screen comprises a folding edge made of flexible materials. Part or all of the flexible folding screen is made of flexible materials. The two screens formed by folding the flexible folding screen are a complete screen of an integral structure, and the two screens can be understood as two display areas. Alternatively, the foldable screen of the electronic device may be a multi-screen foldable screen. The multi-screen folding screen may include multiple (two or more) screens. The plurality of screens are a plurality of individual display screens. The plurality of screens may be connected in turn by a folding shaft. Each screen can rotate around a folding shaft connected with the screen, and folding of the multi-screen folding screen is achieved. The electronic device 100 may implement a shooting function through the ISP, the camera 193, the video codec, the GPU, the display 194, the application processor, and the like.

The ISP is used to process the data fed back by the camera 193. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, the electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

In the embodiment of the present application, the camera 193 may include an outer screen front camera, an inner screen front camera, a rear camera, and the like.

The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to perform fourier transform or the like on the frequency bin energy.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. Applications such as intelligent recognition of the electronic device 100 can be realized through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.

The internal memory 121 may be used to store computer-executable program code, which includes instructions. The processor 110 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as audio data, phone book, etc.) created during use of the electronic device 100, and the like. In addition, the internal memory 121 may include a high speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a Universal Flash Storage (UFS), and the like.

The electronic device 100 may implement audio functions via the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playing, recording, etc.

The headphone interface 170D is used to connect a wired headphone. The headset interface 170D may be the USB interface 130, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used for sensing a pressure signal, and converting the pressure signal into an electrical signal.

The gyro sensor 180B may be used to determine the motion attitude of the electronic device 100. In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., the x, y, and z axes) may be determined by gyroscope sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects a shake angle of the electronic device 100, calculates a distance to be compensated for by the lens module according to the shake angle, and allows the lens to counteract the shake of the electronic device 100 through a reverse movement, thereby achieving anti-shake. The gyroscope sensor 180B may also be used for navigation, somatosensory gaming scenes. In the embodiment of the present application, the foldable screen of the electronic device 100 can be folded to form a plurality of screens. A gyro sensor 180B may be included in each screen to measure the orientation (i.e., the directional vector of the orientation) of the corresponding screen. The electronic device 100 may determine the included angle between adjacent screens according to the measured angle change of the orientation of each screen.

It should be noted that, in the embodiment of the present application, the electronic device includes a foldable screen, and the foldable screen is divided into a plurality of display areas after the electronic device is folded, where each display area is referred to as a screen. A gyro sensor 180B may be included on each screen to measure the orientation (i.e., the directional vector of the orientation) of the corresponding screen. For example, as shown in fig. 2 (a), the electronic device is folded to form a first screen and a second screen, each of which is provided with a gyro sensor 180B, and the orientations of the first screen and the second screen may be measured, respectively. And the electronic equipment determines the included angle between the first screen and the second screen according to the measured orientation angle change of each screen.

For example, the electronic apparatus 100 is folded to form a first screen (diagram a screen) in which the gyro sensor a is provided and a second screen (diagram B screen) in which the gyro sensor B is provided, as shown in fig. 7. Here, the present embodiment describes a principle that the gyro sensor a measures the orientation of the a screen (i.e., the directional vector of the orientation), the gyro sensor B measures the orientation of the B screen (i.e., the directional vector of the orientation), and a principle that the electronic apparatus 100 calculates the angle θ between the a screen and the B screen from the orientation of the a screen and the orientation of the B screen.

Wherein the coordinate system of the gyro sensor is a geographical coordinate system. As shown in fig. 8, the origin O of the geographic coordinate system is located at the point where the vehicle (i.e., the device containing the gyro sensor, such as the electronic device 100) is located, the x-axis points east (E) along the local latitude, the y-axis points north (N) along the local meridian, and the z-axis points upward along the local geographic vertical line, and forms a right-hand rectangular coordinate system with the x-axis and the y-axis. The plane formed by the x axis and the y axis is the local horizontal plane, and the plane formed by the y axis and the z axis is the local meridian plane. Thus, it can be understood that the coordinate system of the gyro sensor is: the gyroscope sensor is used as an origin O, the east direction along the local latitude line is used as an x axis, the north direction along the local meridian line is used as a y axis, and the upward direction along the local geographical vertical line (namely the opposite direction of the geographical vertical line) is used as a z axis.

The electronic apparatus 100 can measure the direction vector of the orientation of each screen in the coordinate system of the gyro sensor provided therein, using the gyro sensor 180B provided in each screen. For example, referring to the side view of the electronic device as shown in fig. 7, the directional vector of the orientation of the a screen measured by the electronic device in the coordinate system of the gyro sensor a is vector z1, and the directional vector of the orientation of the B screen in the coordinate system of the gyro sensor B is vector z 2. The electronic apparatus 100 can calculate the angle α between the vector z1 and the vector z2 by using the formula (1). Wherein, the formula (1) is as follows:

as can be seen from fig. 7, since the vector z1 is perpendicular to the a screen and the vector z2 is perpendicular to the B screen, the angle θ =180 ° - α between the a screen and the B screen can be obtained. That is, the electronic device determines the angle θ between the a screen and the B screen according to the measured direction vector of the orientation of the a screen in the coordinate system of the gyro sensor a (i.e., the vector z 1) and the direction vector of the orientation of the B screen in the coordinate system of the gyro sensor B (i.e., the vector z 2).

It should be noted that although the positions of the gyro sensors disposed in the a screen and the B screen do not overlap, that is, the origins of the coordinate systems of the gyro sensors of the a screen and the B screen do not overlap, the x-axis, the y-axis, and the z-axis of the two coordinate systems are parallel, so that the coordinate systems of the gyro sensors disposed in the a screen and the B screen can be considered to be parallel. Thus, although the vector z1 and the vector z2 are not in the same coordinate system, the angle α between the vector z1 and the vector z2 can be calculated by the above equation (1) because the axes of the two coordinate systems are parallel.

In some embodiments, the angle θ between the a screen and the B screen can also be measured by one or more other sensors. For example, one acceleration sensor 180E may be provided in each screen of the folding screen. The electronic device 100 (e.g., the processor 110) may measure the motion acceleration of each screen θ as it is rotated using the acceleration sensor; and then calculating the rotation angle of one screen relative to the other screen according to the measured motion acceleration, namely the included angle theta between the screen A and the screen B.

In other embodiments, the gyro sensor 180B may be a virtual gyro sensor formed by combining other sensors. The virtual gyroscope sensor can be used for calculating the included angle between adjacent screens of the folding screen, namely the included angle theta between the screen A and the screen B.

The air pressure sensor 180C is used to measure air pressure.

The magnetic sensor 180D includes a hall sensor. The electronic device 100 may detect the opening and closing of the flip holster using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip, the electronic device 100 may detect the opening and closing of the flip according to the magnetic sensor 180D. And then according to the opening and closing state of the leather sheath or the opening and closing state of the flip cover, the automatic unlocking of the flip cover is set.

The acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary. The method can also be used for identifying the posture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and the like.

A distance sensor 180F for measuring a distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, taking a picture of a scene, electronic device 100 may utilize range sensor 180F to range for fast focus.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light to the outside through the light emitting diode. The electronic device 100 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 may determine that there are no objects near the electronic device 100. The electronic device 100 can utilize the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear for talking, so as to automatically turn off the screen to achieve the purpose of saving power. The proximity light sensor 180G may also be used in a holster mode, a pocket mode automatically unlocks and locks the screen.

The ambient light sensor 180L is used to sense ambient light brightness. Electronic device 100 may adaptively adjust the brightness of display screen 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust the white balance when taking a picture. The ambient light sensor 180L may also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 can utilize the collected fingerprint characteristics to unlock the fingerprint, access the application lock, photograph the fingerprint, answer an incoming call with the fingerprint, and so on.

The temperature sensor 180J is used to detect temperature.

The touch sensor 180K is also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation applied thereto or nearby. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided through the display screen 194. In other embodiments, the touch sensor 180K may be disposed on a surface of the electronic device 100, different from the position of the display screen 194.

The bone conduction sensor 180M may acquire a vibration signal.

Indicator 192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be brought into and out of contact with the electronic apparatus 100 by being inserted into the SIM card interface 195 or being pulled out of the SIM card interface 195. The electronic device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support a Nano SIM card, a Micro SIM card, a SIM card, etc. The same SIM card interface 195 can be inserted with multiple cards at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 195 may also be compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as communication and data communication. In some embodiments, the electronic device 100 employs esims, namely: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

The software system of the electronic device may employ a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the invention takes an Android system with a layered architecture as an example, and exemplarily illustrates a software structure of an electronic device.

Fig. 9 is a software structure diagram of an electronic device according to an embodiment of the present application.

It will be appreciated that the hierarchical architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system may include an application layer (referred to as an application layer for short), an application framework layer (referred to as a framework layer for short), a Hardware Abstraction Layer (HAL), and a kernel layer.

The application layer may include a series of application packages.

As shown in fig. 9, the application package may include a system application. The system application refers to an application that is set in the electronic device before the electronic device is shipped from the factory. Exemplary system applications may include programs for cameras, gallery, calendar, music, short messages, and phone calls.

The application package may also include a third party application, which refers to an application that the user installs after downloading the installation package from an application store (or application marketplace). For example, map applications (e.g., hundred degree map, Gade map, etc.), takeaway applications (e.g., Mei Tu, hungry, etc.), reading applications (e.g., electronic book), social applications (e.g., West Xin), and trip applications (e.g., dripping knocking) and the like.

The application framework layer provides an Application Programming Interface (API) and a programming framework for an application of the application layer. The application framework layer includes a number of predefined functions.

As shown in fig. 9, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, a folding screen management module, a camera service module, a background service module, and the like.

The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

Content providers are used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide communication functions of the electronic device. Such as management of call status (including on, off, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.

The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to notify download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, text information is prompted in the status bar, a prompt tone is given, the mobile phone vibrates, and an indicator light flickers.

The folding screen management module is used for determining the screen state of the folding screen according to the angle between the first screen and the second screen of the folding screen. Illustratively, the folding screen may be connected by the first screen and the second screen through a folding shaft. As shown in fig. 2, the first screen may be an inner screen 21, the second screen may be an inner screen 22, and an angle between the first screen and the second screen may be an angle between the inner screen 21 and the inner screen 22.

The camera service module is used for determining the image to be sent and displayed and sending the image to be sent and displayed to the application program.

And the background service module is used for sending the screen state to the camera providing module after receiving the screen state sent by the folding screen management module.

The HAL is a generic interface that performs a layer of encapsulation on the underlying hardware drivers and provides the calling drivers to the application framework layer.

In an embodiment of the present application, the HAL may include a camera providing module and a label setting module.

The camera providing module is used for determining the target camera according to the screen state.

The label setting module is used for marking the image collected by the target camera.

The kernel layer is a layer between hardware and software. The kernel layer at least comprises a display driver, a camera driver, an ISP driver and an audio driver.

In some embodiments, the camera drive may include an outer screen front camera drive and an inner screen front camera drive, wherein the outer screen front camera drive may be used to drive the outer screen front camera and the inner screen front camera drive may be used to drive the inner screen front camera. In addition, the camera drive may further include a rear camera drive.

The ISP drive is used for acquiring the image collected by the camera.

The technical solutions involved in the following embodiments can be implemented in the electronic device 100 having the above-described hardware structure and software architecture. The electronic device 100 is taken as an example of a folding-screen mobile phone, and the present solution is exemplarily described below.

In the embodiment of the application, the camera application in the mobile phone responds to the shooting operation (for example, clicking or touching) of the user, and the camera is used for shooting the image, or the social application in the mobile phone (for example, microcomputer, QQ @, etc.) responds to the operation of the user, and the camera is used for video call or shooting the image. When the screen state of the folding screen of the mobile phone changes, namely the screen displaying the preview image in the mobile phone is switched, the camera acquiring the image is also switched. For example, after the screen state of the folding screen of the mobile phone is switched from the folding state to the unfolding state, the screen for displaying the preview image in the mobile phone is switched from the outer screen to the inner screen, and the image displayed in the display screen is switched from the image acquired by the outer screen front-facing camera to the image acquired by the inner screen front-facing camera.

When the screen state of the folding screen is switched from the folding state to the unfolding state, the camera of the picture is switched from the outer screen front-facing camera to the inner screen front-facing camera, which is only used as an exemplary description. In this embodiment of the application, when the screen state of the folding screen changes, the camera that makes a picture can be switched from the front camera to the rear camera, also can be switched from the rear camera to the front camera, also can be switched from the rear camera 1 to the rear camera 2, and this is not limited here.

In the embodiment of the application, when the internal/external screen front-facing camera of the mobile phone is dynamically switched along with the screen state of the folding screen, the problem that the internal/external screen front-facing camera sends and displays images and the screen state is switched asynchronously may exist, and the situation that the sent and displayed images are staggered exists in the process of switching the internal screen and the external screen.

In the embodiment of the application, in the process that an application program in the mobile phone requests to make a picture, the external screen front-facing camera and the internal screen front-facing camera in the mobile phone may both collect images, and therefore the mobile phone needs to determine a final target image to be sent and displayed from the images collected by the external screen front-facing camera and the internal screen front-facing camera.

In some embodiments, a tag setting module of a hardware abstraction layer of the mobile phone may mark an image acquired by a camera, for example, the tag setting module marks an image acquired by a front-facing inner-screen camera as a first identifier, and marks an image acquired by a front-facing outer-screen camera as a second identifier. The first identification and the second identification are respectively used for uniquely marking images collected by the inner screen front-facing camera and the outer screen front-facing camera. After the label setting module sends the marked image to the camera service module, the camera service module can determine a target image for display sending from the marked image according to a screen of the current display image. Specific implementation procedures can be exemplarily seen in the implementation procedure of fig. 10 as follows.

As shown in fig. 10, the display method may include:

and S11, the application program sends the map request to the ISP drive through the camera service module.

The image request is used for acquiring an instruction of a camera for sending and displaying an image. Herein, the application program may be a system application (e.g., a camera application) of the mobile phone, or a third party application (e.g., microcomputer, QQ, etc.) in the mobile phone, which is not limited herein.

In the embodiment of the application, when a mobile phone with a folding screen starts a shooting function of a camera application, or a social application program in the mobile phone responds to user operation to carry out video call, the camera application or the camera application program sends a picture making request to a camera providing module.

Alternatively, the application program may first send an image request to the camera service module, and then the camera service module sends the received image request to the camera providing module.

For example, fig. 11 (a) shows a user interface diagram of a folding screen mobile phone, and when the mobile phone detects that a user clicks an icon of a camera application on a desktop and starts the camera application to perform self-timer shooting, a shooting interface as shown in fig. 11 (b) is displayed. The shooting interface can comprise a view frame, and the preview image can be displayed in the view frame in real time. In response to the start of the camera application, the camera application sends an image request to the camera providing module. It should be noted that, in the photographing mode and the video recording mode (i.e., the video photographing mode), the size of the viewfinder frame may be the same or different, and is not limited herein. For example, the finder frame shown in (b) in fig. 11 may be a finder frame in the photographing mode. In the video mode, the viewfinder may also be the entire touch screen.

And S12, the ISP drives to acquire the image collected by the camera.

In the embodiment of the application, after the mobile phone receives a map making request sent by an application program, the ISP drive controls the camera drive to trigger the outer screen front-facing camera and the inner screen front-facing camera to collect images, and then the outer screen front-facing camera and the inner screen front-facing camera send the collected images to the ISP drive. Or the ISP drive controls the camera to drive to trigger the front camera or the inner screen front camera to send the acquired image to the ISP drive.

It is understood that the ISP driver may acquire an image from the camera as long as the camera is capable of outputting the image. That is to say, in the embodiment of the present application, the ISP driver may acquire an image captured by a camera from the camera that is currently outputting the image.

And S13, the ISP driver sends the image collected by the camera to the label setting module through the camera providing module.

And S14, the label setting module marks the image collected by the camera.

In this embodiment of the application, when the tag setting module marks an image acquired by a camera, a tag may be marked on a buffer (buffer) corresponding to an image frame acquired by the camera. The cache corresponding to the image frame collected by the camera is used for storing image data and corresponding Metadata (Metadata). Metadata, also called intermediate data and relay data, is mainly information describing data attributes and is used to support functions such as indicating storage locations, history data, resource lookup, file recording, and the like.

Fig. 12 is an exemplary diagram of a buffer structure corresponding to an image frame according to an embodiment of the present disclosure, and as shown in fig. 12, the buffer structure may include a frame number, camera metadata, and image data of a preview image. Wherein the number of frames indicates that the image is a few frame image. The camera metadata may store therein an aperture, a focal length, an exposure time, and the like of the target camera. In the embodiment of the application, the tag setting module adds a tag in the metadata of the camera for marking the camera which displays the image. Therefore, when the screen of the mobile phone sends the display image, the corresponding image can be displayed according to the label added in the cache of the image, the problem of misplaced image sending and displaying is avoided, and the use experience of a user is improved.

In an embodiment, if the image acquired by the camera through the tag setting module is an image acquired by a front-facing outer-screen camera, the tag setting module may mark a first identifier on a tag in the cache of the image frame. The first identification is used for marking the image as an image collected by a front-facing camera of the outer screen.

In another embodiment, if the image acquired by the tag setting module is an image acquired by a front camera of an inner screen, the tag setting module may mark a second identifier on a tag in a cache of the image frame. The second identification is used for marking the image as an image collected by a front camera of the inner screen.

It should be explained that the image captured by the camera received by the tag setting module may be one frame or multiple frames. And under the condition that the images collected by the cameras and received by the label setting module are multiple frames, the label setting module marks each frame of image according to the corresponding camera of each frame of image. For example, assuming that the tag setting module acquires 3 frames of images, if the tag setting module determines that the first frame of image is an image acquired by the front-facing outer-screen camera, the tag setting module marks an image identifier of the frame of image as a first identifier. If the label setting module determines that the second frame of image is the image collected by the front-facing inner-screen camera, the label setting module marks the image identifier of the frame of image as a second identifier. And if the label setting module determines that the third frame of image is the image acquired by the inner screen front camera, the label setting module marks the image identifier of the frame of image as a second identifier.

And S15, the label setting module sends the marked image collected by the camera to the camera service module.

And S16, the camera service module determines the target image to be displayed according to the screen of the current display image.

In this embodiment of the application, after the camera service module obtains the mark sent by the label setting module and the image acquired by the camera, the camera service module may determine the target image to be sent and displayed according to the screen of the currently displayed image.

For example, as shown in fig. 11, after a camera application in a mobile phone is started, in a process that a folding screen is unfolded in response to an unfolding operation of a user, and when a screen state of the mobile phone is in an unfolded state, as shown in fig. 11 (c), a camera service module determines that a screen currently displaying an image is an inner screen, and a camera service module determines that a target image to be sent and displayed is a face image acquired by a front camera in the inner screen.

The method can be interpreted that if the screen state acquired by the camera service module is a folded state, the camera service module determines that the image marked as the first identifier is the target image from the marked images acquired by the camera. Namely, when the current screen displaying the image in the mobile phone is the outer screen, the camera service module determines the image acquired by the front camera of the outer screen as the target image from the image acquired by the marked camera. And if the screen state acquired by the camera service module is the expansion state, the camera service module determines the image marked as the second identifier as the target image from the marked images acquired by the camera. Namely, when the current screen displaying the image in the mobile phone is the inner screen, the camera service module determines the image acquired by the front camera of the inner screen as the target image from the images acquired by the marked camera. Therefore, when the screen of the mobile phone sends the display image, the corresponding image can be displayed according to the screen state of the folding screen, the problem of misplacement of the image sending display is avoided, and the use experience of a user is improved.

And S17, the camera service module sends the target image to the application program.

In the embodiment of the application, after the camera service module determines the target image to be sent and displayed, the target image is sent to the application program to be displayed in the screen of the folding screen.

According to the label setting module, the camera of the label setting module according to the collected image is the inner screen front-mounted camera or the outer screen front-mounted camera, the image collected by the camera is marked, whether the camera corresponding to the screen of the current display image and the camera corresponding to the marked image are matched or not is determined by the camera service module, the displayed target image is determined, the image collected by the outer screen display outer screen front-mounted camera of the folding screen is ensured, the image collected by the inner screen display inner screen front-mounted camera is displayed, the problem of dislocation of the screen when the screen state of the folding screen is switched is solved, and the use experience of a user is improved.

In other embodiments, when the tag setting module of the hardware abstraction layer of the mobile phone determines that the screen state of the folding screen changes, the tag setting module marks an image acquired by the camera according to whether the camera corresponding to the screen currently displaying the image is matched with the camera shown in the drawing. The label setting module determines to display the image collected by the camera matched with the screen of the current display image according to the image identification of the marked image, so that the screen of the current display image is matched with the camera for displaying the image, and the problem that the screen is staggered when the screen state of the folding screen is switched is solved. Specific implementation procedures can be exemplarily seen in the implementation procedure of fig. 13 as follows.

As shown in fig. 13, the display method may include:

and S21, the application program sends an image request to the ISP driver through the camera service module.

And S22, the ISP drives to acquire the image collected by the camera.

And S23, the ISP driver sends the image collected by the camera to the label setting module through the camera providing module.

In the embodiment of the present application, the implementation processes of S21 to S23 may refer to the implementation processes of S11 to S13, which are not described herein again.

And S24, the label setting module determines that the screen state changes and judges whether the screen of the current display image is matched with the camera of the collected image.

In the embodiment of the application, the label setting module judges whether the screen state of the folding screen changes, and when the label setting module determines that the screen state of the folding screen changes, the label setting module judges whether the screen of the current display image is matched with the camera for collecting the image.

It can be understood that when the screen state of the folding screen changes, the camera sending the image is switched along with the switching of the screen. For example, when the screen state of the folding screen is switched from the folding state to the unfolding state, the screen displaying the image is switched from the outer screen to the inner screen, and the camera of the image is also switched from the front camera of the outer screen to the front camera of the inner screen. However, after the screen displaying the image is switched from the outer screen to the inner screen, there may be a case where the camera of the image is not switched. Therefore, the label setting module judges whether the screen of the current display image is consistent with the target camera.

In some embodiments, the mobile phone may mark the screen and the camera, for example, the mobile phone may mark the outer screen and the outer screen front camera as the same identifier, and mark the inner screen and the inner screen front camera as the same identifier. The label setting module can judge whether the screen of the current display image is matched with the image acquisition camera according to whether the screen of the display image is consistent with the identification of the target camera.

If the tag setting module determines in step S24 that the screen of the currently displayed image matches the camera of the captured image, then step S25 is performed, otherwise step S26 is performed.

And S25, the label setting module marks the image collected by the camera as a third identification.

And S26, the label setting module marks the image collected by the camera as a fourth identification.

And the third mark is used for indicating the image collected by the camera to be directly sent and displayed. That is, the image collected by the camera is matched with the screen of the current display image, and the mobile phone can directly send and display the image collected by the camera. The fourth mark is used for indicating that the image collected by the camera is discarded. That is, the image collected by the camera is not matched with the screen of the current display image, and the mobile phone can discard the image collected by the camera.

In the embodiment of the application, if the tag setting module determines that the screen of the currently displayed image is matched with the camera for acquiring the image, the tag setting module marks the image acquired by the camera as the third identifier. If the label setting module determines that the screen of the current display image is not matched with the camera for collecting the image, the label setting module marks the image collected by the camera as a fourth identification. For example, if the tag setting module determines that the screen currently displaying the image is the outer screen and the camera acquiring the image is the outer screen front-facing camera, the tag setting module marks the image acquired by the camera as the third identifier. If the label setting module determines that the screen of the current display image is the outer screen and the camera for collecting the image is the front camera of the inner screen, the label setting module marks the image collected by the camera as a fourth identification.

For example, as shown in fig. 12, if the tag setting module determines that the screen of the currently displayed image matches the camera of the captured image, the tag setting module marks the cache state in the cache structure of the image captured by the camera as the third identifier. For example, the third marker may be NORMAL. If the tag setting module determines that the screen of the currently displayed image is not matched with the camera for acquiring the image, the tag setting module marks the cache state in the cache structure of the image acquired by the camera as a fourth identifier. For example, the fourth flag may be ERROR.

And S27, the label setting module sends the image marked as the third identification to the camera service module.

S28, the camera service module sends the image marked as the third identification to the application.

In this embodiment of the application, after the camera service module acquires the image marked as the third identifier sent by the tag setting module, the camera service module may send the image marked as the third identifier to the application program for display. After the camera service module acquires the image marked as the fourth identifier sent by the label setting module, the camera service module does not send the image marked as the fourth identifier to the application program for display.

The camera service module displays the image marked as the third identifier, so that the image displayed in the current screen of the mobile phone is the image shown by the corresponding camera, and the problem of image display dislocation is solved.

According to the method, the label setting module marks the image collected by the camera according to whether the screen of the current display image is matched with the camera for collecting the image or not, and determines that the image collected by the camera consistent with the screen of the current display image is sent to be displayed, so that the image displayed by the outer screen of the folding screen and displayed by the front-mounted camera on the outer screen is ensured, the image displayed by the front-mounted camera on the inner screen is displayed on the inner screen, the problem of dislocation of the image displayed by the screen when the screen state of the folding screen is switched is solved, and the use experience of a user is improved.

In this embodiment of the application, when the camera service module marks an image collected by a camera according to the tag setting module, and the camera service module determines a target image for display from the marked image, after the screen of the folding screen is switched, that is, the screen of the currently displayed image is lit, the camera service module determines that the image collected by the camera uploaded by the hardware abstraction layer is misaligned with the screen of the currently displayed image. For example, the camera service module determines that an image acquired by a camera uploaded by the hardware abstraction layer is marked as the second identifier or the fourth identifier. Under the condition, if the camera service module loses frames of images which are staggered with the screen of the current display image, the images collected by the corresponding camera cannot be displayed in time in the screen of the mobile phone display image, so that the screen may be blocked or blacked.

To this end, in some embodiments, the handset may save the last few frames of images captured by the switched camera before switching the inner/outer front-facing camera of the handset. For example, the mobile phone may store the last 5 frames of images acquired by the switched camera. When the screen switching of the folding screen is completed, and the switching of the inner/outer screen front-mounted camera is not completed, the camera service module acquires the last frames of images acquired by the switched camera before the screen switching, and the images are sent and displayed in the screen of the current display image in a frame inserting mode until the camera service module acquires the images sent and displayed by the camera corresponding to the screen of the current display image, and the camera service module sends and displays the images sent and displayed by the camera corresponding to the screen of the current display image, so that the condition that the screen of the current display image is blocked or black is avoided, and the use experience of a user is improved.

Illustratively, as shown in fig. 14, when the foldable screen is in the folded state, the front-facing camera of the outer screen captures images to be displayed on the outer screen, see (a) in fig. 14. When the mobile phone stores the folded screen in a folded state, the last frames of images (for example, 5 frames of images) collected by the front camera of the outer screen. When the folding screen is switched from the folding state to the unfolding state, for example, from (a) in fig. 14 to (b) in fig. 14, and is switched from the unfolding state to the folding state, for example, from (b) in fig. 14 to (c) in fig. 14. When the folding screen is switched to the outer screen by the inner screen, if the front camera of the inner screen is not completely switched to the front camera of the outer screen, the camera service module can acquire the last frames of images acquired by the front camera of the outer screen when the screen is in a folding state, and send and display the frames of images on the outer screen, see (c) in fig. 14.

In some embodiments, when the folding screen of the mobile phone is switched from the folding state to the unfolding state, before the folding screen is completely switched from the outer screen to the inner screen, and the camera of the picture is still the front camera of the outer screen, the mobile phone can display the image collected by the front camera of the outer screen on a part of the screen of the inner screen. When the mobile phone determines that the screen switching is completed and the inner screen front camera is used for showing images, the inner screen formed by the first screen and the second screen displays the images collected by the inner screen front camera. Therefore, the images collected by the front camera of the outer screen are displayed by part of the inner screen of the mobile phone before the screen switching is completed, the conditions of black screen or blockage and the like in the use process of the mobile phone are avoided, and the use experience of a user is improved.

For example, as shown in fig. 15, when the folding screen of the mobile phone is in a folding state, and the micro information in the mobile phone responds to the user operation to perform a video call, the front-facing camera of the outer screen of the mobile phone collects image information of the user, and displays the collected image information on the outer screen of the mobile phone, which is shown in fig. 15 (a). In the process that the folding screen of the mobile phone is switched from the folding state to the display state, the second screen of the mobile phone displays the image information collected by the front camera of the outer screen, as shown in fig. 15 (b). The mobile phone triggers the front camera of the inner screen to acquire images, and the images acquired by the front camera of the inner screen are sent and displayed on the inner screen, and the images acquired by the front camera of the inner screen are displayed on a large screen formed by the first screen and the second screen of the mobile phone, which is shown in (c) of fig. 15.

Similarly, when the folding screen of the mobile phone is switched from the unfolding state to the folding state, before the folding screen is completely switched from the inner screen to the outer screen, the camera sending the image is still the front camera of the inner screen, and the mobile phone can display the image collected by the front camera of the inner screen on the outer screen. And when the mobile phone determines that the screen switching is finished and the external screen front-facing camera sends and displays the image, the mobile phone controls the external screen to display the image acquired by the external screen front-facing camera. Therefore, the mobile phone displays the image collected by the front camera of the inner screen through the outer screen before the screen is switched, the conditions of black screen or blockage and the like in the use process of the mobile phone are avoided, and the use experience of a user is improved.

In summary, in the embodiment of the present application, the tag setting module marks an image collected by the camera according to whether the camera that is shown is an inner screen front camera or an outer screen front camera, and the camera service module determines the target image to be sent and displayed according to the consistency between the camera corresponding to the screen state of the folding screen and the camera corresponding to the marked image. Or the label setting module determines to display the image collected by the camera consistent with the screen of the current display image after marking the image according to whether the screen of the current display image corresponds to the camera of the image. From this, the cell-phone has ensured that the outer screen of folding screen shows that the leading camera of outer screen sends the image that shows, and the leading camera of inner screen display sends the image that shows, has solved when the screen state of folding screen switches, and the screen sends the problem that shows the image dislocation, has improved user and has used experience.

As shown in fig. 16, an embodiment of the present application discloses an electronic device, which may be the above-mentioned mobile phone. The electronic device may specifically include: a touch screen 1601, the touch screen 1601 including a touch sensor 1606 and a display 1607; the display 1607 may include a plurality of display areas; one or more processors 1602; a memory 1603; one or more application programs (not shown); and one or more computer programs 1604, which may be connected via one or more communication buses 1605. Wherein the one or more computer programs 1604 are stored in the memory 1603 and configured to be executed by the one or more processors 1602, the one or more computer programs 1604 comprise instructions that may be used to perform related steps in the embodiments.

It is to be understood that the electronic devices and the like described above include hardware structures and/or software modules for performing the respective functions in order to realize the functions described above. Those of skill in the art will readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present embodiments.

In the embodiment of the present application, the electronic device and the like may be divided into functional modules according to the method example, for example, each functional module may be divided according to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, the division of the modules in the embodiment of the present invention is schematic, and is only a logic function division, and there may be another division manner in actual implementation.

In a case where the functional modules are divided according to the respective functions, a possible composition diagram of the electronic device related to the above embodiment may include: display unit, transmission unit and processing unit etc. It should be noted that all relevant contents of each step related to the above method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again.

Embodiments of the present application also provide an electronic device including one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, the one or more memories are for storing computer program code comprising computer instructions which, when executed by the one or more processors, cause the electronic device to perform the associated method steps described above to implement the display method of the electronic device with a foldable screen in the above embodiments.

Embodiments of the present application further provide a computer-readable storage medium, where computer instructions are stored, and when the computer instructions are executed on an electronic device, the electronic device is caused to execute the above related method steps to implement the display method of the electronic device with a foldable screen in the above embodiments.

Embodiments of the present application further provide a computer program product, which includes computer instructions, and when the computer instructions are run on an electronic device, the electronic device executes the above related method steps to implement the display method of the electronic device with a folding screen in the above embodiments.

In addition, embodiments of the present application also provide an apparatus, which may be specifically a chip, a component or a module, and may include a processor and a memory connected to each other; the storage is used for storing computer execution instructions, and when the device runs, the processor can execute the computer execution instructions stored in the storage, so that the device can execute the display method of the electronic equipment with the folding screen, which is executed by the electronic equipment in the above-mentioned method embodiments.

In addition, the electronic device, the computer-readable storage medium, the computer program product, or the apparatus provided in this embodiment are all configured to execute the corresponding method provided above, so that the beneficial effects achieved by the electronic device, the computer-readable storage medium, the computer program product, or the apparatus can refer to the beneficial effects in the corresponding method provided above, and are not described herein again.

Through the above description of the embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions. For the specific working processes of the system, the apparatus and the unit described above, reference may be made to the corresponding processes in the foregoing method embodiments, and details are not described here again.

Each functional unit in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially implemented or make a contribution to the prior art, or all or part of the technical solutions may be implemented in the form of a software product stored in a storage medium and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) or a processor to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: flash memory, removable hard drive, read only memory, random access memory, magnetic or optical disk, and the like.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A display method of an electronic device with a folding screen, wherein the electronic device comprises an inner screen and an outer screen, and a camera of the electronic device comprises a first camera and a second camera, wherein the first camera is a front camera of the inner screen, and the second camera is a front camera of the outer screen, and the method comprises the following steps:

acquiring a first image acquired by a camera of the electronic equipment;

determining whether the first image meets a first preset condition in the process of changing the screen folding state of the electronic equipment; when the first image is the image acquired by the first camera and the target display screen is the inner screen, the first image meets the first preset condition; or, when the first image is the image acquired by the second camera and the target display screen is the external screen, the first image meets the first preset condition;

and under the condition that the first image meets a first preset condition, controlling a target display screen of the electronic equipment to present the first image, wherein the first preset condition comprises that a camera of the first image is acquired to be matched with the target display screen, and the target display screen is a display screen of the current image displayed by the electronic equipment or a display screen of the current image to be displayed by the electronic equipment.

2. The method of claim 1, wherein the determining whether the first image satisfies a first preset condition comprises:

when the first image is the image acquired by the first camera and the target display screen is the outer screen, the first image does not meet the first preset condition; alternatively, the first and second electrodes may be,

and under the condition that the first image is the image acquired by the second camera and the target display screen is the inner screen, the first image does not meet the first preset condition.

3. The method of claim 1, further comprising:

under the condition that the first image does not meet the first preset condition, controlling a target display screen of the electronic equipment to present a second image, wherein the second image is an image collected by a camera which is pre-stored in the electronic equipment and is matched with the target display screen;

or, under the condition that the first image does not meet the first preset condition, controlling a target display screen of the electronic equipment not to present the first image.

4. The method of any of claims 1-3, wherein after acquiring the first image captured by the camera of the electronic device, the method further comprises:

determining that the image identifier of the first image is a first identifier under the condition that the first image is the image acquired by the first camera;

determining that the image identifier of the first image is a second identifier under the condition that the first image is an image acquired by a second camera;

the determining whether the first image meets a first preset condition comprises:

and determining whether the first image meets the first preset condition or not according to the image identifier of the first image and a target display screen.

5. The method according to claim 4, wherein the determining whether the first image satisfies the first preset condition according to the image identifier of the first image and a target display screen comprises:

determining that the first image meets the first preset condition under the condition that the target display screen is an inner screen and the image identifier of the first image is a first identifier;

and under the condition that the target display screen is an outer screen and the image identifier of the first image is a second identifier, determining that the first image meets the first preset condition.

6. The method according to any one of claims 1-3, wherein controlling a target display screen of the electronic device to present the first image if the first image satisfies a first preset condition comprises:

determining that the image identifier of the first image is a third identifier, wherein the third identifier is used for indicating that the first image is directly sent to be displayed;

and controlling a target display screen of the electronic equipment to present the first image with the third identification.

7. The method according to any one of claims 1-3, further comprising:

and under the condition that the first image does not meet the first preset condition, determining that the image identifier of the first image is a fourth identifier, wherein the fourth identifier is used for indicating that the first image is discarded.

8. The method according to any one of claims 1-3, wherein the internal screen of the electronic device comprises a first screen and a second screen, and wherein before determining whether the first image satisfies a first preset condition, the method further comprises:

and determining that the electronic equipment is in the process of changing the folding state of the screen according to the included angle between the first screen and the second screen.

9. An electronic device, comprising:

a touch screen comprising a touch sensor and a display screen;

one or more processors;

a memory;

wherein the memory has stored therein one or more computer programs comprising instructions which, when executed by the electronic device, cause the electronic device to perform the display method of the electronic device with a folding screen of any of claims 1-8.

10. A computer-readable storage medium having instructions stored therein, which when run on an electronic device, cause the electronic device to perform the display method of the electronic device with a folding screen according to any one of claims 1 to 8.