CN114980286B

CN114980286B - Display method for electronic equipment screen-off

Info

Publication number: CN114980286B
Application number: CN202210468981.7A
Authority: CN
Inventors: 黄斌
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-04-29
Filing date: 2022-04-29
Publication date: 2023-08-29
Anticipated expiration: 2042-04-29
Also published as: CN117320131A; CN114980286A

Abstract

The embodiment of the application discloses a screen-off display method of electronic equipment, and relates to the field of electronic equipment. The electronic equipment can quickly judge the use intention of the user after being folded, and control the external screen to be extinguished when the user does not use the intention in a short time, so that the corresponding expense is saved. The specific scheme is as follows: when the electronic equipment is in an unfolding state, a first interface is displayed on the inner screen of the electronic equipment, the first interface comprises a first part and a second part, the first part comprises a first element set, the second part comprises a second element set, a first operation of a user is received, the first operation is used for triggering the electronic equipment to fold, and a second interface is displayed on the outer screen in response to the first operation. The second interface comprises a first element set and a second element set, or the second interface comprises the first element set, and a first part corresponding to the first element set is a focus interface of the first interface. And controlling the outer screen to be extinguished under the condition that the user does not continuously watch the outer screen.

Description

Display method for electronic equipment screen-off

Technical Field

The embodiment of the application relates to the field of electronic equipment, in particular to a screen-off display method of electronic equipment.

Background

In the use process of the electronic equipment, the display screen can be displayed through the bright screen, and a display function is provided for a user. Taking a folding screen mobile phone as an example, in an unfolding state, the folding screen mobile phone can be displayed by a bright screen of an inner screen (namely a folding screen), and a display function is provided for a user. In the folded state, the folding screen mobile phone can be displayed through the external screen bright screen, and a display function is provided for a user.

When the user does not need to use the folding screen mobile phone, taking the folding screen mobile phone as an example in a folding state, the external screen can automatically enter a screen-off (or screen-off) state under the operation of the user or after a preset time length so as to save corresponding power consumption.

However, in the current scheme, the quick screen-off of the external screen needs to rely on the operation of the user. In the scheme of extinguishing the screen for the preset time, the user cannot automatically enter the screen extinguishing state even if the user does not use the folding screen within the preset time, so that the waste of power consumption of the bright screen is caused.

That is, in the current scheme, the screen-off scheme is not intelligent enough, which causes waste of power consumption.

Disclosure of Invention

The embodiment of the application provides a screen-off display method for electronic equipment, which can enable the electronic equipment to quickly judge the use intention of a user after being folded and control an external screen to be turned off when the user does not use the intention in a short time, thereby saving the corresponding expenditure.

In order to achieve the above purpose, the embodiment of the application adopts the following technical scheme:

in a first aspect, there is provided an electronic device screen-off display method, applied to an electronic device, where the electronic device is provided with a folding screen, the method including: when the electronic equipment is in an unfolding state, a first interface is displayed on the inner screen of the electronic equipment, the first interface comprises a first part and a second part, the first part comprises a first element set, the second part comprises a second element set, a first operation of a user is received, the first operation is used for triggering the electronic equipment to fold, and a second interface is displayed on the outer screen in response to the first operation. The second interface comprises the first element set and the second element set, or the second interface comprises the first element set, and the first part corresponding to the first element set is a focus interface of the first interface. And controlling the outer screen to be extinguished in the case that the user does not continuously watch the outer screen.

Based on the scheme, after the electronic equipment is folded by a user, corresponding interfaces can be displayed on the outer screen based on different conditions according to the content displayed on the inner screen before the folding. For example, when the content corresponding to the focus interface in the inner screen is displayed on the outer screen, and for example, when the content displayed in the inner screen does not distinguish the focus interface, all elements of the inner screen, such as a desktop, may be displayed on the outer screen. After the external screen is displayed on the screen, the electronic equipment can be triggered by entering a folding state, and the use intention of the user in a short time is judged. For example, the user can judge that the user does not use the mobile phone any more in a short time for continuously watching the external screen. And correspondingly, the electronic equipment can control the external screen to be turned off, so that the external screen is not turned on any more for display, and corresponding power consumption is saved.

In one possible design, before the controlling the external screen to extinguish, the method further comprises: it is determined that the user is not continuously looking at the external screen. Based on the scheme, an action example of the electronic equipment in the implementation process of the scheme is provided. For example, the electronic device may determine to trigger control of the external screen to extinguish by determining that the user is not continuously looking at the current screen, i.e., the external screen.

In one possible design, the method includes determining that the user is not continuously looking at the external screen when at least one time the duration that the user is not continuously looking at the external screen is greater than the non-looking threshold value within a maximum detection duration after the electronic device is folded. Based on this scheme, a specific scheme example of determining that the user does not continuously look at the screen is provided. For example, in the maximum detection duration, if the duration that the user does not continuously watch the screen is greater than the preset non-watching threshold, the method corresponds to the user not continuously watching the screen. The duration that the user does not continuously watch the screen may be the duration between when the user does not watch the screen any more and when the user starts watching the screen next time (or reaches the maximum detection duration).

In one possible design, the electronic device has a smart perceptibility that provides eye gaze detection functionality, the electronic device including a fold gaze detection module. After the electronic device is folded, the method further comprises: the folding gaze detection module sends a first registration request to the intelligent perception capability, the first registration request is used for registering human eye gaze detection, the intelligent perception capability feeds back a first identifier or a second identifier to the folding gaze detection module when the user gaze condition changes in response to the first registration request, the first identifier is used for indicating that the user gaze condition changes to user gaze, and the second identifier is used for indicating that the user gaze condition changes to user non-gaze. Based on the scheme, a scheme example of the situation that the electronic equipment acquires the user to watch the screen is provided. By acquiring the state change condition of the user gazing at the screen, the folding gazing detection module in the electronic equipment can determine whether the condition that the user continuously does not gaze at the screen exists in the maximum detection duration.

In one possible design, the determining that the user is not continuously looking at the external screen includes: the folding gaze detection module counts a first time length between the second mark and the next first mark within the maximum detection time length, and the first time length is the time length of the user for one time of non-continuous gaze of the external screen. When at least one of the first time periods is greater than the non-gazing threshold, it is determined that the user is not continuously gazing at the outer screen. Based on the scheme, the electronic device can determine whether the user continuously does not watch the screen according to the time length between receiving the two adjacent identifications.

In one possible design, if the last received identifier of the folded gaze detection module is the second identifier within the maximum detection duration, the method further includes: and the folding gaze detection module counts a second time period between the last second mark received and the maximum detection time period, and when the second time period is longer than the non-gaze threshold value, the user is determined to not continuously gaze the external screen. Based on the scheme, the electronic device can also determine whether the user continuously looks at the screen according to the time period from the last second identification to the detection end.

In one possible design, upon determining that the first time period is greater than the gazing-free threshold, the method further includes: the folding gaze detection module sends a first deregistration request to the smart awareness capability, the first deregistration request is used for deregistering human eye gaze detection, and the smart awareness capability does not feed back a first identifier or a second identifier to the folding gaze detection module in response to the first deregistration request. Based on this scheme, the electronic device may perform a quick screen-off after determining that the user is not continuously looking at the screen. Correspondingly, the electronic device can register the detection process of the pair of human eyes, so that acquisition of the relevant information (such as the first identifier and the second identifier) of the human eye gaze is stopped, and the expenditure of human eye gaze detection is saved.

In one possible design, an interface white list is preset in the electronic device, the interface white list includes interface information of at least one interface, the interface information includes package names and class names of corresponding interfaces, and the interface white list does not include package names and class names of the second interface. Before controlling the outer screen to extinguish, the method further comprises: and determining that the interface information of the second interface is not in the interface white list. Based on the scheme, the electronic equipment can also determine whether the user has the intention of continuing to use the electronic equipment or not through the package name and the class name of the current external screen display interface. For some application interfaces, the user's use may continue from the inner screen to the outer screen, such as video calls, voice calls, etc. Then, the interfaces may be set in an interface whitelist, so that the electronic device may determine that the currently displayed interface is in the interface whitelist, and correspondingly, do not execute the quick screen-off. Otherwise, if the current interface is not in the interface whitelist, a quick screen-off may be performed.

In one possible design, the electronic device is provided with a fold gaze detection module, and the determining that the interface information of the first interface is not in the interface whitelist includes: the folding gaze detection module obtains interface information of the current interface from a window manager of the electronic device to obtain interface information of the first interface, and searches in the interface white list according to the interface information of the first interface to determine that the interface information of the first interface is not in the interface white list. Based on the scheme, the folding gaze detection module of the electronic device can acquire the package name and the class name of the current interface, namely the display interface on the external screen through interaction with the window manager.

In one possible design, the electronic device is provided with at least one camera, and before controlling the external screen to extinguish, the method further comprises: it is determined that all cameras are not used. Based on the scheme, the electronic equipment can also determine whether the user has the intention of continuing to use the electronic equipment according to the use condition of the camera. For example, when a camera is in operation (i.e., when the camera is in use), which corresponds to a scene such as a shot, video, etc., the user may need to continue to use the electronic device. Therefore, when all cameras are not used, the corresponding mobile phone can be combined with other judging mechanisms to accurately determine whether the user has intention to continue to use the electronic equipment or not according to the scene related to the fact that the user does not use the cameras.

In one possible design, a fold gaze detection module is provided in the electronic device, the determining that the at least one camera is not in use, comprising: the fold gaze detection module sends a second registration request to a camera manager of the electronic device, the second registration request being used to obtain a working state of each of the at least one camera, the working state of the camera including working and non-working. In response to the second registration request, the camera manager sends a camera state change message to the folding gaze detection module when the working state of each camera is changed, wherein the camera state change message comprises an identifier of the corresponding camera and a third identifier or a fourth identifier, the third identifier is used for indicating that the working state of the camera is changed to work, and the fourth identifier is used for indicating that the working state of the camera is changed to be not working. The folding gaze detection module stores or updates the working state of each camera according to the received camera state change message. And when the working states of all cameras are not working, determining that all cameras are not used. Based on the scheme, the folding gaze detection module of the electronic device can acquire the working states of all cameras through interaction with the camera manager, so that whether all cameras are unused is judged accordingly.

In one possible design, the method further comprises, prior to controlling the external screen to extinguish the screen: it is determined that the electronic device is not in a call. Based on the scheme, the electronic equipment can also determine whether the user has the intention of continuing to use the electronic equipment or not through the call state. For example, in a talk state, the user may need to use some functions on the interface, such as looking at an address book, etc., i.e., the user may need to continue to use the electronic device. Therefore, the electronic equipment can accurately determine whether the user has the intention of continuing to use the electronic equipment or not according to the call state.

In one possible design, the electronic device is provided with a folding gaze detection module, and the determining that the electronic device is not in communication includes: the folding gaze detection module sends a third registration request to a call manager of the electronic device, where the third registration request is used to obtain a call state of the electronic device, and the call state includes a call in progress, a call not in progress, and a hang-up. And when the call state of the call manager is changed in response to the third registration request, a fifth identifier or a sixth identifier or a seventh identifier is sent to the folding gaze detection module, wherein the fifth identifier is used for indicating that the call state is changed into a call, the sixth identifier is used for indicating that the call state is changed into a non-call, and the seventh identifier is used for indicating that the call state is changed into a hanging-up state. The folding gaze detection module stores or updates the call state according to the received fifth or sixth or seventh identifier. And when the current call state is on-hook or not in call, determining that the electronic equipment is not in call. Or the folding gaze detection module determines that the electronic device is not in a call when determining that the last received identification of the call state is the sixth identification or the seventh identification. Based on the scheme, the folding gaze detection module of the electronic device can acquire updated call states through interaction with the call manager, so that whether the electronic device is not in a call or not is judged accordingly.

In one possible design, the method further comprises, prior to controlling the external screen to extinguish the screen: and determining that the current screen is not extinguished and is not locked. Based on the scheme, the electronic equipment can also determine whether the user has the intention of continuing to use the electronic equipment or not by combining the on-off state and the screen locking state of the current screen. In the off-screen state, there may be a need to quickly off the screen. If the external screen is locked in a short time, the external screen generally indicated by the user enters a screen locking state, and correspondingly, the user may not use the electronic device any more in a short time.

In one possible design, the electronic device is provided with a folding gaze detection module, and the determining that the external screen is not extinguished includes: the folding gaze detection module obtains a screen on-off state of a current screen, which is a screen providing a display function to a user, from a power manager of the electronic device. The folding fixation detection module determines that the external screen is not extinguished according to the bright and dark screen state fed back by the telephone manager. The determining that the external screen is not locked includes: the folding gaze detection module obtains a screen locking state of a current screen from a screen locking manager of the electronic device, the current screen being a screen providing a display function to a user. The folding gaze detection module determines that the external screen is unlocked according to the screen locking state fed back by the telephone manager, which is the current screen is unlocked. Based on the scheme, a scheme example for acquiring the on-off screen state and the screen locking state is provided.

In one possible design, before the controlling the external screen to extinguish, the method further comprises: determining that the folding screen electronic device is folded. Based on the scheme, a trigger mechanism of the scheme is provided. For example, the electronic device may trigger a judgment mechanism for each dimension when it is determined that the electronic device is folded, and execute quick screen-off when the user does not have the intention to continue using the electronic device.

In one possible design, the determining that the folding screen electronic device is folded includes: the folding gaze detection module sends a fourth registration request to a device state manager of the electronic device, wherein the fourth registration request is used for obtaining a folding state of the folding screen, and the folding state of the folding screen comprises folding, semi-folding and unfolding. And when the state of the folding screen of the call manager is changed to be folded in response to the fourth registration request, sending an eighth identifier to the folding gaze detection module, wherein the eighth identifier is used for indicating the folding screen to be folded, and the folding gaze detection module determines that the folding screen electronic equipment is folded according to the received eighth identifier. Based on this scheme, a scheme example of acquiring a folded state is provided. Then, each time an eighth identifier is received, the judgment of the quick screen-off provided by the scheme can be triggered.

In a second aspect, an electronic device is provided, the electronic device comprising one or more processors and one or more memories; one or more memories coupled to the one or more processors, the one or more memories storing computer instructions; the computer instructions, when executed by one or more processors, cause the electronic device to perform the electronic device off-screen display method of the first aspect and any of the various possible designs described above.

In a third aspect, a chip system is provided, the chip system comprising an interface circuit and a processor; the interface circuit and the processor are interconnected through a circuit; the interface circuit is used for receiving signals from the memory and sending signals to the processor, and the signals comprise computer instructions stored in the memory; when the processor executes the computer instructions, the system-on-chip performs the electronic device off-screen display method as described in the first aspect above and any of various possible designs.

In a fourth aspect, there is provided a computer readable storage medium comprising computer instructions which, when executed, perform an electronic device off-screen display method as in the first aspect and any of the various possible designs described above.

In a fifth aspect, a computer program product is provided, comprising instructions in the computer program product, which when run on a computer, enables the computer to perform the method of off-screen display of an electronic device as in the first aspect and any of the various possible designs described above according to the instructions.

It should be appreciated that the technical features of the technical solutions provided in the second aspect, the third aspect, the fourth aspect, and the fifth aspect may all correspond to the electronic device screen-off display method provided in the first aspect and the possible designs thereof, so that the beneficial effects that can be achieved are similar, and are not repeated herein.

Drawings

FIG. 1 is a schematic view of a folding screen;

FIG. 2 is a schematic illustration showing an interface before and after folding;

FIG. 3 is a schematic view of a screen after folding;

fig. 4 is a schematic diagram of an electronic device according to an embodiment of the present application;

fig. 5 is a schematic software architecture diagram of an electronic device according to an embodiment of the present application;

FIG. 6 is a schematic diagram of module interaction according to an embodiment of the present application;

FIG. 7A is a schematic diagram of multi-dimension judgment of user intention according to an embodiment of the present application;

Fig. 7B is a schematic diagram of a rapid screen quenching provided in an embodiment of the present application;

FIG. 8 is a schematic diagram of an interface according to an embodiment of the present application;

FIG. 9 is a schematic diagram of scheme interaction for determining whether an interface is in an interface white list according to an embodiment of the present application;

fig. 10 is a schematic diagram of a lock screen according to an embodiment of the present application;

FIG. 11 is a schematic diagram of a scheme for acquiring a current on-off state according to an embodiment of the present application;

FIG. 12 is a schematic diagram of a scheme for acquiring a current screen locking state according to an embodiment of the present application;

fig. 13 is a schematic diagram of a call interface according to an embodiment of the present application;

fig. 14 is a schematic diagram of solution interaction for obtaining a current call state according to an embodiment of the present application;

fig. 15 is a schematic diagram of scheme interaction for obtaining a current use state of a camera according to an embodiment of the present application;

FIG. 16 is a schematic illustration of a discontinuous gaze provided by an embodiment of the present application;

FIG. 17 is a schematic diagram of a scheme for acquiring current eye gaze detection according to an embodiment of the present application;

FIG. 18 is a schematic diagram of a scheme for acquiring a current folding state according to an embodiment of the present application;

FIG. 19 is a schematic diagram showing the comparison of the effects of the present solution provided by the embodiment of the present application with those of the prior art solution;

FIG. 20 is a schematic diagram of module interaction of a screen-extinguishing scheme according to an embodiment of the present application;

FIG. 21 is a schematic flow chart of a screen-extinguishing scheme according to an embodiment of the present application;

FIG. 22 is a schematic diagram of an interface configuration according to an embodiment of the present application;

fig. 23 is a schematic diagram of an electronic device according to an embodiment of the present application;

fig. 24 is a schematic diagram of a system-on-chip according to an embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

Before describing the embodiment of the method for controlling the translation control and the electronic device provided by the application, some terms to be mentioned below will be described. In the description of the embodiments of the present application, unless otherwise specified, the meaning of "plurality" means two or more, for example, the meaning of a plurality of processing units means two or more, or the like; the plurality of elements means two or more elements and the like.

The terms "first" and "second" and the like in the description and in the claims are used for distinguishing between different objects and not for describing a particular sequential order of objects. When the present application refers to the ordinal words "first" or "second," unless the context clearly dictates otherwise, it should be understood to be merely a distinction.

The term "and/or" herein is an association relationship describing an associated object, and means that there may be three relationships, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. The symbol "/" herein indicates that the associated object is or is a relationship, e.g., A/B indicates A or B.

In embodiments of the application, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g." in an embodiment should not be taken as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.

With the development of display screen manufacturing technology, in order to cope with the demand of electronic equipment for larger and larger display area, folding screens are increasingly used in electronic equipment. In the embodiment of the application, the electronic device provided with the folding screen is also called a foldable electronic device. For example, take an electronic device as a folding screen mobile phone. Folding screen handsets provided with a folding screen are also known as foldable handsets or folding screen handsets. A rotating structure (such as a rotating shaft) can be arranged in the folding screen mobile phone, so that the folding screen mobile phone can be folded, unfolded and the like based on the rotating structure.

It will be appreciated that in order to provide a more convenient viewing experience for the user, a folding screen cell phone may be provided with a plurality of display screens including a folding screen. Described in terms of a folding screen phone when fully deployed, the folding screen phone may include a first side and a second side. The first face may be an inwardly folded face during folding of the folding screen phone. That is, after folding, the first face is wrapped inside the folding screen phone and cannot be directly seen by the user. Correspondingly, the second face may be the opposite face to the first face. After folding, the second face can be exposed as an exterior face of the folding screen phone.

In some embodiments, a folding screen may be provided on the first side so that when the folding screen handset is unfolded by a user, the folding screen handset provides display functionality to the user through the folding screen. In the following description, the folding screen provided on the first face may be referred to as an inner screen.

Other display screens, such as non-folding screens, may also be included in the folding screen cell phone. The non-folding screen may be disposed on at least a portion of the second face to continue to provide display functionality to the user through the non-folding screen after the user folds the folding screen phone. In the following description, the non-folding screen provided at least in part on the second face may be referred to as an outer screen. For example, after the folding screen mobile phone is folded, the second face may be folded into two parallel portions corresponding to the upper and lower appearance faces of the folding screen mobile phone, respectively. Then, when an external screen is provided in the folding screen mobile phone, the external screen may be provided on either one of the two appearance surfaces. When two external screens are arranged in the folding screen mobile phone, the external screens can be respectively arranged on the two appearance surfaces.

It should be noted that the above description of the inner screen and the outer screen is merely an example, and does not constitute a specific limitation on the foldable electronic device according to the embodiment of the present application. For example, continuing to take a folding screen mobile phone as an example, the inner screen may be formed by splicing two or more non-folding screens, and/or the outer screen may be a folding screen or the like. In the following examples, the inner screen is taken as a folding screen, and the foldable electronic device is further provided with an outer screen as an example.

It should be appreciated that a folding screen handset, when used by a user, may be divided into a plurality of states depending on the folding situation. By way of example, the plurality of states of a folding screen phone may include a folded state, a semi-folded state, and an unfolded state (otherwise referred to as an unfolded state).

The folded state may correspond to a fully folded state of the folding screen phone. In this folded state, the first face is closed inwardly and is not directly visible to the user. The inner screen (i.e., the folding screen) is also correspondingly closed inward, and the electronic device provides a display function to the user through the outer screen. In this folded state, the folding angle is 0 degrees. The folding angle is an included angle of two parts of the same surface in the folding process of the electronic equipment by taking the rotating structure as an axis.

The unfolded state may correspond to a fully unfolded state of the folding screen phone. In this unfolded state, the first face is flattened and presented to the user as one appearance of the electronic device. Correspondingly, the second surface is also completely flattened to be used as another appearance surface of the electronic equipment. In this unfolded state, the electronic device may provide a display function to the user through the internal screen provided on the first face. In this unfolded state, the folding angle is 180 degrees.

A semi-collapsed state may also be included between the collapsed and expanded states. In this semi-folded state, the folding angle tends to be between 0 degrees and 180 degrees. The display screen of the electronic device for providing the display function for the user can be an external screen or an internal screen. For example, in the case where the folding angle is less than 45 degrees, the electronic device may provide a display function to the user through the external screen. As another example, in the case where the folding angle is greater than 90 degrees, the electronic device may provide a display function or the like to the user through the internal screen.

To more clearly illustrate the foldable electronic device of the present application, fig. 1 shows several examples of foldable electronic devices (such as a folding screen phone) in different folded states. As shown in fig. 1, in the unfolded state, the first face is fully flattened. A folding screen 11 may be provided on the first face. The folding screen 11 may be divided into two parts along a folding axis, such as 11a and 11b. In this example, the folding screen phone may also be provided with an external screen. The outer screen may be a screen 12, disposed opposite 11a of the folding screen 11.

It should be noted that, in order to provide the shooting function for the user, one or more cameras may also be provided on the foldable mobile phone. For example, as shown in fig. 1, a camera may be provided on 11b of the folding screen 11 to provide a photographing function (e.g., a self-photographing function) to the user when the user uses the inner screen. The camera provided on the folding screen 11 (i.e., the inner screen) may also be referred to as an inner screen camera, or an inner screen front camera.

From the unfolded state, the foldable cellular phone can be folded along the folding axis to enter a semi-folded state, as shown in fig. 1. In the semi-folded state, the folding screens 11a and 11b come closer to each other until they are closed. When the folding screen 11 is completely covered on 11b 11a, i.e. the folding angle is reduced from 180 degrees in the unfolded state to 0 degrees, the outer screen 12 can be presented to the user as an appearance surface in order to provide the corresponding display function. In this case, the folding axis may be located on one side of the outer screen 12. As shown in fig. 1, in some embodiments, a camera may also be provided on the outer screen 12 so that in the folded state, the camera may be used to provide a self-timer function to the user. In this example, the camera provided on the external screen 12 may be referred to as an external screen camera, or an external screen front camera.

It will be appreciated that the cameras provided on the inner screen 11 and the outer screen 12 can both provide a self-timer function to the user in their respective states, and therefore both cameras can be referred to as front cameras of the folding screen phone. Correspondingly, on the second surface, the opposite part of the inner screen 11b can be used as the back of the folding screen mobile phone in the folded state or as the back of the folding screen mobile phone in the unfolded state. A rear camera may be provided at this location to provide a user with a rear photographing function in a folded state and/or an unfolded state.

As described above, when the folding screen handset shown in FIG. 1 is in operation, display functionality can be provided to a user through its inner and/or outer screen. For example, a desktop is displayed. With reference to fig. 2, when the folding screen phone is in an unfolded state, a desktop interface 21 as shown in fig. 2 may be displayed on the inner screen thereof. The distribution of the elements such as the components and the application icons included in the desktop interface 21 may be scaled appropriately according to the size of the internal screen, so as to obtain a display effect corresponding to the size of the internal screen. Correspondingly, after being folded into the folded state, the folding screen phone may display the desktop interface 22 on the external screen. In contrast to the desktop interface 21, the desktop interface 22 may also include elements such as various components and application icons on the desktop. The display profile of the desktop interface 22 may be corresponding to the size of the external screen. For example, the desktop interface 22 is scaled appropriately in the width direction as compared with the desktop interface 21 so as to obtain an appropriate display effect on the external screen.

In this example, all contents of the inner screen are displayed on the outer screen after folding. In other implementations, the inner screen may display parallel views in the expanded state. Illustratively, an interface of the application A is displayed on the inner screen. One interface of the application a may be displayed on the left half screen 11a of the inner screen 11, while another interface of the application a may be displayed on the right half screen 11b of the inner screen 11. For example, when the application a is a reading application, in the display of changing the parallel vision, two continuous pages of graphics and texts provided by the reading application can be respectively displayed on the left half screen 11a and the right half screen 11b, so as to achieve the effect of simulating the book to be displayed to the user. In the case where the inner screen displays parallel views, one focus interface may be included in the two interfaces displayed in the left half screen 11a and the right half screen 11b, respectively. The focus interface may be an interface that the user is reading. Then, after the folding as shown in fig. 2, the content of the focus interface may be continuously displayed on the external screen so that the user can continuously read. In the present application, the interface displayed on the screen may include a plurality of elements such as icons, characters, frames, and the like. The set of elements may correspond to all information displayed by the interface. For example, taking the case that the inner screen 11 displays the first interface, the first interface may include the first portion and the second portion thereon. The first and second portions may correspond to the displayed content of 11a and 11b, respectively. Then, the plurality of element sets of the first portion displayed on 11a may be referred to as a first element set. 11b may be referred to as a second element set. Taking the interface displayed on 11a as the focus interface as an example. Then, after the folding screen phone is folded, the interface displayed on the external screen may include the first element set. So that the user continues to view the focus interface through the external screen. In other cases, if the interface displayed by the inner screen 11 in the expanded state does not distinguish the focus interface, for example, the combination of all elements in 11a and 11b corresponds to a desktop interface. Then, after the folding screen mobile phone is folded, the interface displayed on the outer screen can include all elements displayed on the inner screen, namely the first element set and the second element set.

In some cases, the inner screen may be in a dead screen state in the folded state because the inner screen is fully closed when the folding screen phone is in the folded state, providing no display function to the user. In the embodiment of the application, the screen-off state can mean that the corresponding screen does not do any display, or that only a small number of identifiers (such as time, date and the like) are displayed on the screen to realize the screen-off display function.

It can be understood that, compared with the bright screen state, the screen in the off-screen state basically does not need to be displayed, so that the power consumption caused by the corresponding screen display can be saved.

In the folded state, it is also possible for the outer screen to enter the off-screen state in some cases. For example, in connection with fig. 3, in the case shown at 31, after the external screen is displayed on the screen, if no operation of receiving the user input is received for a preset period of time, the off-screen state may be entered. For example, the external screen may display a desktop interface 22 as shown in FIG. 2 when displayed on a bright screen. If no user input has been received, the external screen may enter the off-screen state after a predetermined period of time (e.g., 15s or more) has been reached. For example, after entering the off-screen state, the outer screen may not be displayed at all, entering a rest state (e.g., a power-on state) until the user enters other operations to illuminate the screen. As another example, the external screen may be shown at 33, where no display is made in a large portion of the display screen, and only a small amount of information such as time, date, week, etc. is displayed at 34. In some implementations, the display corresponding to 34 may be selected and set in a "off screen display" function option in a folding screen phone. Of course, this example of 31 and 32 is only one possible implementation, and the user may also instruct the electronic device to enter the off-screen state by other means, such as by a preset gesture, a combined operation of virtual/physical keys, etc.

As shown in fig. 3, the folding screen mobile phone may also enter a screen-off state in response to a screen-off operation after the user inputs the screen-off operation. For example, the off-screen operation may be an operation in which the user presses the shutdown key. And responding to the screen-off operation, the folding screen mobile phone can enter a screen-off state.

It can be seen that the external screen is required to enter the screen-off state, and the external screen can not enter the screen-off state by itself after a preset time period is required to be waited under the condition that any operation of a user is not received, so that power consumption related to external screen display is saved when the user does not use the folding screen mobile phone. The current preset duration is generally 15s or longer, and then the folding screen mobile phone cannot quickly enter the screen-off state within the preset duration. If the preset time period is set to be less than 15s (such as 5s or 8 s), the external screen may automatically enter the off-screen state in the case that the user needs to use the folding screen mobile phone but does not input the related operation quickly, thereby affecting the user experience.

The embodiment of the application provides a screen-off scheme, which can determine the use intention of a user on electronic equipment based on the state of the foldable electronic equipment, accurately judge whether a display screen (such as an external screen) needs to be controlled to enter the screen-off state rapidly, and save unnecessary power consumption expenditure of screen display while not influencing the use of the user.

In order to describe the technical scheme provided by the embodiment of the present application in detail, the following first describes an electronic device to which the scheme is applied in a simple manner.

The scheme provided by the application can be applied to foldable electronic equipment. As explained before, the foldable electronic device may be provided with a folding screen. In some embodiments, the electronic device may also be provided with at least one external screen. The foldable electronic device may be different in different implementations. By way of example, the electronic device may be a portable mobile device such as a folding screen cell phone, tablet computer, media player, etc. provided with a folding screen, or a wearable electronic device provided with a folding screen.

Fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application. Electronic device 400 may include a processor 410, an external memory interface 420, an internal memory 421, a universal serial bus (universal serial bus, USB) interface 430, a charge management module 440, a power management module 441, a battery 442, an antenna 1, an antenna 2, a mobile communication module 450, a wireless communication module 460, an audio module 470, a speaker 470A, a receiver 470B, a microphone 470C, an ear-piece interface 470D, a sensor module 480, keys 490, a motor 491, an indicator 492, a camera 493, a display screen 494, and a subscriber identity module (subscriber identification module, SIM) card interface 495, among others. The sensor modules 480 may include pressure sensors 480A, gyroscope sensors 480B, magnetic sensors 480D, acceleration sensors 480E, distance sensors 480F, proximity sensors 480G, fingerprint sensors 480H, touch sensors 480K, ambient light sensors 480L, and the like.

It should be understood that the illustrated structure of the embodiment of the present application does not constitute a specific limitation on the electronic device 400. In other embodiments of the application, electronic device 400 may include more or fewer components than shown, or may combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 410 may include one or more processing units, such as: the processor 410 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors. For example, the processor 410 is configured to perform the method of detecting ambient light in an embodiment of the present application.

The electronic device 400 implements display functions via a GPU, a display screen 494, and an application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display screen 494 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 410 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 494 is used to display images, videos, and the like. The display screen 494 includes a display panel. The display panel may employ an organic light-emitting diode (OLED). In some embodiments, the electronic device 400 may include 1 or N display screens 494, N being a positive integer greater than 1. For example, in connection with the examples of fig. 1-3, an inner screen, such as folding screen 11, may be included in the N display screens 494. The N display screens 494 may also include at least one external screen, such as screen 12.

It should be understood that fig. 4 above illustrates one hardware structural composition in an electronic device. In the present application, the electronic device 400 may also be divided from another angle. For example, referring to FIG. 5, a software partitioning schematic of an electronic device 400 is shown.

For example, in the example shown in fig. 5, the electronic device may have a layered architecture. The layered architecture divides the software into a plurality of layers, and each layer has clear roles and division of work. The layers communicate with each other through a software interface. In this example, the electronic device is operated withAn (Android) operating system is an example. The system comprises an application program layer (APP layer, short for application layer), an application program Framework layer (Framework layer, short for Framework layer), a kernel layer and hardware from top to bottom Layers, etc. In other divisions, a hardware abstraction layer (Hardware Abstract Layer, HAL), system libraries, etc. may also be included between the framework layer and the kernel layer.

In this example, the application layer may include a series of application packages. By way of example, the application packages may include camera, call, alarm, gallery, calendar, map, navigation, WLAN, bluetooth, music, video, short message, etc., system applications based on the electronic device's operating system. In some implementations, the application package may also include other third party applications, such asA free link, etc. can provide an application for voice/video call functions. In some embodiments, the application layer may be provided with associated software components if AO capabilities are configured in the electronic device. For example, a gaze fence may be provided at the application layer for enabling perception of a user's gaze at the screen.

Wherein the AO (Always ON) module may provide the smart perceptibility to the electronic device. For example, human faces, gestures, objects, etc. are recognized by AI in the case of ground consumption overhead. A plurality of software/hardware modules may be included in the AO module. Different software and hardware cooperate to realize the perception of different objects. For example, the AO module may include a software module gazing fence, where the gazing fence may instruct an AO service (AO service) to cooperate with a camera when the electronic device needs to sense whether the user gazes at the screen, and analyze and determine, based on the acquired image information, a gazing situation of the current user, so as to implement sensing of the user gazing at the screen.

A framework layer in the electronic device may provide an application programming interface (application programming interface, API) and programming framework for application layer applications. The framework layer includes some predefined functions. Illustratively, in an embodiment of the present application, the framework layer may include a power manager for performing screen off/on management, a lock screen manager for performing screen lock management, a device state manager for managing a folded state of a folded screen, a camera manager for managing a camera, a call manager for managing a call such as voice/video, and the like.

In addition, some basic modules may be provided in the frame layer. Such as a window manager, an activity manager, a content provider, a view system, a resource manager, a notification manager, an input manager, etc. As one example, a window manager provides window management (Window Manager Service, WMS) that may be used for window management, window animation management, surface management, and as a relay station for an input system. The activity manager may provide activity management (Activity Manager Service, AMS), which may be used for system component (e.g., activity, service, content provider, broadcast receiver) start-up, handoff, scheduling, and application process management and scheduling tasks.

As shown in fig. 5, in the present application, a folded gaze detection module (also referred to as hnswingfoldback) may also be provided in the frame layer. The folding gaze detection module may be used to interact with other related services or managers to comprehensively determine the intent of the current user.

The manner of interaction between the modules or services may be different in different implementations.

For example, in some embodiments, automatic return upon a state change may be achieved by a registration monitor. It should be appreciated that there may be a variety of ways in which the state may be returned for some module/service interactions. In a specific implementation, a module (such as a folded gaze detection module) that wants to acquire other modules/services may send a corresponding status return manner when registering with the other modules/services, so that the peer module/service may perform status return according to the specified return manner. For example, when the folded gaze detection module indicates that the state is changed, the state return is executed, and then the corresponding module/service may return corresponding state information to the folded gaze detection module when the state is changed (e.g., the angle reaches a preset critical angle, a call is started, etc.).

In other embodiments, the folded gaze detection module may obtain status information of other modules/services by sending a request message (or query message). For example, the fold gaze detection module may send data request information to the AO module when information whether the current user is looking at the screen needs to be obtained. For another example, the fold gaze detection module may send corresponding request information to the power manager when determining whether the current display screen is in a bright screen state, or the like.

It should be noted that, in some embodiments, each module disposed in the framework layer may also correspond to one or more processes/threads in the system running process.

For example, in connection with fig. 6, after the electronic device is started, a process corresponding to a system service (SystemServer) may be initiated. In a system service process, multiple threads may be initiated for implementing different functions. For example, by initiating hnswingfoldbaohub for implementing the functionality of the fold gaze detection module of the present application; the method is used for realizing the function of the device state manager in the application by initiating the DeviceStateManager; the PowerManager is used for realizing the function of the power manager in the application; the keyguard manager is used for realizing the functions of the lock screen manager in the application; the camera manager is used for realizing the function of the camera manager in the application by initiating the CameraManager; by initiating a TelephonyManager, is used to implement the functionality of the call manager in the present application.

The threads can interact with each other to realize corresponding functions. For example, the folding gaze detection module may interact with the device state manager to determine that the current folding screen phone is in a folded state; the folding gaze detection module can interactively determine whether the current folding screen mobile phone is in a bright screen state or not with the power manager; the folding gaze detection module may interact with the lock screen manager to determine whether the current folding screen phone is in a lock screen state, etc.

The kernel layer in the electronic device may include drivers for a number of different components, such as sensor drivers, display drivers, camera drivers, AO drivers, etc. Through each driver set in the kernel layer, the application layer or the framework layer can smoothly call the corresponding components in the hardware layer, and through executing corresponding commands, the corresponding functions are realized. For example, taking a camera call as an example, an application program (such as a video call application program) in the application layer may issue a command for calling the camera, where the command may be processed by the framework layer, and by calling a camera driver in the kernel layer, the command is transferred downward to the camera, thereby starting the camera so as to support the function of video call.

The hardware layer may correspond to the physical components that implement the respective functions. Such as a camera for image acquisition, a display for display, etc.

Furthermore, in some embodiments, an Zhuoyun lines, native C/C++ libraries, etc. may also be included in the electronic device. The android runtime includes a core library and An Zhuoyun rows. The android runtime is responsible for converting source code into machine code. Android runtime mainly includes employing Advanced Or Time (AOT) compilation techniques and Just In Time (JIT) compilation techniques. The core library is mainly used for providing functions of basic Java class libraries, such as basic data structures, mathematics, input Output (IO), tools, databases, networks, and the like. The core library provides an API for the user to develop the android application. The native C/c++ library may include a plurality of functional modules. For example: surface manager (surface manager), media Framework (Media Framework), standard C libraries (Standard C library, libc), open graphics libraries of embedded systems (OpenGL for Embedded Systems, openGL ES), vulkan, SQLite, webkit, etc.

It should be understood that the solutions provided by the embodiments of the present application can be applied to electronic devices having the structural components shown in fig. 4-6.

The technical solutions provided by the embodiments of the present application will be described in detail below with reference to examples of electronic devices shown in fig. 5 and 6. Taking an electronic device as a folding screen mobile phone as an example.

Based on the screen-off scheme provided by the embodiment of the application, the folding screen mobile phone can more quickly and accurately execute screen-off control of the corresponding screen. For example, after the folding screen mobile phone is folded, the folding screen mobile phone can control the outer screen to rapidly turn off the screen under the condition that the user does not use the folding screen mobile phone in a short time, so that corresponding power consumption is saved. In other embodiments, the scheme can also be applied to a scene that whether the inner screen needs to be quickly extinguished after the folding screen mobile phone is opened.

In the following examples, whether the external screen is quenched rapidly after the mobile phone with the folding screen is folded will be described as an example. For other scenes, such as a scene of performing quick screen-off on an internal screen, the implementation of the method can be referred to with each other.

In the application, the folding screen mobile phone can have the capability of determining the use intention of the user. By way of example, after the folding screen mobile phone enters a folding state, the folding screen mobile phone can comprehensively judge the use intention of the user from multiple angles, so that an accurate judging result is obtained. As an example, as shown in fig. 7A, a folding screen phone may determine that a user is using an intent by any of: the display content of the external screen interface, whether the electronic equipment is out of screen, whether the electronic equipment is locked, whether the electronic equipment is in communication, whether the electronic equipment uses a camera, whether a user looks at the display screen, and the like.

In the embodiment of the present application, in conjunction with the foregoing description, the folding-screen mobile phone may display the interface 21 before folding (e.g. in an unfolded state), and the interface 21 may also be referred to as a first interface. After receiving the folding operation input by the user, a folded state may be entered, and the interface 22 (may also be referred to as a second interface) may be displayed on the external screen. Based on the scheme, as shown in fig. 7B, the folding screen mobile phone can control the external screen to rapidly turn off the screen under the condition that the user does not use the intention, so that the corresponding power consumption expense is saved. The following describes the scheme provided by the embodiment of the application in detail with reference to the accompanying drawings.

In some embodiments, the folding screen mobile phone can determine whether the user is using the folding screen mobile phone according to the display content of the external screen interface.

In general, some usage behaviors of a user have continuity. For example, during a voice/video call, even if the user adjusts the folding-screen mobile phone from the unfolded state (or semi-folded state) to the folded state, the voice/video call will not be terminated. That is, after entering the folded state, the user still has the intention to use the folding screen phone, and the folding screen phone needs to display the voice/video call interface to the user on the corresponding interface. In connection with the illustration in fig. 2, when the folding screen handset enters a folded state, the content displayed on the inner screen may be displayed on the outer screen interface. Therefore, in the voice/video call scene, the folding screen mobile phone can determine that the user still needs to use the folding screen mobile phone according to the related interface displayed on the external screen, and cannot put out the screen. Similarly, for other continuous use behaviors, the folding screen mobile phone can also determine that the user still uses the folding screen mobile phone according to the corresponding interface, and cannot put out the screen.

In this embodiment, an interface white list may be configured in the folding screen mobile phone, and the interface white list may include information corresponding to at least one interface. For example, the information corresponding to the interface may include a package name, a class name, etc. of the interface. The interface in the interface white list can be a scene of continuous use behavior in the process of using the folding screen mobile phone by a user. That is, when any interface in the interface white list is displayed on the external screen interface, the user still needs to use the folding screen mobile phone, and cannot put out the screen.

As an example, the interface in the interface whitelist may include at least one of:

such as com.content mm/com.content mm plug in voip ui video activity;

a call interface of the folding screen mobile phone (such as com. Android. Incallui/com. Android. Incallui. Incalloity);

such as com.tent.mobileqq/com.tent.av.ui.avactivity);

an open call interface (e.g., com.huawei.meetime/com.huawei.hicallmanager.incallActivity).

That is, the interface whitelist in the electronic device may include at least package names and class names corresponding to one or more of the interfaces.

In the embodiment of the application, the folding gaze detection module can be used for acquiring the package name and the class name of the current external screen display interface, matching the package name and the class name with the interface white list and determining whether the interface displayed by the current external screen is included in the interface white list.

Illustratively, each interface consists of individual activities, which in turn consist of views, which are the existence of windows, which are the carriers of views. For example, a voice interface is taken as an example. The application providing the voice function can pull up the activity corresponding to the voice interface in the corresponding process after receiving the instruction of performing voice chat input by the user. After the activity is established, the application can send the package name and the class name of the corresponding interface of the activity to the window manager, and correspondingly, the window manager can instruct the display screen to display the corresponding interface according to the received information.

For example, in connection with fig. 8, the voice call interface displayed on the display screen may be an interface 81 as in fig. 8. The package name corresponding to the interface 81 may be a package name 82, and the class name corresponding to the interface 81 may be a class name 83.

Then the fold gaze detection module may obtain the package name and class name of the interface currently being displayed from the window manager. The folding gaze detection module may search from the interface whitelist based on the obtained package name and class name, and determine whether the package name and class name of the currently displayed activity corresponding interface are included in the interface whitelist. If so, determining that the current external screen display interface corresponds to that the user is using the folding screen mobile phone, and not entering into quick screen quenching. Otherwise, if not, determining that the current external screen display interface corresponds to that the user does not use the folding screen mobile phone temporarily, and entering other judging steps. If no other judging steps are configured, the folding gaze detection module can instruct the folding screen mobile phone to rapidly quench the screen.

For example, in connection with fig. 9, the folded gaze detection module may implement the relevant determination of the interface in this example through S91-S92. S91, the folding gaze detection module acquires a package name 82 and a class name 83 of the current interface from the window manager. And S92, the folding gaze detection module performs matching searching from the interface white list according to the package name 82 and the class name 83. If the items which are identical to the package name 82 and the class name 83 exist in the interface white list, the corresponding matching is successful. Otherwise, if there is no item in the interface white list that is identical to the package name 82 and the class name 83, the matching fails.

Therefore, after the folding screen mobile phone is folded, if the package name and the class name of the external screen display interface are the same as any one of the interface whitelists, the electronic device determines that the current user is using the folding screen mobile phone and cannot execute quick screen extinction. Otherwise, if the corresponding item is not matched in the interface white list, the control of the folding screen mobile phone to rapidly turn off the screen can be considered, so that the power consumption is saved.

In other embodiments, the folding screen phone may determine whether the user is using the folding screen phone based on whether the external screen has been extinguished or whether the screen has been locked.

Referring to the illustration of fig. 2, after the folding-screen handset enters the folded state from the semi-folded state, the outer screen may continue to display the contents of the inner screen. That is, the folding screen mobile phone can not automatically extinguish or lock the screen within a short time (such as within 10 seconds) after entering the folding state. In this case, if the user does not need to continue to use the folding screen mobile phone, the folding screen mobile phone can be manually controlled to enter a screen-off state or a screen-locking state. For example, in connection with the operation illustrated at 32 in FIG. 3, a user may press a button, such as a shutdown key, to instruct the folding screen handset to turn off. Correspondingly, the folding screen mobile phone can extinguish the outer screen, and the state after the outer screen is extinguished is shown as 33 in fig. 3. For another example, the user may instruct the external screen to enter the screen locking state by inputting a corresponding operation. For example, please refer to fig. 10. Upon entering the collapsed state, the outer screen may display an interface 101 as shown in FIG. 10. In the current interface, a user can input a preset gesture to instruct the folding screen mobile phone to enter a screen locking state. For example, the preset gesture is the gesture 102 shown in fig. 10. After receiving the input of the gesture 102, the folding screen mobile phone can switch and display a screen locking interface shown as 103 on the external screen to enter a screen locking state in response to the input. In the screen locking state, the external screen can be in a bright screen state, and simple information such as time, date and the like is displayed on the screen locking interface. In this example, on the screen locking interface, a screen locking prompt identifier 104 may be further included, where the user is prompted to be currently in a screen locking state by displaying the screen locking prompt identifier 104. In other implementations, the user may instruct the folding screen mobile phone to enter the screen locking state by voice control or the like.

In the screen locking state, if the user needs to continue to use the folding screen mobile phone, relevant operations such as sliding, clicking a screen and the like can be performed, and unlocking information such as passwords, unlocking gestures and the like is input in a subsequent interface. Of course, in some cases, the user can unlock the folding screen mobile phone for continuous use in a manner of face unlocking, fingerprint unlocking, voiceprint unlocking and the like.

Through the above description, it can be seen that, in a short time after the folding screen mobile phone enters the folding state, the corresponding screen-off state or screen-locking state is entered under the active control of the user. And the user can control the folding screen mobile phone to enter the screen-off state or the screen-locking state only in a short time without using the folding screen mobile phone. In this example, the folding screen mobile phone may determine whether the user needs to continue using the folding screen mobile phone according to whether the current folding screen mobile phone is in the off-screen state or the lock-screen state. For example, when the folding screen mobile phone is in any one of the off-screen state and the lock-screen state, the folding screen mobile phone can determine that the user cannot use the folding screen mobile phone for a short time.

In the embodiment of the application, the folding gaze detection module can also be used for acquiring the relevant information of whether to quench the screen or lock the screen currently.

For example, in conjunction with the description of fig. 5 and 6, a power manager may be used to perform screen off/on management and a lock manager may be used to perform screen lock management. In this example, the fold gaze detection module may interact with the power manager to determine whether the current screen is lit, and the fold gaze detection module may also interact with the lock manager to determine whether the current screen is lit.

As an example, referring to fig. 11, in S111, the fold gaze detection module may send a status request message a to the power manager, as the status request message a may include powermanager. In response to the status request message a, in S112, the power manager may return a value corresponding to the current on-off status to the folded gaze detection module, e.g. return true for on-screen and false for off-screen. Then, based on the return value, the folded gaze detection module may know whether the current screen state is a bright screen.

In other examples, referring to fig. 12, in S121, the fold gaze detection module may also send a status request message B to the lockscreen manager, e.g., the status request message B may include keyguard manager. In response to the status request message B, in S122, the lock manager may return a value corresponding to the current lock status to the fold gaze detection module, return true to represent lock, and return false to represent unlock. Then, based on the return value, the folded gaze detection module may know whether the current screen state is locked.

It should be noted that, in different implementations, the interaction timing between the folding gaze detection module and the power manager and the lock screen manager may be different. For example, in some embodiments, the fold gaze detection module may interact with a power manager to determine whether a screen is locked after determining that the current screen status is a bright screen. Therefore, under the condition that the current screen state is screen extinction, the folding gaze detection module does not need to interact with the screen locking manager, so that signaling overhead and corresponding power consumption in the electronic equipment are saved. In other embodiments, the fold gaze detection module may interact with the screen lock manager to determine whether to extinguish the screen after determining that the current screen state is an unlocked screen. Therefore, under the condition that the current screen state is screen locking, the folding gaze detection module does not need to interact with the power manager, so that signaling overhead and corresponding power consumption in the electronic equipment are saved. In other embodiments, the folding gaze detection module may also send respective status request messages to the power manager and the screen locking manager at the same time, so as to quickly obtain the current on-off status and the screen locking status, thereby saving time overhead.

Thus, after the folding screen mobile phone is folded, if the screen is not locked or extinguished, the electronic device can consider whether to execute quick screen extinguishing or not.

In other embodiments, the folding screen phone may determine whether the user is using the folding screen phone based on whether the user is currently in a call.

It will be appreciated that if the folding screen handset is providing call services to the user prior to folding, then as the folding screen handset enters the folded state, the call services will not be stopped until the user or the opposite user hangs up the current call. While in the course of a call, the user may need to use other functions provided by the folding screen phone through the interface. By way of example, fig. 13 shows a schematic representation of a call interface displayed on an external screen. A plurality of extended function icons may be included on the call interface. For example 131. During the call, the user can record the current call by touching or clicking the record icon 131. As another example, 132 corresponds to a contact icon. During the call, the user can view the address book by touching or clicking on the contact icon 132. Then the user's use of the above functions may be affected if a quick quench is performed during the process.

In the embodiment of the application, the folding gaze detection module can also be used for acquiring the current call state. For example, the call state may include an unvoiced state, a call state (or called a state in call), a hang-up state between the call state and the unvoiced state, and the like.

Illustratively, the fold gaze detection module may obtain the call state by interacting with a call manager.

In this example, as shown in fig. 14, in S141, the fold-gaze module may register a listening call state monitor (e.g., phonetatelistener) with the call manager so that the call manager may send the corresponding call state to the fold-gaze module.

In some embodiments, the folded registration detection module may carry a callback method for hopeing the call manager to return a message in the registration request C (or referred to as a third registration request) when registering for interception. Illustratively, the fold gaze module may carry the onCallStateChanged callback method in the registration request C. Thus, in S142, the call manager may send a corresponding state change message D to the fold-gaze module when the call state changes. For example, a value (e.g., state value) for indicating switching to a certain state may be included in the state change message D. If state is 0 (corresponding to the sixth identifier), the call is correspondingly in the non-call state, i.e. the call is ended. For another example, when state is 1 (corresponding to the fifth identifier), the call state is correspondingly entered, that is, the call connection is already established, and both parties can start the call. For another example, when state is 2 (corresponding to the seventh identifier), the state is correspondingly in the hang-up state, that is, the call connection is disconnected, and the state is about to be in the non-call state.

The fold registration detection module may use the call state corresponding to the current new state change message D to cover the previous call state when receiving one state change message D, so as to ensure that the current stored call state is the latest state.

Thus, if the folding screen mobile phone is in a call, then it is determined that the user is using the folding screen mobile phone, and a quick screen quenching is not performed correspondingly. Otherwise, if the current folding screen mobile phone does not call, the quick screen extinction can be considered to be executed, and power consumption is saved.

In other embodiments, the folding screen phone may determine whether the user is using the folding screen phone based on whether the camera is in use.

In connection with the examples of fig. 1 and 2, a plurality of cameras may be provided on a folding screen phone. For example, the plurality of cameras may include an inner screen camera, an outer screen camera, a rear camera, and the like. In this example, the folding screen may determine that the user is not using the functions associated with image acquisition of the folding screen phone when none of the cameras is in use, and may consider performing a quick screen quench.

It will be appreciated that the folding screen handset may capture images via any one or more cameras disposed therein, and provide relevant functionality to the user based on the captured images. For example, a folding screen cell phone may provide a photographing function through a camera. Such as self-photographing using an external screen camera, or photographing using a rear camera, etc. For another example, the folding screen mobile phone can provide a code scanning function through a camera. And if the rear camera is used for scanning the target two-dimensional code, the bar code and the like, acquiring related information. When the camera of the folding screen mobile phone is in the use process, the user is indicated to be using the corresponding function. Therefore, in this example, quick screen quenching cannot be performed when any of the cameras on the folding screen phone are operated.

In the embodiment of the application, the folding gaze detection module can also be used for acquiring the current working state of each camera. Such as in operation or not.

For example, the fold gaze detection module may interact with a camera manager to obtain the operational status of each camera. In this example, as shown in fig. 15, similar to the acquisition of the on-off state and the acquisition of the lock state, in S151, the folded gaze detection module may also acquire the working states of the respective cameras by registering and listening.

In some embodiments, the fold register detection module may carry a callback method in the registration request E (or referred to as a second registration request) that hopes the camera manager to return a message when registering for listening with the camera manager. For example, the fold gaze module may carry a camelback callback method in the registration request E. In this way, when the working state of the camera changes, the camera manager may send a corresponding state change message F to the fold gaze module in S152. For example, the state change message F may include onCameraAvailable and/or onCameraUnavailable. The onCamera available is used for indicating the registration of the camera, and the onCamera unavailable is used for indicating the deregistration of the camera.

In the present application, each of the plurality of cameras may correspond to one camera ID. The ID of the corresponding camera may be carried in both the oncamera available (e.g., referred to as the third identifier) and the oncamera unavailable (e.g., referred to as the fourth identifier) returned by the camera manager. For example, the camera manager returns oncamera available (1), indicating that the camera with ID 1 starts working. As another example, the camera manager returns oncamera available (3), indicating that the camera with ID 3 stops working.

The folding registration detection module can update the working state of the corresponding camera by using the current new state change message F when receiving the state change message F from the camera manager, so as to ensure that the working state of each camera stored currently is the latest state.

Therefore, after the folding screen mobile phone is folded, if the camera is in a working state, the electronic equipment indicates that the user is using the folding screen mobile phone, and quick screen extinction is not executed. Otherwise, if each camera is in a non-working state, if the latest working state of each camera is transmitted through the onCamera unavailable, the quick screen extinction can be considered to be executed, and the power consumption is saved.

In other embodiments, the folding screen handset may determine whether the user is using the folding screen handset based on whether the user is currently looking at the screen.

It will be appreciated that when a user is using a folding screen handset, the user will typically look at the screen. Correspondingly, the external screen of the folding screen mobile phone can be in a bright screen state, and the content which the user needs to watch is displayed on the interface of the external screen. Conversely, if the user is not looking at the screen, then it is indicated that the user may not have an intention to use the folding screen handset.

While the user may alternate between gazing the screen and not gazing the screen during use of the folding screen phone. If the user has the intention of using the folding screen mobile phone, the user can watch the screen for a long time, and correspondingly, the duration of continuous non-watching screen is not too long. In the embodiment of the application, from the beginning of detecting whether the user gazes at the screen, if the duration that the user does not continuously gaze at the screen within a period of time exceeds the preset gazing-free threshold value, the folding screen mobile phone confirms that the user does not gaze at the screen. Correspondingly, if the duration of the user's non-continuous watching screen is smaller than the preset non-watching threshold value in the time period (namely the maximum detection duration), the user is indicated to have the intention of using the folding screen mobile phone, and the user can not execute quick screen quenching, so that the interference to the user's use is avoided.

Illustratively, taking the case that the duration that the user does not continuously watch the screen within 4s exceeds 2s, the user is considered to have not watched the screen. Fig. 16 shows a diagram of this solution. After time T0, the user gazes at the screen for a short period of time and no longer gazes at the screen. Next, a gazed screen and a non-gazed screen alternate. For example, during 4s after T0, the user does not look at the screen for a period of time L1 during the period of T1-T2. During the period T2-T3, the user continues to look at the screen. During the period L2 of time T3-T4, the user is not looking at the screen. The duration L3 of the non-fixation screen also alternates next.

In this example, the folding screen mobile phone may detect whether the duration of the continuous non-gazing screen of the user exceeds a preset period of 2s from the time T0. For example, starting from the time T0, the folding screen mobile phone detects L1 in the time period of T1-T2, the user does not watch the screen, the L1 is smaller than the preset 2s, and the detection is continued. The folding screen mobile phone detects L2 in the time period of T3-T4, the user does not watch the screen, the L2 is larger than 2s, and then the folding screen mobile phone can consider that the user does not watch the screen. In some embodiments, the folding screen handset may stop detecting whether the user is looking at the screen if it is determined at time T4 that the user is not looking at the screen.

Of course, in the example of fig. 16, if L2 is still smaller than the preset 2s, the folding screen mobile phone may continue to detect whether the user looks at the screen or not until the maximum detection duration reaching t0+4s is calculated from the time T0. If L1, L2 and L3 are all less than 2s, the folding screen mobile phone can confirm that the user has the intention to use the folding screen mobile phone.

In the above examples, the maximum detection duration of 4s and the duration of 2s in which the user continuously does not watch the screen are examples. In other implementations of the application, the maximum detection duration and the duration of the continuous non-gazed screen may be flexibly set according to the actual situation.

In the above examples, the case of detecting that the user looks at the screen by using the folding screen mobile phone is illustrated as an example. In conjunction with the description of fig. 5 and fig. 6, in some implementations of the present application, a folding gaze detection module provided in a folding screen mobile phone may implement detection of a user gaze situation by interacting with an AO module.

As illustrated in fig. 17. When gaze detection is required for the user, in S171, the folded gaze detection module may register human eye gaze detection with the AO module. In some embodiments, the folded gaze detection module may send a registration request G (or referred to as a first registration request) to the AO module for registering human eye gaze detection. For example, the registration request G may enable registration of human eye gaze detection by awarenesscient. In this registration request G, a method may be carried in which the AO module is expected to return information. For example, the registration request G may carry a fenceeventlist callback method, and instruct the AO module to return the eye gaze detection result in a manner corresponding to onEvent. Correspondingly, in S172, when the state of the eye fixation and the state of the eye fixation are changed, the AO module may return a state change message H correspondingly. Illustratively, the result of the eye gaze state change may be encapsulated in the state change message H by the fenceevent. Correspondingly, the folded gaze detection module may, upon receiving the status change message H, find an item of fenceevent. In this looked-up item, an identification (e.g. true, or referred to as first identification) for indicating that the current user is looking at the screen, or an identification (e.g. false, or referred to as second identification) for indicating that the current user is not looking at the screen, may be included. It should be understood that, the time period between receiving the second identifier indicating that the user is not currently looking at the screen and receiving the next first identifier indicating that the user is currently looking at the screen (such as the first time period) may be the time period when the user continuously does not look at the screen at a time. And if the user is within the maximum detection duration, if the last received identification is the second identification, the duration from the time of receiving the second identification to the time of ending the maximum detection duration (such as the second duration) can also be corresponding to the duration that the user continuously does not watch the screen once.

In connection with fig. 16, at time T0, the folded gaze detection module may send a registration request G to the AO module. Correspondingly, the AO module starts to provide relevant information about whether the human eyes watch the screen or not to the folding watch module. For example, at time T0 when receiving the registration request G, the AO module may return a status change message H carrying true to the fold-gaze module, indicating that the user is gazing at the screen. At time T1, the AO module may return a status change message H carrying false to the fold-gaze module indicating that the user is no longer looking at the screen. At this moment, the folded gaze detection module starts timing until receiving the next state change message H carrying true at time T2. The folded gaze detection module may determine that the user begins to gaze at the screen. Then, the folded gaze detection module may determine a magnitude relationship between a duration L1 between time T2 and time T1 and a preset non-gaze threshold (e.g., 2s in the above example), and if L1 is less than 2s, continue detection. Repeatedly, the folded gaze detection module may receive a status change message H carrying false at time T3, indicating that the user is no longer looking at the screen. The folding gaze detection module starts timing until receiving the next state change message H carrying true at time T4. The folding gaze detection module may determine a magnitude relationship between a duration L2 between a time T4 and a time T3 and a preset non-gaze threshold (e.g., 2s in the above example), and if L2 is greater than 2s, stop detection, and determine that the user has not gazed at the screen for a longer time, that is, the user has not intended to continue using the folding screen mobile phone, and may consider triggering a quick screen-off. If L2 is still less than 2s, the above detection process is repeated until a continuous gazing less threshold of more than 2s occurs, or a maximum detection duration is reached, and detection may be stopped by sending a de-registration request (e.g., referred to as a first de-registration request).

In some embodiments, upon stopping detection, if it is determined that L2 is greater than 2s, and if a maximum detection duration is reached, the folded gaze detection module may send a registration message to the AO module indicating that the AO module no longer provides the eye gaze detection functionality to the folded gaze detection module.

Thus, if the time that the eyes continuously do not watch the screen is larger than the preset non-watch threshold, the quick screen quenching can be considered to be executed, and the power consumption is saved.

7A-17, the embodiment of the application provides at least 6 dimensions, so that the folding screen mobile phone can only detect and judge the use intention of the user through the folding gaze detection module, and further determine whether to trigger the rapid screen extinction. As an example, upon determining to trigger a quick screen off, the fold gaze detection module may send a screen off indication to the power management module so that the power management module extinguishes the screen, saving on screen power consumption. For example, the quench indication may include a powermanager.

In addition, in the above examples, the case where the external screen is turned off quickly after the folding-screen mobile phone enters the folded state is taken as an example. The triggering mechanism of the scheme can be set to enable the folding screen mobile phone to enter a folding state.

Illustratively, as shown in FIG. 18, the fold gaze detection module may interact with a device state manager to obtain the state of the current fold screen. So as to trigger the judging mechanism to determine whether to execute quick screen quenching when the current folding state is determined. For example, in S181, the folded gaze detection module may register for listening with a device state manager, such as sending a registration request I (e.g., referred to as a fourth registration request). The registration request I may carry a devicestatemanager.devicestatepre callback, and instruct the device state manager to notify the fold gaze detection module of the change of the current fold state by using a callback method onStateChanged. Correspondingly, in S182, the device state manager may return, when receiving the registration request I and when the subsequent folding state is changed, a state change message J to the folding gaze detection module, where the state change message J may carry an identifier for indicating the current folding state. If the mark is 1, the corresponding current folding state is unfolding, namely the folding angle is 180 degrees. And if the mark is 2 (corresponding to the eighth mark), the current folding state is folding, namely the folding angle is 0 degree.

The folding gaze detection module may trigger the above-described determination of whether to perform a quick screen-off, each time a determination is received that indicates that the current folding state is folding.

In particular, the display content of the external screen interface, whether the electronic device is out of screen, whether the electronic device is locked, whether the electronic device is in a call, whether the electronic device uses a camera, and whether the user looks at the application sequence of the display screen may be flexibly set.

For example, in some embodiments, the folding gaze detection module may sequentially execute the 6-dimension determination of whether the display content of the external screen interface is displayed, whether the electronic device is turned off, whether the electronic device is locked, whether the electronic device is in a call, whether the electronic device uses a camera, whether the user is gazing at the display screen, and when the determination results of all the dimensions are that the user does not use the intention, trigger the quick screen turning off.

In other embodiments, the folding gaze detection module may sequentially execute display content of the external screen interface, whether the electronic device is turned off, whether the electronic device is locked, whether the electronic device is in a call, and whether the electronic device uses the camera, and may include any two or more parallel judgments, and if any one of the judgments results is that the user has a use intention, the judgments of other dimensions are stopped, and it is determined that the user has a use intention, and the quick turn-off is not triggered. And when the judgment results of all the 5 dimensions are that the user does not use the intention, continuing to judge whether the user looks at the display screen, and triggering the quick screen quenching if the conclusion is still that the user does not use the intention. In this way, the interaction process of the AO module which is required to be complicated is set after all other judgments, so that if any one of the other judgments determines that the user has the use intention, the interaction of the AO module is not required to be executed, and the corresponding expenditure is saved.

In other embodiments, the folded gaze detection module may further select any one of the 6 dimensions to determine whether the user has an intent to use. In the scheme of selecting multiple dimension judgment, if all dimensions indicate that the user does not have the use intention, triggering the quick screen quenching.

In the specific implementation, the serial detection time of 5 dimensions, namely, whether the display content of the external screen interface, the electronic equipment is out of screen, whether the electronic equipment is locked, whether the electronic equipment is in a call or not, and whether the electronic equipment uses a camera, is not more than 1s. And the detection time of whether the user is looking at the display screen may be set to not more than 4s (i.e., the maximum detection duration). Then, under the condition that the judgment results of all the dimensions are that the user does not use the intention, the folding screen mobile phone can realize quick screen extinction within 5 seconds. Fig. 19 shows a comparison with an existing screen-off scheme. Take the existing quench scheme as an example of the timeout quench scheme shown at 31 in fig. 3. When the 0s folding screen mobile phone enters a folding state, correspondingly, under the condition of adopting the scheme, the folding screen mobile phone can enter a screen-off state within 5s at the shortest time, and when adopting the overtime screen-off scheme, the folding screen mobile phone can enter the screen-off state after 15 s. It can be seen that the adoption of the scheme can save at least 10s of bright screen power consumption.

In order to more clearly describe the scheme provided by the embodiment of the present application, the interaction between the modules is illustrated by taking serial judgment with 6 dimensions as an example in the following with reference to the interaction schematic diagram of each module shown in fig. 20.

As shown in fig. 20, the scheme may include:

s201, the folding gaze detection module registers monitoring with the device state manager.

For example, when the system is started (for example, when the system is started), the operating system of the folding screen mobile phone starts the system server process. In the application, the HnSwingFoldAOhub thread (namely the folding gaze detection module) can be pulled up in the SystemServer process.

The HnSwingFoldAOhub thread may register a DeviceStateManager.DeviceStatePreCallBack callback at startup, indicating that the DeviceStateManager (i.e., the device state manager) notifies the HnSwingFoldAOhub thread whether the folding screen handset has been folded.

S202, the device state manager sends the folding state of the folding screen to the folding gaze detection module.

Illustratively, the DeviceStateManager may return the current collapsed state to the HnSwingFoldAOhub thread when the HnSwingFoldAOhub thread registers a DeviceStateManager. DeviceStatePreCallback callback. The DeviceStateManager may also update the folding status to the HnSwingFoldAOhub thread when a folding screen status change occurs.

S203, the folding gaze detection module stores/updates the folding state of the folding screen.

Illustratively, after receiving a collapsed state, the HnSwingFoldAOhub thread may store the collapsed state and update the collapsed state each time a new collapsed state is received.

In this example, the execution of S201 to S203 may be described with reference to fig. 18.

S204, the folding gaze detection module registers monitoring with a camera manager.

Illustratively, the HnSwingFoldAOhub thread may register a CameraManager.AvalabiliyCallback callback at startup, instructing the CameraManager (i.e., the camera manager) to notify the HnSwingFoldAOhub thread of camera registration and deregistration events through onCameraAvalable and onCameraUna Vailable.

S205, the camera manager sends the working state of the camera to the folding gaze detection module.

For example, the camelamanager may return the current working state of each camera to the hnswingfoldback thread when the hnswingfoldback thread registers a camelback callback. For example, the working state of the inner screen camera, the working state of the outer screen camera and the working state of the rear camera are included. The camera manager can also update the working state of the camera to the hnswingfoldback thread when the working state of the camera is changed.

S206, the folding gaze detection module stores/updates the working state of the camera.

For example, after receiving the folded state, the hnswingfoldback thread may store each camera operating state and update the corresponding camera operating state each time a new camera operating state is received.

In this example, the execution of S204-S206 may be described with reference to fig. 15.

S207, the folding gaze detection module registers monitoring with a call manager.

Illustratively, the hnswingfoldback thread may register a phonetatelistener callback at start-up, instructing the telesynkmanager (i.e., call manager) to notify the hnswingfoldback thread of the current call state by the callback method onCallStateChanged.

S208, the call manager sends the call state to the folding gaze detection module.

Illustratively, the TelePhony manager may return the current call state to the HnSwingFoldAOhub thread when the HnSwingFoldAOhub thread registers the PhoneTateListener callback. The TelephonyManager may also update the call state to the HnSwingFoldAOhub thread when the call state changes.

S209, the folding gaze detection module stores/updates the call state.

Illustratively, after receiving the collapsed state, the hnswingfoldbaohub thread may store the call state and update the stored call state each time a new call state is received.

In this example, the execution of S207 to S209 may be described with reference to fig. 14.

In the above examples, the registration process with the device status manager, the camera manager, and the call manager is performed when the fold gaze detection module is started. In other implementations, any of the three registration processes described above may also be completed after the folded gaze detection module is activated.

In this example, when the fold gaze detection module determines that the current fold screen state is a folded state, the following execution of S210 may be triggered.

S210, the folding gaze detection module judges whether the current interface is in an interface white list. If not, S211 is performed. If so, the process is stopped. Until the next folding screen state is the folding state, the execution of S210 is triggered again.

For example, the execution of S210 may refer to the execution of fig. 8 and 9 and the description.

S211, the folding gaze detection module sends a state request message A to the power manager.

S212, the power manager sends a value corresponding to the current on-off screen state to the folding gaze detection module.

S213, the folding fixation detection module judges whether the screen is quenched currently. If not, S214 is performed. If so, the process is stopped. Until the next folding screen state is the folding state, the execution of S210 is triggered again.

For example, the execution of S211 to S213 may refer to the execution of fig. 11 and the description.

S214, the folding gaze detection module sends a state request message B to the lock screen manager.

S215, the screen locking manager sends a value corresponding to the current screen locking state to the folding gaze detection module.

S216, the folding gaze detection module judges whether a screen is locked currently. If not, S217 is performed. If so, the process is stopped. Until the next folding screen state is the folding state, the execution of S210 is triggered again.

For example, the execution of S214-S216 may be described with reference to the execution of fig. 12.

S217, the folding gaze detection module judges whether the camera is used or not.

Illustratively, the hnswingfoldbaohub thread may determine whether the camera is in use by storing/updating the camera state in S206. If all cameras are not used, i.e., if the determination result is no, S218 is executed. Otherwise, if there is at least one camera in use, the process is stopped. Until the next folding screen state is the folding state, the execution of S210 is triggered again.

S218, the folding gaze detection module judges whether the call is in progress.

By way of example, the hnswingfoldbaohub thread may determine whether it is currently in a talk state by storing/updating the camera state in S209. If not in the call state, if in the not-call state or the hang-up state, i.e., if the determination result is no, S219 is executed. Otherwise, if the call is in the on-going state, the flow is stopped. Until the next folding screen state is the folding state, the execution of S210 is triggered again.

S219, the folding gaze detection module registers human eye gaze detection with the AO module.

By way of example, the hnswingfoldback thread may register human eye gaze detection through the awaressclient, so that the AO module returns a corresponding human eye gaze detection result through the fenceeventlist callback method onEvent method.

S220, the AO module sends a state change message H to the folding gaze detection module.

For example, the AO module may return the current user's gaze condition to the hnswingfoldback thread when the hnswingfoldback thread registers the eye gaze detection. The AO module may also send the gaze status of the eyes to the hnswingfoldback thread when the gaze status of the user changes.

S221, the folding fixation detection module judges whether fixation is continuously not carried out. If the determination result is negative, the following S222 is performed. Otherwise, if the continuous non-gazing rule is not met, the flow is stopped. Until the next folding screen state is the folding state, the execution of S210 is triggered again.

In this example, the execution of S219 to S221 may be described with reference to the execution of the foregoing fig. 16 to 17.

S222, the folding gaze detection module sends a screen extinction instruction to the power management module.

By way of example, the hnswingfoldback thread may instruct the power manager to perform a screen-off process by powermanager, when it is determined that the user does not have an intention to use the folding screen phone for a short period of time, thereby saving power consumption overhead.

In the explanation of fig. 20, if it is judged in any one of the judging steps that there is a use intention corresponding to the user, S210 may be returned to wait for the next folding screen state to be changed to the folding state, thereby triggering the quick screen-off scheme. In some embodiments of the present application, in a case where a result of any one of the judging steps corresponds to a user's intention, before the next folding screen state is changed to the folding state, the foldable mobile phone may further enter other screen-quenching schemes. For example, in the case where the result of any one of the judging steps corresponds to the user's intention to use, the foldable cellular phone may enter a scheme of turning off the screen after reaching the preset time period as shown by 31 in fig. 3 before the next time the screen folding state is changed to the folded state. Then, before the next time the folding screen state is changed to the folding state, if the user does not input any operation within a preset period of time (e.g. 15 s), the foldable mobile phone may also enter the off-screen state. Of course, if the user inputs a screen-off operation as shown at 32 in fig. 3 while any of the foregoing steps is performed, the corresponding folding screen handset may directly enter a screen-off state.

The scheme provided by the embodiment of the present application is described below from the point of view of the electronic device with reference to the description of fig. 20. For example, please refer to fig. 21. The embodiment of the application provides a flow diagram of an electronic equipment screen-off display method. As shown in fig. 21, the scheme may include:

s2101, the electronic apparatus enters a folded state.

S2102, the electronic device determines that the current interface is not in the interface white list.

S2103, the electronic equipment determines that the electronic equipment is not in a screen-off state or a screen-locking state currently.

S2104, the electronic device determines that it is not currently in a call, and the camera is not used.

S2105, the electronic device determines that the user is not continuously looking at the screen.

S2106, the electronic equipment controls the display screen to be turned off.

It should be understood that each step of the solution shown in fig. 21 corresponds to each step in the foregoing fig. 20 and the foregoing solutions, so that specific implementation processes in the steps may be referred to each other, and the obtained beneficial effects are similar, which is not repeated herein.

It should be noted that, the technical scheme provided by the embodiment of the application can be preset in the electronic equipment and automatically executed. In other embodiments, the electronic device may also provide a first-pass setting interface for the user, so that the user can set the setting by himself as required.

For example, as shown in fig. 22, in a setting interface of the electronic device (such as interface 2201 shown in fig. 22), a personalized setting tab for each function of the electronic device may be included. A label 2202 may be included for adjusting display and brightness, among other things. The user may click or touch the tag 2202 and the corresponding electronic device may display the specific content of the display and brightness tag 2202 in the right side expansion bar. For example, in one of the expanded fields of the display and brightness tag 2202, multiple off screen versions of the folded screen handset may be displayed for selection. In this example, the plurality of off-screen schemes may include a scheme option of "bright screen while looking at the outer screen". Then the user can activate the plan by clicking on the tab 2203 corresponding to the plan option. Therefore, the electronic equipment can execute quick screen quenching according to the screen quenching scheme provided by any one of the embodiments of the application provided in the above description when the user is determined not to use the intention, so that the power consumption is saved, and the service time of the electronic equipment is prolonged.

An example of the setting interface in fig. 22 is shown by way of an inner screen (i.e., a folding screen). It should be understood that the folding screen mobile phone can also provide an interface for opening the screen quenching scheme provided by the embodiment of the application on the external screen.

It should be noted that, in some embodiments, the folding screen mobile phone may determine, through interaction between the AO module and the folding gaze detection module, whether the user is within the maximum detection duration, and whether the time of the continuous non-gazing screen exceeds a preset non-gazing threshold. If so, determining that the user does not use the mobile phone in a short time, and considering triggering the quick screen quenching. In this implementation, the folding screen handset may invoke a camera to determine the user's gaze at the screen. Then, in some implementations of the present application, when the user instructs the folding screen phone to open the "gazing at no screen" function, the folding screen phone may invoke the camera to determine that the user gazes at the screen after the user's authorization.

The above description mainly describes the scheme provided by the embodiment of the application from the perspective of each service module. To achieve the above functions, it includes corresponding hardware structures and/or software modules that perform the respective functions. Those of skill in the art will readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application. It should be noted that, in the embodiment of the present application, the division of the modules is schematic, which is merely a logic function division, and other division manners may be implemented in actual implementation.

Fig. 23 shows a schematic composition diagram of an electronic device 2300. As shown in fig. 23, the electronic device 2300 may be provided with a folding screen. The electronic device 2300 may further include: a processor 2301 and a memory 2302. The memory 2302 is used to store computer-executable instructions. For example, in some embodiments, the processor 2301, when executing instructions stored in the memory 2302, may cause the electronic device 2300 to perform the electronic device off-screen display method shown in any of the embodiments described above.

It should be noted that, all relevant contents of each step related to the above method embodiment may be cited to the functional description of the corresponding functional module, which is not described herein.

Fig. 24 shows a schematic diagram of the composition of a chip system 2400. The chip system 2400 may include: processor 2401 and communication interface 2402 for supporting related devices (such as a folding screen phone) to implement the functions referred to in the above embodiments. In one possible design, the system-on-chip also includes memory for storing the program instructions and data necessary for the folding screen phone. The chip system can be composed of chips, and can also comprise chips and other discrete devices. It is noted that in some implementations of the application, the communication interface 2402 may also be referred to as an interface circuit.

The functions or acts or operations or steps and the like in the embodiments described above may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device including one or more servers, data centers, etc. that can be integrated with the medium. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a Solid State Disk (SSD)), or the like.

Although the application has been described in connection with specific features and embodiments thereof, it will be apparent that various modifications and combinations can be made without departing from the spirit and scope of the application. Accordingly, the specification and drawings are merely exemplary illustrations of the present application as defined in the appended claims and are considered to cover any and all modifications, variations, combinations, or equivalents that fall within the scope of the application. It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the spirit or scope of the application. Thus, it is intended that the present application also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims

1. An electronic device screen-off display method, which is characterized by being applied to an electronic device, wherein the electronic device is provided with a folding screen, and the method comprises the following steps:

when the electronic equipment is in an unfolding state, the inner screen of the electronic equipment displays a first interface, the first interface comprises a first part and a second part, the first part comprises a first element set, the second part comprises a second element set,

Receiving a first operation of a user, the first operation being used to trigger folding of the electronic device,

responding to the first operation, and displaying a second interface on an external screen; the second interface comprises the first element set and a second element set, or the second interface comprises the first element set, and a first part corresponding to the first element set is a focus interface of the first interface;

controlling the external screen to be extinguished when the user does not continuously watch the external screen, the second interface is not included in an interface white list and all cameras of the electronic equipment are not used;

wherein the user does not continuously look at the outer screen, comprising: within the maximum detection time after the electronic equipment is folded, the electronic equipment detects that the time that the user does not continuously watch the external screen is greater than a non-watching threshold;

the interface white list is preset in the electronic equipment, the interface white list comprises at least one interface, and the at least one interface comprises at least one of the following: a voice/video interface, a call interface;

the class names and the package names of the interfaces in the interface white list are stored in the electronic equipment, and the electronic equipment determines that the second interface is not included in the interface white list according to the package names and the class names of the second interface.

2. The method of claim 1, wherein prior to said controlling said external screen to extinguish, said method further comprises: it is determined that the user is not continuously gazing at the outer screen.

3. The method of claim 1 or 2, wherein the maximum detected duration after folding of the electronic device includes determining that the user is not continuously looking at the external screen at least once when a duration of time that the user is not continuously looking at the external screen is greater than a non-gaze threshold.

4. The method according to claim 1, wherein a folding gaze detection module is provided in the electronic device, and when the user gaze condition changes, the electronic device generates and feeds back a first identifier or a second identifier to the folding gaze detection module, where the first identifier is used for indicating that the user gaze condition changes to user gaze, and the second identifier is used for indicating that the user gaze condition changes to user gaze;

the determining that the user is not continuously gazing at the external screen includes:

the folding gaze detection module counts a first time length between the second mark and the next first mark within a maximum detection time length, wherein the first time length is the time length of the user which is not continuously gazing at the external screen once;

When at least one first time period is greater than the non-gazing threshold, determining that the user is not continuously gazing at the external screen.

5. The method of claim 4, wherein if the last received identification of the folded gaze detection module is the second identification within the maximum detection duration, the method further comprising:

and the folding gaze detection module counts a second time period between the last second mark received and the maximum detection time period, and when the second time period is longer than the non-gaze threshold value, the user is determined to not continuously gaze the external screen.

6. The method of claim 1, wherein a fold gaze detection module is provided in the electronic device,

the determining that the interface information of the first interface is not in the interface white list includes:

the folding gaze detection module obtains interface information of the current interface from a window manager of the electronic device to obtain interface information of the first interface,

and the folding gaze detection module searches in the interface white list according to the interface information of the first interface, and determines that the interface information of the first interface is not in the interface white list.

7. The method of claim 1, wherein a fold gaze detection module is provided in the electronic device,

the determining that the at least one camera is not in use includes:

the folding gaze detection module sends a second registration request to a camera manager of the electronic device, wherein the second registration request is used for obtaining the working state of each camera in the at least one camera, and the working state of the camera comprises working and non-working;

responding to the second registration request, when the working state of each camera is changed, the camera manager sends a camera state change message to the folding gaze detection module, wherein the camera state change message comprises an identifier of the corresponding camera and a third identifier or a fourth identifier, the third identifier is used for indicating that the working state of the camera is changed to work, and the fourth identifier is used for indicating that the working state of the camera is changed to be not work;

the folding gaze detection module stores or updates the working state of each camera according to the received camera state change message;

and when the working states of all cameras are not working, determining that all cameras are not used.

8. The method of any of claims 1-7, wherein prior to controlling the external screen quench, the method further comprises:

and determining that the electronic equipment is not in communication.

9. The method of claim 8, wherein a fold gaze detection module is provided in the electronic device,

the determining that the electronic device is not in communication includes:

the folding gaze detection module sends a third registration request to a call manager of the electronic device, wherein the third registration request is used for acquiring a call state of the electronic device, and the call state comprises a call state in which the electronic device is not in call and a hang-up state;

responding to the third registration request, when the call state of the call manager is changed, sending a fifth identifier or a sixth identifier or a seventh identifier to the folding gaze detection module, wherein the fifth identifier is used for indicating that the call state is changed into a call, the sixth identifier is used for indicating that the call state is changed into an un-call, and the seventh identifier is used for indicating that the call state is changed into a hanging-up;

the folding gaze detection module stores or updates the call state according to the received fifth identifier or sixth identifier or seventh identifier; when the current call state is hang-up or not in a call, determining that the electronic equipment is not in the call; or alternatively, the process may be performed,

And the folding gaze detection module determines that the electronic equipment is not in a call when determining that the last received identification of the call state is a sixth identification or a seventh identification.

10. The method of any of claims 1-9, wherein prior to controlling the external screen quench, the method further comprises:

and determining that the current screen is not extinguished and is not locked.

11. The method of claim 10, wherein a fold gaze detection module is provided in the electronic device,

the determining that the external screen is not extinguished includes:

the folding gaze detection module acquires a screen on-off state of a current screen from a power manager of the electronic device, wherein the current screen is a screen providing a display function for a user;

the folding fixation detection module determines that the external screen is not extinguished according to the bright-screen-off state fed back by the telephone manager as the bright-screen state;

the determining that the external screen is not locked includes:

the folding gaze detection module acquires a screen locking state of a current screen from a screen locking manager of the electronic equipment, wherein the current screen is a screen providing a display function for a user;

and the folding gaze detection module determines that the external screen is unlocked according to the screen locking state fed back by the telephone manager, which is the current screen.

12. The method of any of claims 1-11, wherein prior to said controlling the external screen to extinguish, the method further comprises:

and determining that the folding screen electronic device is folded.

13. The method of claim 12, wherein the determining that the folding screen electronic device is folded comprises:

the folding gaze detection module sends a fourth registration request to a device state manager of the electronic device, wherein the fourth registration request is used for obtaining the folding state of the folding screen, and the folding state of the folding screen comprises folding, semi-folding and unfolding;

in response to the fourth registration request, when the state of the folding screen of the call manager is changed to fold, sending an eighth identifier to the folding gaze detection module, wherein the eighth identifier is used for indicating that the folding screen is folded,

and the folding gaze detection module determines that the folding screen electronic equipment is folded according to the received eighth identifier.

14. An electronic device comprising one or more processors and one or more memories; the one or more memories coupled to the one or more processors, the one or more memories storing computer instructions;

The computer instructions, when executed by the one or more processors, cause the electronic device to perform the electronic device off-screen display method of any one of claims 1-13.

15. A computer readable storage medium comprising computer instructions which, when executed, perform the electronic device off-screen display method of any one of claims 1-13.

16. A computer program product, characterized in that the computer program comprises instructions which, when run by a computer, perform the electronic device off-screen display method of any one of claims 1-13.

17. A chip system, wherein the chip system comprises a processor and a communication interface; the processor is configured to invoke and execute a computer program stored in a storage medium from the storage medium, and perform the electronic device off-screen display method according to any of claims 1-13.