WO2022222955A1 - 解锁方法及电子设备 - Google Patents

解锁方法及电子设备 Download PDF

Info

Publication number
WO2022222955A1
WO2022222955A1 PCT/CN2022/087901 CN2022087901W WO2022222955A1 WO 2022222955 A1 WO2022222955 A1 WO 2022222955A1 CN 2022087901 W CN2022087901 W CN 2022087901W WO 2022222955 A1 WO2022222955 A1 WO 2022222955A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
user
unlocking
electronic device
mobile phone
Prior art date
Application number
PCT/CN2022/087901
Other languages
English (en)
French (fr)
Inventor
郝华奇
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP22791061.9A priority Critical patent/EP4318281A1/en
Priority to BR112023021830A priority patent/BR112023021830A2/pt
Priority to JP2023564597A priority patent/JP2024521007A/ja
Publication of WO2022222955A1 publication Critical patent/WO2022222955A1/zh
Priority to US18/491,093 priority patent/US20240086580A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/70—Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
    • G06F21/82—Protecting input, output or interconnection devices
    • G06F21/84—Protecting input, output or interconnection devices output devices, e.g. displays or monitors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72463—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions to restrict the functionality of the device
    • H04M1/724631—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions to restrict the functionality of the device by limiting the access to the user interface, e.g. locking a touch-screen or a keypad
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/36—User authentication by graphic or iconic representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2221/00—Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/21—Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/2111—Location-sensitive, e.g. geographical location, GPS
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2221/00—Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/21—Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F2221/2149—Restricted operating environment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/0206—Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings
    • H04M1/0208—Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings characterized by the relative motions of the body parts
    • H04M1/0214—Foldable telephones, i.e. with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/52—Details of telephonic subscriber devices including functional features of a camera

Definitions

  • the present application relates to the field of electronic technology, and in particular, to an unlocking method and an electronic device.
  • Folding screen devices usually have larger screens, which can provide users with a better visual viewing experience.
  • folding screen devices In order to ensure the security of important data such as user privacy, folding screen devices generally have a lock screen function. When the screen of the folding screen device is locked, the user needs to enter legal authentication information (such as the correct fingerprint, digital password, face data) into the folding screen device to trigger the screen unlocking and restore the interaction between the folding screen device and the user. sex.
  • the folding screen mobile phone receives new messages (such as two notifications of WeChat) in the locked screen state. If the internal screen of the mobile phone reads and replies to the message, the user needs to first unfold the mobile phone from the folded state to the unfolded state, and enter the identity authentication information into the mobile phone in the unfolded state (such as inputting face data through the internal screen camera). It can be seen that compared with using a non-folding screen mobile phone, it usually takes a short time to unlock the mobile phone. When using a folding screen mobile phone, the identity authentication can only be opened after the mobile phone is unfolded, which makes the unlocking efficiency low and the interaction efficiency between the user and the terminal. lower.
  • new messages such as two notifications of WeChat
  • the unlocking method and electronic device provided by the present application can identify the user's identity without fully unfolding the mobile phone, so that the unlocking can be completed quickly when the user's identity is legal, and the interaction efficiency between the user and the terminal is improved.
  • the present application provides an unlocking method, which is applied to an electronic device or a device capable of realizing the functions of the electronic device (such as a chip of the electronic device).
  • a screen and a second screen wherein the first screen is an inner screen, the second screen is an outer screen, the first screen has an associated first collection component, and the second screen has an associated second collection component.
  • the method includes: acquiring an unlocking intent, and in response to the unlocking intent, the electronic device invokes a second collection component to collect the user's identity information, and identifies the user's identity according to the identity information collected by the second collection component. Wherein, if the user's identity is legal and the electronic device meets the conditions for using the first screen, the first screen is unlocked.
  • the user's identity information can be collected by means of a sensor associated with the external screen, and the user's identity can be identified according to the identity information.
  • the identity recognition is turned on after the mobile phone is unfolded, and the unlocking efficiency is low, the technical solution of the present application does not require the user to fully unfold the mobile phone to identify the user's identity, so that the user's identity can be quickly completed when the user's identity is legal. Unlock to improve the interaction efficiency between the user and the terminal.
  • the terminal detects that the terminal meets the conditions for using the first screen, it indicates that the user wishes to unlock the first screen when unlocking the screen of the terminal. Then, after determining that the user's identity is legitimate, the terminal can intelligently and conveniently automatically unlock the first screen for the user, thereby further improving the interaction efficiency between the terminal and the user.
  • the unlocking intent may be an unlocking instruction input by the user, for example, the user inputs the unlocking instruction to the electronic device by pressing the power button or double-clicking the screen.
  • the unlocking intent can also be the unlocking intent perceived and determined by the electronic device itself. For example, when it is detected that the user lifts the mobile phone, the electronic device can preliminarily determine that the user has an intention to unlock the phone.
  • the method further includes: unlocking the second screen, and displaying the first interface on the second screen.
  • the method further includes: displaying a second interface associated with the first interface on the first screen.
  • the electronic device can first unlock the external screen and display the first interface on the external screen. It is also possible to connect the first interface displayed on the external screen to the internal screen. Wherein, the second interface connected to the display on the inner screen is associated with the first interface.
  • the second interface displayed on the inner screen may be the same interface as the first interface displayed on the outer screen.
  • the first interface and the second interface are the same, which means that the included contents are the same, and the size of the first interface and the second interface, the layout of elements in the interface, the size of the elements, etc. may be different.
  • the second interface connected to the internal screen display is associated with the content of the first interface.
  • the second interface is a detailed display interface of the first interface.
  • the second interface entered by the internal screen is the Home interface. If the user clicks the music control on the external screen after the external screen is unlocked, after the phone is unfolded, the second interface entered by the internal screen is a music interface, such as a music playlist interface.
  • the contents displayed on the first interface and the second interface may also be the same.
  • the method before unlocking the first screen, the method further includes: if the user's identity cannot be identified according to the identity information collected by the second collection component, calling the first collection component to collect the user's identity information, and according to the first collection component The identity information collected by the collection component is used to identify the identity of the user. In this way, the probability of successful unlocking can be increased.
  • identifying the user's identity according to the identity information collected by the first collection component includes: identifying the user's identity according to the identity information collected by the second collection component and the identity information collected by the first collection component.
  • the image sensor of the internal screen camera can collect more With fewer face images, face recognition can be completed, which shortens the time from calling the image sensor of the in-screen camera to the successful face recognition, and speeds up the speed of face recognition.
  • the first collection component if the identity information of the user cannot be identified according to the identity information collected by the second collection component, calling the first collection component to collect the identity information of the user, including: if it is detected that the unfolding angle of the electronic device reaches a preset angle, And if the identity of the user cannot be identified according to the identity information collected by the second collection component, the first collection component is invoked to collect the identity information of the user.
  • the method before unlocking the first screen, the method also includes:
  • a third interface is displayed or a prompt voice is played, the third interface is used to prompt the user to unfold the electronic device, and the prompt voice is used to prompt the user to unfold the electronic device.
  • methods also include:
  • a setting instruction input by the user is received, where the setting instruction is used to set any one or more of a preset application, a preset time period, a preset geographic location range, and a preset unlocking instruction.
  • obtaining the unlocking intent includes: receiving the unlocking instruction input by the user;
  • the second collection component is invoked to collect the user's identity information, including:
  • the second collection component is invoked to collect the user's identity information.
  • the first collecting part and the second collecting part are the same or different.
  • the conditions for using the first screen include a combination of one or more of the following conditions: the current time is within a preset time period, the current location is within a preset geographic location range, a new message is received and the new message is The message of the preset application, the electronic device being in the unfolded state, and the unlocking instruction input by the user are the preset unlocking instructions.
  • the preset unlocking instruction includes any one or a combination of the following: a preset gesture, pattern, number, fingerprint, and voice for unlocking the first screen.
  • the first collection component includes any one or more of the following components: a fingerprint collection component, a voiceprint collection component, and an image collection component;
  • the second collection component includes any one or more of the following components: fingerprint collection components, voiceprint acquisition components, image acquisition components.
  • an electronic device in a second aspect, includes a processor, and a first screen and a second screen formed when the screen is folded, wherein the first screen is an inner screen, the second screen is an outer screen, and the first screen is an inner screen. has an associated first collection component, and the second screen has an associated second collection component;
  • the processor is used to obtain the unlocking intention; in response to the unlocking intention, call the second collection component to collect the user's identity information, and identify the user's identity according to the identity information collected by the second collection component; if the user's identity is legal, and the electronic device satisfies Using the conditions of the first screen, the first screen is unlocked.
  • the processor is also used to unlock the second screen
  • the second screen is used to display the first interface.
  • the first screen is used to display a second interface associated with the first interface after unlocking the first screen.
  • the processor is further configured to call the first collection part to collect the user's identity information if the identity information of the user cannot be identified according to the identity information collected by the second collection part, and to collect the user's identity information according to the identity information collected by the first collection part.
  • Identity information identifying the identity of the user.
  • the processor is configured to identify the identity of the user according to the identity information collected by the first collection unit, including: identifying the user according to the identity information collected by the second collection unit and the identity information collected by the first collection unit user's identity.
  • the processor is configured to call the first collection component to collect the user's identity information if the identity information of the user cannot be identified according to the identity information collected by the second collection component, including: if the expansion of the electronic device is detected When the angle reaches the preset angle, and the user's identity cannot be identified according to the identity information collected by the second collection component, the first collection component is called to collect the user's identity information.
  • the second screen is further used to display a third interface or play a prompt voice
  • the third interface is used to prompt the user to unfold the electronic device
  • the prompt voice is used to prompt the user to unfold the electronic device.
  • the processor is further configured to receive a setting instruction input by the user, where the setting instruction is used to set any one or more of a preset application, a preset time period, a preset geographic location range, and a preset unlocking instruction indivual.
  • the processor for acquiring the unlocking intent, includes: receiving an unlocking instruction input by the user;
  • the processor is configured to call the second collection component to collect the user's identity information in response to the unlocking intention, including: in response to the unlocking instruction, calling the second collection component to collect the user's identity information.
  • the first collection member is the same as or different from the second collection member.
  • the conditions for using the first screen include a combination of one or more of the following conditions: the current time is within a preset time period, the current location is within a preset geographic location range, a new message is received and the new message It is the message of the preset application, the electronic device is in the unfolded state, and the unlocking instruction input by the user is the preset unlocking instruction.
  • the preset unlocking instruction includes any one or a combination of the following: a preset gesture, pattern, number, fingerprint, and voice for unlocking the first screen.
  • the first collection component includes any one or more of the following components: a fingerprint collection component, a voiceprint collection component, and an image collection component;
  • the second collection component includes any one or more of the following components: a fingerprint Acquisition components, voiceprint acquisition components, and image acquisition components.
  • the present application provides an electronic device having the function of implementing the unlocking method in the first aspect and any of the possible implementation manners.
  • This function can be implemented by hardware or by executing corresponding software by hardware.
  • the hardware or software includes one or more modules corresponding to the above functions.
  • the present application provides a computer-readable storage medium, including computer instructions, which, when the computer instructions are executed on an electronic device, cause the electronic device to perform any one of the first aspect and any of the possible implementations. method of unlocking.
  • the present application provides a computer program product that, when the computer program product runs on an electronic device, enables the electronic device to execute the unlocking method according to any one of the first aspect and any of the possible implementations.
  • a circuit system in a sixth aspect, includes a processing circuit, and the processing circuit is configured to execute the unlocking method in the above-mentioned first aspect and any one of the possible implementation manners.
  • an embodiment of the present application provides a chip system, including at least one processor and at least one interface circuit, where the at least one interface circuit is configured to perform a transceiving function and send instructions to the at least one processor.
  • the at least one processor executes the unlocking method described in the first aspect and any one of the possible implementations.
  • Fig. 1 is a flow chart of unlocking a folding screen mobile phone in the prior art
  • FIG. 2 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • 3-1 to 3-4 are schematic diagrams of the shapes of the electronic device with a folding screen provided by an embodiment of the present application.
  • FIG. 4 is a schematic diagram of an included angle of a folding screen provided by an embodiment of the present application.
  • FIG. 5 is a schematic block diagram of a software structure of an electronic device provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of a group of interfaces provided by an embodiment of the present application.
  • FIG. 12 are schematic interface diagrams provided by the embodiments of the present application.
  • FIG. 13 is a schematic diagram of an apparatus provided by an embodiment of the present application.
  • FIG. 14 is a schematic diagram of a chip system provided by an embodiment of the present application.
  • the unlocking method provided by the embodiment of the present application can be applied to an electronic device.
  • the electronic device may specifically be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR)/virtual reality (VR) device, a notebook computer, an ultra-mobile personal computer (ultra-mobile) personal computer, UMPC), netbook, personal digital assistant (personal digital assistant, PDA), artificial intelligence (artificial intelligence) device, or special camera (for example, a single-lens reflex camera, a card camera), etc.
  • AR augmented reality
  • VR virtual reality
  • PDA personal digital assistant
  • artificial intelligence artificial intelligence
  • special camera for example, a single-lens reflex camera, a card camera
  • FIG. 2 shows a schematic structural diagram of the electronic device 100 .
  • the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (subscriber identification module, SIM) card interface 195 and so on.
  • SIM Subscriber identification module
  • the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processor
  • graphics processor graphics processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the controller may be the nerve center and command center of the electronic device 100 .
  • the controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
  • the processor 110 is configured to collect the user's identity information with the help of a sensor associated with the external screen when acquiring the user's unlocking intention (receive the unlocking instruction input by the user), and identify the user according to the identity information. user ID.
  • the processor 110 can automatically unlock the first screen for the user intelligently and conveniently. Interaction efficiency between users.
  • the charging management module 140 is used to receive charging input from the charger.
  • the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
  • the power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the display screen 194, the camera 193, and the like.
  • the wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.
  • the mobile communication module 150 may provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the electronic device 100 .
  • the wireless communication module 160 can provide wireless communication including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (bluetooth, BT), etc. applied on the electronic device 100 . solution.
  • WLAN wireless local area networks
  • Wi-Fi wireless fidelity
  • Bluetooth bluetooth, BT
  • the electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
  • Display screen 194 is used to display images, videos, and the like.
  • Display screen 194 includes a display panel.
  • the electronic device 100 may include one or N display screens 194 , where N is a positive integer greater than one.
  • the display screen 194 can display a shooting preview interface, a video preview interface and a shooting interface in the video recording mode, and can also display a video playing interface and the like during video playback.
  • the electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
  • the ISP is used to process the data fed back by the camera 193 .
  • the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin tone.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 193 .
  • the ISP can control the photosensitive element to expose and take pictures according to the shooting parameters.
  • the camera 193 is used to capture still images or video.
  • the object is projected through the lens to generate an optical image onto the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
  • the camera 193 may be located at the edge area of the electronic device, and may be an under-screen camera, a camera that can be raised and lowered, or a hole-digging camera.
  • the camera 193 may include a rear camera, and may also include a front camera. The embodiment of the present application does not limit the specific position and shape of the camera 193 .
  • the layout of the camera on the electronic device 100 can be referred to FIG. 3-1 , where the front surface of the electronic device 100 is the plane where the display screen 194 is located.
  • the camera 1931 is located on the front of the electronic device 100, and the camera is a front-facing camera.
  • the camera 1932 is located on the back of the electronic device 100, and the camera is a rear camera.
  • the solutions of the embodiments of the present application may be applied to the electronic device 100 having a folding screen with multiple display screens (that is, the display screen can be folded).
  • the folding screen may be a flexible folding screen.
  • the flexible folding screen includes a folding shaft made of flexible material. Part or all of the flexible folding screen is made of flexible materials.
  • the foldable part (such as the folding shaft) of the flexible folding screen is made of flexible material, and the other parts are made of rigid material; or, the flexible folding screen is all made of flexible material.
  • the folding screen can be folded along the folding axis to form at least two sub-screens.
  • FIG. 3-1 (c) shows a folding screen electronic device 100 .
  • the foldable screen is folded inward (or folded outward) along the folded edge, so that the foldable screen forms at least two sub-screens (for example, A sub-screen and B sub-screen). subscreen).
  • there is a display screen (such as a C screen) on the outer side of the fold. If the electronic device 100 is provided with a camera on the surface where the C-screen is located. Then, in the unfolded scene of the electronic device 100 as shown in FIG.
  • the camera on the C-screen is on the back of the electronic device 100 and can be regarded as a rear camera.
  • the camera on the C-screen becomes on the front of the electronic device 100 and can be regarded as a front-facing camera. That is to say, the front camera and the rear camera in this application do not limit the nature of the cameras themselves, but are only an illustration of a positional relationship.
  • the folding screen of the folding screen electronic device may form multiple (eg, 2, 3, etc.) sub-screens.
  • the flexible folding screen may include a folding line 030 and a folding line 031 . After longitudinal folding along the folding line 030, the sub-screen 032, the sub-screen 033 and the sub-screen 034 as shown in (2) in FIG. 3-2 can be formed.
  • the screen arrangement of the folding screen electronic device may be the upper and lower screen arrangement such as shown in (d) in Figure 3-1, or it may also be such as shown in (1) or (2) in Figure 3-3. the left and right screen arrangement, etc.
  • the embodiments of the present application do not limit the screen arrangement of the folding screen electronic device.
  • the flexible folding screen shown in (1) in Fig. 3-3 after being folded laterally along the folding line 040, can form the sub-screen 041 and the sub-screen 042 shown in (2) in Fig. 3-3.
  • the folding screen device may be a mobile phone in a folded state, and may be a tablet computer in an unfolded state.
  • the included angle between two adjacent sub-screens in the folding screen is greater than or equal to 0° and less than or equal to 180°.
  • the angle between two adjacent sub-screens in the folding screen may also be referred to as the unfolded angle of the folding screen device, or the unfolding angle of the folding screen device, or the folding angle of the folding screen.
  • the folding screen may include a folded state and an unfolded state.
  • the unfolded state includes an expanded state and a half-expanded state.
  • the unfolded state means that the folding screen is fully unfolded, that is, the included angle between two adjacent sub-screens in the folding screen is 180°, or close to 180° due to some industrial design factors.
  • (1) in FIG. 3-3 represents a schematic diagram of the unfolded state of the folding screen.
  • the folded state means that the folding screen is completely folded, that is, the included angle between two adjacent sub-screens in the folding screen is 0° or close to 0° due to some industrial design factors.
  • (1) in FIG. 3-4 represents a schematic diagram of the folded state of the folding screen, and the included angle between the sub-screen 044 and the sub-screen 045 is 0°.
  • the state between the unfolded state and the folded state may be referred to as a half unfolded state or a non-folded state, that is, the included angle between two adjacent sub-screens in the folding screen is between 0° and 180°.
  • ( 2 ) in FIG. 3-3 and ( 2 ) in FIG. 3-4 are schematic diagrams showing the half-expanded state of the folding screen.
  • the included angle ⁇ between the sub-screen 041 and the sub-screen 042 is greater than 0° and less than 180°.
  • the included angle ⁇ may also be referred to as the unfolded angle of the folding screen device, or the folding angle.
  • other value ranges of the included angle ⁇ can also be defined as the semi-expanded state according to the industrial design level or user experience. When it is equal to or equal to 10°, it is in the folded state.
  • the angle between at least two sub-screens formed by the folding screen may change. Taking (2) in Figure 3-3 as an example, in the process of folding the folding screen, the angle between the sub-screen 41 and the sub-screen 42 becomes smaller; in the process of unfolding the folding screen, the angle between the sub-screen 41 and the sub-screen 42 becomes smaller. The included angle becomes larger.
  • the at least two sub-screens formed after the folding screen is folded may be multiple sub-screens that exist independently; it may also be a complete screen with an integrated structure, which is folded to form at least two parts.
  • the folding screen may also be a multi-screen folding screen.
  • the multi-screen folding screen may include at least two sub-screens.
  • the at least two sub-screens are independent display screens, which can be connected by a folding shaft in sequence, and can be rotated around the folding shafts respectively, so as to realize the folding of the multi-screen folding screen.
  • the folding screen device includes a folding shaft 043 , a sub-screen 044 , and another sub-screen 045 independent of the sub-screen 044 .
  • the sub-screen 044 and the sub-screen 045 can rotate around the folding axis 043 .
  • the angle ⁇ between the sub-screen 044 and the sub-screen 045 may be referred to as the unfolded angle or the folding angle of the folding screen device.
  • the folding screen may be a single-sided screen (that is, only one side can display the user interface) or a double-sided screen (that is, both opposite sides can display the user interface).
  • a single-sided folding screen For a single-sided folding screen, the case where the folding screen is folded toward the side that can display the user interface (that is, the front of the single-sided folding screen) can be called forward folding; the folding screen is turned toward the side that can display the user interface.
  • the case where the opposite side (that is, the back side of the single-sided folding screen) is folded can be referred to as reverse folding.
  • (2) in Fig. 3-3 represents a schematic diagram of forward folding
  • (2) in Fig. 3-4 represents a schematic diagram of reverse folding.
  • the folding screen device can determine whether it is currently folded forward or reversely.
  • Forward folding or reverse folding can make the folding screen achieve a semi-expanded state.
  • the included angle between the surfaces with the display function on the two adjacent sub-screens is greater than 0° and less than 180°.
  • the included angle between the surfaces of two adjacent sub-screens that do not have a display function is greater than 0° and less than 180°.
  • a digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy and so on.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 100 may support one or more video codecs.
  • the electronic device 100 can play or record videos of various encoding formats, such as: Moving Picture Experts Group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
  • MPEG Moving Picture Experts Group
  • MPEG2 moving picture experts group
  • MPEG3 MPEG4
  • MPEG4 Moving Picture Experts Group
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the electronic device 100 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
  • the NPU uses an image recognition technology to identify whether the image captured by the camera 193 includes a face image. Further, the NPU can also determine whether the user's identity is legal according to the face image, so as to confirm whether to unlock the screen.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example to save files like music, video etc in external memory card.
  • Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.
  • the electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.
  • the audio module 170 is used for converting digital audio data into analog audio electrical signal output, and also for converting analog audio electrical signal input into digital audio data, and the audio module 170 may include an analog/digital converter and a digital/analog converter.
  • the audio module 170 is used to convert the analog audio electrical signal output by the microphone 170C into digital audio data. Audio module 170 may also be used to encode and decode audio data.
  • the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .
  • Speaker 170A also referred to as “speaker” is used to convert analog audio electrical signals into sound signals.
  • the electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.
  • the receiver 170B also referred to as the "earpiece" is used to convert the analog audio electrical signal into a sound signal.
  • the electronic device 100 answers a call or a voice message, the voice can be answered by placing the receiver 170B close to the human ear.
  • the microphone 170C also called “microphone” or “microphone”, is used to convert sound signals into analog audio electrical signals.
  • the user can make a sound by approaching the microphone 170C through a human mouth, and input the sound signal into the microphone 170C.
  • the microphone 170C may be a built-in component of the electronic device 100 or an external accessory of the electronic device 100 .
  • the electronic device 100 may include one or more microphones 170C, wherein each microphone or multiple microphones cooperate to collect sound signals in various directions, and convert the collected sound signals into analog audio electrical signals. It can also achieve noise reduction, identify sound sources, or directional recording functions.
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
  • the gyro sensor 180B can be used to determine the movement posture of the electronic device 100 .
  • the angular velocity of electronic device 100 about three axes may be determined by gyro sensor 180B.
  • the gyro sensor 180B can be used for image stabilization.
  • the gyro sensor 180B detects the shaking angle of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse motion to achieve anti-shake.
  • the gyro sensor 180B can also be used for navigation and somatosensory game scenarios.
  • each sub-screen may be provided with a gyro sensor 180B, which is used to measure the orientation (ie, the direction vector of the orientation) of the sub-screen where it is located.
  • a gyro sensor 180B is used to measure the orientation (ie, the direction vector of the orientation) of the sub-screen where it is located.
  • both the sub-screen 041 and the sub-screen 042 include a gyroscope sensor 180B for measuring the orientation of the sub-screen 041 and the sub-screen 042 respectively.
  • the electronic device can determine the included angle between adjacent sub-screens according to the angle change of the orientation of each sub-screen.
  • the electronic device 100 as the folding screen device shown in FIG. 3-1 as an example.
  • the folding screen of the electronic device 100 can be folded to form the sub-screen 061 and the sub-screen 062 shown in (1) in FIG. 4 .
  • the sub-screen 061 is provided with a gyroscope sensor 1
  • the sub-screen 062 is provided with a gyroscope sensor 2 .
  • the coordinate system of the gyro sensor may be, for example, but not limited to, a geographic coordinate system.
  • the origin O of the geographic coordinate system is located at the point where the carrier (ie, the device containing the gyro sensor, such as the electronic device 100) is located, the x-axis points to the east (E) along the local latitude, and the y-axis It points north (N) along the local meridian, and the z-axis points up along the local geographic vertical and forms a right-handed Cartesian coordinate system with the x- and y-axes.
  • the plane formed by the x-axis and the y-axis is the local horizontal plane
  • the plane formed by the y-axis and the z-axis is the local meridian plane. Therefore, it can be understood that the coordinate system of the gyro sensor is: taking the gyro sensor as the origin O, pointing east along the local latitude as the x-axis, pointing north along the local meridian as the y-axis, and pointing up along the local geographic vertical ( That is, the opposite direction of the geographic vertical) is the z-axis.
  • the electronic device 100 can obtain the direction vector of the orientation of each sub-screen in the coordinate system of the gyroscope sensor provided in each sub-screen by using the gyro sensor provided in each sub-screen.
  • the direction vector of the orientation of the sub-screen 061 in the coordinate system of the gyro sensor 1 measured by the electronic device is the vector z1
  • the sub-screen 062 is located in the gyro
  • the direction vector of the orientation in the coordinate system of the sensor sensor 2 is the vector z2.
  • the electronic device can obtain the included angle ⁇ between the vector z1 and the vector z2 according to the vectors z1 and z2.
  • the electronic device When the included angle ⁇ is greater than 0° and less than 180°, the electronic device is currently in a half-expanded state corresponding to the forward folding. When the included angle ⁇ is greater than 180° and less than 360°, the electronic device is currently in a semi-expanded state corresponding to reverse folding.
  • the positions of the gyroscope sensors provided in the sub-screen 061 and the sub-screen 062 do not overlap, that is, the origins of the coordinate systems of the gyroscope sensors of the sub-screen 061 and the sub-screen 062 do not overlap, however, the two coordinate systems do not overlap.
  • the x-axis, y-axis, and z-axis are parallel, so it can be considered that the coordinate systems of the gyroscope sensors provided in the sub-screen 061 and the sub-screen 062 are parallel.
  • the vector z1 and the vector z2 are not in the same coordinate system, since the axes of the two coordinate systems are parallel, the angle ⁇ between the vector z1 and the vector z2 can still be calculated by the above formula (1).
  • the included angle ⁇ between the sub-screen 061 and the sub-screen 062 may also be measured by the cooperation of one or more other sensors.
  • an acceleration sensor can be set in each sub-screen of the folding screen.
  • the electronic device 100 (such as the processor 110 ) can use the acceleration sensor to measure the motion acceleration when each sub-screen is rotated; and then calculate the rotation angle of one screen relative to the other screen according to the measured motion acceleration, that is, the sub-screen 061 and the sub-screen are rotated.
  • the above-mentioned gyro sensor may be a virtual gyro sensor formed by cooperating with a plurality of other sensors.
  • the virtual gyro sensor can be used to calculate the included angle between adjacent sub-screens of the folding screen, that is, the included angle ⁇ between the sub-screen 061 and the sub-screen 062 .
  • sensors such as the gyroscope sensor 180B and the acceleration sensor 180E can also be used to determine the state of each sub-screen, so as to determine whether the folding screen is currently in a forward folding state or a reverse folding state.
  • the gyroscope sensor 180B on the sub-screen can measure the angular velocity when the sub-screen is folded, and the angle of the sub-screen relative to a specific coordinate system (such as a geographic coordinate system) can be obtained by integrating the angular velocity, so that the sub-screen can be obtained.
  • the orientation of the sub-screen can be known according to the posture of the sub-screen. According to the orientation of each sub-screen, it can be known that the folding screen is currently in a forward folded state or a reverse folded state.
  • the electronic device 100 can measure the distance through infrared or laser. In some embodiments, in a shooting scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.
  • Touch sensor 180K also called “touch panel”.
  • the touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”.
  • the touch sensor 180K is used to detect a touch operation on or near it.
  • the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100 .
  • the electronic device 100 may include more or less components than shown, or combine some components, or separate some components, or arrange different components.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
  • the embodiment of the present invention takes an Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100 as an example.
  • FIG. 5 is a block diagram of a software structure of an electronic device 100 according to an embodiment of the present invention.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces.
  • the operating system such as the Android system
  • the operating system of the electronic device is divided into four layers, which are a kernel layer, a hardware abstract layer (HAL), an application framework layer, and an application layer from bottom to top. .
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least camera drivers, audio drivers, display drivers, and sensor drivers.
  • Sensor drivers include but are not limited to image sensor drivers and acoustic sensors.
  • a kernel layer such as a camera driver is called to turn on the camera.
  • the image sensor is called by the image sensor driver to complete the image acquisition.
  • the hardware abstraction layer is located between the kernel layer and the application framework layer, and is used to define the interface that drives the hardware implementation of the application program, and converts the value of the driver hardware implementation into the software implementation programming language. For example, identify the value driven by the camera, convert it into a software programming language and upload it to the application framework layer, and then implement the corresponding function call.
  • the HAL can upload the face image collected by the camera 193 to the application framework layer for further processing.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer obtains the original input event from the kernel layer via the HAL, and identifies the control corresponding to the input event.
  • the application framework layer includes some predefined functions.
  • the application framework layer may include a view system, a telephony manager, a resource manager, a notification manager, a window manager, and the like.
  • the application framework layer includes the first module.
  • the first module is used for invoking the corresponding display driver to display the screen according to the unlocking intention of the user. For example, when it is determined that the user wants to unlock the external screen, the first module calls the display driver of the external screen, so as to display the unlocked interface on the external screen.
  • the first module may also be disposed in another layer, and the first module may also be divided into more sub-modules. Each submodule is used to perform the corresponding function.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. View systems can be used to build applications.
  • a display interface can consist of one or more views.
  • the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.
  • the phone manager is used to provide the communication function of the electronic device 100 .
  • the management of call status including connecting, hanging up, etc.).
  • the resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on.
  • the notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a brief pause without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also display notifications in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and notifications on the screen in the form of dialog windows. For example, text information is prompted in the status bar, a prompt sound is issued, the electronic device vibrates, and the indicator light flashes.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc.
  • the application layer can include a series of application packages.
  • the application package can include applications such as camera, video, call, WLAN, music, short message, Bluetooth, map, calendar, gallery, navigation, etc.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application layer and the application framework layer as binary files.
  • the virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.
  • the unlocking method provided by the embodiment of the present application can be applied to scenarios such as but not limited to receiving messages, playing music, paying, taking pictures, etc.
  • the unlocking methods provided by the application embodiments are described.
  • the roles of the inner screen and the outer screen may change.
  • the inner screen can be the 041 sub-screen and the 042 sub-screen
  • the outer screen can be the screen set on the back of the folding screen.
  • the outer screen can be the sub-screen 044 and the sub-screen 045
  • the inner screen can be the screen set on the back of the folding screen. That is to say, usage scenarios, etc., do not limit the internal and external screens.
  • the mobile phone when acquiring the user's unlocking intention, can collect the user's identity information by means of an associated sensor on the external screen, and identify the user's identity according to the identity information.
  • the terminal determines that the user's identity is legitimate, and detects that the terminal meets the conditions for using the first screen, it means that the user wishes to unlock the first screen when unlocking the screen of the terminal. Then, the terminal can automatically unlock the first screen for the user intelligently and conveniently. It can be seen that the technical solutions of the embodiments of the present application can identify the user's identity without fully unfolding the mobile phone, which can speed up the unlocking progress and improve the interaction efficiency between the terminal and the user. Moreover, when the user wishes to unlock the first screen, the first screen can be unlocked intelligently, which can further improve the interaction efficiency between the terminal and the user.
  • the mobile phone is in a folded state (and the screen is locked).
  • the user can trigger the mobile phone to call the image sensor in the external screen camera to collect the user's face image by, for example, double-tapping the screen, perform face recognition on the user according to the face image, and then identify the user's identity, and determine whether to unlock the screen according to the user's identity.
  • the user when the user has an unlocking intention, the user does not need to double-tap the screen, but triggers the mobile phone to call the image sensor of the external screen camera to collect the user's face image through an operation such as lifting the mobile phone.
  • the embodiments of the present application do not limit the conditions for triggering the mobile phone to call the image sensor of the external screen camera to collect the user's face image.
  • the mobile phone may display a text such as "face recognition in progress" as shown in (2) in FIG. 6 to prompt the user to perform face recognition.
  • the mobile phone when it is determined that the face image collected by the external screen camera is a correct face image and the mobile phone is in a folded state, indicating that the user is likely to want to unlock the external screen, the mobile phone unlocks the external screen. In this way, the user can interact with the mobile phone through the external screen.
  • an interface such as shown in (3) in FIG. 6 is displayed, and the interface may be the interface displayed by the mobile phone before the screen is locked, or may be a home interface or other interface.
  • This embodiment of the present application does not limit the interface presented after the screen is unlocked. It can be seen that with the unlocking method of the embodiment of the present application, the mobile phone can be unlocked without unfolding. After that, the user can unfold the phone for use, or use the phone in a folded state as needed.
  • the phone unlocks the inner screen.
  • an interface such as that shown in (4) in FIG. 6 (for example, the interface displayed before the screen is locked) is displayed. It can be seen that, compared with the prior art, the mobile phone needs to be unfolded to a larger angle before the in-screen camera is called for face recognition, the face unlocking takes a long time, and the unlocking efficiency is low. , when the mobile phone is unfolded to a small angle, the inner screen can be unlocked, which shortens the unlocking time and enables the user to use the inner screen faster.
  • the user can also fully unfold the mobile phone, and use the mobile phone in the unfolded state as shown in (5) in FIG. 6 .
  • the mobile phone can enable the multitasking function.
  • the user can open multiple applications in the interface at the same time, or display different interfaces of the same application. Users can switch between multiple applications, or switch between different functions.
  • the internal screen of the mobile phone can also display information such as a contact list, so that users can view contacts and new messages on the same screen at the same time.
  • the interface can also display a list of emails within a period of time in a split-screen mode to facilitate users to browse overviews of different emails.
  • split-screen situations of different applications or application combinations may be different.
  • the specific split screen situation can be set by the system or the user.
  • the unlocking method of the embodiment of the present application is described by taking the mobile phone being unfolded by the user after (2) in 6 as an example.
  • the timing when the mobile phone is unfolded by the user may also be other timings, for example, between the timings shown in (1) and (2) in 6, the mobile phone is unfolded by the user.
  • FIG. 7 shows a flowchart of an unlocking method provided by an embodiment of the present application when an unlocking instruction input by a user is detected.
  • the method is applied to an electronic device.
  • the electronic device includes a screen 1 and a screen 2 formed when the screen is folded.
  • Screen 1 (such as the screen 1 shown in (4) in the second FIG. 6 ) is an inner screen and a screen 2 (such as The screen 2) shown in (3) in Figure 6 is an external screen as an example, as shown in Figure 7, the method includes:
  • the mobile phone obtains an unlocking intent.
  • the unlocking intent may be an unlocking instruction input by a user, and the user inputs an unlocking instruction to the mobile phone through an unlocking operation, which is used to indicate that the user has an intention to unlock the screen of the mobile phone.
  • the user can input the unlocking instruction by double-clicking the screen interface shown in (2) in FIG. 6 .
  • the user may input an unlocking instruction by means of voice or the like.
  • the unlocking intent may also be an unlocking intent perceived and determined by the mobile phone itself. For example, when the user lifts the mobile phone, the mobile phone can preliminarily determine that the user has the intention of unlocking.
  • the mobile phone invokes a second collection component associated with the external screen to collect the identity information input by the user.
  • the mobile phone may be unlocked using one or more unlocking methods.
  • Unlocking methods include but are not limited to one or more of the following: face unlocking, fingerprint unlocking, pattern unlocking, password unlocking, and voiceprint unlocking.
  • the face unlocking method includes but is not limited to three-color (red, green, blue, RGB) face unlocking, infrared face unlocking, and 3D structured light face unlocking.
  • each unlocking mode may correspond to one or more collection components that can be used to collect user identity information.
  • the collection component for unlocking may include a collection component for collecting user identity information.
  • the user identity information is used to represent the user identity.
  • the phone unlocks the screen.
  • the identity information includes but is not limited to the user's face image, fingerprint information, voiceprint information, input pattern information, and input password information.
  • the capture component used for unlocking may be an image capture component, such as a camera.
  • Image acquisition components include, but are not limited to, image sensors.
  • the image sensor may be, but not limited to, a complementary metal-oxide-semiconductor (CMOS) sensor.
  • CMOS complementary metal-oxide-semiconductor
  • the collection component that can be used for unlocking may be a fingerprint collection component, including, for example, a fingerprint sensor for collecting fingerprint information.
  • the fingerprint sensor may employ any type of sensing technology, including but not limited to optical, capacitive, piezoelectric, or ultrasonic sensing technology.
  • the collection component that can be used for unlocking may be a voiceprint collection component, such as a sound-sensitive sensor.
  • the collection component used for unlocking may also be a touch panel or the like.
  • the mobile phone calls the second collection component (such as an image sensor) associated with the external screen to collect the identity information input by the user or the information used for identity verification.
  • the second collection component associated with the external screen may be, but not limited to, an image sensor associated with the external screen, a fingerprint sensor associated with the external screen, and the like.
  • the mobile phone calls the camera associated with the external screen to collect the user's face image.
  • the embodiment of the present application mainly takes the user identity recognition by collecting the face image through the camera associated with the external screen as an example for description, but the user identity recognition method in the embodiment of the present application is not limited to this, and is unified here. illustrate.
  • the mobile phone identifies the identity of the user according to the identity information collected by the second collection component associated with the external screen.
  • the image sensor of the external screen transmits the collected face image to the mobile phone processor, and the mobile phone uses the image sensor to transfer the collected face image to the mobile phone processor.
  • the face image is compared with the pre-stored target face image to identify whether the user's identity is legitimate.
  • the conditions for using the first screen include a combination of one or more of the following conditions: the current time is within a preset time period, the current location is within a preset geographic location, a new message is received and the new message is a message of a preset application , the electronic device is in a non-folded state, and the unlocking instruction is a preset unlocking instruction; the preset unlocking instruction includes any one or a combination of the following: preset gestures, patterns, numbers, and fingerprints for unlocking the first screen.
  • the mobile phone can detect whether the folding screen is in a folded state.
  • the mobile phone detects whether the mobile phone is in a folded state by detecting the angle between the first sub-screen and the second sub-screen of the folding screen.
  • the mobile phone detects the angle between the sub-screen A and the sub-screen B shown in (d) of FIG. 3-1, and accordingly determines whether the mobile phone is in a folded state.
  • both the first sub-screen and the second sub-screen are provided with gyroscopes for measuring the orientation (direction vector) of the sub-screens where they are located.
  • the mobile phone determines the angle between the first sub-screen and the second sub-screen according to the measurement result of the gyroscope.
  • the mobile phone may periodically detect the folded state of the mobile phone, or detect whether the mobile phone is in the folded state according to an event trigger. For example, when an unlocking instruction input by the user is detected, the mobile phone is triggered to detect whether the folding screen is in a folded state.
  • the embodiments of the present application do not limit the triggering conditions for triggering the detection of whether the folding screen is in the folded state.
  • the mobile phone can determine whether the user wants to unlock the inner screen or the outer screen according to whether the folding screen is in the folded state.
  • the mobile phone executes S104 to unlock the inner screen
  • the mobile phone executes S105 to unlock the outer screen.
  • the mobile phone detects that the folded state of the mobile phone has changed from folded to non-folded state, it means that the user is likely to want to unfold the mobile phone and interact with the mobile phone through the internal screen. Then, the mobile phone unlocks the internal screen to meet the user's use. need.
  • the extent to which the folded screen is unfolded in the non-folded state to identify and determine that the user's current intention is to unlock the inner screen can be actually set as required.
  • the mobile phone unlocks the external screen.
  • the detailed content of the message is not displayed before unlocking (for example, partial information of the message, such as the number of messages, etc.) is displayed, and the detailed content of the message is displayed after the unlocking.
  • the mobile phone when the mobile phone receives a new message in a locked screen state, the mobile phone can be triggered to display the message reminder interface 401 shown in (2) in FIG. 8-1 to prompt the user to receive a new message.
  • the message reminder interface 401 may not display information such as message content, sender, etc., but only display information such as the application to which the new message received and the number of new messages that do not involve private data, so as to reduce the risk of user privacy leakage. probability.
  • the message reminder interface 401 can display the sender, but not the specific content of the message, so that the user can choose whether to unlock the phone and view the message when the user knows the sender. content, which can reduce the probability of privacy leakage as much as possible.
  • the message reminder interface 401 can display most information of the message, including but not limited to the content of the message, the sender, and the like.
  • the application to which the received message belongs is an application of a preset type.
  • Preset type applications include, but are not limited to, applications with lower security requirements.
  • an application with lower security requirements may be an application that does not involve user privacy information, or involves less user privacy information.
  • An application with lower security requirements may be a system default application with low security requirements (for example, an application that does not read information such as a user's phone number and location), or an application set by the user.
  • the message reminder interfaces of different applications may include different information.
  • the private information therein is erased.
  • the mobile phone prompts the user to receive a new message, it can display most of the information corresponding to the message.
  • the caller information of some contacts can be set to be invisible. In this way, when this part of the contact calls or makes a call to this part of the contact, some information of the part of the contact is not displayed on the call interface, including but not limited to one or more of the following information: the contact's phone number number, the name of the contact.
  • some information may not be displayed to some contacts in the call record, including but not limited to one or more of the following information: the contact's phone number, call duration, the location of the contact's number, incoming or outgoing calls. Outgoing call status, call date. Or, hide the call log of this part of the contact in the call log.
  • the embodiment of the present application does not limit the specific display content of the message reminder interface 401 .
  • the screen can be illuminated by double-clicking the screen, and triggering the mobile phone to call the camera on the external screen to collect the user's face image, perform face recognition on the user, and then identify the user's face.
  • the user's identity and determine whether to unlock the screen according to the user's identity.
  • the user does not need to double-tap the screen, but triggers the mobile phone to brighten the screen through an operation such as lifting the mobile phone, and calls the external screen camera to collect the user's face image.
  • the embodiments of the present application do not limit the conditions for triggering the mobile phone to call the external screen camera to collect the user's face image.
  • the mobile phone when the mobile phone receives a new message in the locked screen state, it does not trigger the mobile phone to display the message reminder interface 401 shown in (2) in FIG. 8-1, but through other methods (such as non-interface methods ) alerts the user to a new message.
  • the indicator light of the mobile phone flashes, the mobile phone vibrates, rings, etc.
  • the mobile phone screen can still be in a black screen state.
  • the user can trigger the phone to turn on the screen by pressing the power button, lift the phone, or double-tap the screen, and call the external screen camera to collect the user's face image, and then authenticate the user.
  • the mobile phone may display an interface such as that shown in (3) in Figure 8-1, so as to prompt the user that the mobile phone is performing identity identification.
  • the mobile phone can prompt the user to receive a new message in various ways, for example, the indicator light flashes and vibrates, and the message reminder interface shown in (2) in Figure 8-1 is displayed.
  • the embodiments of the present application do not limit the manner in which the mobile phone prompts a new message.
  • the mobile phone When it is determined that the face image collected by the external screen camera is a correct face image and the mobile phone is in a folded state, indicating that the user is likely to want to unlock the external screen, the mobile phone unlocks the external screen. In this way, the user can interact with the mobile phone through the external screen. For example, reading received WeChat notifications through the external screen, replying to WeChat messages, etc.
  • a related interface such as the new message shown in (4) in FIG. 8-1 is displayed, and the interface includes details such as the message.
  • the mobile phone determines that the face image collected by the external screen camera is the correct face image, and the mobile phone is not in the folded state, it means that the user is likely to want to unlock the internal screen this time. In this case, the mobile phone unlocks the internal screen. In this way, the user can interact with the mobile phone through the internal screen, for example, read the specific WeChat notification content through the internal screen, and reply to WeChat messages.
  • a new message such as the one shown in (5) in Figure 8-1 may be displayed. related interface. If the user does not click on the control 402, after unlocking the internal screen, the mobile phone can enter the desktop or the application interface that was previously exited, or display other interfaces.
  • the mobile phone can determine the user's unlocking intention based on the user's unlocking needs and unlocking timing (for example, after receiving a new message), such as viewing the new message, And show the relevant interface of new messages after unlocking the screen.
  • the relevant interface of the new message may be an interface including the details of the message.
  • the message details include but are not limited to one or more of the following: message content, sender, sender avatar, sending time, etc.
  • the mobile phone in response to a user's operation instruction on the new message (such as, but not limited to, operations such as clicking on the new message), displays a related interface of the new message after unlocking the screen.
  • the manner of displaying the interface can be applied to one or more of the inner screen or the outer screen. If the user does not operate the new message, the desktop or the previous application interface can be displayed.
  • the mobile phone can display the relevant interface of the new message after unlocking the screen.
  • the method of displaying the interface can be applied to one or more of the inner screen or the outer screen.
  • the mobile phone receives a new message in a locked screen state, and optionally displays a message reminder interface 401. If the user wants to view the two notifications of WeChat, he can lift the mobile phone (the user does not click on the control 402). The mobile phone recognizes that the user lifts the mobile phone, and judges that the user currently expects to unlock the mobile phone, and because the user unlocks the mobile phone after the mobile phone receives the WeChat notification message, the mobile phone determines that the user's use intention is to view the WeChat notification message. Therefore, during the process of lifting the mobile phone, the mobile phone calls the external screen camera to complete face recognition, unlocks the screen according to the face recognition result, and displays the WeChat message interface of (4) in Figure 8-1.
  • the mobile phone can determine the user's unlocking intention based on the user's unlocking needs and unlocking timing (for example, after receiving a new message), such as viewing new messages, and unlocking the new message.
  • a related interface of the new message is displayed behind the screen, so that the interaction experience between the user and the mobile phone can be improved.
  • the phone is locked and the user needs to complete identity authentication in order to make payment.
  • the mobile phone uses the face image collected by the external screen camera to determine whether the user's identity is legal. If it is determined that the user's identity is legal and the user does not unfold the phone, then the phone determines that the purpose of unlocking the user is to unlock the external screen, then the phone unlocks the external screen and can display an interface such as (3) in Figure 9-1.
  • the mobile phone may display one or more functions of the application on the desktop in the form of shortcut icons such as functions. Subsequently, the user can use the corresponding function quickly by operating the function shortcut icon.
  • a shortcut icon of the payment function of the wallet application is displayed.
  • the user can operate the shortcut icon (for example, click the shortcut icon) to trigger the display on the phone.
  • the payment QR code shown in (4) in Figure 9-1 is displayed. Subsequently, the user can use the payment QR code to pay.
  • the user can choose to complete the payment operation through the internal screen of the mobile phone.
  • the user unlocks the mobile phone through face recognition.
  • the mobile phone determines that the user's identity is legal and the mobile phone is not folded, it means that the user wants to unlock the inner screen this time.
  • the mobile phone unlocks the inner screen and can display the interface shown in (5) in Figure 9-1.
  • the interface includes an icon for the wallet application (or includes an icon such as a payment function).
  • the user can use one or more functions of the wallet application (such as a payment and receipt function) through operations such as clicking on the wallet icon.
  • the user can also choose to unfold the mobile phone to other angles, such as fully unfolding for use.
  • the mobile phone in response to the user clicking the icon of the wallet application shown in (5) in FIG. 9-1, the mobile phone enters the interface of the wallet application.
  • the mobile phone in response to the user's operation of selecting to use the payment and receipt function in the wallet application interface, the mobile phone can display the payment and receipt function interface shown in (6) in Figure 9-1.
  • the payment methods include but are not limited to two-dimensional code payment, near field communication (near field communication, NFC) payment, and barcode payment.
  • the mobile phone contacts the NFC bus card in the folded state (and the screen is locked), and displays an interface such as (2) in Figure 9-2.
  • the user can trigger the mobile phone to verify the user's identity through actions such as clicking on the "recharge” option.
  • the mobile phone calls the external screen camera to perform face recognition, and can display an interface such as that shown in (3) in Figure 9-2.
  • the mobile phone determines that the user's identity is legal and the mobile phone is in a folded state, indicating that the user wants to unlock the external screen
  • the mobile phone unlocks the external screen and can display an interface such as (4) in Figure 9-2, through which the user can select Recharge the corresponding recharge amount.
  • the mobile phone is in a folded state (lock screen).
  • the user can perform some operations on the mobile phone to trigger the mobile phone to open the camera application. For example, the user presses the power button to light up the external screen, and triggers the mobile phone to display the camera application icon such as shown in (2) in FIG. 10 through the external screen.
  • the mobile phone opens the camera application and enters the interface of the camera application.
  • the interface may include gallery controls, photographing controls, and camera switching controls.
  • the user can trigger the mobile phone to take a picture by, for example, clicking on the camera control, that is, when the external screen is not unlocked, the camera function in the camera application is available.
  • the user can switch the front camera or the rear camera by, for example, clicking on the camera switching control, that is, when the external screen is not unlocked, the camera switching function of the camera application is available.
  • the user may attempt to enter the gallery, such as by clicking.
  • the mobile phone in order to leak some private pictures in the mobile phone gallery, the mobile phone can only display the pictures generated by this photo to the user through the gallery. Then, the user can only view the pictures generated by the camera application this time through the gallery. Pictures taken by operating the camera controls. In other words, if the external screen is not unlocked, you only have permission to browse photos taken in the unlocked state.
  • the pictures stored in the gallery are deleted.
  • the user can trigger the mobile phone to display the pictures in the gallery shown in (4) in FIG. 10 through operations such as clicking on the gallery control.
  • the interface shown in (4) in 10 may include a gallery control.
  • the mobile phone may prompt the user to unlock.
  • the mobile phone may display a prompt interface such as that shown in (5) in FIG. 10 .
  • the mobile phone detects the user's unlocking operation, such as detecting that the user taps the screen, the mobile phone calls the external screen camera to collect the user's face image in order to identify the user's identity.
  • the mobile phone If it is detected that the user's identity is legitimate and the mobile phone is in a non-folded state, the mobile phone unlocks the inner screen and can display a gallery interface such as (6) in Figure 10 for the user to browse and view.
  • the gallery interface can include one or more pictures from the phone.
  • the mobile phone Conversely, if it is detected that the user's identity is legitimate and the mobile phone is in a folded state, the mobile phone unlocks the external screen and can display the gallery interface shown in (7) in FIG. 10 .
  • the unlocking process shown in FIG. 10 is only an example.
  • the conditions for triggering the opening of the camera, the user operating the gallery control to trigger the actual response of the mobile phone, etc. may have other implementation manners, which are not limited in the embodiments of the present application.
  • the mobile phone displays the picture taken by the user this time.
  • the mobile phone can switch the display among the multiple pictures taken this time.
  • the mobile phone prompts the user to unlock it so as to view the mobile phone gallery.
  • the mobile phone is in a folded state, and music is playing in the background. Users can light up the external screen by, for example, tapping the screen or pressing the power button.
  • an interface such as (2) in FIG. 11 may be displayed after the screen of the mobile phone is turned on.
  • the interface may include controls 406 .
  • the user cannot operate music-related operations on the external screen interface, for example, cannot switch songs, and cannot control the pause and playback of songs.
  • the mobile phone may perform some functions of the music application.
  • the user can switch songs, pause and play songs through the control 406 .
  • some other functions are not supported by the mobile phone.
  • the user cannot implement functions such as collecting music through the control 406 .
  • the mobile phone In response to the unlocking operation input by the user, such as double-clicking the screen, the mobile phone calls the external screen camera to collect a face image, and then performs face recognition according to the collected face image to determine whether the user's identity is legal.
  • the mobile phone may display an interface such as that shown in (3) in FIG. 11 .
  • the mobile phone When it is determined that the user's identity is legitimate and the mobile phone is in a non-folded state, the mobile phone unlocks the inner screen.
  • the control 406 Through an interface such as shown in (2) in FIG. 11 (for example, clicks the control 406), then the mobile phone will display music such as shown in (4) in FIG. 11 after unlocking the internal screen. application interface. If the user does not operate the control 406, after unlocking the internal screen of the mobile phone, the internal screen can enter the desktop or the application interface displayed last time.
  • the mobile phone unlocks the external screen.
  • an interface such as the music application shown in (5) in FIG. 11 is displayed.
  • FIG. 11 mainly takes the user triggering the face unlock by double-clicking the music control 406, and the music-related interface is displayed after the mobile phone is unlocked as an example.
  • the user may not operate the music control 406, but use other methods, such as, Slide your finger on the interface shown in (2) in Figure 11 to trigger the mobile phone to perform face unlocking. In this case, after unlocking the phone, you can enter the main interface or the most recent interface displayed by the phone.
  • the mobile phone can be directly unlocked after successful face recognition. Taking receiving a new message as an example, for example, referring to (3) and (4) in Figure 8-1, after the face recognition of the mobile phone is successful, if it is determined that the mobile phone is in the folded state, the external screen is directly unlocked.
  • the mobile phone can also be unlocked based on an unlocking operation (such as an operation of sliding the screen) input by the user after the face recognition is successful.
  • an unlocking operation such as an operation of sliding the screen
  • the mobile phone performs face recognition in response to the user's unlocking requirement. After the face recognition is successful, the mobile phone can display an interface such as (3) in Figure 8-2.
  • the mobile phone unlocks the external screen, and can display the unlocking interface such as shown in (4) in Figure 8-2.
  • the mobile phone unlocks the inner screen, and can display an unlocking interface such as shown in (5) in Figure 8-2.
  • the above embodiments are mainly illustrated by judging whether the user wants to unlock the outer screen or the inner screen by judging whether the mobile phone is in a folded state. For the specific deployment angle, when it is determined that the deployment angle of the mobile phone is within the preset range, the mobile phone unlocks the inner screen.
  • the preset range may be separately set according to actual applications, which is not limited in this embodiment of the present application.
  • judgment conditions include but are not limited to one or more of the following conditions: the current time is within a preset time period, the current location is within a preset geographic location range, the new message is a message of a preset application, a preset unlocking operation.
  • Preset applications include but are not limited to office applications.
  • office applications may be, for example, mailboxes (enterprise mailboxes, private mailboxes, etc.), instant communication applications (such as enterprise WeChat, ordinary personal WeChat, etc.).
  • the preset unlocking operation may be a preset unlocking gesture, an unlocking pattern, and other operations for unlocking the inner screen.
  • the preset unlocking operation can be set by the system or the user.
  • the mobile phone can unlock the inner screen.
  • the mobile phone may acquire user portraits, or collect behavior data for reflecting user behavior characteristics, to determine whether the user wants to unlock the external screen or the internal screen when unlocking the screen at different times, locations or scenarios. Furthermore, when the user unlocks the terminal screen at the corresponding time, place or scene, the terminal can realize efficient interaction between the user and the terminal according to whether the user currently wants to unlock the inner screen or the outer screen.
  • the above-mentioned user portrait usually includes one or more tags of the user (such as gender, staying up late, reading preferences, etc.), the user portrait can reflect the user's overall information, and the terminal can predict the user's current possible behavior or behavior through the user portrait. like.
  • the user portrait of the user indicates that the user is a person who has a habit of entertainment before going to bed (such as playing games before going to bed), and the sleeping time of the user is 23:00-7:30. Then, according to the user portrait, the terminal can determine that the unlocking purpose when the user unlocks the terminal between 22:00 and 23:00 (before going to bed) is to unlock the inner screen and use the game application B. Therefore, if it is detected between 22:00 and 23:00 that the user inputs correct identity authentication information (such as correct face information) into the terminal, the terminal unlocks the internal screen and can automatically open game application B.
  • identity authentication information such as correct face information
  • the terminal may determine that the unlocking purpose of the user when unlocking the mobile phone at home is to unlock the inner screen. Therefore, if it is detected that the user is at home and the user inputs correct identity authentication information into the terminal, the terminal unlocks the inner screen. If it is detected that the user is located in a public place such as a subway, and the user inputs correct identity authentication information into the terminal, the terminal unlocks the external screen.
  • the preset unlocking instruction is an unlocking instruction for unlocking the inner screen, and the preset unlocking instruction includes any one or a combination of the following: preset gestures, patterns, numbers, and fingerprints.
  • the drawing unlock pattern "M” is set as a preset unlock instruction for unlocking the inner screen
  • the drawing unlock pattern "N” is set as the unlock instruction for the user to unlock the outer screen.
  • corporate emails may involve commercial secrets, and therefore require higher security.
  • the mobile phone can unlock the inner screen in response to the unlocking instruction input by the user (such as a face image input through the camera on the outer screen), so as to reduce the viewing rate.
  • the mobile phone receives a corporate email while the screen is locked.
  • the mobile phone uses the external screen camera to authenticate the user's identity.
  • the mobile phone can unlock the inner screen.
  • the mobile phone displays the interface shown in (3) in Figure 8-3.
  • the interface includes the content of the message.
  • the mobile phone may prompt the user to unfold the mobile phone to process corporate emails with high security requirements.
  • an interface 404 (an example of a third interface) may be displayed to prompt the user to expand and use the mobile phone.
  • the mobile phone unlocks the inner screen.
  • an interface such as (5) in Figure 8-3 is displayed.
  • the interface includes details of the email.
  • the interface includes email details and an email list in a split-screen format.
  • the mobile phone when the mobile phone receives a message from an application with high security requirements (such as corporate mail), the mobile phone uses the internal screen as much as possible to process the message. Specifically, when it is determined that the user's identity is legitimate, if it is determined that the mobile phone is in a non-folded state, the mobile phone will preferentially unlock the inner screen. Alternatively, if it is determined that the user's identity is legitimate, if it is determined that the mobile phone is still in a folded state, the user may be prompted that the mobile phone can be unfolded. In this way, it is possible to increase the probability that the user uses the internal screen to process messages (such as corporate emails).
  • an application with high security requirements such as corporate mail
  • the mobile phone may further prompt the user to use the mobile phone through multiple interfaces.
  • the interfaces shown in (2) or (4) in 8-3 all prompt the user to expand the use of the mobile phone.
  • the embodiments of the present application do not limit the specific timing and manner of prompting.
  • the new message may also be a message that is not a preset application or function, or a message that is not received within a preset time period, or a message that is not received within a preset geographic location range, such as some security
  • users can choose whether to interact with the mobile phone through the internal screen based on the user's usage habits.
  • the mobile phone receives a new email in a locked screen state, and displays an interface such as interface 405.
  • the interface can include basic information about the new mail.
  • the mobile phone calls the external screen camera to collect a face image and perform face recognition.
  • the mobile phone may display an interface such as that shown in (3) in Figure 8-4.
  • the mobile phone determines that the user's identity is legitimate according to the face recognition result, and the mobile phone is in a non-folded state, the mobile phone determines that the user's unlocking purpose is to unlock the internal screen, then the mobile phone unlocks the internal screen.
  • an interface such as shown in (4) in Figure 8-4 is displayed.
  • the mobile phone determines that the user's identity is legitimate according to the face recognition result, and the mobile phone is still in a folded state at this time, the mobile phone unlocks the external screen.
  • an interface such as (5) in Figure 8-4 is displayed.
  • the mobile phone unlocks the external screen, that is, The mobile phone interacts with the user through the external screen as much as possible.
  • the mobile phone unlocks the internal screen and interacts with the user through the internal screen as much as possible.
  • the mobile phone may also prompt the user to expand the mobile phone for use.
  • prompt information is displayed in the interface shown in (2) or (3) in Figure 8-4.
  • a prompt message is displayed before unlocking the screen.
  • the manner in which the mobile phone prompts the user to unfold the mobile phone is not limited to the interface manner, and may also be, for example, a voice (an example of a prompt voice) prompt manner, and the like.
  • the embodiments of the present application do not limit the specific prompting timing and prompting manner.
  • the mobile phone may also determine whether to use the internal screen to interact with the user based on other conditions. For example, do some other tests for the mail message, so as to determine whether to recommend unlocking the internal screen to the user to process the mail message.
  • the mobile phone detects whether the newly received email has attachments. If the email has attachments, when it detects that the user needs to unlock the mobile phone and actively expands the mobile phone, the mobile phone unlocks the internal screen.
  • the mobile phone recommends the user to expand the use of the mobile phone, and the prompting method is not limited to the interface method or the voice method.
  • the mobile phone detects whether the newly received email has an attachment with a size exceeding the threshold. If the email has a large attachment (such as more than 10M), when it detects that the user needs to unlock the mobile phone and actively expands the mobile phone, the mobile phone unlocks the internal screen. . Alternatively, the mobile phone recommends the user to expand the use of the mobile phone.
  • a large attachment such as more than 10M
  • the threshold may be flexibly set according to the scenario, which is not limited in this embodiment of the present application.
  • the mobile phone detects whether a newly received email has an attachment of a preset type. If the email has an attachment of a preset type, when it is detected that the user needs to unlock the mobile phone and the mobile phone is actively unfolded, the mobile phone unlocks the internal screen. Alternatively, the mobile phone recommends the user to expand the use of the mobile phone.
  • the preset type of attachment may be an attachment suitable for viewing on an internal screen (such as a large screen).
  • the preset type of attachment may be an attachment with high privacy, for example, an encrypted attachment.
  • the preset type may be, but not limited to, pictures, videos, Word documents, and encrypted attachments.
  • Image types include but are not limited to any one or more of the following types: jpg, png, tif, gif.
  • the terminal may also determine the unlocking purpose of the user by detecting the above-mentioned multiple conditions. Taking the terminal detecting whether the current time is within a preset time period and whether the electronic device is in a folded state as an example, as a possible design, in In some cases, if the terminal detects that the user has entered correct identity authentication information within a preset time period, and at the same time detects that the terminal is in an unfolded state, indicating that the user is ready to unfold the terminal, the terminal can directly unlock the inner screen.
  • the terminal detects that the user has entered correct identity authentication information within a preset period of time, and at the same time detects that the terminal is in a folded state, it may be that the user did not unfold the terminal in time, then the terminal may present prompt information, for example, the terminal Displays such as "Face recognition is successful, expand the terminal to unlock the inner screen" to prompt the user to expand the terminal.
  • the terminal Displays such as "Face recognition is successful, expand the terminal to unlock the inner screen" to prompt the user to expand the terminal.
  • the terminal can unlock the inner screen.
  • the terminal can unlock the external screen.
  • the terminal detects that the user has entered correct identity authentication information within a preset period of time. Then, the terminal can first unlock the external screen, display the first interface on the external screen, and unlock the internal screen when detecting that the user unfolds the phone. The second interface associated with the first interface can be displayed on the inner screen. In this way, the interface association of the outer screen can be connected to the inner screen.
  • the user needs to use the internal screen to interact with the mobile phone, and due to some factors, the mobile phone cannot successfully recognize the face through the external screen camera. For example, the user unfolds the mobile phone quickly, the number of face images collected by the external screen camera is small, or the angle of the face image collected by the external screen camera is relatively biased, and the mobile phone cannot identify the user based on these human images collected.
  • the mobile phone can call the internal screen camera to continue to collect the user's face image (user identity information An example), and identify the user identity according to the face image collected by the in-screen camera.
  • the mobile phone displays an interface such as that shown in (3) in Figure 8-5 through the internal screen to prompt the user that face recognition is in progress.
  • the mobile phone can unlock the internal screen.
  • an interface such as (4) in Figure 8-5 is displayed on the internal screen.
  • the mobile phone can call the internal screen image sensor (an example of the first acquisition component) to continue to collect the face image, and considering that the external screen camera may have After some face images are collected, the mobile phone can use the face images collected by the external screen camera and the face images collected by the internal screen camera to identify the user's identity. In this way, since the external screen camera has already collected part of the face images required for face recognition before the mobile phone calls the internal screen camera, the internal screen camera can collect fewer face images to complete the face recognition and shorten the time. From calling the internal screen camera to the successful use of face recognition, the speed of face recognition is accelerated.
  • the internal screen image sensor an example of the first acquisition component
  • the mobile phone may determine the timing of invoking the in-screen camera according to the positional relationship between the user and the mobile phone. For example, when it is determined that the user's face is out of the field of view (FOV) range of the external screen camera, and the duration reaches the preset time, it means that the external screen camera has a high probability that no more face images can be collected, then, if this time When the mobile phone is in a non-folded state, the mobile phone calls the in-screen camera to continue to collect face images to increase the success rate of face recognition.
  • FOV field of view
  • the mobile phone determines that the user's face is out of the field of view (FOV) range of the external screen camera, and the duration reaches a preset duration, the mobile phone controls the external breath-holding screen to reduce power consumption.
  • FOV field of view
  • the mobile phone may also determine the timing of invoking the in-screen camera in response to an instruction input by the user. For example, if it is detected that the user performs an operation such as pressing the power button, the mobile phone calls the in-screen camera.
  • the mobile phone may also determine the timing of invoking the in-screen camera according to the unfolded angle of the folding screen or according to the folding angle of the mobile phone.
  • the in-screen camera is called to collect the face image.
  • the preset angle range may be determined according to the viewing angle range of the in-screen camera.
  • the in-screen camera can usually capture face images.
  • the in-screen camera is a wide-angle or ultra-wide-angle camera, its viewing angle range is larger, and the corresponding preset angle range is also larger.
  • the preset angle range is correspondingly small.
  • the embodiment of the present application does not limit the preset angle range. It can be seen that in this embodiment, when the user's face falls within the viewing angle range of the internal screen camera, the internal screen camera will be called to start working, which not only reduces the power consumption caused by calling the internal screen camera in advance, but also reduces the The probability that the face recognition speed is slow due to the delay in calling the in-screen camera.
  • the in-screen camera used for face recognition may be a camera with a larger viewing angle range.
  • the probability that the user's face falls within the viewing angle range of the inner-screen camera is increased, which is beneficial for the inner-screen camera to collect face images, thereby improving the success rate of face recognition.
  • the preset angle range is 80°-145, as shown in (1) in Figure 8-6
  • the mobile phone receives a new email in the locked screen state
  • the user picks up the mobile phone and intends to unlock the mobile phone and responds Due to the user's unlocking operation
  • the mobile phone calls the external screen camera to collect face images for face recognition.
  • the mobile phone can display the interface shown in (2) in Figure 8-6. After that, the user gradually unfolds the mobile phone. If the mobile phone detects that the angle of the mobile phone being unfolded reaches 80 degrees and the unlocking is still not successful, the mobile phone calls the in-screen camera to continue to collect face images.
  • the mobile phone can identify the user identity according to the face image collected by the internal screen camera. Or, in order to further improve the face recognition speed, the mobile phone can perform face recognition by combining the face image collected by the external screen camera and the face image collected by the internal screen camera.
  • the mobile phone may display an interface such as that shown in (3) in Figures 8-6 for prompting the user that the identity is being identified.
  • the mobile phone unlocks the internal screen, and can display an interface such as (4) in Figure 8-6.
  • the mobile phone may determine the timing of invoking the in-screen camera in combination with the unfolded angle of the mobile phone and the positional relationship between the user and the mobile phone, so as to invoke the in-screen camera at a more accurate timing. For example, when it is detected that the folding angle of the mobile phone reaches 80 degrees, and the user's face is close to the mobile phone, and the user's identity has not been successfully identified, the mobile phone calls the in-screen camera to collect the user's face image so as to continue face recognition.
  • the mobile phone may also prompt the user whether to unfold the mobile phone in order to unlock the inner screen.
  • the mobile phone Take receiving a new message as an example.
  • the mobile phone is in the locked screen state.
  • the mobile phone can display (2) in Figure 8-7.
  • the message reminder interface may include words such as "expanding the mobile phone will enter the internal screen display" to prompt the user that the internal screen can be unlocked by unfolding the mobile phone.
  • the mobile phone uses an external screen camera to collect a face image for face recognition.
  • the mobile phone displays the interface shown in (3) in Figure 8-7.
  • the mobile phone determines that the user's identity is legitimate through face recognition, and the mobile phone is not in a folded state, it means that the user has unfolded the mobile phone, and the user's purpose of unlocking is to unlock the inner screen, then the mobile phone unlocks the inner screen.
  • the message details interface shown in (4) in Figure 8-7 is displayed.
  • the mobile phone determines that the user's identity is legitimate through face recognition, and the mobile phone is in a folded state at this time, it means that the user has not unfolded the mobile phone, and the user's purpose of unlocking is to unlock the external screen, then the mobile phone will unlock the external screen.
  • the mobile phone displays the message details interface shown in (5) in Figure 8-7.
  • the mobile phone may prompt the user to unfold the mobile phone during the face recognition process in order to unlock the inner screen. If the mobile phone determines that the user's identity is legitimate according to the face recognition result, and the mobile phone is not in a folded state, it means that the user has unfolded the mobile phone, and the purpose of unlocking is to unlock the inner screen, then the mobile phone unlocks the inner screen according to the user's purpose of unlocking. Conversely, if the mobile phone determines that the user's identity is legitimate according to the face recognition result, but the mobile phone is in a folded state, it means that the user has not unfolded the mobile phone, and the purpose of unlocking is to unlock the external screen, then the mobile phone unlocks the external screen.
  • the mobile phone can display the interface 403 shown in (3) in Figure 8-9, and use To prompt the user to unfold the phone in order to unlock the inner screen.
  • the mobile phone detects that the mobile phone is unfolded, it means that the user's unlocking purpose is to unlock the inner screen, and then the mobile phone unlocks the inner screen according to the user's unlocking purpose.
  • the mobile phone does not detect that the mobile phone is unfolded, it means that the user may only want to use the external screen to interact with the mobile phone. Then, the mobile phone unlocks the external screen to restore the interactivity of the external screen.
  • the way in which the mobile phone prompts the user to unfold the mobile phone is not limited to displaying the interface shown in (2) in Fig. 8-7, the interface 407 shown in (1)-(4) in Fig. 8-8, and the interface 407 shown in Fig. 8-8 (1)-(4). the interface shown in (3).
  • the user can also be prompted through the interface at the angle at which the mobile phone can be unfolded, for example, prompting the user "Please unfold the mobile phone by about 15 degrees (for example only) to trigger unlocking of the inner screen.”
  • the manner in which the mobile phone prompts the user to unfold the mobile phone is not limited to the interface prompting method, but may also be, for example, a voice prompting method.
  • the embodiments of the present application do not limit the specific prompting timing and prompting manner.
  • the mobile phone when the user determines that the unlocking purpose of the user is to unlock the inner screen, the mobile phone unlocks the inner screen.
  • the mobile phone detects that the external screen is still on, it can control the external breath-holding screen to reduce the power consumption of the whole machine caused by the bright screen of the external screen.
  • the mobile phone when the mobile phone determines that the unlocking purpose of the user is to unlock the inner screen, the mobile phone can also unlock the inner screen and the outer screen at the same time. For example, in some shooting scenarios, the user may need to preview the image to be shot through the internal screen and the external screen, so as to take a picture with better effect.
  • a shortcut startup mode may also be set for a specific function of a specific application, so as to unlock and enter the corresponding function of the corresponding application more quickly.
  • a shortcut startup icon is set for the camera application.
  • the user can quickly use the camera application by operating the shortcut launch icon of the camera application.
  • a quick launch icon can also be set for the payment function of the wallet application.
  • the mobile phone After the user operates (for example, clicks) the quick start icon of the payment function, the mobile phone authenticates the user's identity, and if it is determined that the user's identity is legitimate, the mobile phone directly displays the payment QR code. In this way, the user's payment operation can be simplified, and the user does not need to search for the wallet application in multiple applications on the desktop after unlocking, and select to enter the payment QR code interface.
  • the mobile phone can also unlock the external screen first when the external screen camera determines that the user's identity is legitimate. Subsequently, when it is detected that the user unfolds the mobile phone, the mobile phone can connect the interface of the external screen to display on the internal screen. Take unlocking the mobile phone in the scenario of receiving a new message as an example, as shown in (1) and (2) in Figure 8-10, the mobile phone receives a new message in the locked screen state, the user picks up the mobile phone to unlock it, and the mobile phone collects the information through the external screen camera. face image, and then perform face recognition on the user.
  • the mobile phone unlocks the external screen, and displays a message interface (an example of the first interface) such as shown in (3) in Figures 8-10. Subsequently, when the user expands to use the mobile phone, the mobile phone can associate and connect the interface displayed on the external screen, such as that shown in (3) in Figure 8-10, to the internal screen. And the interface shown in (4) in Figure 8-10 will be displayed on the internal screen.
  • the external screen interface can be switched to be displayed on the internal screen synchronously, so as to realize seamless switching from the external screen interface to the internal screen interface.
  • an interface associated with the external screen interface may be displayed on the internal screen.
  • the external screen displays the email details interface
  • the internal screen can display the interface in a split-screen manner (an example of the second interface), displaying the email details in a part of the interface and a list of sent and received emails in a part.
  • the external screen displays the interface of the current music being played, and when switching to the internal screen display, the music list interface is displayed on the internal screen, that is, the interface associated with the external screen interface can be displayed on the internal screen.
  • the mobile phone when it is determined that the user's identity is legal and the mobile phone is deployed, the mobile phone does not need to unlock the outer screen, but directly unlocks the inner screen, which can further reduce Power consumption caused by unlocking the external screen.
  • the function interface displayed on the internal screen of the mobile phone and the function interface displayed on the external screen may be different.
  • the payment function interface displayed on the outer screen in (4) of Figure 9-1 includes less Information (for example, it only includes the QR code information used to complete the payment function as shown in the figure), and the payment function interface displayed on the inner screen in (6) of Figure 9-1 includes more information (for example, including the payment function as shown in the figure). QR code information for completing the payment function, as well as barcode information, etc.). In this way, as much important private information as possible can be displayed on the internal screen, so as to improve the security of user information.
  • the interface of the function displayed on the screen with a small size includes less information
  • the interface of the function displayed on the screen with a large size includes less information. More information.
  • This embodiment of the present application may further provide a setting entry for the user to set unlocking related functions.
  • (1)-(4) in FIG. 12 show the relevant setting interface for setting the application operating in the internal screen.
  • the mobile phone can receive a setting instruction input by the user through the setting interface, and the setting instruction is used to set the above-mentioned preset application.
  • the mobile phone can also provide, for example, a time period for using the internal screen (ie, a preset time period), a location for using the internal screen (ie, a preset geographic location range), and an unlocking instruction for unlocking the internal screen (ie, a preset unlocking instruction). ) and other setting entries for one or more options.
  • the first collection component is a camera with an inner screen and the second collection component is a camera with an outer screen.
  • the first collection component may be different from the second collection component.
  • the first collecting part and the second collecting part can also be the same part.
  • the first collecting component and the second collecting component may be the same fingerprint collecting component.
  • the fingerprint collection component can be used to collect the user's fingerprint information, and then can be used to unlock the inner screen or the outer screen.
  • the apparatus may be the above-mentioned electronic device (such as a mobile phone with a folding screen).
  • the apparatus may include a display screen, memory, and one or more processors.
  • the display screen, memory and processor are coupled.
  • the memory is used to store computer program code comprising computer instructions.
  • the processor executes the computer instructions, the electronic device can execute various functions or steps executed by the mobile phone in the foregoing method embodiments.
  • FIG. 2 For the structure of the electronic device, reference may be made to the electronic device shown in FIG. 2 .
  • the core structure of the electronic device may be represented as the structure shown in FIG. 13 , and the core structure may include: a processing module 1301, an input module 1302, a storage module 1303, and a display module 1304.
  • the processing module 1301 may include at least one of a central processing unit (CPU), an application processor (Application Processor, AP), or a communication processor (Communication Processor, CP).
  • the processing module 1301 may perform operations or data processing related to the control and/or communication of at least one of the other elements of the user electronic device. Specifically, the processing module 1301 can be used to control the content displayed on the main screen according to a certain trigger condition. Or determine what is displayed on the screen according to preset rules.
  • the processing module 1301 is further configured to process the input instruction or data, and determine the display style according to the processed data.
  • the processing module 1301 also includes a rendering engine, etc., for rendering the interface element UI.
  • the input module 1302 is configured to acquire instructions or data input by the user, and transmit the acquired instructions or data to other modules of the electronic device.
  • the input method of the input module 1302 may include touch, gesture, proximity to the screen, etc., and may also be voice input.
  • the input module may be a screen of an electronic device, obtains an input operation of the user, generates an input signal according to the obtained input operation, and transmits the input signal to the processing module 1301 .
  • the input module may be configured to receive an unlocking instruction input by a user, and/or perform other steps.
  • the storage module 1303 may include volatile memory and/or non-volatile memory.
  • the storage module is used to store at least one related instruction or data in other modules of the user terminal device, specifically, the storage module can record the position of the interface where the terminal interface element UI is located.
  • the display module 1304 may include, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a microelectromechanical system (MEMS) display, or an electronic paper display. Used to display user-viewable content (eg, text, images, videos, icons, symbols, etc.).
  • the display module may be implemented as a display screen, such as a first screen and/or a second screen.
  • the structure shown in FIG. 13 may further include a communication module 1305 for supporting the communication between the electronic device and other electronic devices.
  • the communication module may be connected to a network via wireless communication or wired communication to communicate with other personal terminals or network servers.
  • Wireless communication may employ at least one of cellular communication protocols, such as Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Universal Mobile Communications System (UMTS), Wireless Broadband (WiBro) or Global System for Mobile Communications (GSM).
  • Wireless communications may include, for example, short-range communications.
  • the short-range communication may include at least one of Wireless Fidelity (Wi-Fi), Bluetooth, Near Field Communication (NFC), Magnetic Stripe Transmission (MST), or GNSS.
  • the chip system includes at least one processor 1401 and at least one interface circuit 1402 .
  • the processor 1401 and the interface circuit 1402 may be interconnected by wires.
  • the interface circuit 1402 may be used to receive signals from other devices, such as the memory of an electronic device.
  • the interface circuit 1402 may be used to send signals to other devices (eg, the processor 1401).
  • the interface circuit 1402 may read the instructions stored in the memory and send the instructions to the processor 1401 .
  • the electronic device can be caused to perform the various steps in the above embodiments.
  • the chip system may also include other discrete devices, which are not specifically limited in this embodiment of the present application.
  • Embodiments of the present application further provide a computer storage medium, where the computer storage medium includes computer instructions, when the computer instructions are executed on the above-mentioned electronic device, the electronic device is made to perform various functions or steps performed by the mobile phone in the above-mentioned method embodiments .
  • Embodiments of the present application further provide a computer program product, which, when the computer program product runs on a computer, enables the computer to perform various functions or steps performed by the mobile phone in the above method embodiments.
  • the disclosed apparatus and method may be implemented in other manners.
  • the apparatus embodiments described above are only illustrative.
  • the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be Incorporation may either be integrated into another device, or some features may be omitted, or not implemented.
  • the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place, or may be distributed to multiple different places . Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a readable storage medium.
  • the technical solutions of the embodiments of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, which are stored in a storage medium , including several instructions to make a device (may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)

Abstract

解锁方法及电子设备，涉及通信技术领域，不需要用户完全展开手机即可对用户身份进行识别，以便在用户身份合法的情况下快速完成解锁，提高用户与终端之间的交互效率。该方法应用于电子设备，电子设备包括屏幕折叠状态下形成的第一屏幕和第二屏幕，其中，第一屏幕为内屏，第二屏幕为外屏，第一屏幕具有关联的第一采集部件，第二屏幕具有关联的第二采集部件，方法包括：获取解锁意图；响应于解锁意图，调用第二采集部件采集用户的身份信息，并根据第二采集部件采集的身份信息识别用户的身份；若用户的身份合法，且电子设备满足使用第一屏幕的条件，则解锁第一屏幕。

Description

解锁方法及电子设备
本申请要求于2021年04月22日提交国家知识产权局、申请号为202110438415.7、发明名称为“解锁方法及电子设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及电子技术领域，尤其涉及解锁方法及电子设备。
背景技术
折叠屏设备通常具有较大的屏幕，可以为用户提供更好的视觉观看体验。为了保证用户隐私等重要数据的安全性，折叠屏设备一般都具有锁屏功能。当折叠屏设备的屏幕锁定后，需要用户向折叠屏设备输入合法的身份验证信息(比如正确的指纹、数字密码、人脸数据)，才会触发屏幕解锁，恢复折叠屏设备与用户的可交互性。
以在接收新消息的场景中解锁折叠屏向手机为例，目前，如图1所示，折叠屏手机在锁屏状态下接收新消息(比如微信的2个通知)，若用户需要在折叠屏手机的内屏读取并回复消息，则用户需要先将手机由折叠状态展开为展开状态，并在展开状态下向手机输入身份认证信息(比如通过内屏摄像头输入人脸数据)。可见，相比于使用非折叠屏手机，解锁手机通常只需要花费较短时间，使用折叠屏手机，由于需展开手机后才能开启身份认证，使得解锁效率较低，用户与终端之间的交互效率较低。
发明内容
本申请提供的解锁方法及电子设备，不需要用户完全展开手机即可对用户身份进行识别，以便在用户身份合法的情况下快速完成解锁，提高用户与终端之间的交互效率。
为达到上述目的，本申请采用如下技术方案：
第一方面，本申请提供一种解锁方法，该方法应用于电子设备或能够实现电子设备功能的装置(比如电子设备的芯片)，以电子设备为例，电子设备包括屏幕折叠状态下形成的第一屏幕和第二屏幕，其中，第一屏幕为内屏，第二屏幕为外屏，第一屏幕具有关联的第一采集部件，第二屏幕具有关联的第二采集部件。
该方法包括：获取解锁意图，响应于该解锁意图，电子设备调用第二采集部件采集用户的身份信息，并根据第二采集部件采集的身份信息识别用户的身份。其中，若用户的身份合法，且电子设备满足使用第一屏幕的条件，则解锁第一屏幕。
可见，在获取到用户的解锁意图时，可借助外屏关联的传感器来采集用户的身份信息，并根据该身份信息识别用户身份。与现有技术中展开手机后才开启身份识别，解锁效率较低相比，本申请的技术方案，不需要用户完全展开手机即可对用户身份进行识别，以便在用户身份合法的情况下快速完成解锁，提高用户与终端之间的交互效率。并且，当终端检测到终端满足使用第一屏幕的条件时，说明用户解锁终端屏幕时希望解锁第一屏幕。那么，当确定用户身份合法后，终端可以智能、便捷的为用户自动解锁第一屏幕，从而进一步提高终端与用户之间的交互效率。
作为一种可能的设计，解锁意图可以是用户输入的解锁指令，比如，用户通过按压电源键或双击屏幕等方式向电子设备输入解锁指令。
作为一种可能的设计，解锁意图也可以是电子设备自己感知并确定的解锁意图。比如，当检测到用户抬起手机时，电子设备可以初步确定用户有解锁意图。
作为一种可能的设计，在确定用户的身份合法之后，解锁第一屏幕前，方法还包括：解锁第二屏幕，并在第二屏幕上显示第一界面。
作为一种可能的设计，在解锁第一屏幕之后，方法还包括：在第一屏幕上显示与第一界面关联的第二界面。
也就是说，当根据外屏关联的采集部件采集的身份信息，确定用户身份合法时，电子设备可以先解锁外屏，并在外屏显示第一界面。还可以将外屏显示的第一界面接续到内屏。其中，接续到内屏显示的第二界面与第一界面关联。
在一些设计中，接续到内屏显示的第二界面可以与外屏显示的第一界面为相同界面。这里，第一界面和第二界面相同，指的是包括的内容相同，第一界面和第二界面的尺寸、界面中元素的布局、元素的尺寸等可以不同。
在另一些设计中，接续到内屏显示的第二界面与第一界面的内容关联。比如，第二界面是第一界面的详细展示界面。再比如，如果外屏解锁后，若用户在外屏没有点击音乐控件，则手机展开后，内屏进入的第二界面为Home界面。如果外屏解锁后，用户在外屏点击音乐控件，则手机展开后，内屏进入的第二界面为音乐界面，比如音乐播放列表界面。或者，第一界面和第二界面显示的内容也可以相同。
作为一种可能的设计，在解锁第一屏幕之前，方法还包括：若根据第二采集部件采集的身份信息不能识别用户的身份，则调用第一采集部件采集用户的身份信息，并根据第一采集部件采集的身份信息，识别用户的身份。如此，能够提升解锁成功的概率。
作为一种可能的设计，根据第一采集部件采集的身份信息，识别用户的身份，包括：根据第二采集部件采集的身份信息以及第一采集部件采集的身份信息，识别用户的身份。以人脸识别为例，由于在电子设备调用内屏摄像头的图像传感器之前，外屏摄像头的图像传感器已经采集了人脸识别所需的部分人脸图像，则内屏摄像头的图像传感器可以采集更少的人脸图像，即可完成人脸识别，缩短了从调用内屏摄像头的图像传感器到人脸识别成功的用时，加快了人脸识别的速度。
作为一种可能的设计，若根据第二采集部件采集的身份信息不能识别用户的身份，则调用第一采集部件采集用户的身份信息，包括：若检测到电子设备的展开角度到达预设角度，且根据第二采集部件采集的身份信息不能识别用户的身份，则调用第一采集部件采集用户的身份信息。
作为一种可能的设计，在解锁第一屏幕之前，方法还包括：
显示第三界面或播放提示语音，第三界面用于提示用户展开电子设备，提示语音用于提示用户展开电子设备。
作为一种可能的设计，方法还包括：
接收用户输入的设置指令，设置指令用于设置预设应用、预设时段、预设地理位置范围、预设解锁指令中的任一个或多个。
作为一种可能的设计，获取解锁意图，包括：接收用户输入的解锁指令；
响应于解锁意图，调用第二采集部件采集用户的身份信息，包括：
响应于解锁指令，调用第二采集部件采集用户的身份信息。
作为一种可能的设计，第一采集部件与第二采集部件相同或不同。
作为一种可能的设计，使用第一屏幕的条件包括如下一项或多项条件的组合：当前时间在预设时段内、当前位置在预设地理位置范围内、接收到新消息且新消息是预设应用的消息、电子设备处于非折叠状态、用户输入的解锁指令是预设解锁指令。
作为一种可能的设计，预设解锁指令包括如下任一项或多项的组合：预设的用于解锁第一屏幕的手势、图案、数字、指纹、语音。
作为一种可能的设计，第一采集部件包括如下任一种或多种部件：指纹采集部件、声纹采集部件、图像采集部件；第二采集部件包括如下任一种或多种部件：指纹采集部件、声纹采集部件、图像采集部件。
第二方面，提供一种电子设备，电子设备包括处理器，以及屏幕折叠状态下形成的第一屏幕和第二屏幕，其中，第一屏幕为内屏，第二屏幕为外屏，第一屏幕具有关联的第一采集部件，第二屏幕具有关联的第二采集部件；
处理器，用于获取解锁意图；响应于解锁意图，调用第二采集部件采集用户的身份信息，并根据第二采集部件采集的身份信息识别用户的身份；若用户的身份合法，且电子设备满足使用第一屏幕的条件，则解锁第一屏幕。
在一种可能的设计中，处理器，还用于解锁第二屏幕；
第二屏幕，用于显示第一界面。
在一种可能的设计中，第一屏幕，用于在解锁第一屏幕之后，显示与第一界面关联的第二界面。
在一种可能的设计中，处理器，还用于若根据第二采集部件采集的身份信息不能识别用户的身份，则调用第一采集部件采集用户的身份信息，并根据第一采集部件采集的身份信息，识别用户的身份。
在一种可能的设计中，处理器，用于根据第一采集部件采集的身份信息，识别用户的身份，包括：根据第二采集部件采集的身份信息以及第一采集部件采集的身份信息，识别用户的身份。
在一种可能的设计中，处理器，用于若根据第二采集部件采集的身份信息不能识别用户的身份，则调用第一采集部件采集用户的身份信息，包括：若检测到电子设备的展开角度到达预设角度，且根据第二采集部件采集的身份信息不能识别用户的身份，则调用第一采集部件采集用户的身份信息。
在一种可能的设计中，第二屏幕，还用于显示第三界面或播放提示语音，第三界面用于提示用户展开电子设备，提示语音用于提示用户展开电子设备。
在一种可能的设计中，处理器，还用于接收用户输入的设置指令，设置指令用于设置预设应用、预设时段、预设地理位置范围、预设解锁指令中的任一个或多个。
在一种可能的设计中，处理器，用于获取解锁意图，包括：接收用户输入的解锁指令；
处理器，用于响应于解锁意图，调用第二采集部件采集用户的身份信息，包括：响应于解锁指令，调用第二采集部件采集用户的身份信息。
在一种可能的设计中，第一采集部件与第二采集部件相同或不同。
在一种可能的设计中，使用第一屏幕的条件包括如下一项或多项条件的组合：当前时间在预设时段内、当前位置在预设地理位置范围内、接收到新消息且新消息是预设应用的消息、电子设备处于非折叠状态、用户输入的解锁指令是预设解锁指令。
在一种可能的设计中，预设解锁指令包括如下任一项或多项的组合：预设的用于解锁第一屏幕的手势、图案、数字、指纹、语音。
在一种可能的设计中，第一采集部件包括如下任一种或多种部件：指纹采集部件、声纹采集部件、图像采集部件；第二采集部件包括如下任一种或多种部件：指纹采集部件、声纹采集部件、图像采集部件。
第二方面的电子设备的技术效果可以参考第一方面的解锁方法的技术效果，此处不再赘述。
第三方面，本申请提供一种电子设备，该电子设备具有实现如上述第一方面及其中任一种可能的实现方式中的解锁方法的功能。该功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。该硬件或软件包括一个或多个与上述功能相对应的模块。
第四方面，本申请提供一种计算机可读存储介质，包括计算机指令，当计算机指令在电子设备上运行时，使得电子设备执行如第一方面及其中任一种可能的实现方式中任一项的解锁方法。
第五方面，本申请提供一种计算机程序产品，当计算机程序产品在电子设备上运行时，使得电子设备执行如第一方面及其中任一种可能的实现方式中任一项的解锁方法。
第六方面，提供一种电路系统，电路系统包括处理电路，处理电路被配置为执行如上述第一方面及其中任一种可能的实现方式中的解锁方法。
第七方面，本申请实施例提供一种芯片系统，包括至少一个处理器和至少一个接口电路，至少一个接口电路用于执行收发功能，并将指令发送给至少一个处理器，当至少一个处理器执行指令时，至少一个处理器执行如上述第一方面及其中任一种可能的实现方式中所述的解锁方法。
附图说明
图1为现有技术中折叠屏手机解锁的流程；
图2为本申请实施例提供的电子设备的结构示意图；
图3-1至图3-4为本申请实施例提供的折叠屏电子设备的形态示意图；
图4为本申请实施例提供的折叠屏的夹角示意图；
图5为本申请实施例提供的电子设备的软件结构框图示意图；
图6为本申请实施例提供的一组界面示意图；
图7为本申请实施例提供的解锁方法流程示意图；
图8-1至图12为本申请实施例提供的界面示意图；
图13为本申请实施例提供的装置的示意图；
图14为本申请实施例提供的芯片系统的示意图。
具体实施方式
下面结合附图对本申请实施例提供的解锁方法及电子设备进行详细地描述。
本申请实施例提供的解锁方法，可以应用于电子设备。例如，该电子设备具体可以是手机、平板电脑、可穿戴设备、车载设备、增强现实(augmented reality，AR)/虚拟现实(virtual reality，VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本、个人数字助理(personal digital assistant，PDA)、人工智能(artificial intelligence)设备或专门的照相机(例如单反相机、卡片式相机)等，本申请实施例对电子设备的具体类型不作任何限制。
示例性的，图2示出了电子设备100的一种结构示意图。电子设备100可以包括处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，充电管理模块140，电源管理模块141，电池142，天线1，天线2，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180，按键190，马达191，指示器192，摄像头193，显示屏194，以及用户标识模块(subscriber identification module，SIM)卡接口195等。
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。
其中，控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。
处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了系统的效率。
在本申请的一些实施例中，处理器110用于在获取用户的解锁意图(接收到用户输入的解锁指令)时，借助外屏关联的传感器来采集用户的身份信息，并根据该身份信息识别用户身份。当确定用户身份合法，且检测到终端满足使用第一屏幕的条件时，说明用户解锁终端屏幕时希望解锁第一屏幕，终端可以智能、便捷的为用户自动解锁第一屏幕，从而能够提高终端与用户之间的交互效率。
充电管理模块140用于从充电器接收充电输入。
电源管理模块141用于连接电池142，充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入，为处理器110，显示屏194，摄像头193等供电。
电子设备100的无线通信功能可以通过天线1，天线2，移动通信模块150，无线通信模块160，调制解调处理器以及基带处理器等实现。
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)等无线通信的解决方案。
电子设备100通过GPU，显示屏194，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏194和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器110可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像，视频等。显示屏194包括显示面板。在一些实施例中，电子设备100可以包括1个或N个显示屏194，N为大于1的正整数。
在一些实施例中，显示屏194可以显示录像模式下的拍摄预览界面、录像预览界面和拍摄界面，还可以在视频回放时显示视频播放界面等。
电子设备100可以通过ISP，摄像头193，视频编解码器，GPU，显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将电信号传递给ISP处理，转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，肤色进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例中，ISP可以设置在摄像头193中。例如，ISP可以根据拍摄参数控制感光元件进行曝光和拍照。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device，CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor，CMOS)光电晶体管。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB，YUV等格式的图像信号。
在一些实施例中，电子设备100可以包括1个或N个摄像头193，N为大于1的正整数。其中，摄像头193可以位于电子设备的边缘区域，可以为屏下摄像头，也可以是可升降的摄像头，或者挖孔摄像头。摄像头193可以包括后置摄像头，还可以包括前置摄像头。本申请实施例对摄像头193的具体位置和形态不予限定。
示例性的，电子设备100上摄像头的布局可以参见图3-1，其中，电子设备100正面为显示屏194所在的平面。如图3-1中(a)所示，摄像头1931位于电子设备100正面，则摄像头为前置摄像头。如图3-1中(b)所示，摄像头1932位于电子设备100背面，则摄像头为后置摄像头。
可选的，本申请实施例的方案可以应用于具有多个显示屏的折叠屏(即显示屏能够折叠)的电子设备100上。
在一些实施例中，折叠屏可以为柔性折叠屏。其中，柔性折叠屏包括采用柔 性材质制作的折叠轴。该柔性折叠屏的部分或全部采用柔性材质制作。例如：该柔性折叠屏中只有可折叠的部分(如折叠轴)采用柔性材质制作，其它部分采用刚性材质制作；或者，该柔性折叠屏全部采用柔性材质制作。该折叠屏可沿折叠轴折叠形成至少两个子屏。
示例性的，图3-1中(c)示出了一种折叠屏电子设备100。响应于用户的操作，如图3-1中(d)所示，沿折叠边向内折叠(或向外折叠)可折叠屏幕，使得可折叠屏幕形成至少两个子屏(例如A子屏和B子屏)。可选的，如图3-1中(e)所示，在折叠的外侧有显示屏(例如C屏)。若电子设备100在C屏所在表面设置有摄像头。那么，在如图3-1中(c)所示的电子设备100未折叠场景中，C屏上的摄像头在电子设备100的背面，可以视为后置摄像头。在如图3-1中(e)所示的电子设备100已折叠场景中，C屏上的摄像头变为在电子设备100的正面，可以视为前置摄像头。也就是说，本申请中前置摄像头和后置摄像头并不对摄像头本身的性质进行限制，仅为一种位置关系的说明。
可选的，折叠屏电子设备的折叠屏可形成多个(比如2个、3个等)子屏。示例性的，如图3-2中(1)所示的柔性折叠屏，可以包括折叠线030和折叠线031。在沿折叠线030纵向折叠后，可以形成如图3-2中(2)所示的子屏032、子屏033和子屏034。
可选的，折叠屏电子设备的屏幕排列方式可以是诸如图3-1中(d)所示的上下屏幕排列，或者，也可以为诸如图3-3中(1)或(2)所示的左右屏幕排列等。本申请实施例对折叠屏电子设备的屏幕排列方式不做限制。如图3-3中(1)所示的柔性折叠屏，在沿折叠线040横向折叠后，可以形成如图3-3中(2)所示的子屏041、和子屏042。例如，该折叠屏设备在折叠状态可以为手机，在展开状态可以为平板电脑。
其中，折叠屏中相邻两个子屏之间的夹角大于或者等于0°且小于或者等于180°。折叠屏中相邻两个子屏之间的夹角也可称为折叠屏设备被展开的角度，或者折叠屏设备的展开角度，或折叠屏的折叠角度。根据折叠屏中相邻两个子屏之间的夹角的范围，折叠屏可以包括折叠状态、非折叠状态。非折叠状态包括展开状态和半展开状态。
展开状态表示折叠屏完全展开，即折叠屏中相邻两个子屏之间的夹角为180°，或由于某些工业设计因素而接近于180°。例如，图3-3中(1)表示折叠屏展开状态的示意图。
折叠状态表示折叠屏完全折叠，即折叠屏中相邻两个子屏之间的夹角为0°或由于某些工业设计因素而接近于0°。例如，图3-4中(1)表示折叠屏折叠状态的示意图，子屏044和子屏045之间的夹角为0°。
介于展开状态和折叠状态之间的状态，可以称为半展开状态或非折叠状态，即折叠屏中相邻两个子屏之间的夹角介于0°和180°之间。例如，图3-3中(2)以及图3-4中(2)等表示折叠屏半展开状态的示意图。示例性的，如图3-3中(2)所示，子屏041和子屏042之间的夹角φ大于0°且小于180°。夹角φ也可称为折叠屏设备被展开的角度，或折叠角度。可选的，也可以根据工业设计水平或用 户体验等方面定义其他的夹角φ的取值范围作为半展开状态，例如夹角φ大于10°且小于170°，而对应地定义夹角φ小于或等于10°时为折叠状态。
在折叠屏折叠或展开的过程中，折叠屏形成的至少两个子屏之间的夹角可发生变化。以图3-3中(2)为例，在折叠屏折叠的过程中，子屏41和子屏42之间的夹角变小；在折叠屏展开的过程中，子屏41和子屏42之间的夹角变大。可以理解的是，该折叠屏被折叠后形成的至少两个子屏，可以为独立存在的多个子屏；也可以为一体结构的一个完整屏，只是被折叠形成了至少两个部分。
在其他一些实施例中，折叠屏也可以为多屏折叠屏。该多屏折叠屏可包括至少两个子屏。该至少两个子屏是独立的显示屏，可依次通过折叠轴连接，可分别绕折叠轴转动，实现多屏折叠屏的折叠。示例性的，如图3-4中(2)所示，折叠屏设备包括折叠轴043，子屏044，以及与子屏044独立的另一子屏045。子屏044与子屏045可绕折叠轴043转动。子屏044与子屏045之间的夹角φ可称为折叠屏设备被展开的角度或折叠角度。
在本申请的实施例中，折叠屏可以是单面屏(即只有一面可以显示用户界面)也可以是双面屏(即相对的两面均可显示用户界面)。
对于单面折叠屏来说，折叠屏朝可显示用户界面的一面(即单面折叠屏的正面)进行翻折的情况，可以称为正向翻折；折叠屏朝可显示用户界面的一面的相对面(即单面折叠屏的背面)进行翻折的情况，可以称为反向翻折。例如，图3-3中(2)表示正向翻折的示意图，图3-4中(2)表示反向翻折的示意图。折叠屏设备可以确定当前是正向翻折还是反向翻折。
正向翻折或反向翻折都可以使得折叠屏实现半展开状态。对于正向翻折场景下的半展开状态，两个相邻子屏上具有显示功能的那一面之间的夹角大于0°且小于180°。对于反向翻折场景下的半展开状态，两个相邻子屏上不具有显示功能的那一面之间的夹角大于0°且小于180°。
数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理其他数字信号。例如，当电子设备100在频点选择时，数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样，电子设备100可以播放或录制多种编码格式的视频，例如：动态图像专家组(moving picture experts group，MPEG)1，MPEG2，MPEG3，MPEG4等。
NPU为神经网络(neural-network，NN)计算处理器，通过借鉴生物神经网络结构，例如借鉴人脑神经元之间传递模式，对输入信息快速处理，还可以不断的自学习。通过NPU可以实现电子设备100的智能认知等应用，例如：图像识别，人脸识别，语音识别，文本理解等。
在一些实施例中，NPU利用图像识别技术，识别摄像头193采集到的图像中是否包含人脸图像。进一步的，NPU还可以根据人脸图像，判断用户身份是否合法，从而确认是否解锁屏幕。
外部存储器接口120可以用于连接外部存储卡，例如Micro SD卡，实现扩展 电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信，实现数据存储功能。例如将音乐，视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令，和/或存储在设置于处理器中的存储器的指令，执行电子设备100的各种功能应用以及数据处理。
电子设备100可以通过音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，以及应用处理器等实现音频功能。例如音乐播放，录音等。
音频模块170用于将数字音频数据转换成模拟音频电信号输出，也用于将模拟音频电信号输入转换为数字音频数据，音频模块170可以包括模/数转换器和数/模转换器。例如，音频模块170用于将麦克风170C输出的模拟音频电信号转换为数字音频数据。音频模块170还可以用于对音频数据进行编码和解码。在一些实施例中，音频模块170可以设置于处理器110中，或将音频模块170的部分功能模块设置于处理器110中。
扬声器170A，也称“喇叭”，用于将模拟音频电信号转换为声音信号。电子设备100可以通过扬声器170A收听音乐，或收听免提通话。
受话器170B，也称“听筒”，用于将模拟音频电信号转换成声音信号。当电子设备100接听电话或语音信息时，可以通过将受话器170B靠近人耳接听语音。
麦克风170C，也称“话筒”，“传声器”，用于将声音信号转换为模拟音频电信号。当拨打电话或发送语音信息时，用户可以通过人嘴靠近麦克风170C发声，将声音信号输入到麦克风170C。其中，该麦克风170C可以是电子设备100的内置部件，也可以是电子设备100的外接配件。
在一些实施例中，电子设备100可以包括一个或多个麦克风170C，其中每一麦克风或多个麦克风合作可以实现采集各个方向的声音信号，并将采集到的声音信号转换为模拟音频电信号的功能，还可以实现降噪，识别声音来源，或定向录音功能等。
其中传感器模块180可以包括压力传感器180A，陀螺仪传感器180B，气压传感器180C，磁传感器180D，加速度传感器180E，距离传感器180F，接近光传感器180G，指纹传感器180H，温度传感器180J，触摸传感器180K，环境光传感器180L，骨传导传感器180M等。
其中，陀螺仪传感器180B，可以用于确定电子设备100的运动姿态。在一些实施例中，可以通过陀螺仪传感器180B确定电子设备100围绕三个轴(即，x，y和z轴)的角速度。陀螺仪传感器180B可以用于拍摄防抖。示例性的，当按下快门，陀螺仪传感器180B检测电子设备100抖动的角度，根据角度计算出镜头模组需要补偿的距离，让镜头通过反向运动抵消电子设备100的抖动，实现防抖。陀螺仪传感器180B还可以用于导航，体感游戏场景。
在本申请的实施例中，每个子屏都可以设置有陀螺仪传感器180B，用于测量所在子屏的朝向(即朝向的方向向量)。例如，在图3-3中(2)所示的电子设备中，子屏041和子屏042中均包括陀螺仪传感器180B，分别用于测量子屏041和子屏042的朝向。电子设备根据每个子屏的朝向的角度变化，可以确定相邻子屏 之间的夹角。
示例性的，以电子设备100为图3-1所示的折叠屏设备为例。电子设备100的折叠屏可折叠形成图4中(1)所示的子屏061和子屏062。子屏061中设置有陀螺仪传感器1，子屏062中设置有陀螺仪传感器2。
其中，陀螺仪传感器的坐标系比如可以但不限于是地理坐标系。如图4中(2)所示，地理坐标系的原点O位于运载体(即包含陀螺仪传感器的设备，如电子设备100)所在的点，x轴沿当地纬线指向东(E)，y轴沿当地子午线线指向北(N)，z轴沿当地地理垂线指向上，并与x轴和y轴构成右手直角坐标系。其中，x轴与y轴构成的平面即为当地水平面，y轴与z轴构成的平面即为当地子午面。因此，可以理解的是，陀螺仪传感器的坐标系是：以陀螺仪传感器为原点O，沿当地纬线指向东为x轴，沿当地子午线线指向北为y轴，沿当地地理垂线指向上(即地理垂线的反方向)为z轴。
电子设备100利用每个子屏中设置的陀螺仪传感器，便可测量得到每个子屏在其设置的陀螺仪传感器的坐标系中的朝向的方向向量。例如，参考如图4中(1)所示的电子设备的侧视图，电子设备测量得到的子屏061在陀螺仪传感器1的坐标系中的朝向的方向向量为向量z1，子屏062在陀螺仪传感器2的坐标系中的朝向的方向向量为向量z2。电子设备可根据向量z1和z2求取出向量z1与向量z2的夹角θ。
又根据图4可知，由于向量z1与子屏061垂直，向量z2与子屏062垂直，因此，可以得到子屏061与子屏062的夹角φ＝180°-θ。即电子设备根据测量得到的子屏061在陀螺仪传感器1的坐标系中的朝向的方向向量(即向量z1)和子屏062在陀螺仪传感器2的坐标系中的朝向的方向向量(即向量z2)，便可确定出子屏061与子屏062的夹角φ。当夹角φ大于0°且小于180°时，电子设备当前为正向翻折对应的半展开状态。当夹角φ大于180°且小于360°时，电子设备当前为反向翻折对应的半展开状态。
需要说明的是，虽然子屏061和子屏062中设置的陀螺仪传感器的位置并不重叠，即子屏061和子屏062的陀螺仪传感器的坐标系的原点并不重叠，但是，两个坐标系的x轴、y轴、z轴是平行的，从而可以认为子屏061和子屏062中设置的陀螺仪传感器的坐标系是平行的。这样一来，虽然向量z1和向量z2不在同一个坐标系，但是因为两个坐标系的各轴平行，因此，仍可通过上述公式(1)计算向量z1与向量z2的夹角θ。
在一些实施例中，还可以由其他一个或多个传感器配合，测量子屏061与子屏062的夹角α。例如，折叠屏的每个子屏中均可设置一个加速度传感器。电子设备100(如处理器110)可利用加速度传感器测量每个子屏被转动时的运动加速度；然后根据测量得到的运动加速度计算一个屏相对于另一个屏转动的角度，即子屏061与子屏062的夹角φ。
在另一些实施例中，上述陀螺仪传感器可以是由其他多个传感器配合形成的虚拟陀螺仪传感器。该虚拟陀螺仪传感器可用于计算折叠屏的相邻子屏的夹角，即子屏061与子屏062的夹角φ。
此外，在本申请的实施例中，陀螺仪传感器180B、加速度传感器180E等传感器还可以用于确定各子屏的状态，从而确定折叠屏当前为正向翻折状态，还是反向翻折状态。
例如，子屏上的陀螺仪传感器180B，可以测得子屏翻折时的角速度，对角速度进行积分可以得到子屏相对于特定坐标系(例如地理坐标系)的夹角，从而可以得到子屏的姿态。根据子屏的姿态可以获知子屏的朝向。根据各子屏的朝向，可以获知折叠屏当前是正向翻折状态或反向翻折状态。
距离传感器180F，用于测量距离。电子设备100可以通过红外或激光测量距离。在一些实施例中，在拍摄场景下，电子设备100可以利用距离传感器180F测距以实现快速对焦。
触摸传感器180K，也称“触控面板”。触摸传感器180K可以设置于显示屏194，由触摸传感器180K与显示屏194组成触摸屏，也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。
可以理解的是，本申请实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中，电子设备100可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
电子设备100的软件系统可以采用分层架构，事件驱动架构，微核架构，微服务架构，或云架构。本发明实施例以分层架构的Android系统为例，示例性说明电子设备100的软件结构。
图5是本发明实施例的电子设备100的软件结构框图。
分层架构将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中，将电子设备的操作系统(例如Android系统)分为四层，从下至上分别为内核层，硬件抽象层(hardware abstract layer，HAL)，应用程序框架层，以及应用程序层。
内核层是硬件和软件之间的层。内核层至少包含摄像头驱动，音频驱动，显示驱动，传感器驱动。传感器驱动包括但不限于图像传感器驱动、声敏传感器。
在一些实施例中，比如在人脸识别场景中，内核层的诸如摄像头驱动被调用以开启摄像头。再比如，通过图像传感器驱动调用图像传感器完成图像采集。
硬件抽象层(hardware abstract layer，HAL)位于内核层和应用程序框架层之间，用于定义驱动应用程序硬件实现的接口，将驱动硬件实现的值转化为软件实现程序语言。例如识别摄像头驱动的值，将其转化为软件程序语言上传至应用程序框架层，进而实现调用相应功能。
在一些实施例中，HAL可以将摄像头193采集到的人脸图像上传至应用程序框架层进行进一步的处理。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface，API)和编程框架。应用程序框架层从内核层经由HAL获取原始输入事件，识别该输入事件所对应的控件。应用程序框架层包括一些预先定义的函数。
如图5所示，应用程序框架层可以包括视图系统，电话管理器，资源管理器，通知管理器，窗口管理器等。
在一些实施例中，应用框架层包括第一模块。第一模块用于根据用户的解锁意图，调用相应显示驱动进行屏幕显示。比如，当确定用户想要解锁外屏，则第一模块调用外屏的显示驱动，从而在外屏显示解锁后的界面。
可选的，第一模块还可以是设置在其他层中，并且，第一模块还可以划分为更多子模块。每个子模块用于执行相应功能。
视图系统包括可视控件，例如显示文字的控件，显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如，包括短信通知图标的显示界面，可以包括显示文字的视图以及显示图片的视图。
电话管理器用于提供电子设备100的通信功能。例如通话状态的管理(包括接通，挂断等)。
资源管理器为应用程序提供各种资源，比如本地化字符串，图标，图片，布局文件，视频文件等等。
通知管理器使应用程序可以在状态栏中显示通知信息，可以用于传达告知类型的消息，可以短暂停留后自动消失，无需用户交互。比如通知管理器被用于告知下载完成，消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知，例如后台运行的应用程序的通知，还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息，发出提示音，电子设备振动，指示灯闪烁等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕等。
应用程序层可以包括一系列应用程序包。
如图5所示，应用程序包可以包括相机，视频，通话，WLAN，音乐，短信息，蓝牙，地图，日历，图库，导航等应用程序。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理，堆栈管理，线程管理，安全和异常的管理，以及垃圾回收等功能。
本申请实施例提供的解锁方法可以适用于诸如但不限于接收消息、播放音乐、支付、拍照等场景，以下将以电子设备为具有图1和图5所示结构的手机为例，分场景对本申请实施例提供的解锁方法进行阐述。
用户在使用折叠屏设备时，可以通过外屏或内屏与手机交互。在不同的使用场景下，内屏和外屏的角色可能有变化。比如，在如图3-3所示的正向翻折使用场景下，内屏可以是041子屏和042子屏，外屏可以是折叠屏的背面中设置的屏幕。再比如，在如图3-4所示的反向翻折使用场景下，外屏可以是子屏044和子屏045，内屏可以使折叠屏背面中设置的屏幕。也就是说，使用场景等并不对内屏、外屏构成限制。
本申请实施例中，在获取用户的解锁意图时，手机可借助外屏具有关联的传感器来采集用户的身份信息，并根据该身份信息识别用户身份。当终端确定用户身份 合法，且检测到终端满足使用第一屏幕的条件时，说明用户解锁终端屏幕时希望解锁第一屏幕，那么，终端可以智能、便捷的为用户自动解锁第一屏幕。可见，本申请实施例的技术方案，无需用户完全展开手机即可对用户身份进行识别，能够加快解锁进度，提高终端与用户之间的交互效率。并且，在用户希望解锁第一屏幕时，能够智能的解锁第一屏幕，能够进一步提高终端与用户之间的交互效率。
以用户主动解锁手机为例，示例性的，以采用人脸解锁方式解锁手机为例，如图6中(1)所示，手机处于折叠状态(且锁屏)。用户可以通过诸如双击屏幕触发手机调用外屏摄像头中的图像传感器采集用户的人脸图像，根据人脸图像对用户进行人脸识别，进而识别用户的身份，并根据用户身份判断是否解锁屏幕。或者，当用户有解锁意图时，用户可以不必双击屏幕，而是通过诸如抬起手机的操作触发手机调用外屏摄像头的图像传感器采集用户的人脸图像。本申请实施例对触发手机调用外屏摄像头的图像传感器采集用户人脸图像的条件不做限制。
可选的，在人脸识别过程中，手机可显示诸如图6中(2)所示文本“人脸识别中…”，以提示用户正在进行人脸识别。
在一些情况下，当确定外屏摄像头采集的人脸图像为正确的人脸图像，且手机处于折叠状态，说明用户很可能是想要解锁外屏，则手机解锁外屏。如此，用户可以通过外屏与手机交互。可选的，手机解锁外屏后显示诸如图6中(3)所示界面，该界面可以是锁屏前手机显示的界面或者可以是主(home)界面或其他界面。本申请实施例对解锁屏幕后呈现的界面不进行限制。可见，本申请实施例的解锁方法，手机在无需展开的情况下就可以完成解锁。之后，用户可以根据需要，展开手机使用，或者在折叠状态下使用手机。
在另一些情况下，当手机确定外屏摄像头采集的人脸图像为正确的人脸图像，且手机不是处于折叠状态，则说明用户的本次很可能是想要解锁内屏，此种情况下，手机解锁内屏。如此，用户可以通过内屏与手机交互。可选的，手机解锁内屏后显示诸如图6中(4)所示界面(比如锁屏前显示的界面)。可以看出，与现有技术中需将手机展开到较大角度才开始调用内屏摄像头进行人脸识别，人脸解锁用时较长，解锁效率较低相比，本申请实施例提供的解锁方式，当手机被展开较小角度时，即可解锁内屏，缩短了解锁用时，使得用户能较快的使用内屏。
此外，在用户需要进行安全性要求较高的操作，比如查看机密文档的场景中，由于仅需将手机展开较小角度就能解锁查看文档，那么，可以避免将手机展开到较大角度才能解锁查看文档，导致安全性较低的问题。
可选的，后续，用户还可以将手机完全展开，并在如图6中(5)所示的展开状态下使用手机。
可选的，手机可以开启多任务处理功能。开启多任务处理功能后，用户可在界面中同时开启多个应用，或者，显示同一应用的不同界面。用户可以在多个应用间进行切换使用，或在不同功能之间进行切换使用。
比如，以图6中(5)所示，手机内屏除了显示来自Sara的微信消息，还可以显示诸如联系人列表等信息，方便用户在同屏上同时查看联系人和新消息。
再比如，以图8-3中(3)所示界面为例，该界面除了包括邮件的详情之外， 还可以以分屏方式显示一段时间内的邮件列表，方便用户浏览不同邮件的概况。
可选的，不同应用或应用组合的分屏情况可以不同。具体的分屏情况可以由系统或用户设置。
需要说明的是，图6中是以手机在6中(2)之后被用户展开为例对本申请实施例的解锁方法进行说明。手机被用户展开的时机还可以是其他时机，比如，在6中(1)和(2)所示时机之间，手机被用户展开。
在一些实施例中，将用户的双击屏幕、抬起手机、语音“解锁”等(用于触发手机执行人脸解锁等)操作称为解锁操作，用户通过解锁操作向手机输入的指令称为解锁指令。如图7示出了在检测到用户输入的解锁指令的情况下，本申请实施例提供的一种解锁方法的流程图。该方法应用在电子设备中，电子设备包括屏幕折叠状态下形成的屏幕1和屏幕2，以屏幕1(比如第二图6中(4)所示的屏幕1)是内屏、屏幕2(比如图6中(3)所示的屏幕2)是外屏为例，如图7所示，该方法包括：
S101、手机获取解锁意图。
解锁意图可以是用户输入的解锁指令，用户通过解锁操作向手机输入解锁指令，用于表示用户有解锁手机屏幕的意图。比如，用户可通过双击图6中(2)所示屏幕界面，输入解锁指令。再比如，用户可通过语音等方式输入解锁指令。
或者，解锁意图也可以是手机自己感知并确定的解锁意图。比如，当用户抬起手机时，手机可初步确定用户有解锁意图。
本申请实施例对解锁指令的具体类型和实现方式不进行限制。
S102、响应于该解锁意图，手机调用外屏关联的第二采集部件采集用户输入的身份信息。
可选的，响应于用户的解锁意图，手机可采用一种或多种解锁方式进行解锁。解锁方式包括但不限于如下一种或多种：人脸解锁、指纹解锁、图案解锁、密码解锁、声纹解锁。其中，人脸解锁方式解锁的方式包括但不限于三基色(red,green,blue，RGB)人脸解锁、红外人脸解锁、3D结构光人脸解锁。相应的，每种解锁方式下可以对应一种或多种可用于采集用户身份信息的采集部件。
可选的，用于解锁的采集部件可以包括用于采集用户身份信息的采集部件。用户身份信息用于表征用户身份，当用户身份信息正确时，手机解锁屏幕。身份信息包括但不限于用户的人脸图像、指纹信息、声纹信息、输入的图案信息、输入的密码信息。
比如，当解锁方式是人脸解锁时，用于解锁的采集部件可以是图像采集部件，如摄像头。图像采集部件包括但不限于图像传感器。图像传感器比如可以但不限于是互补型金属氧化物半导体(complementary metal-oxide-semiconductor，CMOS)传感器等。
当解锁方式是指纹解锁，可用于解锁的采集部件可以是指纹采集部件，包括诸如用于采集指纹信息的指纹传感器。指纹传感器可以采用任何类型的感测技术，包括但不限于光学式、电容式、压电式或超声波传感技术等。
当解锁方式是声纹解锁时，可用于解锁的采集部件可以是声纹采集部件，比 如声敏传感器。
可选的，用于解锁的采集部件还可以是触摸板(touch panel)等。
本申请实施例中，当检测到用户的解锁指令，手机调用外屏关联的第二采集部件(比如图像传感器)采集用户输入的身份信息或用于验证身份的信息。外屏关联的第二采集部件比如可以但不限于为外屏关联的图像传感器、外屏关联的指纹传感器等。
示例性的，当设置的解锁方式是人脸解锁，手机调用外屏关联的摄像头采集用户的人脸图像。
需要说明的是，本申请实施例主要以通过外屏关联的摄像头采集人脸图像，从而进行用户身份识别为例进行说明，但本申请实施例的用户身份识别方法不限于此，在此予以统一说明。
S103、手机根据外屏关联的第二采集部件采集的身份信息识别用户的身份。
以手机外屏关联的用于采集身份信息的第二采集部件为图像传感器为例，作为一种可能的实现方式，外屏的图像传感器将采集的人脸图像传递给手机处理器，手机将该人脸图像与预先存储的目标人脸图像进行比较，以识别用户的身份是否合法。
S104、若用户的身份合法，且电子设备满足使用内屏的条件，则手机解锁内屏。
其中，使用第一屏幕的条件包括如下一项或多项条件的组合：当前时间在预设时段内、当前位置在预设地理位置范围内、接收到新消息且新消息是预设应用的消息、电子设备处于非折叠状态、解锁指令是预设解锁指令；预设解锁指令包括如下任一项或多项的组合：预设的用于解锁第一屏幕的手势、图案、数字、指纹。
以使用第一屏幕的条件为电子设备处于非折叠状态为例，手机可以检测折叠屏是否处于折叠状态。
作为一种可能的实现方式，手机通过检测折叠屏的第一子屏和第二子屏之间的夹角，来检测手机是否处于折叠状态。示例性的，手机检测图3-1中(d)所示的子屏A与子屏B之间的夹角，并依此确定手机是否处于折叠状态。
可选的，第一子屏和第二子屏均设置有陀螺仪，用于测量所在子屏的朝向(方向向量)。手机根据陀螺仪的测量结果确定第一子屏和第二子屏之间的夹角。
可选的，手机可以周期性检测手机的折叠状态，或者，按照事件触发检测手机是否处于折叠状态。比如，当检测到用户输入的解锁指令时，触发手机检测折叠屏是否处于折叠状态。本申请实施例对触发检测折叠屏是否处于折叠状态的触发条件不做限制。
手机可以根据折叠屏是否处于折叠状态确定用户是想要解锁内屏或外屏。可选的，当手机的折叠状态由折叠状态转变为非折叠状态，手机执行S104，以便解锁内屏，当手机的折叠状态为折叠状态，手机执行S105以便解锁外屏。
可以理解，当手机检测到手机的折叠状态由折叠转改转变为非折叠状态，则说明用户很可能是想展开手机，通过内屏与手机交互，那么，手机解锁内屏，以满足用户的使用需求。可选地，折叠屏幕在非折叠状态下展开至何种程度以识别 并确定用户当前意图为解锁内屏，可以根据需要实际设置。
S105、若用户的身份合法，且电子设备不满足使用内屏的条件，则手机解锁外屏。
示例性的，如图6中(3)所示，当确定用户的身份合法，且电子设备处于折叠状态，说明用户想要为解锁外屏，则手机解锁外屏。
如下结合具体场景对本申请实施例提供的解锁方法进行说明。
1、接收新消息
如图8-1中(1)所示，手机处于折叠且锁屏状态之后，手机接收微信的2个通知消息。
可选的，解锁之前不显示消息的详细内容(比如显示消息的部分信息，比如消息个数等)，解锁之后显示消息的详细内容。
在一些实施例中，手机在锁屏状态下接收新的消息，可触发手机显示图8-1中(2)所示的消息提醒界面401，用于提示用户接收到新消息。
可选的，消息提醒界面401可以不显示诸如消息内容，发送方等信息，仅显示诸如接收的新消息所属的应用，以及新消息条数等不涉及隐私数据的信息，以降低用户隐私泄露的概率。
或者，可选的，消息提醒界面401可以显示发送方，不显示消息的具体内容等信息，以便于在用户了解发送方的情况下选择是否解锁手机，查看该消息，同时由于不显示消息的具体内容，可以尽可能降低隐私泄露的概率。
或者，可选的，消息提醒界面401可以显示消息的大部分信息，包括但不限于消息内容，发送方等。可选的，接收的消息所属应用为预设类型应用。预设类型应用比如包括但不限于安全要求较低的应用。安全要求较低的应用比如可以是不涉及用户隐私信息，或涉及较少的用户隐私信息的应用。安全要求较低的应用可以是系统默认的低安全要求应用(比如不读取用户电话号码，位置等信息的应用)，或者是用户设置的应用。
可选的，不同应用程序的消息提醒界面可以包括不同信息。作为一种可能的实现方式，对于一些私密应用的消息，手机在提示用户接收到新消息时，抹去其中的私密信息。对于非私密应用的消息，手机在提示用户接收到新消息时，可以显示消息对应的大部分信息。比如，对于电话应用，可设置部分联系人的来电信息不可见。如此，当该部分联系人来电或给该部分联系人打电话时，在通话等界面不显示该部分联系人的一些信息，包括但不限于如下信息中的一项或多项：联系人的电话号码，联系人的姓名。再有，在通话记录中也可以不显示给部分联系人的一些信息，包括但不限于如下一项或多项信息：联系人的电话号码、通话时长、联系人的号码所属地、呼入或呼出状态、通话日期。或者，在通话记录中隐藏这部分联系人的通话记录。
本申请实施例对消息提醒界面401的具体显示内容不做限制。
在手机接收到新消息的场景中，若用户有解锁意图，则可以通过诸如双击屏幕点亮屏幕，并触发手机调用外屏的摄像头采集用户的人脸图像，对用户进行人脸识别，进而识别用户的身份，并根据用户身份判断是否解锁屏幕。或者，当用 户有解锁意图时，用户可以不必双击屏幕，而是通过诸如抬起手机的操作触发手机亮屏，并调用外屏摄像头采集用户的人脸图像。本申请实施例对触发手机调用外屏摄像头采集用户人脸图像的条件不做限制。
在另一些实施例中，手机在锁屏状态下接收新的消息，并不触发手机显示诸如图8-1中(2)所示的消息提醒界面401，而是通过其他方式(比如非界面方式)提醒用户接收到新消息。比如，手机指示灯闪烁，手机震动、响铃等。此种情况下，手机屏幕可仍处于黑屏状态。当用户有解锁意图时，用户可以通过诸如按压电源键，或抬起手机，或双击屏幕等操作触发手机亮屏，并调用外屏摄像头采集用户的人脸图像,进而对用户进行身份认证。可选的，在身份认证过程中，手机可显示诸如图8-1中(3)所示界面，以便提示用户手机正在进行身份识别。
在另一些实施例中，手机可以采取多种方式提示用户接收到新的消息，比如，指示灯闪烁，且震动，且显示图8-1中(2)所示消息提醒界面。本申请实施例并不限制手机提示新消息的方式。
当确定外屏摄像头采集的人脸图像为正确的人脸图像，且手机处于折叠状态，说明用户很可能是想要解锁外屏，则手机解锁外屏。如此，用户可以通过外屏与手机交互。比如，通过外屏读取接收的微信通知，回复微信消息等。可选的，手机解锁外屏后显示诸如图8-1中(4)所示的新消息的相关界面，该界面包括诸如消息详情。
当手机确定外屏摄像头采集的人脸图像为正确的人脸图像，且手机不是处于折叠状态，则说明用户的本次很可能是想要解锁内屏，此种情况下，手机解锁内屏。如此，用户可以通过内屏与手机交互，比如，通过内屏读取具体的微信通知内容，回复微信消息等。
在一些情况下，若用户在图8-1中(2)所示界面执行诸如点击控件402的操作，则手机解锁内屏后可以显示诸如图8-1中(5)所示的新消息的相关界面。如果用户没有点击控件402，则手机解锁内屏后可进入桌面或前一次退出的应用界面，或者显示其他界面。
在另一些情况下，考虑到用户可能并不方便输入新消息的相关操作指令，手机可以基于用户的解锁需求和解锁时机(比如在接收新消息后)确定用户的解锁意图是诸如查看新消息，并在解锁屏幕后显示新消息的相关界面。
本申请实施例中，新消息的相关界面，可以是包括消息详情的界面。消息详情包括但不限于如下一项或多项：消息内容，发送方，发送方头像，发送时间等。
在一些实施例中，响应于用户对新消息的操作指令(比如但不限于对新消息的点击等操作)，手机在解锁屏幕后显示新消息的相关界面。该显示界面的方式可应用在内屏或外屏中的一个或多个。若用户没有对新消息进行操作，则可以显示桌面或前一次的应用界面。
示例性的，如图8-1中(2)所示，当用户希望查看微信的2个消息通知时，可以点击控件402，触发手机在解锁屏幕后显示图8-1中(4)所示的微信消息界面。
在另一些实施例中，用户可能并不方便输入新消息的相关操作指令，比如并 未点击图8-1中(2)所示控件402，此种情况下，考虑到将新消息及时提示给用户或其他因素，即便手机并未检测到用户对新消息的操作指令，手机也可以在解锁屏幕后显示新消息的相关界面。该显示界面的方法可应用在内屏或外屏中的一个或多个。
示例性的，仍参见图8-1中(1)和图8-1中(2)所示，手机在锁屏状态下接收新消息，并可选的显示消息提醒界面401。用户希望查看微信的2个通知，则可以抬起手机(用户并未点击控件402)。手机识别出用户抬起手机的操作，判断用户当前期望解锁手机，又因为用户是在手机接收微信通知消息后解锁手机，则手机确定用户的使用意图是查看微信的通知消息。因此，手机在抬起手机的过程中，调用外屏摄像头完成人脸识别，并根据人脸识别结果解锁屏幕，并显示图8-1中(4)的微信消息界面。
可以看出，在用户不方便对新消息进行操作的一些场景中，手机可以基于用户的解锁需求和解锁时机(比如在接收新消息后)确定用户的解锁意图是诸如查看新消息，并在解锁屏幕后显示新消息的相关界面，如此，能够提升用户与手机的交互体验。
2、支付场景
在一些场景中，如图9-1中(1)所示，手机处于锁屏状态，用户需要完成身份认证，以便进行支付。如图9-1中(2)所示，手机通过外屏摄像头采集的人脸图像，以判断用户身份是否合法。若确定用户身份合法，且用户并未展开手机，那么，手机判断用户解锁的目的是解锁外屏，则手机解锁外屏，并可以显示诸如图9-1中(3)所示界面。
在一些实施例中，为了用户使用便捷，手机可以将应用程序的某一项或多项功能以诸如功能的快捷图标形式显示在桌面上。后续，用户可以通过操作功能快捷图标，快捷使用相应功能。
比如，如图9-1中(3)所示，手机解锁外屏后，显示钱包应用程序的收款功能的快捷图标，用户可以通过操作该快捷图标(比如点击该快捷图标)，触发手机显示图9-1中(4)所示的付款二维码。后续，用户可以使用付款二维码进行支付。
在另一些场景中，用户可以选择借助手机内屏完成支付操作。如图9-1中(1)和(2)所示，用户通过人脸识别方式解锁手机，当手机确定用户身份合法，且手机不是折叠状态，说明用户本次解锁是想要解锁内屏，则手机解锁内屏，并可以显示图9-1中(5)所示界面。该界面包括钱包应用的图标(或者包括诸如付款功能的图标)。后续，用户可以通过诸如点击钱包图标的操作使用钱包应用的某一项或多项功能(比如收付款功能)。可选的，用户还可以选择将手机展开成其他角度，比如完全展开进行使用。示例性的，响应于用户点击图9-1中(5)所示钱包应用的图标，手机进入钱包应用的界面。响应于用户在钱包应用界面中选择使用收付款功能的操作，手机可显示图9-1中(6)所示的收付款功能界面。
可选的，本申请实施例的支付场景中，支付方式包括但不限于二维码支付，近场通信(near field communication，NFC)支付、条码支付。
以NFC支付为例，如图9-2中(1)所示，手机在折叠状态(且锁屏状态)下接触NFC公交卡，并显示诸如图9-2中(2)所示界面。用户可以通过诸如点击“充值”选项的操作，触发手机验证用户身份。可选的，手机调用外屏摄像头进行人脸识别，并可以显示诸如图9-2中(3)所示界面。在手机确定用户身份合法，且手机处于折叠状态，说明用户是想要解锁外屏，则手机解锁外屏，并可以显示诸如图9-2中(4)所示界面，用户可以通过该界面选择相应充值金额进行充值。
3、拍照场景
如图10中(1)所示，手机处于折叠状态(锁屏)。用户可以对手机进行一些操作，以触发手机开启相机应用。比如，用户按下电源键点亮外屏，触发手机通过外屏显示诸如图10中(2)所示的相机应用图标，用户可以采用诸如单击相机应用图标的操作，触发手机开启相机应用。如图10中(3)所示，手机开启相机应用，并进入相机应用的界面。该界面可包括图库控件、拍照控件、摄像头切换控件。
需要说明的是，在外屏未解锁的情况下，可以设置为相机应用中的部分功能可用，部分功能不可用。
示例性的，用户可通过诸如点击拍照控件触发手机拍照，即在外屏未解锁的情况下，相机应用中的拍照功能可用。
再示例性的，用户可通过诸如点击摄像头切换控件来切换前置摄像头或后置摄像头，即在外屏未解锁的情况下，相机应用的切换摄像头功能可用。
可选的，用户可通过诸如点击来尝试进入图库。此种场景中，可选的，为了泄露手机图库中某些私密图片，手机可通过图库仅向用户显示本次拍照生成的图片，那么，用户仅可通过图库查看本次开启相机应用后，其通过操作拍照控件拍摄的图片。换言之，在外屏没有解锁的情况下，只有权限浏览在未解锁状态下拍摄的照片。
可选的，在外屏未解锁的情况下，在关闭相机应用或锁屏后，图库中存储的图片被删除。
仍沿用上述举例，在手机显示如图10中(3)所示界面后，用户可以通过诸如点击图库控件的操作，触发手机显示图10中(4)所示的图库中的图片。可选的，10中(4)所示界面可包括图库控件。为了提升手机图库中私密图片的安全性，当检测到用户的诸如点击图库控件2的操作，手机可提示用户解锁。比如，手机可显示诸如图10中(5)所示提示界面。当手机检测到用户的解锁操作，比如检测到用户点击屏幕，手机调用外屏摄像头采集用户的人脸图像，以便识别用户身份。若检测到用户身份合法，且手机处于非折叠状态，则手机解锁内屏，并可显示诸如图10中(6)所示图库界面，以供用户浏览查看。图库界面可包括手机中的一张或多张图片。反之，若检测到用户身份合法，且手机处于折叠状态，则手机解锁外屏，并可显示图10中(7)所示图库界面。
需要说明的是，图10所示的解锁流程，仅为一个示例。其中的触发开启相机的条件，用户操作图库控件触发手机的实际响应等，可以有其他实现方式，本申请实施例不做限制。比如，当检测到用户的诸如触摸图库控件1的操作，且本次 开启相机应用后拍摄了图片，则手机显示用户本次拍摄的图片。并且，响应于用户的诸如左右滑动操作，手机可以在本次拍摄的多张图片中进行切换显示。当检测到用户触摸图库控件1，且本次开启相机应用后并未拍摄照片，则手机提示用户解锁，以便查看手机图库。
4、音乐播放场景
如图11中(1)所示，手机处于折叠状态，并在后台播放音乐。用户可以通过诸如点击屏幕或按下电源键等方式点亮外屏。可选的，在后台播放音乐且未解锁的情况下，手机亮屏后可显示诸如图11中(2)所示界面。可选的，该界面可包括控件406。
可选的，在未解锁的情况下，用户就不可以在外屏界面上操作和音乐相关的操作，比如，不可以切换歌曲，不可以控制歌曲的暂停、播放。
或者，可选的，在未解锁的情况下，为了减少用户解锁的频率，手机可以执行音乐应用的部分功能。比如，用户可通过控件406实现歌曲的切换，歌曲的暂停、播放等。可选的，对于一些其他功能，手机不予支持。比如，用户不能通过控件406实现收藏音乐等功能。
响应于用户输入的解锁操作，比如双击屏幕，手机调用外屏摄像头采集人脸图像，进而根据采集的人脸图像进行人脸识别，判断用户身份是否合法。可选的，在人脸识别过程中，手机可显示诸如图11中(3)所示界面。
当确定用户身份合法，且手机处于非折叠状态，则手机解锁内屏。可选的，如果用户通过诸如图11中(2)所示界面对诸如控件406进行了操作(比如点击控件406)，那么，手机解锁内屏后显示诸如图11中(4)所示的音乐应用的界面。如果用户没有对控件406进行操作，那么，手机解锁内屏后，内屏可以进入桌面或最近一次显示的应用界面。
反之，当确定用户身份合法，且手机处于折叠状态，则手机解锁外屏。可选的，手机解锁外屏后显示诸如图11中(5)所示的音乐应用的界面。
图11主要以用户通过双击音乐控件406触发人脸解锁，手机解锁后显示音乐相关界面为例，在另一些实施例中，用户还可以不对音乐控件406进行操作，而是通过其他方式，比如，通过手指在图11中(2)所示界面中进行滑动，触发手机进行人脸解锁。这种情况下，手机解锁后可以进入主界面或手机最近一次显示的界面。
在一些实施例中，在一些实施例中，手机可以在人脸识别成功后直接解锁。以接收新消息为例，比如，仍参见图8-1中(3)和(4)，手机在人脸识别成功后，若确定手机处于折叠状态，则直接解锁外屏。
在另一些实施例中，手机也可以在人脸识别成功后，基于用户输入的解锁操作(比如滑动屏幕的操作)解锁。仍以接收新消息为例，比如，参见图8-2中(1)和(2)，手机响应于用户的解锁需求，进行人脸识别。在人脸识别成功后，手机可显示诸如图8-2中(3)所示界面。当检测到用户输入的上划操作，且检测到手机处于折叠状态，则手机解锁外屏，并可显示诸如图8-2中(4)所示解锁界面。当检测到用户输入的上划操作，且检测到手机处于非折叠状态，则手机解锁内屏， 并可显示诸如图8-2中(5)所示解锁界面。
上述实施例主要以通过判断手机是否为折叠状态判断用户是想要解锁外屏或内屏为例进行举例说明，在另一些实施例中，手机不仅判断手机是否处于折叠状态，还可以判断手机的具体展开角度，当确定手机的展开角度在预设范围内，手机解锁内屏。预设范围可以根据实际应用另行设置，本申请实施例对此不限制。
在另一些实施例中，除了判断手机的叠折状态，还可以设置其他判断条件，以便手机更准确的判断用户想要解锁内屏还是外屏。可选的，其他判断条件包括但不限于如下一项或多项条件：当前时间在预设时段内、当前位置在预设地理位置范围内、新消息是预设应用的消息、检测到预设的解锁操作。
预设应用包括但不限于办公类应用。示例性的，办公类应用比如可以是邮箱(企业邮箱、私人邮箱等)，及时通信应用(比如企业版微信，普通个人版的微信等)。
预设的解锁操作可以是预设的解锁手势，解锁图案等用于解锁内屏的操作。预设的解锁操作可以由系统或用户设置。
可选的，在检测到满足上述条件中的一项或多项，手机可解锁内屏。
示例性的，手机可以获取用户画像，或者采集用于反映用户行为特征的行为数据，确定用户在不同时间、不同地点或不同场景下解锁屏幕时是想要解锁外屏还是内屏。进而，用户在相应的时间、地点或场景下解锁终端屏幕时，终端可以根据用户当前是想要解锁内屏还是外屏，实现用户与终端之间的高效互动。
其中，上述用户画像中通常包括用户的一个或多个标签(例如性别、熬夜习惯、阅读偏好等)，该用户画像可反映出用户的信息全貌，终端可以通过用户画像预测用户当前可能的行为或喜好。
示例性的，用户的用户画像中指示该用户是一个具有睡前娱乐习惯(比如睡前打游戏)的人，且该用户的睡眠时间为23:00-7:30。那么，终端根据该用户画像可以将用户在22:00-23:00之间(睡前)解锁终端时的解锁目的确定为解锁内屏，并使用游戏应用B。因此，如果在22:00-23:00之间检测到用户向终端输入正确的身份认证信息(比如正确的人脸信息)，则终端解锁内屏，并可以自动打开游戏应用B。
示例性的，用户的用户画像中指示该用户在家使用手机时，通常是使用内屏，用户在地铁等公共场所通常使用外屏。那么，终端根据用户授权后的该用户画像可以将用户在家解锁手机时的解锁目的确定为解锁内屏。因此，如果检测到用户位置在家，且用户向终端输入正确的身份认证信息，则终端解锁内屏。如果检测到用户位置在诸如地铁等公共场所，且用户向终端输入正确的身份认证信息，则终端解锁外屏。
本申请实施例中，可以为外屏和内屏设置不同的解锁指令。其中，预设解锁指令为用于解锁内屏的解锁指令，预设解锁指令包括如下任一项或多项的组合：预设的手势、图案、数字、指纹。
比如，设置绘制解锁图案“M”为用于解锁内屏的预设解锁指令，绘制解锁图案“N”为用户解锁外屏的解锁指令。那么，当检测到用户在外屏绘制解锁图案M 的解锁指令，且手机当前处于非折叠状态，手机确定用户的解锁目的是解锁内屏，那么，手机按照用户的解锁目的解锁内屏。
再示例性的，通常，企业邮件可能涉及商业机密，因此，安全性要求较高。考虑到企业邮件的该特点，若手机在锁屏状态下接收到企业邮件，则响应于用户输入的解锁指令(比如通过外屏摄像头输入的人脸图像)，手机可以解锁内屏，以便降低查看、回复企业邮件过程中的商业机密泄露概率。比如，如图8-3中(1)所示，手机在锁屏状态下接收到企业邮件，那么，响应于用户的诸如抬起手机的解锁操作，手机使用外屏摄像头对用户身份进行认证。若确定用户身份合法，且，手机处于图8-3中(2)所示的半展开状态，则手机可以解锁内屏。可选的，解锁内屏后，手机显示图8-3中(3)所示的界面。该界面包括邮件的内容。
再示例性的，在一些场景中，用户并未主动展开手机，则手机可以提示用户展开手机处理安全性要求较高的企业邮件。以图8-3中(4)所示，当手机判断用户身份合法后，可以显示界面404(第三界面的一种示例)，以提示用户展开使用手机。
可选的，若在显示界面404后的一段时间内，检测到手机处于非折叠状态，说明用户的解锁目的确实是解锁内屏，则手机解锁内屏。可选的，手机解锁内屏后，显示诸如图8-3中(5)所示界面。示例性的，该界面包括邮件的详情。再示例性的，该界面以分屏形式包括邮件详情以及邮件列表。
或者，可选的，在一段时间内，检测到手机仍处于折叠状态，则说明用户的解锁目的很可能仅是解锁外屏，那么，手机仅解锁外屏。可选的，手机解锁外屏后，显示诸如图8-3中(6)所示界面。
也就是说，在手机接收到安全性要求较高的应用的消息(比如企业邮件)时，手机尽可能使用内屏处理该消息。具体的，在确定用户身份合法的情况下，若确定手机处于非折叠状态，则手机优先解锁内屏。或者，在确定用户身份合法的情况下，若确定手机仍处于折叠状态，则可以提示用户可以展开使用手机。如此，能够提升用户使用内屏处理消息(比如企业邮件)的概率。
在另一些实施例中，为了进一步增加提升用户使用内屏处理诸如企业邮件的概率，手机还可以通过多个界面提示用户展开手机使用。比如，在8-3中(2)或(4)所示界面均提示用户展开手机使用。本申请实施例并不限制提示的具体时机和方式。
上述以新消息是安全性较高的企业邮件为例对本申请实施例提供的解锁方法进行了举例说明。在另一些实施例中，新消息还可以非预设应用或非预设功能的消息，或不是预设时段内接收的消息，或不是预设地理位置范围内接收的消息，比如可以是一些安全性要求不太高的消息，对于这类消息，可以基于用户使用习惯，让用户选择是否通过内屏与手机交互。
以新消息是安全性要求不高的新邮件为例，比如，如图8-4中(1)和(2)所示，手机在锁屏状态下接收新邮件，并显示诸如界面405。该界面可以包括新邮件的基本信息。之后，响应于用户输入的解锁指令，比如用户双击屏幕的操作，手机调用外屏摄像头采集人脸图像，进行人脸识别。可选的，在人脸识别过程中， 手机可显示诸如图8-4中(3)所示界面。
在一些情况下，若根据人脸识别结果，手机确定用户身份合法，且手机处于非折叠状态，则手机确定用户的解锁目的是解锁内屏，那么，手机解锁内屏。可选的，手机解锁内屏后，显示诸如图8-4中(4)所示的界面。
在另一些情况下，若根据人脸识别结果，手机确定用户身份合法，且手机此时仍处于折叠状态，则手机解锁外屏。可选的，手机解锁外屏后，显示诸如图8-4中(5)所示界面。
由上述实施例可知，对于一些没必要使用内屏的场景(比如对于一些不涉及安全泄露风险的消息)，在没有用户干预(比如用户并未展开手机)的情况下，手机解锁外屏，即手机尽可能通过外屏与用户交互。对于一些有必要使用内屏的场景，手机解锁内屏，尽可能通过内屏与用户交互。
在另一些实施例中，手机还可以提示用户展开手机使用。比如，在图8-4中(2)或(3)所示界面中显示提示信息。或者，在识别出用户身份合法之后，解锁屏幕之前显示提示信息。手机提示用户展开手机的方式不局限于界面方式，还可以比如是语音(提示语音的一个示例)提示方式等。本申请实施例不限制具体的提示时机和提示方式。
在另一些实施例中，手机还可基于其他条件判断是否使用内屏与用户交互。比如，针对邮件消息做一些其他检测，以便判断是否向用户推荐解锁内屏以处理邮件消息。
比如，手机检测新接收的邮件是否带有附件，若邮件带有附件，则当检测到用户有解锁需求，并主动展开手机时，手机解锁内屏。或者，手机向用户推荐展开使用手机，提示方式不局限于界面方式或语音方式等。
再比如，手机检测新接收的邮件是否带有大小超过阈值的附件，若邮件带有较大附件(比如10M以上)，则当检测到用户有解锁需求，并主动展开手机时，手机解锁内屏。或者，手机向用户推荐展开使用手机。
其中，阈值可以根据场景灵活设定，本申请实施例不做限制。
再比如，手机检测新接收的邮件是否带有预设类型的附件，若邮件带有预设类型的附件，则当检测到用户有解锁需求，并主动展开手机时，手机解锁内屏。或者，手机向用户推荐展开使用手机。
可选的，预设类型的附件可以是适合采用内屏(比如大屏)查看的附件。可选的，预设类型附件可以是私密性较高的附件，比如，可以是加密附件。
示例性的，预设类型比如可以但不限于是图片、视频、Word文档、加密附件。图片类型包括但不限于是如下任一或多种类型：jpg，png,tif,gif。
在另一些实施例中，终端还可以结合检测上述多项条件判断用户的解锁目的，以终端检测当前时间是否在预设时段以及电子设备是否处于折叠状态为例，作为一种可能的设计，在一些情况下，若终端在预设时段内检测到用户输入正确的身份认证信息，且同时检测到终端处于非折叠状态，说明用户已准备展开使用终端，那么，终端可直接解锁内屏。在另一些情况下，终端在预设时段内检测到用户输入正确的身份认证信息，同时检测到终端处于折叠状态，有可能是用户没有及时 展开终端，那么，终端可呈现提示信息，比如，终端显示诸如“人脸识别成功，展开终端以解锁内屏”以便提示用户展开终端。在终端呈现提示信息后的一段时间内，若检测到终端被展开，则终端可解锁内屏。在终端呈现提示信息后的一段时间内，若检没有测到终端被展开，则终端可解锁外屏。
作为另一种可能的设计，终端在预设时段内检测到用户输入正确的身份认证信息，那么，终端可先解锁外屏，在外屏显示第一界面，并在检测到用户展开手机时解锁内屏，并可以在内屏显示与第一界面关联的第二界面，如此，可以将外屏的界面关联接续到内屏。
在另一些实施例中，用户需要使用内屏与手机交互，且由于一些因素，手机无法通过外屏摄像头成功识别人脸。比如，用户展开手机的过程较快，外屏摄像头采集的人脸图像数目较少，或外屏摄像头采集的人脸图像的角度比较偏，手机根据采集的这些人类图像不足以识别出用户身份。
在一些情况下，如图8-5中(1)和(2)所示，当通过外屏摄像头进行人脸解锁失败，手机可以调用内屏摄像头继续采集用户的人脸图像(用户身份信息的一种示例)，并根据内屏摄像头采集的人脸图像对用户身份进行识别。可选的，手机通过内屏显示诸如图8-5中(3)所示界面，以提示用户正在人脸识别。当根据人脸识别结果确定用户身份合法，手机可以解锁内屏。可选的，手机解锁内屏后，在内屏显示诸如图8-5中(4)所示界面。
在另一些情况下，当通过外屏的图像传感器进行人脸解锁失败，手机可以调用内屏图像传感器(第一采集部件的一个示例)继续采集人脸图像，并且，考虑到外屏摄像头可能已采集到一些人脸图像，那么，手机可以利用外屏摄像头采集的人脸图像，以及内屏摄像头采集的人脸图像，对用户身份进行识别。如此，由于在手机调用内屏摄像头之前，外屏摄像头已经采集了人脸识别所需的部分人脸图像，则内屏摄像头可以采集更少的人脸图像，即可完成人脸识别，缩短了从调用内屏摄像头到人脸识别成功的用时，加快了人脸识别的速度。
可选的，本申请实施例中，手机可以根据用户与手机之间的位置关系，确定调用内屏摄像头的时机。比如，当确定用户人脸脱离外屏摄像头的视角(field of view，FOV)范围，且持续时长达到预设时长，则意味着外屏摄像头高概率不能再采集人脸图像，那么，若此时手机处于非折叠状态，则手机调用内屏摄像头继续采集人脸图像，以增加人脸识别的成功率。
可选的，当手机确定用户人脸脱离外屏摄像头的视角(field of view，FOV)范围，且持续时长达到预设时长，则控制外屏息屏，以便降低功耗。
可选的，手机还可以响应于用户输入的指令，确定调用内屏摄像头的时机。比如，若检测到用户进行诸如按下电源键之类的操作，则手机调用内屏摄像头。
可选的，手机还可以根据折叠屏被展开的角度或者说根据手机的折叠角度，确定调用内屏摄像头的时机。具体的，当手机的折叠角度在预设角度范围内，调用内屏摄像头采集人脸图像。其中，预设角度范围可以根据内屏摄像头的视角范围确定。当手机的折叠角度在预设角度范围内，内屏摄像头通常可以采集到人脸图像。当内屏摄像头为广角或超广角摄像头时，其视角范围较大，对应预设角度 范围也较大。当内屏摄像头的视角较窄，预设角度范围相应较小。本申请实施例不对预设角度范围做限定。可见，本该实施例中，当用户人脸落在内屏摄像头的视角范围内，才会调用内屏摄像头开始工作，既降低了提前调用内屏摄像头导致的功耗，又尽可能降低了因延迟调用内屏摄像头导致的人脸识别速度较慢的概率。
可选的，用于人脸识别的内屏摄像头可以是视角范围较大的摄像头。如此，提升了用户面部落在内屏摄像头视角范围内的概率，有利于内屏摄像头采集人脸图像，进而提升人脸识别的成功率。
示例性的，以预设角度范围为80度-145，参见图8-6中(1)所示，手机在锁屏状态下接收到一封新邮件，用户拿起手机意图解锁使用手机，响应于用户的该解锁操作，手机调用外屏摄像头采集人脸图像，以便进行人脸识别。
可选的，在人脸识别过程中，手机可以显示如图8-6中(2)所示的界面。之后，用户将手机逐步展开，若手机检测到手机被展开的角度到达80度，且仍未解锁成功，则手机调用内屏摄像头继续采集人脸图像。可选的，手机可以根据内屏摄像头采集的人脸图像识别用户身份。或者，为了进一步提升人脸识别速度，手机可以结合外屏摄像头采集的人脸图像和内屏摄像头采集的人脸图像，进行人脸识别。
可选的，在识别用户身份的过程中，手机可以显示诸如图8-6中(3)所示用于提示用户正在识别身份的界面。当确定用户身份合法，则手机解锁内屏，并可以显示诸如图8-6中(4)所示界面。
在另一些实施例中，手机可以结合手机被展开的角度以及用户与手机之间的位置关系，确定调用内屏摄像头的时机，以便在更准确的时机调用内屏摄像头。比如，检测到手机的折叠角度达到80度，且用户面部接近手机，且当前并未成功识别用户身份时，手机调用内屏摄像头采集用户的人脸图像，以便继续进行人脸识别。
在一些实施例中，手机还可以提示用户是否展开手机，以便解锁内屏。
仍以接收新消息为例，比如，如图8-7中(1)所示，手机处于锁屏状态下，之后，手机接收到新消息，那么，手机可以显示图8-7中(2)所示的消息提醒界面，该消息提醒界面可以包括诸如“展开手机将进入内屏显示”的字样，以提示用户可以通过展开手机解锁内屏。之后，响应于用户的诸如双击屏幕的操作，手机使用外屏摄像头采集人脸图像，进行人脸识别。可选的，在人脸识别过程中，手机显示图8-7中(3)所示的界面。
在一些情况下，若手机通过人脸识别确定用户身份合法，且手机不是折叠状态，说明用户展开了手机，用户的解锁目的是解锁内屏，则手机解锁内屏。可选的，手机解锁内屏后，显示图8-7中(4)所示的消息详情界面。
在另一些情况下，若手机通过人脸识别确定用户身份合法，且手机此时的状态为折叠状态，说明用户未展开手机，用户的解锁目的是解锁外屏，则手机解锁外屏。可选的，解锁内屏后，手机显示图8-7中(5)所示的消息详情界面。
再比如，如图8-7中(1)-(4)所示，手机可以在人脸识别的过程中，提示用户展开手机，以便解锁内屏。若根据人脸识别结果，手机确定用户身份合法， 且手机不是折叠状态，则说明用户展开了手机，其解锁目的是解锁内屏，则手机根据用户的解锁目的解锁内屏。反之，若根据人脸识别结果，手机确定用户身份合法，但手机是折叠状态，则说明用户未展开手机，其解锁目的是解锁外屏，则手机解锁外屏。
再比如，如图8-9中(1)-(5)所示，在手机根据人脸识别结果确定用户身份合法之后，手机可以显示如图8-9中(3)所示界面403，用于提示用户展开手机，以便解锁内屏。在提示界面403之后的一段时间内，若手机检测到手机被展开，则说明用户的解锁目的是解锁内屏，那么，手机根据用户的解锁目的解锁内屏。反之，在提示界面403后的一段时间内，若手机未检测到手机被展开，则说明用户可能仅想使用外屏与手机交互，那么，手机解锁外屏，恢复外屏的可交互性。
需要说明的是，手机提示用户展开手机的方式不局限于显示诸如图8-7中(2)所示界面、图8-8中(1)-(4)所示界面407、图8-9中(3)所示界面的方式。比如，还可以通过图8-2中(3)所示上划解锁图标处增加提示信息，比如“展开手机并上划以解锁内屏”。此外，还可以通过界面向用户提示可以将手机展开的角度，比如，向用户提示“请将手机展开约15度(仅为举例)，以触发解锁内屏”。
此外，手机提示用户展开手机的方式不局限于界面提示方法，还可以比如是语音提示方式等。本申请实施例不限制具体的提示时机和提示方式。
可选的，当用户确定用户的解锁目的是解锁内屏，则手机解锁内屏。此种情况下，若手机检测到外屏仍处于亮屏状态，则可以控制外屏息屏，以降低外屏亮屏导致的整机功耗。
或者，可选的，当手机确定用户的解锁目的为解锁内屏，手机还可以同时解锁内屏和外屏。比如，在一些拍照场景，用户可能需要通过内屏和外屏预览待拍摄画面，以便拍摄出效果更佳的图片。
在一些实施例中，还可以设置对特定应用的特定功能设置快捷启动方式，以便更加快速的解锁进入相应应用的相应功能。
比如，如图10中(2)所示，在锁屏界面，针对相机应用，设置快捷启动图标。如此，用户可以通过操作相机应用的快捷启动图标快速使用相机应用。
再比如，还可以针对钱包应用的付款功能设置快捷启动图标。在用户操作(比如点击)付款功能的快捷启动图标后，手机对用户进行身份认证，若确定用户身份合法，则手机直接显示付款二维码。如此，可以简化用户的付款操作，用户无需在解锁后在桌面的多个应用中查找钱包应用，并选择进入付款二维码界面。
以手机通过摄像头进行人脸识别来验证用户身份为例，在一些实施例中，在外屏摄像头确定用户身份合法的情况下，手机还可以先解锁外屏。后续，当检测到用户展开手机时，手机可以将外屏的界面关联接续到内屏上显示。以在接收新消息场景中解锁手机为例，参见图8-10中(1)和(2)所示，手机在锁屏状态下接收新消息，用户拿起手机解锁，手机通过外屏摄像头采集人脸图像，进而对用户进行人脸识别。在人脸识别成功后，手机解锁外屏，并显示诸如图8-10中(3)所示的消息界面(第一界面的一种示例)。后续，用户展开使用手机，则手机可 以将外屏显示的诸如图8-10中(3)所示界面关联接续到内屏。并在内屏显示图8-10中(4)所示界面。在一种示例中，外屏界面可以同步切换到内屏上显示，实现外屏界面到内屏界面的无缝切换。在另一些示例中，外屏界面在切换到内屏显示时，可以在内屏显示与外屏界面关联的界面。比如，外屏显示邮件详情界面，内屏可以以分屏方式显示界面(第二界面的一个示例)，在界面的一部分显示邮件详情，在一部分显示收发的邮件列表。再比如，外屏显示播放的当前音乐的界面，切换到内屏显示时，在内屏显示音乐列表界面，也就是说，可以在内屏显示外屏界面关联的界面。
与图8-10的方案相比，上述图6所示方案中，在确定用户身份合法，且手机被展开使用的情况下，手机可不必解锁外屏，而是直接解锁内屏，能够进一步降低解锁外屏导致的功耗。
在一些实施例中，考虑到内屏、外屏具有不同特点，对于同一应用的同一功能，手机在内屏显示的功能界面和外屏显示的功能界面可以不同。
以支付场景(不局限于支付场景)为例，比如，考虑到内屏的安全性往往比外屏的安全性更高，图9-1的(4)中外屏显示的付款功能界面包括更少信息(比如仅包括如图所示用于完成付款功能的二维码信息)，图9-1的(6)中内屏显示的付款功能界面包括更多信息(比如包括如图所示的用于完成付款功能的二维码信息，以及条码信息等)。如此，可将重要的隐私信息等尽可能多的显示在内屏，以便提升用户信息的安全性。
再比如，考虑到内屏尺寸和外屏尺寸的差异，对于同一应用中相同功能，尺寸小的屏幕上显示的该功能的界面包括更少信息，尺寸大的屏幕上显示的该功能的界面包括更多信息。
本申请实施例还可以为用户提供设置入口，用于设置解锁的相关功能。
比如，如图12中(1)-(4)示出了设置在内屏中操作的应用的相关设置界面。手机可以接收用户通过设置界面输入的设置指令，设置指令用于设置上述预设应用。类似的，手机还可以提供诸如利用内屏操作的时段(即预设时段)、利用内屏操作的地点(即预设地理位置范围)、用于解锁内屏的解锁指令(即预设解锁指令)等一个或多个选项的设置入口。
上述主要以第一采集部件为内屏的摄像头，第二采集部件为外屏的摄像头为例进行说明，在这种情况下，第一采集部件可以与第二采集部件不同。在另一些实施例中，第一采集部件还可以与第二采集部件为同一部件。比如，仍以电子设备为折叠屏手机为例，第一采集部件和第二采集部件可以为同一指纹采集部件。该指纹采集部件可以用于采集用户的指纹信息，进而可以用于解锁内屏或外屏。
本申请另一些实施例提供了一种装置，该装置可以是上述电子设备(比如折叠屏手机)。该装置可以包括：显示屏、存储器和一个或多个处理器。该显示屏、存储器和处理器耦合。该存储器用于存储计算机程序代码，该计算机程序代码包括计算机指令。当处理器执行计算机指令时，电子设备可执行上述方法实施例中手机执行的各个功能或者步骤。该电子设备的结构可以参考图2所示的电子设备。
其中，该电子设备的核心结构可以表示为图13所示的结构，该核心结构可包括：处 理模块1301、输入模块1302、存储模块1303、显示模块1304。
处理模块1301，可包括中央处理器(CPU)、应用处理器(Application Processor，AP)或通信处理器(Communication Processor，CP)中的至少一个。处理模块1301可执行与用户电子设备的其他元件中的至少一个的控制和/或通信相关的操作或数据处理。具体地，处理模块1301可用于根据一定的触发条件，控制主屏上显示的内容。或者根据预设规则确定屏幕上显示的内容。处理模块1301还用于将输入的指令或数据进行处理，并根据处理后的数据确定显示样式。处理模块1301还包括渲染引擎等，以用于渲染界面元素UI。
输入模块1302，用于获取用户输入的指令或数据，并将获取到的指令或数据传输到电子设备的其他模块。具体地说，输入模块1302的输入方式可以包括触摸、手势、接近屏幕等，也可以是语音输入。例如，输入模块可以是电子设备的屏幕，获取用户的输入操作并根据获取到的输入操作生成输入信号，将输入信号传输至处理模块1301。在本申请实施例中，输入模块可用于接收用户输入的解锁指令，和/或执行其他步骤。
存储模块1303，可包括易失性存储器和/或非易失性存储器。存储模块用于存储用户终端设备的其他模块中的至少一个相关的指令或数据，具体地说，存储模块可记录终端界面元素UI所在界面的位置。
显示模块1304，可包括例如液晶显示器(LCD)、发光二极管(LED)显示器、有机发光二极管(OLED)显示器、微机电系统(MEMS)显示器或电子纸显示器。用于显示用户可观看的内容(例如，文本、图像、视频、图标、符号等)。在本申请实施例中，显示模块可实现为显示屏幕，比如第一屏幕和/或第二屏幕。
可选的，图13所示结构还可通信模块1305，用于支持电子设备与其他电子设备通信。例如，通信模块可经由无线通信或有线通信连接到网络，以与其他个人终端或网络服务器进行通信。无线通信可采用蜂窝通信协议中的至少一个，诸如，长期演进(LTE)、高级长期演进(LTE-A)、码分多址(CDMA)、宽带码分多址(WCDMA)、通用移动通信系统(UMTS)、无线宽带(WiBro)或全球移动通信系统(GSM)。无线通信可包括例如短距通信。短距通信可包括无线保真(Wi-Fi)、蓝牙、近场通信(NFC)、磁条传输(MST)或GNSS中的至少一个。
本申请实施例还提供一种芯片系统，如图14所示，该芯片系统包括至少一个处理器1401和至少一个接口电路1402。处理器1401和接口电路1402可通过线路互联。例如，接口电路1402可用于从其它装置(例如电子设备的存储器)接收信号。又例如，接口电路1402可用于向其它装置(例如处理器1401)发送信号。示例性的，接口电路1402可读取存储器中存储的指令，并将该指令发送给处理器1401。当所述指令被处理器1401执行时，可使得电子设备执行上述实施例中的各个步骤。当然，该芯片系统还可以包含其他分立器件，本申请实施例对此不作具体限定。
本申请实施例还提供一种计算机存储介质，该计算机存储介质包括计算机指令，当所述计算机指令在上述电子设备上运行时，使得该电子设备执行上述方法实施例中手机执行的各个功能或者步骤。
本申请实施例还提供一种计算机程序产品，当所述计算机程序产品在计算机上运行时，使得所述计算机执行上述方法实施例中手机执行的各个功能或者步骤。
通过以上实施方式的描述，所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功 能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。
在本申请所提供的几个实施例中，应该理解到，所揭露的装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅是示意性的，例如，所述模块或单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个装置，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是一个物理单元或多个物理单元，即可以位于一个地方，或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个可读取存储介质中。基于这样的理解，本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该软件产品存储在一个存储介质中，包括若干指令用以使得一个设备(可以是单片机，芯片等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(read only memory，ROM)、随机存取存储器(random access memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上内容，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何在本申请揭露的技术范围内的变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (29)

  1. 一种解锁方法，其特征在于，所述方法应用于电子设备，所述电子设备包括屏幕折叠状态下形成的第一屏幕和第二屏幕，其中，所述第一屏幕为内屏，所述第二屏幕为外屏，所述第一屏幕具有关联的第一采集部件，所述第二屏幕具有关联的第二采集部件，所述方法包括：
    获取解锁意图；
    响应于所述解锁意图，调用所述第二采集部件采集用户的身份信息，并根据所述第二采集部件采集的所述身份信息识别所述用户的身份；
    若所述用户的身份合法，且所述电子设备满足使用所述第一屏幕的条件，则解锁所述第一屏幕。
  2. 根据权利要求1所述的方法，其特征在于，在确定所述用户的身份合法之后，解锁所述第一屏幕前，所述方法还包括：解锁所述第二屏幕，并在所述第二屏幕上显示第一界面。
  3. 根据权利要求2所述的方法，其特征在于，在解锁所述第一屏幕之后，所述方法还包括：在所述第一屏幕上显示与所述第一界面关联的第二界面。
  4. 根据权利要求1所述的方法，其特征在于，在解锁所述第一屏幕之前，所述方法还包括：若根据所述第二采集部件采集的身份信息不能识别所述用户的身份，则调用所述第一采集部件采集所述用户的身份信息，并根据所述第一采集部件采集的身份信息，识别所述用户的身份。
  5. 根据权利要求4所述的方法，其特征在于，根据所述第一采集部件采集的身份信息，识别所述用户的身份，包括：根据所述第二采集部件采集的身份信息以及所述第一采集部件采集的身份信息，识别所述用户的身份。
  6. 根据权利要求4或5所述的方法，其特征在于，若根据所述第二采集部件采集的身份信息不能识别所述用户的身份，则调用所述第一采集部件采集所述用户的身份信息，包括：若检测到所述电子设备的展开角度到达预设角度，且根据所述第二采集部件采集的身份信息不能识别所述用户的身份，则调用所述第一采集部件采集所述用户的身份信息。
  7. 根据权利要求1-6中任一项所述的方法，其特征在于，在解锁所述第一屏幕之前，所述方法还包括：
    显示第三界面或播放提示语音，所述第三界面用于提示所述用户展开所述电子设备，所述提示语音用于提示所述用户展开所述电子设备。
  8. 根据权利要求1-7中任一项所述的方法，其特征在于，所述方法还包括：
    接收用户输入的设置指令，所述设置指令用于设置预设应用、预设时段、预设地理位置范围、预设解锁指令中的任一个或多个。
  9. 根据权利要求1-8中任一项所述的方法，其特征在于，获取解锁意图，包括：接收用户输入的解锁指令；
    响应于所述解锁意图，调用所述第二采集部件采集用户的身份信息，包括：
    响应于所述解锁指令，调用所述第二采集部件采集所述用户的身份信息。
  10. 根据权利要求1-9中任一项所述的方法，其特征在于，所述第一采集部件与所 述第二采集部件相同或不同。
  11. 根据权利要求1-10中任一项所述的方法，其特征在于，使用所述第一屏幕的条件包括如下一项或多项条件的组合：当前时间在预设时段内、当前位置在预设地理位置范围内、接收到新消息且所述新消息是预设应用的消息、所述电子设备处于非折叠状态、用户输入的解锁指令是预设解锁指令。
  12. 根据权利要求11所述的方法，其特征在于，所述预设解锁指令包括如下任一项或多项的组合：预设的用于解锁所述第一屏幕的手势、图案、数字、指纹、语音。
  13. 根据权利要求1-12中任一项所述的方法，其特征在于，所述第一采集部件包括如下任一种或多种部件：指纹采集部件、声纹采集部件、图像采集部件；所述第二采集部件包括如下任一种或多种部件：指纹采集部件、声纹采集部件、图像采集部件。
  14. 一种电子设备，其特征在于，所述电子设备包括处理器，以及屏幕折叠状态下形成的第一屏幕和第二屏幕，其中，所述第一屏幕为内屏，所述第二屏幕为外屏，所述第一屏幕具有关联的第一采集部件，所述第二屏幕具有关联的第二采集部件；
    所述处理器，用于获取解锁意图；响应于所述解锁意图，调用所述第二采集部件采集用户的身份信息，并根据所述第二采集部件采集的所述身份信息识别所述用户的身份；若所述用户的身份合法，且所述电子设备满足使用所述第一屏幕的条件，则解锁所述第一屏幕。
  15. 根据权利要求14所述的电子设备，其特征在于，
    所述处理器，还用于解锁所述第二屏幕；
    所述第二屏幕，用于显示第一界面。
  16. 根据权利要求15所述的电子设备，其特征在于，所述第一屏幕，用于在解锁所述第一屏幕之后，显示与所述第一界面关联的第二界面。
  17. 根据权利要求14所述的电子设备，其特征在于，所述处理器，还用于若根据所述第二采集部件采集的身份信息不能识别所述用户的身份，则调用所述第一采集部件采集所述用户的身份信息，并根据所述第一采集部件采集的身份信息，识别所述用户的身份。
  18. 根据权利要求17所述的电子设备，其特征在于，所述处理器，用于根据所述第一采集部件采集的身份信息，识别所述用户的身份，包括：根据所述第二采集部件采集的身份信息以及所述第一采集部件采集的身份信息，识别所述用户的身份。
  19. 根据权利要求17或18所述的电子设备，其特征在于，所述处理器，用于若根据所述第二采集部件采集的身份信息不能识别所述用户的身份，则调用所述第一采集部件采集所述用户的身份信息，包括：若检测到所述电子设备的展开角度到达预设角度，且根据所述第二采集部件采集的身份信息不能识别所述用户的身份，则调用所述第一采集部件采集所述用户的身份信息。
  20. 根据权利要求14-19中任一项所述的电子设备，其特征在于，所述第二屏幕，还用于显示第三界面或播放提示语音，所述第三界面用于提示所述用户展开所述电子设备，所述提示语音用于提示所述用户展开所述电子设备。
  21. 根据权利要求14-20中任一项所述的电子设备，其特征在于，所述处理器，还用于接收用户输入的设置指令，所述设置指令用于设置预设应用、预设时段、预设地 理位置范围、预设解锁指令中的任一个或多个。
  22. 根据权利要求14-21中任一项所述的电子设备，其特征在于，所述处理器，用于获取解锁意图，包括：接收用户输入的解锁指令；
    所述处理器，用于响应于所述解锁意图，调用所述第二采集部件采集用户的身份信息，包括：响应于所述解锁指令，调用所述第二采集部件采集所述用户的身份信息。
  23. 根据权利要求14-22中任一项所述的电子设备，其特征在于，所述第一采集部件与所述第二采集部件相同或不同。
  24. 根据权利要求14-23中任一项所述的电子设备，其特征在于，使用所述第一屏幕的条件包括如下一项或多项条件的组合：当前时间在预设时段内、当前位置在预设地理位置范围内、接收到新消息且所述新消息是预设应用的消息、所述电子设备处于非折叠状态、用户输入的解锁指令是预设解锁指令。
  25. 根据权利要求24所述的电子设备，其特征在于，所述预设解锁指令包括如下任一项或多项的组合：预设的用于解锁所述第一屏幕的手势、图案、数字、指纹、语音。
  26. 根据权利要求14-25中任一项所述的电子设备，其特征在于，所述第一采集部件包括如下任一种或多种部件：指纹采集部件、声纹采集部件、图像采集部件；所述第二采集部件包括如下任一种或多种部件：指纹采集部件、声纹采集部件、图像采集部件。
  27. 一种电子设备，其特征在于，包括：处理器，存储器，所述存储器与所述处理器耦合，所述存储器用于存储计算机程序代码，所述计算机程序代码包括计算机指令，当所述处理器从所述存储器中读取所述计算机指令，使得所述电子设备执行如权利要求1-13任一项所述的解锁方法。
  28. 一种计算机可读存储介质，所述计算机可读存储介质中存储有指令，其特征在于，当所述指令在电子设备上运行时，使得所述电子设备执行如权利要求1-13中任一项所述的解锁方法。
  29. 一种包含指令的计算机程序产品，其特征在于，当所述计算机程序产品在电子设备上运行时，使得所述电子设备执行如权利要求1-13中任一项所述的解锁方法。
PCT/CN2022/087901 2021-04-22 2022-04-20 解锁方法及电子设备 WO2022222955A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP22791061.9A EP4318281A1 (en) 2021-04-22 2022-04-20 Unlocking method and electronic device
BR112023021830A BR112023021830A2 (pt) 2021-04-22 2022-04-20 Método de desbloqueio e dispositivo eletrônico
JP2023564597A JP2024521007A (ja) 2021-04-22 2022-04-20 ロック解除方法および電子デバイス
US18/491,093 US20240086580A1 (en) 2021-04-22 2023-10-20 Unlocking method and electronic device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110438415.7A CN115238255A (zh) 2021-04-22 2021-04-22 解锁方法及电子设备
CN202110438415.7 2021-04-22

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/491,093 Continuation US20240086580A1 (en) 2021-04-22 2023-10-20 Unlocking method and electronic device

Publications (1)

Publication Number Publication Date
WO2022222955A1 true WO2022222955A1 (zh) 2022-10-27

Family

ID=83666535

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/087901 WO2022222955A1 (zh) 2021-04-22 2022-04-20 解锁方法及电子设备

Country Status (6)

Country Link
US (1) US20240086580A1 (zh)
EP (1) EP4318281A1 (zh)
JP (1) JP2024521007A (zh)
CN (1) CN115238255A (zh)
BR (1) BR112023021830A2 (zh)
WO (1) WO2022222955A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116132568A (zh) * 2023-02-24 2023-05-16 维沃移动通信有限公司 操作执行方法、装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160381014A1 (en) * 2015-03-31 2016-12-29 Samsung Electronics Co., Ltd. Foldable device and method of controlling the same
EP3285133A1 (en) * 2016-08-19 2018-02-21 Samsung Electronics Co., Ltd. Foldable device and method of controlling the same
CN109840061A (zh) * 2019-01-31 2019-06-04 华为技术有限公司 控制屏幕显示的方法及电子设备
CN110232266A (zh) * 2019-04-25 2019-09-13 维沃移动通信有限公司 一种屏幕解锁方法及终端设备
CN112115444A (zh) * 2019-06-21 2020-12-22 华为技术有限公司 一种解锁方法及电子设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160381014A1 (en) * 2015-03-31 2016-12-29 Samsung Electronics Co., Ltd. Foldable device and method of controlling the same
EP3285133A1 (en) * 2016-08-19 2018-02-21 Samsung Electronics Co., Ltd. Foldable device and method of controlling the same
CN109840061A (zh) * 2019-01-31 2019-06-04 华为技术有限公司 控制屏幕显示的方法及电子设备
CN110232266A (zh) * 2019-04-25 2019-09-13 维沃移动通信有限公司 一种屏幕解锁方法及终端设备
CN112115444A (zh) * 2019-06-21 2020-12-22 华为技术有限公司 一种解锁方法及电子设备

Also Published As

Publication number Publication date
EP4318281A1 (en) 2024-02-07
CN115238255A (zh) 2022-10-25
US20240086580A1 (en) 2024-03-14
BR112023021830A2 (pt) 2023-12-19
JP2024521007A (ja) 2024-05-28

Similar Documents

Publication Publication Date Title
EP3979628B1 (en) Display method of video call applied to electronic device and related apparatus
CN110839096B (zh) 一种具有折叠屏的设备的触控方法与折叠屏设备
JP2023514962A (ja) 折り畳み可能画面のための表示方法および関連装置
CN110456951B (zh) 一种应用显示方法及电子设备
CN110536004B (zh) 多传感器应用于具有柔性屏幕的电子设备的方法及电子设备
WO2021213164A1 (zh) 应用界面交互方法、电子设备和计算机可读存储介质
WO2021036771A1 (zh) 具有可折叠屏幕的电子设备及显示方法
WO2021052279A1 (zh) 一种折叠屏显示方法及电子设备
WO2021063237A1 (zh) 电子设备的控制方法及电子设备
WO2021169399A1 (zh) 一种暂存应用界面的方法及电子设备
CN112714901A (zh) 系统导航栏的显示控制方法、图形用户界面及电子设备
CN110543287A (zh) 一种屏幕显示方法及电子设备
US20220269800A1 (en) Privacy protection method for electronic device and electronic device
CN114125130B (zh) 控制通信服务状态的方法、终端设备和可读存储介质
CN112130788A (zh) 一种内容分享方法及其装置
EP4199499A1 (en) Image capture method, graphical user interface, and electronic device
WO2022161119A1 (zh) 一种显示方法及电子设备
US20230342106A1 (en) Collaborative display method, terminal device, and computer-readable storage medium
WO2021042878A1 (zh) 一种拍摄方法及电子设备
CN113010076A (zh) 一种显示要素的显示方法和电子设备
US20240086580A1 (en) Unlocking method and electronic device
CN110647731A (zh) 一种显示方法及电子设备
WO2022262592A1 (zh) 一种访问控制方法及相关装置
CN115291780A (zh) 一种辅助输入方法、电子设备及系统
CN116339569A (zh) 分屏显示的方法、折叠屏设备和计算机可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22791061

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023564597

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2022791061

Country of ref document: EP

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112023021830

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 2022791061

Country of ref document: EP

Effective date: 20231023

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 112023021830

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20231019