WO2022089060A1

WO2022089060A1 - Interface display method and electronic device

Info

Publication number: WO2022089060A1
Application number: PCT/CN2021/118075
Authority: WO
Inventors: 殷代宗
Original assignee: 华为技术有限公司
Priority date: 2020-10-29
Filing date: 2021-09-13
Publication date: 2022-05-05
Also published as: CN114510174A

Abstract

An interface display method and an electronic device. The method comprises: after receiving a first operation, an electronic device starting a one-handed operation mode in response to the first operation; and in the one-handed operation mode, the electronic device acquiring first viewpoint coordinates and finger coordinates, acquiring first display content in a first display area corresponding to the first viewpoint coordinates, and displaying the first display content in a second display area corresponding to the finger coordinates. By means of the method, a user can operate any content in an operation interface with one hand, thereby effectively improving the user experience.

Description

Interface display method and electronic device

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the priority of the Chinese patent application with the application number 202011179164.7 and the application title "An interface display method and electronic device" filed with the China Patent Office on October 29, 2020, the entire contents of which are incorporated into this application by reference middle.

technical field

The present application relates to the field of terminal technologies, and in particular, to an interface display method and an electronic device.

Background technique

With the advancement of terminal technology, the functions of electronic devices are gradually improved. In order to satisfy people's visual experience, the screen of an electronic device is usually set to be larger. However, when a user operates an electronic device with a large screen with one hand, the user experience is poor due to the limitation of the length of the user's finger.

Some electronic devices provide a one-handed operation mode, but due to the limitations of the screen width of the electronic device and the length of the user's fingers, the user still needs to use multiple fingers together (for example, if the user wants to click the application icon on the far right of the mobile phone screen with the left hand, need to span the entire width of the screen), there is still the problem of poor user experience.

Therefore, how to provide a convenient one-handed operation mode is an urgent problem to be solved.

SUMMARY OF THE INVENTION

The present application provides an interface display method and an electronic device, which are used to solve the problem of inconvenient user operation in the existing one-hand operation mode.

In a first aspect, an interface display method is provided, the method can be executed by an electronic device, the method includes: receiving a first operation; in response to the first operation, starting a one-handed operation mode; in the one-handed operation mode, acquiring the first Viewpoint coordinates and finger coordinates; obtain the first display content in the first display area corresponding to the first viewpoint coordinates, and display the first display content in the second display area corresponding to the finger coordinates.

In the above technical solution, when the electronic device receives the first operation, in response to the first operation, the single-handed operation mode is activated; and in the single-handed operation mode, the electronic device can obtain the coordinates of the first viewpoint and the finger, and obtain the first The first display content in the first display area corresponding to a viewpoint coordinate, and the first display content is displayed in the second display area corresponding to the finger coordinate. In this way, the user can effectively operate any content in the display interface with one hand, thereby effectively improving the user experience.

In order to improve the flexibility of the solution, in this embodiment of the present application, the first operation may be that the electronic device is lifted or shaken; or, a click operation or a sliding operation on the display screen of the electronic device; or, a voice command; or, Operation of hardware keys for electronic devices.

It should be noted that, in the embodiments of the present application, the above only provide several specific implementation manners of the first operation. In addition, the first operation may also be implemented in other manners in the embodiments of the present application, which are not implemented in the embodiments of the present application. limited.

In a possible design, after the electronic device displays the first display content in the second display area corresponding to the coordinates of the finger, the electronic device can also receive the first sliding operation in the second display area, and The sliding operation determines the second display content, and switches the display content in the second display area from the first display content to the second display content.

In the above technical solution, after the electronic device displays the first display content in the second display area corresponding to the coordinates of the finger, if the electronic device detects a sliding operation on the second display area, the display content of the second display area can be updated. , which effectively meets the user's operational needs, thereby making the display of the user interface more intelligent.

In a possible design, after displaying the first display content in the second display area corresponding to the coordinates of the finger, the electronic device may also obtain the coordinates of the second viewpoint and the first display area in the third display area corresponding to the coordinates of the second viewpoint. The third display content is to switch the display content in the second display area from the first display content to the third display content.

In the above technical solution, after the electronic device displays the first display content in the second display area corresponding to the finger coordinates, if the electronic device can also monitor the change of the viewpoint coordinates in real time, for example, the electronic device detects the change of the first viewpoint coordinates For the second viewpoint coordinates, the electronic device can acquire the third display content in the third display area corresponding to the two viewpoint coordinates, and switch the display content in the second display area from the first display content to the third display content. In this way, the user's operation requirements are effectively met, thereby effectively improving the intelligence of the user operation interface.

In a possible design, before displaying the first display content in the second display area corresponding to the finger coordinates, the electronic device also needs to determine whether there is an application icon at the first position corresponding to the finger coordinates in the second display area or a control icon; if it exists, the first display content will be displayed at the second position in the second display area; the second position is separated from the first position by the first preset value; if it does not exist, the first display content will be displayed displayed in the first position.

In the above technical solution, before displaying the first display content in the second display area corresponding to the finger coordinates, the electronic device judges whether there is an application icon or a control icon at the first position corresponding to the finger coordinates, if there is an application icon or control icon at the first position icon or control icon, the first display content will be displayed at the second position in the second display area that is far from the first position by the first preset value; if it does not exist, the first display content will be displayed at the first position . In this way, it is effectively avoided that the first display content covers other control icons in the second display area, which may cause inconvenience for the user to operate, thereby effectively improving the user experience.

In a possible design, before the electronic device displays the first display content in the second display area corresponding to the finger, the electronic device may further determine that the user's line of sight stays on the coordinates of the first viewpoint for longer than a second preset threshold.

In the above technical solution, the electronic device displays the first display content in the second display area corresponding to the finger only after it is determined that the user's line of sight stays on the coordinates of the first viewpoint for longer than the second preset threshold. In this way, misoperations are effectively avoided, thereby effectively improving the display accuracy of the user operation interface and effectively improving the user experience.

In a possible design, the electronic device may also receive a click operation on at least one target icon in the first display content, determine the first target icon, and execute an application process corresponding to the first target icon.

In the above technical solution, if the electronic device detects a click operation on at least one target icon in the first display content, it can determine the first target icon the user wants to operate, and then start the application process corresponding to the first target icon, effectively Improve the interaction efficiency between electronic devices and users, thereby effectively improving the user experience.

In a possible design, in response to the first operation, the electronic device may acquire the coordinates of the first viewpoint by: determining the first distance between the user's eyes and the infrared camera, as well as the coordinates of the corneal reflection spot and the center of the pupil; The first distance, the coordinates of the corneal reflection spot and the coordinates of the pupil center determine the coordinates of the first viewpoint.

In the above technical solution, the electronic device determines the coordinates of the first viewpoint through the first distance between the user's eyes and the infrared camera, the coordinates of the corneal reflection spot, and the coordinates of the center of the pupil. In this way, the interaction efficiency between the electronic device and the user is effectively improved, thereby effectively improving the user experience.

In a possible design, the electronic device acquires the coordinates of the finger in response to the first operation, and the specific manner may be: determining the second distance between the finger and the infrared light sensor in the electronic device, and the third distance between the finger and the display screen of the electronic device. distance, the orientation of the finger relative to the infrared light sensor; according to the second distance and the third distance, determine the fourth distance between the projection point of the finger on the display screen and the infrared light sensor; according to the fourth distance and orientation, determine the coordinates of the finger.

In the above technical solution, the electronic device determines the coordinates of the finger according to the fourth distance between the projection point of the finger on the display screen and the infrared light sensor, and the orientation of the finger relative to the infrared light sensor. In this way, the interaction efficiency between the electronic device and the user is effectively improved, thereby effectively improving the user experience.

In a second aspect, there is provided an electronic device comprising means for performing the method of the first aspect.

As an example, the electronic device may include: a processor and a memory; wherein the memory is used to store one or more computer programs; when the one or more computer programs stored in the memory are executed by the processor, the electronic device is made to execute as follows step:

Receive a first operation; in response to the first operation, start a single-handed operation mode; in the single-handed operation mode, obtain the coordinates of the first viewpoint and the coordinates of the finger; obtain the first display content in the first display area corresponding to the coordinates of the first viewpoint , the first display content is displayed in the second display area corresponding to the finger coordinates.

Optionally, the memory is located outside the electronic device.

Optionally, the electronic device includes a memory connected to the at least one processor, and the memory stores instructions executable by the at least one processor.

In a possible design, the electronic device further includes a display screen, and the first operation is: the electronic device is lifted or shaken; or, a click operation or sliding operation for the display screen; or a voice command; or, for the electronic device The operation of the hardware keys of the device.

In a possible design, when one or more computer programs stored in the memory are executed by the processor, the electronic device is further caused to perform the following steps: receiving a first sliding operation in the second display area; according to the first sliding operation , determine the second display content, and switch the display content in the second display area from the first display content to the second display content.

In a possible design, when one or more computer programs stored in the memory are executed by the processor, the electronic device is further caused to perform the following steps: acquiring the coordinates of the second viewpoint and the coordinates in the third display area corresponding to the coordinates of the second viewpoint The third display content is to switch the display content in the second display area from the first display content to the third display content.

In a possible design, when one or more computer programs stored in the memory are executed by the processor, the electronic device is further caused to perform the following steps: judging whether there is an application on the first position corresponding to the finger coordinates in the second display area icon or control icon; if it exists, the first display content will be displayed on the second position in the second display area; the second position is separated from the first position by the first preset value; if it does not exist, the first display will be displayed The content is displayed in the first position.

In a possible design, when one or more computer programs stored in the memory are executed by the processor, the electronic device also causes the electronic device to perform the following step: determining that the user's sight stays on the coordinates of the first viewpoint for a duration exceeding a second time threshold.

In a possible design, when one or more computer programs stored in the memory are executed by the processor, the electronic device is further caused to perform the following steps: receiving a click operation on at least one target icon in the first display content, determining the first Target icon, execute the application process corresponding to the first target icon.

In a possible design, the electronic device further includes an infrared camera, and when one or more computer programs stored in the memory are executed by the processor, the electronic device also causes the electronic device to perform the following steps: determining a first distance between the user's eyes and the infrared camera , the coordinates of the corneal reflection spot and the coordinates of the pupil center; the coordinates of the first viewpoint are determined according to the first distance, the coordinates of the cornea reflection spot and the coordinates of the pupil center.

In a possible design, the electronic device further includes an infrared light sensor, and when one or more computer programs stored in the memory are executed by the processor, the electronic device also causes the electronic device to perform the following steps: determine the relationship between the finger and the infrared light sensor in the electronic device According to the second distance, the third distance between the finger and the display screen of the electronic device, the orientation of the finger relative to the infrared light sensor; according to the second distance and the third distance, determine the projection point of the finger on the display screen and the infrared light sensor. Four distances; according to the fourth distance and orientation, determine the finger coordinates.

These electronic devices may perform the corresponding functions in the method example in the first aspect or any possible design of the first aspect. For details, please refer to the detailed description in the method example, which will not be repeated here.

In a third aspect, a computer-readable medium is provided, and the computer-readable medium stores a program code for execution by a device. When the program code is executed by the device, the above-mentioned first aspect or any possible design of the first aspect The method in will be executed.

In a fourth aspect, a computer program instruction comprising instructions is provided, when the program instruction is executed on a computer, the method in the above-mentioned first aspect or any possible design of the first aspect is performed.

A fifth aspect provides a chip, the chip includes a processor and a data interface, the processor is configured to read and execute instructions stored on a memory through the data interface, so that the first aspect or any one of the first aspect The methods in the possible designs are implemented.

In a possible design, the chip may further include the memory, where the instructions are stored.

For the technical effects that can be achieved by the various design solutions in any of the above-mentioned third aspects to the fifth aspect, please refer to the technical effects that can be brought about by the above-mentioned first aspect or any possible design method of the first aspect, here It will not be repeated.

Description of drawings

1A is a scene diagram of a user operating an electronic device with one hand;

1B is a schematic diagram of a user graphical interface of a mobile phone provided by the application;

1C is a schematic diagram of a user graphical interface of a mobile phone provided by the application;

FIG. 2A is a schematic diagram of a hardware structure of a mobile phone 100 according to an embodiment of the present application;

FIG. 2B is a schematic diagram of the software structure of the mobile phone 100 according to an embodiment of the application;

3 is a schematic flowchart of an interface display method according to an embodiment of the present application;

FIG. 4A is one of schematic diagrams of operations of the mobile phone 100 entering a one-handed operation mode according to an embodiment of the present application;

FIG. 4B is the second schematic diagram of the operation of the mobile phone 100 entering the one-hand operation mode according to an embodiment of the present application;

4C is the third schematic diagram of the operation of the mobile phone 100 entering the one-hand operation mode according to an embodiment of the present application;

FIG. 4D is the third schematic diagram of the operation of the mobile phone 100 entering the one-hand operation mode according to an embodiment of the present application;

5 is a schematic flowchart of a possible determination of user viewpoint coordinates according to an embodiment of the present application;

FIG. 6A is one of the schematic diagrams of acquiring viewpoint coordinates of the mobile phone 100 according to an embodiment of the present application;

FIG. 6B is the second schematic diagram of acquiring viewpoint coordinates of the mobile phone 100 according to an embodiment of the application;

6C is a schematic diagram of a user graphical interface of the mobile phone 100 according to an embodiment of the present application;

FIG. 7 is a schematic flowchart of a possible determination of the coordinates of a user's finger provided by an embodiment of the present application;

FIG. 8A is a schematic diagram of acquiring finger coordinates of the mobile phone 100 according to an embodiment of the application;

FIG. 8B is a schematic diagram of a user graphical interface of the mobile phone 100 according to an embodiment of the present application;

9A is a schematic diagram of a user graphical interface of a mobile phone 100 according to an embodiment of the present application;

FIG. 9B is a schematic diagram of a user graphical interface of the mobile phone 100 according to an embodiment of the application;

FIG. 10 is a schematic diagram of a user graphical interface of a mobile phone 100 according to an embodiment of the application;

FIG. 11 is a schematic diagram of a user graphical interface of a mobile phone 100 according to an embodiment of the application;

12A is a schematic diagram of a possible game interface provided by an embodiment of the application;

FIG. 12B is a schematic diagram of another possible game interface provided by an embodiment of the application;

FIG. 13 is a schematic diagram of a user graphical interface of a mobile phone 100 according to an embodiment of the application;

14 is a schematic diagram of a user graphical interface for implementing one-handed operation with multiple devices according to an embodiment of the application;

FIG. 15 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed ways

FIG. 1A shows a scene diagram of a user operating an electronic device with one hand, where the electronic device is a mobile phone as an example. A graphical user interface (graphical user interface, GUI) of the electronic device in FIG. 1A is displayed on the electronic device 101 with icons of a plurality of application programs (application, APP). When the user holds the electronic device with one hand, if the user needs to control the area that is far away from the finger currently used for operation by the user (for example, the APP1 icon above the operation interface 101 shown in FIG. Operating on these areas makes the user experience poor.

In order to allow the user to operate the electronic device with one hand more conveniently, some electronic devices may provide a one-handed operation mode.

For a specific example, please refer to FIG. 1B . In FIG. 1B , after the electronic device detects an operation for sliding from top to bottom on the screen, in response to the operation, it is determined to activate the one-handed mode, and the operation interface 101 is reduced as a whole. , and display it in the display area close to the operation position (ie, the user's finger) to obtain the operation interface 102 shown in FIG. 1B . In this display mode, the reduction ratio of the operation interface 102 set by the electronic device relative to the operation interface 101 is fixed. If the screen of the electronic device is large or the user's fingers are short, the user still has the problem of inconvenient one-handed operation.

For another specific example, see FIG. 1C , when the electronic device detects two consecutive click operations on the start key of the electronic device within a preset time period, it moves the operation interface 101 of the electronic device down to the electronic device The operation interface 103 is obtained, but in this way, the operation interface 101 is only reduced in the vertical direction, and the operation interface 101 is not reduced in the horizontal direction. For example, in FIG. 1C , the user holds the electronic device with the right hand, and the thumb of the right hand cannot touch the area where the APP1 icon is located, and there is still a problem of poor user experience.

In view of this, an embodiment of the present application provides an interface display method. After the electronic device detects the first operation, it enters a one-handed operation mode. In the one-handed operation mode, the electronic device obtains the coordinates of the finger and the first viewpoint coordinates, and The first display content in the first display area corresponding to the coordinates of the first viewpoint is displayed in the second display area corresponding to the coordinates of the finger (ie, the operable range of the finger). In this way, the user only needs to control the position of the viewpoint, and can operate the application icon or control icon located at any position in the operation interface with one hand in the same area, which improves the user experience. The specific implementation manner of this technical solution will be described in detail later.

First, some terms in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

An application program (application, app for short) involved in the embodiments of the present application is a software program capable of implementing one or more specific functions. Typically, multiple applications can be installed in an electronic device. For example, camera application, gallery application, SMS application, MMS application, various mailbox applications, WeChat, Tencent chat software (QQ), WhatsApp Messenger, Link (Line), photo sharing (instagram), Kakao Talk, DingTalk, etc. The application program mentioned below may be an application program installed when the terminal leaves the factory, or it may be an application program downloaded from the network or acquired by other terminals when the user uses the electronic device.

The operation interface involved in the embodiments of the present application may also be referred to as a user interface (User Interface, UI) or a graphical interface, or other names. The operation interface is an interface between an electronic device and a user for human-computer interaction. Output information, such as displaying images or text, etc., can also receive user operations through the operation interface, such as receiving user touch operations. For example, the operation interface 101 in FIG. 1A , or the operation interface 102 in FIG. 1B , or the operation interface 103 in FIG. 1C , or the operation interface 901 in FIG. 9A or FIG. 9B , or the operation interface 1001 in FIG. 10 , or The operation interface 1101 and the like in FIG. 11 are all operation interfaces.

The application icons involved in the embodiments of the present application are graphics with explicit meanings, which explicitly refer to an application. Application icons can be displayed on the desktop (or on the home screen interface) of the electronic device. The electronic device detects the click operation on these application icons, and can run the corresponding application program and start the corresponding application process. For example, assuming that the APP1 icon in FIG. 1A is an application icon of WeChat, when the mobile phone detects a click operation on the APP1 icon, it runs WeChat and starts WeChat.

The control icon (referred to as the control) involved in the embodiment of the present application may be an icon in the interface of a certain application used to implement a specific function of the application. The electronic device detects a click operation on the control icon and can start the certain application. The corresponding child process under each application. For example, when the game application has been started in FIG. 12A, the mobile phone detects a click or long-press operation on the control ① in the game application operation interface, and can start the process of controlling the forward direction of the game character in the game application.

The one-handed operation mode involved in the embodiments of the present application is an interface display mode set for the convenience of the user to operate any icon in the display interface with one hand. In this interface display mode, the electronic device can display the coordinates of the user's viewpoint The display content in the corresponding display area is displayed in the display area corresponding to the coordinates of the user's finger. For example, in FIG. 9A , the APP8 icon corresponding to the viewpoint coordinates is displayed in the display area corresponding to the finger coordinates, that is, the operation interface 901 shown in (b) of FIG. 9A .

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

The multiple involved in the embodiments of the present application refers to greater than or equal to two. It should be noted that the term "and/or" in this document is only an association relationship to describe associated objects, indicating that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, and A exists at the same time and B, there are three cases of B alone. In addition, the character "/" in this text, unless otherwise specified, generally indicates that the related objects before and after are an "or" relationship. In the description of the embodiments of the present application, words such as "first" and "second" are only used for the purpose of distinguishing and describing, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying order.

The following describes an electronic device for executing the interface display method provided by the embodiments of the present application, a graphical user interface (GUI) for such an electronic device, and an embodiment for using such an electronic device. In some embodiments of the present application, the electronic device may be a portable terminal including a display screen, such as a mobile phone, a tablet computer, and the like. Exemplary embodiments of portable electronic devices include, but are not limited to, carry-on

Or portable electronic devices with other operating systems. The above-mentioned portable electronic device may also be other portable electronic device, such as a digital camera. It should also be understood that, in some other embodiments of the present application, the above-mentioned electronic device may not be a portable electronic device, but a desktop computer having a display screen or the like.

Typically, electronic devices can support multiple applications. For example, one or more of the following applications: messaging applications, instant messaging applications, gaming applications, etc. Among them, there may be many kinds of instant messaging applications. Such as WeChat (Wechat), Weibo, Tencent chat software (QQ), WhatsApp Messenger, Lianme (Line), photo sharing (Instagram), Kakao Talk, DingTalk, etc. Users can send text, voice, pictures, video files and other various files to other contacts (or other contacts) through instant messaging applications; or, users can communicate with other contacts through instant messaging applications video or audio call.

Hereinafter, the electronic device is a mobile phone as an example, and FIG. 2A shows a schematic structural diagram of the mobile phone 100 .

The mobile phone 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, Mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and user Identity module (subscriber identification module, SIM) card interface 195 and so on. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an orientation sensor 180C, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a touch sensor 180K, a bone conduction sensor 180M, and the like.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

The controller may be the nerve center and command center of the mobile phone 100 . The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.

The processor 110 may run the software code of the interface display method provided by the embodiment of the present application, so as to realize the one-hand operation mode of the mobile phone 100 .

The USB interface 130 is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 130 can be used to connect a charger to charge the mobile phone 100, and can also be used to transmit data between the mobile phone 100 and peripheral devices.

The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives input from the battery 142 and/or the charging management module 140 and supplies power to the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 .

The wireless communication function of the mobile phone 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in handset 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the mobile phone 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .

The wireless communication module 160 can provide applications on the mobile phone 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify the signal, and convert it into electromagnetic waves for radiation through the antenna 2 .

In some embodiments, the antenna 1 of the mobile phone 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the mobile phone 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc. The GNSS may include global positioning system (global positioning system, GPS), global navigation satellite system (global navigation satellite system, GLONASS), Beidou navigation satellite system (beidou navigation satellite system, BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite based augmentation systems (SBAS).

The mobile phone 100 realizes the display function through the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 194 is used to display images, videos, application icons, control icons, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light). emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on. In some embodiments, the handset 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. Exemplarily, the display screen 194 may be used to display an operation interface provided by an embodiment of the present application (eg, the operation interface 901 shown in FIG. 9A ), and application icons or control icons in the operation interface.

Camera 193 is used to capture still images or video. The camera 193 may include a front camera and a rear camera. Exemplarily, the camera 193 may be used to capture an image of the user's face. Optionally, the front camera may be an infrared camera, which may be used to capture infrared light reflected from the user's eyes and generate a depth image of the eyes.

Internal memory 121 may be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the mobile phone 100 by executing the instructions stored in the internal memory 121 . The internal memory 121 may include a storage program area and a storage data area. Wherein, the storage program area can store the operating system, and the software code of at least one application (such as game application, WeChat application, etc.). The storage data area can store data (such as images, videos, etc.) and the like generated during the use of the mobile phone 100 . In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.

The internal memory 121 may also store software codes of the interface display method provided by the embodiments of the present application. When the processor 110 executes the software codes, the process steps of the interface display method are executed to realize a one-handed operation mode.

The internal memory 121 can also store information generated or received by the electronic device during operation, such as user-defined shortcut gesture information for entering the one-hand operation mode, face image, viewpoint coordinates, finger coordinates, fingerprint information, and the like.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 100 . The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example to save files like music, video etc in external memory card.

Of course, the software code of the interface display method provided in the embodiment of the present application may also be stored in an external memory, and the processor 110 may run the software code through the external memory interface 120 to execute the process steps of the interface display method to realize the one-handed operation mode . The user's face information, viewpoint coordinates, finger coordinates, etc. collected by the mobile phone 100 may also be stored in an external memory.

The mobile phone 100 can implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor. Such as answering calls, recording, etc.

The pressure sensor 180A is used to sense pressure signals, and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be provided on the display screen 194 . In some embodiments, the mobile phone 100 can detect the click operation on the display screen 194 or on the application icon in the operation interface displayed on the display screen 194 through the pressure sensor 180A. In other embodiments, the pressure sensor 180A may be used to detect the shortcut gestures determined by the bone joint for the sliding operation of the display screen 194, for example, the shortcut gesture letters "Z" and "C" in FIG. 4B.

The gyroscope sensor 180B can be used to determine the motion attitude of the mobile phone 100 . In some embodiments, the angular velocity of the mobile phone 100 around three axes (ie, the x, y and z axes) can be determined by the gyro sensor 180B to determine whether the mobile phone 100 is lifted.

The orientation sensor 180C can detect the absolute attitude value of the mobile phone 100 , and then determine the angle change of the mobile phone 100 .

The acceleration sensor 180E can detect the magnitude of the acceleration of the mobile phone 100 in various directions (generally three axes). When the mobile phone 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc. In some possible embodiments, together with the direction sensor 180C, it can also detect whether the mobile phone 100 is lifted.

Distance sensor 180F for measuring distance. The cell phone 100 can measure the distance through infrared or laser. In some embodiments, when shooting a scene, the mobile phone 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The light emitting diodes may be infrared light emitting diodes. The mobile phone 100 emits infrared light through the light emitting diodes. Cell phone 100 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the mobile phone 100 . When insufficient reflected light is detected, the cell phone 100 may determine that there is no object near the cell phone 100 . The mobile phone 100 can use the proximity light sensor 180G to detect that the user holds the mobile phone 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in holster mode, pocket mode automatically unlocks and locks the screen.

Optionally, when the proximity light sensor 180G is an infrared light sensor, the distance between the user's eyes and the screen 194 and the coordinates of the user's finger relative to the display screen 194 can also be obtained through infrared light emitting diodes.

The fingerprint sensor 180H is used to collect fingerprints. The mobile phone 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering incoming calls with fingerprints, and the like. In a possible embodiment, the size of the fingerprint sensor 180H may be the same as the size of the display screen 194. After the mobile phone 100 obtains the coordinates of the user's finger, the display screen 194 displays the fingerprint unlock pattern in the display area corresponding to the coordinates of the finger, and the mobile phone 100 Detecting the click operation for the fingerprint unlocking pattern, the fingerprint sensor 180H is activated, the fingerprint sensor 180H starts to collect the fingerprint information of the user, and the fingerprint sensor 180H sends the collected fingerprint information to the processor 100, and the processor 100 stores the fingerprint information according to the internal memory 121. The fingerprint information of the user matches the fingerprint information. If the matching is successful, the unlocking application process is started. If the matching is unsuccessful, the screen lock mode is continued.

Touch sensor 180K, also called "touch panel". The touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor 180K may pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to touch operations may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the mobile phone 100 , which is different from the position where the display screen 194 is located. For example, the touch sensor 180K detects a touch action on the display screen 194, and the coordinates of the user's finger can be determined.

The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M can also contact the pulse of the human body and receive the blood pressure beating signal.

The keys 190 include a power-on key, a volume key, and the like. Keys 190 may be mechanical keys. It can also be a touch key. The cell phone 100 can receive key input and generate key signal input related to user settings and function control of the cell phone 100 . In a possible embodiment, the mobile phone 100 detects multiple click operations on the button 190 within a preset time period, and starts the one-handed operation mode of the mobile phone 100 .

Motor 191 can generate vibrating cues. The motor 191 can be used for vibrating alerts for incoming calls, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as answering a call, playing audio, etc.) can correspond to different vibration feedback effects.

The indicator 192 can be an indicator light, which can be used to indicate the charging state, the change of the power, and can also be used to indicate a message, a missed call, a notification, and the like.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be contacted and separated from the mobile phone 100 by being inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 .

It can be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the mobile phone 100 . In other embodiments of the present application, the mobile phone 100 may include more or less components than shown, or some components may be combined, or some components may be separated, or different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The hardware structure of the mobile phone 100 is described above, and the software structure of the mobile phone 100 is described below.

Specifically, the software system of the mobile phone 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiments of the present application take an Android system with a layered architecture as an example to illustrate the software structure of the mobile phone 100 as an example. The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces.

Referring to FIG. 2B, in some possible embodiments, the Android system is divided into four layers, from top to bottom, the applications layer (hereinafter referred to as the "application layer"), the application framework (Application Framework) layer (herein referred to as "framework layer"), Android runtime (Android runtime) and system library layer (herein referred to as "system runtime layer"), and kernel layer.

Among them, at least one application program runs in the application program layer, and these application programs can be a Window program, a system setting program, a contact program, a short message program, a clock program, a camera application, etc. Applications developed by third-party developers, such as instant messaging programs, photo enhancement programs, game programs, etc. Of course, during specific implementation, the application package in the application layer is not limited to the above examples, and may actually include other application packages, which are not limited in this embodiment of the present application.

The framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center, which decides to let the applications in the application layer take action.

As shown in Figure 2B, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

A window manager is used to manage window programs. The window manager can get the size of the display screen and control the change of the display window. For example, in FIG. 9A and FIG. 9B, a selected part of the display content is displayed in a separate display window (eg, the operation interface 901). For another example, in FIG. 11, the mobile phone 100 detects a sliding operation for the operation interface 1101 (ie, the display window). The icons in the operation interface 1101 are displayed in reduced or enlarged size. The window manager can also tell if there is a status bar, lock screen, screen capture, etc. Content providers are used to store and retrieve data and make these data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.

The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. View systems can be used to build applications. A display interface (eg, the operation interface 101 shown in FIG. 1B , or the operation interface 901 shown in FIG. 9A ) may be composed of one or more views.

The phone manager is used to provide the communication function of the mobile phone 100 . For example, the management of call status (including connecting, hanging up, etc.). The resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on.

The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a brief pause without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also display notifications in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and notifications on the screen in the form of dialog windows. For example, text information is prompted in the status bar, a prompt sound is issued, the electronic device vibrates, and the indicator light flashes.

Exemplarily, as shown in FIG. 4D , when the mobile phone 100 detects multiple click operations on the operation interface 301 displayed on the display screen 194 but no application process is triggered, the notification manager controls the display 194 and displays the dialog 302 .

The system runtime layer provides support for the upper layer, that is, the framework layer. When the framework layer is used, the Android operating system will run the C/C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.

The kernel layer is the layer between hardware and software. As shown in FIG. 2B , the core layer at least includes a display driver, a sensor driver (such as an infrared light sensor, a touch sensor, a pressure sensor, etc.), a camera driver, an audio driver, and the like.

For ease of understanding, the following embodiments of the present application will take the mobile phone 100 having the structure shown in FIG. 2A and FIG. 2B as an example, and specifically describe the interface display method provided by the embodiments of the present application with reference to the accompanying drawings.

Please refer to FIG. 3 , which is a schematic flowchart of an interface display method provided by an embodiment of the present application. As shown in Figure 3, the method may include the following steps:

S301: The mobile phone 100 receives the first operation, and in response to the first operation, enters a one-handed operation mode.

The first operation is an operation to trigger the mobile phone 100 to enter the one-hand operation mode.

After the mobile phone 100 receives the first operation, the processor 110 in the mobile phone 100 can control the display screen 194 to display an operation interface that can be operated by the user with one hand in a one-handed operation mode. , parameter control icons, function control icons in an application, etc.), users can operate with one hand. For specific plans, see the introduction below.

Wherein, there are various specific implementation manners of the first operation, including but not limited to the following:

Mode 1, lift up the mobile phone 100 .

In Mode 1, the first operation is an operation of lifting the mobile phone 100 to be lifted.

Exemplarily, the mobile phone 100 can detect whether the mobile phone 100 is lifted through the acceleration sensor 180E and the direction sensor 180C.

Specifically, when the mobile phone 100 is lifted, the acceleration sensor 180E converts the detected signal into information that can be processed by the processor 110 and transmits it to the processor 110, and the kernel layer running in the processor 110 generates corresponding acceleration data based on the information The direction sensor 180C converts the detected signal into information that the processor 110 can process and transmits it to the processor 110, and the kernel layer running in the processor 110 generates the angle change data of the mobile phone 100 relative to its own horizontal axis based on this information; The kernel layer determines that the difference between the acceleration data and the preset acceleration data exceeds a preset threshold, and determines that the angle change data satisfies a preset condition (for example, the angle value changes from 0 to 180), then it is determined that the mobile phone 100 is lifted, The processor 110 controls the display screen 194 to enter a one-handed operation mode.

Optionally, after the mobile phone 100 detects that the mobile phone 100 is lifted, it may continue to detect whether there is a click operation or a shaking operation on the display screen 194 of the mobile phone 100, and if so, enter the one-handed operation mode. In this way, user misoperations can be effectively avoided, thereby improving user experience.

4A , the mobile phone 100 detects that the mobile phone 100 is lifted through the acceleration sensor detection 180E, and detects a double-tap action or a shaking action on the display screen 194, and the processor 110 controls the display screen 194 to enter one hand. operating mode.

Method 2, shortcut gestures.

In Mode 2, the first operation is a user-defined shortcut gesture.

Exemplarily, the mobile phone 100 can detect the shortcut gesture through the pressure sensor 180A.

Specifically, the pressure sensor 180A converts the detected signal into information that can be processed by the processor 110 and transmits it to the processor 110, and the kernel layer running in the processor 110 generates the position data (specifically, the contact point) corresponding to the operation based on the information. coordinates, time stamps corresponding to contact coordinates, etc.); the kernel layer draws the data of the shortcut gesture according to the finger position data collected within the first preset time period, and determines the data of the shortcut gesture and the preset stored in the internal memory 121. Whether the data of the shortcut gesture matches, if so, the processor 110 controls the display screen 194 to enter the one-hand operation mode.

4B, it is assumed that the internal memory 121 of the mobile phone 100 stores shortcut gestures (the letter Z and the letter C) customized by the user according to their own preferences. As shown in (a) of FIG. 4B , when the processor 110 in the mobile phone 100 detects the letter Z through the pressure sensor 180A, the processor 110 controls the display screen 194 to enter the one-hand operation mode. As shown in (b) of FIG. 4B , when the processor 110 in the mobile phone 100 detects the letter Z through the pressure sensor 180A, the processor 110 controls the display screen 194 to enter the one-hand operation mode.

Mode 3, voice command.

In mode 3, the first operation may be sound information.

Specifically, the audio module 170 converts the detected sound signal into information that can be processed by the processor 110 and transmits it to the processor 110, and the kernel layer running in the processor 110 generates sound instruction data corresponding to the operation based on the information. The kernel layer matches the voice command data collected within the preset duration with the preset voice command data. If the matching is successful, the processor 110 controls the display screen 194 to enter the one-hand operation mode; if the matching is unsuccessful, the original display is maintained. model.

For example, referring to FIG. 4C , assuming that the internal memory 121 of the mobile phone 100 stores a preset voice command “turn on the one-handed mode”, when the processor 110 in the mobile phone 100 detects the “turn on the one-handed mode” through the audio module 170 In the case of a voice command, the processor 110 controls the display screen 194 to enter the one-hand operation mode.

Mode 4, key operation.

In Mode 4, the first operation may be an operation on a hardware control (eg, key 190 ) of the mobile phone 100 .

The key 190 may be a power key or a volume key, which is not limited in this embodiment of the present application. Specifically, the first operation may be two click operations on the button 190 detected by the mobile phone 100 within a preset duration, or three click operations, or a touch operation, which is not specifically limited in this embodiment of the present application.

Exemplarily, when the mobile phone 100 detects two click operations on the power key within a preset time period, the processor 110 controls the display screen 194 to enter the one-handed operation mode.

Method 5, click operation or touch operation.

In Mode 5, the first operation may be multiple click operations or touch operations on the display screen 194 within a preset time period. Specifically, the touch sensor 180K in the display screen 194 detects the multiple click operations and touch operations, and the touch sensor 180K converts the detected signals into information that can be processed by the processor 110 and transmits it to the processor 110 , and the processor 110 It is determined that the multiple click operation or touch operation does not trigger any application process, and the processor 110 controls the window manager to output a dialog box for asking the user whether to enter the one-handed operation mode (refer to the dialog box 402 shown in FIG. 4D ), If the processor 110 detects a confirmation command, the display screen 194 is controlled to enter the one-hand operation mode, and if the processor 110 detects a negative command, the display screen 194 is controlled to maintain the original display mode.

For the five methods provided above, the user can set it according to his own needs in the auxiliary function in the setting application program of the mobile phone 100 .

It should be understood that the above five manners are merely examples rather than limitations, and other specific implementation manners are also possible in practical applications.

S302: The mobile phone 100 obtains the coordinates of the viewpoint and the coordinates of the finger.

It should be understood that the viewpoint coordinates in this embodiment of the present application are used to represent the specific position where the user's line of sight falls on the display screen 194 of the mobile phone 100 .

The viewpoint coordinate system can be a two-dimensional coordinate system, and the two-dimensional plane corresponding to the two-dimensional coordinate system can be the plane where the display screen 194 of the mobile phone 100 is located. Based on pupil corneal vector reflection technology, visual tracking technology based on 3D eyeball model, etc.

Optionally, after the mobile phone 100 determines the coordinates of the viewpoint, it can also be judged whether the time that the user's line of sight resides at the position where the coordinates of the viewpoint are located exceeds the first time threshold, and if so, the mobile phone 100 obtains the coordinates of the user's finger; If it exceeds, the mobile phone 100 continues to detect the coordinates of the new viewpoint until the viewpoint coordinates for which the dwell time of the user's sight exceeds the first time threshold occurs, and then obtains the coordinates of the user's finger. In this way, the obtained viewpoint coordinates are more accurate and closer to the viewpoint coordinates of the target that the user actually wants to operate.

It should be understood that the finger coordinates in this embodiment of the present application are used to represent the position information of the projection of the user's finger on the display screen 194 of the mobile phone 100 or the position information of the contact point between the user's finger and the display screen 194 on the display screen 194 .

It can be understood that the coordinates of the user's finger may be three-dimensional coordinates or two-dimensional coordinates, which are not specifically limited in the embodiments of the present application. When the finger coordinates are two-dimensional coordinates, the finger coordinate system and the viewpoint coordinate system may be the same coordinate system.

There are various specific implementations for the mobile phone 100 to obtain the coordinates of the finger, which are not limited in this application.

Example 1, the mobile phone 100 detects the position data corresponding to the touch operation through the touch sensor 180K (specifically may include contact coordinates, time stamps corresponding to the contact coordinates, etc.), and then determines the coordinates of the user's finger.

Example 2. The mobile phone 100 emits infrared rays through the infrared optical sensor, detects the infrared light reflected by the finger, and determines the coordinates of the user's finger.

S303: The mobile phone 100 acquires the first display content of the first display area corresponding to the viewpoint coordinates, and displays the first display content to the second display area corresponding to the finger coordinates.

Specifically, the mobile phone 100 obtains the user's viewpoint coordinates and finger coordinates and converts them into information that the processor 110 can process. the first display content of the first display area, and generate a new display window according to the first display content; the processor 110 controls the display screen 194 to display the new display window in the second display area corresponding to the finger coordinates.

In a possible implementation manner, the first display area may be a circular display area with the viewpoint coordinates as the center and the radius as the first preset value; in another possible implementation manner, the first display area may be A display area of a square whose center is the coordinate of the viewpoint and whose side length is the second preset value. Of course, the above two are only examples and not limitations.

Optionally, the first display content may include at least one application icon or control icon. The specific content may be determined according to the display content of the first display area where the viewpoint coordinates are located.

Optionally, when the mobile phone 100 detects a click operation on any application icon or control icon in the first display content, the mobile phone 100 determines the icon as the target icon, and starts the process corresponding to the target icon.

Optionally, after the mobile phone 100 determines the coordinates of the viewpoint and the coordinates of the finger, it can also be judged whether the time that the user's line of sight resides at the position of the coordinates of the viewpoint exceeds the second time threshold. Display to the second display area; if not exceeded, the mobile phone 100 continues to detect the new viewpoint coordinates, until there is a viewpoint coordinate where the user's sight dwell time exceeds the second time threshold, the mobile phone 100 displays the first display content to the second display area. In this way, the acquired first display content is more accurate and closer to the display content that the user actually wants to operate.

As can be seen from the above, in the embodiment of the present application, after detecting the first operation, the mobile phone 100 enters the one-handed operation mode. In the one-handed operation mode, the mobile phone 100 can obtain the coordinates of the user's viewpoint and finger, and use the coordinates of the viewpoint to The first display content in the corresponding first display area is displayed in the second display area corresponding to the finger coordinates. It can effectively solve the technical problem of inconvenient mobile phones for users with one hand, and effectively improve the user experience.

The following introduces a method for determining the coordinates of a viewpoint provided by an embodiment of the present application. Referring to Figure 5, the method includes:

S501: The mobile phone 100 detects the face image of the user.

Specifically, the processor 110 in the mobile phone 100 starts the camera 193, and the camera 193 captures environmental image data around the mobile phone 100, converts the environmental image data into information that can be processed by the processor 110, and transmits it to the processor 110; 110 determines whether there is human face data in the environmental image data, if there is human face data, the processor 110 continues to execute S502; if there is no human face data, the processor 110 controls the display screen 194 to exit the one-handed operation mode.

Optionally, before the mobile phone 100 performs step S502, the legitimacy of the user identity may be further verified. The specific implementations for verifying the legitimacy of the user identity include but are not limited to the following three ways:

Mode 1: The processor 110 in the mobile phone 100 determines whether the face image in the environmental image data matches the stored face image, and if so, executes S402; if not, controls the display screen 194 to exit the one-handed operation mode.

Mode 2: The processor 110 in the mobile phone 100 detects the user's voiceprint information, and determines whether the current user's voiceprint information matches the stored voiceprint information. If it matches, execute S402; if not, control the display screen 194 to exit One-handed operation mode.

Mode 3: The processor 110 in the mobile phone 100 detects the iris information of the user, and judges whether the iris information of the current user matches the stored iris information, if so, execute S402; if not, control the display screen 194 to exit the one-handed operation model.

S502: The mobile phone 100 determines the distance between the user's eyes and the infrared camera, as well as the coordinates of the corneal reflection spot and the center of the pupil.

Specifically, referring to FIG. 6A , the processor 110 in the mobile phone 100 activates the infrared light sensor in the kernel layer and the infrared camera arranged in the center of the upper edge of the display screen 194; The face emits infrared rays; the infrared camera captures the light returned by the user's eyes, converts the light data into information that can be processed by the processor 110 and transmits it to the processor 110; the processor 110 controls the processor 110 to run according to the information The image processing library in the system library of the system library generates the depth image of the user's eyes; the processor 110 processes the depth image according to the algorithm (for example, the coordinate transformation algorithm) stored in the internal memory 121, and then determines the user's eyes and the infrared camera. When the user's eyes move relative to the infrared camera, the processor 110 can also determine the corneal reflection spot coordinates and the pupil center coordinates according to algorithms such as pupil segmentation, pupil coarse positioning, edge extraction, and edge fitting.

S503: The mobile phone 100 determines the coordinates of the user's viewpoint according to the distance, the coordinates of the corneal reflection spot, and the coordinates of the pupil center.

In a possible implementation, referring to FIG. 6A , the mobile phone 100 takes the center point of the upper edge of the display screen 194 as the origin, and the upper edge of the display screen 194 is the Y axis, passing through the center point of the upper edge of the display screen 194 and perpendicular to the display screen 194 The straight line on the upper edge is used as the X-axis, and the mobile phone 100 can determine the position of the user's line of sight relative to the display screen 194 according to the distance between the user's eyes and the infrared camera, the coordinates of the corneal reflection spot, and the center coordinates of the pupil (ie, the coordinates of the viewpoint) . Specifically, the processor 110 may acquire the offset of the corneal reflection spot relative to the center of the pupil in the depth image of the eye, and determine the first position of the user's line of sight in the world coordinate system according to the preset mapping relationship between the offset and the viewpoint coordinates. A coordinate; the processor 110 then performs matrix transformation on the first coordinate according to the distance between the user's eyes and the infrared camera, and then obtains the viewpoint coordinates (Ex, Ey) of the user's line of sight relative to the display screen 194 . The processor 110 determines the position information corresponding to the viewpoint coordinates, and controls the display screen 194 to display prompt information (eg, a cursor) at the position corresponding to the viewpoint coordinates.

In another possible implementation, referring to FIG. 6B , the processor 110 of the mobile phone 100 activates the human eye viewpoint tracking sensor, and the human eye viewpoint tracking sensor acquires viewpoint coordinates (Ex, Ey) and converts them into the processor 110 can process The information is sent to the processor 110; the processor 110 determines the position information corresponding to the viewpoint coordinates, and controls the display screen 194 to display prompt information (eg, a floating icon) at the position corresponding to the viewpoint data.

Optionally, the human eye tracking sensor and the obtained viewpoint coordinates are converted into information that can be processed by the processor 110 and transmitted to the processor 110; the processor 110 controls the window manager in the application framework layer that the processor 110 runs. Obtain the display content within the preset range corresponding to the coordinates of the viewpoint. For example, referring to FIG. 6C , the processor 110 determines that the coordinate of the viewpoint falls on the APP8 icon, and the mobile phone 100 obtains the display information corresponding to the icon APP8 (ie, the content of the dotted box).

The following introduces a method for determining the coordinates of a finger provided by an embodiment of the present application. Referring to Figure 7, the method includes:

S701: The mobile phone 100 emits infrared rays to the user's finger.

Optionally, before the mobile phone 100 executes S701-S702, the processor 110 in the mobile phone 100 may control the front camera of the mobile phone 100 to start, and the front camera starts to collect the surrounding environment image data, and converts the environment image data into The information that can be processed by the processor 110 is transmitted to the processor 110; the processor 110 executes the finger recognition program stored in the internal memory 121, if it is determined that there are multiple fingers in the environmental image data, and the multiple fingers include the user's thumb , the processor 110 executes S701-S702 to obtain the coordinates of the thumb; if it is determined that there is only one finger in the environmental image data, the processor 110 executes S701-S702 to obtain the coordinates of the finger.

Optionally, the user's finger may be a finger closest to the display screen 194 .

Specifically, before transmitting infrared rays to the user's finger, the mobile phone 100 determines whether the distance between the finger and the screen 194 is less than a preset value through the built-in gesture tracking sensor of the mobile phone 100. If it is less than the preset value, the mobile phone 100 performs step S701, If not less than the preset value, the processor in the mobile phone 100 controls the display screen 194 to exit the one-handed operation mode.

S702: The mobile phone 100 receives the infrared light reflected by the finger.

Specifically, the processor 110 in the mobile phone 100 activates the infrared optical sensor in the kernel layer where the processor 110 runs, and the infrared optical sensor controls the infrared light-emitting diode inside it to emit infrared rays to the user's finger, and receives the infrared rays returned by the finger. Light.

S703: The mobile phone 100 determines the coordinates of the finger according to the infrared light reflected by the finger.

Specifically, referring to FIG. 8A , the infrared light sensor is disposed at the center point of the upper edge of the display screen 194 , and the two infrared light emitting diodes in the infrared light sensor are disposed on both sides of the center point of the upper edge of the display screen 194 respectively. After the infrared sensor receives the infrared light information reflected by the finger, the processor 110 in the mobile phone 100 can determine the first distance between the finger and the infrared light sensor according to the formula S=((t2-t1)c)/2, where t1 is the moment when the infrared sensor emits infrared rays to the finger, t2 is the moment when the infrared sensor receives the infrared light reflected by the finger, c is the speed of light, and S is the first distance between the finger and the infrared light sensor.

Further, the processor 110 obtains the second distance of the finger from the display screen 194 according to the built-in gesture tracking sensor, and the processor 110 performs geometric operations on the first distance and the second distance to obtain the projection point of the finger on the display screen 194 and The third distance from the center point of the upper edge of the display screen 194; the processor 110 controls the infrared camera to take an image of the finger, and determines the position of the finger relative to the infrared light sensor according to the image; and then the processor 110 can determine the finger relative to the display screen. 194 The coordinates of the center point (ie, the infrared light sensor) and the orientation of the finger relative to the infrared light sensor determine the coordinates of the finger. For example, as shown in FIG. 8A , the second distance is Ez, the third distance is Ex, and the user's finger is located in the true north direction of the infrared light sensor, the finger coordinates are (Ex, 0, Ez). The finger coordinates here are three-dimensional coordinates. Referring to FIG. 8B , after the coordinates of the user's finger are determined, a corresponding icon may be displayed on the display screen 194 of the mobile phone 100 .

Optionally, when the mobile phone 100 is not unlocked, the mobile phone 100 can also acquire the coordinates of the user's finger by the infrared light sensor, and control the display screen 194 to display a fingerprint unlock icon on the operable interface corresponding to the coordinates of the finger. The touch sensor 180K of the mobile phone 100 detects the touch operation for the unlock icon, converts the touch operation into an electrical signal, drives the fingerprint sensor 180H by the kernel layer, collects the user's fingerprint by the fingerprint sensor 180H, and uses the fingerprint and the stored fingerprint. Make a match, and after the match is successful, enter the unlock mode. With this implementation, the position of the fingerprint unlocking does not need to be fixed at a fixed position, which effectively improves the user experience.

The software and hardware workflows of the electronic device are exemplarily described below with reference to the interface display method provided by the embodiments of the present application.

The touch sensor 180K detects the sliding touch operation on the display screen 194, converts the detected signal into information that can be processed by the processor 110 and transmits it to the processor 110, and the kernel layer running in the processor 110 generates the corresponding operation based on the information. Position data (specifically may include contact coordinates, time stamps corresponding to the contact coordinates, etc.); the processor 110 determines that the multiple click operations or touch operations do not trigger any application process, and the processor 110 controls the window manager to output for querying A dialog box for whether the user enters the one-handed operation mode (refer to the dialog box 302 shown in FIG. 4D ). If the processor 110 detects the confirmation instruction, it controls the display screen 194 to enter the one-handed operation mode, and the mobile phone 100 activates the infrared camera to obtain infrared image, and transmit the infrared image to the processor 110, the processor 110 determines the user's viewpoint coordinates and finger coordinates according to the infrared image, and transmits the viewpoint coordinates and finger coordinates to the application framework layer, the view system in the framework layer The first display content in the first display area corresponding to the viewpoint coordinates and the second display area corresponding to the finger coordinates are acquired, and the first display content is displayed in the second display area.

Of course, the above only takes the first operation as a sliding touch operation detected by the touch sensor 180K as an example to illustrate the interface display method provided by the embodiment of the present application. There may also be other implementation manners during specific implementation, which are not limited in this embodiment of the present application.

To better understand the technical solutions provided by the embodiments of the present application, the following describes the interface display method in the one-hand operation mode in the embodiments of the present application in combination with several specific application scenarios.

Scenario 1 - Launch the app.

In scenario 1, there are various specific implementations for the mobile phone 100 to display the first display content in the first display area corresponding to the viewpoint coordinates to the second display area corresponding to the finger coordinates, including but not limited to the following methods:

Mode 1, when the processor 110 in the mobile phone 100 determines that the position corresponding to the viewpoint coordinates overlaps the position of an APP icon, the processor 110 of the mobile phone 100 determines the APP icon as the first display content, and displays the first display content to the position of the finger coordinates. the corresponding second display area.

9A, in (a) of FIG. 9A, the processor 110 in the mobile phone 100 determines that the position corresponding to the viewpoint coordinates overlaps the position of the APP8 icon, the mobile phone 100 uses the APP8 icon as the first display content, and controls The display screen 194 displays it in the second display area corresponding to the finger coordinates, that is, the operation interface 901 in (b) of FIG. 9A .

Optionally, the mobile phone 100 may monitor the change of the viewpoint coordinates in real time, that is, acquire the third display content in the first display area corresponding to the new viewpoint coordinates in real time, and change the display content in the second display area corresponding to the finger coordinates from the first display area. A display content is switched to a third display content.

9B, suppose the mobile phone 100 detects that the position of the viewpoint coordinates corresponds to the APP8 icon at the first moment, and detects that the position of the viewpoint coordinates corresponds to the APP9 icon at the second moment, then the finger coordinates at the first moment correspond to the APP9 icon. The APP8 icon is displayed on the operation interface 901 at the second moment, and the APP9 icon is displayed on the operation interface 901 corresponding to the finger coordinates at the second moment.

In this embodiment of the present application, the display content in the second display area (eg, the operation interface 901 ) corresponding to the coordinates of the finger may change in real time as the coordinates of the viewpoint change.

Method 2, when the processor 110 in the mobile phone 100 determines that the position of the viewpoint coordinates does not overlap with the position of any APP icon, it determines the APP icon whose distance from the position of the viewpoint coordinates is a preset value as the first display content, and the first display content is A display content is displayed to the corresponding second display area of the finger coordinates.

10, in (a) of FIG. 10, after the mobile phone 100 obtains the coordinates of the viewpoint and the coordinates of the finger, the processor 110 determines that the coordinates of the viewpoint are located between the APP8 icon and the APP13 icon, then the processor 110 The APP8 icon and the APP13 icon are determined as the first display content, and the icon APP8 and APP13 are displayed in the second display area corresponding to the finger coordinates, that is, the operation interface 1001 shown in (b) in FIG. 10 .

Optionally, after the mobile phone 100 displays the first display content in the second display area and detects a sliding operation for the second display area, the processor 110 in the mobile phone 100 can control the display screen 194 to display a new content in the second display area. Display content.

Exemplarily, in (c) of FIG. 10 , the mobile phone 100 detects a sliding operation (swiping left and right, sliding up and down, etc.) on the operation interface 1001 , and the operation interface 1001 displays the APP8 icon, APP9 icon, APP13 icon, and APP14 icon.

Optionally, after the mobile phone 100 displays the first display content in the second display area, and detects a sliding operation or a touch operation for the second display area, the processor 110 in the mobile phone 100 can control the display screen 194 in the second display area. Display the first display content after scaling at a preset scaling ratio. The zoom ratio may also be set by the user through a voice command when using the mobile phone 100 .

11 , in (a) of FIG. 11 , after the mobile phone 100 obtains the coordinates of the viewpoint and the coordinates of the finger, the processor 110 in the mobile phone 100 determines that the coordinates of the viewpoint are located between the APP8 icon and the APP13 icon, and processes The controller 110 takes the APP8 icon and the APP13 icon as the first display content, and displays the APP8 and APP13 icons on the operation interface 1101 corresponding to the coordinates of the finger. In FIG. 11(b), the mobile phone 100 detects a touch operation on the operation interface 1101, and displays the APP8 icon and the APP13 icon on the operation interface 1101 at a preset magnification ratio; in FIG. 11(c), the mobile phone 100 detects two touch operations on the operation interface 1101 within a preset time period, and displays the APP8 icon and the APP13 icon on the operation interface 1101 at a preset reduced scale.

Scenario 2 - The controls of the game interface.

In Scenario 2, further taking the mobile phone 100 as an example, the process of displaying the display content corresponding to the viewpoint coordinates to the display area corresponding to the finger coordinates by the mobile phone 100 is introduced. Specifically, before displaying the display content corresponding to the viewpoint coordinates in the second display area corresponding to the finger coordinates, the mobile phone 100 further includes: judging whether there is an application icon at the first position corresponding to the finger coordinates in the second display area corresponding to the finger coordinates or control icon; if it exists, the display content is displayed in the second position of the second display area; if it does not exist, the display content is displayed in the first position, wherein the second position and the first position are separated by the first preset value.

Please refer to (a) in FIG. 12A , (a) in FIG. 12A shows a schematic diagram of a possible game interface, in which controls ①, controls ②, controls ③, controls ④, controls are set in the game interface ⑤, control ⑥, control ⑦; wherein, the mobile phone 100 detects a click operation or a touch operation for the control ①, control ②, and control ③, and the processor 110 in the mobile phone 100 can control the walking speed of the characters in the game interface; the mobile phone 100 When a click operation or a touch operation for the control ④, control ⑤, and control ⑥ is detected, the processor 110 in the mobile phone 100 can control the characters in the game interface to make an attack action; the mobile phone 100 detects a click operation or touch operation for the control ⑦, The processor 110 in the mobile phone 100 can control the characters in the game interface to change game equipment.

Example 1, in (a) in FIG. 12A, the mobile phone 100 has turned on the one-handed operation mode, the mobile phone 100 starts to obtain the coordinates of the user's viewpoint and finger coordinates, and detects that the display area corresponding to the coordinates of the user's viewpoint includes controls ⑦ 12A in (b), the mobile phone 100 determines the display area corresponding to the user's thumb, namely the operation interface 1201, the mobile phone 100 further determines that there is a control ⑥ in the position corresponding to the thumb coordinates, and the mobile phone 100 determines the operation interface 1201 The middle distance is another position of the preset distance from the thumb coordinate, and then the mobile phone 100 displays the control ⑦ to this position, so that the user can operate with one hand.

Example 2, in (a) in FIG. 12B, the mobile phone 100 has turned on the one-handed operation mode, the mobile phone 100 starts to obtain the coordinates of the user's viewpoint and finger coordinates, and detects that the display area corresponding to the coordinates of the user's viewpoint includes controls ⑦ 12B in (b), the mobile phone 100 determines the display area corresponding to the user's thumb, namely the operation interface 1001, the mobile phone 100 further determines that there is no control ⑥ in the position corresponding to the thumb coordinates, and then the mobile phone 100 will The control ⑦ is displayed to this position, enabling the user to operate with one hand.

Scenario 3 - The user answers the phone with one hand.

Please refer to FIG. 13( a ), in FIG. 13( a ), the operation interface of the mobile phone 100 includes an answering control 1301 for instructing to reject a call and an answering control 1302 for instructing to answer a call.

When the user holds the mobile phone with the right hand, there is an incoming call reminder, and the finger of the user's right hand can only reach the answering control 1301. The mobile phone 100 detects the voice command for enabling the one-handed mode, enters the one-handed operation mode, and obtains the coordinates of the user's finger and Viewpoint coordinates; if the mobile phone 100 detects that the display area corresponding to the viewpoint coordinates contains the rejection control 1301, the icon of the rejection control 1301 is displayed to the operable range of the user's finger (for example, as shown in (b) in FIG. 13 ) ); if the display area corresponding to the coordinates of the viewpoint includes the answering control 1302, the original display mode is maintained (for example, as shown in (a) in FIG. 13 ).

It should be understood that the above embodiments are all described by taking a single device implementing the one-hand operation mode as an example. The one-hand operation method provided by the embodiments of the present application can also be applied to multiple electronic devices or a system composed of multiple electronic devices. The following is an example of application to two electronic devices.

14, taking the computer 1401 and the mobile phone 100 as an example, the computer 1401 and the mobile phone 100 are connected in communication (wired connection, Bluetooth connection, wifi connection, etc., no limitation). The computer 1401 obtains the coordinates of the user's viewpoint on the computer 1401, the mobile phone 100 obtains the coordinates of the user's finger on the mobile phone 100, and the computer 1401 displays the display content in the display area corresponding to the coordinates of the viewpoint to the operation interface 1402 on the mobile phone 100 (ie the user's finger). operative range). The process of obtaining the coordinates of the viewpoint, the coordinates of the finger, and controlling the display can be referred to above, and will not be repeated here.

In the above-mentioned embodiments of the present application, the methods provided by the embodiments of the present application are introduced from the perspective of an electronic device as an execution subject. In order to implement the functions in the methods provided by the above embodiments of the present application, the electronic device may include a hardware structure and/or software modules, and implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above functions is performed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

Based on the same technical concept, the present application further provides an electronic device 1500 for implementing the methods in the embodiments shown in FIG. 3 , FIG. 5 , and FIG. 7 . As shown in FIG. 15 , the electronic device 1500 may include a processor 1501 for executing programs or instructions stored in the memory 1502 . When the programs or instructions stored in the memory 1502 are executed, the processor is used for the interface display method shown in FIG. 3 . .

Optionally, the electronic device 1500 may further include a communication interface 1503 . FIG. 15 shows with dashed lines that the communication interface 1503 is optional to the electronic device 1500 .

The numbers of the processors 1501, the memories 1502, and the communication interfaces 1503 do not constitute a limitation on the embodiments of the present application, and can be arbitrarily configured according to business requirements during specific implementation.

Optionally, the memory 1502 is located outside the electronic device 1500 .

Optionally, the electronic device 1500 includes the memory 1502 , the memory 1502 is connected to the at least one processor 1501 , and the memory 1502 stores instructions executable by the at least one processor 1501 . FIG. 15 shows with dashed lines that memory 1502 is optional to electronic device 1500 .

The processor 1501 and the memory 1502 may be coupled through an interface circuit, or may be integrated together, which is not limited here.

The specific connection medium between the processor 1501, the memory 1502, and the communication interface 1503 is not limited in the embodiments of the present application. In this embodiment of the present application, the processor 1501, the memory 1502, and the communication interface 1503 are connected through a bus 1504 in FIG. 15. The bus is represented by a thick line in FIG. 15. The connection between other components is only for schematic illustration. , is not limited. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in FIG. 15, but it does not mean that there is only one bus or one type of bus.

It should be understood that the processor mentioned in the embodiments of the present application may be implemented by hardware or software. When implemented in hardware, the processor may be a logic circuit, an integrated circuit, or the like. When implemented in software, the processor may be a general-purpose processor implemented by reading software codes stored in memory.

Exemplarily, the processor may be a central processing unit (Central Processing Unit, CPU), or other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC) , Off-the-shelf Programmable Gate Array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

It should be understood that the memory mentioned in the embodiments of the present application may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Wherein, the non-volatile memory may be a read-only memory (Read-Only Memory, ROM), a programmable read-only memory (Programmable ROM, PROM), an erasable programmable read-only memory (Erasable PROM, EPROM), an electrically programmable read-only memory (Erasable PROM, EPROM). Erase programmable read-only memory (Electrically EPROM, EEPROM) or flash memory. Volatile memory may be Random Access Memory (RAM), which acts as an external cache. By way of illustration and not limitation, many forms of RAM are available, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data Eate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (Synchlink DRAM, SLDRAM) ) and direct memory bus random access memory (Direct Rambus RAM, DR RAM).

It should be noted that when the processor is a general-purpose processor, DSP, ASIC, FPGA or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components, the memory (storage module) can be integrated in the processor.

It should be noted that the memory described herein is intended to include, but not be limited to, these and any other suitable types of memory.

Based on the same technical concept, embodiments of the present application further provide a computer-readable medium, where the computer-readable medium stores program codes for device execution, the program codes including the interface display methods for executing the foregoing embodiments.

Based on the same technical concept, the embodiments of the present application also provide a computer program product containing instructions, when the computer program product runs on a computer, the computer can execute the interface display method in the foregoing embodiments.

Based on the same technical concept, an embodiment of the present application further provides a chip, the chip includes a processor and a data interface, the processor reads the instructions stored in the memory through the data interface, and executes the interface display in the foregoing embodiments. method.

In a possible design, the chip may further include a memory, in which instructions are stored, the processor is configured to execute the instructions stored in the memory, and when the instructions are executed, the processor uses to execute the interface display method in the foregoing embodiment.

It should be noted that, the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation. Each functional module in the embodiments of the present application may be integrated into one processing module, or each module may exist physically alone, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules.

The various embodiments of the present application may be used alone or in combination with each other to achieve different technical effects.

As described above, the above embodiments are only used to describe the technical solutions of the present application in detail, but the descriptions of the above embodiments are only used to help understand the methods of the embodiments of the present application, and should not be construed as limitations on the embodiments of the present application. Changes or substitutions that can be easily conceived by those skilled in the art should all fall within the protection scope of the embodiments of the present application.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be downloaded from a website site, computer, server, or data center Transmission to another website site, computer, server, or data center by wire (eg, coaxial cable, optical fiber, digital subscriber line) or wireless (eg, infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media. The usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVDs), or semiconductor media (eg, solid state drives), and the like.

For purposes of explanation, the foregoing description has been made with reference to specific embodiments. However, the exemplary discussion above is not intended to be exhaustive, nor to limit the application to the precise form disclosed. Many modifications and variations are possible in light of the above teachings. The embodiment was chosen and described in order to fully explain the principles of the application and its practical application, to thereby enable others skilled in the art to utilize the application and various implementations with various modifications as are suited to the particular use contemplated example.

Claims

An interface display method, characterized in that, applied to an electronic device, the method comprising:

receive the first operation;

in response to the first operation, initiating a one-handed operation mode;

In the one-handed operation mode, obtain the coordinates of the first viewpoint and the coordinates of the finger; obtain the first display content in the first display area corresponding to the coordinates of the first viewpoint, and display the first display content on the finger in the second display area corresponding to the coordinates.
The method of claim 1, wherein the first operation is:

the electronic device is lifted or shaken; or,

A click operation or a swipe operation on the display screen of the electronic device; or,

voice commands; or,

Operation of hardware keys for the electronic device.
The method according to claim 1 or 2, wherein after the first display content is displayed in the second display area corresponding to the finger coordinates, the method further comprises:

receiving a first sliding operation in the second display area;

According to the first sliding operation, the second display content is determined, and the display content in the second display area is switched from the first display content to the second display content.
The method according to claim 1 or 2, wherein after displaying the first display content in the second display area corresponding to the finger coordinates, the method further comprises:

Obtain the coordinates of the second viewpoint and the third display content in the third display area corresponding to the coordinates of the second viewpoint, and switch the display content in the second display area from the first display content to the third display content.
The method according to any one of claims 1-4, wherein before displaying the first display content in the second display area corresponding to the finger coordinates, the method further comprises:

judging whether there is an application icon or a control icon at the first position corresponding to the finger coordinates in the second display area;

If there is, the first display content is displayed at a second position in the second display area; the second position is separated from the first position by a first preset value;

If it does not exist, the first display content is displayed on the first position.
The method according to any one of claims 1-5, wherein before displaying the first display content in the second display area corresponding to the finger, the method further comprises: determining that the user's sight stays on the The duration of the first viewpoint coordinates exceeds the second preset value.
The method according to any one of claims 1-6, wherein the method further comprises:

A click operation on at least one target icon in the first display content is received, a first target icon is determined, and an application process corresponding to the first target icon is executed.
The method according to any one of claims 1-7, wherein, in response to the first operation, acquiring the coordinates of the first viewpoint includes:

determining the first distance between the user's eyes and the infrared camera, the coordinates of the corneal reflection spot, and the coordinates of the pupil center;

The coordinates of the first viewpoint are determined according to the first distance, the coordinates of the corneal reflection spot and the coordinates of the pupil center.
The method according to any one of claims 2-8, wherein the acquiring finger coordinates in response to the first operation comprises:

determining the second distance between the finger and the infrared light sensor in the electronic device, the third distance between the finger and the display screen, and the orientation of the finger relative to the infrared light sensor;

According to the second distance and the third distance, determine the fourth distance between the projection point of the finger on the display screen and the infrared light sensor;

The finger coordinates are determined based on the fourth distance and the orientation.
An electronic device, characterized in that the electronic device comprises: a processor and a memory; wherein the memory is used to store one or more computer programs;

When executed by the processor, one or more computer programs stored in the memory cause the electronic device to perform the following steps:

receive the first operation;

in response to the first operation, initiating a one-handed operation mode;

In the one-handed operation mode, obtain the coordinates of the first viewpoint and the coordinates of the finger; obtain the first display content in the first display area corresponding to the coordinates of the first viewpoint, and display the first display content on the finger in the second display area corresponding to the coordinates.
The electronic device according to claim 10, wherein the electronic device further comprises a display screen, and the first operation is:

the electronic device is lifted or shaken; or,

A tap operation or a swipe operation on the display screen; or,

voice commands; or,

Operation of hardware keys for the electronic device.
The electronic device according to claim 10 or 11, wherein when one or more computer programs stored in the memory are executed by the processor, the electronic device is further caused to perform the following steps:

receiving a first sliding operation in the second display area;

According to the first sliding operation, the second display content is determined, and the display content in the second display area is switched from the first display content to the second display content.
The electronic device according to claim 10 or 11, wherein when one or more computer programs stored in the memory are executed by the processor, the electronic device is further caused to perform the following steps:

Obtain the coordinates of the second viewpoint and the third display content in the third display area corresponding to the coordinates of the second viewpoint, and switch the display content in the second display area from the first display content to the third display content.
The electronic device according to any one of claims 10-13, wherein when one or more computer programs stored in the memory are executed by the processor, the electronic device is further caused to perform the following steps:

judging whether there is an application icon or a control icon at the first position corresponding to the finger coordinates in the second display area;

If there is, the first display content is displayed at a second position in the second display area; the second position is separated from the first position by a first preset value;

If it does not exist, the first display content is displayed on the first position.
The electronic device according to any one of claims 10-14, wherein when one or more computer programs stored in the memory are executed by the processor, the electronic device is further caused to perform the following step: determining The time period for which the user's sight stays on the coordinates of the first viewpoint exceeds a second preset value.
The electronic device according to any one of claims 10-15, wherein when one or more computer programs stored in the memory are executed by the processor, the electronic device is further caused to perform the following steps:

A click operation on at least one target icon in the first display content is received, a first target icon is determined, and an application process corresponding to the first target icon is executed.
The electronic device according to any one of claims 10-16, wherein the electronic device further comprises an infrared camera, and when the one or more computer programs stored in the memory are executed by the processor, the electronic device further enables The electronic device performs the following steps:

determining the first distance between the user's eyes and the infrared camera, the coordinates of the corneal reflection spot, and the coordinates of the pupil center;

The coordinates of the first viewpoint are determined according to the first distance, the coordinates of the corneal reflection spot, and the coordinates of the pupil center.
The electronic device according to any one of claims 11-17, characterized in that, the electronic device further comprises an infrared light sensor, and when one or more computer programs stored in the memory are executed by the processor, the electronic device further enables all the computer programs stored in the memory to be executed by the processor. The electronic device performs the following steps:

determining the second distance between the finger and the infrared light sensor, the third distance between the finger and the display screen, and the orientation of the finger relative to the infrared light sensor;

According to the second distance and the third distance, determine the fourth distance between the projection point of the finger on the display screen and the infrared light sensor;

The finger coordinates are determined based on the fourth distance and the orientation.
A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a computer program, which, when the computer program is run on an electronic device, causes the electronic device to perform any one of claims 1 to 9. method.
A chip, characterized in that the chip includes a processor and a data interface, and the processor is configured to read and execute the instructions stored in the memory through the data interface, so that the computer executes any one of claims 1 to 9. The described method is executed.