WO2019000437A1 - 显示图形用户界面的方法和移动终端 - Google Patents

显示图形用户界面的方法和移动终端 Download PDF

Info

Publication number
WO2019000437A1
WO2019000437A1 PCT/CN2017/091283 CN2017091283W WO2019000437A1 WO 2019000437 A1 WO2019000437 A1 WO 2019000437A1 CN 2017091283 W CN2017091283 W CN 2017091283W WO 2019000437 A1 WO2019000437 A1 WO 2019000437A1
Authority
WO
WIPO (PCT)
Prior art keywords
application
mobile terminal
screen area
screen
notification
Prior art date
Application number
PCT/CN2017/091283
Other languages
English (en)
French (fr)
Inventor
严斌
薛康乐
马冬
尹帮实
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201780091258.9A priority Critical patent/CN110663016B/zh
Priority to PCT/CN2017/091283 priority patent/WO2019000437A1/zh
Priority to CN202211291655.XA priority patent/CN116055610B/zh
Publication of WO2019000437A1 publication Critical patent/WO2019000437A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72484User interfaces specially adapted for cordless or mobile telephones wherein functions are triggered by incoming communication events
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets

Definitions

  • the present application relates to the field of human-computer interaction, and in particular to a method and a mobile terminal for displaying a graphical user interface.
  • the embodiment of the present application provides a plurality of methods for displaying a graphical user interface and a mobile terminal, which are intended to improve the diverse interactive functions of the mobile terminal, simplify the operation process of the user, and improve the user experience.
  • an embodiment of the present application provides a method for displaying a graphical user interface on a mobile terminal, where the method includes the following steps: First, the mobile terminal displays an application interface of the first application in the first screen area. And then, when the second application has a notification, the mobile terminal displays the notification in the second screen area; subsequently, when detecting a first touch operation performed on the notification, the mobile terminal is The first screen area continues to display an application interface of the first application, and displays an application interface related to the notification of the second application on an application interface of the first application. Therefore, the method can fully utilize the display area of the mobile terminal, and display the interface content of the first application in the first screen area, such as video call, video play (movie, television, animation, etc.), game, etc.
  • the interface content of the first application in the first screen area such as video call, video play (movie, television, animation, etc.), game, etc.
  • the mobile terminal may display the notification related information in the second screen area.
  • the first screen area is not occupied, and the first screen area is not affected, compared to the manner of prompting the pop-up interface in the first screen area.
  • the display content of a screen area on the other hand, the content of the notification can be permanently displayed in the second screen area, preventing the user from having time to see the content of the notification, the notification disappears; and providing a convenient function to make the user fast Processing the notification of the second application and continuing to view the interface content of the first application.
  • the mobile terminal displays an application interface of the second application on a partial area of an application interface of the first application.
  • the mobile terminal displays an application interface of the second application on a partial area of the application interface of the first application, where the mobile terminal is on an application interface of the first application.
  • the application interface of the second application is displayed in a transparent or semi-transparent manner to improve the display effect of the mobile terminal on the touch screen.
  • the mobile terminal when the mobile terminal displays an application interface related to the notification of the second application, when detecting a second touch operation performed on an application interface of the second application, The mobile terminal processes the notification to enable the user to continue to view the interface content of the first application and quickly process the notification of the second application, including viewing, replying, and the like.
  • the mobile terminal after the mobile terminal processes the notification, the mobile terminal further displays an application interface of the first application in the first screen area, and does not display the second application.
  • Application interface After the mobile terminal processes the notification, the application interface of the second application displayed on the first screen area is closed, and the processing procedure is simple and smooth, and is adapted to the usage habit of the user.
  • the mobile terminal when the mobile terminal displays an application interface related to the notification of the second application, when detecting the application interface in the first screen area and in the second application a third touch operation performed on the area, the mobile terminal executing an instruction corresponding to the third touch operation in the second application, and continuing to display the second application in the first screen area
  • the notification related application interface that is, when the application interface of the second application and the application interface of the first application are displayed on the first screen, the execution may be selected according to the location of the touch operation performed in the first screen area.
  • the second application related instruction is also an execution related instruction of the second application.
  • the mobile terminal when the mobile terminal displays an application interface related to the notification of the second application, when detecting a fourth touch operation, the mobile terminal continues to display in the first screen area.
  • the application interface of the first application does not display the application interface of the second application, and the mobile terminal may exit the application interface of the second application displayed in the first screen area according to the corresponding fourth touch operation, and fourth The touch operation may be determined according to a preset, and the step of the mobile terminal detecting the fourth touch operation includes any one of: the mobile terminal detecting the notification of the second application in the second screen area corresponding to the second application a touch operation; the mobile terminal detects a touch operation on an application interface of the second application; the mobile terminal detects an application interface in the first application and outside an application interface of the second application Touch operations performed on the area.
  • the mobile terminal displays an icon of at least one of the second applications in the second screen area.
  • the method further includes: when detecting a first touch operation performed on an icon of the second application, displaying an application interface of the second application in the first screen area, The second screen area displays an icon of the first application.
  • the method further includes: when the mobile terminal does not display an application interface of the second application in the second screen area, The second screen area displays an icon of the second application.
  • the second application may be a system level application or an application provided by a third service party. Displaying at least one icon of the second application in the second screen area to provide a user with a variety of display modes, and, in some embodiments, the mobile terminal may be responsive to detecting that the user is in the second screen area Displaying a touch operation of at least one icon of the second application to quickly enter the second application, thereby providing a function of quickly entering a common application and quickly returning to an application interface of the previous access application, simplifying the user operation process and improving the user experience .
  • the mobile terminal prompts the notification by displaying the content of the notification in the second screen area.
  • the mobile terminal prompts the notification by displaying the sender information of the notification in the second screen area, where the sender information includes a sender image and a sender identity information. And the sender sends any one or more of the time.
  • the mobile terminal prompts the notification by changing a display manner of an icon of the second application corresponding to the notification in the second screen area.
  • the method further includes: the mobile terminal displaying a control in the second screen area; when detecting a third touch operation performed on the control, the mobile terminal hides the At least one icon of the second application and/or a notification of the second application.
  • the mobile terminal selects to extinguish the second screen area based on the touch operation to save power consumption or reduce interference of the display content of the second screen area with the display content of the first screen area; or the mobile terminal displays the first display based on the touch operation
  • the screen area and the first screen area cooperate to display a continuous interface content, and the overall display improves the display effect, thereby providing a variety of display modes and functions.
  • the mobile terminal displays the notification in the second screen area
  • the content of the notification is displayed in a manner of scrolling display on the second screen area to adapt to the second screen.
  • the size of the area and the complete display of the content of the notification are displayed in a manner of scrolling display on the second screen area to adapt to the second screen.
  • the present application provides a method for displaying a graphical user interface on a mobile terminal, wherein the mobile terminal includes a touch screen and a camera, the touch screen includes a first screen area and a second screen area, the first The screen area is a rectangular area, and the second screen area is an area of the touch screen extending from the first screen area to the periphery of the camera, and the method performed at the mobile terminal includes the following steps: First, the mobile terminal is The first screen area displays an application interface of the first application, and displays an icon of the second application in the second screen area; then, when detecting a first touch operation performed on the icon of the second application, the Mobile terminal Displaying an application interface of the second application in the first screen area, and displaying an icon of the first application in the second screen area.
  • the mobile terminal quickly enters the second application in the first screen area by displaying an icon of the at least one second application in the second screen area, for example, some commonly used applications, when detecting a touch operation performed on the icon of the second application
  • Switching to display the application interface of the second application saves the touch operation of the application interface that needs to exit the first application first, thereby providing a function of quickly entering the common application, simplifying the interaction process, and improving the user experience.
  • the mobile terminal displays the application interface of the second application in the first screen area
  • the mobile terminal does not display the second application in the second screen area
  • an icon of the second application is displayed in the second screen area.
  • the icon of the first application displayed in the second screen area in response to detecting the touch operation on the icon of the first application, switching the application interface of the second application in the first screen area, thereby providing a quick return to the front
  • the function of the access application is simple and fast.
  • the present application provides a method for displaying on a mobile terminal, wherein the mobile terminal includes a touch screen and a camera, the touch screen includes a first screen area and a second screen area, where the first screen area is a rectangular area, the second screen area is an area of the touch screen extending from the first screen area to the periphery of the camera, and the method performed on the mobile terminal includes: first, the mobile terminal starts the camera shooting Then, the mobile terminal displays an image acquired by the camera on the first screen area, and increases a display brightness of all or a part of the area of the second screen area to exceed a threshold to fill the subject with light.
  • the mobile terminal uses the second screen area as a fill light during the front camera shooting process, and can fill the subject (such as a human face) without additional setting of the fill light device.
  • the subject such as a human face
  • the mobile terminal has more interactive functions, which improves the user's use requirements in the shooting scene and improves the user experience.
  • the mobile terminal displays a preset color in all or at least one partial area of the second screen area to fill the subject with light.
  • the mobile terminal adjusts the second screen area to a monochrome mode, such as white, yellow, blue, etc., to complement the subject, and also helps to improve the imaging color of the subject and improve imaging. The effect is to provide the user's shooting experience.
  • the method further includes: the mobile terminal further displaying a prompt pattern pointing to the camera position in the second screen area.
  • the application provides a mobile terminal, where the mobile terminal includes: a camera; a touch screen, wherein the touch screen includes a first screen area and a second screen area, and the first screen area is a rectangular area
  • the second screen area is an area of the touch screen extending from the first screen area to the periphery of the camera; one or more processors; a memory; and one or more computer programs, wherein the one or more Computer programs are stored in the memory, the one or more computer programs comprising instructions that, when executed by the mobile terminal, cause the mobile terminal to perform the steps of: first, at the first The screen area displays an application interface of the first application; when the second application has a notification, the notification is displayed in the second screen area; then, when a first touch operation performed on the notification is detected, after And continuing to display an application interface of the first application in the first screen area, and displaying the first on an application interface of the first application Application interface associated with the notification application.
  • the mobile terminal in the step of displaying an application interface related to the notification of the second application, when the instruction is executed by the mobile terminal, the mobile terminal is caused to perform the following steps: An application interface of the second application is displayed on a partial area of the application interface of the first application.
  • the mobile terminal in the step of displaying an application interface related to the notification of the second application, when the instruction is executed by the mobile terminal, the mobile terminal is caused to perform the following steps:
  • the application interface of the second application is displayed in a transparent or semi-transparent manner on the application interface of the first application.
  • the instruction when the application interface related to the notification of the second application is displayed, the instruction is When the mobile terminal executes, the mobile terminal is caused to perform the step of processing the notification when a second touch operation performed on the application interface of the second application is detected.
  • the mobile terminal after the processing is performed by the mobile terminal after processing the notification, the mobile terminal is further caused to perform the step of: continuing to display the first in the first screen area The application interface of the application, and the application interface of the second application is not displayed.
  • the mobile terminal when the mobile terminal displays an application interface related to the notification of the second application, when the instruction is executed by the mobile terminal, the mobile terminal is configured to perform the following steps: Detecting a third touch operation performed on the first screen area and on an area outside the application interface of the second application, executing an instruction corresponding to the third touch operation in the second application, and in the The first screen area continues to display an application interface associated with the notification in the second application.
  • the mobile terminal when the application interface related to the notification of the second application is displayed, when the instruction is executed by the mobile terminal, the mobile terminal is caused to perform the following steps: when detecting the The four-touch operation continues to display the application interface of the first application in the first screen area, and does not display the application interface of the second application.
  • step of detecting a fourth touch operation when the instruction is executed by the mobile terminal, causing the mobile terminal to perform any of the following steps: detecting that the second application is corresponding to the second application in the second screen area a touch operation of the notification; detecting a touch operation on the application interface of the second application; detecting a touch operation performed on an area of the application interface of the first application and outside the application interface of the second application .
  • the mobile terminal when the instruction is executed by the mobile terminal, the mobile terminal further performs the step of: displaying an icon of at least one of the second applications in the second screen area.
  • the mobile terminal in the step of prompting the notification in the second screen area, when the instruction is executed by the mobile terminal, the mobile terminal is configured to perform at least any one of the following steps: a second screen area displaying the content of the notification; displaying, in the second screen area, sender information of the notification, the sender information including any one of a sender image, a sender identity information, and a sender sending time or a plurality of items; changing a display manner of the icon of the second application corresponding to the notification in the second screen area.
  • the mobile terminal when the instruction is executed by the mobile terminal, the mobile terminal further performs the steps of: displaying a control in the second screen area; when detecting the execution of the control a three-touch operation of hiding an icon of the at least one second application and/or a notification of the second application.
  • the mobile terminal in the displaying that the second screen area is in the notification, when the instruction is executed by the mobile terminal, the mobile terminal is caused to perform the following steps: scrolling in the second screen area The manner in which the notification is displayed.
  • the application provides a mobile terminal, where the mobile terminal includes: a camera; a touch screen, wherein the touch screen includes a first screen area and a second screen area, where the first screen area is a rectangular area, The second screen area is an area of the touch screen extending from the first screen area to the periphery of the camera; one or more processors; a memory; and one or more computer programs, wherein the one or more A computer program is stored in the memory, the one or more computer programs including instructions that, when executed by the mobile terminal, cause the mobile terminal to perform the steps of: first, at the first screen The area displays an application interface of the first application, displaying an icon of the second application in the second screen area; and then displaying a first touch operation performed on the icon of the second application, displaying in the first screen area
  • the application interface of the second application displays an icon of the first application in the second screen area.
  • the mobile terminal after the mobile terminal performs the application interface of the second application after the first screen area displays the application interface, when the instruction is executed by the mobile terminal, the mobile terminal further performs the following steps.
  • the mobile terminal does not display the application interface of the second application in the second screen area, displaying an icon of the second application in the second screen area.
  • the present application provides a mobile terminal displayed on a mobile terminal, wherein: a camera; a touch screen, wherein the touch screen includes a first screen area and a second screen area, wherein the first screen area is a rectangular area, The second screen area is the touch An area extending from the first screen area to the periphery of the camera; one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory
  • the one or more computer programs include instructions that, when executed by the mobile terminal, cause the mobile terminal to perform the steps of: initiating the camera capture; and then displaying on the first screen area
  • the image acquired by the camera increases the display brightness of all or part of the area of the second screen area beyond a threshold to fill the subject with light.
  • the mobile terminal when the instruction is executed by the mobile terminal, the mobile terminal further performs the step of: displaying a preset color in all or at least one partial area of the second screen area to give a The subject fills in light.
  • the mobile terminal when the instruction is executed by the mobile terminal, the mobile terminal further performs the step of: displaying a prompt pattern pointing to the camera position in the second screen area.
  • the present application provides a graphical user interface (GUI) stored in an electronic device, the electronic device including a touch screen, a memory, and one or more processors, the touch screen including the first a screen area and a second screen area, the first screen area being a rectangular area, the second screen area being an area of the touch screen extending from the first screen area to the periphery of the camera, the one or more
  • the processor is configured to execute one or more computer programs stored in the memory, wherein the graphical user interface comprises: a first GUI displayed in the first screen area, the first GUI comprising a first An application interface of the application; in response to detecting that the second application has a notification, the second GUI displayed in the second screen area, the second GUI includes the notification; in response to detecting that the notification is performed a first touch operation, continuing to display the first GUI in the first screen area, and displaying a third GUI on the first GUI, the third GUI including the second application Associated with the notification application interface.
  • GUI graphical user interface
  • the first GUI further includes: an icon of at least one of the second applications.
  • the present application provides a computer program product, wherein when the computer program product is run on a mobile terminal, the mobile terminal is caused to perform any of the first to third aspects and embodiments thereof One of the methods described.
  • the present application provides a computer readable storage medium, comprising instructions, wherein when the instructions are run on a mobile terminal, causing the mobile terminal to perform the first to third aspects and embodiments thereof The method of any of the preceding claims.
  • the present application provides a mobile terminal with a touch screen
  • the mobile terminal comprising: a display unit, a detecting unit and a control unit
  • the display unit is configured to display the first application in a first screen area of the touch screen
  • the detecting unit is configured to detect whether the second application has a notification and detect whether there is a touch operation on the touch screen
  • the control unit is configured to detect, in the detecting unit, detecting the second application When there is a notification, causing the display unit to display the notification in a second screen area of the touch screen, and in the first screen area when the detecting unit detects a first touch operation performed on the notification And continuing to display an application interface of the first application, and displaying an application interface related to the notification of the second application on an application interface of the first application.
  • the mobile terminal further includes a camera
  • the touch screen includes a first screen area and a second screen area
  • the first screen area is a rectangular area
  • the second screen area is the touch screen from the first screen The area that extends around the camera
  • the display unit is further configured to display an icon of the at least one second application in the second screen area.
  • control unit is further configured to: at the detecting unit, detect a first touch operation performed on an icon of the second application, to cause the display unit to display in the first screen area
  • the application interface of the second application displays an icon of the first application in the second screen area.
  • the display unit is further configured to: when the second screen area does not display an application interface of the second application, in the second screen area An icon of the second application is displayed.
  • the second application may be a system level application or an application provided by a third service party.
  • the display unit is configured to display a control in the second screen area; the control unit is further configured to detect, at the detecting unit, a third touch operation performed on the control, Having the display unit hide the at least one second application Icon and/or notification of the second application.
  • the display unit is configured to display an application interface of the second application on a partial area of an application interface of the first application.
  • control unit is further configured to process the notification when the detecting unit detects a second touch operation performed on an application interface of the second application.
  • the processing unit is further configured to: when the display unit continues to display the application interface of the first application in the first screen area, And the application interface of the second application is not displayed.
  • the control unit when the display unit displays an application interface related to the notification of the second application, the control unit is configured to detect, in the first screen area, a third touch operation performed on an area outside the application interface of the second application, executing an instruction corresponding to the third touch operation in the second application, and causing the display unit to continue in the first screen area An application interface related to the notification in the second application is displayed.
  • the display unit displays an application interface related to the notification of the second application
  • the control unit when the control unit is configured to detect a fourth touch operation at the detecting unit, in the A screen area continues to display an application interface of the first application, and an application interface of the second application is not displayed. Further, the control unit exits the application interface of the second application displayed in the first screen area according to the corresponding fourth touch operation.
  • the fourth touch operation may be determined according to a preset, and the step of the detecting unit detecting the fourth touch operation includes any one of the following: the mobile terminal detects that the second application is corresponding to the second application in the second screen area a touch operation of the notification; the mobile terminal detects a touch operation on an application interface of the second application; the mobile terminal detects an application interface in an application interface of the first application and in the second application A touch operation performed on an outer area.
  • the display unit prompts the notification by displaying the content of the notification in the second screen area.
  • the display unit prompts the notification by displaying the sender information of the notification in the second screen area, where the sender information includes a sender image and a sender identity information. And the sender sends any one or more of the time.
  • the display unit prompts the notification by changing a display manner of an icon of the second application corresponding to the notification in the second screen area.
  • the display unit is further configured to display a control in the second screen area; the control unit is further configured to detect, at the detecting unit, a third touch operation performed on the control And causing the display unit to hide the icon of the at least one second application and/or the notification of the second application.
  • the display unit displays the content of the notification in a manner of scrolling display in the second screen area when the notification is displayed in the second screen area.
  • the present application provides a mobile terminal with a touch screen, the mobile terminal comprising: a display unit and a control unit, wherein the display unit is configured to display a first application in a first screen area of the touch screen Application interface, displaying an icon of the second application in a second screen area of the touch screen; the detecting unit is configured to detect whether there is a touch operation on the touch screen; and the control unit is configured to detect at the detecting unit Performing a first touch operation on the icon of the second application, causing the display unit to display an application interface of the second application in the first screen area, and displaying the first application in the second screen area Icon.
  • the display unit is further configured to: after displaying the application interface of the second application in the first screen area, not displaying an application interface of the second application in the second screen area And displaying an icon of the second application in the second screen area.
  • the present application provides a mobile terminal with a touch screen, the mobile terminal comprising: a shooting unit and a display unit And a control unit, wherein the photographing unit is configured to capture an image; the display unit is configured to display an image acquired by the camera on a first screen area of the touch screen; and the control unit is configured to control the display The unit increases the display brightness of all or part of the second screen area of the touch screen beyond a threshold to fill the subject with light.
  • the display unit is further configured to display a preset color in all or at least one partial area of the second screen area to fill the subject with light.
  • the display unit is further configured to display a prompt pattern pointing to the camera position in the second screen area.
  • FIG. 1 is a schematic structural diagram of hardware of a mobile terminal according to some embodiments of the present application.
  • FIG. 2 is a schematic diagram of a part of hardware and software of a mobile terminal according to some embodiments of the present disclosure
  • 3A and 3B are schematic views provided in accordance with some embodiments of the present application.
  • FIG. 4 is a schematic diagram of a graphical user interface of a mobile terminal according to some embodiments of the present application.
  • FIG. 5 is a schematic flowchart of a GUI display process in a mobile terminal according to some embodiments of the present disclosure
  • FIG. 6A and FIG. 6B are schematic diagrams showing a GUI display process in a mobile terminal according to some embodiments of the present disclosure
  • FIGS. 7A and 7B are schematic diagrams showing a GUI display process in a mobile terminal according to some embodiments of the present disclosure.
  • FIGS. 8A and 8B are schematic diagrams showing a GUI display process in a mobile terminal according to some embodiments of the present application.
  • 9A, 9B, and 9C are schematic diagrams showing a GUI display process in a mobile terminal according to some embodiments of the present disclosure.
  • FIG. 10A and FIG. 10B are schematic diagrams showing a GUI display process in a mobile terminal according to some embodiments of the present disclosure
  • FIG. 11A and FIG. 11B are schematic diagrams showing a GUI display process in a mobile terminal according to some embodiments of the present disclosure.
  • FIG. 12A, FIG. 12B and FIG. 12C are schematic diagrams showing a GUI display process in a mobile terminal according to some embodiments of the present disclosure
  • FIG. 13A and FIG. 13B are schematic diagrams showing a GUI display process in a mobile terminal according to some embodiments of the present disclosure
  • FIGS. 14A and 14B are schematic diagrams of GUIs displayed in a mobile terminal according to some embodiments of the present disclosure.
  • FIG. 15A and FIG. 15B are schematic diagrams showing a GUI display process in a mobile terminal according to some embodiments of the present disclosure.
  • FIG. 16A and FIG. 16B are schematic diagrams showing a GUI display process in a mobile terminal according to some embodiments of the present disclosure
  • 17A, 17B, and 17C are schematic diagrams of a GUI display process in a mobile terminal according to some embodiments of the present disclosure.
  • FIG. 18 is a schematic diagram of a GUI display process in a mobile terminal according to some embodiments of the present application.
  • first can be named a second contact
  • second contact can be named the first contact without departing from the scope of the present application.
  • Both the first contact and the second contact are contacts, but they may not be the same contact, and may be the same contact in some scenarios.
  • the term “if” may be interpreted to mean “when” or “after” or “in response to determining” or “in response to detecting”, depending on the context.
  • the phrase “if determined" or “if the stated condition or event is detected” can be interpreted to mean “when determining" or “in response to determining... “or” when [the stated condition or event] is detected” or “in response to detecting the [condition or event stated]”.
  • the mobile terminal is a portable mobile terminal that also includes other functions, such as a personal digital assistant and/or music player functionality, such as a cell phone, tablet, and the like.
  • portable mobile terminals include, but are not limited to, piggybacking Or a portable mobile terminal of other operating systems.
  • Other portable mobile terminals may also be used, such as a laptop or tablet with a touch-sensitive surface (eg, a touch screen display and/or a touchpad).
  • a mobile terminal including a display and a touch-sensitive surface is described. It should be understood, however, that the mobile terminal can include one or more other physical user interface devices, such as a physical keyboard, mouse, and/or joystick.
  • Mobile terminals typically support a variety of applications, such as one or more of the following: a drawing application, a word processing application, a web page creation application, a spreadsheet application, a game application, a phone application, a video conferencing application. , email applications, instant messaging applications, workout support applications, photo management applications, gallery applications, digital video camera applications, web browsing applications, digital music player applications, and/or digital video players application.
  • applications such as one or more of the following: a drawing application, a word processing application, a web page creation application, a spreadsheet application, a game application, a phone application, a video conferencing application.
  • email applications instant messaging applications
  • workout support applications photo management applications, gallery applications, digital video camera applications, web browsing applications, digital music player applications, and/or digital video players application.
  • Various applications that can be executed on the mobile terminal can use at least one shared physical user interface device, such as a touch-sensitive surface.
  • One or more functions of the touch-sensitive surface and corresponding information displayed on the mobile terminal can be displayed and/or changed from one application to the next and/or displayed and/or changed within the corresponding application .
  • the shared physical architecture of the mobile terminal such as a touch-sensitive surface, can support various applications with a user interface that is intuitive to the user.
  • FIG. 1 is a block diagram showing a portable mobile terminal with a touch-sensitive display 115 (taking mobile phone 100 as an example) in accordance with some embodiments.
  • the touch sensitive display 115 is sometimes also referred to as a "touch screen" and may also be referred to as or referred to as a touch sensitive display system, and may also be referred to as a display having a touch-sensitive surface and a display. system.
  • the mobile phone 100 shown in FIG. 1 is only one example of the above mobile terminal, and the mobile phone 100 may have more or fewer components than those shown in the figure, and two or more components may be combined. Or can have different component configurations.
  • the various components shown in the figures can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
  • the mobile phone 100 may include: a processor 101, a radio frequency circuit 102, a memory 103, an input/output subsystem 104, a Bluetooth device 105, a sensor 106, a Wi-Fi device 107, a positioning device 108, an audio circuit 109, Peripheral interface 110 and components such as power system 111. These components can communicate over one or more communication buses or signal lines.
  • a processor 101 a radio frequency circuit 102
  • a memory 103 the mobile phone 100 may include: a processor 101, a radio frequency circuit 102, a memory 103, an input/output subsystem 104, a Bluetooth device 105, a sensor 106, a Wi-Fi device 107, a positioning device 108, an audio circuit 109, Peripheral interface 110 and components such as power system 111.
  • these components can communicate over one or more communication buses or signal lines.
  • the hardware structure illustrated in FIG. 1 does not constitute a limitation to a mobile terminal, and may include more or fewer components than those
  • the processor 101 is a control center of the mobile phone 100, and connects various parts of the mobile phone 100 by using various interfaces and lines, by running or executing an application (application, referred to as App) stored in the memory 103, and calling the storage in the memory 103. Data and finger Let the various functions and processing data of the mobile phone 100 be executed.
  • processor 101 may include one or more control units; processor 101 may also integrate an application processor and a modem processor; wherein the application processor primarily processes operating systems, user interfaces, applications, etc.
  • the modem processor primarily handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 101.
  • the processor 101 may be a Kirin 960 chip manufactured by Huawei Technologies Co., Ltd.
  • the processor 101 may further include a fingerprint verification chip for verifying the collected fingerprint.
  • the radio frequency circuit 102 can be used to receive and transmit wireless signals during transmission or reception of information or calls.
  • the radio frequency circuit 102 can process the downlink data of the base station and then process it to the processor 101; in addition, transmit the data related to the uplink to the base station.
  • radio frequency circuits include, but are not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
  • the radio frequency circuit 102 can also communicate with other devices through wireless communication.
  • the wireless communication can use any communication standard or protocol, including but not limited to global mobile communication systems, general packet radio services, code division multiple access, wideband code division multiple access, long term evolution, email, short message service, and the like.
  • the memory 103 is used to store applications, software, and data, and the processor 101 executes various functions and data processing of the mobile phone 100 by running applications and data stored in the memory.
  • the memory 103 mainly includes a storage program area and a storage data area, wherein the storage program area can store an operating system, an application required for at least one function (such as a sound playing function, an image management function, etc.); the storage data area can be stored according to the use of the mobile phone.
  • the data created (such as audio data, phone book, calendar events, etc.).
  • the memory may include a high speed random access memory, and may also include a nonvolatile memory such as a magnetic disk storage device, a flash memory device, or other volatile solid state storage device.
  • I/O subsystem 104 couples input/output devices on device 100, such as touch sensitive display 115 and other input control devices 116, to processor 101.
  • I/O subsystem 104 may include display controller 117 and one or more input controllers 118 for other input control devices 116.
  • the one or more input controllers 118 receive electrical signals/transmit electrical signals from other input control devices 116 to other input control devices 116.
  • the other input control device 116 may include physical buttons (eg, a push button, rocker button, etc.), a dial, a slide switch, a joystick, a click wheel, and the like.
  • the input controller 118 can be coupled to (or not coupled to) any of the following: a keyboard, an infrared port, a USB port, and a pointing device such as a mouse.
  • the one or more buttons may include up/down buttons for volume control of the speaker 112 and/or the microphone 113.
  • the one or more buttons can include a push button.
  • the touch sensitive display 115 provides an input interface and an output interface between the mobile terminal and the user.
  • Display controller 117 receives electrical signals from touch-sensitive display 115 and/or transmits electrical signals to touch-sensitive display 115.
  • the touch sensitive display 115 displays a visual output to the user.
  • Visual output can include graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some visual output or all of the visual output may correspond to interface elements.
  • the touch sensitive display 115 is sometimes referred to as a "touch screen” for convenience, and may also be referred to as a touch sensitive display system, and may also be referred to as a display system having a touch sensitive surface and a display screen.
  • the touch sensitive display 115 has a touch sensitive surface, display, sensor or group of sensors that receive input from a user based on tactile and/or tactile contact.
  • Touch sensitive display 115 and display controller 117 (along with any associated modules and/or sets of instructions in memory 103) detect contact on touch sensitive display 115 (and any movement or interruption of the contact), which will be detected The contact is converted into an interaction with an interface element (eg, one or more soft keys, icons, web pages, or images) displayed on the touch-sensitive display 115.
  • an interface element eg, one or more soft keys, icons, web pages, or images
  • the point of contact between the touch sensitive display 115 and the user corresponds to the user's finger.
  • a touch-sensitive surface (such as a touch panel) can capture touch events on or near the user of the mobile phone 100 (eg, the user uses a finger, a stylus, or the like on the touch-sensitive surface or near the touch-sensitive surface. And the transmitted touch information is sent to other devices such as the processor 101.
  • the touch event of the user near the touch-sensitive surface may be referred to as a hovering touch; the hovering touch may mean that the user does not need to directly touch the touchpad in order to select, move or drag a target (eg, an icon, etc.), and only The user is required to be located near the mobile terminal in order to perform the desired function.
  • the touch sensitive surface can include two portions of a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits a signal to the touch controller; the touch controller receives the touch information from the touch detection device, and converts the touch information into contact coordinates, and then Sended to the processor 101, the touch controller can also receive instructions from the processor 101 and execute them.
  • resistive, capacitive, infrared, and surface acoustic waves can be used to achieve a touch-sensitive surface.
  • a display also referred to as a display screen
  • the display can be used to display information entered by the user or information provided to the user as well as various menus of the mobile phone 100.
  • the display can be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.
  • the touch-sensitive surface can be overlaid on the display, and when the touch-sensitive surface detects a touch event thereon or nearby, it is transmitted to the processor 101 to determine the type of touch event, and then the processor 101 can be on the display depending on the type of touch event Provide corresponding visual output on it.
  • the touch-sensitive surface and display are implemented as two separate components to implement the input and output functions of the handset 100, in some embodiments, the touch-sensitive surface can be integrated with the display to enable input to the handset 100. And output function. It can be understood that the touch screen 115 is formed by stacking a plurality of layers of materials. In the embodiment of the present application, only the touch-sensitive surface (layer) and the display screen (layer) are shown, and other layers are not described in the embodiment of the present application.
  • the touch-sensitive surface may be overlaid on the display, and the size of the touch-sensitive surface is larger than the size of the display such that the display is completely covered under the touch-sensitive surface, or the touch-sensitive surface may be
  • the full panel form is disposed on the front side of the mobile phone 100, that is, the user's touch on the front of the mobile phone 100 can be perceived by the mobile phone, so that the full touch experience on the front of the mobile phone can be realized.
  • the touch-sensitive surface is disposed on the front side of the mobile phone 100 in the form of a full-board, and the display may also be disposed on the front side of the mobile phone 100 in the form of a full-board, so that a frameless structure can be realized on the front side of the mobile phone.
  • the touch sensitive display 115 can use LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, although other display technologies can be used in other embodiments.
  • Touch sensitive display 115 and display controller 117 may utilize any of a variety of touch sensing techniques now known or later developed, as well as other proximity sensor arrays or for determining one or more of contact with touch sensitive display 115.
  • Other elements of the dot to detect contact and any movement or interruption thereof include, but are not limited to, capacitive, resistive, infrared, and surface acoustic wave techniques. In an exemplary embodiment, a projected mutual capacitance sensing technique is used.
  • the touch sensitive display 115 can have a video resolution of more than 100 dpi. In some embodiments, the touch screen has a video resolution of approximately 160 dpi.
  • the user can contact the touch sensitive display 115 using any suitable object or add-on such as a stylus, finger, or the like.
  • the user interface is designed to work primarily with finger-based contacts and gestures, which may be less accurate than the stylus-based input due to the larger contact area of the finger on the touch screen.
  • the device translates the finger-based coarse input into an accurate pointer/cursor position or command to perform the action desired by the user.
  • the touch screen described above can include a sensor set with pressure sensing.
  • the handset 100 can include a touchpad (not shown) for activating or deactivating a particular function.
  • the touchpad is a touch sensitive area of the mobile terminal that is different from the touchscreen in that it does not display a visual output.
  • the touchpad can be a touch-sensitive surface that is separate from the touch-sensitive display 115, or an extension of the touch-sensitive surface formed by the touchscreen.
  • the handset 100 can also include one or more light sensors 119.
  • FIG. 1 shows an optical sensor 119 coupled to a light sensor controller 120 in an I/O subsystem 104.
  • Light sensor 119 can include a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor.
  • CMOS complementary metal oxide semiconductor
  • the light sensor 119 receives light projected through one or more lenses from an external environment and converts the light into data representing an image.
  • light sensor 119 can capture still images or video.
  • one or more light sensors are located at the front and/or rear of the handset 100, opposite the touch-sensitive display 115 on the front of the device, such that the touch-sensitive display 115 can be used for still images and/or video Viewfinder for image acquisition.
  • another or more light sensors are located at the front of the device such that the user can view images of the user for video conferencing while viewing other video conferencing participants on the touch screen display, and the light sensor 119 can be camera.
  • the mobile phone 100 may also have a fingerprint recognition function.
  • it can be on the back of the phone 100 (eg Below the rear camera, a fingerprint reader is configured, or a fingerprint reader is disposed on the front side of the mobile phone 100 (eg, below the touch screen 115).
  • the fingerprint recognition function can also be implemented by configuring the fingerprint recognizer in the touch screen 115, that is, the fingerprint recognizer can be integrated with the touch screen 115 to implement the fingerprint recognition function of the mobile phone 100.
  • the fingerprint identifier may be disposed in the touch screen 115, may be part of the touch screen 115, or may be otherwise disposed in the touch screen 115.
  • the fingerprint recognizer can also be implemented as a full-board fingerprint reader, and therefore, the touch screen 115 can be regarded as a panel that can perform fingerprint acquisition at any position.
  • the fingerprint reader can send the collected fingerprint to the processor 101 for the processor 101 to process the fingerprint (eg, fingerprint verification, etc.).
  • the main component of the fingerprint identifier in the embodiment of the present application is a fingerprint sensor, which can adopt any type of sensing technology, including but not limited to optical, capacitive, piezoelectric or ultrasonic sensing technologies.
  • the Bluetooth device 105 is configured to establish a wireless link with other mobile terminals (such as a smart watch, a tablet, etc.) through a Bluetooth communication protocol, and perform data interaction.
  • other mobile terminals such as a smart watch, a tablet, etc.
  • the handset 100 can also include at least one type of sensor 106, such as the light sensor 119, motion sensor, and other sensors described above.
  • the light sensor 119 may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel of the touch-sensitive display 115 according to the brightness of the ambient light, and the proximity sensor may move when the mobile phone 100 moves to the ear. Turn off the power of the display panel.
  • the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity.
  • the mobile phone 100 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here No longer.
  • the Wi-Fi device 107 is configured to provide Wi-Fi network access for the mobile phone 100.
  • the mobile phone 100 can help the user to send and receive e-mails, browse web pages, and access streaming media through the Wi-Fi device 107, and provides the user with wireless broadband. Internet access.
  • the location device 108 is configured to provide the mobile phone 100 with geographic location information, where the geographic location information may indicate the geographic location where the mobile phone is currently located. It can be understood that the positioning device 108 can be specifically a receiver of a global positioning system or a positioning communication system such as a Beidou satellite navigation system or a Russian GLONASS. After receiving the geographical location information sent by the positioning communication system, the positioning device 108 sends the information to the processor 101 for further processing, or sends it to the memory 103 for storage.
  • the audio circuit 109, the speaker 112, and the microphone 113 can provide an audio interface between the user and the handset 100.
  • the audio circuit 109 can transmit the converted electrical data of the received audio data to the speaker 112, which is converted into a sound signal output by the speaker 112.
  • the speaker 112 can include a power amplifier speaker, an earpiece, etc.; on the other hand, the microphone 113 will collect the sound.
  • the signal is converted to an electrical signal, which is received by the audio circuit 109 and converted to audio data, which is then output to the RF circuit 102 for transmission to, for example, another handset, or the audio data is output to the memory 103 for further processing.
  • the handset 100 may also include a power system 111 (including a power fault detection circuit, a power converter or inverter, a power status indicator, a battery, and a power management chip) that powers various components.
  • the battery can be logically coupled to the processor 101 through a power management chip to manage functions such as charging, discharging, and power consumption through the power system 111.
  • the handset 100 can also include a peripheral interface 110 for providing an interface to an external input/output device (eg, a mouse, keyboard, external display, external memory, etc.). Peripheral interface 110 can be used to couple the input and output peripherals of the device to processor 101 and memory 103.
  • the processor 101 runs or executes various applications and/or sets of instructions stored in the memory 103 to perform various functions of the handset 100 and process data.
  • the processor 101 can include an image signal processor and a dual or multi-core processor.
  • the handset 100 may also include a camera (front camera and/or rear camera), a subscriber identity module (SIM) Card slot, flash unit, micro projection device, near field communication (NFC) device, etc.
  • a camera front camera and/or rear camera
  • SIM subscriber identity module
  • flash unit flash unit
  • micro projection device micro projection device
  • NFC near field communication
  • the software stored in the memory 103 may include an operating system 201, a communication module (or set of instructions) 202, a contact/moving module (or set of instructions) 203, a graphics module (or instructions).
  • memory 103 may also store device/global internal state 209, as shown in Figures 1 and 2.
  • the device/global internal state 209 can include at least one of the following: an active application state for indicating which applications (if any) are currently active; a display state for indicating what applications, views, or other information The various areas of the touch screen 115 are occupied; the sensor status includes information obtained from the various sensors and peripheral interfaces 110 of the mobile terminal; and information regarding the geographic location and posture of the mobile terminal.
  • Operating system 201 eg, Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, ANDROID, or an embedded operating system (such as Vx Works)
  • general system tasks eg, memory management, storage device control, Various software and/or drivers for power management, etc., and facilitate communication between various hardware and software.
  • the memory 103 can also store the gallery 210.
  • Communication module 202 can communicate with other mobile terminals via peripheral interface 110, and can also include various software for processing data received by radio frequency circuit 102 and/or peripheral interface 110.
  • Peripheral interfaces eg, Universal Serial Bus (USB), Firewire, etc.
  • USB Universal Serial Bus
  • Firewire Firewire
  • peripheral interface 110 may also be the same or similar and/or compatible multi-pin (eg, 30-pin) as the 30-pin connector used on the iPod (trademark of Apple Inc.) device. Connector.
  • the contact/movement module 203 can detect contact with the touch screen 115 and other touch sensitive devices (eg, a trackpad or a physical click wheel).
  • the contact/move module 203 can include a plurality of software for performing various operations related to contact detection, such as determining whether a contact has occurred (eg, detecting a finger press event), determining if there is a contact movement, and at the touch panel The movement is tracked (eg, detecting one or more finger drag events), and it is determined whether the contact has terminated (eg, detecting a finger lift event or a contact interruption).
  • the contact/movement module 203 receives contact data from the touch panel.
  • Determining the movement of the contact point may include determining the speed (magnitude), velocity (magnitude and direction), and/or acceleration (change in magnitude and/or direction) of the contact point, the movement of the contact point being caused by a series of contact data Said. These operations can be applied to a single point of contact (eg, one finger contact) or multiple points of simultaneous contact (eg, "multi-touch" / multiple finger contacts).
  • the contact/movement module 203 can also detect a user's gesture input. Different types of gestures on the touch-sensitive surface have different contact patterns. Therefore, the type of gesture can be detected by detecting a specific contact pattern. For example, detecting a one-finger tap gesture includes detecting a finger press event, and then detecting a finger lift at a location (or substantially the same location) as the finger press event (eg, at the icon location) ( Lift off) event. As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift off) event.
  • the gesture may be a Flick gesture, that is, a single finger taps the touch-sensitive surface of the touch-sensitive display 115, then swiftly slides, and then quickly leaves the touch-sensitive surface, scrolls the screen as above, or switches left and right.
  • the above gesture may also be a Slide gesture, that is, a single finger taps the touch-sensitive surface, and then continuously contacts and moves, such as sliding to unlock;
  • the above gesture may also be a Swipe gesture, that is, multiple fingers contact the touch-sensitive surface, and then continuously contact and move
  • the three fingers can return to the main interface;
  • the above gesture can also be a Tap gesture, that is, a single finger taps the touch sensitive surface, and then immediately leaves the touch sensitive surface;
  • the above gesture can also be a Double Tap gesture, that is, tap twice in a very short time.
  • the above gesture may also be a Touch&Hold gesture, that is, the finger taps the touch-sensitive surface and remains motionless; the gesture may also be a Drag gesture, that is, the finger taps the touch-sensitive surface, and slowly moves the finger without leaving the touch-sensitive surface.
  • the above gestures can also It is the Pinch gesture that two fingers (usually the thumb and forefinger) are kneaded on the touch-sensitive surface; the above gesture can also be an Unpinch gesture that two fingers (usually the thumb and forefinger) open on the touch-sensitive surface.
  • the gestures may be other types of gestures in addition to the various gestures listed above. This embodiment does not impose any restrictions on the types of gestures.
  • Graphics module 204 includes a number of known software for rendering and displaying graphics on touch-sensitive display 115 or other display, including components for varying the intensity of the displayed graphics.
  • graphics includes any object that can be displayed to a user, including, without limitation, text, web pages, icons (such as user interface objects including soft keys), digital images, video, animation, and the like.
  • graphics module 204 stores data representation graphics to be used. Each graphic can be assigned a corresponding code.
  • the graphic module 204 receives one or more codes specifying a graphic to be displayed from an application or the like, and also receives coordinate data and other graphic attribute data together if necessary, and then generates screen image data to be output to the display controller 117.
  • a text input module 205 which may be a component of the graphics module 204, provides for entering text in a variety of applications 208 (eg, contacts 208-1, browser 208-6, and any other applications that require text input). soft keyboard.
  • applications 208 eg, contacts 208-1, browser 208-6, and any other applications that require text input.
  • the location module 206 is operative to determine the geographic location of the mobile terminal and provide this information for use in various applications 208 (e.g., to the telephone 2082 for geographic location based dialing, to the camera module 208-3 as a picture) /video metadata, and other applications provided to provide location-based services, such as weather desktop applet 211-1, map/navigation desktop applet 211-2, etc.).
  • applications 208 e.g., to the telephone 2082 for geographic location based dialing, to the camera module 208-3 as a picture
  • other applications provided to provide location-based services such as weather desktop applet 211-1, map/navigation desktop applet 211-2, etc.
  • the Wi-Fi module 207 is used to execute various instructions required by the Wi-Fi device 107.
  • Application 208 can include the following modules (or sets of instructions) or a subset or superset thereof:
  • Contact module 208-1 (sometimes referred to as an address book or contact) for managing stored contacts;
  • a camera module 208-3 for still images and/or video images for receiving a user's instructions for digital imaging (photographing) using the light sensor 119;
  • the image management module 208-4 is configured to edit, delete, move, rename, and the like to the library 210 stored in the memory 103;
  • a desktop applet module 211 which may include one or more of the following: a weather desktop applet 211-1, a map/navigation desktop applet 211-2, and other desktop applets obtained by the user, and a user-defined desktop. Applet 211-3;
  • a multimedia player module (ie video and music player module) 208-7, which may be composed of a video player module and a music player module;
  • Video conferencing module 208-9
  • Examples of other applications 208 that may be stored in memory 103 include other word processing applications, other image editing applications, drawing applications, JAVA enabled applications, encryption, digital rights management, voice recognition, and sound reproduction.
  • contact module 208-1 can be used to manage an address book or contact list (eg, stored in memory 103 in contact module 208- 1 in the internal state of the application), including: adding a name to the address book; deleting the name from the address book; associating the phone number, email address, home address or other information with the name; associating the image with the name; classifying the name And categorization; provide a phone number or email address to initiate and/or facilitate adoption Telephone 208-2, communication of emails, etc.
  • an address book or contact list eg, stored in memory 103 in contact module 208- 1 in the internal state of the application
  • telephony module 208-2 can be used Enter a sequence of characters corresponding to the phone number, access one or more phone numbers in the contact module 208-1, modify the phone number that has been entered, dial the corresponding phone number, make a call, and disconnect or hang up when the call is complete .
  • wireless communication can use any of a variety of communication standards, protocols, and technologies.
  • the video conferencing module 208-9 includes executable instructions for initiating, conducting, and ending a video conference between the user and one or more other participants in accordance with user instructions.
  • email client module 208-10 includes means for creating, transmitting, in response to user instructions Executable instructions for receiving, receiving, and managing email.
  • email client module 208-10 makes it very easy to create and send emails with still images or video images taken by camera module 208-3.
  • the instant messaging module 208-11 can include a sequence of characters for inputting an instant message, modifying the previous Enter the characters, transmit the corresponding instant message (for example, use Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocol for phone-based instant messaging or use XMPP, SIMPLE, or IMPS for Internet-based instant messaging), An executable instruction that receives an instant message and views the received instant message.
  • SMS Short Message Service
  • MMS Multimedia Messaging Service
  • XMPP extensible Markup Language
  • SIMPLE Session Initiation Protocol
  • IMPS Internet Messaging Protocol
  • An executable instruction that receives an instant message and views the received instant message.
  • the transmitted and/or received instant messages may include graphics, photos, audio files, video files, and/or other attachments supported in MMS and/or Enhanced Messaging Service (EMS).
  • EMS Enhanced Messaging Service
  • instant messaging refers to both phone-based messages (eg, messages sent using SMS or MMS) and Internet-based messages (eg
  • exercise Support module 208-5 includes executable instructions for creating an exercise (eg, having a time, distance, and/or calorie consumption target); communicating with an exercise sensor (sports device); receiving exercise sensor data; calibrating for monitoring exercise Sensors; select and play music for exercise; and display, store, and transmit workout data.
  • an exercise e.g, having a time, distance, and/or calorie consumption target
  • communicating with an exercise sensor sports device
  • receiving exercise sensor data calibrating for monitoring exercise Sensors
  • select and play music for exercise and display, store, and transmit workout data.
  • the camera module 208-3 includes a camera for capturing still images or Video (including video streams) and stored in memory 103 (eg, in digital photo 210), modifying the characteristics of still images or video, or deleting still images or video from memory 1023 (eg, from digital photo 210) Executable instructions.
  • the image management module 208-4 includes for arranging, modifying (eg, editing) Or otherwise manipulated, tagged, deleted, rendered (eg, in a digital slideshow or photo album), and stored in still images and/or video images (including still images and/or video images stored in the gallery 210) Executable instructions.
  • the browser module 208-6 includes means for browsing the Internet according to user instructions (including searching, linking Executable instructions to, receive, and display a web page or portion thereof, as well as attachments and other files linked to the web page.
  • calendar module 208- 14 included for use according to user instructions
  • An executable instruction that creates, displays, modifies, and stores calendars and data associated with the calendar eg, calendar entries, to-do list, etc.
  • the desktop applet module 149 is downloadable and usable by the user.
  • a micro-application eg, weather desktop applet 211-1, map/navigation desktop applet 211-2
  • a micro-application created by a user eg, user-defined desktop applet 211-3
  • the desktop applet includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheet) file, and a JavaScript file.
  • the desktop applet includes an XML (Extensible Markup Language) file and a JavaScript file (eg, a Yahoo! desktop applet).
  • multimedia player module 208-7 includes a user Downloading and playback of executable instructions of recorded music and other sound files stored in one or more file formats (such as MP3 or AAC files), and for displaying, rendering, or otherwise playing back video (eg, in touch Executable instructions on the display 115 or on an external display connected via the peripheral interface 110.
  • the handset 100 can include the functionality of an MP3 player.
  • the map module 208-13 can be used. Receiving, displaying, modifying, and storing maps and data associated with the map (eg, driving directions; stores and other points of interest at or near a particular geographic location; and other geographic location-based data) in accordance with user instructions.
  • maps and data associated with the map eg, driving directions; stores and other points of interest at or near a particular geographic location; and other geographic location-based data
  • the application store module 208-15 can be used to The command receives and displays data related to the application store such as price, content, and the like.
  • notification module 208-12 includes displaying a notification or warning on touch-sensitive display 115 (such as an incoming message or an incoming call, a calendar event reminder) Executable instructions for application events, etc.).
  • modules and applications corresponds to a set of methods for performing one or more of the functions described above, as well as the methods described in this application (eg, computer implemented methods and other information processing methods described herein). Execute the instruction.
  • modules ie, sets of instructions
  • memory 103 can store a subset of the modules and data structures described above. Furthermore, the memory 103 can store additional modules and data structures not described above.
  • Each of the above identified components in FIG. 2 can be stored in one or more of the aforementioned memories 103.
  • Each of the above identified modules corresponds to a set of instructions for performing the functions described above.
  • the above identified modules or programs (ie, sets of instructions) need not be implemented as separate software programs, procedures or modules, and thus various subsets of these modules may be combined or otherwise rearranged in various embodiments.
  • memory 103 can store a subset of the modules and data structures described above.
  • the memory 103 can also store additional modules and data structures not described above.
  • a mobile terminal is a device in which the operation of a predefined set of functions on the device is performed exclusively through a touch screen and/or a touchpad.
  • the touch screen and/or the touchpad as the primary input control device for the operation of the mobile terminal, the number of physical input control devices (such as push buttons, dials, etc.) on the mobile terminal can be reduced.
  • the predefined set of functions that can be performed by the touch screen and/or the touchpad include navigation between the user interfaces.
  • the mobile terminal navigates from the graphical user interface that can be displayed on the mobile terminal to the main menu, main menu, or root menu when the touchpad is touched by the user.
  • the touchpad can be referred to as a "menu button.”
  • the menu button can be a physical push button or other physical input control device instead of a touchpad.
  • the following embodiments can all be implemented in a mobile terminal (e.g., mobile phone 100) having the above hardware.
  • the mobile terminal 100 may further include physical components such as a camera 306, an earpiece 307, an ambient light sensor (not shown), and the camera may include one or more front cameras and one or more rear cameras, wherein the front camera is disposed at The display is on the same side, the rear camera is placed on the back of the display, and the front camera can be placed on the face of the phone and placed in close alignment with the display.
  • the front camera 306 is located near the top of the phone.
  • the earpiece 307 is located above the front camera 306, or, for example, as shown in FIG.
  • the front camera 306 is located near the top of the mobile terminal 100, and the earpiece 307 is disposed directly above the front camera 306.
  • the front camera 306 is also It can be placed close to the bottom of the mobile terminal 100, and the specific design can be product design.
  • the touch screen 115 is a non-regular rectangular touch screen. The irregular area of the screen area of the touch screen 115 extends to the two sides of the front camera 306 at the top of the mobile terminal 100, providing a working space for the camera 306, the handset 307 and the like, and greatly improving the display. Screen ratio to improve visual effects.
  • the front camera 306 is disposed at the center of the top of the mobile terminal 100 as an example for explanation.
  • Touch screen 115 can display one or more graphics within a graphical user interface (GUI).
  • GUI graphical user interface
  • the mobile terminal can detect that the user is using, for example, one or more fingers 301 (not drawn to scale in the drawings) or with one or more touches.
  • a pen (not shown) gestures graphically to select an operation of one or more of these graphics.
  • the selection of one or more graphics occurs when the user interrupts contact with the one or more graphics.
  • the gesture may include one or more taps, one or more swipes (from left to right, from right to left, up and/or down) and/or fingers that have been in contact with the mobile terminal 100 (from right to left, left to right, up and/or down).
  • unintentional contact with the graphic does not select the graphic. For example, when the gesture corresponding to the selection is a tap, the swipe gesture swiped over the application icon does not select the corresponding application.
  • the mobile terminal 100 may also include one or more physical buttons, such as a home screen button 303, a menu button 304, and a return button 305.
  • menu button 304 can be used to navigate to any of a set of applications that can run on mobile terminal 100.
  • the buttons described above can each be implemented as virtual keys displayed in a graphical user interface (GUI) on the touch screen 115.
  • GUI graphical user interface
  • the mobile terminal 100 may further include a push button for the device power on and lock device, a volume adjustment button(s), a subscriber identity module (SIM) card slot, a headset jack, and docking / Charging external port, etc.
  • the push button can be used to power the device by pressing the button and holding the button in a depressed state for a predefined time interval; by pressing the button and releasing it before the predefined time interval This button locks the device; and/or unlocks the device or initiates an unlocking process.
  • device 100 may also accept voice input for activating or deactivating certain functions via microphone 113.
  • GUI graphical user interface
  • the mobile terminal provided by the embodiment of the present application has a display screen and a camera, wherein the display screen may be a touch screen, and the touch screen includes a first screen area 308 and a second screen area 309.
  • the first screen area 308 is a rectangular area
  • the second screen area 309 is an area of the touch screen extending from the first screen area 308 to the periphery of the front camera. Therefore, the touch screen 115 is different from the conventional rectangular touch screen in the prior art, and the display area of the touch screen 115 extends to the two sides of the front camera 306 at the top of the mobile terminal 100 to provide a working space for the camera 306, the handset 307, and the like.
  • the screen ratio of the touch screen 115 is improved, and the visual effect is improved.
  • the front camera 306 is disposed at the top center of the mobile terminal 100 as a drawing for illustration.
  • the first screen area 308 and the second screen area 309 may be controlled and controlled by the same display controller 117.
  • the mobile terminal upon illuminating the display screen or detecting that the user clicks on the home screen button 303, the mobile terminal displays a series of exemplary graphical user interfaces (GUIs) on the touch screen, including in the first screen area.
  • GUIs graphical user interfaces
  • 303 shows the main screen In the second screen area 309, a device status icon such as a Wi-Fi signal, a communication signal, a battery power, a time, and the like are displayed, and an application icon such as a short message, a mail, a camera, a music, a WeChat, or the like may be displayed in the second screen area.
  • the home screen may include a plurality of sub-screens, and each of the sub-screens may include different contents.
  • the GUI may be the first sub-screen in the main screen of the mobile terminal.
  • the first sub-screen is displayed on the touch screen of the mobile terminal and may include a main screen indicator 403 and icons of various types of App.
  • the main screen indicator 403 is used to prompt the user which sub-screen is currently displayed.
  • the first sub-screen including multiple rows and columns of App icons; when the mobile terminal detects that the user's finger (or stylus, etc.) touches a position on the touch screen, in response to the touch event,
  • the mobile terminal can open a graphical user interface of the App corresponding to an App icon.
  • a Dock bar may also be included in the main screen, and a commonly used App icon may be included in the Dock column, and details are not described herein.
  • the graphical user interface 400 illustratively includes the following elements or a subset or superset thereof:
  • a setting 406 that provides access to settings of the device 100 and its various applications 208;
  • finger input eg, single finger contact, single finger tap gesture, single finger swipe gesture
  • these finger inputs are One or more inputs from another input device (example For example, stylus input) instead.
  • Embodiments of the user interface ("UI") and associated processes that can be implemented on a mobile terminal having a display and a touch-sensitive surface, such as the portable mobile terminal 100, are now turned to.
  • the mobile terminal 100 described in the present application is intended to fully display the display screen 115 with the second screen area 309 that is not continuously displayed, providing various interactive functions and improving the user experience.
  • the user's gestures are flexible, and can be click, double click, slide, circle, draw line, single finger touch, or multi finger touch, and the like.
  • the selection of a particular gesture is flexible as long as substantially the same effect is achieved.
  • the position or area of the user's gesture acting on the touch-sensitive surface is flexible, and may be the area of an application interface element displayed on the display screen or a nearby area, and the display does not display the blank of the application interface element. Area, the display shows the area of a function setting, and so on.
  • the specific location or area of the gesture acting on the touch-sensitive surface can be flexibly set as long as substantially the same effect can be achieved.
  • the mobile terminal 100 can detect the pressure, duration, region, location, distance to one or some application icons, or distance from the boundary of the touch-sensitive surface, etc., by the finger 301 acting on the touch-sensitive surface, etc. In a manner, it is determined that the intention of the gesture is to instruct the device to operate on the application icon or in the non-application icon area, for example, launching the application, flipping the sub-screen, and the like, thereby responding to the gesture.
  • FIG. 5 illustrates a flow diagram of a method of displaying a graphical user interface provided in accordance with some embodiments.
  • the method is performed on the mobile terminal 100 with a display mentioned in the various embodiments below.
  • the display is a touch screen display and the touch sensitive surface is on the display.
  • the display is separate from the touch-sensitive surface.
  • the method includes steps 501 to 503.
  • step 501 the mobile terminal displays an application interface of the first application in the first screen area; then, in step 502, when the second application has a notification, the mobile terminal is The second screen area displays the notification; in step 503, when detecting a first touch operation performed on the notification, the mobile terminal continues to display the application of the first application in the first screen area And displaying an application interface related to the notification of the second application on an application interface of the first application.
  • the finger 301 can be detected on the touch-sensitive surface of the touch screen 115.
  • the mobile terminal 100 launches the application icon 418 in response to clicking the finger 301 of the application icon 418 on the first screen area 308. Thereafter, the graphical user interface of the mobile terminal 100 transitions to FIG. 6B, and the interface content of the application interface is displayed on the first screen area 308.
  • the mobile terminal 100 may display or implicitly prompt the user that the application icon 418 can be launched, for example, the mobile terminal 100 vibrates.
  • the application icon 503 can be unresponsive to the finger 301.
  • the mobile terminal 100 can also display or implicitly prompt the user that the application icon 418 does not respond to the finger 301.
  • the mobile terminal 100 when the touch screen displays an interface of the home screen as shown in FIG. 4, the mobile terminal 100 is responsive to the finger 301 that is slid from the non-apply icon area in the first screen area 308, in the first screen area 308. Displays an interface that transitions from one screen's interface to another.
  • the mobile terminal 100 in response to the finger 301 executed in the first screen area 308, when the mobile terminal 100 changes the corresponding display content in the first screen area 308, the same content may be displayed in the second screen area 309, such as FIG. 6A. After the transition to FIG. 6B, the mobile terminal 100 still displays some device status icons and application icons in the second screen area 309. Even when the first screen area 308 is not lit, the mobile terminal 100 may still be in the second screen area 309. Some device status icons and application icons are displayed, so that the user does not need to fully power the mobile terminal 100, and some device related information can still be obtained, which saves the power of the device and improves the user experience.
  • the mobile terminal 100 can set whether to display or hide the display content of the first screen area 309 in response to one finger 301.
  • the mobile terminal 100 has a display/hide icon 423 in the second screen area 309, and in the display state, when the mobile terminal 100 detects the operation of the finger 301 on the display/hide icon 423 (for example, clicking and double-clicking When the operation is long pressed, dragged, etc., the mobile terminal 100 can transition from displaying some device status icons and application icons in the second screen area 309 as shown in FIG. 7A to hiding in the second screen area as shown in FIG. 7B. 309 displays those device status icons and application icons (keep the show/hide icon 423).
  • the mobile terminal 100 can display those device status icons and application icons hidden from the second screen area 309 as shown in FIG. 7B (reserved The show/hide icon 423) transitions to display some device status icons and application icons in the second screen area 309 as shown in FIG. 7A.
  • the mobile terminal 100 may extinguish the second screen area 309 to save power consumption, reduce the interference of the display content of the second screen area 309 on the display content of the first screen area 308, and may also be in the first display area 308 and The first screen area 308 cooperates to display one continuous interface content, and the overall display improves the display effect.
  • the mobile terminal 100 may also provide a pressure sensitive function instead of or in combination with the show/hide icon 423.
  • the mobile terminal 100 may display or hide the above-described icon displayed in the second screen region 309, similar to FIGS. 8A and 8B.
  • the mobile terminal 100 may reduce the brightness or transparency of the second screen area 309, and may reduce the display content of the second screen area 309 to the user. Interference from a screen area 308.
  • the mobile terminal 100 when the mobile terminal 100 detects an operation of the icon 422 of the application of the second screen area 309 by the finger 301 (eg, clicking the icon 422 of the application), the mobile terminal 100 can run the application and display the interface content of the corresponding application in the first screen area 308.
  • the mobile terminal 100 may display icons of some specified applications on the second screen area 308, such as a commonly used application or a user-set application, the mobile terminal 100 is in the second screen area 309 and the first screen area 308. It can be used to quickly enter the application interface of common applications, simplifying the user operation process. For example, as shown in FIG. 9A, when the mobile terminal 100 detects that the finger 301 clicks on the icon 406 of the setting application of the first screen area 308, the set application interface is displayed in the first screen area 308, as shown in FIG.
  • the mobile terminal 100 displays the application interface of the WeChat application in the first screen area 308, and displays the icon 406a of the setting application in the second screen area 309; Then, when detecting that the finger 301 clicks on the touch operation 301a of the icon 406a of the setting application of the second screen area 309, the mobile terminal 100 displays the application interface of the setting application as shown in FIG. 9B on the first screen area 308, while at the second The icon 422 of the WeChat application is displayed on the screen interface 309; or when the touch operation 301b of the return control 425 shown in FIG.
  • the mobile terminal 100 displays the main screen as shown in FIG. 9A in the first screen area 308.
  • the interface, and the icon 422 of the WeChat application is displayed in the second screen area 309.
  • the example method can provide quick access to commonly used applications and quickly return to the application interface of the previous access application, simplifying the user operation process and improving the user experience.
  • Steps 501 to 503 in the method are further described below with reference to the accompanying drawings and the above embodiments.
  • step 501 the mobile terminal 100 displays an application interface of the first application in the first screen area 308.
  • the mobile terminal 100 displays an interface of the instant messaging application during the video call in the first screen area 308. .
  • the mobile terminal 100 may further display an icon 422 of the at least one second application in the second screen area 309, specifically showing which second application and the number of displays can be determined and adjusted according to the settings.
  • step 502 when there is a notification of the second application, the mobile terminal 100 displays the content of the notification in the second screen area 309; and continues to display the application interface of the first application in the first screen area.
  • the mobile terminal 100 when the mobile terminal 100 detects the notification of the second application, the mobile terminal 100 may be in the second screen area.
  • the 309 flashes an icon corresponding to the second application, or displays the number of messages on the icon corresponding to the second application.
  • the mobile terminal 100 can also modify the application icon to the source of the message, that is, the image of the sender of the message, so that the user can identify the identity of the party.
  • the notification may be an instant message received by the mobile terminal 100 through the radio frequency circuit 102, and the notification may also be triggered when the second application is running in the background to determine that certain conditions (eg, specific time, specific location, specific temperature, etc.) are met.
  • Content such as a timed reminder notice.
  • the specific content of the notification may include, but is not limited to, text, image, animation, etc., and the prompt information may also be information of the sender of the notification, such as a sender image (eg, avatar, icon, etc.), sender identity information. (such as name, name, number, etc.), sender's sending time, etc.
  • the mobile terminal 100 displays a notification 424 alongside an icon (eg, WeChat) 422 of the first application of the second screen area 309, the notification 424 including the sender avatar and the text content "Where" of the notification.
  • an icon eg, WeChat
  • the mobile terminal 100 when the mobile terminal 100 detects the notification of the second application, the mobile terminal may automatically adjust other application icon positions on the second screen area 309 according to the notified content length, and may also only be in the entire second screen area 309.
  • the notification content is displayed, and the content of the notification may be scrolled when the content of the notification is long, and the icon corresponding to the second application may be flashed or changed color or the number of messages displayed beside the user, so that the user can perceive the notification.
  • the mobile terminal 100 may display the notification fixedly on the second screen area, facilitating the user to view the content of the notification at any time, and the mobile terminal 100 may detect the user selecting to close the operation (pressing When the screen is either swiped, clicked, double-clicked on the icon or message, or the second application is triggered, the notification information of the notification is turned off, and the user returns to the initial state as shown in FIG. 10A to reach a valid notification of the message.
  • the mobile terminal 100 when the mobile terminal 100 displays the notification 424, due to the size of the second screen area 309, icons of other applications may be hidden. For example, as shown in FIG. 10B, the mobile terminal 100 displays the notification 424 in the first Next to the icon 422 of the second application, the icon on the right side of the notification 424 is shifted to the right as a whole, and other icons of the "moving out" of the second screen area 309 are not displayed.
  • the mobile terminal 100 can move and display other icons than the second screen area 309 according to the sliding operation of the finger 301 on the second screen area 309, so that the user can be made in need. Show the other icons that were previously hidden.
  • the mobile terminal 100 may fix the display size of the notification 424 and display the notified message content within the notified display size area, such as a scroll display from right to left, or a scroll display from top to bottom. Wait.
  • step 503 the mobile terminal 100 continues to display the first application in the first screen area 308 in response to detecting the first operation performed by the finger 301 on the notification displayed by the second screen area 309.
  • An application interface is displayed, and an application interface 430 related to the second application is displayed on all or part of the application interface of the first application.
  • the application interface 430 may be an application interface related to the notification, or may be an application interface that invokes other functions of the second application.
  • the mobile terminal 100 when the mobile terminal 100 detects the operation of dragging the notification 402 from the second screen area 309 to the first screen area 308, the mobile terminal 100 continues to display the interface of the running instant messaging application, and continues the video call.
  • the notification is displayed on the application interface of the instant messaging application, and the application interface 430 may include the specific content-related application interface of the notification shown in FIG. 12B.
  • the application interface 430 may further include an application interface of other related functions of the second application, for example, the mobile terminal 100 detects that the user clicks or double-clicks the icon 422 of the second application. Operation, the contact list may be displayed in the first screen area 308, the operation of detecting the sliding content input by the user contact list may be moved, the display context may be moved, the contact is detected in the detection of the user's sliding or input, and the display interface of the contact is entered. .
  • the method may further include step 504, in step 504, when the mobile terminal 100 detects an operation performed by the finger 301 on the interactive interface of the touch screen (eg, clicking "reply"), the mobile terminal 100 displays Application interface 430 from Figure 12B Going to the input interface shown in FIG. 12C, the mobile terminal 100 acquires the second operation of the finger 301 in the input area of the application interface 430, and obtains a reply message. When it is detected that the point finger 301 clicks "send", the second application will reply the message. Send to the corresponding recipient (corresponding to the aforementioned sender).
  • step 504 when the mobile terminal 100 detects an operation performed by the finger 301 on the interactive interface of the touch screen (eg, clicking "reply"), the mobile terminal 100 displays Application interface 430 from Figure 12B Going to the input interface shown in FIG. 12C, the mobile terminal 100 acquires the second operation of the finger 301 in the input area of the application interface 430, and obtains a reply message. When it is detected that the point finger 301 clicks "
  • the application interface 430 displayed by the mobile terminal 100 transitions from FIG. 12B to the input interface shown in FIG. 12C to continue to display the interface of the running instant messaging application, the notification of the continued video call, and the application on the interface of the instant messaging application. Interface 430.
  • the mobile terminal 100 still continues to run the first application, and still displays the application interface of the first application in the first screen area 308 in real time, for example, FIG. 12A to FIG. 12C, the mobile terminal 100 is in the first screen area.
  • 308 still performs the video call process in real time, that is, continues to display the moving images of both parties in the real time, and the voices of both parties of the call.
  • the application interface 430 can be displayed in a semi-transparent or opaque manner, wherein displaying the interface content that allows the user to continue viewing the first application in a semi-transparent manner.
  • the mobile terminal 100 when the mobile terminal 100 displays an application interface related to the notification of the second application, when detecting an area outside the application interface of the first screen area 308 and the second application The third touch operation performed on the mobile terminal 100 executes an instruction corresponding to the third touch operation in the second application, and continues to display the application related to the notification in the second application in the first screen area interface.
  • the input interface 430 of the second application may include a virtual keyboard, and the virtual keyboard may be set as a full keyboard or a nine-square grid keyboard.
  • the input interface 430 of the second application may be split into two. In part, the middle part of the interface content of the first application is vacated. For example, during the game, the central view area is more important, and the middle part is free to interfere with the game.
  • the application interface of the second application may further integrate voice input in the input method, and the mobile terminal 100 runs the second application reply message according to the voice input of the user, further reducing the keyboard to the first application. Display interference on the screen.
  • the content displayed by the mobile terminal 100 may transition from FIG. 13A to FIG. 13B.
  • the application interface 430 that is, the notification content displayed by the mobile terminal in the first screen area 308 is displayed as being input, and the input interface is displayed on the first screen area 309.
  • the method is adopted.
  • the first screen area 308 and the second screen area 309 cooperate with the processing of the notification of the second application, further simplifying the interaction process of the second application displayed in the first screen area 308 and the interaction interface, which facilitates the user to quickly process the second application.
  • the notification shortens the influence time of the application interface of the first application, so that the user can return to, for example, watching a movie, playing a game, or a video call as soon as possible, thereby improving the user experience.
  • the mobile terminal 100 continues to display the application interface of the first application in the first screen area, and does not display the application interface of the second application, for example, After the mobile terminal 100 detects that the gesture 301 clicks and sends, the mobile terminal 100 exits the application interface of the second application, and the display is as shown in FIG. 13A.
  • the mobile terminal 100 may perform the second application and The instruction corresponding to the third touch operation, for example, when the first application is a game application, during the notification process of processing the second application, if an enemy approach is found in the game, the user can immediately operate the interface of the first application, and The mobile terminal may continue to display an application interface related to the notification in the second application in the first screen area.
  • the mobile terminal 100 may continue to display the application interface of the first application in the first screen area 308 according to an operation of the user, and exit the application interface of the second application, and the exit mode may be
  • the mobile terminal 100 detects that the finger 301 clicks on the icon corresponding to the second application in the second screen area 308; the mobile terminal 100 detects that the finger 301 is long pressed by the application interface of the second application; the mobile terminal detects that The finger 301 double-clicks on an area of the application interface of the first application and outside the application interface of the second application.
  • the mobile terminal 100 displays the interface content of the first application, such as video call, video play (movie, television, animation, etc.), game, etc., in the first screen area 308, when there is a notification of the second application, the mobile terminal 100 can be displayed in the second screen area 309
  • the notification related information on the one hand, does not occupy the first screen area 308, does not affect the display content of the first screen area 308, and on the other hand, the manner of prompting the pop-up interface in the first screen area 308
  • the related information can be permanently displayed in the second screen area 309, and is not quickly retracted after the pop-up interface pops up, so that the user does not have time to see the content of the notification, and the notification disappears.
  • the mobile terminal 100 After the mobile terminal 100 detects the first operation of the notification by the user, displaying the interface content of the first application in the first screen area 308, displaying the application interface 430 of the second application on the interface content of the first application,
  • the application interface 430 can process the notification in response to a second operation performed by the user, including reviewing the content of the notification, processing or replying to the notification, and the like. Therefore, the mobile terminal 100 does not need to jump from the interface content of the first application being displayed to the interface content of the second application on the first screen area 308, so that the user can still continue to view the interface content of the first application, and the application interface 430
  • the function of quickly processing the notification of the second application can be provided to the user.
  • the user experience is greatly improved. For example, when the user is watching a movie, the user does not need to stop the movie being watched, and does not need to exit the player application in the first screen area, and switch to another application. , the notification can be processed; the user does not need to jump out of the game application during the game, avoiding problems that may be judged as “dropped” or “escaped” by the game service party, and the notification can be processed; and the user is not required during the video pass. Close the video call interface to avoid affecting the call process with the other party, you can handle the notification.
  • the mobile terminal 100 can detect that the user clicks on a message, an icon, presses a screen or a certain place to enter a message input mode.
  • the mobile terminal 100 displays and serves as an input area in a part or the entire area of the first screen area, and does not enter the input area. It will affect the screen display of the original game, movie or reading application, for example, superimposing the message content, input keyboard, handwriting input track, input method, etc. on it in a translucent or opaque manner, and then send the input message.
  • the icon of the second screen area 309 may also rotate with it, for example, as shown in FIG. 14A.
  • the user is provided with an appropriate viewing angle of the viewing direction, and the application interface 430, also displayed on the first screen area 308, also provides an appropriate display orientation.
  • a method of displaying a graphical user interface comprising steps 601 to 602.
  • step 601 the mobile terminal 100 activates the pre-camera function. As shown in FIG. 16A, the mobile terminal 100 detects the operation of the finger 301 clicking the camera icon 407, turns on the photographing function, and detects that the finger 301 clicks on the front/rear camera. The operation of the control 425 starts the front camera to shoot.
  • the mobile terminal 100 displays the image acquired by the front camera on the first screen area 308, and enters the fill light mode in the second screen area 309.
  • the fill light mode may include: increasing the second screen area. Or the display brightness of the partial area exceeds the threshold to fill the subject, for example, as shown in FIG. 16B, the display brightness of the second screen area 309 is raised above a certain threshold, or even increased to a maximum value, that is, the second The brightness of the backlight in screen area 309 is increased to a certain threshold or even increased to a maximum.
  • the mobile terminal 100 can also adjust the second screen area 309 to a monochrome mode, such as white, yellow, blue, etc., to complement the subject, and also help to improve the subject image.
  • a monochrome mode such as white, yellow, blue, etc.
  • the color enhances the imaging effect and provides the user's shooting experience.
  • the mobile terminal displays the second screen area 309 as a fill light strip during the front camera shooting process, and fills the subject (such as a human face) to make the user's ambient light dark. You can still get better brightness images, for example, you can still take selfies and video calls in dark environments. Therefore, when the front camera is started to take a photo, the mobile terminal 100 uses the second screen area as a fill light to light the discontinuous screen area, and provides a fill light in applications such as photographing, makeup, and face recognition. The effect is to improve the image quality obtained in a dark environment. In the discontinuous screen area, the backlight brightness of the area can be enhanced to obtain a better fill light effect.
  • the display screen has more functions, improves the user's use requirements in various scenarios, and improves the user experience.
  • the mobile terminal 100 may fill light in one or more partial regions of the second screen area 309, as shown in FIGS. 17A, 17B, and 17C, the current camera shooting process enters the depth 3D mode, and when the finger 301 is detected to click to take a photo, the front camera Three photos are taken continuously, and each time the photograph is taken, 426a, 426b, and 426c are respectively illuminated to fill light, and then the processor 101 of the mobile terminal 100 combines the three images, and the dual front camera is used to obtain high precision by using light and shadow changes. 3D depth information. Filling the light from different angles to form a more accurate image further helps to improve the imaging effect.
  • the front camera and the iris scan camera are activated, and the captured human eye is displayed in the first screen area 308, and the infrared light is added on the basis of the visible light displayed on the second screen area 309 for iris recognition or Face recognition provides infrared fill light effect and enhances iris recognition.
  • the mobile terminal utilizes the second screen area to achieve a soft fill light effect, which brings better shooting effects without affecting the display of the application content.
  • the present application provides a solution for utilizing a discontinuous screen area as a fill light. Compared with the existing technology, it is not necessary to occupy extra space on the device panel and add additional openings, so that the fill light effect can be realized in the scheme of large screen ratio.
  • the mobile terminal 100 may also display a cue pattern 435 pointing to the position of the front camera 306 in the second screen area 309 to improve the shooting effect.
  • the computer program product includes one or more computer instructions.
  • the computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable device.
  • the computer instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions can be from a website site, computer, server or data center Transfer to another website site, computer, server, or data center by wire (eg, coaxial cable, fiber optic, digital subscriber line (DSL), or wireless (eg, infrared, wireless, microwave, etc.).
  • the computer readable storage medium can be any available media that can be accessed by a computer or a data storage device such as a server, data center, or the like that includes one or more available media.
  • the usable medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (such as a solid state disk (SSD)).
  • the embodiment of the present application may divide the function module into the device according to the foregoing method example.
  • each function module may be divided according to each function, or two or more functions may be integrated into one processing module.
  • the above integrated modules can be implemented in the form of hardware or in the form of software functional modules.
  • the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and may be further divided in actual implementation.

Abstract

本申请提供了显示图形用户界面的方法和包括触摸屏和摄像头的移动终端,该移动终端的触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域。其中,所述移动终端在所述第一屏幕区域显示第一应用的应用界面;当所述第二应用有通知时,所述移动终端在所述第二屏幕区域显示所述通知;当检测到对所述通知执行的第一触摸操作,所述移动终端在所述第一屏幕区域继续显示所述第一应用的应用界面,并在所述第一应用的应用界面上显示所述第二应用的与所述通知相关的应用界面。本申请提高了移动终端的多样化交互功能,简化用户的操作过程,同时提高用户体验。

Description

显示图形用户界面的方法和移动终端 技术领域
本申请涉及人机交互领域,尤其涉及显示图形用户界面的方法和移动终端。
背景技术
在当前智能手机等终端设备的发展趋势下,终端可实现的功能不断扩展,消费者对于终端设备不再仅仅满足于通话的需求,对于显示方面的诉求也在不断提高。从数字按键的功能机到电阻屏、电容屏的智能手机,显示屏幕尺寸也发展到5.5英寸,甚至更大,大屏手机越来越受到消费者的青睐。随着智能终端竞争的白热化,超大屏占比、甚至全屏手机的概念也应运而生,考虑到手机尺寸的便携性,业界致力于提高手机的屏占比。随着为提高手机屏占比产生各种显示屏结构和尺寸,如何在显示屏中提供更多样化的交互功能,成为提高用户使用体验的关键。
发明内容
为解决上述技术问题,本申请实施例提供多种显示图形用户界面的方法及移动终端,旨在提高移动终端的多样化交互功能,简化用户的操作过程,同时提高用户体验。
第一方面,本申请实施例提供了一种在移动终端上显示图形用户界面的方法,所述方法包括以下步骤:首先,所述移动终端在所述第一屏幕区域显示第一应用的应用界面;然后,当所述第二应用有通知时,所述移动终端在所述第二屏幕区域显示所述通知;随后,当检测到对所述通知执行的第一触摸操作,所述移动终端在所述第一屏幕区域继续显示所述第一应用的应用界面,并在所述第一应用的应用界面上显示所述第二应用的与所述通知相关的应用界面。因此,所述方法能够充分利用所述移动终端的显示区域,在第一屏幕区域显示第一应用的界面内容,例如视频通话、影音播放(电影、电视、动画等)、游戏等时,当有第二应用的通知时,移动终端可以在第二屏幕区域显示通知相关的信息,一方面,相比于在第一屏幕区域弹出界面进行提示的方式,不会占用第一屏幕区域,不影响第一屏幕区域的显示内容,另一方面,通知的内容可以持久地显示在第二屏幕区域,避免用户来不及看清通知的内容,通知就消失的问题;并且提供了一种便捷功能,使用户快速处理第二应用的通知并继续观看第一应用的界面内容。
在一些可能的实现方式中,所述移动终端在所述第一应用的应用界面的部分区域上显示所述第二应用的应用界面。
在一些可能的实现方式中,所述移动终端在所述第一应用的应用界面的部分区域上显示所述第二应用的应用界面,所述移动终端在所述第一应用的应用界面上以透明或半透明方式显示所述第二应用的应用界面,以提高移动终端在触摸屏上的显示效果。
在一些可能的实现方式中,所述移动终端显示所述第二应用的与所述通知相关的应用界面时,当检测到在所述第二应用的应用界面上执行的第二触摸操作,所述移动终端处理所述通知,以使用户能够继续观看第一应用的界面内容并快速处理第二应用的通知,包括查看、回复等。
在一些可能的实现方式中,所述移动终端处理完所述通知之后,所述移动终端还在所述第一屏幕区域继续显示所述第一应用的应用界面,且不显示所述第二应用的应用界面。所述移动终端处理完所述通知后,关闭在第一屏幕区域上显示的第二应用的应用界面,该处理过程简洁流畅,适应用户的使用习惯。
在一些可能的实现方式中,所述移动终端显示所述第二应用的与所述通知相关的应用界面时,当检测到在所述第一屏幕区域且在所述第二应用的应用界面外的区域上执行的第三触摸操作,所述移动终端执行第二应用中与所述第三触摸操作对应的指令,并在所述第一屏幕区域继续显示所述第二应用中与所 述通知相关的应用界面,也就是说,在第一屏幕上显示第二应用的应用界面和第一应用的应用界面时,可以根据检测到在第一屏幕区域执行的触摸操作的位置,选择执行第二应用相关的指令还是执行第二应用的相关指令。
在一些可能的实现方式中,所述移动终端显示所述第二应用的与所述通知相关的应用界面时,当检测到第四触摸操作,所述移动终端在所述第一屏幕区域继续显示所述第一应用的应用界面,且不显示所述第二应用的应用界面,所述移动终端可以根据相应的第四触摸操作退出显示在第一屏幕区域的第二应用的应用界面,第四触摸操作可以根据预先设定确定,所述移动终端检测到第四触摸操作的步骤包括以下任一项:所述移动终端检测到对所述第二屏幕区域中对应所述第二应用的通知的触摸操作;所述移动终端检测到对所述第二应用的应用界面的触摸操作;所述移动终端检测到对所述第一应用的应用界面中且在所述第二应用的应用界面外的区域上执行的触摸操作。
在一些可能的实现方式中,所述移动终端在所述第二屏幕区域显示至少一个所述第二应用的图标。
在一些可能的实现方式中,所述方法还包括:当检测到对所述第二应用的图标执行的第一触摸操作,在所述第一屏幕区域显示所述第二应用的应用界面,在所述第二屏幕区域显示所述第一应用的图标。
在一些可能的实现方式中,结合前一所述的实施例,所述方法还包括:当所述移动终端在所述第二屏幕区域不显示所述第二应用的应用界面时,在所述第二屏幕区域显示所述第二应用的图标。
所述第二应用可以是系统级的应用,也可以是第三服务方提供的应用。在所述第二屏幕区域显示至少一个所述第二应用的图标,为用户提供多样化的显示方式,并且,在一些实施例中,移动终端可以响应于检测到用户在所述第二屏幕区域显示至少一个所述第二应用的图标的触摸操作,快速进入第二应用,从而提供了快速进入常用应用和快速回到前次访问应用的应用界面的功能,简化用户操作流程,提高用户使用体验。
在一些可能的实现方式中,所述移动终端通过在所述第二屏幕区域显示所述通知的内容来提示所述通知。
在一些可能的实现方式中,所述移动终端通过在所述第二屏幕区域显示所述通知的发送方信息来提示所述通知,其中,所述发送方信息包括发送方图像、发送方身份信息及发送方发送时间中任一项或任几项。
在一些可能的实现方式中,所述移动终端通过在所述第二屏幕区域改变所述通知对应的所述第二应用的图标的显示方式来提示所述通知。
在一些可能的实现方式中,所述方法还包括:所述移动终端在所述第二屏幕区域显示一控件;当检测到对所述控件执行的第三触摸操作,所述移动终端隐藏所述至少一个第二应用的图标和/或所述第二应用的通知。所述移动终端基于触摸操作选择熄灭第二屏幕区域,以节约电量消耗或者降低第二屏幕区域的显示内容对第一屏幕区域的显示内容的干扰;或者所述移动终端基于触摸操作将第一显示屏区域和第一屏幕区域配合共同显示一个连续的界面内容,整体显示提高显示效果,从而提供多样化的显示方式和功能。
在一些可能的实现方式中,所述移动终端在所述第二屏幕区域显示所述通知时,在所述第二屏幕区域以滚动显示的方式,显示所述通知的内容,以适应第二屏幕区域的尺寸并完整第显示所述通知的内容。
第二方面,本申请提供了一种在移动终端上显示图形用户界面的方法,其中,所述移动终端包括触摸屏和摄像头,所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域,在该移动终端执行的方法包括以下步骤:首先,所述移动终端在所述第一屏幕区域显示第一应用的应用界面,在所述第二屏幕区域显示第二应用的图标;然后,当检测到对所述第二应用的图标执行的第一触摸操作,所述移动终端 在所述第一屏幕区域显示所述第二应用的应用界面,在所述第二屏幕区域显示所述第一应用的图标。移动终端通过在第二屏幕区域显示至少一个第二应用的图标,例如一些常用的应用,当检测到对所述第二应用的图标执行的触摸操作,快速进入第二应用,在第一屏幕区域切换显示第二应用的应用界面,节省了需要先退出第一应用的应用界面的触摸操作,从而提供了一种快速进入常用应用的功能,简化交互过程,提高用户使用体验。
在一些可能的实现方式中,所述移动终端在所述第一屏幕区域显示所述第二应用的应用界面之后,当所述移动终端在所述第二屏幕区域不显示所述第二应用的应用界面时,在所述第二屏幕区域显示所述第二应用的图标。在第二屏幕区域显示的第一应用的图标,响应于检测到对第一应用的图标的触摸操作,在第一屏幕区域切换显示第二应用的应用界面,进而提供了一种快速回到前次访问应用的功能,交互过程简便快捷。
第三方面,本申请提供了一种在移动终端上显示的方法,其中,所述移动终端包括触摸屏和摄像头,所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域,在该移动终端上执行的方法包括:首先,所述移动终端启动所述摄像头拍摄;然后,所述移动终端在所述第一屏幕区域上显示所述摄像头所获取的图像,并提高所述第二屏幕区域全部或部分区域的显示亮度超过阈值,以给被拍摄物补光。所述方法中,移动终端通过在前置摄像头拍摄过程中,将第二屏幕区域作为补光灯,无需额外设置补光灯器件,即可为被拍摄物(例如人脸)进行补光,使用户环境光线较暗时仍然能够获得亮度较佳的图像,在拍照、化妆、人脸识别等应用中提供补光灯的作用,使获得的图像质量在暗光环境下得到改善。因此,所述移动终端具有更多样的交互功能,提高用户在拍摄场景的使用需求,提高用户使用体验。
在一些可能的实施方式中,所述移动终端在所述第二屏幕区域全部或至少一个局部区域显示预设颜色,以给被拍摄物补光。在一些实施例中,移动终端将第二屏幕区域调整至单色模式,例如白色、黄色、蓝色等,为被拍摄物进行补光的同时,还可以帮助提高被拍摄物成像颜色,提高成像效果,提供用户的拍摄体验。
在一些可能的实施方式中,所述方法还包括:所述移动终端在第二屏幕区域还显示指向所述摄像头位置的提示图案。
第四方面,本申请提供了一种移动终端,其中,所述移动终端包括:摄像头;触摸屏,其中,所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域;一个或多个处理器;存储器;以及一个或多个计算机程序,其中所述一个或多个计算机程序被存储在所述存储器中,所述一个或多个计算机程序包括指令,当所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:首先,在所述第一屏幕区域显示第一应用的应用界面;当所述第二应用有通知时,在所述第二屏幕区域显示所述通知;然后,当检测到对所述通知执行的第一触摸操作,之后,在所述第一屏幕区域继续显示所述第一应用的应用界面,并在所述第一应用的应用界面上显示所述第二应用的与所述通知相关的应用界面。
在一些可能的实施方式中,在显示所述第二应用的与所述通知相关的应用界面的步骤中,所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:在所述第一应用的应用界面的部分区域上显示所述第二应用的应用界面。
在一些可能的实施方式中,在显示所述第二应用的与所述通知相关的应用界面的步骤中,所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:在所述第一应用的应用界面上以透明或半透明方式显示所述第二应用的应用界面。
在一些可能的实施方式中,在显示所述第二应用的与所述通知相关的应用界面时,所述指令被所述 移动终端执行时,使得所述移动终端执行以下步骤:当检测到在所述第二应用的应用界面上执行的第二触摸操作,处理所述通知。
在一些可能的实施方式中,在处理完所述通知之后,所述指令被所述移动终端执行时,使得所述移动终端还执行以下步骤:在所述第一屏幕区域继续显示所述第一应用的应用界面,且不显示所述第二应用的应用界面。
在一些可能的实施方式中,所述移动终端显示所述第二应用的与所述通知相关的应用界面时,所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:当检测到在所述第一屏幕区域且在所述第二应用的应用界面外的区域上执行的第三触摸操作,执行第二应用中与所述第三触摸操作对应的指令,并在所述第一屏幕区域继续显示所述第二应用中与所述通知相关的应用界面。
在一些可能的实施方式中,在显示所述第二应用的与所述通知相关的应用界面时,所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:当检测到第四触摸操作,在所述第一屏幕区域继续显示所述第一应用的应用界面,且不显示所述第二应用的应用界面。
其中,检测到第四触摸操作的步骤,所述指令被所述移动终端执行时,使得所述移动终端执行以下任一步骤:检测到对所述第二屏幕区域中对应所述第二应用的通知的触摸操作;检测到对所述第二应用的应用界面的触摸操作;检测到对所述第一应用的应用界面中且在所述第二应用的应用界面外的区域上执行的触摸操作。
在一些可能的实施方式中,所述指令被所述移动终端执行时,使得所述移动终端还执行以下步骤:在所述第二屏幕区域显示至少一个所述第二应用的图标。
在一些可能的实施方式中,在所述第二屏幕区域提示所述通知的步骤中,所述指令被所述移动终端执行时,使得所述移动终端执行以下至少任一步骤:在所述第二屏幕区域显示所述通知的内容;在所述第二屏幕区域显示所述通知的发送方信息,所述发送方信息包括发送方图像、发送方身份信息及发送方发送时间中任一项或任几项;在所述第二屏幕区域改变所述通知对应的所述第二应用的图标的显示方式。
在一些可能的实施方式中,所述指令被所述移动终端执行时,使得所述移动终端还执行以下步骤:在所述第二屏幕区域显示一控件;当检测到对所述控件执行的第三触摸操作,隐藏所述至少一个第二应用的图标和/或所述第二应用的通知。
在一些可能的实施方式中,在所述第二屏幕区域显示所述通知中,所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:在所述第二屏幕区域以滚动显示的方式,显示所述通知的内容。
第五方面,本申请提供了一种移动终端,其中,所述移动终端包括:摄像头;触摸屏,其中所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域;一个或多个处理器;存储器;以及一个或多个计算机程序,其中所述一个或多个计算机程序被存储在所述存储器中,所述一个或多个计算机程序包括指令,当所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:首先,在所述第一屏幕区域显示第一应用的应用界面,在所述第二屏幕区域显示第二应用的图标;然后当检测到对所述第二应用的图标执行的第一触摸操作,在所述第一屏幕区域显示所述第二应用的应用界面,在所述第二屏幕区域显示所述第一应用的图标。
在一些可能的实施方式中,所述移动终端在所述第一屏幕区域显示所述第二应用的应用界面之后,所述指令被所述移动终端执行时,使得所述移动终端还执行以下步骤:当所述移动终端在所述第二屏幕区域不显示所述第二应用的应用界面时,在所述第二屏幕区域显示所述第二应用的图标。
第六方面,本申请提供了一种在移动终端上显示的移动终端,其中,摄像头;触摸屏,其中所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸 屏从所述第一屏幕区域向所述摄像头周围延伸的区域;一个或多个处理器;存储器;以及一个或多个计算机程序,其中所述一个或多个计算机程序被存储在所述存储器中,所述一个或多个计算机程序包括指令,当所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:启动所述摄像头拍摄;然后,在所述第一屏幕区域上显示所述摄像头所获取的图像,并提高所述第二屏幕区域全部或部分区域的显示亮度超过阈值,以给被拍摄物补光。
在一些可能的实施方式中,所述指令被所述移动终端执行时,使得所述移动终端还执行以下步骤:在所述第二屏幕区域全部或至少一个局部区域显示预设颜色,以给被拍摄物补光。
在一些可能的实施方式中,所述指令被所述移动终端执行时,使得所述移动终端还执行以下步骤:在第二屏幕区域还显示指向所述摄像头位置的提示图案。
第七方面,本申请提供了一种图形用户界面(GUI),所述图形用户界面存储在电子设备中,所述电子设备包括触摸屏、存储器、一个或多个处理器,所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域,所述一个或多个处理器用于执行存储在所述存储器中的一个或多个计算机程序,其特征在于,所述图形用户界面包括:显示在所述第一屏幕区域的第一GUI,所述第一GUI包括第一应用的应用界面;响应于检测到所述第二应用有通知时,在所述第二屏幕区域显示的第二GUI,所述第二GUI包括所述通知;响应于检测到对所述通知执行的第一触摸操作,在所述第一屏幕区域继续显示所述第一GUI,并在所述第一GUI上显示第三GUI,所述第三GUI包括所述第二应用的与所述通知相关的应用界面。
在一些可能的实施方式中,所述第一GUI还包括:至少一个所述第二应用的图标。
第八方面,本申请提供了一种计算机程序产品,其中,当所述计算机程序产品在移动终端上运行时,使得所述移动终端执行如第一方面至第三方面及其中各实施例中任一项所述的方法。
第九方面,本申请提供了一种计算机可读存储介质,包括指令,其中,当所述指令在移动终端上运行时,使得所述移动终端执行第一方面至第三方面及其中各实施例中任一项所述的方法。
第十方面,本申请提供了一种具有触摸屏的移动终端,所述移动终端包括:显示单元、检测单元和控制单元,所述显示单元用于在所述触摸屏的第一屏幕区域显示第一应用的应用界面;所述检测单元用于检测所述第二应用是否有通知和检测是否有对所述触摸屏的触摸操作;所述控制单元用于在所述检测单元检测到检测所述第二应用有通知时,使所述显示单元在所述触摸屏的第二屏幕区域显示所述通知,以及在所述检测单元检测到对所述通知执行的第一触摸操作时,在所述第一屏幕区域继续显示所述第一应用的应用界面,并在所述第一应用的应用界面上显示所述第二应用的与所述通知相关的应用界面。其中,所述移动终端还包括摄像头,所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域。
在一些可能的实施方式中,所述显示单元还用于在所述第二屏幕区域显示至少一个所述第二应用的图标。
在一些可能的实现方式中,所述控制单元还用于在所述检测单元检测到对所述第二应用的图标执行的第一触摸操作,使所述显示单元在所述第一屏幕区域显示所述第二应用的应用界面,在所述第二屏幕区域显示所述第一应用的图标。
在一些可能的实现方式中,结合前一所述的实施例,所述显示单元还用于在所述第二屏幕区域不显示所述第二应用的应用界面时,在所述第二屏幕区域显示所述第二应用的图标。
所述第二应用可以是系统级的应用,也可以是第三服务方提供的应用。
在一些可能的实施方式中,所述显示单元用于在所述第二屏幕区域显示一控件;所述控制单元还用于在所述检测单元检测到对所述控件执行的第三触摸操作,使所述显示单元隐藏所述至少一个第二应用 的图标和/或所述第二应用的通知。
在一些可能的实现方式中,所述显示单元用于在所述第一应用的应用界面的部分区域上显示所述第二应用的应用界面。
在一些可能的实现方式中,所述控制单元还用于在所述检测单元检测到在所述第二应用的应用界面上执行的第二触摸操作时,处理所述通知。
在一些可能的实现方式中,所述控制单元处理完所述通知之后,所述处理单元还用于在使所述显示单元在所述第一屏幕区域继续显示所述第一应用的应用界面,且不显示所述第二应用的应用界面。
在一些可能的实现方式中,所述显示单元显示所述第二应用的与所述通知相关的应用界面时,所述控制单元用于在所述检测单元检测到在所述第一屏幕区域且在所述第二应用的应用界面外的区域上执行的第三触摸操作,执行第二应用中与所述第三触摸操作对应的指令,并使所述显示单元在所述第一屏幕区域继续显示所述第二应用中与所述通知相关的应用界面。
在一些可能的实现方式中,所述显示单元显示所述第二应用的与所述通知相关的应用界面时,当控制单元用于在所述检测单元检测到第四触摸操作,在所述第一屏幕区域继续显示所述第一应用的应用界面,且不显示所述第二应用的应用界面。进一步地,所述控制单元根据相应的第四触摸操作退出显示在第一屏幕区域的第二应用的应用界面。第四触摸操作可以根据预先设定确定,所述检测单元检测到第四触摸操作的步骤包括以下任一项:所述移动终端检测到对所述第二屏幕区域中对应所述第二应用的通知的触摸操作;所述移动终端检测到对所述第二应用的应用界面的触摸操作;所述移动终端检测到对所述第一应用的应用界面中且在所述第二应用的应用界面外的区域上执行的触摸操作。
在一些可能的实现方式中,所述显示单元通过在所述第二屏幕区域显示所述通知的内容来提示所述通知。
在一些可能的实现方式中,所述显示单元通过在所述第二屏幕区域显示所述通知的发送方信息来提示所述通知,其中,所述发送方信息包括发送方图像、发送方身份信息及发送方发送时间中任一项或任几项。
在一些可能的实现方式中,所述显示单元通过在所述第二屏幕区域改变所述通知对应的所述第二应用的图标的显示方式来提示所述通知。
在一些可能的实现方式中,所述显示单元还用于在所述第二屏幕区域显示一控件;所述控制单元还用于在所述检测单元检测到对所述控件执行的第三触摸操作,使所述显示单元隐藏所述至少一个第二应用的图标和/或所述第二应用的通知。
在一些可能的实现方式中,所述显示单元在所述第二屏幕区域显示所述通知时,在所述第二屏幕区域以滚动显示的方式,显示所述通知的内容。
第十一方面,本申请提供了一种具有触摸屏的移动终端,所述移动终端包括:显示单元和控制单元,其中,所述显示单元用于在所述触摸屏的第一屏幕区域显示第一应用的应用界面,在所述触摸屏的第二屏幕区域显示第二应用的图标;所述检测单元用于检测是否有对所述触摸屏的触摸操作;所述控制单元用于在所述检测单元检测到对所述第二应用的图标执行的第一触摸操作,使所述显示单元在所述第一屏幕区域显示所述第二应用的应用界面,在所述第二屏幕区域显示所述第一应用的图标。
在一些可能的实现方式中,所述显示单元还用于在所述第一屏幕区域显示所述第二应用的应用界面之后,在所述第二屏幕区域不显示所述第二应用的应用界面时,在所述第二屏幕区域显示所述第二应用的图标。
第十二方面,本申请提供了一种具有触摸屏的移动终端,所述移动终端包括:拍摄单元、显示单元 和控制单元,其中,所述拍摄单元用于拍摄图像;所述显示单元用于在所述触摸屏的第一屏幕区域上显示所述摄像头所获取的图像;所述控制单元用于控制所述显示单元提高所述触摸屏的第二屏幕区域全部或部分区域的显示亮度超过阈值,以给被拍摄物补光。
在一些可能的实施方式中,所述显示单元还用于在所述第二屏幕区域全部或至少一个局部区域显示预设颜色,以给被拍摄物补光。
在一些可能的实施方式中,所述显示单元还用于在第二屏幕区域还显示指向所述摄像头位置的提示图案。
附图说明
图1是根据本申请一些实施例提供的移动终端的硬件结构示意图;
图2是根据本申请一些实施例提供的移动终端的一部分硬件、软件的示意图;
图3A和图3B是根据本申请一些实施例提供的的示意图;
图4是根据本申请一些实施例提供的的移动终端的图形用户界面示意图;
图5是根据本申请一些实施例提供的移动终端中GUI显示过程的流程示意图;
图6A和图6B是根据本申请一些实施例提供的移动终端中GUI显示过程的示意图;
图7A和图7B是根据本申请一些实施例提供的移动终端中GUI显示过程的示意图;
图8A和图8B是根据本申请一些实施例提供的移动终端中GUI显示过程的示意图;
图9A、图9B和图9C是根据本申请一些实施例提供的移动终端中GUI显示过程的示意图;
图10A和图10B是根据本申请一些实施例提供的移动终端中GUI显示过程的示意图;
图11A和图11B是根据本申请一些实施例提供的移动终端中GUI显示过程的示意图;
图12A、图12B和图12C是根据本申请一些实施例提供的移动终端中GUI显示过程的示意图;
图13A和图13B是根据本申请一些实施例提供的移动终端中GUI显示过程的示意图;
图14A和图14B是根据本申请一些实施例提供的移动终端中显示的GUI的示意图;
图15A和图15B是根据本申请一些实施例提供的移动终端中GUI显示过程的示意图;
图16A和图16B是根据本申请一些实施例提供的移动终端中GUI显示过程的示意图;
图17A、图17B和图17C是根据本申请一些实施例提供的移动终端中GUI显示过程的示意图;
图18是根据本申请一些实施例提供的移动终端中GUI显示过程的示意图。
具体实施方式
下面结合附图和实施例对本申请进行进一步描述。
现在将详细地参考实施例,这些实施例的示例在附图中被示出。在下面的详细描述中给出了许多具体细节,以便提供对本申请的充分理解。但是,对本领域技术人员将显而易见的是本申请可以在没有这些具体细节的情况下被实践。在其他情况下,没有详细地描述众所周知的方法、过程、部件、电路、和网络,从而不会不必要地使实施例的方面晦涩难懂。
还应理解的是,虽然术语“第一”、“第二”等可能在本文中用来描述各种元素,但是这些元素不应当被这些术语限定。这些术语只是用来将一个元素与另一元素区分开。例如,第一接触可以被命名为第二接触,并且类似地,第二接触可以被命名为第一接触,而不背离本申请的范围。第一接触和第二接触二者都是接触,但是它们可以不是同一接触,在某些场景下也可以是同一接触。
在本文中对本申请的描述中所使用的术语只是为了描述特定实施例的目的,而并非旨在作为对本申请的限制。如本在申请的说明书和所附权利要求书中所使用的那样,单数表达形式“一个”、“一种” 和“这一”旨在也包括复数表达形式,除非其上下文中明确地有相反指示。还将理解的是,本文中所使用的术语“和/或”是指并且涵盖相关联地列出的项目中一个或多个项目的任何和全部可能的组合。还将理解的是,术语“包括”和/或“包含”当在本说明书中使用时是指定存在所陈述的特征、整数、步骤、操作、元素和/或部件,但是并不排除存在或添加一个或多个其他特征、整数、步骤、操作、元素、部件和/或其分组。
如本文中所用,根据上下文,术语“如果”可以被解释为意思是“当...时”或“在...后”或“响应于确定”或“响应于检测到”。类似地,根据上下文,短语“如果确定...”或“如果检测到[所陈述的条件或事件]”可以被解释为意思是“在确定...时”或“响应于确定...”或“在检测到[所陈述的条件或事件]时”或“响应于检测到[所陈述的条件或事件]”。
以下介绍了移动终端、用于这样的移动终端的用户界面、和用于使用这样的移动终端的相关联过程的实施例。在一些实施例中,移动终端是还包含其它功能诸如个人数字助理和/或音乐播放器功能的便携式移动终端,诸如手机、平板电脑等。便携式移动终端的示例性实施例包括但不限于搭载
Figure PCTCN2017091283-appb-000001
Figure PCTCN2017091283-appb-000002
或者其它操作系统的便携式移动终端。也可以使用其它便携式移动终端,诸如具有触敏表面(例如,触摸屏显示器和/或触控板)的膝上型计算机或平板电脑。
在下面的讨论中,介绍了一种包括显示器和触敏表面的移动终端。然而应当理解,移动终端可以包括一个或多个其他物理用户接口设备,诸如物理键盘、鼠标和/或操作杆。
移动终端通常支持多种应用程序,诸如以下中的一种或多种:画图应用程序、文字处理应用程序、网页创建应用程序、电子表格应用程序、游戏应用程序、电话应用程序、视频会议应用程序、电子邮件应用程序、即时消息应用程序、锻炼支持应用程序、相片管理应用程序、图库应用程序、数字视频摄像机应用程序、网络浏览应用程序、数字音乐播放器应用程序、和/或数字视频播放器应用程序。
可在移动终端上执行的各种应用程序可使用至少一个共用的物理用户接口设备,诸如触敏表面。触敏表面的一种或多种功能以及显示在移动终端上的相应信息可从一种应用程序显示和/或变化至下一种应用程序和/或在相应应用程序内被显示和/或变化。这样,移动终端的共用物理架构(诸如触敏表面)可利用对于用户而言直观清楚的用户界面来支持各种应用程序。
现在关注具有触敏显示器的便携式移动终端的实施例。图1是示出根据一些实施例的具有触敏显示器115的便携式移动终端(以手机100为例)的框图。触敏显示器115有时也被成为“触摸屏”,并且也可被称为是或者被叫做触敏显示器系统,也可以被称为具有触敏表面(touch-sensitive surface)和显示屏(display)的显示器系统。
应该理解的是,图1所示的手机100仅仅是上述移动终端的一个范例,手机100可以具有比图中所示出的更多的或者更少的部件,可以组合两个或更多的部件,或者可以具有不同的部件配置。图中所示出的各种部件可以在包括一个或多个信号处理和/或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。
如图1所示,手机100可以包括:处理器101、射频电路102、存储器103、输入/输出子系统104、蓝牙装置105、传感器106、Wi-Fi装置107、定位装置108、音频电路109、外设接口110以及电源系统111等部件。这些部件可通过一根或多根通信总线或信号线进行通信。本领域技术人员可以理解,图1中示出的硬件结构并不构成对移动终端的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。
下面结合图1对手机100的各个部件进行具体的介绍:
处理器101是手机100的控制中心,利用各种接口和线路连接手机100的各个部分,通过运行或执行存储在存储器103内的应用程序(application,简称App),以及调用存储在存储器103内的数据和指 令,执行手机100的各种功能和处理数据。在一些实施例中,处理器101可包括一个或多个控制单元;处理器101还可以集成应用处理器和调制解调处理器;其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器101中。举例来说,处理器101可以是华为技术有限公司制造的麒麟960芯片。在本申请一些实施例中,上述处理器101还可以包括指纹验证芯片,用于对采集到的指纹进行验证。
射频电路102可用于在收发信息或通话过程中,无线信号的接收和发送。特别地,射频电路102可以将基站的下行数据接收后,给处理器101处理;另外,将涉及上行的数据发送给基站。通常,射频电路包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等。此外,射频电路102还可以通过无线通信和其他设备通信。所述无线通信可以使用任一通信标准或协议,包括但不限于全球移动通讯系统、通用分组无线服务、码分多址、宽带码分多址、长期演进、电子邮件、短消息服务等。
存储器103用于存储应用程序、软件以及数据,处理器101通过运行存储在存储器的应用程序以及数据,执行手机100的各种功能以及数据处理。存储器103主要包括存储程序区以及存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像管理功能等);存储数据区可以存储根据使用手机所创建的数据(比如音频数据、电话本、日历事件等)。此外,存储器可以包括高速随机存取存储器,还可以包括非易失存储器,例如磁盘存储器件、闪存器件或其他易失性固态存储器件。
输入/输出子系统(I/O子系统)104将设备100上的输入/输出设备,诸如触敏显示器115和其他输入控制设备116,耦接到处理器101。I/O子系统104可以包括显示控制器117和用于其他输入控制设备116的一个或多个输入控制器118。该一个或多个输入控制器118从其他输入控制设备116接收电信号/发送电信号到其他输入控制设备116。该其他输入控制设备116可包括物理按钮(例如,下压按钮、摇臂按钮等)、拨号盘、滑动开关、操纵杆、点击式转盘等等。在另外的一些实施例中,输入控制器118可耦接到(或不耦接到)以下任一个:键盘、红外线端口、USB端口、和指针设备诸如鼠标。该一个或多个按钮可包括用于扬声器112和/或麦克风113的音量控制的上/下按钮。该一个或多个按钮可包括下压按钮。
触敏显示器115提供移动终端与用户之间的输入接口和输出接口。显示控制器117从触敏显示器115接收电信号和/或向触敏显示器115发送电信号。触敏显示器115向用户显示视觉输出。视觉输出可包括图形、文本、图标、视频及它们的任何组合(统称为“图形”)。在一些实施例中,一些视觉输出或全部的视觉输出可对应于界面元素。触敏显示器115有时为了方便被称为“触摸屏”,也可被叫做触敏显示器系统,也可以被称为具有触敏表面和显示屏的显示器系统。
触敏显示器115具有基于触觉和/或触觉接触从用户接收输入的触敏表面、显示器、传感器或传感器组。触敏显示器115和显示控制器117(与存储器103中的任何相关联模块和/或指令集一起)检测触敏显示器115上的接触(和该接触的任何移动或中断),将所检测到的接触转换为与显示在触敏显示器115上的界面元素(例如,一个或多个软按键、图标、网页或图像)的交互。在示例性实施例中,触敏显示器115与用户之间的接触点对应于用户的手指。
其中,触敏表面(例如触控面板)可采集手机100的用户在其上或附近的触摸事件(比如用户使用手指、触控笔等任何适合的物体在触敏表面上或在触敏表面附近的操作),并将采集到的触摸信息发送给其他器件例如处理器101。其中,用户在触敏表面附近的触摸事件可以称之为悬浮触控;悬浮触控可以是指,用户无需为了选择、移动或拖动目标(例如图标等)而直接接触触控板,而只需用户位于移动终端附近以便执行所想要的功能。在悬浮触控的应用场景下,术语“触摸”、“接触”等不会暗示用于直接接触触摸屏,而是在其附近或接近的接触。能够进行悬浮触控的触敏表面可以采用电容式、红外光感 以及超声波等实现。触敏表面可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再发送给处理器101,触摸控制器还可以接收处理器101发送的指令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型来实现触敏表面。显示器(也称为显示屏)可用于显示由用户输入的信息或提供给用户的信息以及手机100的各种菜单。可以采用液晶显示器、有机发光二极管等形式来配置显示器。触敏表面可以覆盖在显示器之上,当触敏表面检测到在其上或附近的触摸事件后,传送给处理器101以确定触摸事件的类型,随后处理器101可以根据触摸事件的类型在显示器上提供相应的视觉输出。虽然在图1中,触敏表面与显示器是作为两个独立的部件来实现手机100的输入和输出功能,但是在某些实施例中,可以将触敏表面与显示器集成而实现手机100的输入和输出功能。可以理解的是,触摸屏115是由多层材料堆叠而成,本申请实施例中只展示出了触敏表面(层)和显示屏(层),其他层在本申请实施例中不予记载。另外,在本申请其他一些实施例中,触敏表面可以覆盖在显示器之上,并且触敏表面的尺寸大于显示器的尺寸,使得显示器全部覆盖在触敏表面下面,或者,上述触敏表面可以以全面板的形式配置在手机100的正面,也即用户在手机100正面的触摸均能被手机感知,这样就可以实现手机正面的全触控体验。在其他一些实施例中,触敏表面以全面板的形式配置在手机100的正面,显示器也可以以全面板的形式配置在手机100的正面,这样在手机的正面就能够实现无边框的结构。
触敏显示器115可使用LCD(液晶显示器)技术、LPD(发光聚合物显示器)技术、或LED(发光二极管)技术,但是在其他实施例中可使用其他显示技术。触敏显示器115和显示控制器117可以利用现在已知的或以后将开发出的多种触摸感测技术中的任何技术以及其他接近传感器阵列或用于确定与触敏显示器115接触的一个或多个点的其他元件来检测接触及其任何移动或中断,该多种触摸感测技术包括但不限于电容性的、电阻性的、红外线的、和表面声波技术。在一示例性实施例中,使用投射式互电容感测技术。
触敏显示器115可以具有超过100dpi的视频分辨率。在一些实施例中,触摸屏具有大约160dpi的视频分辨率。用户可以利用任何合适的物体或附加物诸如触笔、手指等等,与触敏显示器115接触。在一些实施例中,用户界面被设计为主要与基于手指的接触和手势一起工作,这与基于触笔的输入相比由于手指在触摸屏上接触面积更大而可能精确度更低。在一些实施例中,设备将基于手指的粗略输入翻译为精确的指针/光标位置或命令,以执行用户所期望的动作。
在一些实施例中,上述触摸屏可以包括具有压力感应的传感器组。
在另外的一些实施例中,除了触摸屏之外,手机100可包括用于激活或解除激活特定功能的触控板(未示出)。在一些实施例中,触控板是移动终端的触敏区域,该触敏区域与触摸屏不同,其不显示视觉输出。触控板可以是与触敏显示器115分开的触敏表面,或者是由触摸屏形成的触敏表面的延伸部分。
手机100还可包括一个或多个光传感器119。图1示出了耦接到I/O子系统104中光传感器控制器120的光学传感器119。光传感器119可包括电荷耦合器件(CCD)或互补金属氧化物半导体(CMOS)光电晶体管。光传感器119从外部环境接收通过一个或多个透镜投射的光,并且将光转换为表示图像的数据。结合相机模块213,光传感器119可以捕获静态图像或视频。在一些实施例中,一个或者多个光传感器位于手机100的前部和/或后部,与设备前部上的触敏显示器115相对,使得触敏显示器115可用作用于静态图像和/或视频图像采集的取景器。在一些实施例中,另一个或者多个光传感器位于设备的前部,使得用户在触摸屏显示器上观看其它视频会议参与者的同时可以获得该用户的图像以用于视频会议,光传感器119可以是摄像头。
在本申请各个实施例中,手机100还可以具有指纹识别功能。例如,可以在手机100的背面(例如 后置摄像头的下方)配置指纹识别器,或者在手机100的正面(例如触摸屏115的下方)配置指纹识别器。另外,也可以通过在触摸屏115中配置指纹识别器来实现指纹识别功能,即指纹识别器可以与触摸屏115集成在一起来实现手机100的指纹识别功能。在这种情况下,该指纹识别器可以配置在触摸屏115中,可以是触摸屏115的一部分,也可以以其他方式配置在触摸屏115中。另外,该指纹识别器还可以被实现为全面板指纹识别器,因此,可以把触摸屏115看成是任何位置都可以进行指纹采集的一个面板。该指纹识别器可以将采集到的指纹发送给处理器101,以便处理器101对该指纹进行处理(例如指纹验证等)。本申请实施例中的指纹识别器的主要部件是指纹传感器,该指纹传感器可以采用任何类型的感测技术,包括但不限于光学式、电容式、压电式或超声波传感技术等。
另外,关于本申请实施例中在触摸屏中集成指纹采集器件的具体技术方案,可以参见美国专利与商标局公告的申请号为US 2015/0036065 A1,名称为“在移动终端中的指纹传感器”的专利申请,其全部内容通过引用结合在本申请各个实施例中。
蓝牙装置105,用于通过蓝牙通信协议与其他移动终端(例如智能手表、平板电脑等)建立无线链接,并进行数据交互。
手机100还可以包括至少一种传感器106,比如上述光传感器119、运动传感器以及其他传感器。具体地,光传感器119可包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节触敏显示器115的显示面板的亮度,接近传感器可在手机100移动到耳边时,关闭显示面板的电源。作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别移动终端姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;至于手机100还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器,在此不再赘述。
Wi-Fi装置107,用于为手机100提供Wi-Fi网络接入,手机100可以通过Wi-Fi装置107帮助用户收发电子邮件、浏览网页和访问流媒体等,它为用户提供了无线的宽带互联网访问。
定位装置108,用于为手机100提供地理位置信息,该地理位置信息可以表示手机当前所处的地理位置。可以理解的是,该定位装置108具体可以是全球定位系统或北斗卫星导航系统、俄罗斯GLONASS等定位通信系统的接收器。定位装置108在接收到上述定位通信系统发送的地理位置信息后,将该信息发送给处理器101进行进一步处理,或者发送给存储器103进行保存。
音频电路109、扬声器112,麦克风113可提供用户与手机100之间的音频接口。音频电路109可将接收到的音频数据转换后的电信号,传输到扬声器112,由扬声器112转换为声音信号输出,扬声器112可以包括功放扬声器、听筒等;另一方面,麦克风113将收集的声音信号转换为电信号,由音频电路109接收后转换为音频数据,再将音频数据输出至射频电路102以发送给比如另一手机,或者将音频数据输出至存储器103以便进一步处理。
手机100还可以包括给各个部件供电的电源系统111(包括电力故障检测电路、功率变换器或逆变器、电力状态指示器、电池和电源管理芯片)。电池可以通过电源管理芯片与处理器101逻辑相连,从而通过电源系统111实现管理充电、放电、以及功耗等功能。
手机100还可以包括外设接口110,用于为外部输入/输出设备(例如鼠标、键盘、外接显示器、外部存储器等)提供接口。外设接口110可以被用来将设备的输入和输出外围设备耦接到处理器101和存储器103。该处理器101运行或执行存储在存储器103中的各种应用程序和/或指令集,以执行手机100的各种功能以及处理数据。在一些实施例中,该处理器101可以包括图像信号处理器和双核或多核处理器。
尽管未示出,手机100还可以包括摄像头(前置摄像头和/或后置摄像头)、用户识别模块(SIM) 卡槽、闪光灯、微型投影装置、近场通信(near field communication,NFC)装置等。
在一些实施例中,如图2所示,在存储器103中存储的软件可以包括操作系统201、通信模块(或指令集)202、接触/移动模块(或指令集)203、图形模块(或指令集)204、文本输入模块(或指令集)205、定位模块(或指令集)206、Wi-Fi模块(或指令集)207以及应用程序(或指令集)208。此外,在一些实施例中,存储器103也可以存储设备/全局内部状态209,如图1和2中所示。设备/全局内部状态209可以包括以下至少一种状态:活动应用程序状态,用于指示哪些应用程序(如果有的话)当前是活动的;显示状态,用于指示什么应用程序、视图或其它信息占据触摸屏115的各个区域;传感器状态,包括从移动终端的各个传感器和外设接口110获得的信息;和关于移动终端的地理位置和姿态的信息。
操作系统201(例如,Darwin、RTXC、LINUX、UNIX、OS X、WINDOWS、ANDROID或嵌入式操作系统(诸如Vx Works))包括用于控制和管理一般系统任务(例如,存储器管理、存储设备控制、电力管理等)的各种软件和/或驱动器,并且有利于各个硬件和软件之间的通信。此外,在一些实施例中,存储器103还可以存储图库210。
通信模块202可以通过外设接口110与其它移动终端进行通信,还可以包括用于处理由射频电路102和/或外设接口110所接收的数据的各种软件。外设接口(例如,通用串行总线(USB)、火线等)适于直接耦接到其他移动终端或者间接地通过网络(例如,因特网、无线LAN等)耦接。在一些实施例中,外设接口110还可以是与iPod(Apple Inc.的商标)设备上所使用的30针连接器相同的或类似的以及/或者与其兼容的多针(例如,30针)连接器。
接触/移动模块203可检测与触摸屏115和其他触敏设备(例如,触控板或物理点击式转盘)的接触。接触/移动模块203可以包括多个软件用于执行与接触检测相关的各种操作,诸如确定是否已经发生了接触(例如,检测手指按下事件)、确定是否存在接触的移动并在触控面板上跟踪该移动(例如,检测一个或多个手指拖动事件)、以及确定接触是否已经终止(例如,检测手指抬起事件或者接触中断)。接触/移动模块203从触控面板接收接触数据。确定接触点的移动可以包括确定接触点的速度(量值)、速度(量值和方向)、和/或加速度(量值和/或方向的改变),接触点的移动由一系列接触数据来表示。这些操作可被应用于单点接触(例如,一个手指接触)或者多点同时接触(例如,“多点触摸”/多个手指接触)。
接触/移动模块203还可检测用户的手势输入。触敏表面上不同类型的手势具有不同的接触图案。因此,可通过检测具体接触图案来检测手势的类型。例如,检测到单指轻击手势包括检测到手指按下事件、然后在与手指按下事件相同的位置(或基本上相同的位置)处(例如,在图标位置处)检测到手指抬起(抬离)事件。又如,在触敏表面上检测到手指轻扫手势包括检测到手指按下事件、然后检测到一个或多个手指拖动事件、并且随后检测到手指抬起(抬离)事件。
上述手势的类型可以是多种多样的,例如上述手势可以是Flick手势即单个手指轻击触敏显示器115的触敏表面,然后迅速滑动,然后快速离开触敏表面,如上下滚动屏幕或左右切换图片等;上述手势也可以是Slide手势即单个手指轻击触敏表面,然后持续接触并移动,如滑动解锁;上述手势也可以是Swipe手势即多个手指接触触敏表面,然后持续接触并移动,如三指抓返回主界面;上述手势还可以是Tap手势即单个手指轻击触敏表面,随后立即离开触敏表面;上述手势还可以是Double Tap手势即非常短的时间内进行两次Tap手势的操作;上述手势也可以是Touch&Hold手势即手指轻击触敏表面并保持不动;上述手势还可以是Drag手势即手指轻击触敏表面,在不离开触敏表面的情况下缓慢移动手指(一般有明确的目标位置,如将文件拖动到垃圾桶以删除文件);上述手势还可以是Pinch手势即两个手指(一般是大拇指和食指)在触敏表面上进行捏合;上述手势还可以是Unpinch手势即两个手指(一般是大拇指和食指)在触敏表面上进行张开;可以理解的是,手势除了上述列举出的各种手势之外还可以是其他类型的手势,本实施例对手势的类型不做任何限制。
图形模块204包括用于在触敏显示器115或其他显示器上渲染和显示图形的多个已知软件,包括用于改变被显示图形的强度的部件。如本文所用,术语“图形”包括可以被显示给用户的任何对象,非限制性地包括文本、网页、图标(诸如包括软按键的用户界面对象)、数字图像、视频、动画等等。
在一些实施例中,图形模块204存储要使用的数据表示图形。每个图形可以被分配有相应的代码。图形模块204从应用程序等接收指定要显示的图形的一个或多个代码,在必要的情况下还一起接收坐标数据和其他图形属性数据,并且然后生成屏幕图像数据来输出给显示控制器117。
可作为图形模块204的部件的文本输入模块205提供用于在多种应用程序208(例如,联系人208-1、浏览器208-6、和需要文本输入的任何其他应用程序)中输入文本的软键盘。
定位模块206用于确定移动终端的地理位置,并且提供该信息以在各种应用程序208中使用(例如,提供给电话2082来用于基于地理位置的拨号、提供给相机模块208-3作为图片/视频元数据、以及提供给提供基于地理位置的服务的其他应用程序,诸如天气桌面小程序211-1、地图/导航桌面小程序211-2等)。
Wi-Fi模块207用于运行Wi-Fi装置107所需的各种指令。
应用程序208可包括以下模块(或指令集)或者其子集或超集:
● 联系人模块208-1(有时也称为通讯录或联系人),用于管理存储的联系人;
● 电话模块208-2;
● 用于静态图像和/或视频图像的相机模块208-3,用于接收用户的指令利用光传感器119进行数字成像(拍照);
● 图像管理模块208-4,用于对存储器103中存储的图库210进行编辑、删除、移动、重命名等操作;
● 锻炼支持模块208-5;
● 浏览器模块208-6;
● 桌面小程序模块211,其可以包括以下中一者或多者:天气桌面小程序211-1、地图/导航桌面小程序211-2和用户获得的其他桌面小程序、以及用户自定义的桌面小程序211-3;
● 多媒体播放器模块(即视频和音乐播放器模块)208-7,其可以由视频播放器模块和音乐播放器模块构成;
● 文字处理模块208-8;
● 视频会议模块208-9,
● 电子邮件模块208-10;
● 即时消息模块208-11;
● 通知模块208-12;
● 地图模块208-13;
● 日历模块208-14;和/或
● 应用程序商店模块208-15。
可被存储在存储器103中的其他应用程序208的示例包括其他文字处理应用程序、其他图像编辑应用程序、画图应用程序、JAVA启用的应用程序、加密、数字权益管理、声音识别、和声音复制。
结合触敏显示器115、接触模块203、图形模块204、和文本输入模块205,联系人模块208-1可被用于管理通讯录或联系人列表(例如,存储在存储器103中联系人模块208-1的应用程序内部状态中),包括:添加姓名到通讯录;从通讯录删除姓名;将电话号码、电子邮件地址、家庭地址或其他信息与姓名关联;将图像与姓名关联;对姓名进行分类和归类;提供电话号码或电子邮件地址来发起和/或促进通过 电话208-2、电子邮件的通信;等等。
结合射频电路102、音频电路109、扬声器112、麦克风113、触敏显示器115、显示控制器117、移动/接触模块203、图形模块204、和文本输入模块205,电话模块208-2可以被用于输入对应于电话号码的字符序列、访问联系人模块208-1中的一个或多个电话号码、修改已经输入的电话号码、拨打相应的电话号码、进行通话以及当通话完成时断开或挂断。如上所述,无线通信可以使用多个通信标准、协议和技术中的任一个。
结合射频电路102、音频电路109、扬声器112、麦克风113、触敏显示器115、显示控制器117、光传感器119、光传感器控制器120、移动接触模块203、图形模块204、文本输入模块205、联系人模块208-1、和电话模块208-2,视频会议模块208-9包括用于根据用户指令发起、进行、和结束用户与一个或多个其他参与方之间的视频会议的可执行指令。
结合射频电路102、触敏显示器115、显示控制器117、移动/接触模块203、图形模块204、和文本输入模块205,电子邮件客户端模块208-10包括用于响应于用户指令来创建、发送、接收、和管理电子邮件的可执行指令。结合图像管理模块208-4,电子邮件客户端模块208-10使得非常容易创建和发送具有由相机模块208-3拍摄的静态图像或视频图像的电子邮件。
结合射频电路102、触敏显示器115、显示控制器117、接触模块203、图形模块204、和文本输入模块205,即时消息模块208-11可以包括用于输入对应于即时消息的字符序列、修改先前输入的字符、传输相应即时消息(例如,使用短消息服务(SMS)或多媒体消息服务(MMS)协议用于基于电话的即时消息或者使用XMPP、SIMPLE、或IMPS用于基于因特网的即时消息)、接收即时消息以及查看所接收的即时消息的可执行指令。在一些实施例中,所传输和/或接收的即时消息可包括图形、相片、音频文件、视频文件以及/或者MMS和/或增强消息服务(EMS)中所支持的其他附件。如本文所用,“即时消息”是指基于电话的消息(例如,利用SMS或MMS发送的消息)和基于因特网的消息(例如,利用XMPP、SIMPLE、或IMPS发送的消息)二者。
结合射频电路102、触敏显示器115、显示控制器117、移动/接触模块203、图形模块204、文本输入模块205、定位模块206、地图模块208-13、和多媒体播放器模块208-7,锻炼支持模块208-5包括可执行指令,用于创建锻炼(例如,具有时间、距离、和/或卡路里消耗目标);与锻炼传感器(体育设备)通信;接收锻炼传感器数据;校准用于监视锻炼的传感器;为锻炼选择和播放音乐;以及显示、存储和传输锻炼数据。
结合触敏显示器115、显示控制器117、光传感器119、光传感器控制器120、移动/接触模块203、图形模块204和图像管理模块208-4,相机模块208-3包括用于捕获静态图像或视频(包括视频流)并将其存储到存储器103中(例如,在数字相片210中)、修改静态图像或视频的特性、或从存储器1023(例如,从数字相片210中)删除静态图像或视频的可执行指令。
结合触敏显示器115、显示控制器117、移动/接触模块203、图形模块204、文本输入模块205、和相机模块208-3,图像管理模块208-4包括用于排列、修改(例如,编辑)、或以其他方式操控、加标签、删除、呈现(例如在数字幻灯片或相册中)、以及存储静态图像和/或视频图像(包括存储在图库210中的静态图像和/或视频图像)的可执行指令。
结合射频电路102、触敏显示器115、显示控制器117、移动/接触模块203、图形模块204、和文本输入模块205,浏览器模块208-6包括用于根据用户指令浏览因特网(包括搜索、链接到、接收、和显示网页或其部分、以及链接到网页的附件和其他文件)的可执行指令。
结合射频电路102、触敏显示器115、显示控制器117、移动/接触模块203、图形模块204、文本输入模块205、电子邮件客户端模块208-10和浏览器模块208-6,日历模块208-14包括用于根据用户指令 创建、显示、修改、和存储日历和与日历相关联的数据(例如,日历条目、待办任务列表等)的可执行指令。
结合射频电路102、触敏显示器115、显示控制器117、移动/接触模块203、图形模块204、文本输入模块205和浏览器模块208-6,桌面小程序模块149是可以由用户下载并使用的微型应用程序(例如,天气桌面小程序211-1、地图/导航桌面小程序211-2)或由用户创建的微型应用程序(例如,用户自定义的桌面小程序211-3)。在一些实施例中,桌面小程序包括HTML(超文本标记语言)文件、CSS(层叠样式表)文件、和JavaScript文件。在一些实施例中,桌面小程序包括XML(可扩展标记语言)文件和JavaScript文件(例如,Yahoo!桌面小程序)。
结合触敏显示器115、显示控制器117、移动/接触模块203、图形模块204、音频电路109、扬声器112、射频电路102、和浏览器模块208-6,多媒体播放器模块208-7包括允许用户下载和回放以一种或多种文件格式(诸如MP3或AAC文件)存储的所记录的音乐和其他声音文件的可执行指令,以及用于显示、呈现或以其他方式回放视频(例如,在触敏显示器115上或在经由外设接口110连接的外部显示器上)的可执行指令。在一些实施例中,手机100可以包括MP3播放器的功能性。
结合射频电路102、触敏显示器115、显示控制器117、移动/接触模块203、图形模块204、文本输入模块205、定位模块206、和浏览器模块208-6,地图模块208-13可以被用于根据用户指令接收、显示、修改、和存储地图及与地图相关联的数据(例如,驾车路线;特定地理位置处或附近的商店和其他兴趣点的数据;和其他基于地理位置的数据)。
结合射频电路102、触敏显示器115、显示控制器117、移动/接触模块203、图形模块204、文本输入模块205和浏览器模块208-6,应用程序商店模块208-15可以被用于根据用户指令接收、显示与应用程序商店相关的数据例如价格、内容等。
结合触敏显示器115、显示控制器117、移动/接触模块203、和图形模块204,通知模块208-12包括在触敏显示器115上显示通知或警告(诸如传入消息或来电呼叫、日历事件提醒、应用程序事件等等)的可执行指令。
上述每个模块和应用程序对应于用于执行上述一种或多种功能以及在本申请中所介绍的方法(例如,本文中所描述的计算机实现的方法和其他信息处理方法)的一组可执行指令。这些模块(即指令集)不必被实现为分开的软件程序、过程或模块,因此这些模块的各种子组可以在各种实施例中被组合或以其他方式重新布置。在一些实施例中,存储器103可存储上述模块和数据结构的一个子组。此外,存储器103可以存储上面没有描述的另外的模块和数据结构。
图2中上述所识别的元件的每一个可被存储在一个或多个前面提到的存储器103中。上述所识别的模块的每一个对应于用于执行上述功能的一组指令。上述所识别的模块或程序(即,指令集)不必被实现为单独的软件程序、过程或模块,并且因此这些模块的各种子组可以在各种实施例中被组合或以其它方式重新布置。在一些实施例中,存储器103可存储上述模块和数据结构的子组。此外,存储器103还可以存储上面没有描述的另外的模块和数据结构。
在一些实施例中,移动终端是这样一种设备,即在该设备上预定义的一组功能的操作唯一地通过触摸屏和/或触控板来执行。通过使用触摸屏和/或触控板作为用于移动终端的操作的主要输入控制设备,可以减少移动终端上物理输入控制设备(诸如下压按钮、拨号盘等等)的数量。
可通过触摸屏和/或触控板执行的该预定义的一组功能包括在用户界面之间的导航。在一些实施例中,当触控板被用户触摸时将移动终端从可显示在移动终端上的任何图形用户界面导航到主要菜单、主菜单或根菜单。在这样的实施例中,触控板可被称为“菜单按钮”。在一些其他实施例中,菜单按钮可以是物理下压按钮或者其他物理输入控制设备,而不是触控板。
以下实施例均可以在具有上述硬件的移动终端(例如手机100)中实现。
图3A和图3B示出了根据一些实施例的具有触摸屏的一种移动终端(以手机100为例)。移动终端100还可包括摄像头306、听筒307、环境光传感器(未示出)等物理器件,摄像头可以包括一个或多个前置摄像头和一个或多个后置摄像头,其中,前置摄像头设置在显示屏同一面,后置摄像头设置在显示屏的背面,前置摄像头可以设置在该手机面上并与显示屏紧密布局,例如图3A所示,前置摄像头306位于靠近手机顶部的正中央位置,听筒307位于前置摄像头306上方,或者例如图3B所示,前置摄像头306位于靠近移动终端100顶部偏向一侧位置,听筒307设置于前置摄像头306正上方,此外,前置摄像头306也可设置在靠近移动终端100底部位置,具体设计可以产品设计。触摸屏115为非规则矩形的触摸屏,触摸屏115的屏幕区域的非规则区域延展到移动终端100顶部的前置摄像头306两侧区域,为摄像头306、听筒307等器件提供工作空间,同时大大提高了显示器屏占比,提高视觉效果。在以下实施例中,以前置摄像头306设置在移动终端100的顶部正中央为例进行说明。
触摸屏115可以在图形用户界面(GUI)内显示一个或多个图形。在该实施例中,以及在下文中介绍的其他实施例中,移动终端可以检测到用户通过例如用一根或多根手指301(在附图中没有按比例绘制)或者用一个或多个触控笔(未示出)在图形上做出手势来选择这些图形中的一个或多个的操作。在一些实施例中,当用户中断与该一个或多个图形的接触时,发生对一个或多个图形的选择。在一些实施例中,手势可包括一次或多次轻击、一次或多次滑动(从左向右、从右向左、向上和/或向下)和/或已经与移动终端100接触的手指(从右向左、从左向右、向上和/或向下)拨动。在一些实施例中,无意地与图形接触不会选择该图形。例如,当对应于选择的手势是轻击时,在应用程序图标之上扫动的轻扫手势不会选择相应的应用程序。
移动终端100还可包括一个或多个物理按钮,诸如主屏幕按钮303、菜单按钮304、返回按钮305。如前所述,菜单按钮304可以被用于导航到可以在移动终端100上运行的一组应用程序中的任何应用程序208。在另外的一些实施例中,上述按钮均可以被实现为显示在触摸屏115上的图形用户界面(GUI)中的虚拟按键。
在一些实施例中,移动终端100还可包括用于设备开关机和锁定设备的下压按钮、(一个或多个)音量调节按钮、用户身份模块(SIM)卡槽、耳麦插孔、和对接/充电外部端口等。下压按钮可被用于通过压下该按钮并将该按钮保持在压下状态达预定义的时间间隔来对设备进行开关机;通过压下该按钮并在经过该预定义的时间间隔之前释放该按钮来锁定设备;和/或解锁设备或发起解锁过程。在一另选的实施例中,设备100还可通过麦克风113接受用于激活或解除激活某些功能的语音输入。
现在将注意力转到可以在移动终端100上实现的图形用户界面(GUI)的实施例。
如图4所示,本申请实施例提供的移动终端具有显示屏和摄像头,其中,显示屏可以是触摸屏,触摸屏包括第一屏幕区域308和第二屏幕区域309。所述第一屏幕区域308为矩形区域,所述第二屏幕区域309为所述触摸屏从所述第一屏幕区域308向所述前置摄像头周围延伸的区域。因此,触摸屏115与现有技术中规则矩形的触摸屏不同,触摸屏115的显示区域的延展到移动终端100顶部的前置摄像头306两侧区域,为摄像头306、听筒307等器件提供工作空间,同时大大提高了触摸屏115的屏占比,提高视觉效果。在以下一些实施例中,以前置摄像头306设置在移动终端100的顶部正中央作为附图展示,进行说明。
在本申请实施例中,第一屏幕区域308和第二屏幕区域309可以是由同一个显示控制器117控制控制。
在一些实施例中,在点亮显示屏或检测到用户点击主屏幕按钮303时,移动终端在触摸屏上显示一系列示例性的用户图形界面(graphical user interface,GUI),包括在第一屏幕区域303显示主屏幕 (home screen),在第二屏幕区域309显示Wi-Fi信号、通信信号、电池电量、时间等设备状态图标,还可在第二屏幕区域显示短信、邮件、相机、音乐、微信等应用图标。
其中,主屏幕可以包括多个子屏幕(sub-screen),每个子屏幕可以包括有不同的内容。以图4为例进行说明,该GUI可以是该移动终端的主屏幕中的第一子屏幕。该第一子屏幕显示在该移动终端的触摸屏上,可以包括主屏幕指示标403以及各类App的图标。其中,主屏幕指示标403用来提示用户当前显示的子屏幕具体是哪个子屏幕。示例性的,在该第一子屏幕中,包括多排多列的App图标;当移动终端检测到用户的手指(或触控笔等)触摸到触摸屏上的一个位置,响应于该触摸事件,移动终端可以打开与某一App图标相应的App的图形用户界面。可以理解的是,在其他一些实施例中,在主屏幕中还可以包括Dock栏,Dock栏中可以包括常用的App图标等,不再赘述。
结合图4,在一些实施例中,该图形用户界面400示例性地包括以下元素或者其子集或超集:
显示在第一屏幕区域308上的:
● 主页面指示器403;
● 主屏幕按钮303;
● 菜单按钮304;
● 返回按钮305;
● 应用程序的图标,例如:
◆ 电子邮件404;
◆ 日历405;
◆ 设置406,其提供对设备100及其各种应用程序208的设置的访问;
◆ 相机407;
◆ 电话408;
◆ 联系人409;
◆ 短消息410;
◆ 图库411;
◆ 天气412;
◆ 阅读413;
◆ 应用商店414;
◆ 地图415;
◆ 浏览器416;
◆ 视频和音乐播放器417;以及
◆ 即时通讯应用(微信)418。
显示在第二屏幕区域309上的:
● 无线通信信号强度标识421;
● 时间指示器402;
● 电池状态指示器401;
● Wi-Fi信号强度标识419;
● 闹钟指示器420;
● 应用程序的图标422等。
此外,虽然主要是参考手指输入(例如,单指接触、单指轻击手势、单指轻扫手势)来给出下面的示例,但是应当理解的是,在一些实施例中,这些手指输入中的一个或多个由来自另一输入设备的输入(例 如,触控笔输入)替代。
现在将关注点转到可以在具有显示器和触敏表面的移动终端(诸如便携式移动终端100)上实现的用户界面(“UI”)及相关联的过程的实施例。本申请所述移动终端100旨在充分显示屏115利用不连续显示的第二屏幕区域309,提供多样的交互功能,提高用户使用体验。
在本文中,除非特别说明,用户的手势是灵活的,可以是点击,双击,滑动,画圈,画线,单指触碰,或多指触碰,等等。本领域普通技术人员可以理解,只要能达到基本相同的效果,具体手势的选择是灵活的。在本文中,除非特别说明,用户的手势作用于触敏表面的位置或区域也是灵活的,可以是显示屏显示的某个应用接口元素的区域或附近区域,显示屏不显示应用接口元素的空白区域,显示屏显示的某个功能设置的区域,等等。本领域普通技术人员可以理解,只要能达到基本相同的效果,手势作用于触敏表面的具体位置或区域是可以灵活设置的。
在一些实施例中,移动终端100可以通过检测手指301作用于触敏表面的压力,持续时间,区域,位置,与某个或某些应用图标的距离,或与触敏表面的边界的距离等方式,判断出手势的意图是指令设备对应用图标或者在非应用图标区域进行操作,例如:启动应用,翻转子屏幕等等,从而对手势做出响应。
图5示出根据一些实施例提供的显示图形用户界面的方法的流程示意图。方法在以下各个实施例提及的具有显示器的移动终端100上被执行。在一些实施例中,显示器是触摸屏显示器,并且触敏表面在显示器上。在一些实施例中,显示器与触敏表面是分开的。方法中的一些操作可以被组合,和/或一些操作的次序可以改变。
如图5所示,所述方法包括步骤501~步骤503。其中,首先,在步骤501中,所述移动终端在所述第一屏幕区域显示第一应用的应用界面;然后,在步骤502中,当所述第二应用有通知时,所述移动终端在所述第二屏幕区域显示所述通知;在步骤503中,当检测到对所述通知执行的第一触摸操作,所述移动终端在所述第一屏幕区域继续显示所述第一应用的应用界面,并在所述第一应用的应用界面上显示所述第二应用的与所述通知相关的应用界面。
下面结合一些实施例和各个附图进行具体描述。
如图6A所示,手指301可在触摸屏115的触敏表面上被检测到。移动终端100响应在第一屏幕区域308上点击应用程序图标418的手指301,启动应用程序图标418。之后,移动终端100的图形用户界面过渡到图6B,在第一屏幕区域308上显示应用界面的界面内容。
在一些实施例中,移动终端100可以显示或者隐式地提示用户:应用程序图标418可被启动,例如:移动终端100进行震动。
在一些实施例中,应用图标503可以对手指301无响应。移动终端100也可以显示或者隐式地提示用户:应用图标418对手指301无响应。
在另一些实施例中,当触摸屏显示如图4所示主屏幕的界面时,移动终端100响应于在第一屏幕区域308的从非应用图标区域开始滑动的手指301,在第一屏幕区域308显示从一个屏幕的界面转换到另一个屏幕的界面。
在上述实施例中,响应于在第一屏幕区域308执行的手指301,移动终端100在第一屏幕区域308变换相应的显示内容时,在第二屏幕区域309可以显示相同的内容,例如图6A到图6B过渡后,移动终端100在第二屏幕区域309仍然显示一些设备状态图标和应用图标,甚至,移动终端100在第一屏幕区域308未点亮时,在第二屏幕区域309也可以仍然显示一些设备状态图标和应用图标,使用户无需完全电量移动终端100,仍可获得一些设备相关信息,节约设备电量,提高用户使用体验。
当然,移动终端100可以响应于一个手指301来设置显示还是隐藏第一屏幕区域309的显示内容。
如图7A所示,移动终端100在第二屏幕区域309中具有一个显示/隐藏图标423,在显示状态,当移动终端100检测到手指301对显示/隐藏图标423的操作(例如单击、双击、长按、拖动等操作)时,移动终端100可以从如图7A所示的在第二屏幕区域309显示一些设备状态图标和应用图标过渡到如图7B所示的隐藏在第二屏幕区域309显示那些设备状态图标和应用图标(保留显示/隐藏图标423)。在隐藏状态,当移动终端100检测到手指301对显示/隐藏图标423的操作时,移动终端100可以从如图7B所示的隐藏在第二屏幕区域309显示那些设备状态图标和应用图标(保留显示/隐藏图标423)过渡到如图7A所示的在第二屏幕区域309显示一些设备状态图标和应用图标。
隐藏后,移动终端100可以熄灭第二屏幕区域309,以节约电量消耗,降低第二屏幕区域309的显示内容对第一屏幕区域308的显示内容的干扰,也可以在第一显示屏区域308和第一屏幕区域308配合共同显示一个连续的界面内容,整体显示提高显示效果。
在一些实施例中,移动终端100也可以提供压感功能,替代显示/隐藏图标423或与显示/隐藏图标423结合使用。当移动终端100检测到按压触摸屏或设备边框的输入,且输入的压力达到一定阈值后,移动终端100可以显示或隐藏在第二屏幕区域309显示的上述图标,类似于图8A和图8B。
在一些实施例中,在一段时间没有检测到对第二屏幕区域309操作后,移动终端100可降低第二屏幕区域309的亮度或透明度,可以降低第二屏幕区域309的显示内容对用户观看第一屏幕区域308的干扰。
如图8A和图8B所示,在一些实施例中,移动终端100检测到手指301对第二屏幕区域309的应用程序的图标422的操作(例如单击应用程序的图标422)时,移动终端100可以运行该应用程序,并在第一屏幕区域308中显示对应应用的界面内容。
在一些实施例中,移动终端100可以在第二屏幕区域308上显示一些指定的应用的图标,例如常用的应用或用户设置的应用,移动终端100在第二屏幕区域309和第一屏幕区域308可以配合快速进入常用应用的应用界面,简化用户操作过程。例如,如图9A所示,当移动终端100检测到手指301点击第一屏幕区域308的设置应用的图标406,在第一屏幕区域308显示设置的应用界面,如图9B所示,接着,当检测到手指301点击第二屏幕区域309的微信应用的图标422,移动终端100在第一屏幕区域308显示如图9C微信应用的应用界面,并在第二屏幕区域309显示设置应用的图标406a;之后当检测到手指301点击第二屏幕区域309的设置应用的图标406a的触摸操作301a,移动终端100在第一屏幕区域308上显示如图9B所示的设置应用的应用界面,同时在第二屏幕界面309上显示微信应用的图标422;或者当检测到手指301执行的点击图9C所示的返回控件425的触摸操作301b,移动终端100在第一屏幕区域308显示如图9A所示的主界面,并在第二屏幕区域309显示微信应用的图标422。相比于现有技术需要先退出设置应用的应用界面回到主屏幕才能再进入微信应用的应用界面,或者现有技术需要进行操作进入后台运行列表可能能进入微信应用的应用界面,本申请实施例的方法能够提供快速进入常用应用和快速回到前次访问应用的应用界面的功能,简化用户操作流程,提高用户使用体验。
以下继续结合附图及上述各实施例,对所述方法中步骤501~步骤503进行进一步描述。
在步骤501中,移动终端100在所述第一屏幕区域308显示第一应用的应用界面,例如图10A所示,移动终端100在第一屏幕区域308显示即时通讯应用在视频通话过程中的界面。
在一些实施例中,移动终端100还可以在所述第二屏幕区域309显示至少一个第二应用的图标422,具体显示哪个第二应用及显示数量可以根据设置确定和调整。
接着,在步骤502中,当有所述第二应用的通知,移动终端100在第二屏幕区域309显示所述通知的内容;在所述第一屏幕区域继续显示所述第一应用的应用界面。
在一些实施例中,当移动终端100检测到所述第二应用的通知时,移动终端100可在第二屏幕区域 309闪动对应第二应用的图标、或者在对应第二应用的图标上显示消息数量等方式进行提示。对于社交或通信类应用,移动终端100还可将应用图标修改为消息来源方,即消息发送方的图像,便于用户识别来信方身份。
所述通知可以是移动终端100通过射频电路102接收的即时消息,通知也可以是第二应用在后台运行中,确定满足特定条件(例如,特定时间、特定地点、特定温度等)时所触发的内容,例如定时提醒事项通知。所述通知的具体内容,可以包括但不限于文字、图像、动画等内容,所述提示信息也可以是通知的发送方的信息,例如发送方图像(例如头像、图标等)、发送方身份信息(例如姓名、名称、号码等)、发送方的发送时间等。
结合图10B,移动终端100在第二屏幕区域309的第一应用的图标(例如微信)422旁显示通知424,通知424包括发送方头像和通知的文字内容“在哪儿”。
在一些实施例中,当移动终端100检测到第二应用的通知时,移动终端可以根据通知的内容长度自动调整第二屏幕区域309上其他应用图标位置,还可在整个第二屏幕区域309只显示该通知内容,在通知的内容较长时可滚动显示,还可以使对应第二应用的图标闪动或变颜色或其旁边显示消息数量等方式,使用户可感知到通知。在一些实施例中,移动终端100可以在所述第二屏幕区域上固定地显示所述通知,有利于用户随时查看所述通知的内容,移动终端100可以在检测到用户选择关闭的操作(按压屏幕或滑动、点击、双击图标或消息)或触发所述第二应用时,关闭通知的提示信息,后退回到如图10A所示的初始状态,达到消息的有效通知。
在一些实施例中,当移动终端100显示通知424时,由于第二屏幕区域309的尺寸所限,可以隐藏其他一些应用程序的图标,例如图10B所示,移动终端100将通知424显示在第二应用的图标422旁,通知424右侧的图标整体右移,并不显示“移出”第二屏幕区域309的其他图标。
在一些实施例中,结合图11A和图11B,移动终端100可以根据手指301在第二屏幕区域309上的滑动操作,移动显示第二屏幕区域309以外的其他图标,从而可以使用户在需要的时候展示前述被隐藏的其他图标。
在另一些实施例中,当移动终端100可以固定通知424的显示尺寸,并在通知的显示尺寸区域内显示通知的消息内容,例如从右向左的滚动显示,或从上到下的滚动显示等。
然后,在步骤503中,移动终端100响应于检测到手指301对第二屏幕区域309显示的所述通知执行的第一操作时,在所述第一屏幕区域308继续显示所述第一应用的应用界面,并在所述第一应用的应用界面的全部或部分区域上显示与所述第二应用相关的应用界面430。
所述应用界面430可以是与所述通知相关的应用界面,也可以是调用所述第二应用其他功能的应用界面。
如图12A所示,移动终端100检测到手指301从第二屏幕区域309拖动通知402到第一屏幕区域308的操作时,继续显示正在运行的即时通讯应用的界面,继续进行的视频通话的通知,在即时通讯应用的应用界面上显示应用界面430,应用界面430可以包括图12B所示的通知的具体内容相关的应用界面。
在一些实施例中,结合图15A和图15B,应用界面430可以还可以包括第二应用的其他相关功能的应用界面,例如,移动终端100检测到用户单击或双击第二应用的图标422的操作,可以在第一屏幕区域308显示联系人列表,在检测到用户联系列表输入的滑动内容的操作,可移动显示上下文,在检测用户的滑动或输入确定联系人,进入联系人的显示界面431。
在一些实施例中,所述方法还可以包括步骤504,在步骤504中,移动终端100检测到手指301在触摸屏的交互界面上执行的操作(例如点击“回复”)时,移动终端100显示的应用界面430从图12B过 渡到图12C所示的输入界面,移动终端100获取手指301在应用界面430的输入区域的第二操作,获取回复消息,当检测到点手指301点击“发送”时,第二应用将回复消息发送给相应的接收方(对应前述的发送方)。
然后,移动终端100显示的应用界面430从图12B过渡到图12C所示的输入界面继续显示正在运行的即时通讯应用的界面,继续进行的视频通话的通知,在即时通讯应用的界面上显示应用界面430。
在此期间,移动终端100仍然继续运行第一应用,并在所述第一屏幕区域308仍然实时地显示第一应用的应用界面,例如,图12A-图12C,移动终端100在第一屏幕区域308仍然实时地进行视频通话过程,也就是继续实时地显示通话双方的动态图像、传递通话双方的语音等。该应用界面430可以是半透明或不透明的方式显示,其中以半透明的方式显示可以使用户继续观看到第一应用的界面内容。
在一些实施例中,移动终端100显示所述第二应用的与所述通知相关的应用界面时,当检测到在所述第一屏幕区域308且在所述第二应用的应用界面外的区域上执行的第三触摸操作,移动终端100执行第二应用中与所述第三触摸操作对应的指令,并在所述第一屏幕区域继续显示所述第二应用中与所述通知相关的应用界面。
如图12C所示,第二应用的输入界面430可以包括虚拟键盘,虚拟键盘可设置为全键盘或九宫格键盘,还可如图14B所示,第二应用的输入界面430的拆分为左右两部分,将第一应用的界面内容的中间部分空出来,比如在游戏过程中,中央视区比较重要,中间部分空出来不容易干扰到游戏。
在一些实施例中,第二应用的应用界面还可在输入法中集成语音输入,移动终端100根据用户的语音输入转为文字后,运行第二应用回复消息,进一步减少键盘对第一应用的显示画面的干扰。
在另一些实施例中,移动终端100检测到手指301从第二屏幕区域309拖动通知402到第一屏幕区域308的操作时,移动终端100显示的内容可以从图13A过渡到图13B所示的应用界面430,也就是说,移动终端在第一屏幕区域308显示的通知内容切换显示为正在输入的内容,在第一屏幕区域309上显示输入界面,在本实施例中,所述方法通过第一屏幕区域308和第二屏幕区域309配合处理第二应用的通知,进一步简化了在第一屏幕区域308所显示的第二应用的交互过程以及交互界面,有利于用户快速处理第二应用的通知,缩短对第一应用的应用界面的影响时间,可以使用户尽快回到例如观看电影、打游戏、视频通话中,提高用户使用体验。
在一些实施例中,移动终端100处理完所述通知之后,移动终端100在所述第一屏幕区域继续显示所述第一应用的应用界面,且不显示所述第二应用的应用界面,例如图13B移动终端100检测到手势301点击发送后,退出所述第二应用的应用界面,显示如图13A所示。
在一些实施例中,当检测到手指301在所述第一屏幕区域308且在所述第二应用的应用界面外的区域上执行的第三触摸操作,移动终端100可以执行第二应用中与所述第三触摸操作对应的指令,例如在第一应用为游戏应用时,处理第二应用的通知过程中,如果发现游戏中出现敌人接近,用户可以立即对第一应用的界面进行操作,并移动终端在所述第一屏幕区域可以继续显示所述第二应用中与所述通知相关的应用界面。
在一些实施例中,移动终端100可以根据用户的操作,在所述第一屏幕区域308继续显示所述第一应用的应用界面,且退出所述第二应用的应用界面,退出方式可以是但不限于,移动终端100检测到手指301点击所述第二屏幕区域308中对应所述第二应用的图标;移动终端100检测到手指301长按所述第二应用的应用界面;移动终端检测到手指301双击所述第一应用的应用界面中且在所述第二应用的应用界面外的区域等。
因此,当移动终端100在第一屏幕区域308显示第一应用的界面内容,例如视频通话、影音播放(电影、电视、动画等)、游戏等时,当有第二应用的通知时,移动终端100可以在第二屏幕区域309显 示通知相关的信息,一方面,相比于在第一屏幕区域308弹出界面进行提示的方式,不会占用第一屏幕区域308,不影响第一屏幕区域308的显示内容,另一方面,通知相关信息可以持久地显示在第二屏幕区域309,不像弹出界面弹出后快速收回,避免用户来不及看清通知的内容,通知就消失的问题。
当移动终端100检测到用户对所述通知的第一操作后,在第一屏幕区域308显示第一应用的界面内容的同时,在第一应用的界面内容上显示第二应用的应用界面430,该应用界面430可以响应于用户在其上执行的第二操作,处理通知,包括查阅通知的内容、对通知进行处理或回复等。因此,移动终端100在第一屏幕区域308上无需从正在显示的第一应用的界面内容跳转到第二应用的界面内容,使用户仍然可以继续观看第一应用的界面内容,同时应用界面430可以为用户提供快速处理第二应用的通知的功能。
因此,在一些具体的使用场景中,大大提高了用户的使用体验,例如:用户在进行观看电影时,可以不用停止正在观看的电影,无需退出第一屏幕区域中播放器应用,切换到其他应用,就可以处理通知;用户正在游戏过程中无需跳出游戏应用,避免可能被游戏服务方判断为“掉线”、“逃跑”等问题,就可以处理通知;还有,用户正在视频通过过程中无需关闭视频通话界面,避免影响与对方通话过程,就可以处理通知。
移动终端100可检测用户点击消息、图标、按压屏幕或边框某处进入消息输入模式,输入模式下,移动终端100在第一屏幕区域的部分或整个区域显示并作为输入区域,并且在输入区域不会影响原先的游戏、电影或阅读等应用的画面显示,例如,在其上通过半透明或不透明的方式叠加消息内容、输入键盘、手写输入轨迹、输入法等内容,获取输入消息后发送。
在一些实施例中,当移动终端100利用加速计传感器、重力传感器、陀螺仪检测到移动终端100发生旋转时,所述第二屏幕区域309的图标也可随之旋转,例如如图14A所示,为用户提供恰当视角的显示方向,同样在第一屏幕区域308上显示的应用界面430也提供恰当的显示方向。
根据本申请另一方面提供的一种显示图形用户界面的方法,所述方法包括步骤601~步骤602。
在步骤601中,移动终端100启动前置摄像功能,如图16A所示,移动终端100检测到手指301点击相机图标407的操作,开启拍摄功能,并且检测到手指301点击切换前/后摄像头的控件425的操作,启动前置摄像头进行拍摄。
随即,在步骤602中,移动终端100在第一屏幕区域308上显示前置摄像头获取的图像,在第二屏幕区域309进入补光模式,补光模式可以包括,提高所述第二屏幕区域全部或部分区域的显示亮度超过阈值,以给被拍摄物补光,例如图16B所示,第二屏幕区域309的显示亮度提高到一定阈值以上,甚至提高到最大值,也就是说,将第二屏幕区域309中的背光灯亮度提高到一定阈值甚至提高到最大值。
在一些实施例中,移动终端100还可以将第二屏幕区域309调整至单色模式,例如白色、黄色、蓝色等,为被拍摄物进行补光的同时,还可以帮助提高被拍摄物成像颜色,提高成像效果,提供用户的拍摄体验。
因此,所述方法中,移动终端通过在前置摄像头拍摄过程中,将第二屏幕区域309显示为补光灯条,为被拍摄物(例如人脸)进行补光,使用户环境光线较暗时仍然能够获得亮度较佳的图像,例如,黑暗环境下仍然可以自拍,视频通话。因此,在启动前置摄像头进行拍照时,移动终端100将所述第二屏幕区域作为补光灯,将不连续屏幕区域点亮,在拍照、化妆、人脸识别等应用中提供补光灯的作用,使获得的图像质量在暗光环境下得到改善。在不连续屏幕区域可加强该区域的背光亮度,以获得更佳的补光效果。结合前述各实施例,使所述显示屏具有更多样的功能,提高用户在各个场景的使用需求,提高用户使用体验。
在一些实施例中,在步骤602中,在第二屏幕区域309进入补光模式进行补光的过程中,移动终端 100可以在第二屏幕区域309的一个或多个部分区域进行补光,如图17A、图17B和图17C,当前置摄像头拍摄过程进入深度3D模式,当检测到手指301点击拍照,前置摄像头连续拍摄3张照片,并且每次拍照时分别点亮426a、426b和426c进行补光,然后移动终端100的处理器101将三张图片进行合成,结合双前置摄像头利用光影变化获得高精度的3D深度信息。从不同角度进行补光,形成精度更高的图像,进一步帮助提高成像效果。
在移动终端实现虹膜识别功能时,启动前置摄像头和虹膜扫描摄像头,在第一屏幕区域308显示拍摄的人眼,在第二屏幕区域309显示可见光的基础上,增加红外光,为虹膜识别或人脸识别提供红外补光效果,提高虹膜识别功能。
因此移动终端利用第二屏幕区域,实现了柔和的补光灯效果,在不影响显示应用内容的情况下,带来更好的拍摄效果。本申请提供一种利用不连续屏幕区域作为补光灯的方案。相对于现有的技术而言,无需在设备面板上占用额外的空间并增加额外的开孔,可以在大屏占比的方案中实现补光效果。
在一些实施例中,如图18所示,移动终端100在第二屏幕区域309还可以显示指向所述前置摄像头306位置的提示图案435,提高拍摄效果。
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如固态硬盘Solid State Disk(SSD))等。
本申请实施例可以根据上述方法示例对设备进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将移动设备的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。上述描述的系统,移动设备和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
综上所述,以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照上述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对上述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。

Claims (40)

  1. 一种在移动终端上显示图形用户界面的方法,其中,所述移动终端包括触摸屏和摄像头,所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域,所述方法包括:
    所述移动终端在所述第一屏幕区域显示第一应用的应用界面;
    当所述第二应用有通知时,所述移动终端在所述第二屏幕区域显示所述通知;
    当检测到对所述通知执行的第一触摸操作,所述移动终端在所述第一屏幕区域继续显示所述第一应用的应用界面,并在所述第一应用的应用界面上显示所述第二应用的与所述通知相关的应用界面。
  2. 根据权利要求1所述的方法,其中,所述移动终端显示所述第二应用的与所述通知相关的应用界面的步骤,包括:
    所述移动终端在所述第一应用的应用界面的部分区域上显示所述第二应用的应用界面;和/或
    所述移动终端在所述第一应用的应用界面上以透明或半透明方式显示所述第二应用的应用界面。
  3. 根据权利要求1或2所述的方法,其中,所述移动终端显示所述第二应用的与所述通知相关的应用界面时,所述方法还包括:
    当检测到在所述第二应用的应用界面上执行的第二触摸操作,所述移动终端处理所述通知。
  4. 根据权利要求3所述的方法,其中,所述移动终端处理完所述通知之后,所述方法还包括:
    所述移动终端在所述第一屏幕区域继续显示所述第一应用的应用界面,且不显示所述第二应用的应用界面。
  5. 根据权利要求1至4中任一项所述的方法,其中,所述移动终端显示所述第二应用的与所述通知相关的应用界面时,所述方法还包括:
    当检测到在所述第一屏幕区域且在所述第二应用的应用界面外的区域上执行的第三触摸操作,所述移动终端执行第二应用中与所述第三触摸操作对应的指令,并在所述第一屏幕区域继续显示所述第二应用中与所述通知相关的应用界面。
  6. 根据权利要求1至4中任一项所述的方法,其中,所述移动终端显示所述第二应用的与所述通知相关的应用界面时所述方法还包括:
    当检测到第四触摸操作,所述移动终端在所述第一屏幕区域继续显示所述第一应用的应用界面,且不显示所述第二应用的应用界面,其中,所述移动终端检测到第四触摸操作的步骤包括以下任一项:
    所述移动终端检测到对所述第二屏幕区域中对应所述第二应用的通知的触摸操作;
    所述移动终端检测到对所述第二应用的应用界面的触摸操作;
    所述移动终端检测到对所述第一应用的应用界面中且在所述第二应用的应用界面外的区域上执行的触摸操作。
  7. 根据权利要求1至6中任一项所述的方法,其中,所述方法还包括:
    所述移动终端在所述第二屏幕区域显示至少一个所述第二应用的图标。
  8. 根据权利要求7所述的方法,其中,所述移动终端在所述第二屏幕区域提示所述通知的步骤包括以下至少任一项:
    所述移动终端在所述第二屏幕区域显示所述通知的内容;
    所述移动终端在所述第二屏幕区域显示所述通知的发送方信息,所述发送方信息包括发送方图像、发送方身份信息及发送方发送时间中任一项或任几项;
    所述移动终端在所述第二屏幕区域改变所述通知对应的所述第二应用的图标的显示方式。
  9. 根据权利要求7或8所述的方法,其中,所述方法还包括:
    所述移动终端在所述第二屏幕区域显示一控件;
    当检测到对所述控件执行的第三触摸操作,所述移动终端隐藏所述至少一个第二应用的图标和/或所述第二应用的通知。
  10. 根据权利要求1至9中任一项所述的方法,其中,所述移动终端在所述第二屏幕区域显示所述通知的步骤,包括:
    所述移动终端在所述第二屏幕区域以滚动显示的方式,显示所述通知的内容。
  11. 一种在移动终端上显示图形用户界面的方法,其中,所述移动终端包括触摸屏和摄像头,所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域,所述方法包括:
    所述移动终端在所述第一屏幕区域显示第一应用的应用界面,在所述第二屏幕区域显示第二应用的图标;
    当检测到对所述第二应用的图标执行的第一触摸操作,所述移动终端在所述第一屏幕区域显示所述第二应用的应用界面,在所述第二屏幕区域显示所述第一应用的图标。
  12. 根据权利要求11所述的方法,其中,所述移动终端在所述第一屏幕区域显示所述第二应用的应用界面之后,所述方法还包括:
    当所述移动终端在所述第二屏幕区域不显示所述第二应用的应用界面时,在所述第二屏幕区域显示所述第二应用的图标。
  13. 一种在移动终端上显示的方法,其中,所述移动终端包括触摸屏和摄像头,所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域,所述方法包括:
    所述移动终端启动所述摄像头拍摄;
    所述移动终端在所述第一屏幕区域上显示所述摄像头所获取的图像,并提高所述第二屏幕区域全部或部分区域的显示亮度超过阈值,以给被拍摄物补光。
  14. 根据权利要求13所述的方法,其中,所述方法还包括:
    所述移动终端在所述第二屏幕区域全部或至少一个局部区域显示预设颜色,以给被拍摄物补光。
  15. 根据权利要求13或14所述的方法,其中,所述方法还包括:
    所述移动终端在第二屏幕区域还显示指向所述摄像头位置的提示图案。
  16. 一种移动终端,其中,所述移动终端包括:
    摄像头;
    触摸屏,其中,所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域;
    一个或多个处理器;
    存储器;
    以及一个或多个计算机程序,其中所述一个或多个计算机程序被存储在所述存储器中,所述一个或多个计算机程序包括指令,当所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:
    在所述第一屏幕区域显示第一应用的应用界面;
    当所述第二应用有通知时,在所述第二屏幕区域显示所述通知;
    当检测到对所述通知执行的第一触摸操作,在所述第一屏幕区域继续显示所述第一应用的应用界面,并在所述第一应用的应用界面上显示所述第二应用的与所述通知相关的应用界面。
  17. 根据权利要求16所述的移动终端,其中,在显示所述第二应用的与所述通知相关的应用界面 的步骤中,所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:
    在所述第一应用的应用界面的部分区域上显示所述第二应用的应用界面;和/或
    在所述第一应用的应用界面上以透明或半透明方式显示所述第二应用的应用界面。
  18. 根据权利要求16或17所述的移动终端,其中,在显示所述第二应用的与所述通知相关的应用界面时,所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:
    当检测到在所述第二应用的应用界面上执行的第二触摸操作,处理所述通知。
  19. 根据权利要求18所述的移动终端,其中,在处理完所述通知之后,所述指令被所述移动终端执行时,使得所述移动终端还执行以下步骤:
    在所述第一屏幕区域继续显示所述第一应用的应用界面,且不显示所述第二应用的应用界面。
  20. 根据权利要求16至19中任一项所述的移动终端,其中,所述移动终端显示所述第二应用的与所述通知相关的应用界面时,所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:
    当检测到在所述第一屏幕区域且在所述第二应用的应用界面外的区域上执行的第三触摸操作,执行第二应用中与所述第三触摸操作对应的指令,并在所述第一屏幕区域继续显示所述第二应用中与所述通知相关的应用界面。
  21. 根据权利要求16至19中任一项所述的移动终端,其中,在显示所述第二应用的与所述通知相关的应用界面时,所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:
    当检测到第四触摸操作,在所述第一屏幕区域继续显示所述第一应用的应用界面,且不显示所述第二应用的应用界面,其中,
    检测到第四触摸操作的步骤,所述指令被所述移动终端执行时,使得所述移动终端执行以下任一步骤:
    检测到对所述第二屏幕区域中对应所述第二应用的通知的触摸操作;
    检测到对所述第二应用的应用界面的触摸操作;
    检测到对所述第一应用的应用界面中且在所述第二应用的应用界面外的区域上执行的触摸操作。
  22. 根据权利要求16至21中任一项所述的移动终端,其中,所述指令被所述移动终端执行时,使得所述移动终端还执行以下步骤:
    在所述第二屏幕区域显示至少一个所述第二应用的图标。
  23. 根据权利要求22所述的移动终端,其中,在所述第二屏幕区域提示所述通知的步骤中,所述指令被所述移动终端执行时,使得所述移动终端执行以下至少任一步骤:
    在所述第二屏幕区域显示所述通知的内容;
    在所述第二屏幕区域显示所述通知的发送方信息,所述发送方信息包括发送方图像、发送方身份信息及发送方发送时间中任一项或任几项;
    在所述第二屏幕区域改变所述通知对应的所述第二应用的图标的显示方式。
  24. 根据权利要求22或23所述的移动终端,其中,所述指令被所述移动终端执行时,使得所述移动终端还执行以下步骤:
    在所述第二屏幕区域显示一控件;
    当检测到对所述控件执行的第三触摸操作,隐藏所述至少一个第二应用的图标和/或所述第二应用的通知。
  25. 根据权利要求16至24中任一项所述的的移动终端,其中,在所述第二屏幕区域显示所述通知中,所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:
    在所述第二屏幕区域以滚动显示的方式,显示所述通知的内容。
  26. 一种移动终端,其中,所述移动终端包括:
    摄像头;
    触摸屏,其中所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域;
    一个或多个处理器;
    存储器;
    以及一个或多个计算机程序,其中所述一个或多个计算机程序被存储在所述存储器中,所述一个或多个计算机程序包括指令,当所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:
    在所述第一屏幕区域显示第一应用的应用界面,在所述第二屏幕区域显示第二应用的图标;
    当检测到对所述第二应用的图标执行的第一触摸操作,在所述第一屏幕区域显示所述第二应用的应用界面,在所述第二屏幕区域显示所述第一应用的图标。
  27. 根据权利要求26所述的移动终端,其中,所述移动终端在所述第一屏幕区域显示所述第二应用的应用界面之后,所述指令被所述移动终端执行时,使得所述移动终端还执行以下步骤:
    当所述移动终端在所述第二屏幕区域不显示所述第二应用的应用界面时,在所述第二屏幕区域显示所述第二应用的图标。
  28. 一种在移动终端上显示的移动终端,其中,
    摄像头;
    触摸屏,其中所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域;
    一个或多个处理器;
    存储器;
    以及一个或多个计算机程序,其中所述一个或多个计算机程序被存储在所述存储器中,所述一个或多个计算机程序包括指令,当所述指令被所述移动终端执行时,使得所述移动终端执行以下步骤:
    启动所述摄像头拍摄;
    在所述第一屏幕区域上显示所述摄像头所获取的图像,并提高所述第二屏幕区域全部或部分区域的显示亮度超过阈值,以给被拍摄物补光。
  29. 根据权利要求28所述的移动终端,其中,所述指令被所述移动终端执行时,使得所述移动终端还执行以下步骤:
    在所述第二屏幕区域全部或至少一个局部区域显示预设颜色,以给被拍摄物补光。
  30. 根据权利要求28或29所述的移动终端,其中,所述指令被所述移动终端执行时,使得所述移动终端还执行以下步骤:
    在第二屏幕区域还显示指向所述摄像头位置的提示图案。
  31. 一种图形用户界面(GUI),所述图形用户界面存储在电子设备中,所述电子设备包括触摸屏、存储器、一个或多个处理器,所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域,所述一个或多个处理器用于执行存储在所述存储器中的一个或多个计算机程序,其特征在于,所述图形用户界面包括:
    显示在所述第一屏幕区域的第一GUI,所述第一GUI包括第一应用的应用界面;
    响应于检测到所述第二应用有通知时,在所述第二屏幕区域显示的第二GUI,所述第二GUI包括所述通知;
    响应于检测到对所述通知执行的第一触摸操作,在所述第一屏幕区域继续显示所述第一GUI,并在所述第一GUI上显示第三GUI,所述第三GUI包括所述第二应用的与所述通知相关的应用界面。
  32. 根据权利要求31所述的图形用户界面,其中,所述第一GUI还包括:至少一个所述第二应用的图标。
  33. 一种计算机程序产品,其中,当所述计算机程序产品在移动终端上运行时,使得所述移动终端执行如权利要求1-15中任一项所述的方法。
  34. 一种计算机可读存储介质,包括指令,其中,当所述指令在移动终端上运行时,使得所述移动终端执行如权利要求1-15中任一项所述的方法。
  35. 一种具有触摸屏的移动终端,所述移动终端包括:显示单元、检测单元和控制单元,其中,
    所述显示单元用于在所述触摸屏的第一屏幕区域显示第一应用的应用界面;
    所述检测单元用于检测所述第二应用是否有通知和检测是否有对所述触摸屏的触摸操作;
    所述控制单元用于在所述检测单元检测到检测所述第二应用有通知时,使所述显示单元在所述触摸屏的第二屏幕区域显示所述通知,以及在所述检测单元检测到对所述通知执行的第一触摸操作时,在所述第一屏幕区域继续显示所述第一应用的应用界面,并在所述第一应用的应用界面上显示所述第二应用的与所述通知相关的应用界面。
  36. 根据权利要求35所述的移动终端,其中,所述移动终端还包括摄像头,所述触摸屏包括第一屏幕区域和第二屏幕区域,所述第一屏幕区域为矩形区域,所述第二屏幕区域为所述触摸屏从所述第一屏幕区域向所述摄像头周围延伸的区域。
  37. 根据权利要求35或36所述的移动终端,其中,所述显示单元还用于在所述第二屏幕区域显示至少一个所述第二应用的图标。
  38. 根据权利要求37所述的移动终端,其中,所述显示单元用于在所述第二屏幕区域显示一控件;所述控制单元还用于在所述检测单元检测到对所述控件执行的第三触摸操作,使所述显示单元隐藏所述至少一个第二应用的图标和/或所述第二应用的通知和/或所述第二应用的通知。
  39. 一种具有触摸屏的移动终端,所述移动终端包括:显示单元、检测单元和控制单元,其中,
    所述显示单元用于在所述触摸屏的第一屏幕区域显示第一应用的应用界面,在所述触摸屏的第二屏幕区域显示第二应用的图标;
    所述检测单元用于检测是否有对所述触摸屏的触摸操作;
    所述控制单元用于在所述检测单元检测到对所述第二应用的图标执行的第一触摸操作,使所述显示单元在所述第一屏幕区域显示所述第二应用的应用界面,在所述第二屏幕区域显示所述第一应用的图标。
  40. 一种具有触摸屏的移动终端,所述移动终端包括:拍摄单元、显示单元和控制单元,其中,
    所述拍摄单元用于拍摄图像;
    所述显示单元用于在所述触摸屏的第一屏幕区域上显示所述摄像头所获取的图像;
    所述控制单元用于控制所述显示单元提高所述触摸屏的第二屏幕区域全部或部分区域的显示亮度超过阈值,以给被拍摄物补光。
PCT/CN2017/091283 2017-06-30 2017-06-30 显示图形用户界面的方法和移动终端 WO2019000437A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201780091258.9A CN110663016B (zh) 2017-06-30 2017-06-30 显示图形用户界面的方法和移动终端
PCT/CN2017/091283 WO2019000437A1 (zh) 2017-06-30 2017-06-30 显示图形用户界面的方法和移动终端
CN202211291655.XA CN116055610B (zh) 2017-06-30 2017-06-30 显示图形用户界面的方法和移动终端

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/091283 WO2019000437A1 (zh) 2017-06-30 2017-06-30 显示图形用户界面的方法和移动终端

Publications (1)

Publication Number Publication Date
WO2019000437A1 true WO2019000437A1 (zh) 2019-01-03

Family

ID=64742786

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/091283 WO2019000437A1 (zh) 2017-06-30 2017-06-30 显示图形用户界面的方法和移动终端

Country Status (2)

Country Link
CN (2) CN110663016B (zh)
WO (1) WO2019000437A1 (zh)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109886000A (zh) * 2019-02-01 2019-06-14 维沃移动通信有限公司 一种图像加密方法及移动终端
CN110196667A (zh) * 2019-05-30 2019-09-03 维沃移动通信有限公司 一种通知消息的处理方法及终端
CN112380014A (zh) * 2020-11-17 2021-02-19 莫雪华 基于大数据的系统资源分配系统及方法
CN112583957A (zh) * 2019-09-30 2021-03-30 华为技术有限公司 电子设备的显示方法、电子设备与计算机可读存储介质
CN112714236A (zh) * 2019-10-24 2021-04-27 中兴通讯股份有限公司 终端及拍摄方法、存储介质、电子装置
CN114816209A (zh) * 2019-06-25 2022-07-29 华为技术有限公司 一种移动终端的全屏显示方法及设备
CN115150550A (zh) * 2022-06-20 2022-10-04 湖北星纪时代科技有限公司 用于终端的拍照处理方法、装置、电子设备和存储介质
WO2023005999A1 (zh) * 2021-07-28 2023-02-02 华为技术有限公司 提示摄像头状态的方法及电子设备
CN116088716A (zh) * 2022-06-13 2023-05-09 荣耀终端有限公司 窗口管理方法和终端设备
EP4206913A4 (en) * 2020-09-24 2024-01-31 Vivo Mobile Communication Co Ltd METHOD AND APPARATUS FOR EXECUTING FUNCTION

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112291412B (zh) * 2020-10-29 2022-04-22 维沃移动通信(杭州)有限公司 应用程序控制方法、装置及电子设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105955573A (zh) * 2016-04-27 2016-09-21 上海斐讯数据通信技术有限公司 一种移动终端应用程序切换方法和系统
CN106231187A (zh) * 2016-07-29 2016-12-14 维沃移动通信有限公司 一种拍摄图像的方法及移动终端
CN106657485A (zh) * 2017-03-07 2017-05-10 广东欧珀移动通信有限公司 移动终端
US20170149959A1 (en) * 2013-05-15 2017-05-25 Lg Electronics Inc. Mobile terminal and controlling method thereof
CN106843654A (zh) * 2017-01-24 2017-06-13 维沃移动通信有限公司 一种终端多任务操作的方法及移动终端

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9619143B2 (en) * 2008-01-06 2017-04-11 Apple Inc. Device, method, and graphical user interface for viewing application launch icons
US8723823B2 (en) * 2011-02-07 2014-05-13 Qualcomm Incorporated System and method for providing notifications on a mobile computing device
KR20120126161A (ko) * 2011-05-11 2012-11-21 삼성전자주식회사 휴대 단말기 및 이의 화면 제어 방법
KR20160097393A (ko) * 2013-06-07 2016-08-18 삼성전자주식회사 프로그램 호출 방법 및 그 전자 장치
CN103500079A (zh) * 2013-09-17 2014-01-08 小米科技有限责任公司 通知消息显示方法、装置及电子设备
CN104750381A (zh) * 2013-12-31 2015-07-01 中兴通讯股份有限公司 一种快捷操作应用项目的方法、装置及终端
US9887949B2 (en) * 2014-05-31 2018-02-06 Apple Inc. Displaying interactive notifications on touch sensitive devices
CN104267950A (zh) * 2014-09-25 2015-01-07 北京金山安全软件有限公司 终端应用程序的设置方法、装置和移动终端
CN106302095B (zh) * 2015-06-04 2021-03-02 深圳市腾讯计算机系统有限公司 一种消息显示控制方法、装置及终端
CN105162959A (zh) * 2015-08-04 2015-12-16 广东欧珀移动通信有限公司 一种消息通知的处理方法及装置
CN105511719A (zh) * 2015-11-27 2016-04-20 努比亚技术有限公司 通知信息显示方法和装置
CN105335056A (zh) * 2015-12-10 2016-02-17 魅族科技(中国)有限公司 应用程序控制方法、应用程序控制装置和终端
CN106547446A (zh) * 2016-10-31 2017-03-29 努比亚技术有限公司 应用切换装置和方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170149959A1 (en) * 2013-05-15 2017-05-25 Lg Electronics Inc. Mobile terminal and controlling method thereof
CN105955573A (zh) * 2016-04-27 2016-09-21 上海斐讯数据通信技术有限公司 一种移动终端应用程序切换方法和系统
CN106231187A (zh) * 2016-07-29 2016-12-14 维沃移动通信有限公司 一种拍摄图像的方法及移动终端
CN106843654A (zh) * 2017-01-24 2017-06-13 维沃移动通信有限公司 一种终端多任务操作的方法及移动终端
CN106657485A (zh) * 2017-03-07 2017-05-10 广东欧珀移动通信有限公司 移动终端

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109886000A (zh) * 2019-02-01 2019-06-14 维沃移动通信有限公司 一种图像加密方法及移动终端
CN109886000B (zh) * 2019-02-01 2024-03-01 维沃移动通信有限公司 一种图像加密方法及移动终端
CN110196667A (zh) * 2019-05-30 2019-09-03 维沃移动通信有限公司 一种通知消息的处理方法及终端
CN114816209A (zh) * 2019-06-25 2022-07-29 华为技术有限公司 一种移动终端的全屏显示方法及设备
CN112583957A (zh) * 2019-09-30 2021-03-30 华为技术有限公司 电子设备的显示方法、电子设备与计算机可读存储介质
CN112714236A (zh) * 2019-10-24 2021-04-27 中兴通讯股份有限公司 终端及拍摄方法、存储介质、电子装置
EP4206913A4 (en) * 2020-09-24 2024-01-31 Vivo Mobile Communication Co Ltd METHOD AND APPARATUS FOR EXECUTING FUNCTION
CN112380014A (zh) * 2020-11-17 2021-02-19 莫雪华 基于大数据的系统资源分配系统及方法
WO2023005999A1 (zh) * 2021-07-28 2023-02-02 华为技术有限公司 提示摄像头状态的方法及电子设备
CN116088716A (zh) * 2022-06-13 2023-05-09 荣耀终端有限公司 窗口管理方法和终端设备
CN116088716B (zh) * 2022-06-13 2023-12-08 荣耀终端有限公司 窗口管理方法和终端设备
CN115150550A (zh) * 2022-06-20 2022-10-04 湖北星纪时代科技有限公司 用于终端的拍照处理方法、装置、电子设备和存储介质

Also Published As

Publication number Publication date
CN110663016A (zh) 2020-01-07
CN116055610A (zh) 2023-05-02
CN110663016B (zh) 2024-01-16
CN116055610B (zh) 2023-12-08

Similar Documents

Publication Publication Date Title
CN116055610B (zh) 显示图形用户界面的方法和移动终端
US10209877B2 (en) Touch screen device, method, and graphical user interface for moving on-screen objects without using a cursor
US20210081560A1 (en) Device, method, and graphical user interface for accessing an application in a locked device
CN108701001B (zh) 显示图形用户界面的方法及电子设备
US9952681B2 (en) Method and device for switching tasks using fingerprint information
JP5658765B2 (ja) 別の装置の表示解像度を持つモードを含む複数のアプリケーション表示モードを有する装置および方法
KR101749235B1 (ko) 동시에 열린 소프트웨어 애플리케이션들을 관리하기 위한 디바이스, 방법, 및 그래픽 사용자 인터페이스
KR101170877B1 (ko) 사진 관리용 휴대용 전자 장치
US9483175B2 (en) Device, method, and graphical user interface for navigating through a hierarchy
US11455096B2 (en) Method for displaying graphical user interface based on gesture and electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17916140

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17916140

Country of ref document: EP

Kind code of ref document: A1