WO2017092680A1 - Electronic device and method for deleting object - Google Patents

Electronic device and method for deleting object Download PDF

Info

Publication number
WO2017092680A1
WO2017092680A1 PCT/CN2016/108076 CN2016108076W WO2017092680A1 WO 2017092680 A1 WO2017092680 A1 WO 2017092680A1 CN 2016108076 W CN2016108076 W CN 2016108076W WO 2017092680 A1 WO2017092680 A1 WO 2017092680A1
Authority
WO
WIPO (PCT)
Prior art keywords
interface element
gesture
application
touch
file
Prior art date
Application number
PCT/CN2016/108076
Other languages
French (fr)
Chinese (zh)
Inventor
梁德胜
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2017092680A1 publication Critical patent/WO2017092680A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • G06F1/325Power saving in peripheral device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons

Definitions

  • This document relates to electronic devices having touch-sensitive surfaces, including but not limited to electronic devices and methods having touch-sensitive surfaces for mobile application interface elements.
  • the use of portable electronic devices with touch-sensitive surfaces has increased dramatically.
  • Such portable electronic devices have greatly increased the number of applications or "apps".
  • image and video camera applications provide users with content generation opportunities, such as taking photos or recording videos.
  • the Notes application allows users to read or write notes.
  • the application corresponds to an application interface element on the graphical user interface of the portable electronic device.
  • Such application interface elements are sometimes referred to as: app icons, app shortcuts, app buttons, app widgets, and the like.
  • the method for deleting an application or a file in an electronic device is: first, the user presses an icon of an application or a file to be deleted, and the electronic device displays a trash can icon, the user's finger.
  • Such methods and interfaces can complement or replace traditional methods of managing application interface elements.
  • Such methods and interfaces can respond to user's individual needs more quickly and intelligently, helping users to achieve substantially the same management application interface elements in less time, and generate a more efficient human-machine interface.
  • For battery powered devices such methods and interfaces can save power and increase the time between battery charges.
  • the device is a desktop computer.
  • the device is portable (eg, a laptop, tablet, or handheld device, or a wearable device).
  • the device has a trackpad.
  • the device has a touch sensitive display (also referred to as a "touch screen", a “touch screen display” or a “display with a touch-sensitive surface”).
  • a device has a graphical user interface (GUI), one or more processors, memory, and one or more modules, programs, or sets of instructions stored in memory for performing a plurality of functions.
  • GUI graphical user interface
  • the user interacts with the GUI primarily through finger contact and/or gestures on the touch-sensitive surface.
  • these functions may include image editing, drawing, rendering, word processing, web page creation, disk editing, spreadsheet creation, playing games, making calls, video conferencing, emailing, instant messaging, exercise support. , digital photography, digital video recording, web browsing, digital music playback, and/or digital video playback. Executable instructions for performing these functions can be included in a non-transitory computer readable storage medium or other computer program product configured for execution by one or more processors.
  • an embodiment of the present invention provides a portable electronic device.
  • the device includes a display, wherein the display includes a touch-sensitive surface and a display screen; one or more processors; a memory; a plurality of applications; and one or more programs.
  • the one or more programs are stored in memory and configured to be executed by one or more processors.
  • the one or more programs include instructions.
  • the instructions are for displaying at least one object interface element on the display screen, the at least one object interface element associating at least one object; detecting a gesture for the at least one object interface element at the touch-sensitive surface, the gesture
  • the gesture speed and the gesture direction are included; when the gesture speed and the gesture direction satisfy a predetermined condition, the at least one object is deleted. This can respond to the user's individual needs more quickly and intelligently, reducing the manual operation of the user, greatly improving the efficiency of processing the electronic device, and saving power.
  • the object interface element specifically includes: an application interface element or a file interface element, the application interface element is associated with an application, and the file interface element is associated with File data.
  • the predetermined condition includes: the gesture speed is greater than or equal to a predetermined threshold, and the gesture direction information is To the right of the display.
  • the at least one of the gestures is moved according to the detected gesture An object interface element.
  • the method before the touch-sensitive surface detects a gesture for the at least one object interface element, the method includes: determining the at least one object Whether to delete: if the at least one object is erasable, detecting a gesture for the at least one object interface element on the touch-sensitive surface; prompting the user if the at least one object is not undeletable.
  • the at least one object interface element is specifically a first application interface element and a second application interface element,
  • the first application interface element is associated with a first application
  • the second application interface element is associated with a second application
  • the gesture for the at least one object interface element is detected at the touch-sensitive surface Deleting the at least one object when the gesture speed and the gesture direction satisfy a predetermined condition, specifically: detecting a gesture for the first application interface element and the second application interface element on the touch-sensitive surface When the gesture speed and the gesture direction satisfy a predetermined condition, the first application and the second application are uninstalled.
  • the at least one object interface element is specifically a first file interface element and a second file interface element,
  • the first file interface element is associated with first file data
  • the second file interface element is associated with second file data;
  • the gesture for the at least one object interface element is detected on the touch-sensitive surface Deleting the at least one object when the gesture speed and the gesture direction satisfy a predetermined condition, specifically: detecting a gesture for the first file interface element and the second file interface element on the touch-sensitive surface And erasing the first file data and the second file data when the gesture speed and the gesture direction satisfy a predetermined condition.
  • the at least one object interface element is specifically a third file interface element and a fourth application interface element
  • the third file interface element is associated with third file data
  • the fourth application interface element is associated with a fourth application
  • the gesture for the at least one object interface element is detected on the touch-sensitive surface, when Deleting the at least one object when the gesture speed and the gesture direction satisfy a predetermined condition, specifically: detecting a gesture for the third file interface element and the fourth application interface element on the touch-sensitive surface When the gesture speed and gesture direction are satisfied When the condition is predetermined, the third file data is erased and the fourth application is unloaded.
  • the present embodiment provides a method of deleting an object for a portable electronic device including a display and a plurality of applications, wherein the display includes a touch-sensitive surface and a display screen, the method comprising: The display screen displays at least one object interface element associated with the at least one object; a gesture for the at least one object interface element is detected at the touch-sensitive surface, the gesture including gesture speed information and gesture direction Information; deleting the at least one object when the gesture speed and the gesture direction satisfy a predetermined condition.
  • the object interface element specifically includes: an application interface element or a file interface element, the application interface element is associated with an application, and the file interface element is associated with File data.
  • the predetermined condition specifically includes: the gesture speed is greater than or equal to a predetermined threshold, and the gesture direction information is To the right of the display.
  • a third possible embodiment of the second aspect when the gesture speed information is less than the predetermined threshold, moving the at least according to the detected gesture An object interface element.
  • the method includes: determining whether the at least one object is removable: if the at least one object is deletable, detecting a gesture for the at least one object interface element at the touch-sensitive surface; if the at least one object If it is not removable, the user is prompted.
  • the at least one object interface element is specifically a first application interface element and a second application interface element,
  • the first application interface element is associated with a first application
  • the second application interface element is associated with a second application; wherein the gesture for the at least one object interface element is detected at the touch-sensitive surface Deleting the at least one object when the gesture speed and the gesture direction satisfy a predetermined condition, specifically: detecting a gesture for the first application interface element and the second application interface element on the touch-sensitive surface When the gesture speed and the gesture direction satisfy a predetermined condition, the first application and the second application are uninstalled.
  • the at least one object interface element is specifically a first file interface element and a second file interface element,
  • the first file interface element is associated with first file data
  • the second file interface element is associated with second file data;
  • the gesture for the at least one object interface element is detected on the touch-sensitive surface
  • the gesture speed and gesture direction are satisfied Deleting the at least one object when a condition is predetermined, specifically: detecting a gesture for the first file interface element and the second file interface element on the touch-sensitive surface; when the gesture speed and gesture When the direction satisfies the predetermined condition, the first file data and the second file data are erased.
  • the at least one object interface element is specifically a third file interface element and a fourth application interface element
  • the third file interface element is associated with third file data
  • the fourth application interface element is associated with a fourth application
  • the gesture for the at least one object interface element is detected on the touch-sensitive surface, when Deleting the at least one object when the gesture speed and the gesture direction satisfy a predetermined condition, specifically: detecting a gesture for the third file interface element and the fourth application interface element on the touch-sensitive surface And erasing the third file data and unloading the fourth application when the gesture speed and the gesture direction satisfy a predetermined condition.
  • an embodiment of the present invention provides an electronic device.
  • the electronic device specifically includes: a touch-sensitive display unit, configured to detect a gesture of a user for an object interface element, the gesture includes a gesture speed and a gesture direction, the object interface element includes an application interface element and a file interface element; and a processing unit, And a gesture for acquiring the touch-sensitive display unit, and determining whether the gesture satisfies a predetermined condition: if the processing unit determines that the gesture satisfies a predetermined condition, deleting an object associated with the object interface element.
  • the predetermined condition specifically includes: the gesture speed is greater than or equal to a predetermined threshold, and the gesture direction information is to the display screen Right.
  • the processing unit before the touch sensitive display unit detects a gesture for the object interface element, the processing unit is further configured to: Determining whether the object is erasable: if the object is removable, the touch-sensitive display unit detects a gesture for the object interface element; if the object is non-deletable, prompts the user.
  • the electronic device can provide a more friendly method and user interface for the user, and implement the function of uninstalling a specific application or erasing a specific file. At the same time, this also helps users use less time to achieve the same effect of managing application interface elements and generate a more efficient human-machine interface.
  • battery powered devices such methods and interfaces can save power and increase the time between battery charges.
  • battery powered devices such methods and interfaces can save power and increase the time between battery charges.
  • FIG. 1 is a graphical user interface showing how to delete an application in the prior art.
  • FIG. 2A is a block diagram showing a portable electronic device with a touch-sensitive display, in accordance with some embodiments.
  • 2B is a block diagram showing exemplary components for event processing in accordance with some embodiments.
  • FIG. 3 illustrates a portable electronic device with a touch screen in accordance with some embodiments.
  • FIG. 4 is a block diagram of an exemplary electronic device having a display and a touch-sensitive surface, in accordance with some embodiments.
  • FIG. 5 illustrates an exemplary graphical user interface for an application menu on a portable electronic device in accordance with some embodiments.
  • 6A-6C illustrate an exemplary graphical user interface for uninstalling application interface elements in accordance with some embodiments.
  • FIG. 7A, 7B illustrate an exemplary graphical user interface for deleting multiple object interface elements, in accordance with some embodiments.
  • FIG. 8 illustrates a functional block diagram of an electronic device in accordance with some embodiments.
  • first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another.
  • first application interface element can be named a second application interface element, and similarly, the second application interface element can be named the first application interface element without departing from the scope of the invention.
  • the term “if” may be interpreted to mean “when” or “after” or “in response to determining” or “in response to detecting”, depending on the context.
  • the phrase “if determined" or “if the stated condition or event is detected” can be interpreted to mean “when determining" or “in response to determining... “or” when [the stated condition or event] is detected” or “in response to detecting the [condition or event stated]”.
  • the electronic device is a portable electronic device, such as a mobile phone, that also includes other functions, such as a personal digital assistant and/or music player functionality.
  • exemplary embodiments of an electronic device include, but are not limited to, piggybacking Or a portable communication device of other operating systems.
  • Other electronic devices can also be used, such as a laptop or tablet with a touch-sensitive surface (eg, a touch screen display and/or a touchpad).
  • the electronic device is not a portable electronic device, but a desktop computer having a touch-sensitive surface (eg, a touch screen display and/or a touch pad).
  • an electronic device including a display and a touch-sensitive surface is described. It should be understood, however, that an electronic device can include one or more other physical user interface devices, such as a physical keyboard, mouse, and/or joystick.
  • Electronic devices typically support a variety of applications, such as one or more of the following: a drawing application, a rendering application, a word processing application, a web page creation application, a disk editing application, a spreadsheet application, a gaming application. , phone applications, video conferencing applications, email applications, instant messaging applications, workout support applications, photo management applications (ie image management applications), digital camera applications, digital video camera applications, networks Browse applications, digital music player applications, and/or digital video player applications.
  • applications such as one or more of the following: a drawing application, a rendering application, a word processing application, a web page creation application, a disk editing application, a spreadsheet application, a gaming application.
  • phone applications video conferencing applications, email applications, instant messaging applications, workout support applications, photo management applications (ie image management applications), digital camera applications, digital video camera applications, networks Browse applications, digital music player applications, and/or digital video player applications.
  • Various applications that can be executed on an electronic device can use at least one shared physical user interface device, such as a touch-sensitive surface.
  • One or more functions of the touch-sensitive surface and corresponding information displayed on the device may be adjusted and/or changed from one application to the next and/or adjusted and/or varied within the respective application.
  • the shared physical architecture of the electronic device such as a touch-sensitive surface, can support various applications with a user interface that is intuitive to the user.
  • FIG. 2A is a block diagram showing a portable communication device 100 with a touch-sensitive display 112 in accordance with some embodiments.
  • Touch sensitive display 112 is sometimes referred to as a "touch screen" for convenience, and may also be referred to as or referred to as a touch sensitive display system, and may also be referred to as touch sensitive. Display system for touch-sensitive surfaces and displays.
  • Device 100 can include memory 102 (which can include one or more computer readable storage media), memory controller 122, one or more central processing units (CPUs) 120, peripheral interface 118, RF circuitry 108, audio circuitry System 110, speaker 111, microphone 113, input/output (I/O) subsystem 106, other input control devices 116, and external port 124.
  • Device 100 can include one or more optical sensors 164. These components can communicate over one or more communication buses or signal lines 103.
  • device 100 is but one example of a portable electronic device, and device 100 may have more or fewer components than shown, two or more components may be combined, or may have different components Configuration or layout.
  • the various components shown in Figure 2A can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
  • Memory 102 can include high speed random access memory and can also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state memory devices. Access to memory 102 by other components of device 100, such as CPU 120 and peripheral interface 118, may be controlled by memory controller 122.
  • Peripheral device interface 118 can be used to couple the input and output peripherals of the device to CPU 120 and memory 102.
  • the one or more processors 120 execute or execute various software programs and/or sets of instructions stored in the memory 102 to perform various functions of the device 100 and process the data.
  • the one or more processors 120 include an image signal processor and a dual or multi-core processor.
  • peripheral interface 118, CPU 120, and memory controller 122 can be implemented on a single chip, such as chip 104. In some other embodiments, they can be implemented on separate chips.
  • RF (radio frequency) circuitry 108 receives and transmits RF signals, also referred to as electromagnetic signals.
  • the RF circuitry 108 converts electrical signals into/from electromagnetic signals and communicates with communication networks and other communication devices via electromagnetic signals.
  • RF circuitry 108 may include well-known circuitry for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, Decode chipset, Subscriber Identity Module (SIM) card, memory, and more.
  • SIM Subscriber Identity Module
  • the RF circuitry 108 can communicate with the network and other devices via wireless communication, such as the Internet (also known as the World Wide Web (WWW)), intranets, and/or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and/or Or Metropolitan Area Network (MAN).
  • wireless communication such as the Internet (also known as the World Wide Web (WWW)), intranets, and/or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and/or Or Metropolitan Area Network (MAN).
  • WWW World Wide Web
  • LANs wireless local area networks
  • MAN Metropolitan Area Network
  • Wireless communication can use any of a variety of communication standards, protocols, and technologies including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed Downlink Packet Access (HSDPA), high speed uplink Link Packet Access (HSUPA), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Blue Teeth, Wireless Fidelity (WI-Fi) (eg, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, and/or IEEE 802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (eg, Internet) Message Access Protocol (IMAP) and/or Post Office Protocol (POP), instant messaging (eg, Extensible Messaging Processing Site Protocol (XMPP), Session Initiation Protocol (SIMPLE) for instant messaging and field utilization extensions, instant messaging and Presence Service (IMPS), and/or Short Message Service (SMS), or any other suitable communication protocol, including communication
  • Audio circuitry 110, speaker 111, and microphone 113 provide an audio interface between the user and device 100.
  • Audio circuitry 110 receives audio data from peripheral interface 118, converts the audio data into electrical signals, and transmits the electrical signals to speaker 111.
  • the speaker 111 converts the electrical signal into a human audible sound wave.
  • the audio circuitry 110 also receives electrical signals converted by the microphone 113 based on the acoustic waves.
  • Audio circuitry 110 converts the electrical signals into audio data and transmits the audio data to peripheral interface 118 for processing. Audio data may be retrieved from and/or transmitted to memory 102 and/or RF circuitry 108 by peripheral device interface 118.
  • audio circuitry 110 also includes a headset jack (eg, 212 in FIG. 3).
  • the headset jack provides an interface between the audio circuitry 110 and a removable audio input/output peripheral, such as an output only headset or with an output (eg, a monaural or binaural headset) and input (eg, Microphone) Both
  • the I/O subsystem 106 couples input/output peripherals on device 100, such as touch screen 112 and other input control devices 116, to peripheral device interface 118.
  • the I/O subsystem 106 can include a display controller 156 and one or more input controllers 160 for other input control devices.
  • the one or more input controllers 160 receive electrical signals/transmit electrical signals from other input control devices 116 to other input control devices 116.
  • the other input control device 116 may include physical buttons (eg, a push button, rocker button, etc.), a dial, a slide switch, a joystick, a click wheel, and the like.
  • input controller 160 may be coupled to (or not coupled to) any of the following: a keyboard, an infrared port, a USB port, and a pointing device such as a mouse.
  • the one or more buttons may include up/down buttons for volume control of the speaker 111 and/or the microphone 113.
  • the one or more buttons can include a push button (eg, 206 in Figure 3).
  • Touch sensitive display 112 provides an input interface and an output interface between the device and the user.
  • Display controller 156 receives electrical signals from touch screen 112 and/or transmits electrical signals to touch screen 112.
  • Touch screen 112 displays a visual output to the user.
  • Visual output can include graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some visual output or all of the visual output may correspond to a user interface object.
  • Touch screen 112 has a touch-sensitive surface, sensor or group of sensors that accept input from a user based on tactile and/or tactile contact.
  • Touch screen 112 and display controller 156 (along with any associated modules and/or sets of instructions in memory 102) Detecting contact on touch screen 112 (and any movement or interruption of the contact) and converting the detected contact to a user interface object (eg, one or more soft keys, icons, web pages, or Image) interaction.
  • a user interface object eg, one or more soft keys, icons, web pages, or Image
  • the point of contact between the touch screen 112 and the user corresponds to the user's finger.
  • the touch screen 112 referred to in the embodiment of the present invention specifically refers to a touch-sensitive display system having a touch-sensitive surface and a display screen, unless otherwise specified.
  • Touch screen 112 may use LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, although other display technologies may be used in other embodiments.
  • Touch screen 112 and display controller 156 may utilize any of a variety of touch sensing techniques now known or later developed, as well as other proximity sensor arrays or other means for determining one or more points in contact with touch screen 112. Elements to detect contact and any movement or interruption thereof, including but not limited to capacitive, resistive, infrared, and surface acoustic wave techniques. In an exemplary embodiment, a projected mutual capacitance sensing technique is used.
  • Touch screen 112 can have a video resolution in excess of 100 dpi. In some embodiments, the touch screen has a video resolution of approximately 160 dpi.
  • the user can contact the touch screen 112 using any suitable object or add-on such as a stylus, finger, or the like.
  • the user interface is designed to work primarily with finger-based contacts and gestures, which may be less accurate than the stylus-based input due to the larger contact area of the finger on the touch screen.
  • the device translates the finger-based coarse input into an accurate pointer/cursor position or command to perform the action desired by the user.
  • device 100 in addition to the touch screen, device 100 can include a touchpad (not shown) for activating or deactivating a particular function.
  • the touchpad is a touch sensitive area of the device that is different from the touchscreen in that it does not display a visual output.
  • the touchpad can be a touch-sensitive surface that is separate from the touchscreen 112 or an extension of the touch-sensitive surface formed by the touchscreen.
  • Apparatus 100 also includes a power system 162 for powering various components.
  • the power system 162 can include a power management system, one or more power sources (eg, batteries, alternating current (AC)), a recharging system, power fault detection circuitry, power converters or inverters, power status indicators (eg, lighting) A diode (LED) and any other component associated with the generation, management, and distribution of power in a portable device.
  • Device 100 may also include one or more optical sensors 164.
  • FIG. 2A shows an optical sensor coupled to optical sensor controller 158 in I/O subsystem 106.
  • Optical sensor 164 can include a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor.
  • CMOS complementary metal oxide semiconductor
  • Optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image.
  • imaging module 143 also referred to as a camera module
  • optical sensor 164 can capture still images or video.
  • one or more optical sensors are located The rear of device 100 is opposite the touch screen display 112 on the front of the device such that the touch screen display can be used as a viewfinder for still image and/or video image capture.
  • another or more optical sensors are located on the front of the device such that the user can view images of the user while viewing other video conferencing participants on the touch screen display for video conferencing.
  • Device 100 may also include one or more proximity sensors 166.
  • FIG. 2A shows proximity sensor 166 coupled to peripheral interface 118.
  • proximity sensor 166 can be coupled to input controller 160 in I/O subsystem 106.
  • the proximity sensor turns off and disables the touch screen 112.
  • Device 100 may also include one or more accelerometers 168.
  • FIG. 2A shows an accelerometer 168 coupled to a peripheral device interface 118.
  • accelerometer 168 can be coupled to input controller 160 in I/O subsystem 106.
  • the information is displayed in a portrait view or a landscape view on the touch screen display based on an analysis of the data received from the one or more accelerometers.
  • Apparatus 100 optionally includes a magnetometer (not shown) and a GPS (or GLONASS or Beidou or other global navigation system) receiver (not shown) in addition to accelerometer 168 for obtaining a position regarding device 100 and Information that is oriented (eg, portrait or landscape).
  • the software components stored in the memory 102 include an operating system 126, a communication module (or set of instructions) 128, a contact/moving module (or set of instructions) 130, a graphics module (or set of instructions) 132, text input.
  • memory 102 stores device/global internal state 157, as shown in Figures 2A and 3.
  • the device/global internal state 157 includes one or more of the following: an active application state indicating which applications (if any) are currently active; a display state indicating which applications, views, or other Information occupies various areas of the touch screen display 112; sensor status, including information obtained from various sensors of the device and input control device 116; and position information regarding the position and posture of the device.
  • Operating system 126 eg, Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, ANDROID, or an embedded operating system (such as Vx Works)
  • general system tasks eg, memory management, storage device control, Various software components and/or drivers for power management, etc., and facilitate communication between various hardware and software components.
  • memory 102 stores digital camera film 159 and digital image pipeline 161.
  • Communication module 128 facilitates communication with other devices via one or more external ports 124, and also includes various software components for processing data received by RF circuitry 108 and/or external port 124.
  • External port 124 eg, Universal Serial Bus (USB), Firewire, etc.
  • USB Universal Serial Bus
  • Firewire Firewire
  • the external port is a multi-pin (eg, 30-pin) connector that is identical or similar to and/or compatible with a 30-pin connector used on an iPod (trademark of Apple Inc.) device.
  • the contact/movement module 130 can detect contact with the touch screen 112 (in conjunction with the display controller 156) and other touch sensitive devices (eg, a touchpad or physical click wheel).
  • the contact/movement module 130 includes a plurality of software components for performing various operations related to contact detection, such as determining if a contact has occurred (eg, detecting a finger press event), determining if there is a contact movement, and being touch sensitive throughout The movement is tracked on the surface (eg, detecting one or more finger drag events), and determining if the contact has terminated (eg, detecting a finger lift event or contact interruption).
  • Contact/movement module 130 receives contact data from the touch-sensitive surface.
  • Determining the movement of the contact point may include determining the rate (magnitude), velocity (magnitude and direction), and/or acceleration (change in magnitude and/or direction) of the contact point, the movement of the contact point being caused by a series of contact data Said. These operations can be applied to a single point of contact (eg, one finger contact) or multiple points of simultaneous contact (eg, "multi-touch" / multiple finger contacts).
  • the contact/movement module 130 and the display controller 156 detect contact on the touchpad.
  • the contact/movement module 130 can detect a user's gesture input. Different gestures on the touch-sensitive surface have different contact patterns. Therefore, the gesture can be detected by detecting a specific contact pattern. For example, detecting a one-finger tap gesture includes detecting a finger press event, and then detecting a finger lift at a location (or substantially the same location) as the finger press event (eg, at the icon location) ( Lift off) event. As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift off) event.
  • Graphics module 132 includes a number of known software components for rendering and displaying graphics on touch screen 112 or other display, including components for changing the strength of the displayed graphics.
  • object includes any object that can be displayed to a user, including, without limitation, text, web pages, icons (such as user interface objects including soft keys), digital images, video, animation, and the like.
  • graphics module 132 stores data representation graphics to be used. Each graphic can be assigned a corresponding code.
  • the graphics module 132 receives one or more codes specifying graphics to be displayed from an application or the like, and also receives coordinate data and other graphics attribute data together if necessary, and then generates screen image data for output to the display controller 156.
  • a text input module 134 which may be a component of the graphics module 132, is provided for use in a variety of applications (eg, contacts 137, email 140, instant message 141, browser 147, and any other application requiring text input) Enter the soft keyboard for the text.
  • applications eg, contacts 137, email 140, instant message 141, browser 147, and any other application requiring text input
  • the GPS module 135 determines the location of the device and provides this information for use in various applications (eg, for phone 138 for location based dialing, for camera 143 as picture/video metadata, and for providing) Applications for location-based services, such as the weather desktop applet, the local yellow pages desktop applet, and the map/navigation desktop applet.
  • applications eg, for phone 138 for location based dialing, for camera 143 as picture/video metadata, and for providing
  • Applications for location-based services such as the weather desktop applet, the local yellow pages desktop applet, and the map/navigation desktop applet.
  • Application 136 may include the following modules (or sets of instructions) or subgroups or supersets thereof:
  • Contact module 137 (sometimes referred to as an address book or contact list);
  • IM Instant messaging
  • a camera module 143 for still images and/or video images
  • Image management module 144
  • Calendar module 148
  • a desktop applet module 149 which may include one or more of the following: weather desktop applet 149-1, stock market desktop applet 149-2, calculator desktop applet 149-3, alarm desktop applet 149-4 , the dictionary desktop applet 149-5, and other desktop applets obtained by the user, and the user-created desktop applet 149-6;
  • a desktop applet creator module 150 for generating a user-created desktop applet 149-6;
  • Video and music player module 152 which may be comprised of a video player module and a music player module;
  • Sound/audio recorder module 163 Sound/audio recorder module 163; and/or
  • Notification module 165
  • Examples of other applications 136 that may be stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA enabled applications, encryption, digital rights management, voice recognition, And sound reproduction.
  • contact module 137 can be used to manage contacts or contact lists (eg, stored in memory 102 or memory 370 for contact)
  • the application internal state 192 of the person module 137 includes: adding a name to the address book; deleting the name from the address book; associating the phone number, email address, actual address, or other information with the name; associating the image with the name; Names are categorized and categorized; a phone number or email address is provided to initiate and/or facilitate communication over the phone 138, video conference 139, email 140, or IM 141;
  • telephone module 138 can be used to input corresponding to the telephone The character sequence of the number, accessing one or more phone numbers in the address book 137, modifying the phone number that has been entered, dialing the corresponding phone number, making a call, and disconnecting or hanging up when the call is completed.
  • wireless communication can use any of a variety of communication standards, protocols, and technologies.
  • the video conferencing module 139 includes executable instructions for initiating, conducting, and ending a video conference between the user and one or more other participants in accordance with user instructions.
  • email client module 140 includes means for creating, transmitting, receiving, and managing in response to user instructions Executable instructions for email.
  • the email client module 140 makes it very easy to create and send emails with still images or video images taken by the camera module 143.
  • instant messaging module 141 includes a sequence of characters for inputting an instant message, modifying previously entered characters, Transmitting corresponding instant messages (eg, using Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocols for phone-based instant messaging or using XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and View executable instructions for the received instant message.
  • SMS Short Message Service
  • MMS Multimedia Messaging Service
  • XMPP extensible Markup Language
  • SIMPLE Session Initiation Protocol
  • IMPS Internet Messaging Protocol
  • the transmitted and/or received instant messages may include graphics, photos, audio files, video files, and/or other attachments supported in MMS and/or Enhanced Messaging Service (EMS).
  • EMS Enhanced Messaging Service
  • instant messaging refers to both phone-based messages (eg, messages sent using SMS or MMS) and Internet-based messages (eg, messages transmitted using XMPP, SIMPLE, or IMPS).
  • exercise support module 142 includes executable instructions for creating an exercise (eg, having a time, distance, and/or calorie consumption target); Exercise sensor (sports equipment) communication; receiving exercise sensor data; calibrating sensors for monitoring exercise; selecting and playing music for exercise; and displaying, storing, and transmitting exercise data.
  • an exercise eg, having a time, distance, and/or calorie consumption target
  • Exercise sensor sports equipment
  • camera module 143 includes features for capturing still images or video (including video streams) and storing them in memory 102 (eg, in digital camera film 159), modifying the characteristics of still images or video, or from memory 102 (eg, from digital camera film 159) deletes executable instructions for still images or video.
  • image management module 144 includes means for arranging, modifying (eg, editing), or otherwise manipulating, adding An executable instruction to tag, delete, render (eg, in a digital slide or album), and to store still images and/or video images (including still images and/or video images stored in camera roll 159).
  • browser module 147 includes means for browsing the Internet in accordance with user instructions (including searching, linking to, receiving, Executable instructions for displaying a web page or portion thereof, and attachments and other files linked to the web page.
  • calendar module 148 includes instructions for An executable instruction that creates, displays, modifies, and stores calendars and data associated with the calendar (eg, calendar entries, to-do list, etc.).
  • desktop applet module 149 is a mini-application that can be downloaded and used by a user. (eg, weather desktop applet 147-1, stock desktop applet 149-2, calculator desktop applet 149-3, alarm desktop applet 149-4, and dictionary desktop applet 149-5) or created by the user Micro-apps (for example, user-created desktop applets 149-6).
  • the desktop applet includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheet) file, and a JavaScript file.
  • the desktop applet includes an XML (Extensible Markup Language) file and a JavaScript file (eg, a Yahoo! desktop applet).
  • desktop applet creator module 150 can be used by the user Create a desktop applet (for example, transfer the user-specified portion of a web page to the desktop applet).
  • search module 151 includes means for searching in memory 102 for one or more search criteria (eg, user specified) in accordance with user instructions.
  • search criteria eg, user specified
  • One or more search terms executable instructions for matching text, music, sound, images, video, and/or other files.
  • video and music player module 152 includes user download and playback Executable instructions for recorded music and other sound files stored in one or more file formats (such as MP3 or AAC files), and for displaying, rendering, or otherwise playing back video (eg, on touch screen 112 or Executable instructions on an external display connected via external port 124.
  • device 100 may include the functionality of an MP3 player.
  • note pad module 153 includes executable instructions for creating and managing notes, to-do list, and the like in accordance with user instructions.
  • map module 154 can be used to receive, according to user instructions, Display, modify, and store maps and data associated with the map (eg, driving directions; data for stores and other points of interest at or near specific locations; and other location-based data).
  • map module 154 can be used to receive, according to user instructions, Display, modify, and store maps and data associated with the map (eg, driving directions; data for stores and other points of interest at or near specific locations; and other location-based data).
  • online Video module 155 includes allowing a user to access, browse, receive (eg, stream receive and/or download), play back (eg, on a touch screen or on an external display connected via external port 124), send with a particular online video.
  • receive eg, stream receive and/or download
  • play back eg, on a touch screen or on an external display connected via external port 124
  • sends eg, on a touch screen or on an external display connected via external port 124
  • the instant message module 141 is used instead of the email client module 140 to send a link to a particular online video.
  • audio/audio recorder module 163 includes a user-allowed one or more file formats (such as An MP3 or AAC file) executable instructions that record audio (eg, sound), and executable instructions for rendering or otherwise playing back the recorded audio file.
  • file formats such as An MP3 or AAC file
  • the notification module 165 includes executable instructions for displaying a notification or warning on touch screen 112, such as an incoming message or an incoming call, a calendar event reminder, an application event, and the like.
  • modules and applications corresponds to a set of methods for performing one or more of the functions described above, as well as the methods described in this application (eg, computer implemented methods and other information processing methods described herein). Execute the instruction.
  • modules ie, sets of instructions
  • memory 102 can store a subset of the modules and data structures described above.
  • memory 102 can store additional modules and data structures not described above.
  • device 100 is a device in which the operation of a predefined set of functions on the device is performed exclusively through a touch screen and/or a touchpad.
  • a touch screen and/or a touchpad as the primary input control device for operation of device 100, the number of physical input control devices (such as push buttons, dials, etc.) on device 100 can be reduced.
  • the predefined set of functions that are uniquely executable by the touch screen and/or trackpad include navigation between user interfaces.
  • device 100 is navigated from any user interface displayable on device 100 to a main menu, main menu, or root menu when the touchpad is touched by a user.
  • the touchpad can be referred to as a "menu button.”
  • the menu button can be a physical push button or other physical input control device instead of a touchpad.
  • memory 102 in FIG. 2A or memory 370 (in FIG. 4) includes event classifier 170 (eg, in operating system 126) and corresponding application 136-1 (eg, aforementioned application 137) - any application in -151, 155, 380-390).
  • event classifier 170 eg, in operating system 126
  • application 136-1 eg, aforementioned application 137
  • the event classifier 170 receives the event information and determines the application 136-1 to which the event information is to be passed and the application view 191 of the application 136-1.
  • the event classifier 170 includes an event monitor 171 and an event scheduler module 174.
  • application 136-1 includes an application internal state 192 that indicates a current application view that is displayed on touch-sensitive display 112 when the application is active or executing.
  • the device/global internal state 157 is used by the event classifier 170 to determine which application(s) are currently active, and the application internal state 192 is used by the event classifier 170 to determine that event information is to be passed. Go to the application view 191.
  • the application internal state 192 includes additional information, such as one or more of: recovery information to be used when the application 136-1 resumes execution, indicating that it is being displayed by the application 136-1 of Information or user interface state information ready for information displayed by application 136-1, a status queue for enabling a user to return to a previous state or view of application 136-1, and previous actions taken by the user Repeat/deactivate the queue.
  • the event monitor 171 receives event information from the peripheral device interface 118.
  • the event information includes information about sub-events (eg, user touches on the touch-sensitive display 112 as part of a multi-touch gesture).
  • Peripheral device interface 118 transmits information it receives from I/O subsystem 106 or sensors (such as proximity sensor 166), accelerometer 168, and/or microphone 113 (via audio circuitry 110).
  • the information that peripheral device interface 118 receives from I/O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.
  • event monitor 171 sends a request to peripheral device interface 118 at predetermined intervals.
  • peripheral device interface 118 transmits event information.
  • the peripheral device interface 118 transmits event information only when there is a significant event (eg, an input that is above a predetermined noise threshold is received and/or an input that exceeds a predetermined duration is received).
  • event classifier 170 also includes hit view determination module 172 and/or activity event recognizer determination module 173.
  • the hit view determination module 172 provides a software process for determining where a sub-event has occurred within one or more views.
  • the view consists of controls and other components that the user can see on the display.
  • the application view (of the respective application) in which the touch is detected may correspond to a programmatic level within the programmatic or view hierarchy of the application. For example, the lowest level view in which a touch is detected may be referred to as a hit view, and the set of events identified as being correctly entered may be determined based at least in part on a hit view of the initial touch that begins with the touch based gesture.
  • the hit view determination module 172 receives information related to sub-events of the touch-based gesture. When the application has multiple views organized in a hierarchy, the hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should handle the sub-event. In most cases, the hit view is the lowest level view in which the sub-event (ie, the first sub-event in the sequence of sub-events that formed the event or potential event) is initiated. Once the hit view is identified by the hit view determination module, the hit view typically receives all of the sub-events associated with the same touch or input source for which it was identified as the hit view.
  • the activity event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, the activity event recognizer determination module 173 determines that only the hit view should be picked up. Receive a specific sequence of sub-events. In other embodiments, the activity event recognizer determination module 173 determines that all views including the physical location of the sub-event are actively involved views, and thus determines that all actively involved views should receive a particular sequence of sub-events. In other embodiments, even if the touch sub-event is completely confined to the area associated with a particular view, the higher view in the hierarchy will remain as the active involved view.
  • Event scheduler module 174 dispatches event information to an event recognizer (e.g., event recognizer 180). In an embodiment that includes an activity event recognizer determination module 173, the event scheduler module 174 passes the event information to the event recognizer determined by the activity event recognizer determination module 173. In some embodiments, event scheduler module 174 stores event information in an event queue that is retrieved by respective event receiver module 182.
  • operating system 126 includes an event classifier 170.
  • application 136-1 includes event classifier 170.
  • event classifier 170 is a stand-alone module or is part of another module (such as contact/mobile module 130) stored in memory 102.
  • the application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which includes a touch event for processing a respective view occurring within a user interface of the application. Instructions.
  • Each application view 191 of application 136-1 includes one or more event recognizers 180.
  • the corresponding application view 191 includes a plurality of event recognizers 180.
  • one or more of the event recognizers 180 are part of a stand-alone module, such as a user interface toolkit (not shown) or from which the application 136-1 inherits methods and other features. Higher level objects.
  • the respective event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and/or event data 179 received from the event classifier 170.
  • Event handler 190 can utilize or call data updater 176, object updater 177, or GUI updater 178 to update application internal state 192.
  • one or more of the application views 191 include one or more respective event handlers 190.
  • one or more of data updater 176, object updater 177, and GUI updater 178 are included in respective application views 191.
  • the corresponding event recognizer 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event from the event information.
  • Event recognizer 180 includes an event receiver 182 and an event comparator 184.
  • event recognizer 180 also includes at least one of the following subgroups: metadata 183, and event delivery instructions 188 (which may include sub-event delivery instructions).
  • Event receiver 182 receives event information from event classifier 170.
  • the event information includes information about sub-events, such as touch or touch movement. Based on the sub-event, the event information also includes additional information, such as the location of the sub-event. When a sub-event involves movement of a touch, the event information may also include the rate and direction of the sub-event.
  • the event includes the rotation of the device from one orientation to another (eg, from a portrait orientation to a landscape orientation, and vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as device gesture).
  • Event comparator 184 compares the event information to a predefined event or sub-event definition and determines an event or sub-event based on the comparison, or determines or updates the status of the event or sub-event.
  • event comparator 184 includes an event definition 186.
  • Event definition 186 contains definitions of events (eg, predefined sub-event sequences), such as event 1 (187-1), event 2 (187-2), and others.
  • sub-events in event 187 include, for example, touch start, touch end, touch movement, touch cancellation, and multi-touch.
  • the definition of event 1 (187-1) is a double click on the displayed object.
  • the double tap includes a first touch of a predetermined duration on the displayed object (touch start), a first lift of the predetermined duration (touch end), a second predetermined time duration on the displayed object The second touch (touch start) and the second lift of the predetermined duration (touch end).
  • the definition of event 2 (187-2) is a drag on the displayed object.
  • the drag includes a predetermined duration of touch (or contact) on the displayed object, movement of the touch on the touch-sensitive display 112, and lifting of the touch (touch end).
  • the event also includes information for one or more associated event handlers 190.
  • event definition 187 includes definitions of events for respective user interface objects.
  • event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view in which three user interface objects are displayed on touch display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine among the three user interface objects. Which one is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler associated with the object and sub-event that triggered the hit test.
  • the definition of the respective event 187 also includes a delay action that delays the delivery of the event information until after it has been determined that the sequence of sub-events does or does not correspond to the event type of the event recognizer.
  • the corresponding event recognizer 180 determines that the sub-event string does not match any of the events in the event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event end state, and then ignores the touch-based gesture. Subsequent sub-events. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.
  • the respective event recognizer 180 includes metadata 183 having configurable properties, flags, and/or lists that indicate how the event delivery system should perform sub-event delivery to the event identifiers involved in the activity.
  • the metadata 183 includes configurable attributes, flags indicating how the event recognizers can interact with each other And / or list.
  • metadata 183 includes configurable attributes, tags, and/or lists that indicate whether a sub-event is passed to a level in a view or a programmed hierarchy.
  • the respective event recognizer 180 activates an event handler 190 associated with the event.
  • the respective event recognizer 180 passes event information associated with the event to the event handler 190.
  • the activation event handler 190 is different from the send (and postponed) sub-event to the corresponding hit view.
  • event recognizer 180 throws a flag associated with the identified event, and event handler 190 associated with the flag receives the flag and performs a predefined process.
  • the event delivery instructions 188 include sub-event delivery instructions that pass event information about sub-events without activating an event handler. Instead, the sub-event delivery instruction passes the event information to an event handler associated with the sub-event string or to the active involved view. An event handler associated with a sub-event string or with an active involved view receives event information and performs a predetermined process.
  • data updater 176 creates and updates data used in application 136-1. For example, the data updater 176 updates the phone number used in the contact module 137 or stores the video file used in the video player module 145.
  • object updater 176 creates and updates objects used in application 136-1. For example, object updater 177 creates a new user interface object or updates the location of the user interface object.
  • the GUI updater 178 updates the GUI. For example, GUI updater 178 is ready to display information and send it to graphics module 132 for display on a touch sensitive display.
  • event handler 190 includes or has access to data updater 176, object updater 177, and GUI updater 178.
  • data updater 176, object updater 177, and GUI updater 178 are included in a single module of respective application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.
  • event handling of user touches on touch-sensitive displays is also applicable to other forms of user input that utilizes input devices to operate electronic device 100 (not all of which are initiated on a touch screen), such as coordination.
  • Mouse movement and mouse button press (with or without single or multiple keyboard presses or hold), user movement on the touchpad, flick, drag, scroll, etc., stylus input, device movement, verbal command, detected Eye movements, biometric inputs, and/or any combination thereof, can be used as input corresponding to sub-events that define an event to be identified.
  • FIG. 3 illustrates a portable electronic device 100 having a touch screen 112 in accordance with some embodiments.
  • the touch screen can display one or more graphics within a user interface (UI) 200.
  • UI user interface
  • the user may make a graphic representation by, for example, one or more fingers 202 (not drawn to scale in the drawings) or one or more styluses 203 (not drawn to scale in the drawings). Gestures to select one or more of these graphics.
  • the selection of one or more graphics occurs when the user interrupts contact with the one or more graphics.
  • the gesture may include one or more taps, one or more swipes (from left to right, from right to left, up and/or down) and/or fingers that have been in contact with device 100 ( Toggle from right to left, left to right, up and/or down.
  • unintentional contact with the graphic does not select the graphic. For example, when the gesture corresponding to the selection is a tap, the swipe gesture swiped over the application icon does not select the corresponding application.
  • Device 100 may also include one or more physical buttons, such as a "home screen” or menu button 204.
  • menu button 204 can be used to navigate to any of a set of applications that can run on device 100.
  • the menu button is implemented as a soft key displayed in a GUI on touch screen 112.
  • device 100 includes touch screen 112, menu button 204, push button 206 for device power on and lock device, volume adjustment button(s) 208, user identity module (SIM) card slot 210 The headset jack 212, and the docking/charging external port 124.
  • the push button 206 can be used to power the device by pressing the button and holding the button in a depressed state for a predefined time interval; by pressing the button and before the predefined time interval Release the button to lock the device; and/or unlock the device or initiate an unlocking process.
  • device 100 may also accept voice input for activating or deactivating certain functions via microphone 113.
  • Device 300 need not be portable.
  • device 300 is a laptop, desktop, tablet, multimedia player device, navigation device, educational device (such as a children's learning toy), gaming system, or control device (eg, home or industrial control) Device).
  • Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components.
  • processing unit 310 includes an image signal processor and a dual or multi-core processor.
  • Communication bus 320 may include circuitry (sometimes referred to as a chipset) that interconnects system components and controls communication between system components.
  • Device 300 includes an input/output (I/O) interface 330 having a display 340, which is typically a touch screen display.
  • the I/O interface 330 may also include a keyboard and/or mouse (or other pointing device) 350 and a trackpad 355.
  • Device 300 also includes an optical sensor 164 and an optical sensor controller 158.
  • the memory 370 includes a high speed random access memory such as DRAM, SRAM, DDR RAM or other random access solid state memory device; Loss of memory, such as one or more disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices.
  • memory 370 can include one or more storage devices remotely located from CPU 310.
  • memory 370 stores programs, modules, and data structures similar to the programs, modules, and data structures stored in memory 102 of portable electronic device 100 (FIG. 2A), or a subset thereof.
  • memory 370 can store additional programs, modules, and data structures that are not present in memory 102 of portable electronic device 100.
  • memory 370 of device 300 can store drawing module 380, rendering module 382, word processing module 384, web page creation module 386, disk editing module 388, and/or spreadsheet module 390, while portable electronic device 100 (FIG. 2A)
  • the memory 102 may not store these modules.
  • Each of the above identified components in Figure 4 can be stored in one or more of the aforementioned memory devices.
  • Each of the above identified modules corresponds to a set of instructions for performing the functions described above.
  • the above identified modules or programs (ie, sets of instructions) need not be implemented as separate software programs, procedures or modules, and thus various subsets of these modules may be combined or otherwise rearranged in various embodiments.
  • memory 370 can store a subset of the modules and data structures described above.
  • memory 370 can store additional modules and data structures not described above.
  • UI user interface
  • FIG. 5 illustrates an exemplary user interface for an application menu on the portable electronic device 100 in accordance with some embodiments.
  • a similar user interface can be implemented on device 300.
  • user interface 400 includes the following elements or subgroups or supersets thereof:
  • a signal strength indicator 402 for wireless communication such as cell phone signals and Wi-Fi signals
  • ⁇ phone 138 which may include an indicator 414 of the number of missed calls or voicemail messages;
  • An email client 140 which may include an indicator 410 of the number of unread emails
  • Video and music player 152 also known as iPod (trademark of Apple Inc.) module 152;
  • An online video module 155 also known as the YouTube (trademark of Google Inc.) module 155.
  • finger input eg, single finger contact, single finger tap gesture, single finger swipe gesture
  • these finger inputs are One or more of the ones are replaced by inputs from another input device (eg, stylus input).
  • Embodiments of the user interface ("UI") and associated processes that can be implemented on an electronic device such as device 300 or portable electronic device 100 having a display and a touch-sensitive surface are now turned to.
  • 6A-6C illustrate an exemplary user interface for deleting an object (eg, an application) in accordance with some embodiments.
  • the user interfaces in these figures are used to illustrate the processes and/or functions described below.
  • the object specifically refers to a target pointing object associated with the displayed icon.
  • icon A is an icon of application A displayed on touch screen 112 of the device, that is, an application interface element.
  • application A is the target pointing object associated with icon A.
  • the object can also be a file.
  • the graphical user interface of the application is displayed on the touch screen 112, and the image displayed as a thumbnail at this time can also be regarded as an icon, which can be referred to as a file interface element.
  • the target point of the icon is the image file data associated with this icon (for example, an image in JPG or JEPG format). Therefore, when the user performs an operation on the icon, it is an operation performed on the associated image file data, such as modifying the naming of the icon. Activating the icon also activates its associated image file for display on touch screen 112.
  • an object interface element such as an icon
  • the object interface element can be dragged or moved, and the object associated with it (such as an application, file, etc.) is opened when the finger is raised.
  • the terms “select,” “select,” “move,” “drag,” “touch,” “touch,” and “fast move” are generally described herein with reference to a touch screen display. However, in alternative embodiments, the terms are also intended to include the required user actions with respect to other input devices. For example, in the case of a proximity screen, the user does not need to be in direct contact with the screen in order to select, move or drag object interface elements or other information.
  • the above terms are intended to include that the user only needs to be located near the device in order to perform the desired function.
  • the term "contact” does not imply a direct contact for activating an adjacent device, but a proximity or proximity contact.
  • FIG. 6A illustrates a graphical user interface (GUI) displayed on touch screen 112 of device 100.
  • GUI graphical user interface
  • a plurality of object interface elements are displayed on the graphical user interface, wherein the object interface elements 501, 502, 503 are application icons, that is, application interface elements, and each application icon is associated with an application. .
  • the embodiment of the present invention deletes the object associated with the object interface element by using a specific gesture on the object interface element, thereby greatly improving the intelligent interaction capability between the electronic device and the user, and improving the processing of the electronic device. The efficiency of the transaction.
  • the touch screen 112 can detect a first gesture 505 of the user for the application icon 503, which can be a gesture of selecting an application icon 503, which can be a selected application icon After 503, quickly move your finger and lift it up, and quickly leave the touch screen surface.
  • the electronic device can now detect the gesture speed and gesture direction of the first gesture 505 through the touch screen 112.
  • the central processing unit 120 of the electronic device can determine the gesture speed of the first gesture 505 through the data about the first gesture received by the touch screen 112. Specifically, it is determined that it belongs to the prior art, and details are not described herein again.
  • the central processing unit 120 determines that the gesture speed meets the predetermined condition, the application associated with the application icon 503 is uninstalled.
  • the user may pre-store a threshold of a gesture speed in the memory 102.
  • the central processing unit 120 may determine that the first gesture belongs to a gesture that moves rapidly on the touch screen, that is,
  • the first gesture 505 can be used as an instruction to trigger an application uninstallation.
  • the application associated with the application icon 503 to which the first gesture 505 is applied is unloaded. It can be understood that before the associated application is uninstalled, it can be displayed on the touch screen 112 in the form of a dynamic GUI to indicate to the user that the application is about to be uninstalled. As shown in FIG. 6B, the icon 507 can be an animation. Display, indicating that the application tweet is about to be uninstalled. Of course, you can also use it In a user-perceivable manner, the user is indicated that the application is about to be uninstalled, and the embodiment is not limited herein.
  • the user before executing the uninstall command, the user can be prompted in a user-aware manner to indicate whether the application will be uninstalled or not.
  • the uninstallation operation can be performed after receiving an instruction from the user to confirm the consent.
  • the current graphical user interface can be re-arranged after the application is uninstalled.
  • the electronic device can erase the file associated with the file interface element based on the detected gesture.
  • the touch screen 112 can detect a second gesture of the user for the file icon 504 (ie, the file interface element), which can be a gesture of selecting the file icon 504, which can be After selecting the file icon 504, quickly move the finger and lift it up, quickly leaving the touch screen surface.
  • the electronic device can now detect the gesture speed of the second gesture through the touch screen 112.
  • the central processing unit 120 of the electronic device can determine the gesture speed of the second gesture through the data about the second gesture received by the touch screen 112. Specifically, it is determined that it belongs to the prior art, and details are not described herein again.
  • the central processing unit 120 determines that the gesture speed satisfies the predetermined condition, the file associated with the file icon 504 is erased.
  • the user may pre-store a threshold of a gesture speed in the memory 102. When it is determined that the detected gesture speed is greater than or equal to the threshold, the central processing unit 120 may determine that the second gesture belongs to a gesture that moves quickly on the touch screen. That is, the second gesture can be used as an instruction to trigger file erasure.
  • the file associated with the file icon 504 to which the second gesture is applied is erased.
  • the associated file data may be displayed on the touch screen 112 in the form of a dynamic GUI to indicate to the user that the file is about to be erased before the associated file data is erased. It is of course possible to indicate to the user that the file is to be erased in a manner that is sensible to other users. This embodiment is not limited herein.
  • the object interface element may be moved according to the detected gesture (eg, the first gesture or the second gesture described above) (eg, The location of icon 503, icon 504).
  • the touch screen 112 can detect the gesture direction in addition to detecting the gesture speed, that is, detecting which direction the user's finger is moving toward the touch screen 112. Further, in the embodiment, a condition may be added: the central processing unit 120 selects an application selected for the first gesture when the gesture speed is greater than or equal to a predetermined threshold, and the gesture direction is to the right of the touch screen 112. Unload or erase the file selected by the second gesture. As shown in FIG. 6A, icon 506 represents the direction of gesture 505.
  • the central processing unit 120 may further determine whether the object corresponding to the icon is erasable: The object is erasable, then detecting an object interface element (ie, an icon) on the touch-sensitive surface The gesture of 503 or icon 504); if it is not erasable, the user is prompted.
  • the gestures described above may also operate for two or more object interface elements, ie, the gestures detected by touch screen 112 are selected for two or more icons.
  • the gestures detected by touch screen 112 are selected for two or more icons.
  • the following embodiment is illustrated with two object interface elements as an example.
  • the object interface element selected by the above gesture may specifically be a first application interface element and a second application interface element, where the first application interface element is associated with the first application. a program, the second application interface element associated with the second application.
  • the first application interface element (icon 502) is associated with an image management application
  • the second application interface element (icon 503) is associated with a Twitter application.
  • the touch screen 112 detects a gesture 605 that begins on the icon 503 and then passes the icon 502 along the gesture direction shown by the icon 606, and then the finger quickly lifts off the touch screen 112.
  • the central processing unit 120 of the electronic device receives the data of the gesture 605 through the touch screen 112, and the gesture speed of the gesture 605 can be determined.
  • the central processing unit 120 determines that the gesture speed meets a predetermined condition, for example, determining that the gesture speed is greater than or equal to a predetermined threshold, the image management application and the second application associated with the first application interface element (icon 502) The tweet application associated with the interface element (icon 503) is unloaded.
  • the associated application may be displayed on the touch screen 112 in the form of a dynamic GUI to indicate to the user that the application is about to be uninstalled before the associated application is uninstalled. It is of course possible to indicate to the user that the application is about to be uninstalled in a manner that is sensible to other users. This embodiment is not limited herein.
  • the object interface element selected by the gesture may specifically be a first file interface element and a second file interface element.
  • the first file interface element is associated with first file data
  • the second file interface element is associated with second file data.
  • the user activates the open gallery graphical user interface upon selection of the icon 502 in FIG. 6A.
  • the photo or video in the gallery is displayed in the form of a thumbnail icon.
  • the icon 601 is associated with the image file data of the name 4
  • the icon 602 is associated with the video file data of the name 5
  • the specific format of the picture or video is not limited here.
  • the touch screen 112 detects a gesture 607 that begins on the icon 601 and then passes the icon 602 along the gesture direction shown by the icon 606, and then the finger quickly lifts off the touch screen 112.
  • the gesture 607 is for the first file interface element (icon 601) and the second file interface element (icon 602).
  • the central processing unit 120 of the electronic device receives the data of the gesture 607 through the touch screen 112, and the gesture speed of the gesture 607 can be determined. When the central processing unit 120 determines that the gesture speed meets a predetermined condition, for example, it is determined that the gesture speed is large.
  • the image file associated with the first file interface element (icon 601) and the video file associated with the second file interface element (icon 602) are erased.
  • the associated file may be displayed on the touch screen 112 in the form of a dynamic GUI to indicate to the user that the image file and video file are about to be erased before the associated file is erased. It is of course possible to indicate to the user that the file is about to be erased in a manner that is sensible to other users. This embodiment is not limited herein.
  • the object interface element selected by the above gesture may specifically be a third file interface element and a fourth application interface element.
  • the third file interface element corresponds to the third file data
  • the fourth application interface element corresponds to the fourth application.
  • the central processing unit 120 determines whether the gesture speed is satisfied. a predetermined condition, when the predetermined condition is satisfied, the third file data is erased and the fourth application is uninstalled.
  • the touch screen 112 can detect the gesture direction in addition to detecting the gesture speed, that is, detecting which direction the user's finger is moving toward the touch screen 112. Further, in the embodiment, a condition may be added: the central processing unit 120 selects an application selected for the first gesture when the gesture speed is greater than or equal to a predetermined threshold, and the gesture direction is to the right of the touch screen 112. Unload or erase the file selected by the second gesture. For example, icon 608 in Figure 7B is used to indicate the gesture direction of gesture 607.
  • the user's gestures are flexible and can be click, double click, circle, draw line, single finger touch, or multi finger touch, and so on.
  • the selection of a particular gesture is flexible as long as substantially the same effect is achieved.
  • the position or area of the user's gesture acting on the touch-sensitive surface is flexible, and may be the area of an application interface element displayed on the display screen or a nearby area, and the display does not display the blank of the application interface element. Area, the display shows the area of a function setting, and so on.
  • the specific location or area of the gesture acting on the touch-sensitive surface can be flexibly set as long as substantially the same effect can be achieved.
  • a computer readable storage medium storing one or more programs, the instructions including instructions, when included in a portable electronic device including a display and a plurality of applications, can be provided The device, when executed, causes the portable electronic device to perform an event, wherein the display includes a touch-sensitive surface and a display screen.
  • the above computer readable storage medium can be used to perform the events in the above embodiments.
  • a graphical user interface on an electronic device including a display, a memory, a plurality of applications, and one or more programs for executing in the memory
  • the display includes a touch-sensitive surface and a display screen, the graphical user community
  • the facets include the graphical user interface introduced and displayed in the above embodiments.
  • FIG. 8 illustrates a functional block diagram of an electronic device 700 configured in accordance with the principles of the present invention described above.
  • Functional blocks of a device may be implemented by hardware, software, or a combination of hardware and software to perform the principles of the invention.
  • FIG. 8 can be combined or separated into sub-blocks to implement the principles of the invention described above. Accordingly, the description herein may support any possible combination or separation or further definition of the functional blocks described herein.
  • the electronic device 700 includes a touch-sensitive display unit 701 configured to display a screen interface and configured to receive gestures, and a processing unit 702 coupled to the touch Sensitive display unit 701.
  • the touch-sensitive display unit 701 receives a gesture of the user for the object interface element, and the gesture may include a gesture speed and a gesture direction;
  • the processing unit 702 acquires a gesture of the touch-sensitive display unit 701, and determines whether the gesture speed is greater than or equal to The predetermined threshold, if the processing unit 702 determines that the gesture speed is greater than or equal to a predetermined threshold, the processing unit 702 deletes the object associated with the object interface element.
  • the meanings of terms such as objects, object interface elements, and the like in this embodiment are referred to the above embodiments.
  • the electronic device 700 can be used to implement the technical solutions in the above embodiments.
  • the processing unit 702 may specifically include a touch screen receiving unit 7021, a motion interpretation unit 7022, an event distribution unit 7023, a home screen receiving unit 7024, an event determining unit 7025, an application unloading unit 7026, and a file erasing unit 7027. .
  • the functions of the electronic device 700 are described below, and those skilled in the art can understand the following functions and the electronic devices, systems, devices, methods, graphical user interfaces, information processing devices (eg, processor chips or processors) described herein.
  • the various embodiments of the computer-readable storage medium are echoed, and the various combinations and/or combinations of the various aspects are combinations that can be directly and unambiguously contemplated by those of ordinary skill in the art after understanding this document.
  • the touch screen receiving unit 7021 the touch sensitive display receives a signal of the user gesture touch screen operation, and the operation may include pressing, moving, lifting, and the like.
  • the action interpretation unit 7022 is configured to interpret the original actions such as pressing, moving, lifting, etc. as events such as clicking, long pressing, fast moving, and the like;
  • the event distribution unit 7023 the event in the system action interpretation unit is delivered to the upper layer application (such as the home screen receiving unit 7024);
  • the main screen receiving unit 7024 the main screen receives the above event, and sends it to the following processing unit corresponding to the event, and executes a process corresponding to the event;
  • the event judging unit 7025 determining whether the current event satisfies a predetermined condition, for example, whether the gesture speed of the gesture is greater than or equal to a predetermined threshold, and starting the corresponding processing unit after the judgment is completed;
  • the application unloading unit 7026 according to the event determining unit 7025, determining that the gesture speed of the gesture is greater than or equal to a predetermined threshold, uninstalling the application clicked by the gesture;
  • the file erasing unit 7027 according to the event determining unit 7025, determining that the gesture speed of the gesture is greater than or equal to a predetermined threshold, erasing the file clicked by the gesture.
  • the file may specifically be a picture, a video in the image management application, or a contact in the contact application.
  • event monitor 171 in event sorter 170 detects contact on touch-sensitive display 112, and event scheduler module 174 passes the event information to application 136-1.
  • the corresponding event recognizer 180 of the application 136-1 compares the event information with the corresponding event definition 186 and determines whether the first contact at the first location on the touch-sensitive surface corresponds to a predefined event or sub-event, such as The selection of objects on the user interface.
  • Event detector 180 activates event handler 190 associated with detecting the event or sub-event when a corresponding predefined event or sub-event is detected.
  • Event handler 190 can utilize or call data updater 176 or object updater 177 to update application internal state 192.
  • event handler 190 accesses corresponding GUI updater 178 to update the content displayed by the application.
  • GUI updater 178 it will be apparent to those skilled in the art how other processes may be implemented based on the components illustrated in Figures 2A-2B.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An electronic device and method for deleting an object, relating to the field of data processing. The method comprises: displaying at least one object interface element on a display screen, the at least one object interface element being associated with at least one object; detecting a gesture for the at least one object interface element on a touch-sensitive surface, the gesture comprising gesture speed information and gesture direction information; and when the gesture speed and the gesture direction satisfy pre-determined conditions, deleting the at least one object. The solution enables the interaction between an electronic device and a user to be more fluent, and improves the efficiency of processing transactions by an electronic device.

Description

用于删除对象的电子设备和方法Electronic device and method for deleting an object
本申请要求于2015年12月3日提交中国专利局、申请号为201510883748.5、发明名称为“用于删除对象的电子设备和方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。The present application claims priority to Chinese Patent Application No. 201510883748.5, entitled "Electronic Apparatus and Method for Deleting Objects", filed on Dec. 3, 2015, the entire contents of which is incorporated herein by reference. In the application.
技术领域Technical field
本文涉及具有触敏表面(touch-sensitive surface)的电子设备,包括但不限于用于移动应用接口元素(application interface element)的具有触敏表面的电子设备和方法。This document relates to electronic devices having touch-sensitive surfaces, including but not limited to electronic devices and methods having touch-sensitive surfaces for mobile application interface elements.
背景技术Background technique
近年来,对具有触敏表面的便携式电子设备的使用显著地增加。这样的便携式电子设备已经极大地增加了应用程序或“app”的数量。例如,图像和视频相机应用程序为用户提供了内容生成机会,诸如拍照或记录视频。便笺应用程序允许用户阅读或写下便签。应用程序在便携式电子设备的图形用户界面上会对应一个应用接口元素。这样的应用接口元素有时也被称为:应用程序图标(app icon),应用程序快捷方式(app shortcut),应用程序按钮(app button),应用工具(app widget)等。如图1所示,现有技术中对在电子设备中的应用程序或文件进行删除的方法是:首先用户长按将要删除的应用程序或文件的图标,电子设备显示垃圾桶图标,用户的手指继续拖动图标直到覆盖垃圾桶图标,然后放开手指,电子设备弹出对话框提示用户是否删除应用程序或文件,并由用户进行手动确认。由此可见,上述删除应用程序的方式非常复杂而且非常耗时,严重降低了电子设备与用户的智能交互能力。 In recent years, the use of portable electronic devices with touch-sensitive surfaces has increased dramatically. Such portable electronic devices have greatly increased the number of applications or "apps". For example, image and video camera applications provide users with content generation opportunities, such as taking photos or recording videos. The Notes application allows users to read or write notes. The application corresponds to an application interface element on the graphical user interface of the portable electronic device. Such application interface elements are sometimes referred to as: app icons, app shortcuts, app buttons, app widgets, and the like. As shown in FIG. 1 , in the prior art, the method for deleting an application or a file in an electronic device is: first, the user presses an icon of an application or a file to be deleted, and the electronic device displays a trash can icon, the user's finger. Continue dragging the icon until the trash can icon is overwritten, then release your finger, and the electronic device pops up a dialog box prompting the user to delete the application or file and manually confirm it by the user. It can be seen that the above method of deleting an application is very complicated and time consuming, which seriously reduces the intelligent interaction ability between the electronic device and the user.
发明内容Summary of the invention
因此,需要有电子设备具有更快、更高效的方法和界面来与用户进行交互,提高电子设备的事务处理能力。这样的方法和界面可以补充或替代传统的管理应用接口元素的方法。这样的方法和界面可以更快速、更智能地响应用户的个性需求,帮助用户使用更少的时间来达到基本相同的管理应用接口元素的效果,并且生成了一种更高效的人机界面。对于电池驱动的设备,这样的方法和界面能节省电力,并且能增加电池充电之间的时间。Therefore, there is a need for electronic devices with faster, more efficient methods and interfaces to interact with users and improve the transaction capabilities of electronic devices. Such methods and interfaces can complement or replace traditional methods of managing application interface elements. Such methods and interfaces can respond to user's individual needs more quickly and intelligently, helping users to achieve substantially the same management application interface elements in less time, and generate a more efficient human-machine interface. For battery powered devices, such methods and interfaces can save power and increase the time between battery charges.
本文的一些实施例通过所公开的设备提供了上述的方法和用户界面。在一些实施例中,设备是台式计算机。在一些实施例中,设备是便携式的(例如,笔记本电脑、平板电脑、或手持设备,或可穿戴设备)。在一些实施例中,设备具有触控板。在一些实施例中,设备具有触敏显示器(也被称为“触摸屏”、“触摸屏显示器”或“具有触敏表面的显示器”)。在一些实施例中,设备具有图形用户界面(GUI)、一个或多个处理器、存储器以及存储在存储器中用于执行多个功能的一个或多个模块、程序或指令集。在一些实施例中,用户主要通过触敏表面上的手指接触和/或手势来与GUI交互。在一些实施例中,这些功能可以包括图像编辑、画图、呈现、文字处理、网页创建、盘编辑、电子表格制作、玩游戏、接打电话、视频会议、收发电子邮件、即时消息通信、锻炼支持、数字摄影、数字视频记录、网络浏览、数字音乐播放、和/或数字视频播放。用于执行这些功能的可执行指令可被包括在被配置用于由一个或多个处理器执行的非暂态计算机可读存储介质或其他计算机程序产品中。Some embodiments herein provide the methods and user interfaces described above through the disclosed apparatus. In some embodiments, the device is a desktop computer. In some embodiments, the device is portable (eg, a laptop, tablet, or handheld device, or a wearable device). In some embodiments, the device has a trackpad. In some embodiments, the device has a touch sensitive display (also referred to as a "touch screen", a "touch screen display" or a "display with a touch-sensitive surface"). In some embodiments, a device has a graphical user interface (GUI), one or more processors, memory, and one or more modules, programs, or sets of instructions stored in memory for performing a plurality of functions. In some embodiments, the user interacts with the GUI primarily through finger contact and/or gestures on the touch-sensitive surface. In some embodiments, these functions may include image editing, drawing, rendering, word processing, web page creation, disk editing, spreadsheet creation, playing games, making calls, video conferencing, emailing, instant messaging, exercise support. , digital photography, digital video recording, web browsing, digital music playback, and/or digital video playback. Executable instructions for performing these functions can be included in a non-transitory computer readable storage medium or other computer program product configured for execution by one or more processors.
第一方面,本发明实施例提供了一种便携式电子设备。设备包括:显示器,其中,显示器包括触敏表面和显示屏;一个或多个处理器;存储器;多个应用程序;以及一个或多个程序。这一个或多个程序被存储在存储器中并被配置为被一个或多个处理器执行。这一个或多个程序包括指令。指令用于:在所述显示屏显示至少一个对象接口元素,所述至少一个对象接口元素关联至少一个对象;在所述触敏表面检测到针对所述至少一个对象接口元素的手势,所述手势包括手势速度和手势方向;当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除。这样可以更快速、更智能地响应用户的个性需求,减少了用户的手动操作,极大提高电子设备处理事务的效率,也节省了电力。In a first aspect, an embodiment of the present invention provides a portable electronic device. The device includes a display, wherein the display includes a touch-sensitive surface and a display screen; one or more processors; a memory; a plurality of applications; and one or more programs. The one or more programs are stored in memory and configured to be executed by one or more processors. The one or more programs include instructions. The instructions are for displaying at least one object interface element on the display screen, the at least one object interface element associating at least one object; detecting a gesture for the at least one object interface element at the touch-sensitive surface, the gesture The gesture speed and the gesture direction are included; when the gesture speed and the gesture direction satisfy a predetermined condition, the at least one object is deleted. This can respond to the user's individual needs more quickly and intelligently, reducing the manual operation of the user, greatly improving the efficiency of processing the electronic device, and saving power.
结合第一方面,在第一方面的第一种可能的实现方式中,所述对象接口元素具体包括:应用接口元素或文件接口元素,所述应用接口元素关联应用程序,所述文件接口元素关联文件数据。 With reference to the first aspect, in a first possible implementation manner of the first aspect, the object interface element specifically includes: an application interface element or a file interface element, the application interface element is associated with an application, and the file interface element is associated with File data.
结合第一方面的第一种实现方式,在第一方面的第二种可能的实现方式中,所述预定条件具体包括:所述手势速度大于或等于预定阈值,并且,所述手势方向信息是向所述显示屏的右侧。With reference to the first implementation manner of the first aspect, in a second possible implementation manner of the first aspect, the predetermined condition includes: the gesture speed is greater than or equal to a predetermined threshold, and the gesture direction information is To the right of the display.
结合第一方面的第二种实现方式,在第一方面的第三种可能的实现方式中,当所述手势速度信息小于所述预定阈值时,根据检测到的所述手势,移动所述至少一个对象接口元素。With reference to the second implementation manner of the first aspect, in a third possible implementation manner of the first aspect, when the gesture speed information is less than the predetermined threshold, the at least one of the gestures is moved according to the detected gesture An object interface element.
结合第一方面,在第一方面的第四种可能的实现方式中,在所述触敏表面检测到针对所述至少一个对象接口元素的手势之前,所述方法包括:判断所述至少一个对象是否可删除:如果所述至少一个对象是可删除的,则在所述触敏表面检测针对所述至少一个对象接口元素的手势;如果所述至少一个对象是不可删除的,则提示用户。In conjunction with the first aspect, in a fourth possible implementation of the first aspect, before the touch-sensitive surface detects a gesture for the at least one object interface element, the method includes: determining the at least one object Whether to delete: if the at least one object is erasable, detecting a gesture for the at least one object interface element on the touch-sensitive surface; prompting the user if the at least one object is not undeletable.
结合第一方面或第一方面的第四种实现方式,在第一方面的第五种可能的实现方式中,所述至少一个对象接口元素具体为第一应用接口元素和第二应用接口元素,所述第一应用接口元素关联第一应用程序,所述第二应用接口元素关联第二应用程序;其中,所述在所述触敏表面检测到针对所述至少一个对象接口元素的手势,当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除,具体为:在所述触敏表面检测到针对所述第一应用接口元素和所述第二应用接口元素的手势;当所述手势速度和手势方向满足预定条件时,对所述第一应用程序和所述第二应用程序进行卸载。With reference to the first aspect, or the fourth implementation manner of the first aspect, in the fifth possible implementation manner of the first aspect, the at least one object interface element is specifically a first application interface element and a second application interface element, The first application interface element is associated with a first application, the second application interface element is associated with a second application; wherein the gesture for the at least one object interface element is detected at the touch-sensitive surface Deleting the at least one object when the gesture speed and the gesture direction satisfy a predetermined condition, specifically: detecting a gesture for the first application interface element and the second application interface element on the touch-sensitive surface When the gesture speed and the gesture direction satisfy a predetermined condition, the first application and the second application are uninstalled.
结合第一方面或第一方面的第四种实现方式,在第一方面的第六种可能的实现方式中,所述至少一个对象接口元素具体为第一文件接口元素和第二文件接口元素,所述第一文件接口元素关联第一文件数据,所述第二文件接口元素关联第二文件数据;其中,所述在所述触敏表面检测到针对所述至少一个对象接口元素的手势,当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除,具体为:在所述触敏表面检测到针对所述第一文件接口元素和所述第二文件接口元素的手势;当所述手势速度和手势方向满足预定条件时,对所述第一文件数据和所述第二文件数据进行擦除。With reference to the first aspect, or the fourth implementation manner of the first aspect, in the sixth possible implementation manner of the first aspect, the at least one object interface element is specifically a first file interface element and a second file interface element, The first file interface element is associated with first file data, and the second file interface element is associated with second file data; wherein the gesture for the at least one object interface element is detected on the touch-sensitive surface Deleting the at least one object when the gesture speed and the gesture direction satisfy a predetermined condition, specifically: detecting a gesture for the first file interface element and the second file interface element on the touch-sensitive surface And erasing the first file data and the second file data when the gesture speed and the gesture direction satisfy a predetermined condition.
结合第一方面或第一方面的第四种实现方式,在第一方面的第七种可能的实现方式中,所述至少一个对象接口元素具体为第三文件接口元素和第四应用接口元素,所述第三文件接口元素关联第三文件数据,所述第四应用接口元素关联第四应用程序;其中,所述在所述触敏表面检测到针对所述至少一个对象接口元素的手势,当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除,具体为:在所述触敏表面检测到针对所述第三文件接口元素和所述第四应用接口元素的手势;当所述手势速度和手势方向满足 预定条件时,对所述第三文件数据进行擦除和对所述第四应用程序进行卸载。With reference to the first aspect, or the fourth implementation manner of the first aspect, in the seventh possible implementation manner of the first aspect, the at least one object interface element is specifically a third file interface element and a fourth application interface element, The third file interface element is associated with third file data, the fourth application interface element is associated with a fourth application; wherein the gesture for the at least one object interface element is detected on the touch-sensitive surface, when Deleting the at least one object when the gesture speed and the gesture direction satisfy a predetermined condition, specifically: detecting a gesture for the third file interface element and the fourth application interface element on the touch-sensitive surface When the gesture speed and gesture direction are satisfied When the condition is predetermined, the third file data is erased and the fourth application is unloaded.
第二方面,本实施例提供一种删除对象的方法,用于包括显示器和多个应用程序的便携式电子设备,其中,所述显示器包括触敏表面和显示屏,所述方法包括:在所述显示屏显示至少一个对象接口元素,所述至少一个对象接口元素关联至少一个对象;在所述触敏表面检测到针对所述至少一个对象接口元素的手势,所述手势包括手势速度信息和手势方向信息;当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除。In a second aspect, the present embodiment provides a method of deleting an object for a portable electronic device including a display and a plurality of applications, wherein the display includes a touch-sensitive surface and a display screen, the method comprising: The display screen displays at least one object interface element associated with the at least one object; a gesture for the at least one object interface element is detected at the touch-sensitive surface, the gesture including gesture speed information and gesture direction Information; deleting the at least one object when the gesture speed and the gesture direction satisfy a predetermined condition.
结合第二方面,在第二方面的第一种可能的实施例中,所述对象接口元素具体包括:应用接口元素或文件接口元素,所述应用接口元素关联应用程序,所述文件接口元素关联文件数据。With reference to the second aspect, in a first possible embodiment of the second aspect, the object interface element specifically includes: an application interface element or a file interface element, the application interface element is associated with an application, and the file interface element is associated with File data.
结合第二方面的第一种实施例,在第二方面的第二种可能的实施例中,所述预定条件具体包括:所述手势速度大于或等于预定阈值,并且,所述手势方向信息是向所述显示屏的右侧。With reference to the first embodiment of the second aspect, in a second possible embodiment of the second aspect, the predetermined condition specifically includes: the gesture speed is greater than or equal to a predetermined threshold, and the gesture direction information is To the right of the display.
结合第二方面的第二种实施例,在第二方面的第三种可能的实施例中,当所述手势速度信息小于所述预定阈值时,根据检测到的所述手势,移动所述至少一个对象接口元素。With reference to the second embodiment of the second aspect, in a third possible embodiment of the second aspect, when the gesture speed information is less than the predetermined threshold, moving the at least according to the detected gesture An object interface element.
结合第二方面或第二方面的第二种实施例,在第二方面的第四种可能的实施例中,在所述触敏表面检测到针对所述至少一个对象接口元素的手势之前,所述方法包括:判断所述至少一个对象是否可删除:如果所述至少一个对象是可删除的,则在所述触敏表面检测针对所述至少一个对象接口元素的手势;如果所述至少一个对象是不可删除的,则提示用户。In conjunction with the second aspect or the second embodiment of the second aspect, in a fourth possible embodiment of the second aspect, before the touch sensitive surface detects a gesture for the at least one object interface element, The method includes: determining whether the at least one object is removable: if the at least one object is deletable, detecting a gesture for the at least one object interface element at the touch-sensitive surface; if the at least one object If it is not removable, the user is prompted.
结合第二方面或第二方面的第二种实施例,在第二方面的第五种可能的实施例中,所述至少一个对象接口元素具体为第一应用接口元素和第二应用接口元素,所述第一应用接口元素关联第一应用程序,所述第二应用接口元素关联第二应用程序;其中,所述在所述触敏表面检测到针对所述至少一个对象接口元素的手势,当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除,具体为:在所述触敏表面检测到针对所述第一应用接口元素和所述第二应用接口元素的手势;当所述手势速度和手势方向满足预定条件时,对所述第一应用程序和所述第二应用程序进行卸载。With reference to the second aspect or the second embodiment of the second aspect, in a fifth possible embodiment of the second aspect, the at least one object interface element is specifically a first application interface element and a second application interface element, The first application interface element is associated with a first application, the second application interface element is associated with a second application; wherein the gesture for the at least one object interface element is detected at the touch-sensitive surface Deleting the at least one object when the gesture speed and the gesture direction satisfy a predetermined condition, specifically: detecting a gesture for the first application interface element and the second application interface element on the touch-sensitive surface When the gesture speed and the gesture direction satisfy a predetermined condition, the first application and the second application are uninstalled.
结合第二方面或第二方面的第二种实施例,在第二方面的第六种可能的实施例中,所述至少一个对象接口元素具体为第一文件接口元素和第二文件接口元素,所述第一文件接口元素关联第一文件数据,所述第二文件接口元素关联第二文件数据;其中,所述在所述触敏表面检测到针对所述至少一个对象接口元素的手势,当所述手势速度和手势方向满足 预定条件时,对所述至少一个对象进行删除,具体为:在所述触敏表面检测到针对所述第一文件接口元素和所述第二文件接口元素的手势;当所述手势速度和手势方向满足预定条件时,对所述第一文件数据和所述第二文件数据进行擦除。With reference to the second aspect or the second embodiment of the second aspect, in a sixth possible embodiment of the second aspect, the at least one object interface element is specifically a first file interface element and a second file interface element, The first file interface element is associated with first file data, and the second file interface element is associated with second file data; wherein the gesture for the at least one object interface element is detected on the touch-sensitive surface The gesture speed and gesture direction are satisfied Deleting the at least one object when a condition is predetermined, specifically: detecting a gesture for the first file interface element and the second file interface element on the touch-sensitive surface; when the gesture speed and gesture When the direction satisfies the predetermined condition, the first file data and the second file data are erased.
结合第二方面或第二方面的第二种实施例,在第二方面的第七种可能的实施例中,所述至少一个对象接口元素具体为第三文件接口元素和第四应用接口元素,所述第三文件接口元素关联第三文件数据,所述第四应用接口元素关联第四应用程序;其中,所述在所述触敏表面检测到针对所述至少一个对象接口元素的手势,当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除,具体为:在所述触敏表面检测到针对所述第三文件接口元素和所述第四应用接口元素的手势;当所述手势速度和手势方向满足预定条件时,对所述第三文件数据进行擦除和对所述第四应用程序进行卸载。With reference to the second aspect or the second embodiment of the second aspect, in a seventh possible embodiment of the second aspect, the at least one object interface element is specifically a third file interface element and a fourth application interface element, The third file interface element is associated with third file data, the fourth application interface element is associated with a fourth application; wherein the gesture for the at least one object interface element is detected on the touch-sensitive surface, when Deleting the at least one object when the gesture speed and the gesture direction satisfy a predetermined condition, specifically: detecting a gesture for the third file interface element and the fourth application interface element on the touch-sensitive surface And erasing the third file data and unloading the fourth application when the gesture speed and the gesture direction satisfy a predetermined condition.
第三方面,本发明实施例提供了一种电子设备。所述电子设备具体包括:触敏显示器单元,用于检测用户针对对象接口元素的手势,所述手势包括手势速度和手势方向,所述对象接口元素包括应用接口元素和文件接口元素;处理单元,用于获取所述触敏显示器单元的手势,并判断所述手势是否满足预定条件:如果所述处理单元判断出手势满足预定条件,则删除与上述对象接口元素关联的对象。In a third aspect, an embodiment of the present invention provides an electronic device. The electronic device specifically includes: a touch-sensitive display unit, configured to detect a gesture of a user for an object interface element, the gesture includes a gesture speed and a gesture direction, the object interface element includes an application interface element and a file interface element; and a processing unit, And a gesture for acquiring the touch-sensitive display unit, and determining whether the gesture satisfies a predetermined condition: if the processing unit determines that the gesture satisfies a predetermined condition, deleting an object associated with the object interface element.
结合第三方面,在第三方面的第一种可能的实施例中,所述预定条件具体包括:所述手势速度大于或等于预定阈值,并且,所述手势方向信息是向所述显示屏的右侧。With reference to the third aspect, in a first possible embodiment of the third aspect, the predetermined condition specifically includes: the gesture speed is greater than or equal to a predetermined threshold, and the gesture direction information is to the display screen Right.
结合第三方面的第一种实施例,在第三方面的第二种可能的实施例中,在所述触敏显示器单元检测到针对对象接口元素的手势之前,所述处理单元还用于:判断所述对象是否可删除:如果所述对象是可删除的,则所述触敏显示器单元检测针对对象接口元素的手势;如果所述对象是不可删除的,则提示用户。In conjunction with the first embodiment of the third aspect, in a second possible embodiment of the third aspect, before the touch sensitive display unit detects a gesture for the object interface element, the processing unit is further configured to: Determining whether the object is erasable: if the object is removable, the touch-sensitive display unit detects a gesture for the object interface element; if the object is non-deletable, prompts the user.
基于上述技术方案,电子设备可以给用户提供更友好的方法和用户界面,实现卸载特定应用程序或者擦除特定文件的功能。同时,这样也帮助用户使用更少的时间来达到基本相同的管理应用接口元素的效果,并且生成了一种更高效的人机界面。对于电池驱动的设备,这样的方法和界面能节省电力,并且能增加电池充电之间的时间。对于电池驱动的设备,这样的方法和界面能节省电力,并且能增加电池充电之间的时间。Based on the above technical solution, the electronic device can provide a more friendly method and user interface for the user, and implement the function of uninstalling a specific application or erasing a specific file. At the same time, this also helps users use less time to achieve the same effect of managing application interface elements and generate a more efficient human-machine interface. For battery powered devices, such methods and interfaces can save power and increase the time between battery charges. For battery powered devices, such methods and interfaces can save power and increase the time between battery charges.
附图说明DRAWINGS
为了更好地理解本发明的前述实施例以及本发明的附加实施例,应该结合以下附图 参考下面的实施例的说明,在附图中,相同的附图标号在所有附图中指示相应的部件。In order to better understand the foregoing embodiments of the present invention and additional embodiments of the present invention, the following drawings should be combined With reference to the following description of the embodiments, in the drawings, the
图1是示出现有技术中如何删除应用程序的图形用户界面。FIG. 1 is a graphical user interface showing how to delete an application in the prior art.
图2A是示出根据一些实施例的具有触敏显示器的便携式电子设备的框图。2A is a block diagram showing a portable electronic device with a touch-sensitive display, in accordance with some embodiments.
图2B是示出根据一些实施例的用于事件处理的示例性部件的框图。2B is a block diagram showing exemplary components for event processing in accordance with some embodiments.
图3示出了根据一些实施例的具有触摸屏的便携式电子设备。FIG. 3 illustrates a portable electronic device with a touch screen in accordance with some embodiments.
图4是根据一些实施例的具有显示器和触敏表面的示例性电子设备的框图。4 is a block diagram of an exemplary electronic device having a display and a touch-sensitive surface, in accordance with some embodiments.
图5示出了根据一些实施例的在便携式电子设备上用于应用程序菜单的一种示例性图形用户界面。FIG. 5 illustrates an exemplary graphical user interface for an application menu on a portable electronic device in accordance with some embodiments.
图6A-6C示出了根据一些实施例的用于卸载应用接口元素的示例性图形用户界面。6A-6C illustrate an exemplary graphical user interface for uninstalling application interface elements in accordance with some embodiments.
图7A、7B示出根据一些实施例的删除多个对象接口元素的示例性图形用户界面。7A, 7B illustrate an exemplary graphical user interface for deleting multiple object interface elements, in accordance with some embodiments.
图8示出根据一些实施例的电子设备的功能框图。FIG. 8 illustrates a functional block diagram of an electronic device in accordance with some embodiments.
具体实施方式detailed description
以上所现在将详细地参考实施例,这些实施例的示例在附图中被示出。在下面的详细描述中给出了许多具体细节,以便提供对本发明的充分理解。但是,对本领域技术人员将显而易见的是本发明可以在没有这些具体细节的情况下被实践。在其他情况下,没有详细地描述众所周知的方法、过程、部件、电路、和网络,从而不会不必要地使实施例的方面晦涩难懂。The embodiments will now be referred to in detail above, examples of which are illustrated in the accompanying drawings. Numerous specific details are set forth in the following detailed description in the claims. However, it will be apparent to those skilled in the art that the invention may be practiced without the specific details. In other instances, well-known methods, procedures, components, circuits, and networks are not described in detail so as not to unnecessarily obscure the aspects of the embodiments.
在本发明实施例中使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本发明。在本发明实施例和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。The terms used in the embodiments of the present invention are for the purpose of describing particular embodiments only and are not intended to limit the invention. The singular forms "a", "the" and "the"
还将理解的是,虽然术语“第一”、“第二”等可能在本文中用来描述各种元素,但是这些元素不应当被这些术语限定。这些术语只是用来将一个元素与另一元素区分开。例如,第一应用接口元素可以被命名为第二应用接口元素,并且类似地,第二应用接口元素可以被命名为第一应用接口元素,而不背离本发明的范围。It will also be understood that although the terms "first", "second", etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, the first application interface element can be named a second application interface element, and similarly, the second application interface element can be named the first application interface element without departing from the scope of the invention.
还将理解的是,本文中所使用的术语“和/或”是指并且涵盖相关联地列出的项目中一个或多个项目的任何和全部可能的组合。还将理解的是,术语“包括”和/或“包含”当在本说明书中使用时是指定存在所陈述的特征、整数、步骤、操作、元素和/或部件,但是并不排除存在或添加一个或多个其他特征、整数、步骤、操作、元素、部件和/或其 分组。It will also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will also be understood that the terms "comprise" and "comprises", "the"," One or more other features, integers, steps, operations, elements, components, and/or Grouping.
如本文中所用,根据上下文,术语“如果”可以被解释为意思是“当...时”或“在...后”或“响应于确定”或“响应于检测到”。类似地,根据上下文,短语“如果确定...”或“如果检测到[所陈述的条件或事件]”可以被解释为意思是“在确定...时”或“响应于确定...”或“在检测到[所陈述的条件或事件]时”或“响应于检测到[所陈述的条件或事件]”。As used herein, the term "if" may be interpreted to mean "when" or "after" or "in response to determining" or "in response to detecting", depending on the context. Similarly, depending on the context, the phrase "if determined..." or "if the stated condition or event is detected" can be interpreted to mean "when determining..." or "in response to determining... "or" when [the stated condition or event] is detected" or "in response to detecting the [condition or event stated]".
介绍了电子设备、用于这样的设备的用户界面、和用于使用这样的设备的相关联过程的实施例。在一些实施例中,电子设备是还包含其它功能诸如个人数字助理和/或音乐播放器功能的便携式电子设备,诸如移动电话。电子设备的示例性实施例包括但不限于搭载
Figure PCTCN2016108076-appb-000001
或者其它操作系统的便携式通信设备。也可以使用其它电子设备,诸如具有触敏表面(例如,触摸屏显示器和/或触控板)的膝上型计算机或平板电脑。还应当理解的是,在一些实施例中,电子设备不是便携式电子设备,而是具有触敏表面(例如,触摸屏显示器和/或触控板)的台式计算机。
Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the electronic device is a portable electronic device, such as a mobile phone, that also includes other functions, such as a personal digital assistant and/or music player functionality. Exemplary embodiments of an electronic device include, but are not limited to, piggybacking
Figure PCTCN2016108076-appb-000001
Or a portable communication device of other operating systems. Other electronic devices can also be used, such as a laptop or tablet with a touch-sensitive surface (eg, a touch screen display and/or a touchpad). It should also be understood that in some embodiments, the electronic device is not a portable electronic device, but a desktop computer having a touch-sensitive surface (eg, a touch screen display and/or a touch pad).
在下面的讨论中,介绍了一种包括显示器和触敏表面的电子设备。然而应当理解,电子设备可以包括一个或多个其他物理用户接口设备,诸如物理键盘、鼠标和/或操作杆。In the discussion that follows, an electronic device including a display and a touch-sensitive surface is described. It should be understood, however, that an electronic device can include one or more other physical user interface devices, such as a physical keyboard, mouse, and/or joystick.
电子设备通常支持多种应用程序,诸如以下中的一种或多种:画图应用程序、呈现应用程序、文字处理应用程序、网页创建应用程序、盘编辑应用程序、电子表格应用程序、游戏应用程序、电话应用程序、视频会议应用程序、电子邮件应用程序、即时消息应用程序、锻炼支持应用程序、相片管理应用程序(也即图像管理应用程序)、数字相机应用程序、数字视频摄像机应用程序、网络浏览应用程序、数字音乐播放器应用程序、和/或数字视频播放器应用程序。Electronic devices typically support a variety of applications, such as one or more of the following: a drawing application, a rendering application, a word processing application, a web page creation application, a disk editing application, a spreadsheet application, a gaming application. , phone applications, video conferencing applications, email applications, instant messaging applications, workout support applications, photo management applications (ie image management applications), digital camera applications, digital video camera applications, networks Browse applications, digital music player applications, and/or digital video player applications.
可在电子设备上执行的各种应用程序可使用至少一个共用的物理用户接口设备,诸如触敏表面。触敏表面的一种或多种功能以及显示在设备上的相应信息可从一种应用程序调整和/或变化至下一种应用程序和/或在相应应用程序内被调整和/或变化。这样,电子设备的共用物理架构(诸如触敏表面)可利用对于用户而言直观清楚的用户界面来支持各种应用程序。Various applications that can be executed on an electronic device can use at least one shared physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device may be adjusted and/or changed from one application to the next and/or adjusted and/or varied within the respective application. In this way, the shared physical architecture of the electronic device, such as a touch-sensitive surface, can support various applications with a user interface that is intuitive to the user.
现在关注具有触敏显示器的便携式通信设备的实施例。图2A是示出根据一些实施例的具有触敏显示器112的便携式通信设备100的框图。触敏显示器112有时为了方便被称为“触摸屏”,并且也可被称为是或者被叫做触敏显示器系统,也可以被称为具有触敏 表面(touch-sensitive surface)和显示屏(display)的显示器系统。设备100可包括存储器102(其可包括一个或多个计算机可读存储介质)、存储器控制器122、一个或多个中央处理单元(CPU)120、外围设备接口118、RF电路系统108、音频电路系统110、扬声器111、麦克风113、输入/输出(I/O)子系统106、其他输入控制设备116、和外部端口124。设备100可包括一个或多个光学传感器164。这些部件可通过一根或多根通信总线或信号线103进行通信。Attention is now directed to an embodiment of a portable communication device having a touch sensitive display. FIG. 2A is a block diagram showing a portable communication device 100 with a touch-sensitive display 112 in accordance with some embodiments. Touch sensitive display 112 is sometimes referred to as a "touch screen" for convenience, and may also be referred to as or referred to as a touch sensitive display system, and may also be referred to as touch sensitive. Display system for touch-sensitive surfaces and displays. Device 100 can include memory 102 (which can include one or more computer readable storage media), memory controller 122, one or more central processing units (CPUs) 120, peripheral interface 118, RF circuitry 108, audio circuitry System 110, speaker 111, microphone 113, input/output (I/O) subsystem 106, other input control devices 116, and external port 124. Device 100 can include one or more optical sensors 164. These components can communicate over one or more communication buses or signal lines 103.
应当理解,设备100只是一种便携式电子设备的一个示例,并且设备100可具有比所示出的更多或更少的部件,可组合两个或更多个部件,或者可具有这些部件的不同配置或布置。图2A中所示的各种部件可以硬件、软件方式或软硬件组合来实现,包括一个或多个信号处理和/或专用集成电路。It should be understood that device 100 is but one example of a portable electronic device, and device 100 may have more or fewer components than shown, two or more components may be combined, or may have different components Configuration or layout. The various components shown in Figure 2A can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
存储器102可以包括高速随机存取存储器,并且还可包括非易失性存储器,诸如一个或多个磁盘存储设备、闪存存储器设备、或其他非易失性固态存储器设备。设备100的其他部件(诸如CPU 120和外围设备接口118)对存储器102的访问可由存储器控制器122来控制。Memory 102 can include high speed random access memory and can also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state memory devices. Access to memory 102 by other components of device 100, such as CPU 120 and peripheral interface 118, may be controlled by memory controller 122.
外围设备接口118可以被用来将设备的输入和输出外围设备耦接到CPU 120和存储器102。该一个或多个处理器120运行或执行存储在存储器102中的各种软件程序和/或指令集,以执行设备100的各种功能以及处理数据。在一些实施例中,该一个或多个处理器120包括图像信号处理器和双核或多核处理器。 Peripheral device interface 118 can be used to couple the input and output peripherals of the device to CPU 120 and memory 102. The one or more processors 120 execute or execute various software programs and/or sets of instructions stored in the memory 102 to perform various functions of the device 100 and process the data. In some embodiments, the one or more processors 120 include an image signal processor and a dual or multi-core processor.
在一些实施例中,外围设备接口118、CPU 120、和存储器控制器122可以被实现在单个芯片诸如芯片104上。在一些其他实施例中,它们可以被实现在独立的芯片上。In some embodiments, peripheral interface 118, CPU 120, and memory controller 122 can be implemented on a single chip, such as chip 104. In some other embodiments, they can be implemented on separate chips.
RF(射频)电路系统108接收和发送RF信号,也被叫做电磁信号。RF电路系统108将电信号转换为电磁信号/将电磁信号转换为电信号,并且经由电磁信号与通信网络及其他通信设备通信。RF电路系统108可包括用于执行这些功能的众所周知的电路系统,包括但不限于天线系统、RF收发器、一个或多个放大器、调谐器、一个或多个振荡器、数字信号处理器、编解码芯片组、用户身份模块(SIM)卡、存储器等等。RF电路系统108可通过无线通信与网络以及其他设备通信,网络诸如是互联网(也被称为万维网(WWW))、内联网和/或无线网络(诸如蜂窝电话网络、无线局域网(LAN)和/或城域网(MAN))。无线通信可使用多种通信标准、协议和技术中的任何类型,包括但不限于全球移动通信系统(GSM)、增强数据GSM环境(EDGE)、高速下行链路分组接入(HSDPA)、高速上行链路分组接入(HSUPA)、宽带码分多址(W-CDMA)、码分多址(CDMA)、时分多址(TDMA)、蓝 牙、无线保真(WI-Fi)(例如,IEEE 802.11a、IEEE 802.11b、IEEE 802.11g和/或IEEE802.11n)、因特网语音协议(VoIP)、Wi-MAX、电子邮件协议(例如,因特网消息访问协议(IMAP)和/或邮局协议(POP))、即时消息(例如,可扩展消息处理现场协议(XMPP)、用于即时消息和现场利用扩展的会话发起协议(SIMPLE)、即时消息和到场服务(IMPS))、和/或短消息服务(SMS)、或者其他任何适当的通信协议,包括在本文献提交日还未开发出的通信协议。RF (radio frequency) circuitry 108 receives and transmits RF signals, also referred to as electromagnetic signals. The RF circuitry 108 converts electrical signals into/from electromagnetic signals and communicates with communication networks and other communication devices via electromagnetic signals. RF circuitry 108 may include well-known circuitry for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, Decode chipset, Subscriber Identity Module (SIM) card, memory, and more. The RF circuitry 108 can communicate with the network and other devices via wireless communication, such as the Internet (also known as the World Wide Web (WWW)), intranets, and/or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and/or Or Metropolitan Area Network (MAN). Wireless communication can use any of a variety of communication standards, protocols, and technologies including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed Downlink Packet Access (HSDPA), high speed uplink Link Packet Access (HSUPA), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Blue Teeth, Wireless Fidelity (WI-Fi) (eg, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, and/or IEEE 802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (eg, Internet) Message Access Protocol (IMAP) and/or Post Office Protocol (POP), instant messaging (eg, Extensible Messaging Processing Site Protocol (XMPP), Session Initiation Protocol (SIMPLE) for instant messaging and field utilization extensions, instant messaging and Presence Service (IMPS), and/or Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed at the filing date of this document.
音频电路系统110、扬声器111、和麦克风113提供用户与设备100之间的音频接口。音频电路系统110从外围设备接口118接收音频数据,将音频数据转换为电信号,并将电信号传输到扬声器111。扬声器111将电信号转换为人类可听的声波。音频电路系统110还接收由麦克风113根据声波转换来的电信号。音频电路系统110将电信号转换为音频数据,并将音频数据传输到外围设备接口118以进行处理。音频数据可由外围设备接口118检索自和/或传输至存储器102和/或RF电路系统108。在一些实施例中,音频电路系统110还包括耳麦插孔(例如,图3中的212)。耳麦插孔提供音频电路系统110与可移除的音频输入/输出外围设备之间的接口,该外围设备诸如仅输出的耳机或者具有输出(例如,单耳或双耳耳机)和输入(例如,麦克风)二者的耳麦。Audio circuitry 110, speaker 111, and microphone 113 provide an audio interface between the user and device 100. Audio circuitry 110 receives audio data from peripheral interface 118, converts the audio data into electrical signals, and transmits the electrical signals to speaker 111. The speaker 111 converts the electrical signal into a human audible sound wave. The audio circuitry 110 also receives electrical signals converted by the microphone 113 based on the acoustic waves. Audio circuitry 110 converts the electrical signals into audio data and transmits the audio data to peripheral interface 118 for processing. Audio data may be retrieved from and/or transmitted to memory 102 and/or RF circuitry 108 by peripheral device interface 118. In some embodiments, audio circuitry 110 also includes a headset jack (eg, 212 in FIG. 3). The headset jack provides an interface between the audio circuitry 110 and a removable audio input/output peripheral, such as an output only headset or with an output (eg, a monaural or binaural headset) and input (eg, Microphone) Both headsets.
I/O子系统106将设备100上的输入/输出外围设备,诸如触摸屏112和其他输入控制设备116,耦接到外围设备接口118。I/O子系统106可以包括显示控制器156和用于其他输入控制设备的一个或多个输入控制器160。该一个或多个输入控制器160从其他输入控制设备116接收电信号/发送电信号到其他输入控制设备116。所述其他输入控制设备116可包括物理按钮(例如,下压按钮、摇臂按钮等)、拨号盘、滑动开关、操纵杆、点击式转盘等等。在一些另选实施例中,输入控制器160可耦接到(或不耦接到)以下任一个:键盘、红外线端口、USB端口、和指针设备诸如鼠标。该一个或多个按钮(例如,图3中的208)可包括用于扬声器111和/或麦克风113的音量控制的上/下按钮。该一个或多个按钮可包括下压按钮(例如,图3中的206)。I/O subsystem 106 couples input/output peripherals on device 100, such as touch screen 112 and other input control devices 116, to peripheral device interface 118. The I/O subsystem 106 can include a display controller 156 and one or more input controllers 160 for other input control devices. The one or more input controllers 160 receive electrical signals/transmit electrical signals from other input control devices 116 to other input control devices 116. The other input control device 116 may include physical buttons (eg, a push button, rocker button, etc.), a dial, a slide switch, a joystick, a click wheel, and the like. In some alternative embodiments, input controller 160 may be coupled to (or not coupled to) any of the following: a keyboard, an infrared port, a USB port, and a pointing device such as a mouse. The one or more buttons (eg, 208 in FIG. 3) may include up/down buttons for volume control of the speaker 111 and/or the microphone 113. The one or more buttons can include a push button (eg, 206 in Figure 3).
触敏显示器112提供设备与用户之间的输入接口和输出接口。显示控制器156从触摸屏112接收电信号和/或向触摸屏112发送电信号。触摸屏112向用户显示视觉输出。视觉输出可包括图形、文本、图标、视频及它们的任何组合(统称为“图形”)。在一些实施例中,一些视觉输出或全部的视觉输出可对应于用户界面对象。Touch sensitive display 112 provides an input interface and an output interface between the device and the user. Display controller 156 receives electrical signals from touch screen 112 and/or transmits electrical signals to touch screen 112. Touch screen 112 displays a visual output to the user. Visual output can include graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some visual output or all of the visual output may correspond to a user interface object.
触摸屏112具有基于触觉和/或触觉接触从用户接受输入的触敏表面、传感器或传感器组。触摸屏112和显示控制器156(与存储器102中的任何相关联模块和/或指令集一起) 检测触摸屏112上的接触(和该接触的任何移动或中断),并且将所检测到的接触转换为与显示在触摸屏112上的用户界面对象(例如,一个或多个软按键、图标、网页或图像)的交互。在示例性实施例中,触摸屏112与用户之间的接触点对应于用户的手指。在不做特殊说明的情况下,本发明实施例中所指的触摸屏112具体是指具有触敏表面和显示屏的触敏显示器系统。 Touch screen 112 has a touch-sensitive surface, sensor or group of sensors that accept input from a user based on tactile and/or tactile contact. Touch screen 112 and display controller 156 (along with any associated modules and/or sets of instructions in memory 102) Detecting contact on touch screen 112 (and any movement or interruption of the contact) and converting the detected contact to a user interface object (eg, one or more soft keys, icons, web pages, or Image) interaction. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to the user's finger. The touch screen 112 referred to in the embodiment of the present invention specifically refers to a touch-sensitive display system having a touch-sensitive surface and a display screen, unless otherwise specified.
触摸屏112可使用LCD(液晶显示器)技术、LPD(发光聚合物显示器)技术、或LED(发光二极管)技术,但是在其他实施例中可使用其他显示技术。触摸屏112和显示控制器156可以利用现在已知的或以后将开发出的多种触摸感测技术中的任何技术以及其他接近传感器阵列或用于确定与触摸屏112接触的一个或多个点的其他元件来检测接触及其任何移动或中断,该多种触摸感测技术包括但不限于电容性的、电阻性的、红外线的、和表面声波技术。在一示例性实施例中,使用投射式互电容感测技术。 Touch screen 112 may use LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, although other display technologies may be used in other embodiments. Touch screen 112 and display controller 156 may utilize any of a variety of touch sensing techniques now known or later developed, as well as other proximity sensor arrays or other means for determining one or more points in contact with touch screen 112. Elements to detect contact and any movement or interruption thereof, including but not limited to capacitive, resistive, infrared, and surface acoustic wave techniques. In an exemplary embodiment, a projected mutual capacitance sensing technique is used.
触摸屏112可以具有超过100dpi的视频分辨率。在一些实施例中,触摸屏具有大约160dpi的视频分辨率。用户可以利用任何合适的物体或附加物诸如触笔、手指等等,与触摸屏112接触。在一些实施例中,用户界面被设计为主要与基于手指的接触和手势一起工作,这与基于触笔的输入相比由于手指在触摸屏上接触面积更大而可能精确度更低。在一些实施例中,设备将基于手指的粗略输入翻译为精确的指针/光标位置或命令,以执行用户所期望的动作。 Touch screen 112 can have a video resolution in excess of 100 dpi. In some embodiments, the touch screen has a video resolution of approximately 160 dpi. The user can contact the touch screen 112 using any suitable object or add-on such as a stylus, finger, or the like. In some embodiments, the user interface is designed to work primarily with finger-based contacts and gestures, which may be less accurate than the stylus-based input due to the larger contact area of the finger on the touch screen. In some embodiments, the device translates the finger-based coarse input into an accurate pointer/cursor position or command to perform the action desired by the user.
在一些实施例中,除了触摸屏之外,设备100可包括用于激活或解除激活特定功能的触控板(未示出)。在一些实施例中,触控板是设备的触敏区域,该触敏区域与触摸屏不同,其不显示视觉输出。触控板可以是与触摸屏112分开的触敏表面,或者是由触摸屏形成的触敏表面的延伸部分。In some embodiments, in addition to the touch screen, device 100 can include a touchpad (not shown) for activating or deactivating a particular function. In some embodiments, the touchpad is a touch sensitive area of the device that is different from the touchscreen in that it does not display a visual output. The touchpad can be a touch-sensitive surface that is separate from the touchscreen 112 or an extension of the touch-sensitive surface formed by the touchscreen.
设备100还包括用于为各种部件供电的电力系统162,。电力系统162可包括电力管理系统、一个或多个电源(例如,电池、交流电(AC))、再充电系统、电力故障检测电路、功率变换器或逆变器、电力状态指示器(例如,发光二极管(LED))和任何其他与便携式设备中电力的生成、管理和分配相关联的部件。 Apparatus 100 also includes a power system 162 for powering various components. The power system 162 can include a power management system, one or more power sources (eg, batteries, alternating current (AC)), a recharging system, power fault detection circuitry, power converters or inverters, power status indicators (eg, lighting) A diode (LED) and any other component associated with the generation, management, and distribution of power in a portable device.
设备100还可包括一个或多个光学传感器164。图2A示出了耦接到I/O子系统106中光学传感器控制器158的光学传感器。光学传感器164可包括电荷耦合器件(CCD)或互补金属氧化物半导体(CMOS)光电晶体管。光学传感器164从环境接收通过一个或多个透镜投射的光,并且将光转换为表示图像的数据。结合成像模块143(也称为相机模块),光学传感器164可以捕获静态图像或视频。在一些实施例中,一个或者多个光学传感器位于 设备100的后部,与设备前部上的触摸屏显示器112相对,使得触摸屏显示器可用作用于静态图像和/或视频图像采集的取景器。在一些实施例中,另一个或者多个光学传感器位于设备的前部上,使得用户在触摸屏显示器上观看其它视频会议参与者的同时可以获得该用户的图像以用于视频会议。 Device 100 may also include one or more optical sensors 164. FIG. 2A shows an optical sensor coupled to optical sensor controller 158 in I/O subsystem 106. Optical sensor 164 can include a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. Optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In conjunction with imaging module 143 (also referred to as a camera module), optical sensor 164 can capture still images or video. In some embodiments, one or more optical sensors are located The rear of device 100 is opposite the touch screen display 112 on the front of the device such that the touch screen display can be used as a viewfinder for still image and/or video image capture. In some embodiments, another or more optical sensors are located on the front of the device such that the user can view images of the user while viewing other video conferencing participants on the touch screen display for video conferencing.
设备100还可以包括一个或多个接近传感器166。图2A示出了耦接到外围设备接口118的接近传感器166。作为另外一种选择,接近传感器166可耦接到I/O子系统106中的输入控制器160。在一些实施例中,当电子设备被置于用户耳朵附近时(例如,当用户正在进行电话呼叫时),接近传感器关闭并禁用触摸屏112。 Device 100 may also include one or more proximity sensors 166. FIG. 2A shows proximity sensor 166 coupled to peripheral interface 118. Alternatively, proximity sensor 166 can be coupled to input controller 160 in I/O subsystem 106. In some embodiments, when the electronic device is placed near the user's ear (eg, when the user is making a phone call), the proximity sensor turns off and disables the touch screen 112.
设备100还可包括一个或多个加速度计168。图2A示出了耦接到外围设备接口118的加速度计168。作为另外一种选择,加速度计168可耦接到I/O子系统106中的输入控制器160。在一些实施例中,信息基于对从该一个或多个加速度计所接收的数据的分析而在触摸屏显示器上以纵向视图或横向视图被显示。设备100可选地除了加速度计168之外还包括磁力仪(未示出)和GPS(或GLONASS或北斗或其它全球导航系统)接收器(未示出),用于获得关于设备100的位置和取向(例如,纵向或横向)的信息。 Device 100 may also include one or more accelerometers 168. FIG. 2A shows an accelerometer 168 coupled to a peripheral device interface 118. Alternatively, accelerometer 168 can be coupled to input controller 160 in I/O subsystem 106. In some embodiments, the information is displayed in a portrait view or a landscape view on the touch screen display based on an analysis of the data received from the one or more accelerometers. Apparatus 100 optionally includes a magnetometer (not shown) and a GPS (or GLONASS or Beidou or other global navigation system) receiver (not shown) in addition to accelerometer 168 for obtaining a position regarding device 100 and Information that is oriented (eg, portrait or landscape).
在一些实施例中,存储在存储器102中的软件部件包括操作系统126、通信模块(或指令集)128、接触/移动模块(或指令集)130、图形模块(或指令集)132、文本输入模块(或指令集)134、全球定位系统(GPS)模块(或指令集)135、以及应用程序(或指令集)136。此外,在一些实施例中,存储器102存储设备/全局内部状态157,如图2A和图3中所示。设备/全局内部状态157包括以下中一者或多者:活动应用程序状态,用于指示哪些应用程序(如果有的话)当前是活动的;显示状态,用于指示什么应用程序、视图或其它信息占据触摸屏显示器112的各个区域;传感器状态,包括从设备的各个传感器和输入控制设备116获得的信息;和关于设备的位置和姿态的位置信息。In some embodiments, the software components stored in the memory 102 include an operating system 126, a communication module (or set of instructions) 128, a contact/moving module (or set of instructions) 130, a graphics module (or set of instructions) 132, text input. A module (or set of instructions) 134, a Global Positioning System (GPS) module (or set of instructions) 135, and an application (or set of instructions) 136. Moreover, in some embodiments, memory 102 stores device/global internal state 157, as shown in Figures 2A and 3. The device/global internal state 157 includes one or more of the following: an active application state indicating which applications (if any) are currently active; a display state indicating which applications, views, or other Information occupies various areas of the touch screen display 112; sensor status, including information obtained from various sensors of the device and input control device 116; and position information regarding the position and posture of the device.
操作系统126(例如,Darwin、RTXC、LINUX、UNIX、OS X、WINDOWS、ANDROID或嵌入式操作系统(诸如Vx Works))包括用于控制和管理一般系统任务(例如,存储器管理、存储设备控制、电力管理等)的各种软件部件和/或驱动器,并且有利于各个硬件和软件部件之间的通信。此外,在一些实施例中,存储器102存储数字相机胶卷159和数字图像流水线161。Operating system 126 (eg, Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, ANDROID, or an embedded operating system (such as Vx Works)) includes control and management of general system tasks (eg, memory management, storage device control, Various software components and/or drivers for power management, etc., and facilitate communication between various hardware and software components. Moreover, in some embodiments, memory 102 stores digital camera film 159 and digital image pipeline 161.
通信模块128有利于通过一个或多个外部端口124与其它设备通信,并且还包括用于处理由RF电路系统108和/或外部端口124所接收的数据的各种软件部件。外部端口124(例如,通用串行总线(USB)、火线等)适于直接耦接到其他设备或者间接地通过网络 (例如,因特网、无线LAN等)耦接。在一些实施例中,外部端口是与iPod(Apple Inc.的商标)设备上所使用的30针连接器相同的或类似的以及/或者与其兼容的多针(例如,30针)连接器。 Communication module 128 facilitates communication with other devices via one or more external ports 124, and also includes various software components for processing data received by RF circuitry 108 and/or external port 124. External port 124 (eg, Universal Serial Bus (USB), Firewire, etc.) is adapted to be directly coupled to other devices or indirectly through the network (for example, the Internet, wireless LAN, etc.) is coupled. In some embodiments, the external port is a multi-pin (eg, 30-pin) connector that is identical or similar to and/or compatible with a 30-pin connector used on an iPod (trademark of Apple Inc.) device.
接触/移动模块130可检测与触摸屏112(结合显示控制器156)和其他触敏设备(例如,触控板或物理点击式转盘)的接触。接触/移动模块130包括多个软件部件用于执行与接触检测相关的各种操作,诸如确定是否已经发生了接触(例如,检测手指按下事件)、确定是否存在接触的移动并在整个触敏表面上跟踪该移动(例如,检测一个或多个手指拖动事件)、以及确定接触是否已经终止(例如,检测手指抬起事件或者接触中断)。接触/移动模块130从触敏表面接收接触数据。确定接触点的移动可以包括确定接触点的速率(量值)、速度(量值和方向)、和/或加速度(量值和/或方向的改变),接触点的移动由一系列接触数据来表示。这些操作可被应用于单点接触(例如,一个手指接触)或者多点同时接触(例如,“多点触摸”/多个手指接触)。在一些实施例中,接触/移动模块130和显示控制器156检测触控板上的接触。The contact/movement module 130 can detect contact with the touch screen 112 (in conjunction with the display controller 156) and other touch sensitive devices (eg, a touchpad or physical click wheel). The contact/movement module 130 includes a plurality of software components for performing various operations related to contact detection, such as determining if a contact has occurred (eg, detecting a finger press event), determining if there is a contact movement, and being touch sensitive throughout The movement is tracked on the surface (eg, detecting one or more finger drag events), and determining if the contact has terminated (eg, detecting a finger lift event or contact interruption). Contact/movement module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point may include determining the rate (magnitude), velocity (magnitude and direction), and/or acceleration (change in magnitude and/or direction) of the contact point, the movement of the contact point being caused by a series of contact data Said. These operations can be applied to a single point of contact (eg, one finger contact) or multiple points of simultaneous contact (eg, "multi-touch" / multiple finger contacts). In some embodiments, the contact/movement module 130 and the display controller 156 detect contact on the touchpad.
接触/移动模块130可检测用户的手势输入。触敏表面上不同的手势具有不同的接触图案。因此,可通过检测具体接触图案来检测手势。例如,检测到单指轻击手势包括检测到手指按下事件、然后在与手指按下事件相同的位置(或基本上相同的位置)处(例如,在图标位置处)检测到手指抬起(抬离)事件。又如,在触敏表面上检测到手指轻扫手势包括检测到手指按下事件、然后检测到一个或多个手指拖动事件、并且随后检测到手指抬起(抬离)事件。The contact/movement module 130 can detect a user's gesture input. Different gestures on the touch-sensitive surface have different contact patterns. Therefore, the gesture can be detected by detecting a specific contact pattern. For example, detecting a one-finger tap gesture includes detecting a finger press event, and then detecting a finger lift at a location (or substantially the same location) as the finger press event (eg, at the icon location) ( Lift off) event. As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift off) event.
图形模块132包括用于在触摸屏112或其他显示器上渲染和显示图形的多个已知软件部件,包括用于改变被显示图形的强度的部件。如本文所用,术语“对象”包括可以被显示给用户的任何对象,非限制性地包括文本、网页、图标(诸如包括软按键的用户界面对象)、数字图像、视频、动画等等。 Graphics module 132 includes a number of known software components for rendering and displaying graphics on touch screen 112 or other display, including components for changing the strength of the displayed graphics. As used herein, the term "object" includes any object that can be displayed to a user, including, without limitation, text, web pages, icons (such as user interface objects including soft keys), digital images, video, animation, and the like.
在一些实施例中,图形模块132存储要使用的数据表示图形。每个图形可以被分配有相应的代码。图形模块132从应用程序等接收指定要显示的图形的一个或多个代码,在必要的情况下还一起接收坐标数据和其他图形属性数据,并且然后生成屏幕图像数据来输出给显示控制器156。In some embodiments, graphics module 132 stores data representation graphics to be used. Each graphic can be assigned a corresponding code. The graphics module 132 receives one or more codes specifying graphics to be displayed from an application or the like, and also receives coordinate data and other graphics attribute data together if necessary, and then generates screen image data for output to the display controller 156.
可作为图形模块132的部件的文本输入模块134提供用于在多种应用程序(例如,联系人137、电子邮件140、即时消息141、浏览器147、和需要文本输入的任何其他应用程序)中输入文本的软键盘。 A text input module 134, which may be a component of the graphics module 132, is provided for use in a variety of applications (eg, contacts 137, email 140, instant message 141, browser 147, and any other application requiring text input) Enter the soft keyboard for the text.
GPS模块135确定设备的位置,并且提供该信息以在各种应用程序中使用(例如,提供给电话138来用于基于位置的拨号、提供给相机143作为图片/视频元数据、以及提供给提供基于位置的服务的应用程序,诸如天气桌面小程序、本地黄页桌面小程序、和地图/导航桌面小程序)。The GPS module 135 determines the location of the device and provides this information for use in various applications (eg, for phone 138 for location based dialing, for camera 143 as picture/video metadata, and for providing) Applications for location-based services, such as the weather desktop applet, the local yellow pages desktop applet, and the map/navigation desktop applet.
应用程序136可包括以下模块(或指令集)或者其子组或超集: Application 136 may include the following modules (or sets of instructions) or subgroups or supersets thereof:
●联系人模块137(有时也称为通讯录或联系人列表);Contact module 137 (sometimes referred to as an address book or contact list);
●电话模块138;telephone module 138;
●视频会议模块139;video conferencing module 139;
●电子邮件客户端模块140;email client module 140;
●即时消息(IM)模块141;Instant messaging (IM) module 141;
●锻炼支持模块142;exercise support module 142;
●用于静态图像和/或视频图像的相机模块143;a camera module 143 for still images and/or video images;
●图像管理模块144; Image management module 144;
●浏览器模块147; Browser module 147;
●日历模块148; Calendar module 148;
●桌面小程序模块149,其可以包括以下中一者或多者:天气桌面小程序149-1、股市桌面小程序149-2、计算器桌面小程序149-3、闹钟桌面小程序149-4、字典桌面小程序149-5、和用户获得的其他桌面小程序、以及用户创建的桌面小程序149-6;a desktop applet module 149, which may include one or more of the following: weather desktop applet 149-1, stock market desktop applet 149-2, calculator desktop applet 149-3, alarm desktop applet 149-4 , the dictionary desktop applet 149-5, and other desktop applets obtained by the user, and the user-created desktop applet 149-6;
●用于生成用户创建的桌面小程序149-6的桌面小程序创建器模块150;a desktop applet creator module 150 for generating a user-created desktop applet 149-6;
●搜索模块151;search module 151;
●视频和音乐播放器模块152,其可以由视频播放器模块和音乐播放器模块构成;Video and music player module 152, which may be comprised of a video player module and a music player module;
●便签模块153;note module 153;
●地图模块154; Map module 154;
●在线视频模块155;online video module 155;
●声音/音频录制器模块163;和/或Sound/audio recorder module 163; and/or
●通知模块165。 Notification module 165.
可被存储在存储器102中的其他应用程序136的示例包括其他文字处理应用程序、其他图像编辑应用程序、画图应用程序、呈现应用程序、JAVA启用的应用程序、加密、数字权益管理、声音识别、和声音复制。 Examples of other applications 136 that may be stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA enabled applications, encryption, digital rights management, voice recognition, And sound reproduction.
结合触摸屏112、显示控制器156、接触模块130、图形模块132、和文本输入模块134,联系人模块137可被用于管理通讯录或联系人列表(例如,存储在存储器102或存储器370中联系人模块137的应用程序内部状态192中),包括:添加姓名到通讯录;从通讯录删除姓名;将电话号码、电子邮件地址、实际地址或其他信息与姓名关联;将图像与姓名关联;对姓名进行分类和归类;提供电话号码或电子邮件地址来发起和/或促进通过电话138、视频会议139、电子邮件140或IM 141的通信;等等。In conjunction with touch screen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, contact module 137 can be used to manage contacts or contact lists (eg, stored in memory 102 or memory 370 for contact) The application internal state 192 of the person module 137) includes: adding a name to the address book; deleting the name from the address book; associating the phone number, email address, actual address, or other information with the name; associating the image with the name; Names are categorized and categorized; a phone number or email address is provided to initiate and/or facilitate communication over the phone 138, video conference 139, email 140, or IM 141;
结合RF电路系统108、音频电路系统110、扬声器111、麦克风113、触摸屏112、显示控制器156、接触模块130、图形模块132、和文本输入模块134,电话模块138可以被用于输入对应于电话号码的字符序列、访问通讯录137中的一个或多个电话号码、修改已经输入的电话号码、拨打相应的电话号码、进行通话以及当通话完成时断开或挂断。如上所述,无线通信可以使用多个通信标准、协议和技术中的任一个。In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, telephone module 138 can be used to input corresponding to the telephone The character sequence of the number, accessing one or more phone numbers in the address book 137, modifying the phone number that has been entered, dialing the corresponding phone number, making a call, and disconnecting or hanging up when the call is completed. As noted above, wireless communication can use any of a variety of communication standards, protocols, and technologies.
结合RF电路系统108、音频电路系统110、扬声器111、麦克风113、触摸屏112、显示控制器156、光学传感器164、光学传感器控制器158、接触模块130、图形模块132、文本输入模块134、联系人列表137、和电话模块138,视频会议模块139包括用于根据用户指令发起、进行、和结束用户与一个或多个其他参与方之间的视频会议的可执行指令。In combination with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact module 130, graphics module 132, text input module 134, contacts List 137, and telephony module 138, the video conferencing module 139 includes executable instructions for initiating, conducting, and ending a video conference between the user and one or more other participants in accordance with user instructions.
结合RF电路系统108、触摸屏112、显示控制器156、接触模块130、图形模块132、和文本输入模块134,电子邮件客户端模块140包括用于响应于用户指令来创建、发送、接收、和管理电子邮件的可执行指令。结合图像管理模块144,电子邮件客户端模块140使得非常容易创建和发送具有由相机模块143拍摄的静态图像或视频图像的电子邮件。In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, email client module 140 includes means for creating, transmitting, receiving, and managing in response to user instructions Executable instructions for email. In conjunction with the image management module 144, the email client module 140 makes it very easy to create and send emails with still images or video images taken by the camera module 143.
结合RF电路系统108、触摸屏112、显示控制器156、接触模块130、图形模块132、和文本输入模块134,即时消息模块141包括用于输入对应于即时消息的字符序列、修改先前输入的字符、传输相应即时消息(例如,使用短消息服务(SMS)或多媒体消息服务(MMS)协议用于基于电话的即时消息或者使用XMPP、SIMPLE、或IMPS用于基于因特网的即时消息)、接收即时消息以及查看所接收的即时消息的可执行指令。在一些实施例中,所传输和/或接收的即时消息可包括图形、相片、音频文件、视频文件以及/或者MMS和/或增强消息服务(EMS)中所支持的其他附接件。如本文所用,“即时消息”是指基于电话的消息(例如,利用SMS或MMS发送的消息)和基于因特网的消息(例如,利用XMPP、SIMPLE、或IMPS发送的消息)二者。In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, instant messaging module 141 includes a sequence of characters for inputting an instant message, modifying previously entered characters, Transmitting corresponding instant messages (eg, using Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocols for phone-based instant messaging or using XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and View executable instructions for the received instant message. In some embodiments, the transmitted and/or received instant messages may include graphics, photos, audio files, video files, and/or other attachments supported in MMS and/or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both phone-based messages (eg, messages sent using SMS or MMS) and Internet-based messages (eg, messages transmitted using XMPP, SIMPLE, or IMPS).
结合RF电路系统108、触摸屏112、显示控制器156、接触模块130、图形模块132、 文本输入模块134、GPS模块135、地图模块154、和音乐播放器模块146,锻炼支持模块142包括可执行指令,用于创建锻炼(例如,具有时间、距离、和/或卡路里消耗目标);与锻炼传感器(体育设备)通信;接收锻炼传感器数据;校准用于监视锻炼的传感器;为锻炼选择和播放音乐;以及显示、存储和传输锻炼数据。In combination with the RF circuit system 108, the touch screen 112, the display controller 156, the contact module 130, the graphics module 132, Text input module 134, GPS module 135, map module 154, and music player module 146, exercise support module 142 includes executable instructions for creating an exercise (eg, having a time, distance, and/or calorie consumption target); Exercise sensor (sports equipment) communication; receiving exercise sensor data; calibrating sensors for monitoring exercise; selecting and playing music for exercise; and displaying, storing, and transmitting exercise data.
结合触摸屏112、显示控制器156、光学传感器164、光学传感器控制器158、接触模块130、图形模块132、数字图像流水线161(其将来自光学传感器的原始数据转换为最终图像或视频)、和图像管理模块144,相机模块143包括用于捕获静态图像或视频(包括视频流)并将其存储到存储器102中(例如,在数字相机胶卷159中)、修改静态图像或视频的特性、或从存储器102(例如,从数字相机胶卷159)删除静态图像或视频的可执行指令。In conjunction with touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact module 130, graphics module 132, digital image pipeline 161 (which converts raw data from the optical sensor into a final image or video), and images Management module 144, camera module 143 includes features for capturing still images or video (including video streams) and storing them in memory 102 (eg, in digital camera film 159), modifying the characteristics of still images or video, or from memory 102 (eg, from digital camera film 159) deletes executable instructions for still images or video.
结合触摸屏112、显示控制器156、接触模块130、图形模块132、文本输入模块134、和相机模块143,图像管理模块144包括用于排列、修改(例如,编辑)、或以其他方式操控、加标签、删除、呈现(例如在数字幻灯片或相册中)、以及存储静态图像和/或视频图像(包括存储在相机胶卷159中的静态图像和/或视频图像)的可执行指令。In conjunction with touch screen 112, display controller 156, contact module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes means for arranging, modifying (eg, editing), or otherwise manipulating, adding An executable instruction to tag, delete, render (eg, in a digital slide or album), and to store still images and/or video images (including still images and/or video images stored in camera roll 159).
结合RF电路系统108、触摸屏112、显示系统控制器156、接触模块130、图形模块132、和文本输入模块134,浏览器模块147包括用于根据用户指令浏览因特网(包括搜索、链接到、接收、和显示网页或其部分、以及链接到网页的附件和其他文件)的可执行指令。In conjunction with RF circuitry 108, touch screen 112, display system controller 156, contact module 130, graphics module 132, and text input module 134, browser module 147 includes means for browsing the Internet in accordance with user instructions (including searching, linking to, receiving, Executable instructions for displaying a web page or portion thereof, and attachments and other files linked to the web page.
结合RF电路系统108、触摸屏112、显示系统控制器156、接触模块130、图形模块132、文本输入模块134、电子邮件客户端模块140、和浏览器模块147,日历模块148包括用于根据用户指令创建、显示、修改、和存储日历和与日历相关联的数据(例如,日历条目、待办任务列表等)的可执行指令。In conjunction with RF circuitry 108, touch screen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, calendar module 148 includes instructions for An executable instruction that creates, displays, modifies, and stores calendars and data associated with the calendar (eg, calendar entries, to-do list, etc.).
结合RF电路系统108、触摸屏112、显示系统控制器156、接触模块130、图形模块132、文本输入模块134、和浏览器模块147,桌面小程序模块149是可以由用户下载并使用的微型应用程序(例如,天气桌面小程序149-1、股市桌面小程序149-2、计算器桌面小程序149-3、闹钟桌面小程序149-4、和字典桌面小程序149-5)或由用户创建的微型应用程序(例如,用户创建的桌面小程序149-6)。在一些实施例中,桌面小程序包括HTML(超文本标记语言)文件、CSS(层叠样式表)文件、和JavaScript文件。在一些实施例中,桌面小程序包括XML(可扩展标记语言)文件和JavaScript文件(例如,Yahoo!桌面小程序)。In conjunction with RF circuitry 108, touch screen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, and browser module 147, desktop applet module 149 is a mini-application that can be downloaded and used by a user. (eg, weather desktop applet 147-1, stock desktop applet 149-2, calculator desktop applet 149-3, alarm desktop applet 149-4, and dictionary desktop applet 149-5) or created by the user Micro-apps (for example, user-created desktop applets 149-6). In some embodiments, the desktop applet includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheet) file, and a JavaScript file. In some embodiments, the desktop applet includes an XML (Extensible Markup Language) file and a JavaScript file (eg, a Yahoo! desktop applet).
结合RF电路系统108、触摸屏112、显示系统控制器156、接触模块130、图形模块132、文本输入模块134、和浏览器模块147,桌面小程序创建器模块150可以被用户用来 创建桌面小程序(例如,将网页的用户指定部分转到桌面小程序中)。In conjunction with RF circuitry 108, touch screen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, and browser module 147, desktop applet creator module 150 can be used by the user Create a desktop applet (for example, transfer the user-specified portion of a web page to the desktop applet).
结合触摸屏112、显示系统控制器156、接触模块130、图形模块132、和文本输入模块134,搜索模块151包括用于根据用户指令在存储器102中搜索与一个或多个搜索标准(例如,用户指定的一个或多个搜索词)匹配的文本、音乐、声音、图像、视频、和/或其他文件的可执行指令。In conjunction with touch screen 112, display system controller 156, contact module 130, graphics module 132, and text input module 134, search module 151 includes means for searching in memory 102 for one or more search criteria (eg, user specified) in accordance with user instructions. One or more search terms) executable instructions for matching text, music, sound, images, video, and/or other files.
结合触摸屏112、显示系统控制器156、接触模块130、图形模块132、音频电路系统110、扬声器111、RF电路系统108、和浏览器模块147,视频和音乐播放器模块152包括允许用户下载和回放以一种或多种文件格式(诸如MP3或AAC文件)存储的所记录的音乐和其他声音文件的可执行指令,以及用于显示、呈现或以其他方式回放视频(例如,在触摸屏112上或在经由外部端口124连接的外部显示器上)的可执行指令。在一些实施例中,设备100可以包括MP3播放器的功能性。In conjunction with touch screen 112, display system controller 156, contact module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes user download and playback Executable instructions for recorded music and other sound files stored in one or more file formats (such as MP3 or AAC files), and for displaying, rendering, or otherwise playing back video (eg, on touch screen 112 or Executable instructions on an external display connected via external port 124. In some embodiments, device 100 may include the functionality of an MP3 player.
结合触摸屏112、显示控制器156、接触模块130、图形模块132、和文本输入模块134,便签模块153包括用于根据用户指令创建和管理便签、待办任务清单等的可执行指令。In conjunction with touch screen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, note pad module 153 includes executable instructions for creating and managing notes, to-do list, and the like in accordance with user instructions.
结合RF电路系统108、触摸屏112、显示系统控制器156、接触模块130、图形模块132、文本输入模块134、GPS模块135、和浏览器模块147,地图模块154可以被用于根据用户指令接收、显示、修改、和存储地图及与地图相关联的数据(例如,驾车路线;特定位置处或附近的商店和其他兴趣点的数据;和其他基于位置的数据)。In conjunction with RF circuitry 108, touch screen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 can be used to receive, according to user instructions, Display, modify, and store maps and data associated with the map (eg, driving directions; data for stores and other points of interest at or near specific locations; and other location-based data).
结合触摸屏112、显示系统控制器156、接触模块130、图形模块132、音频电路系统110、扬声器111、RF电路系统108、文本输入模块134、电子邮件客户端模块140、和浏览器模块147,在线视频模块155包括允许用户访问、浏览、接收(例如,流式接收和/或下载)、回放(例如,在触摸屏上或在经由外部端口124连接的外部显示器上)、发送具有到特定在线视频的链接的电子邮件、以及以其他方式管理一种或多种文件格式(诸如H.264)的在线视频的指令。在一些实施例中,使用即时消息模块141、而不是电子邮件客户端模块140来发送到特定在线视频的链接。In conjunction with touch screen 112, display system controller 156, contact module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, online Video module 155 includes allowing a user to access, browse, receive (eg, stream receive and/or download), play back (eg, on a touch screen or on an external display connected via external port 124), send with a particular online video. Linked emails, and instructions to otherwise manage online video of one or more file formats, such as H.264. In some embodiments, the instant message module 141 is used instead of the email client module 140 to send a link to a particular online video.
结合触摸屏112、显示系统控制器156、接触模块130、图形模块132、音频电路系统110、扬声器111、和麦克风113,声音/音频录制器模块163包括允许用户以一种或多种文件格式(诸如MP3或AAC文件)记录音频(例如,声音)的可执行指令、以及用于呈现或以其他方式回放所记录的音频文件的可执行指令。In conjunction with touch screen 112, display system controller 156, contact module 130, graphics module 132, audio circuitry 110, speaker 111, and microphone 113, audio/audio recorder module 163 includes a user-allowed one or more file formats (such as An MP3 or AAC file) executable instructions that record audio (eg, sound), and executable instructions for rendering or otherwise playing back the recorded audio file.
结合触摸屏112、显示系统控制器156、接触模块130、和图形模块132,通知模块 165包括在触摸屏112上显示通知或警告(诸如传入消息或来电呼叫、日历事件提醒、应用程序事件等等)的可执行指令。Incorporating the touch screen 112, the display system controller 156, the contact module 130, and the graphic module 132, the notification module 165 includes executable instructions for displaying a notification or warning on touch screen 112, such as an incoming message or an incoming call, a calendar event reminder, an application event, and the like.
上述每个模块和应用程序对应于用于执行上述一种或多种功能以及在本申请中所介绍的方法(例如,本文中所描述的计算机实现的方法和其他信息处理方法)的一组可执行指令。这些模块(即指令集)不必被实现为分开的软件程序、过程或模块,因此这些模块的各种子组可以在各种实施例中被组合或以其他方式重新布置。在一些实施例中,存储器102可存储上述模块和数据结构的一个子组。此外,存储器102可以存储上面没有描述的另外的模块和数据结构。Each of the above modules and applications corresponds to a set of methods for performing one or more of the functions described above, as well as the methods described in this application (eg, computer implemented methods and other information processing methods described herein). Execute the instruction. These modules (ie, sets of instructions) need not be implemented as separate software programs, procedures or modules, and thus various sub-groups of these modules may be combined or otherwise re-arranged in various embodiments. In some embodiments, memory 102 can store a subset of the modules and data structures described above. Moreover, memory 102 can store additional modules and data structures not described above.
在一些实施例中,设备100是这样一种设备,即在该设备上预定义的一组功能的操作唯一地通过触摸屏和/或触控板来执行。通过使用触摸屏和/或触控板作为用于设备100的操作的主要输入控制设备,可以减少设备100上物理输入控制设备(诸如下压按钮、拨号盘等等)的数量。In some embodiments, device 100 is a device in which the operation of a predefined set of functions on the device is performed exclusively through a touch screen and/or a touchpad. By using a touch screen and/or a touchpad as the primary input control device for operation of device 100, the number of physical input control devices (such as push buttons, dials, etc.) on device 100 can be reduced.
唯一地可通过触摸屏和/或触控板执行的该预定义的一组功能包括在用户界面之间的导航。在一些实施例中,当触控板被用户触摸时将设备100从可显示在设备100上的任何用户界面导航到主要菜单、主菜单或根菜单。在这样的实施例中,触控板可被称为“菜单按钮”。在一些其他实施例中,菜单按钮可以是物理下压按钮或者其他物理输入控制设备,而不是触控板。The predefined set of functions that are uniquely executable by the touch screen and/or trackpad include navigation between user interfaces. In some embodiments, device 100 is navigated from any user interface displayable on device 100 to a main menu, main menu, or root menu when the touchpad is touched by a user. In such an embodiment, the touchpad can be referred to as a "menu button." In some other embodiments, the menu button can be a physical push button or other physical input control device instead of a touchpad.
图2B是示出根据一些实施例的用于事件处理的示例性部件的框图。在一些实施例中,存储器102(图2A中)或存储器370(图4中)包括事件分类器170(例如,在操作系统126中)以及相应的应用程序136-1(例如,前述应用程序137-151、155、380-390中的任何应用程序)。2B is a block diagram showing exemplary components for event processing in accordance with some embodiments. In some embodiments, memory 102 (in FIG. 2A) or memory 370 (in FIG. 4) includes event classifier 170 (eg, in operating system 126) and corresponding application 136-1 (eg, aforementioned application 137) - any application in -151, 155, 380-390).
事件分类器170接收事件信息并确定要将事件信息传递到的应用程序136-1和应用程序136-1的应用程序视图191。事件分类器170包括事件监视器171和事件调度器模块174。在一些实施例中,应用程序136-1包括应用程序内部状态192,应用程序内部状态192指示当应用程序是活动的或正在执行时显示在触敏显示器112上的当前应用程序视图。在一些实施例中,设备/全局内部状态157被事件分类器170用来确定哪个(哪些)应用程序当前是活动的,并且应用程序内部状态192被事件分类器170用来确定要将事件信息传递到的应用程序视图191。The event classifier 170 receives the event information and determines the application 136-1 to which the event information is to be passed and the application view 191 of the application 136-1. The event classifier 170 includes an event monitor 171 and an event scheduler module 174. In some embodiments, application 136-1 includes an application internal state 192 that indicates a current application view that is displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, the device/global internal state 157 is used by the event classifier 170 to determine which application(s) are currently active, and the application internal state 192 is used by the event classifier 170 to determine that event information is to be passed. Go to the application view 191.
在一些实施例中,应用程序内部状态192包括另外的信息,诸如以下中一者或多者:当应用程序136-1恢复执行时将被使用的恢复信息、指示正被应用程序136-1显示的 信息或准备好用于被应用程序136-1显示的信息的用户界面状态信息、用于使得用户能够返回到应用程序136-1的前一状态或视图的状态队列、以及用户采取的先前动作的重复/撤销队列。In some embodiments, the application internal state 192 includes additional information, such as one or more of: recovery information to be used when the application 136-1 resumes execution, indicating that it is being displayed by the application 136-1 of Information or user interface state information ready for information displayed by application 136-1, a status queue for enabling a user to return to a previous state or view of application 136-1, and previous actions taken by the user Repeat/deactivate the queue.
事件监视器171从外围设备接口118接收事件信息。事件信息包括关于子事件(例如,触敏显示器112上的用户触摸,作为多点触摸手势的一部分)的信息。外围设备接口118传输其从I/O子系统106或传感器(诸如是接近传感器166)、加速度计168、和/或麦克风113(通过音频电路系统110)所接收的信息。外围设备接口118从I/O子系统106接收的信息包括来自触敏显示器112或触敏表面的信息。The event monitor 171 receives event information from the peripheral device interface 118. The event information includes information about sub-events (eg, user touches on the touch-sensitive display 112 as part of a multi-touch gesture). Peripheral device interface 118 transmits information it receives from I/O subsystem 106 or sensors (such as proximity sensor 166), accelerometer 168, and/or microphone 113 (via audio circuitry 110). The information that peripheral device interface 118 receives from I/O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.
在一些实施例中,事件监视器171以预先确定的间隔发送请求给外围设备接口118。作为响应,外围设备接口118传输事件信息。在其他实施例中,外围设备接口118仅当存在显著事件(例如,接收到高于预先确定的噪声阈值的输入和/或接收到超过预先确定的持续时间的输入)时传输事件信息。In some embodiments, event monitor 171 sends a request to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other embodiments, the peripheral device interface 118 transmits event information only when there is a significant event (eg, an input that is above a predetermined noise threshold is received and/or an input that exceeds a predetermined duration is received).
在一些实施例中,事件分类器170还包括命中视图确定模块172和/或活动事件识别器确定模块173。In some embodiments, event classifier 170 also includes hit view determination module 172 and/or activity event recognizer determination module 173.
当触敏显示器112显示多于一个视图时,命中视图确定模块172提供用于确定子事件已经在一个或多个视图内什么地方发生了的软件过程。视图由用户在显示器上可以看到的控件和其他元件构成。When the touch sensitive display 112 displays more than one view, the hit view determination module 172 provides a software process for determining where a sub-event has occurred within one or more views. The view consists of controls and other components that the user can see on the display.
与应用程序相关联的用户界面的另一方面是一组视图,本文中有时也称为应用程序视图或用户界面窗口,在其中显示信息以及发生基于触摸的手势。在其中检测到触摸的(相应应用程序的)应用程序视图可对应于在应用程序的程序化或视图分级结构内的程序化水平。例如,在其中检测到触摸的最低水平视图可被称为命中视图,并且被识别为正确输入的事件集可至少部分地基于始于基于触摸的手势的初始触摸的命中视图来确定。Another aspect of the user interface associated with the application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the respective application) in which the touch is detected may correspond to a programmatic level within the programmatic or view hierarchy of the application. For example, the lowest level view in which a touch is detected may be referred to as a hit view, and the set of events identified as being correctly entered may be determined based at least in part on a hit view of the initial touch that begins with the touch based gesture.
命中视图确定模块172接收与基于触摸的手势的子事件相关的信息。当应用程序具有被组织在分级结构中的多个视图时,命中视图确定模块172将命中视图识别为该分级结构中应该处理该子事件的最低视图。在大多数情形中,命中视图是发起子事件(即形成事件或潜在事件的子事件序列中的第一个子事件)在其中发生的最低水平视图。一旦命中视图被命中视图确定模块识别,命中视图通常接收与其被识别为命中视图所针对的同一触摸或输入源相关的所有子事件。The hit view determination module 172 receives information related to sub-events of the touch-based gesture. When the application has multiple views organized in a hierarchy, the hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should handle the sub-event. In most cases, the hit view is the lowest level view in which the sub-event (ie, the first sub-event in the sequence of sub-events that formed the event or potential event) is initiated. Once the hit view is identified by the hit view determination module, the hit view typically receives all of the sub-events associated with the same touch or input source for which it was identified as the hit view.
活动事件识别器确定模块173确定视图分级结构内的哪个或哪些视图应该接收特定的子事件序列。在一些实施例中,活动事件识别器确定模块173确定仅命中视图应该接 收特定的子事件序列。在其他实施例中,活动事件识别器确定模块173确定包括子事件物理位置的所有视图是活跃涉及的视图,并因此确定所有活跃涉及的视图应该接收特定子事件序列。在其他实施例中,即使触摸子事件完全被局限到与一特定视图相关联的区域,分级结构中更高的视图将仍然保持为活跃涉及的视图。The activity event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, the activity event recognizer determination module 173 determines that only the hit view should be picked up. Receive a specific sequence of sub-events. In other embodiments, the activity event recognizer determination module 173 determines that all views including the physical location of the sub-event are actively involved views, and thus determines that all actively involved views should receive a particular sequence of sub-events. In other embodiments, even if the touch sub-event is completely confined to the area associated with a particular view, the higher view in the hierarchy will remain as the active involved view.
事件调度器模块174将事件信息调度到事件识别器(例如,事件识别器180)。在包括活动事件识别器确定模块173的实施例中,事件调度器模块174将事件信息传递到由活动事件识别器确定模块173确定的事件识别器。在一些实施例中,事件调度器模块174在事件队列中存储事件信息,事件信息由相应事件接收器模块182检索。 Event scheduler module 174 dispatches event information to an event recognizer (e.g., event recognizer 180). In an embodiment that includes an activity event recognizer determination module 173, the event scheduler module 174 passes the event information to the event recognizer determined by the activity event recognizer determination module 173. In some embodiments, event scheduler module 174 stores event information in an event queue that is retrieved by respective event receiver module 182.
在一些实施例中,操作系统126包括事件分类器170。或者,应用程序136-1包括事件分类器170。在另一实施例中,事件分类器170是独立的模块,或者是存储在存储器102中的另一模块(诸如接触/移动模块130)的一部分。In some embodiments, operating system 126 includes an event classifier 170. Alternatively, application 136-1 includes event classifier 170. In another embodiment, event classifier 170 is a stand-alone module or is part of another module (such as contact/mobile module 130) stored in memory 102.
在一些实施例中,应用程序136-1包括多个事件处理程序190和一个或多个应用程序视图191,其中每一个都包括用于处理发生在应用程序的用户界面的相应视图内的触摸事件的指令。应用程序136-1的每个应用程序视图191包括一个或多个事件识别器180。通常,相应应用程序视图191包括多个事件识别器180。在其他实施例中,事件识别器180中的一个或多个是独立模块的一部份,独立模块诸如是用户界面工具包(未示出)或应用程序136-1从中继承方法和其他特性的更高水平对象。在一些实施例中,相应事件处理程序190包括以下中的一者或多者:数据更新器176、对象更新器177、GUI更新器178、和/或从事件分类器170接收的事件数据179。事件处理程序190可利用或调用数据更新器176、对象更新器177或GUI更新器178来更新应用程序内部状态192。或者,应用程序视图191中的一个或多个包括一个或多个相应事件处理程序190。另外,在一些实施例中,数据更新器176、对象更新器177、和GUI更新器178中的一个或多个被包括在相应应用程序视图191中。In some embodiments, the application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which includes a touch event for processing a respective view occurring within a user interface of the application. Instructions. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, the corresponding application view 191 includes a plurality of event recognizers 180. In other embodiments, one or more of the event recognizers 180 are part of a stand-alone module, such as a user interface toolkit (not shown) or from which the application 136-1 inherits methods and other features. Higher level objects. In some embodiments, the respective event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and/or event data 179 received from the event classifier 170. Event handler 190 can utilize or call data updater 176, object updater 177, or GUI updater 178 to update application internal state 192. Alternatively, one or more of the application views 191 include one or more respective event handlers 190. Additionally, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in respective application views 191.
相应的事件识别器180从事件分类器170接收事件信息(例如,事件数据179),并且从事件信息来标识事件。事件识别器180包括事件接收器182和事件比较器184。在一些实施例中,事件识别器180还至少包括以下的一个子组:元数据183、和事件传递指令188(其可以包括子事件传递指令)。The corresponding event recognizer 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event from the event information. Event recognizer 180 includes an event receiver 182 and an event comparator 184. In some embodiments, event recognizer 180 also includes at least one of the following subgroups: metadata 183, and event delivery instructions 188 (which may include sub-event delivery instructions).
事件接收器182从事件分类器170接收事件信息。事件信息包括关于子事件的信息,例如触摸或触摸移动。根据子事件,事件信息还包括另外的信息,诸如子事件的位置。当子事件涉及触摸的移动时,事件信息可还包括子事件的速率和方向。在一些实施例 中,事件包括设备从一个取向旋转到另一取向(例如,从纵向取向旋转到横向趋向,反之亦然),并且事件信息包括关于设备的当前取向(也被称为设备姿态)的相应信息。 Event receiver 182 receives event information from event classifier 170. The event information includes information about sub-events, such as touch or touch movement. Based on the sub-event, the event information also includes additional information, such as the location of the sub-event. When a sub-event involves movement of a touch, the event information may also include the rate and direction of the sub-event. In some embodiments The event includes the rotation of the device from one orientation to another (eg, from a portrait orientation to a landscape orientation, and vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as device gesture).
事件比较器184将事件信息与预定义的事件或子事件定义进行比较,并且基于该比较来确定事件或子事件、或者确定或更新事件或子事件的状态。在一些实施例中,事件比较器184包括事件定义186。事件定义186包含事件的定义(例如,预定义的子事件序列),例如事件1(187-1)、事件2(187-2)以及其他。在一些实施例中,事件187中的子事件例如包括触摸开始、触摸结束、触摸移动、触摸取消、和多点触摸。在一个实例中,事件1(187-1)的定义是在被显示对象上的双击。例如,该双击包括在被显示的对象上的预定时长的第一次触摸(触摸开始)、预定时长的第一次抬起(触摸结束)、在该被显示的对象上的预定时长的第二次触摸(触摸开始)、以及预定时长的第二次抬起(触摸结束)。在另一实例中,事件2(187-2)的定义是在被显示对象上的拖动。例如,该拖动包括在该被显示对象上的预定时长的触摸(或接触)、该触摸在触敏显示器112上的移动、以及该触摸的抬起(触摸结束)。在一些实施例中,事件还包括用于一个或多个相关联事件处理程序190的信息。 Event comparator 184 compares the event information to a predefined event or sub-event definition and determines an event or sub-event based on the comparison, or determines or updates the status of the event or sub-event. In some embodiments, event comparator 184 includes an event definition 186. Event definition 186 contains definitions of events (eg, predefined sub-event sequences), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in event 187 include, for example, touch start, touch end, touch movement, touch cancellation, and multi-touch. In one example, the definition of event 1 (187-1) is a double click on the displayed object. For example, the double tap includes a first touch of a predetermined duration on the displayed object (touch start), a first lift of the predetermined duration (touch end), a second predetermined time duration on the displayed object The second touch (touch start) and the second lift of the predetermined duration (touch end). In another example, the definition of event 2 (187-2) is a drag on the displayed object. For example, the drag includes a predetermined duration of touch (or contact) on the displayed object, movement of the touch on the touch-sensitive display 112, and lifting of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.
在一些实施例中,事件定义187包括用于相应用户界面对象的事件的定义。在一些实施例中,事件比较器184执行命中测试,以确定哪个用户界面对象与子事件相关联。例如,在其中在触摸显示器112上显示三个用户界面对象的应用程序视图中,当在触敏显示器112上检测到触摸时,事件比较器184执行命中测试,以确定这三个用户界面对象中哪一个与该触摸(子事件)相关联。如果每个所显示的对象与相应的事件处理程序190相关联,则事件比较器使用该命中测试的结果来确定哪个事件处理程序190应该被激活。例如,事件比较器184选择与触发该命中测试的对象和子事件相关联的事件处理程序。In some embodiments, event definition 187 includes definitions of events for respective user interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view in which three user interface objects are displayed on touch display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine among the three user interface objects. Which one is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler associated with the object and sub-event that triggered the hit test.
在一些实施例中,相应事件187的定义还包括延迟动作,延迟动作延迟事件信息的传递直到已经确定子事件序列确实对应于或确实不对应于事件识别器的事件类型之后。In some embodiments, the definition of the respective event 187 also includes a delay action that delays the delivery of the event information until after it has been determined that the sequence of sub-events does or does not correspond to the event type of the event recognizer.
当相应事件识别器180确定子事件串不与事件定义186中的任何事件匹配,则该相应事件识别器180进入事件不可能、事件失败、或事件结束状态,然后其不理会该基于触摸的手势的后续子事件。在这种情况下,对于命中视图保持活动的其他事件识别器(如果有的话)继续跟踪和处理正在进行的基于触摸的手势的子事件。When the corresponding event recognizer 180 determines that the sub-event string does not match any of the events in the event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event end state, and then ignores the touch-based gesture. Subsequent sub-events. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.
在一些实施例中,相应事件识别器180包括具有指示事件传递系统应该如何执行对活跃涉及的事件识别器的子事件传递的能配置的属性、标志和/或列表的元数据183。在一些实施例中,元数据183包括指示事件识别器彼此可如何交互的能配置的属性、标志 和/或列表。在一些实施例中,元数据183包括指示子事件是否被传递到视图或程序化分级结构中变化的水平的能配置的属性、标记和/或列表。In some embodiments, the respective event recognizer 180 includes metadata 183 having configurable properties, flags, and/or lists that indicate how the event delivery system should perform sub-event delivery to the event identifiers involved in the activity. In some embodiments, the metadata 183 includes configurable attributes, flags indicating how the event recognizers can interact with each other And / or list. In some embodiments, metadata 183 includes configurable attributes, tags, and/or lists that indicate whether a sub-event is passed to a level in a view or a programmed hierarchy.
在一些实施例中,当事件的一个或多个特定子事件被识别时,相应事件识别器180激活与事件相关联的事件处理程序190。在一些实施例中,相应事件识别器180将与该事件相关联的事件信息传递到事件处理程序190。激活事件处理程序190不同于发送(和延期发送)子事件到相应的命中视图。在一些实施例中,事件识别器180抛出与所识别的事件相关联的标志,并且与该标志相关联的事件处理程序190接到该标志并执行预定义的过程。In some embodiments, when one or more particular sub-events of an event are identified, the respective event recognizer 180 activates an event handler 190 associated with the event. In some embodiments, the respective event recognizer 180 passes event information associated with the event to the event handler 190. The activation event handler 190 is different from the send (and postponed) sub-event to the corresponding hit view. In some embodiments, event recognizer 180 throws a flag associated with the identified event, and event handler 190 associated with the flag receives the flag and performs a predefined process.
在一些实施例中,事件传递指令188包括传递关于子事件的事件信息而不激活事件处理程序的子事件传递指令。相反,子事件传递指令将事件信息传递到与子事件串相关联的事件处理程序或者传递到活跃涉及的视图。与子事件串或与活跃涉及的视图相关联的事件处理程序接收事件信息,并执行预先确定的过程。In some embodiments, the event delivery instructions 188 include sub-event delivery instructions that pass event information about sub-events without activating an event handler. Instead, the sub-event delivery instruction passes the event information to an event handler associated with the sub-event string or to the active involved view. An event handler associated with a sub-event string or with an active involved view receives event information and performs a predetermined process.
在一些实施例中,数据更新器176创建并更新在应用程序136-1中使用的数据。例如,数据更新器176更新在联系人模块137中使用的电话号码,或者存储在视频播放器模块145中使用的视频文件。在一些实施例中,对象更新器176创建并更新在应用程序136-1中使用的对象。例如,对象更新器177创建新的用户界面对象,或者更新用户界面对象的位置。GUI更新器178更新GUI。例如,GUI更新器178准备显示信息,并将其发送到图形模块132用以显示在触敏显示器上。In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, the data updater 176 updates the phone number used in the contact module 137 or stores the video file used in the video player module 145. In some embodiments, object updater 176 creates and updates objects used in application 136-1. For example, object updater 177 creates a new user interface object or updates the location of the user interface object. The GUI updater 178 updates the GUI. For example, GUI updater 178 is ready to display information and send it to graphics module 132 for display on a touch sensitive display.
在一些实施例中,事件处理程序190包括或者具有对数据更新器176、对象更新器177、和GUI更新器178的访问权限。在一些实施例中,数据更新器176、对象更新器177、和GUI更新器178被包括在相应应用程序136-1或应用程序视图191的单个模块中。在其他实施例中,它们被包括在两个或更多个软件模块中。In some embodiments, event handler 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of respective application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.
应当理解的是,前面关于触敏显示器上用户触摸的事件处理的讨论也适用于其他形式的利用输入设备来操作电子设备100的用户输入(并非它们所有都是在触摸屏上发起的),例如协调鼠标移动和鼠标按钮按压(具有或没有单个或多个键盘按压或保持)、触控板上的用户移动轻击、拖动、滚动等、触控笔输入、设备的移动、口头指令、检测到的眼睛移动、生物特征输入、和/或其任意组合,它们可以被用作为对应于定义要识别的事件的子事件的输入。It should be understood that the foregoing discussion of event handling of user touches on touch-sensitive displays is also applicable to other forms of user input that utilizes input devices to operate electronic device 100 (not all of which are initiated on a touch screen), such as coordination. Mouse movement and mouse button press (with or without single or multiple keyboard presses or hold), user movement on the touchpad, flick, drag, scroll, etc., stylus input, device movement, verbal command, detected Eye movements, biometric inputs, and/or any combination thereof, can be used as input corresponding to sub-events that define an event to be identified.
图3示出了根据一些实施例的具有触摸屏112的一种便携式电子设备100。触摸屏可以在用户界面(UI)200内显示一个或多个图形。在该实施例中,以及在下文中介绍的其他 实施例中,用户可以通过例如用一根或多根手指202(在附图中没有按比例绘制)或者用一个或多个触控笔203(在附图中没有按比例绘制)在图形上作出手势来选择这些图形中的一个或多个。在一些实施例中,当用户中断与该一个或多个图形的接触时,发生对一个或多个图形的选择。在一些实施例中,手势可包括一次或多次轻击、一次或多次滑动(从左向右、从右向左、向上和/或向下)和/或已经与设备100接触的手指(从右向左、从左向右、向上和/或向下)拨动。在一些实施例中,无意地与图形接触不会选择该图形。例如,当对应于选择的手势是轻击时,在应用程序图标之上扫动的轻扫手势不会选择相应的应用程序。FIG. 3 illustrates a portable electronic device 100 having a touch screen 112 in accordance with some embodiments. The touch screen can display one or more graphics within a user interface (UI) 200. In this embodiment, as well as other In an embodiment, the user may make a graphic representation by, for example, one or more fingers 202 (not drawn to scale in the drawings) or one or more styluses 203 (not drawn to scale in the drawings). Gestures to select one or more of these graphics. In some embodiments, the selection of one or more graphics occurs when the user interrupts contact with the one or more graphics. In some embodiments, the gesture may include one or more taps, one or more swipes (from left to right, from right to left, up and/or down) and/or fingers that have been in contact with device 100 ( Toggle from right to left, left to right, up and/or down. In some embodiments, unintentional contact with the graphic does not select the graphic. For example, when the gesture corresponding to the selection is a tap, the swipe gesture swiped over the application icon does not select the corresponding application.
设备100还可包括一个或多个物理按钮,诸如“主屏幕”或菜单按钮204。如前所述,菜单按钮204可以被用于导航到可以在设备100上运行的一组应用程序中的任何应用程序136。或者,在一些实施例中,菜单按钮被实现为显示在触摸屏112上的GUI中的软键。 Device 100 may also include one or more physical buttons, such as a "home screen" or menu button 204. As previously mentioned, menu button 204 can be used to navigate to any of a set of applications that can run on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key displayed in a GUI on touch screen 112.
在一个实施例中,设备100包括触摸屏112、菜单按钮204、用于设备开关机和锁定设备的下压按钮206、(一个或多个)音量调节按钮208、用户身份模块(SIM)卡槽210、耳麦插孔212、和对接/充电外部端口124。下压按钮206可被用于通过压下该按钮并将该按钮保持在压下状态达预定义的时间间隔来对设备进行开关机;通过压下该按钮并在经过该预定义的时间间隔之前释放该按钮来锁定设备;和/或解锁设备或发起解锁过程。在一另选的实施例中,设备100还可通过麦克风113接受用于激活或解除激活某些功能的语音输入。In one embodiment, device 100 includes touch screen 112, menu button 204, push button 206 for device power on and lock device, volume adjustment button(s) 208, user identity module (SIM) card slot 210 The headset jack 212, and the docking/charging external port 124. The push button 206 can be used to power the device by pressing the button and holding the button in a depressed state for a predefined time interval; by pressing the button and before the predefined time interval Release the button to lock the device; and/or unlock the device or initiate an unlocking process. In an alternative embodiment, device 100 may also accept voice input for activating or deactivating certain functions via microphone 113.
图4是根据一些实施例的具有显示器和触敏表面的一种示例性电子设备的框图。设备300不必是便携式的。在一些实施例中,设备300是膝上型计算机、台式计算机、平板电脑、多媒体播放器设备、导航设备、教育设备(诸如儿童学习玩具)、游戏系统或控制设备(例如,家用或工业用控制器)。设备300通常包括一个或多个处理单元(CPU)310、一个或多个网络或其他通信接口360、存储器370和用于将这些部件互联的一根或多根通信总线320。在一些实施例中,处理单元310包括图像信号处理器和双核或多核处理器。通信总线320可包括将系统部件互联及控制系统部件之间通信的电路系统(有时称为芯片组)。设备300包括具有显示器340的输入/输出(I/O)接口330,显示器340通常是触摸屏显示器。I/O接口330还可以包括键盘和/或鼠标(或其他指向设备)350和触控板355。设备300还包括光学传感器164和光学传感器控制器158。存储器370包括高速随机存取存储器,诸如DRAM、SRAM、DDR RAM或其他随机存取固态存储器设备;并可包括非易 失性存储器,诸如一个或多个磁盘存储设备、光盘存储设备、闪存设备、或其他非易失性固态存储设备。任选地,存储器370可包括从CPU 310远程定位的一个或多个存储设备。在一些实施例中,存储器370存储与便携式电子设备100(图2A)的存储器102中所存储的程序、模块和数据结构类似的程序、模块、和数据结构,或它们的子组。此外,存储器370可存储在便携式电子设备100的存储器102中不存在的另外的程序、模块、和数据结构。例如,设备300的存储器370可存储画图模块380、呈现模块382、文字处理模块384、网页创建模块386、盘编辑模块388、和/或电子表格模块390,而便携式电子设备100(图2A)的存储器102可不存储这些模块。4 is a block diagram of an exemplary electronic device having a display and a touch-sensitive surface, in accordance with some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop, desktop, tablet, multimedia player device, navigation device, educational device (such as a children's learning toy), gaming system, or control device (eg, home or industrial control) Device). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. In some embodiments, processing unit 310 includes an image signal processor and a dual or multi-core processor. Communication bus 320 may include circuitry (sometimes referred to as a chipset) that interconnects system components and controls communication between system components. Device 300 includes an input/output (I/O) interface 330 having a display 340, which is typically a touch screen display. The I/O interface 330 may also include a keyboard and/or mouse (or other pointing device) 350 and a trackpad 355. Device 300 also includes an optical sensor 164 and an optical sensor controller 158. The memory 370 includes a high speed random access memory such as DRAM, SRAM, DDR RAM or other random access solid state memory device; Loss of memory, such as one or more disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. Optionally, memory 370 can include one or more storage devices remotely located from CPU 310. In some embodiments, memory 370 stores programs, modules, and data structures similar to the programs, modules, and data structures stored in memory 102 of portable electronic device 100 (FIG. 2A), or a subset thereof. Moreover, memory 370 can store additional programs, modules, and data structures that are not present in memory 102 of portable electronic device 100. For example, memory 370 of device 300 can store drawing module 380, rendering module 382, word processing module 384, web page creation module 386, disk editing module 388, and/or spreadsheet module 390, while portable electronic device 100 (FIG. 2A) The memory 102 may not store these modules.
图4中上述所识别的元件的每一个可被存储在一个或多个前面提到的存储器设备中。上述所识别的模块的每一个对应于用于执行上述功能的一组指令。上述所识别的模块或程序(即,指令集)不必被实现为单独的软件程序、过程或模块,并且因此这些模块的各种子组可以在各种实施例中被组合或以其它方式重新布置。在一些实施例中,存储器370可存储上述模块和数据结构的子组。此外,存储器370可存储上面没有描述的另外的模块和数据结构。Each of the above identified components in Figure 4 can be stored in one or more of the aforementioned memory devices. Each of the above identified modules corresponds to a set of instructions for performing the functions described above. The above identified modules or programs (ie, sets of instructions) need not be implemented as separate software programs, procedures or modules, and thus various subsets of these modules may be combined or otherwise rearranged in various embodiments. . In some embodiments, memory 370 can store a subset of the modules and data structures described above. Moreover, memory 370 can store additional modules and data structures not described above.
现在将注意力转到可以在便携式电子设备100上实现的用户界面(“UI”)的实施例。Attention is now directed to an embodiment of a user interface ("UI") that can be implemented on portable electronic device 100.
图5示出了根据一些实施例的便携式电子设备100上用于应用程序菜单的一种示例性用户界面。类似的用户界面可以在设备300上实现。在一些实施例中,用户界面400包括以下元素或者其子组或超集:FIG. 5 illustrates an exemplary user interface for an application menu on the portable electronic device 100 in accordance with some embodiments. A similar user interface can be implemented on device 300. In some embodiments, user interface 400 includes the following elements or subgroups or supersets thereof:
●无线通信(诸如手机信号和Wi-Fi信号)的信号强度指示器402;a signal strength indicator 402 for wireless communication, such as cell phone signals and Wi-Fi signals;
●时间404;● time 404;
●蓝牙指示器405;Bluetooth indicator 405;
●电池状态指示器406;● battery status indicator 406;
●具有常用应用程序图标的托盘408,常用应用程序诸如:● A tray 408 with common application icons, commonly used applications such as:
■电话138,其可包括未接电话或语音留言消息的数量的指示器414;phone 138, which may include an indicator 414 of the number of missed calls or voicemail messages;
■电子邮件客户端140,其可包括未读电子邮件数量的指示器410;An email client 140, which may include an indicator 410 of the number of unread emails;
■浏览器147;以及browser 147; and
■视频和音乐播放器152,也被称为iPod(Apple Inc.的商标)模块152;以及■ Video and music player 152, also known as iPod (trademark of Apple Inc.) module 152;
■其他应用程序的图标,其他应用程序诸如:■ Icons for other applications, other applications such as:
◆IM 141;IM 141;
◆图像管理144;Image Management 144;
◆相机143; camera 143;
◆天气149-1;◆Weather 147-1;
◆股市149-2;◆Stock market 149-2;
◆锻炼支持142;exercise support 142;
◆日历148;calendar 148;
◆闹钟149-4;◆Alarm 149-4;
◆地图154;Map 154;
◆便笺153;◆Note 153;
◆设置412,其提供对设备100及其各种应用程序136的设置的访问;以及Setting 412, which provides access to settings of device 100 and its various applications 136;
◆在线视频模块155,也被称为YouTube(Google Inc.的商标)模块155。An online video module 155, also known as the YouTube (trademark of Google Inc.) module 155.
此外,虽然主要是参考手指输入(例如,单指接触、单指轻击手势、单指轻扫手势)来给出下面的示例,但是应当理解的是,在一些实施例中,这些手指输入中的一个或多个由来自另一输入设备的输入(例如,触控笔输入)替代。Moreover, while the following examples are primarily given with reference to finger input (eg, single finger contact, single finger tap gesture, single finger swipe gesture), it should be understood that in some embodiments, these finger inputs are One or more of the ones are replaced by inputs from another input device (eg, stylus input).
用户界面和相关联的过程User interface and associated processes
现在将关注点转到可以在具有显示器和触敏表面的电子设备(诸如设备300或便携式电子设备100)上实现的用户界面(“UI”)及相关联的过程的实施例。Embodiments of the user interface ("UI") and associated processes that can be implemented on an electronic device (such as device 300 or portable electronic device 100) having a display and a touch-sensitive surface are now turned to.
图6A-6C示出了根据一些实施例的用于删除对象(例如:应用程序)的示例性用户界面。这些附图中的用户界面被用于阐示下面介绍的过程和/或功能。6A-6C illustrate an exemplary user interface for deleting an object (eg, an application) in accordance with some embodiments. The user interfaces in these figures are used to illustrate the processes and/or functions described below.
在本发明实施例中,对象具体是指与显示的图标关联的目标指向物。例如图标A是显示在设备的触摸屏112上的应用程序A的图标,也即应用接口元素。那么,应用程序A就是与图标A关联的目标指向物。当一用户通过触敏表面对图标A进行接触时,也即激活图标A关联的应用程序A,使应用程序A的具体图形用户界面在触摸屏112上显示出来。另一方面,对象也可以是一个文件。例如激活图像管理应用程序144后,在触摸屏112上显示该应用程序的图形用户界面,而此时以缩略图显示的图像也可以认为是图标,该图标我们可以称之为文件接口元素,而该图标的目标指向物就是这个图标所关联的图像文件数据(例如JPG或者JEPG格式的图像)。所以当用户针对该图标进行的操作即为对其关联的图像文件数据进行的操作,例如修改该图标的命名等。激活该图标也即激活其关联的图像文件,使其显示在触摸屏112上。In the embodiment of the present invention, the object specifically refers to a target pointing object associated with the displayed icon. For example, icon A is an icon of application A displayed on touch screen 112 of the device, that is, an application interface element. Then, application A is the target pointing object associated with icon A. When a user makes contact with the icon A through the touch-sensitive surface, that is, the application A associated with the icon A is activated, the specific graphical user interface of the application A is displayed on the touch screen 112. On the other hand, the object can also be a file. For example, after the image management application 144 is activated, the graphical user interface of the application is displayed on the touch screen 112, and the image displayed as a thumbnail at this time can also be regarded as an icon, which can be referred to as a file interface element. The target point of the icon is the image file data associated with this icon (for example, an image in JPG or JEPG format). Therefore, when the user performs an operation on the icon, it is an operation performed on the associated image file data, such as modifying the naming of the icon. Activating the icon also activates its associated image file for display on touch screen 112.
为了选择一个对象,可以通过选择对象所关联的对象接口元素(诸如图标)来实现。 在一实施例中,对象接口元素可以被拖动或移动,当手指抬起时,与其关联的对象(诸如应用程序、文件等)被打开。在此参考触摸屏显示器大致地描述术语“选择”、“选定”、“移动”、“拖动”、“接触”、“触摸”以及“快速移动”。不过,在可替换实施例中,所述术语也意在包括就其它输入装置而言的所需用户动作。例如,就近程屏(proximity screen)而论,用户无需为了选择、移动或拖动对象接口元素或其它信息而直接与屏幕接触。因此,上述术语意在包括:用户仅需要位于设备附近以便执行所想要的功能。例如,当在邻近屏幕装置的场景中使用时,术语“接触”不会暗示用于激活邻近装置的直接接触,而是附近或接近的接触。In order to select an object, it can be achieved by selecting an object interface element (such as an icon) to which the object is associated. In an embodiment, the object interface element can be dragged or moved, and the object associated with it (such as an application, file, etc.) is opened when the finger is raised. The terms "select," "select," "move," "drag," "touch," "touch," and "fast move" are generally described herein with reference to a touch screen display. However, in alternative embodiments, the terms are also intended to include the required user actions with respect to other input devices. For example, in the case of a proximity screen, the user does not need to be in direct contact with the screen in order to select, move or drag object interface elements or other information. Therefore, the above terms are intended to include that the user only needs to be located near the device in order to perform the desired function. For example, when used in a scene adjacent to a screen device, the term "contact" does not imply a direct contact for activating an adjacent device, but a proximity or proximity contact.
图6A示出了在设备100的触摸屏112上显示的图形用户界面(GUI)。FIG. 6A illustrates a graphical user interface (GUI) displayed on touch screen 112 of device 100.
该图形用户界面上显示了多个对象接口元素(501-504),其中,对象接口元素501、502、503是应用程序图标,也即应用接口元素,每一个应用程序图标均与一个应用程序关联。对象接口元素504位文件图标,也即文件接口元素,每一个文件图标均与一个文件数据关联。本发明实施例通过作用在对象接口元素上的特定的手势,来对对象接口元素所关联的对象进行删除操作,这样大大提高了电子设备与用户之间的智能交互能力,也提高了电子设备处理事务的效率。A plurality of object interface elements (501-504) are displayed on the graphical user interface, wherein the object interface elements 501, 502, 503 are application icons, that is, application interface elements, and each application icon is associated with an application. . Object interface element 504 bit file icon, ie file interface element, each file icon is associated with a file data. The embodiment of the present invention deletes the object associated with the object interface element by using a specific gesture on the object interface element, thereby greatly improving the intelligent interaction capability between the electronic device and the user, and improving the processing of the electronic device. The efficiency of the transaction.
现在,我们以卸载应用程序为例子来详细说明本实施例。如图6A所示,触摸屏112可以检测到用户针对应用程序图标503的第一手势505,该第一手势可以为选择应用程序图标503的手势,该第一手势505可以是在选定应用程序图标503之后快速移动手指并抬起,迅速离开触摸屏表面。电子设备此时可以通过触摸屏112检测到第一手势505的手势速度和手势方向。Now, we will explain this embodiment in detail by taking an uninstall application as an example. As shown in FIG. 6A, the touch screen 112 can detect a first gesture 505 of the user for the application icon 503, which can be a gesture of selecting an application icon 503, which can be a selected application icon After 503, quickly move your finger and lift it up, and quickly leave the touch screen surface. The electronic device can now detect the gesture speed and gesture direction of the first gesture 505 through the touch screen 112.
电子设备的中央处理单元120通过触摸屏112接收的关于第一手势的数据,可以确定第一手势505的手势速度。具体如何确定属于现有技术,在此不再赘述。当中央处理单元120判断出该手势速度满足预定条件时,对上述应用程序图标503所关联的应用程序进行卸载。用户可以在存储器102中预先存储一个手势速度的阈值,当判断出检测到的手势速度大于或者等于该阈值时,中央处理单元120可以确定该第一手势属于在触摸屏上快速移动的手势,也即该第一手势505可以作为触发进行应用程序卸载的指令。当中央处理单元120将该第一手势编译为卸载指令后,该第一手势505所作用到的应用程序图标503关联的应用程序即被卸载。可以理解的是,在该关联的应用程序被卸载之前,可以辅助以动态GUI的形式显示在触摸屏112上,以向用户表明该应用程序即将被卸载,如图6B所示,图标507可以是动画显示,表示应用程序推特即将被卸载。当然也可以以其 他用户可感知的方式向用户表明该应用程序即将被卸载,本实施例在此不做限制。The central processing unit 120 of the electronic device can determine the gesture speed of the first gesture 505 through the data about the first gesture received by the touch screen 112. Specifically, it is determined that it belongs to the prior art, and details are not described herein again. When the central processing unit 120 determines that the gesture speed meets the predetermined condition, the application associated with the application icon 503 is uninstalled. The user may pre-store a threshold of a gesture speed in the memory 102. When it is determined that the detected gesture speed is greater than or equal to the threshold, the central processing unit 120 may determine that the first gesture belongs to a gesture that moves rapidly on the touch screen, that is, The first gesture 505 can be used as an instruction to trigger an application uninstallation. After the central processing unit 120 compiles the first gesture into an unloading instruction, the application associated with the application icon 503 to which the first gesture 505 is applied is unloaded. It can be understood that before the associated application is uninstalled, it can be displayed on the touch screen 112 in the form of a dynamic GUI to indicate to the user that the application is about to be uninstalled. As shown in FIG. 6B, the icon 507 can be an animation. Display, indicating that the application tweet is about to be uninstalled. Of course, you can also use it In a user-perceivable manner, the user is indicated that the application is about to be uninstalled, and the embodiment is not limited herein.
当然,在执行卸载命令之前,可以先以用户可感知的方式提示用户,表明该应用程序将被卸载用户是否同意。可以在接收到用户确认同意的指令后再执行卸载操作。Of course, before executing the uninstall command, the user can be prompted in a user-aware manner to indicate whether the application will be uninstalled or not. The uninstallation operation can be performed after receiving an instruction from the user to confirm the consent.
如图6C所示,在该应用程序被卸载后,当前图形用户界面可以重新布局。As shown in Figure 6C, the current graphical user interface can be re-arranged after the application is uninstalled.
在另外的一些实施例中,电子设备可以根据检测到的手势,对文件接口元素所关联的文件进行擦除。如图6A所示,触摸屏112可以检测到用户针对文件图标504(即文件接口元素)的第二手势,该第二手势可以为选择文件图标504的手势,该第二手势可以是在选定文件图标504之后快速移动手指并抬起,迅速离开触摸屏表面。电子设备此时可以通过触摸屏112检测到第二手势的手势速度。In still other embodiments, the electronic device can erase the file associated with the file interface element based on the detected gesture. As shown in FIG. 6A, the touch screen 112 can detect a second gesture of the user for the file icon 504 (ie, the file interface element), which can be a gesture of selecting the file icon 504, which can be After selecting the file icon 504, quickly move the finger and lift it up, quickly leaving the touch screen surface. The electronic device can now detect the gesture speed of the second gesture through the touch screen 112.
电子设备的中央处理单元120通过触摸屏112接收的关于第二手势的数据,可以确定第二手势的手势速度。具体如何确定属于现有技术,在此不再赘述。当中央处理单元120判断出该手势速度满足预定条件时,对上述文件图标504所关联的文件进行擦除。用户可以在存储器102中预先存储一个手势速度的阈值,当判断出检测到的手势速度大于或者等于该阈值时,中央处理单元120可以确定该第二手势属于在触摸屏上快速移动的手势,也即该第二手势可以作为触发进行文件擦除的指令。当中央处理单元120将该第二手势编译为擦除指令后,该第二手势所作用到的文件图标504所关联的文件即被擦除。可以理解的是,在该关联的文件数据被擦除之前,可以辅助以动态GUI的形式显示在触摸屏112上,以向用户表明该文件即将被擦除。当然也可以以其他用户可感知的方式向用户表明该文件将被擦除,本实施例在此不做限制。The central processing unit 120 of the electronic device can determine the gesture speed of the second gesture through the data about the second gesture received by the touch screen 112. Specifically, it is determined that it belongs to the prior art, and details are not described herein again. When the central processing unit 120 determines that the gesture speed satisfies the predetermined condition, the file associated with the file icon 504 is erased. The user may pre-store a threshold of a gesture speed in the memory 102. When it is determined that the detected gesture speed is greater than or equal to the threshold, the central processing unit 120 may determine that the second gesture belongs to a gesture that moves quickly on the touch screen. That is, the second gesture can be used as an instruction to trigger file erasure. When the central processing unit 120 compiles the second gesture into an erase command, the file associated with the file icon 504 to which the second gesture is applied is erased. It will be appreciated that the associated file data may be displayed on the touch screen 112 in the form of a dynamic GUI to indicate to the user that the file is about to be erased before the associated file data is erased. It is of course possible to indicate to the user that the file is to be erased in a manner that is sensible to other users. This embodiment is not limited herein.
在另外的一些实施例中,如果中央处理单元120检测到的手势速度信息小于所述阈值时,可以根据检测到的手势(例如上述第一手势或第二手势),移动对象接口元素(例如图标503、图标504)的位置。In still other embodiments, if the gesture speed information detected by the central processing unit 120 is less than the threshold, the object interface element may be moved according to the detected gesture (eg, the first gesture or the second gesture described above) (eg, The location of icon 503, icon 504).
在另外的一些实施例中,触摸屏112除了检测手势速度之外还可以检测手势方向,也即检测用户的手指具体是向触摸屏112的哪个方向快速移动。进一步地,在实施例中可以增加条件:中央处理单元120当手势速度大于或等于预定阈值,并且,手势方向是向所述触摸屏112的右侧时,则对第一手势所选定的应用程序进行卸载,或者对第二手势所选定的文件进行擦除。如图6A所示,图标506表示手势505的方向。In still other embodiments, the touch screen 112 can detect the gesture direction in addition to detecting the gesture speed, that is, detecting which direction the user's finger is moving toward the touch screen 112. Further, in the embodiment, a condition may be added: the central processing unit 120 selects an application selected for the first gesture when the gesture speed is greater than or equal to a predetermined threshold, and the gesture direction is to the right of the touch screen 112. Unload or erase the file selected by the second gesture. As shown in FIG. 6A, icon 506 represents the direction of gesture 505.
在另外的一些实施例中,在所述触摸屏112的触敏表面检测到针对应用程序图标503或者文件图标504的手势之前,中央处理单元120还可以判断上述图标所对应的对象是否可删除:如果所述对象是可删除的,则在所述触敏表面检测针对对象接口元素(也即图标 503或图标504)的手势;如果是不可删除的,则提示用户。In still other embodiments, before the touch-sensitive surface of the touch screen 112 detects a gesture for the application icon 503 or the file icon 504, the central processing unit 120 may further determine whether the object corresponding to the icon is erasable: The object is erasable, then detecting an object interface element (ie, an icon) on the touch-sensitive surface The gesture of 503 or icon 504); if it is not erasable, the user is prompted.
在另外的一些实施例中,上述手势还可以针对两个或两个以上的对象接口元素来进行操作,也即触摸屏112检测到的手势是针对两个或两个以上的图标来选定的。下面的实施例以两个对象接口元素作为示例来进行说明。In still other embodiments, the gestures described above may also operate for two or more object interface elements, ie, the gestures detected by touch screen 112 are selected for two or more icons. The following embodiment is illustrated with two object interface elements as an example.
举例来说,上述手势(包括第一手势或第二手势)所选定的对象接口元素具体可以为第一应用接口元素和第二应用接口元素,所述第一应用接口元素关联第一应用程序,所述第二应用接口元素关联第二应用程序。如图7A所示,第一应用接口元素(图标502)关联的是图像管理应用程序,第二应用接口元素(图标503)关联的是推特应用程序。触摸屏112检测到手势605,该手势起点在图标503上,然后沿着图标606所示的手势方向经过图标502,然后手指迅速抬起离开触摸屏112。我们可以认为,该手势605是针对第一应用接口元素(图标502)和第二应用接口元素(图标503)的。电子设备的中央处理单元120通过触摸屏112接收该手势605的数据,可以确定该手势605的手势速度。当中央处理单元120判断出该手势速度满足预定条件时,例如判断出该手势速度大于或等于预定阈值时,对上述第一应用接口元素(图标502)所关联的图像管理应用程序和第二应用接口元素(图标503)所关联的推特应用程序进行卸载。可以理解的是,在该关联的应用程序被卸载之前,可以辅助以动态GUI的形式显示在触摸屏112上,以向用户表明该应用程序即将被卸载。当然也可以以其他用户可感知的方式向用户表明该应用程序即将被卸载,本实施例在此不做限制。For example, the object interface element selected by the above gesture (including the first gesture or the second gesture) may specifically be a first application interface element and a second application interface element, where the first application interface element is associated with the first application. a program, the second application interface element associated with the second application. As shown in FIG. 7A, the first application interface element (icon 502) is associated with an image management application, and the second application interface element (icon 503) is associated with a Twitter application. The touch screen 112 detects a gesture 605 that begins on the icon 503 and then passes the icon 502 along the gesture direction shown by the icon 606, and then the finger quickly lifts off the touch screen 112. We can assume that the gesture 605 is for the first application interface element (icon 502) and the second application interface element (icon 503). The central processing unit 120 of the electronic device receives the data of the gesture 605 through the touch screen 112, and the gesture speed of the gesture 605 can be determined. When the central processing unit 120 determines that the gesture speed meets a predetermined condition, for example, determining that the gesture speed is greater than or equal to a predetermined threshold, the image management application and the second application associated with the first application interface element (icon 502) The tweet application associated with the interface element (icon 503) is unloaded. It will be appreciated that the associated application may be displayed on the touch screen 112 in the form of a dynamic GUI to indicate to the user that the application is about to be uninstalled before the associated application is uninstalled. It is of course possible to indicate to the user that the application is about to be uninstalled in a manner that is sensible to other users. This embodiment is not limited herein.
在另外的一些实施例中,上述手势(包括第一手势或第二手势)所选定的对象接口元素具体可以为第一文件接口元素和第二文件接口元素。所述第一文件接口元素关联第一文件数据,所述第二文件接口元素关联第二文件数据。如图7B所示,是用户在选定图6A中的图标502后激活打开的图库图形用户界面。在该界面中以缩略图图标的形式展示了图库里的照片或者视频,例如图标601所关联的是名称为4的图片文件数据,图标602所关联的是名称为5的视频文件数据,图标603所关联的是名称为6的图片文件数据。图片或者视频的具体格式在此不做限制。In some other embodiments, the object interface element selected by the gesture (including the first gesture or the second gesture) may specifically be a first file interface element and a second file interface element. The first file interface element is associated with first file data, and the second file interface element is associated with second file data. As shown in FIG. 7B, the user activates the open gallery graphical user interface upon selection of the icon 502 in FIG. 6A. In the interface, the photo or video in the gallery is displayed in the form of a thumbnail icon. For example, the icon 601 is associated with the image file data of the name 4, the icon 602 is associated with the video file data of the name 5, and the icon 603. Associated with the image file data named 6. The specific format of the picture or video is not limited here.
触摸屏112检测到手势607,该手势起点在图标601上,然后沿着图标606所示的手势方向经过图标602,然后手指迅速抬起离开触摸屏112。我们可以认为,该手势607是针对第一文件接口元素(图标601)和第二文件接口元素(图标602)的。电子设备的中央处理单元120通过触摸屏112接收该手势607的数据,可以确定该手势607的手势速度。当中央处理单元120判断出该手势速度满足预定条件时,例如判断出该手势速度大 于或等于预定阈值时,对上述第一文件接口元素(图标601)所关联的图像文件和第二文件接口元素(图标602)所关联的视频文件进行擦除。可以理解的是,在该关联的文件被擦除之前,可以辅助以动态GUI的形式显示在触摸屏112上,以向用户表明该图像文件和视频文件即将被擦除。当然也可以以其他用户可感知的方式向用户表明该文件即将被擦除,本实施例在此不做限制。The touch screen 112 detects a gesture 607 that begins on the icon 601 and then passes the icon 602 along the gesture direction shown by the icon 606, and then the finger quickly lifts off the touch screen 112. We can assume that the gesture 607 is for the first file interface element (icon 601) and the second file interface element (icon 602). The central processing unit 120 of the electronic device receives the data of the gesture 607 through the touch screen 112, and the gesture speed of the gesture 607 can be determined. When the central processing unit 120 determines that the gesture speed meets a predetermined condition, for example, it is determined that the gesture speed is large. At or equal to the predetermined threshold, the image file associated with the first file interface element (icon 601) and the video file associated with the second file interface element (icon 602) are erased. It will be appreciated that the associated file may be displayed on the touch screen 112 in the form of a dynamic GUI to indicate to the user that the image file and video file are about to be erased before the associated file is erased. It is of course possible to indicate to the user that the file is about to be erased in a manner that is sensible to other users. This embodiment is not limited herein.
在另外的一些实施例中,上述手势(包括第一手势或第二手势)所选定的对象接口元素具体可以为第三文件接口元素和第四应用接口元素。所述第三文件接口元素对应第三文件数据,所述第四应用接口元素对应第四应用程序。与上述实施例相同的是,在所述触摸屏112的触敏表面检测到针对所述第三文件接口元素和所述第四应用接口元素的手势后,中央处理单元120判断所述手势速度是否满足预定条件,当满足预定条件时,则对所述第三文件数据进行擦除和对所述第四应用程序进行卸载。In some other embodiments, the object interface element selected by the above gesture (including the first gesture or the second gesture) may specifically be a third file interface element and a fourth application interface element. The third file interface element corresponds to the third file data, and the fourth application interface element corresponds to the fourth application. The same as the above embodiment, after the touch sensitive surface of the touch screen 112 detects the gestures for the third file interface element and the fourth application interface element, the central processing unit 120 determines whether the gesture speed is satisfied. a predetermined condition, when the predetermined condition is satisfied, the third file data is erased and the fourth application is uninstalled.
在另外的一些实施例中,触摸屏112除了检测手势速度之外还可以检测手势方向,也即检测用户的手指具体是向触摸屏112的哪个方向快速移动。进一步地,在实施例中可以增加条件:中央处理单元120当手势速度大于或等于预定阈值,并且,手势方向是向所述触摸屏112的右侧时,则对第一手势所选定的应用程序进行卸载,或者对第二手势所选定的文件进行擦除。例如图7B中的图标608用以表明手势607的手势方向。In still other embodiments, the touch screen 112 can detect the gesture direction in addition to detecting the gesture speed, that is, detecting which direction the user's finger is moving toward the touch screen 112. Further, in the embodiment, a condition may be added: the central processing unit 120 selects an application selected for the first gesture when the gesture speed is greater than or equal to a predetermined threshold, and the gesture direction is to the right of the touch screen 112. Unload or erase the file selected by the second gesture. For example, icon 608 in Figure 7B is used to indicate the gesture direction of gesture 607.
在本文中,除非特别说明,用户的手势是灵活的,可以是点击,双击,画圈,画线,单指触碰,或多指触碰,等等。本领域普通技术人员可以理解,只要能达到基本相同的效果,具体手势的选择是灵活的。在本文中,除非特别说明,用户的手势作用于触敏表面的位置或区域也是灵活的,可以是显示屏显示的某个应用接口元素的区域或附近区域,显示屏不显示应用接口元素的空白区域,显示屏显示的某个功能设置的区域,等等。本领域普通技术人员可以理解,只要能达到基本相同的效果,手势作用于触敏表面的具体位置或区域是可以灵活设置的。In this article, unless otherwise specified, the user's gestures are flexible and can be click, double click, circle, draw line, single finger touch, or multi finger touch, and so on. One of ordinary skill in the art will appreciate that the selection of a particular gesture is flexible as long as substantially the same effect is achieved. In this document, unless otherwise specified, the position or area of the user's gesture acting on the touch-sensitive surface is flexible, and may be the area of an application interface element displayed on the display screen or a nearby area, and the display does not display the blank of the application interface element. Area, the display shows the area of a function setting, and so on. One of ordinary skill in the art will appreciate that the specific location or area of the gesture acting on the touch-sensitive surface can be flexibly set as long as substantially the same effect can be achieved.
在另外的一些实施例中,可以提供一种存储一个或多个程序的计算机可读存储介质,所述一个或多个程序包括指令,所述指令当被包括显示器以及多个应用程序的便携式电子设备执行时使所述便携式电子设备执行以下事件,其中,所述显示器包括触敏表面和显示屏。上述计算机可读存储介质可以用来执行上述实施例中的事件。In still other embodiments, a computer readable storage medium storing one or more programs, the instructions including instructions, when included in a portable electronic device including a display and a plurality of applications, can be provided The device, when executed, causes the portable electronic device to perform an event, wherein the display includes a touch-sensitive surface and a display screen. The above computer readable storage medium can be used to perform the events in the above embodiments.
在另外的一些实施例中,可以提供一种电子设备上的图形用户界面,所述电子设备包括显示器、存储器、多个应用程序、以及用于执行存储在所述存储器中的一个或多个程序的一个或多个处理器,其中,所述显示器包括触敏表面和显示屏,所述图形用户界 面包括上述实施例中所介绍的并且显示出来的图形用户界面。In still other embodiments, a graphical user interface on an electronic device can be provided, the electronic device including a display, a memory, a plurality of applications, and one or more programs for executing in the memory One or more processors, wherein the display includes a touch-sensitive surface and a display screen, the graphical user community The facets include the graphical user interface introduced and displayed in the above embodiments.
根据一些实施例,图8示出了根据上述本发明原理配置的一种电子设备700的功能框图。设备的功能块可由硬件、软件、或者软硬件组合实现,以执行本发明的原理。本领域的技术人员能够理解,图8中所述的功能块可被组合为或者被分离为子块,以实现上述的本发明的原理。因此,本文的描述可以支持本文所述功能块的任何可能的组合或分离或进一步限定。In accordance with some embodiments, FIG. 8 illustrates a functional block diagram of an electronic device 700 configured in accordance with the principles of the present invention described above. Functional blocks of a device may be implemented by hardware, software, or a combination of hardware and software to perform the principles of the invention. Those skilled in the art will appreciate that the functional blocks described in FIG. 8 can be combined or separated into sub-blocks to implement the principles of the invention described above. Accordingly, the description herein may support any possible combination or separation or further definition of the functional blocks described herein.
如图8中所示,电子设备700包括:触敏显示器单元701,触敏显示器单元701被配置为显示屏幕界面、并被配置为接收手势;以及处理单元702,该处理单元702耦接到触敏显示器单元701。在实施例中,上述触敏显示器单元701接收用户针对对象接口元素的手势,手势可以包括手势速度、手势方向;上述处理单元702获取触敏显示器单元701的手势,并判断手势速度是否大于或等于预定的阈值,如果处理单元702判断出手势速度大于或等于预定的阈值,则处理单元702删除与上述对象接口元素关联的对象。本实施例中对对象、对象接口元素等术语的含义参照以上实施例。电子设备700可以用来执行上述实施例中的技术方案。As shown in FIG. 8, the electronic device 700 includes a touch-sensitive display unit 701 configured to display a screen interface and configured to receive gestures, and a processing unit 702 coupled to the touch Sensitive display unit 701. In an embodiment, the touch-sensitive display unit 701 receives a gesture of the user for the object interface element, and the gesture may include a gesture speed and a gesture direction; the processing unit 702 acquires a gesture of the touch-sensitive display unit 701, and determines whether the gesture speed is greater than or equal to The predetermined threshold, if the processing unit 702 determines that the gesture speed is greater than or equal to a predetermined threshold, the processing unit 702 deletes the object associated with the object interface element. The meanings of terms such as objects, object interface elements, and the like in this embodiment are referred to the above embodiments. The electronic device 700 can be used to implement the technical solutions in the above embodiments.
在一些实施例中,处理单元702具体可以包括触屏接收单元7021、动作解释单元7022、事件分发单元7023、主屏幕接收单元7024、事件判断单元7025、应用程序卸载单元7026和文件擦除单元7027。In some embodiments, the processing unit 702 may specifically include a touch screen receiving unit 7021, a motion interpretation unit 7022, an event distribution unit 7023, a home screen receiving unit 7024, an event determining unit 7025, an application unloading unit 7026, and a file erasing unit 7027. .
以下对电子设备700的功能进行描述,本领域普通技术人员可以理解,以下的功能跟本文描述的电子设备、系统、装置、方法、图形用户界面、信息处理装置(例如:处理器芯片或者处理器芯片组)、计算机可读存储介质各个实施例是相呼应的,其互相结合和/或组合的各种情况均为本领域普通技术人员在理解本文以后可以直接而毫无疑义地想到的组合。The functions of the electronic device 700 are described below, and those skilled in the art can understand the following functions and the electronic devices, systems, devices, methods, graphical user interfaces, information processing devices (eg, processor chips or processors) described herein. The various embodiments of the computer-readable storage medium are echoed, and the various combinations and/or combinations of the various aspects are combinations that can be directly and unambiguously contemplated by those of ordinary skill in the art after understanding this document.
触屏接收单元7021:触敏显示器接收到用户手势触控屏幕操作的信号,该操作可以包括按下、移动、抬起等动作。The touch screen receiving unit 7021: the touch sensitive display receives a signal of the user gesture touch screen operation, and the operation may include pressing, moving, lifting, and the like.
动作解释单元7022:该单元用于把上述按下、移动、抬起等原始动作解释为点击、长按、快速移动等事件;The action interpretation unit 7022 is configured to interpret the original actions such as pressing, moving, lifting, etc. as events such as clicking, long pressing, fast moving, and the like;
事件分发单元7023:将系统动作解释单元中的事件传递给上层应用(如主屏幕接收单元7024);The event distribution unit 7023: the event in the system action interpretation unit is delivered to the upper layer application (such as the home screen receiving unit 7024);
主屏幕接收单元7024:主屏幕接收到上述事件,并且下发到该事件对应的下列处理单元中,执行与该事件所对应的过程; The main screen receiving unit 7024: the main screen receives the above event, and sends it to the following processing unit corresponding to the event, and executes a process corresponding to the event;
事件判断单元7025:判断当前的事件是否满足预定条件,例如手势的手势速度是否大于或者等于预定的阈值,在判断完成后启动其对应的处理单元;The event judging unit 7025: determining whether the current event satisfies a predetermined condition, for example, whether the gesture speed of the gesture is greater than or equal to a predetermined threshold, and starting the corresponding processing unit after the judgment is completed;
应用程序卸载单元7026:根据上述事件判断单元7025判断出手势的手势速度是大于或者等于预定的阈值,则对手势所点击的应用程序进行卸载;The application unloading unit 7026: according to the event determining unit 7025, determining that the gesture speed of the gesture is greater than or equal to a predetermined threshold, uninstalling the application clicked by the gesture;
文件擦除单元7027:根据上述事件判断单元7025判断出手势的手势速度是大于或者等于预定的阈值,则对手势所点击的文件进行擦除。The file erasing unit 7027: according to the event determining unit 7025, determining that the gesture speed of the gesture is greater than or equal to a predetermined threshold, erasing the file clicked by the gesture.
在上述实施例中,文件具体可以是图像管理应用程序中的图片、视频,也可以是联系人应用程序中的联系人。In the above embodiment, the file may specifically be a picture, a video in the image management application, or a contact in the contact application.
应当理解,本领域普通技术人员通过理解本文可以认识到上面参考图6A-6C、7A-7B所述的操作可由图2A-2B中所示的部件来实现。例如,事件分类器170中的事件监视器171检测在触敏显示器112上的接触,并且事件调度器模块174将事件信息传递到应用程序136-1。应用程序136-1的相应事件识别器180将事件信息与相应的事件定义186进行比较,并确定在触敏表面上第一位置处的第一接触是否对应于预定义的事件或子事件,诸如对用户界面上对象的选定。当检测到相应的预定义的事件或子事件时,事件识别器180激活与检测到该事件或子事件相关联的事件处理程序190。事件处理程序190可以利用或调用数据更新器176或对象更新器177来更新应用程序内部状态192。在一些实施例中,事件处理程序190访问相应GUI更新器178来更新应用程序显示的内容。类似地,本领域技术人员会清楚地知道基于在图2A-2B中所示的部件可如何实现其他过程。It will be appreciated that those of ordinary skill in the art will appreciate that the operations described above with reference to Figures 6A-6C, 7A-7B can be implemented by the components illustrated in Figures 2A-2B. For example, event monitor 171 in event sorter 170 detects contact on touch-sensitive display 112, and event scheduler module 174 passes the event information to application 136-1. The corresponding event recognizer 180 of the application 136-1 compares the event information with the corresponding event definition 186 and determines whether the first contact at the first location on the touch-sensitive surface corresponds to a predefined event or sub-event, such as The selection of objects on the user interface. Event detector 180 activates event handler 190 associated with detecting the event or sub-event when a corresponding predefined event or sub-event is detected. Event handler 190 can utilize or call data updater 176 or object updater 177 to update application internal state 192. In some embodiments, event handler 190 accesses corresponding GUI updater 178 to update the content displayed by the application. Similarly, it will be apparent to those skilled in the art how other processes may be implemented based on the components illustrated in Figures 2A-2B.
为了解释的目的,前面的描述是通过参考具体实施例来进行描述的。然而,上面的示例性的讨论并非意图是详尽的,也并非意图要将本发明限制到所公开的精确形式。根据以上教导内容,很多修改形式和变型形式都是可能的。选择和描述实施例是为了充分阐明本发明的原理及其实际应用,以由此使得本领域的其他技术人员能够充分利用具有适合于所构想的特定用途的各种修改的本发明以及各种实施例。 For the purposes of explanation, the foregoing description has been described by reference to the specific embodiments. However, the above illustrative discussions are not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in light of the above teachings. The embodiment was chosen and described in order to explain the embodiment of the invention and the embodiments of the invention example.

Claims (19)

  1. 一种便携式电子设备,包括:A portable electronic device comprising:
    显示器,其中,所述显示器包括触敏表面和显示屏;a display, wherein the display comprises a touch sensitive surface and a display screen;
    一个或多个处理器;One or more processors;
    存储器;Memory
    多个应用程序;以及Multiple applications; and
    一个或多个程序,其中所述一个或多个程序被存储在所述存储器中并被配置为被所述一个或多个处理器执行,所述一个或多个程序包括指令,所述指令用于:One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for to:
    在所述显示屏显示至少一个对象接口元素,所述至少一个对象接口元素关联至少一个对象;Displaying at least one object interface element on the display screen, the at least one object interface element associating at least one object;
    在所述触敏表面检测到针对所述至少一个对象接口元素的手势,所述手势包括手势速度和手势方向;Detecting a gesture for the at least one object interface element at the touch-sensitive surface, the gesture including a gesture speed and a gesture direction;
    当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除。The at least one object is deleted when the gesture speed and the gesture direction satisfy a predetermined condition.
  2. 如权利要求1所述的便携式电子设备,其特征在于,所述对象接口元素具体包括:应用接口元素或文件接口元素,所述应用接口元素关联应用程序,所述文件接口元素关联文件数据。The portable electronic device of claim 1, wherein the object interface element comprises: an application interface element or a file interface element, the application interface element associating an application, the file interface element associating file data.
  3. 如权利要求2所述的方法,其特征在于,所述预定条件具体包括:所述手势速度大于或等于预定阈值,并且,所述手势方向信息是向所述显示屏的右侧。The method of claim 2, wherein the predetermined condition specifically comprises: the gesture speed is greater than or equal to a predetermined threshold, and the gesture direction information is to a right side of the display screen.
  4. 如权利要求3所述的方法,其特征在于,当所述手势速度信息小于所述预定阈值时,根据检测到的所述手势,移动所述至少一个对象接口元素。The method of claim 3, wherein when the gesture speed information is less than the predetermined threshold, the at least one object interface element is moved according to the detected gesture.
  5. 如权利要求1所述的方法,其特征在于,在所述触敏表面检测到针对所述至少一个对象接口元素的手势之前,所述方法包括:判断所述至少一个对象是否可删除:如果所述至少一个对象是可删除的,则在所述触敏表面检测针对所述至少一个对象接口元素的手势;如果所述至少一个对象是不可删除的,则提示用户。 The method of claim 1 wherein before the touch sensitive surface detects a gesture for the at least one object interface element, the method includes determining whether the at least one object is erasable: if The at least one object is erasable, the gesture for the at least one object interface element is detected at the touch-sensitive surface; and the user is prompted if the at least one object is non-deletable.
  6. 如权利要求1或5所述的方法,其特征在于,所述至少一个对象接口元素具体为第一应用接口元素和第二应用接口元素,所述第一应用接口元素关联第一应用程序,所述第二应用接口元素关联第二应用程序;The method according to claim 1 or 5, wherein the at least one object interface element is specifically a first application interface element and a second application interface element, and the first application interface element is associated with the first application, The second application interface element is associated with the second application;
    其中,among them,
    所述在所述触敏表面检测到针对所述至少一个对象接口元素的手势,当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除,具体为:The detecting, at the touch-sensitive surface, a gesture for the at least one object interface element, when the gesture speed and the gesture direction satisfy a predetermined condition, deleting the at least one object, specifically:
    在所述触敏表面检测到针对所述第一应用接口元素和所述第二应用接口元素的手势;Gestures for the first application interface element and the second application interface element are detected at the touch sensitive surface;
    当所述手势速度和手势方向满足预定条件时,对所述第一应用程序和所述第二应用程序进行卸载。When the gesture speed and the gesture direction satisfy a predetermined condition, the first application and the second application are uninstalled.
  7. 如权利要求1或5所述的方法,其特征在于,所述至少一个对象接口元素具体为第一文件接口元素和第二文件接口元素,所述第一文件接口元素关联第一文件数据,所述第二文件接口元素关联第二文件数据;The method according to claim 1 or 5, wherein the at least one object interface element is specifically a first file interface element and a second file interface element, and the first file interface element is associated with the first file data. The second file interface element associates the second file data;
    其中,among them,
    所述在所述触敏表面检测到针对所述至少一个对象接口元素的手势,当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除,具体为:The detecting, at the touch-sensitive surface, a gesture for the at least one object interface element, when the gesture speed and the gesture direction satisfy a predetermined condition, deleting the at least one object, specifically:
    在所述触敏表面检测到针对所述第一文件接口元素和所述第二文件接口元素的手势;Gestures for the first file interface element and the second file interface element are detected on the touch sensitive surface;
    当所述手势速度和手势方向满足预定条件时,对所述第一文件数据和所述第二文件数据进行擦除。The first file data and the second file data are erased when the gesture speed and the gesture direction satisfy a predetermined condition.
  8. 如权利要求1或5所述的方法,其特征在于,所述至少一个对象接口元素具体为第三文件接口元素和第四应用接口元素,所述第三文件接口元素关联第三文件数据,所述第四应用接口元素关联第四应用程序;The method according to claim 1 or 5, wherein the at least one object interface element is specifically a third file interface element and a fourth application interface element, and the third file interface element is associated with the third file data. The fourth application interface element is associated with the fourth application;
    其中,among them,
    所述在所述触敏表面检测到针对所述至少一个对象接口元素的手势,当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除,具体为: The detecting, at the touch-sensitive surface, a gesture for the at least one object interface element, when the gesture speed and the gesture direction satisfy a predetermined condition, deleting the at least one object, specifically:
    在所述触敏表面检测到针对所述第三文件接口元素和所述第四应用接口元素的手势;Gestures for the third file interface element and the fourth application interface element are detected on the touch sensitive surface;
    当所述手势速度和手势方向满足预定条件时,对所述第三文件数据进行擦除和对所述第四应用程序进行卸载。When the gesture speed and the gesture direction satisfy a predetermined condition, the third file data is erased and the fourth application is unloaded.
  9. 一种删除对象的方法,用于包括显示器和多个应用程序的便携式电子设备,其中,所述显示器包括触敏表面和显示屏,其特征在于,所述方法包括:A method of deleting an object for a portable electronic device comprising a display and a plurality of applications, wherein the display comprises a touch-sensitive surface and a display screen, wherein the method comprises:
    在所述显示屏显示至少一个对象接口元素,所述至少一个对象接口元素关联至少一个对象;Displaying at least one object interface element on the display screen, the at least one object interface element associating at least one object;
    在所述触敏表面检测到针对所述至少一个对象接口元素的手势,所述手势包括手势速度信息和手势方向信息;Detecting a gesture for the at least one object interface element at the touch-sensitive surface, the gesture including gesture speed information and gesture direction information;
    当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除。The at least one object is deleted when the gesture speed and the gesture direction satisfy a predetermined condition.
  10. 如权利要求9所述的方法,其特征在于,所述对象接口元素具体包括:应用接口元素或文件接口元素,所述应用接口元素关联应用程序,所述文件接口元素关联文件数据。The method of claim 9, wherein the object interface element comprises: an application interface element or a file interface element, the application interface element associating an application, the file interface element associating file data.
  11. 如权利要求10所述的方法,其特征在于,所述预定条件具体包括:The method of claim 10, wherein the predetermined condition specifically comprises:
    所述手势速度大于或等于预定阈值,并且,所述手势方向信息是向所述显示屏的右侧。The gesture speed is greater than or equal to a predetermined threshold, and the gesture direction information is to the right of the display screen.
  12. 如权利要求11所述的方法,其特征在于,当所述手势速度信息小于所述预定阈值时,根据检测到的所述手势,移动所述至少一个对象接口元素。The method of claim 11 wherein when said gesture speed information is less than said predetermined threshold, said at least one object interface element is moved in accordance with said detected gesture.
  13. 如权利要求9或11所述的方法,其特征在于,在所述触敏表面检测到针对所述至少一个对象接口元素的手势之前,所述方法包括:The method of claim 9 or 11, wherein before the touch sensitive surface detects a gesture for the at least one object interface element, the method comprises:
    判断所述至少一个对象是否可删除:如果所述至少一个对象是可删除的,则在所述触敏表面检测针对所述至少一个对象接口元素的手势;如果所述至少一个对象是不可删除的,则提示用户。 Determining whether the at least one object is removable: if the at least one object is erasable, detecting a gesture for the at least one object interface element on the touch-sensitive surface; if the at least one object is undeletable , then prompt the user.
  14. 如权利要求9或11所述的方法,其特征在于,所述至少一个对象接口元素具体为第一应用接口元素和第二应用接口元素,所述第一应用接口元素关联第一应用程序,所述第二应用接口元素关联第二应用程序;The method according to claim 9 or 11, wherein the at least one object interface element is specifically a first application interface element and a second application interface element, and the first application interface element is associated with the first application, The second application interface element is associated with the second application;
    其中,among them,
    所述在所述触敏表面检测到针对所述至少一个对象接口元素的手势,当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除,具体为:The detecting, at the touch-sensitive surface, a gesture for the at least one object interface element, when the gesture speed and the gesture direction satisfy a predetermined condition, deleting the at least one object, specifically:
    在所述触敏表面检测到针对所述第一应用接口元素和所述第二应用接口元素的手势;Gestures for the first application interface element and the second application interface element are detected at the touch sensitive surface;
    当所述手势速度和手势方向满足预定条件时,对所述第一应用程序和所述第二应用程序进行卸载。When the gesture speed and the gesture direction satisfy a predetermined condition, the first application and the second application are uninstalled.
  15. 如权利要求9或11所述的方法,其特征在于,所述至少一个对象接口元素具体为第一文件接口元素和第二文件接口元素,所述第一文件接口元素关联第一文件数据,所述第二文件接口元素关联第二文件数据;The method according to claim 9 or 11, wherein the at least one object interface element is specifically a first file interface element and a second file interface element, and the first file interface element is associated with the first file data, The second file interface element associates the second file data;
    其中,among them,
    所述在所述触敏表面检测到针对所述至少一个对象接口元素的手势,当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除,具体为:The detecting, at the touch-sensitive surface, a gesture for the at least one object interface element, when the gesture speed and the gesture direction satisfy a predetermined condition, deleting the at least one object, specifically:
    在所述触敏表面检测到针对所述第一文件接口元素和所述第二文件接口元素的手势;Gestures for the first file interface element and the second file interface element are detected on the touch sensitive surface;
    当所述手势速度和手势方向满足预定条件时,对所述第一文件数据和所述第二文件数据进行擦除。The first file data and the second file data are erased when the gesture speed and the gesture direction satisfy a predetermined condition.
  16. 如权利要求9或11所述的方法,其特征在于,所述至少一个对象接口元素具体为第三文件接口元素和第四应用接口元素,所述第三文件接口元素关联第三文件数据,所述第四应用接口元素关联第四应用程序;The method according to claim 9 or 11, wherein the at least one object interface element is specifically a third file interface element and a fourth application interface element, and the third file interface element is associated with the third file data. The fourth application interface element is associated with the fourth application;
    其中,among them,
    所述在所述触敏表面检测到针对所述至少一个对象接口元素的手势,当所述手势速度和手势方向满足预定条件时,对所述至少一个对象进行删除,具体为: The detecting, at the touch-sensitive surface, a gesture for the at least one object interface element, when the gesture speed and the gesture direction satisfy a predetermined condition, deleting the at least one object, specifically:
    在所述触敏表面检测到针对所述第三文件接口元素和所述第四应用接口元素的手势;Gestures for the third file interface element and the fourth application interface element are detected on the touch sensitive surface;
    当所述手势速度和手势方向满足预定条件时,对所述第三文件数据进行擦除和对所述第四应用程序进行卸载。When the gesture speed and the gesture direction satisfy a predetermined condition, the third file data is erased and the fourth application is unloaded.
  17. 一种电子设备,其特征在于,所述电子设备具体包括:An electronic device, the electronic device specifically includes:
    触敏显示器单元,用于检测用户针对对象接口元素的手势,所述手势包括手势速度和手势方向,所述对象接口元素包括应用接口元素和文件接口元素;a touch-sensitive display unit for detecting a gesture of a user for an object interface element, the gesture includes a gesture speed and a gesture direction, and the object interface element includes an application interface element and a file interface element;
    处理单元,用于获取所述触敏显示器单元的手势,并判断所述手势是否满足预定条件:如果所述处理单元判断出手势满足预定条件,则删除与上述对象接口元素关联的对象。And a processing unit, configured to acquire a gesture of the touch-sensitive display unit, and determine whether the gesture satisfies a predetermined condition: if the processing unit determines that the gesture satisfies a predetermined condition, deleting an object associated with the object interface element.
  18. 如权利要求17所述的电子设备,其特征在于,所述预定条件具体包括:所述手势速度大于或等于预定阈值,并且,所述手势方向信息是向所述显示屏的右侧。The electronic device according to claim 17, wherein the predetermined condition specifically comprises: the gesture speed is greater than or equal to a predetermined threshold, and the gesture direction information is to a right side of the display screen.
  19. 如权利要求18所述的电子设备,其特征在于,在所述触敏显示器单元检测到针对对象接口元素的手势之前,所述处理单元还用于:The electronic device according to claim 18, wherein the processing unit is further configured to: before the touch sensitive display unit detects a gesture for the object interface element:
    判断所述对象是否可删除:如果所述对象是可删除的,则所述触敏显示器单元检测针对对象接口元素的手势;如果所述对象是不可删除的,则提示用户。 Determining whether the object is erasable: if the object is removable, the touch-sensitive display unit detects a gesture for the object interface element; if the object is non-deletable, prompts the user.
PCT/CN2016/108076 2015-12-03 2016-11-30 Electronic device and method for deleting object WO2017092680A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510883748.5 2015-12-03
CN201510883748.5A CN106843708A (en) 2015-12-03 2015-12-03 Electronic equipment and method for deleting object

Publications (1)

Publication Number Publication Date
WO2017092680A1 true WO2017092680A1 (en) 2017-06-08

Family

ID=58796349

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/108076 WO2017092680A1 (en) 2015-12-03 2016-11-30 Electronic device and method for deleting object

Country Status (2)

Country Link
CN (1) CN106843708A (en)
WO (1) WO2017092680A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108038130B (en) * 2017-11-17 2021-06-25 中国平安人寿保险股份有限公司 Automatic false user cleaning method, device, equipment and storage medium
EP3721268B1 (en) * 2018-06-05 2021-06-02 Google LLC Confidence-based application-specific user interactions
CN111857451B (en) * 2019-04-24 2022-06-24 网易(杭州)网络有限公司 Information editing interaction method and device, storage medium and processor

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102929555A (en) * 2012-10-29 2013-02-13 东莞宇龙通信科技有限公司 Terminal and application program uninstalling method
CN102968270A (en) * 2012-11-01 2013-03-13 广东欧珀移动通信有限公司 Data deleting method and terminal equipment thereof
CN102981762A (en) * 2012-11-14 2013-03-20 深圳桑菲消费通信有限公司 File deletion method and device
CN104731473A (en) * 2015-03-13 2015-06-24 酷派软件技术(深圳)有限公司 Operation response method and device based on icons

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103713799B (en) * 2012-09-29 2017-05-24 联想(北京)有限公司 Information processing method and electronic equipment
CN103324437A (en) * 2013-05-24 2013-09-25 东莞宇龙通信科技有限公司 Object bulk operation achievement method and device
CN104077145B (en) * 2014-07-11 2017-07-21 北京安兔兔科技有限公司 Applied program processing method and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102929555A (en) * 2012-10-29 2013-02-13 东莞宇龙通信科技有限公司 Terminal and application program uninstalling method
CN102968270A (en) * 2012-11-01 2013-03-13 广东欧珀移动通信有限公司 Data deleting method and terminal equipment thereof
CN102981762A (en) * 2012-11-14 2013-03-20 深圳桑菲消费通信有限公司 File deletion method and device
CN104731473A (en) * 2015-03-13 2015-06-24 酷派软件技术(深圳)有限公司 Operation response method and device based on icons

Also Published As

Publication number Publication date
CN106843708A (en) 2017-06-13

Similar Documents

Publication Publication Date Title
US20240078375A1 (en) Device, method, and graphical user interface for sharing a content object in a document
US20220124254A1 (en) Device, Method, and Graphical User Interface for Accessing an Application in a Locked Device
US10346012B2 (en) Device, method, and graphical user interface for resizing content viewing and text entry interfaces
US10007400B2 (en) Device, method, and graphical user interface for navigation of concurrently open software applications
US8826164B2 (en) Device, method, and graphical user interface for creating a new folder
US8806369B2 (en) Device, method, and graphical user interface for managing and interacting with concurrently open software applications
US9563351B2 (en) Device, method, and graphical user interface for navigating between document sections
TWI503737B (en) Methods,devices,and computer readable storage medium for configuring an electronic device to interpret key input signals from a keyboard
US20110167339A1 (en) Device, Method, and Graphical User Interface for Attachment Viewing and Editing
US20140006994A1 (en) Device, Method, and Graphical User Interface for Displaying a Virtual Keyboard
US20110163967A1 (en) Device, Method, and Graphical User Interface for Changing Pages in an Electronic Document
JP6378451B2 (en) Method and apparatus for processing new messages associated with an application
WO2017092680A1 (en) Electronic device and method for deleting object
JP6612351B2 (en) Device, method and graphic user interface used to move application interface elements
JP7002512B2 (en) Devices, methods and graphic user interfaces used to move application interface elements

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16869990

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16869990

Country of ref document: EP

Kind code of ref document: A1