KR20130031890A - Portable electronic device with a touch-sensitive display and navigation device and method - Google Patents

Abstract

The method includes detecting a touch at a location on a touch-sensitive display, receiving an input by the navigation device, and associated with at least one of the touch and the input in response to the passage of a period between detecting the touch and receiving the input. It involves performing a function.

Description

PORTABLE ELECTRONIC DEVICE WITH A TOUCH-SENSITIVE DISPLAY AND NAVIGATION DEVICE AND METHOD}

The present disclosure relates to electronic devices, including but not limited to touch-sensitive displays and portable electronic devices having control thereof.

Electronic devices, including portable electronic devices, have come into widespread use and can provide a variety of functions, including, for example, telephone, electronic messaging, and other personal information manage (PIM) application functionality. Portable electronic devices include many types of devices, including simple cellular phones, smart phones, wireless PDAs, and mobile stations such as wireless 702.11 or laptop computers with Bluetooth capabilities.

Portable electronic devices, such as PDAs or smart phones, are generally for handheld use and ease of portability. Smaller devices are generally preferred for portability. Touch-sensitive displays, also known as touchscreen displays, are particularly useful for handheld devices, which are small and have limited space for user input and output. Information displayed on the touch-sensitive display can be modified according to the function and operation being performed.

Improvements in devices with touch-sensitive displays are desirable.

The method includes detecting a touch at a location on a touch-sensitive display, receiving an input by a navigation device, and detecting at least one of the touch and the input in response to a passage of time between detecting the touch and receiving the input. Performing a function associated with one. The electronic device detects a touch at a touch-sensitive display, a navigation device, and a location on the touch-sensitive display, receives an input from the navigation device, and over time passes between detecting the touch and receiving the input. A processor operatively coupled to perform a function associated with at least one of a touch and an input in response.

According to the present invention, a portable electronic device and method having a touch-sensitive display and a navigation device can be provided.

1 is a block diagram of a portable electronic device according to the present disclosure.
2 and 3 are flowcharts illustrating a method of combining to select a function to perform on an electronic device in accordance with the present disclosure.
4-11 illustrate examples of touch and input to an electronic device in accordance with the present disclosure.

The following is associated with at least one of the touch and the input in response to the passage of a period between detecting a touch at a location on the touch-sensitive display, receiving an input by the navigation device, and detecting the touch and receiving the input. A method and electronic device comprising performing a function are described.

For simplicity and clarity of explanation, reference numerals may be repeated between the figures to indicate corresponding or analogous elements. Numerous details are set forth in order to provide an understanding of the embodiments described herein. Embodiments may be practiced without these details. In other instances, well known methods, procedures and components have not been described in order not to obscure the embodiments described herein. The description should not be considered as limited to the scope of the embodiments described herein.

The present disclosure relates generally to electronic devices, which in the embodiments described herein are portable electronic devices. Examples of portable electronic devices include mobile or handheld wireless communication devices such as pagers, cellular telephones, cellular smart phones, wireless electronic organizers, PDAs, wireless capable notebook computers, and the like. The portable electronic device may also be a portable electronic device without wireless communication capabilities such as a handheld electronic game device, digital photo album, digital camera or other device.

A block diagram of an example of a portable electronic device 100 is shown in FIG. 1. The portable electronic device 100 includes a number of components, such as a processor 102 that controls the overall operation of the portable electronic device 100. Communication functions, including data and voice communications, are performed through the communication subsystem 104. Data received by the portable electronic device 100 is decrypted and decoded by the decoder 106. Communication subsystem 104 receives a message from wireless network 150 and sends a message to wireless network 150. The wireless network 150 may be any type of wireless network, including but not limited to a data wireless network, a voice wireless network, and a network supporting both voice and data communications. A power source 142, such as one or more rechargeable batteries or ports to an external power source, powers the portable electronic device 100.

Processor 102 includes random access memory (RAM) 108, memory 110, and touch-sensitive overlay 114 operatively connected to electronic controller 116 to form touch-sensitive display 118 together. Display 112, auxiliary input / output (I / O) subsystem 124, data port 126, speakers 128, microphone 130, short range communication 132, and other device subsystems 134 Interact with other components, such as User interaction with the graphical user interface is performed via the touch sensitive overlay 114. Processor 102 interacts with touch-sensitive overlay 114 through electronic controller 116. Information such as text, letters, symbols, images, icons, and other items that can be displayed or rendered on the portable electronic device is displayed on the touch-sensitive display 118 through the processor 102. The processor 102 may interact with an accelerometer 136 that may be used to detect the direction of gravity or reaction forces induced by gravity. Optionally, processor 102 may interact with one or more actuators 120 and / or one or more force sensors 122.

The processor also interacts with navigation device 140, which may be, for example, a touch-sensitive track pad, trackball, optical joystick, or the like, to interface with a user to provide input. Navigation device 140 may be used, for example, to navigate information on the display, to control cursors or other indicators, to edit information, and so on. In the example shown, the navigation device 140 is located near the touch sensitive display 118. “Input” as used below refers to the gesture or other contact applied to the navigation device 140, or the interpretation of the gesture or contact by the navigation device 140.

To identify the subscriber for network access, portable electronic device 100 uses Subscriber Identity Module (SIM) or Removable User Identity Module (RUIM) card 138 for communication with a network, such as wireless network 150. do. Alternatively, user identification information can be programmed into memory 110.

The portable electronic device 100 includes an operating system 146 and a software program or component 148, which are executed by the processor 102 and are typically stored in permanent updateable storage, such as the memory 110. . Additional applications or programs may be carried over the wireless network 150, the auxiliary I / O subsystem 124, the data port 126, the short-range communications subsystem 132, or any other suitable subsystem 134. 100 may be loaded.

Received signals, such as text messages, e-mail messages, or web page downloads, are processed by communication subsystem 104 and entered into processor 102. Processor 102 processes the received signal for output to display 112 and / or secondary I / O subsystem 124. The subscriber may generate data items, such as e-mail messages, that may be transmitted over the wireless network 150 via the communication subsystem 104. In the case of voice communication, the overall operation of the portable electronic device 100 is similar. The speaker 128 outputs audible information converted from the electrical signal, and the microphone 130 converts the audible information into an electrical signal for processing.

The touch sensitive display 118 is capacitive, resistive, infrared, surface acoustic wave (SAW) touch sensitive display, strain gauge, optical imaging, and dispersive signal technology (DST) as is known in the art. May be any suitable touch-sensitive display, such as acoustic pulse recognition. Capacitive touch-sensitive display includes capacitive touch-sensitive overlay 114. Overlay 114 may be, for example, an assembly of multiple layers of a stack structure that may include a substrate, a ground shield layer, a barrier layer, one or more capacitive touch sensor layers separated by a substrate or other barrier, and a cover. Can be. The capacitive touch sensor layer can be any suitable material, such as patterned indium tin oxide (ITO).

One or more touches, also known as touch contacts or touch events, may be detected by the touch-sensitive display 118. The processor 102 receives touch data including the location of the touch. The touch data may include a single contact point, such as a contact area or a center point of or near the contact area. A signal is provided to the controller 116 in response to the detection of the touch. The touch can be detected from any suitable object, such as a finger, thumb or appendage. Controller 116 and / or processor 102 may detect the touch by any suitable contact member on touch-sensitive display 118. Multiple simultaneous touches can be detected.

One or more gestures may also be detected by the touch sensitive display 118. A swipe-like gesture, also known as a flick, is a specific type of touch on the touch-sensitive display 118 that starts at the origin point and continues to the end point. Gestures may be long or short in interval and / or duration. Two points of the gesture can be used to determine the direction of the gesture.

The optional actuator (s) 120 can be pressed by applying a force to the touch-sensitive display 118 sufficient to surpass the actuation force of the actuator 120. Actuator 120 may be activated by pressing anywhere on touch-sensitive display 118. Actuator 120 may actuate to provide input to processor 102. Operation of actuator 120 may result in the provision of tactile feedback.

The optional force sensor (s) 122 can provide force information related to the detected touch. Force information may be used to select information such as information associated with the location of the touch. For example, a touch that does not meet a force threshold may highlight a selection option, while a touch that meets a force threshold may select or enter that selection option. Selection options include "Cancel", "Delete" or "Unlock" function buttons, for example displayed or virtual keys on the keyboard, selection boxes or windows, for example playing or stopping the music player. Different magnitudes of force may be associated with different functions or inputs, for example, small forces may cause panning, and large forces may cause zooming.

Flowcharts illustrating a method of selecting a function to be performed by an electronic device, such as portable electronic device 100, are shown in FIGS. 2 and 3. The method may be performed by, for example, computer readable code executed by the processor 102. Coding of software to perform this method is within the scope of one of ordinary skill in the art, given the present specification. The method may include additional or fewer processes than shown and / or described, and may be performed in a different order. Computer readable media having computer readable code may be executable by at least processor 102 to perform a method. The process may be any suitable application, such as an email, text messaging, calendar, task, or address book, on any displayed screen, such as a home screen, a preference menu, or any other suitable application that the user can browse and / or select. For example, it may be performed in a list, a document, an index, a menu, and the like.

A touch associated with the function is detected (202). The touch may be associated with a function, for example, when the touch location is associated with a selectable feature, such as a key, box, or menu item displayed on the touch-sensitive display 118. If the touch location is near the navigation device 140 (204), the process continues to 206. For example, the touch position is within a predetermined distance of the navigation device 140, in a predetermined area of the touch-sensitive display 118, or in advance of an edge of the touch-sensitive display 118 closest to the navigation device 140. When within a determined distance, for example within 5 mm, the touch position is near the navigation device 140. If the touch location is not near the navigation device 140 (204), the process continues to 218.

Optionally, if the touch moves a distance greater than the threshold distance at 206, the process continues to 220 of FIG. 3. Gestures on the touch-sensitive display 118 may be, for example, values of 1/4 to 1/2 of the length of the touch-sensitive display 118, other suitable values such as 2 cm to 7 cm, user selection stored in the user profile. Extends a distance greater than the threshold distance, which may be a value, or any other suitable value. For example, a long gesture on a touch-sensitive display can result in an unintended touch on the navigation device 140. Input from the navigation device 140 may be filtered out based on the travel distance of the touch on the touch-sensitive display 118, ie the function associated with the input is not performed. At 206, if the touch has not moved a distance greater than the threshold distance or if the touch travel distance is not taken into account, the process continues to 208.

If at 208 an input from the navigation device 140 has been received within a predetermined period of time prior to detecting a touch, the process continues to 210. If at 208 no input from the navigation device 140 has been received within the predetermined period of time prior to detecting the touch, the process continues to 214. The time period can be any suitable time period, for example 30 ms. In this example, if the input from the navigation device 140 is received more than 30 ms prior to detecting a touch on the touch sensitive display 118 and is not received for a 30 ms period, the process continues to 214.

If the direction of input to the navigation device 140 at 210 is toward a touch, the process continues to 212. At 212 the function associated with the input is performed and the process continues to 202. Data from the touch on the touch-sensitive display 118 is not used and no function associated with the touch is performed. The function associated with the input may be a scrolling function, a selection function or any other suitable function, for example. If the direction of input to the navigation device 140 at 210 does not point to touch, then the process continues to 218. For example, if the scrolling or swiping on the navigation device 140 is in the direction of the touch sensitive display 118, which can be directed or obliquely directed to the touch position on the touch sensitive display 118, the navigation device ( The direction of the input from 140 is towards the touch.

The function associated with the touch is performed, and if an input is detected, the function associated with the input is also performed 218.

If an input from the navigation device 140 is received within a predetermined period of time after detecting the touch at 214, the process continues to 216. If no input from the navigation device 140 is received within the period after detecting the touch at 214, the process continues to 218. Instead of performing the function associated with the touch, the process waits for the period to elapse, for example by setting a timer to wait for input from the navigation device 140. This period is short in duration, for example 30 milliseconds, or another period to avoid unnecessary delay to the user. The user can optionally set a delay that can be stored in the user profile. This period may be the same as or different from the period between receiving an input from the navigation device 140 and detecting a touch, at 208.

If at 216 the input from the navigation device 140 is in a direction away from the touch on the touch-sensitive display 118, the process continues to 212. If the input from the navigation device 140 is not the direction away from the touch on the touch-sensitive display 118 at 216, the process continues to 218. Input from the navigation device 140 when the input from the navigation device 140 is in a direction away from the touch-sensitive display 118, which may be straight away or at an angle away from the touch location on the touch-sensitive display 118. It is in the direction away from this touch.

As described above, the touch on the touch-sensitive display 118 may be evaluated to identify which associated function to perform based on the touch and the input received before or after the touch. Navigation device 140 input may also be evaluated based on touch and input.

If the input from the navigation device 140 is received within a predetermined period before detecting the touch at 220, the process continues to 222. If the input from the navigation device 140 is not received within a predetermined period before detecting the touch at 220, the process continues to 228. This period can be any suitable period, for example 30 milliseconds. In this example, if the input from the navigation device 140 is received more than 30 ms prior to detecting a touch on the touch sensitive display 118 and has not been received for a 30 ms period, the process continues to 228.

If at 222 the movement of the touch along the touch-sensitive display 118 is in a direction away from the navigation device 140, the process continues to 224. The function associated with the touch is performed at 224, and the process continues to 202. The input from the navigation device 140 is not used and the function associated with the input is not performed. If the movement of the touch on the touch-sensitive display 118 is not the direction away from the navigation device 140 at 222, the process continues to 226. If the touch is, for example, a gesture on the touch-sensitive display 118, and the direction is far away from the navigation device 140 or obliquely away from the navigation device 140, the movement of the touch may be in a direction away from the navigation device 140. .

The function associated with the touch is performed, and if an input is detected, the function associated with the input is also performed (226).

If the input from the navigation device 140 is received within a predetermined period of time after detecting the touch at 228, the process continues to 230. If the input from the navigation device 140 is not received after detecting the touch and within the period at 228, the process continues to 226.

If the movement of the touch at 230 is the direction of the navigation device 140, the process continues to 224. If the movement of the touch at 230 is not the direction of the navigation device 140, the process continues to 226.

The process identifies which function to perform from the navigation device 140, the touch-sensitive display 118, or both, effectively clarifying the difference between the touch data and the navigation input and sometimes discarding the input or touch data. do. The navigation input may be discarded based on the travel distance of the touch on the touch-sensitive display 118, but the navigation input or touch may be discarded based on any other suitable factor. For example, navigation input may not be discarded or processed based on the touch period and / or the input period. Alternatively, all navigation device inputs may be used and associated functions may be performed. The touch information may be discarded based on other factors than described in the flowchart.

Examples of touch gestures and navigation input on portable electronic device 100 are illustrated in FIGS. 4-11. In the example of FIGS. 4-11, the navigation device 140 is an optical track pad located near one end of the touch-sensitive display 118. In the example it is simplified in that the direction of the touch or input is straight perpendicular to the drawing, but the method can be successfully applied even when the direction is at an angle obliquely, curved, zigzag and the like.

A gesture across the navigation device 140 may be used to scroll the displayed information, such as for example a list of email messages. For example, a gesture in a direction away from the touch-sensitive display 118 scrolls the information downward, and a gesture in a direction toward the touch-sensitive display 118 scrolls the information upward. For example, when scrolling quickly, depending on the scrolling direction, the user intends the touch-sensitive display 118 before scrolling using the navigation device 140 or after scrolling using the navigation device 140. You can touch it.

An example of a gesture according to navigation device 140 in FIG. 4 is illustrated by arrow 402 starting at a touch position on touch-sensitive display 118 illustrated by ellipse 404. Touch is detected at touch location 404 on touch-sensitive display 118. The touch is associated with a selectable feature, for example an email message, and is within a predetermined distance, for example 10 mm, of the edge of the touch-sensitive display 118 closest to the navigation device 140. The touch on the touch sensitive display 118 is a touch that is both short duration and distance. An input from the navigation device 140 has been received within 15 ms before detecting the touch, which is a gesture in the direction of the touch location 404. The list is scrolled based on the navigation device input. The email message associated with the touch is not selected.

In FIG. 5, an example of a touch position on the touch sensitive display 118 is illustrated by ellipse 504. Touch is detected at touch location 504 on touch-sensitive display 118. The touch is associated with the selectable email message and is within a predetermined distance, for example 10 mm, of the edge of the touch-sensitive display 118 closest to the navigation device 140. The time between detecting an input from the navigation device 140 and a touch is greater than a predetermined period of time, and the function associated with the touch position is performed. The email message is selected and opened.

An example of a gesture according to navigation device 140 in FIG. 6 is illustrated by arrow 602 leading along device 100 to a touch location on touch-sensitive display 118 illustrated by ellipse 604. Touch is detected at touch location 604 on touch-sensitive display 118. The touch is associated with the selectable email message and is within a predetermined distance, for example 10 mm, of the edge of the touch-sensitive display 118 closest to the navigation device 140. Input from the navigation device 140 is a gesture received within 15 ms of detecting a touch and in a direction towards the touch location 604. The list is scrolled based on the navigation device input. The email message associated with the touch is not selected.

In FIG. 7, an example of a gesture according to the navigation device 140 is illustrated by arrow 702. Touch is detected at touch location 704 on touch-sensitive display 118. The touch is at a location associated with the selectable email message, which location is not within a predetermined distance of the edge of the touch-sensitive display 118 closest to the navigation device 140. The list scrolls, and the email message associated with the touch is selected and opened.

Gestures on the touch-sensitive display 118 may be used to scroll the displayed information, such as for example a list of email messages. For example, a gesture in a direction away from the navigation device 140 scrolls the information downward, and a gesture in a direction toward the navigation device 140 scrolls the information upward. For example, when scrolling quickly, a user may unintentionally touch the input or navigation device 140 before or after scrolling, depending on the scroll direction.

An example of a touch gesture on touch-sensitive display 118 in FIG. 8 is illustrated by arrow 802 and followed by input using navigation device 140 as illustrated by ellipse 804. Touch on the touch-sensitive display 118 extends more than one half of the touch-sensitive display 118. The input from the navigation device 140 was received within 15 ms before detecting the touch, and the touch is not in a direction away from the navigation device 140. Functions associated with both touch and input are performed. For example, scrolling may be performed based on a touch on the touch-sensitive display 118, and selection may be made based on input from the navigation device 140.

An example of a touch gesture on touch-sensitive display 118 in FIG. 9 is illustrated by arrow 902 and begins as input using navigation device 140 as illustrated by ellipse 904. Touch on the touch-sensitive display 118 extends more than half of the length of the touch-sensitive display 118. An input from the navigation device 140 was received within 15 ms prior to detecting the touch and the touch is in a direction away from the navigation device 140. The function associated with the touch is performed. The function associated with the input is not performed.

An example of a touch gesture on touch-sensitive display 118 in FIG. 10 is illustrated by arrow 1002 and extends to input using navigation device 140 as illustrated by ellipse 1004. Touch on the touch-sensitive display 118 extends more than half of the length of the touch-sensitive display 118. An input from the navigation device 140 was received within 15 ms after detecting a touch in the direction of the navigation device 140. The function associated with the touch is performed. The function associated with the input is not performed.

An example of a touch gesture on touch sensitive display 118 in FIG. 11 is illustrated by arrow 1102 and input using navigation device 140 is illustrated by ellipse 1104. The touch on the touch-sensitive display 118 is not near the navigation device 140, that is, beyond the threshold distance, and the function associated with both touch and input is performed.

The process described above can be performed in any suitable application. Optionally, the process may optionally be used in an application such that the process is not activated for applications where a very fast response time to touch on a touch-sensitive display is desired. The process can also be activated or deactivated by selecting or toggling an option in a menu or submenu.

A touch sensitive display positioned close to the navigation device may be inadvertently touched during use of the navigation device, and the navigation device may be inadvertently touched during use of the touch sensitive display. Performing a function in response to an unintentional touch may result in corrective operation using additional device time and additional power, and may result in user dissatisfaction or dissatisfaction. Filtering out or eliminating touches based on touch location, timing for navigation device input, direction of navigation device input, and the like can reduce device usage time, reduce power requirements, and improve user interface.

This disclosure may be embodied in other specific forms without departing from the true meaning or essential features thereof. The described embodiments are to be considered in all respects only as illustrative and not restrictive. Accordingly, the scope of the disclosure is indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.

100: portable electronic device
140: navigation device

Claims (15)

Detecting a touch at a location on the touch-sensitive display;
Receiving an input by a navigation device; And
And performing a function associated with at least one of the touch and the input in response to a passage of time between detecting the touch and receiving the input. The method of claim 1, wherein the input comprises a scrolling input at the navigation device. The method of claim 1, wherein the function is performed in response to determining that the location is outside a predetermined area of the touch-sensitive display. The method of claim 1, wherein the function is performed in response to determining that the location is not within a predetermined distance of the navigation device. The method of claim 1, wherein the touch is detected before receiving the input. The method of claim 1, wherein the function associated with the touch is performed when the input is in a direction towards the location. The method of claim 1, wherein the input is received before detecting the touch. The method of claim 1, wherein the function associated with the touch is performed when the input is made in a direction away from the touch. The method of claim 1 including starting a timer to determine when the time period has elapsed. The method of claim 1, wherein the function is associated with the touch. The method of claim 1, wherein the function is associated with the input. The method of claim 1, wherein the function associated with the input is performed when the touch on the touch-sensitive display is not a moving touch. A computer readable medium having computer readable code executable by at least one processor of a portable electronic device to perform a method according to claim 1. Touch-sensitive display;
Navigation device; And
At least one of the touch and the input in response to the passage of a period between detecting a touch at a location on the touch-sensitive display, receiving an input from the navigation device, and detecting the touch and receiving the input. And a processor operatively coupled to perform a function associated with the. The portable electronic device of claim 14, wherein the navigation device comprises one of a touch-sensitive track pad, trackball, and an optical joystick.

Images