TWI453651B - Portable electronic device and method of controlling same - Google Patents

Description

Portable electronic device and method for controlling same

The present invention relates to control of portable electronic devices (including but not limited to portable electronic devices having touch screen displays) and the like.

Electronic devices including portable electronic devices are widely used and provide a variety of functions including, for example, telephony, electronic messaging, and other personal information manager (PIM) application functions. Portable electronic devices include, for example, several types of mobile stations, such as simple cellular phones, smart phones, wireless personal digital assistants (PDAs), and laptops with wireless 802.11 or Bluetooth capabilities.

Portable electronic devices, such as PDAs or smart phones, are generally intended for handheld use and are convenient for portability. Smaller devices are generally expected to be portable. A touch sensitive display (also known as a touch screen display) is particularly useful on handheld devices that are small and have limited space for user input and output. The information displayed on the touch-sensitive display can be modified depending on the functions and operations performed. With the continuing demand for reduced size of portable electronic devices, touch-sensitive displays continue to decrease in size.

Improvements in electronic devices with touch-sensitive displays are desired.

A method of controlling a portable electronic device having a touch-sensitive display includes: displaying information on the touch-sensitive display; detecting a gesture on the touch-sensitive display; and when the gesture is associated with the touch-sensitive display An area is scrolled through the information in a first scroll mode; and the information is scrolled through the information in a second scroll mode when the gesture is associated with the second region of one of the touch sensitive displays.

A computer readable medium having computer readable code embodied therein executable by at least one processor of a portable electronic device to implement the above method.

A portable electronic device includes a touch sensitive display configured to display information. a processor configured to: detect a gesture on the touch-sensitive display; and when the gesture is associated with a first region of the touch-sensitive display, scrolling through the information in a first scrolling mode; And when the gesture is associated with the second region of one of the touch sensitive displays, scrolling through the information in a second scrolling mode.

An apparatus and method for scrolling through information displayed on a touch sensitive display of a portable electronic device is set forth below. Detecting a gesture on the touch-sensitive display and determining one of the origins and directions of the gesture. The information is scrolled in a pattern that depends on the origin of the gesture.

For simplicity and clarity of illustration, reference numerals may be repeated among the figures to indicate corresponding or similar elements. Numerous details are set forth to provide an understanding of one of the embodiments set forth herein. The embodiments may be practiced without these details. In the other examples, well-known methods, procedures, and components are not described in detail to avoid obscuring the illustrated embodiments. This description should not be considered as limited to the scope of the embodiments set forth herein.

The present invention relates generally to an electronic device that is a portable electronic device in the embodiments set forth herein. Examples of portable electronic devices include mobile or handheld wireless communication devices, such as pagers, cellular phones, cellular smart phones, wireless notebooks, personal digital assistants, wireless capable notebook computers, and the like. The portable electronic device can also be a portable electronic device that does not have wireless communication capabilities, such as a handheld electronic game device, a digital photo album, a digital camera, or other devices.

One block diagram of one example of a portable electronic device 100 is shown in FIG. The portable electronic device 100 includes a plurality of components, such as a processor 102 that controls the overall operation of the portable electronic device 100. The communication function is performed through a communication subsystem 104, including data and voice communication. The data received by the portable electronic device 100 is decompressed and decrypted by a decoder 106. Communication subsystem 104 receives a message from a wireless network 150 and sends a message to the wireless network. Wireless network 150 can be any type of wireless network, including but not limited to data wireless networks, voice wireless networks, and networks that support both voice and data communications. A power source 142, such as one or more rechargeable batteries or to one of the external power supplies, powers the portable electronic device 100.

The processor 102 interacts with other components, such as a random access memory (RAM) 108, a memory 110, and a display 112 operatively coupled to one of the touch sensitive overlays 114 of an electronic controller 116 (which together Forming a touch sensitive display 118), one or more actuators 120, one or more force sensors 122, an auxiliary input/output (I/O) subsystem 124, a data 埠126, a speaker 128, A microphone 130, short range communication 132, and other device subsystems 134. Interaction with a graphical user interface is performed through the touch sensitive overlay 114. The processor 102 interacts with the touch sensitive overlay 114 via the electronic controller 116. Information, such as text, characters, symbols, images, icons, and other items that can be displayed or rendered on a portable electronic device, is displayed via the processor 102 on the touch-sensitive display 118. The processor 102 can interact with one of the accelerometers 136 that can be used to detect gravity or gravity induced reaction forces.

To identify a user accessing the network, the portable electronic device 100 uses a user identity module or a removable user identity module (SIM/RUIM) card 138 to communicate with a network (such as a wireless network). Road 150) communication. Alternatively, the user identification information can be programmed into the memory 110.

The portable electronic device 100 includes an operating system 146 and software programs or components 148 that are executed by the processor 102 and are typically stored in a persistent, updatable storage such as the memory 110. Additional applications or programs can be loaded onto the portable electronic device 100 via the wireless network 150, the auxiliary I/O subsystem 124, the data port 126, the short-range communication subsystem 132, or any other suitable subsystem 134.

A received signal (such as a text message, an email message, or a web page download) is processed by communication subsystem 104 and input to processor 102. The processor 102 processes the received signals for output to the display 112 and/or to the auxiliary I/O subsystem 124. A user may generate data items, for example, email messages, etc., which may be transmitted over wireless network 150 via communication subsystem 104. For voice communications, the overall operation of portable electronic device 100 is similar. The speaker 128 outputs the audio information converted from the electrical signal, and the microphone 130 converts the audio information into an electrical signal for processing.

The touch sensitive display 118 can be any suitable touch sensitive display, such as a capacitive, resistive, infrared, surface acoustic wave (SAW) touch sensitive display, strain gauge, optical imaging, dispersive signal technology, acoustic pulse identification, and the like. As is known in the art. A capacitive touch sensitive display includes a capacitive touch sensitive overlay 114. The cladding layer 114 can comprise, for example, a substrate, a grounding shield layer, a barrier layer, one or more capacitive touch sensor layers separated by a substrate or other barrier, and a stack of a cover layer. One of the multiple layers in the assembly. The capacitive touch sensor layers can be any suitable material, such as patterned indium tin oxide (ITO).

One or more touches (also known as touch contacts or touch events) can be detected by the touch sensitive display 118. The processor 102 can determine the properties of the touch, including a location of a touch. The touch location data can include a contact area or a single contact point, such as a point at or near one of the centers of the contact area. A position at which the touch is detected may include x and y components relative to a view of the touch sensitive display 118, such as a horizontal component and a vertical component, respectively. For example, the x position component can be determined by generating a signal from a touch sensor, and the y position component can be determined by generating a signal from another touch sensor. A signal is provided to controller 116 in response to a touch detection. One touch can be detected from any suitable object, such as a finger, thumb, appendage, or other item, for example, a stylus, pen, or other pointer, depending on the nature of the touch-sensitive display 118. Can detect multiple simultaneous touches.

The actuator 120 can be depressed by applying sufficient force to the touch sensitive display 118 to overcome the actuation force of the actuator 120. Actuator 120 can be actuated by pressing anywhere on touch-sensitive display 118. Actuator 120 can provide input to processor 102 when actuated. Actuation of the actuator 120 can cause tactile feedback to be provided.

A mechanical dome switch actuator can be utilized. In this example, tactile feedback is provided when the pan is collapsed due to the force imparted and when the pan returns to the rest position after the switch is released.

Alternatively, actuator 120 can include one or more piezo actuators that provide tactile feedback to touch-sensitive display 118. The contraction of the (or the like) piezoelectric actuator applies, for example, a spring force of a force opposite to one of the forces applied externally to the touch sensitive display 118. Each piezoelectric actuator includes a piezoelectric device attached to a substrate, such as a metal substrate, such as a piezoelectric disk. The substrate is bent when the piezoelectric device contracts due to charge/voltage build-up at the piezoelectric device or in response to a force, such as an external force applied to one of the touch-sensitive displays 118. The charge/voltage can be adjusted by varying the applied voltage or current, thereby controlling the force applied by the piezoelectric actuator. The charge/voltage at the piezoelectric actuator can be removed by a controlled discharge current that causes the piezoelectric device to expand, thereby releasing the force, thereby reducing the piezoelectric The force exerted by the actuator. It may be advantageous to remove the charge/voltage for a relatively short period of time to provide tactile feedback to the user. In the absence of an external force and in the absence of a charge/voltage at the piezoelectric actuator, the piezoelectric actuator may be slightly curved due to a mechanical preload.

The touch sensitive display 118 is configured to display from an application in a display area (such as a web browser, address book, email, calendar, music player, spreadsheet, word processor, operating system interface) Etc.) Information. A virtual keyboard can be displayed, for example, in an input area below the display area in the orientation of the portable electronic device 100, and the virtual keyboard includes keys for keying digits, punctuation, or symbols.

Touch sensitive display 118 is also configured to detect a gesture. A gesture (such as a wipe) is a type of touch, also known as a tap, that begins at an origin and continues to an end while maintaining touch contact. A slip can be long or short in distance and/or duration. The two points of the wipe are used to determine a vector describing one of the directions of the wipe. The direction may be referenced relative to the orientation of the touch sensitive display 118, the information displayed on the touch sensitive display 118, or another reference. For the purposes of providing a reference, the "level" utilized herein is generally from left to right or from right to left with respect to the orientation of the displayed information, and the "vertical" utilized herein is relative to the display. The orientation of the information is generally up or down. The origin and the end point of the sliding wipe can be used to determine the magnitude or distance of the slip. The duration of the slip is determined in time based on the origin and the end point of the slip. Controller 116 and/or processor 102 determines the direction, magnitude, and/or duration of the wipe.

When a gesture (such as a swipe) is detected and it is associated with the display area of the touch-sensitive display 118, page scrolling within the information occurs. Page scrolling is a scrolling mode in which information can be advanced or retracted while displaying information. The direction in which the page is scrolled can be based on the direction of the wipe. When a wiper is associated with the input area of the touch sensitive display 118, cursor scrolling of the information occurs. The cursor scrolling system reproduces one of the cursors on the touch-sensitive display 118 and can advance or retreat (which depends on the direction of the wipe) through a scrolling mode of information displayed on the touch-sensitive display. While maintaining the display of the cursor, the cursor scrolls through the information. Another option is to use cursor scrolling when a gesture is associated with the display area, and page scrolling can be utilized when a gesture is associated with the input area.

Since one of the touch sensitive displays 118 on a portable electronic device 100 is typically relatively small, the amount of information displayed is typically much less than that displayed on, for example, a computer monitor or other larger device. The amount of information. Based on the screen size and the memory capabilities of the device that controls the display of information on the screen, information from an application can be used to display using a number of scrolling techniques. The amount of information is usually matched to a screen or window more than once.

Information may include, for example, a web page, electronic messaging or mailing text, address book details, calendar event details, spreadsheet data, text or word processing, to name a few. For example, when the calendar event details are typed to schedule a calendar event, the calendar application can display 10 lines of information at a time, while displaying a virtual keyboard for typing data in the field of the calendar event. However, the calendar event can contain 50 lines of information. Typically, a user can advance or rewind through the information by scrolling using a control device such as a button or menu option. Using gesture-based associativity (such as the origin, endpoint, or other attributes of a gesture) to determine a scrolling mode rather than selecting a button or using a menu promotes faster, seamless navigation and interaction. Page scrolling or cursor scrolling can be done at any time or at any time. The process of navigating to view, add, delete, and edit data is faster without having to find and press a button or enter a menu.

An example of a touch sensitive display 118 before and after scrolling in a first mode is shown in FIG. 2, and an example of a touch sensitive display 118 before and after scrolling in a second mode is shown in FIG. . In these examples, portable electronic device 100 is used to compose and send an email using an email application. The typed information is displayed in display area 202 of one of touch-sensitive displays 118, and a virtual keyboard is displayed in one of input areas 204 of touch-sensitive display 118. Display area 202 is placed over input area 204 in an orientation that displays the information. The virtual keyboard includes keys for typing characters (such as letters, numbers, punctuation, symbols, etc.) and functions for composing an email (such as switching, entering or deleting) and can be a simplified keyboard, where At least some of the keys are associated with a plurality of alphabetically alphabetic letters. Optionally, the keyboard can be a full keyboard, with each alphabetically alphabetic letter associated with a respective key.

The information includes, for example, an email header field (such as a "Recipient" field, a "Cc" field, a "Subject" field), and a body field. Each of the fields of the email may be edited during the composing of the email and a cursor 206 is displayed to be rendered in the message. The cursor 206 indicates, for example, a location within the information that can be added, deleted, or edited. The user can scroll through the email to view or edit any of the fields of the email in page scroll mode. The origin 208 is shown in the display area 202 on the touch-sensitive display 118 in FIG. 2 and the direction of the gesture is down relative to the displayed information, reaching the end of the tip of the arrow 210. When the gesture is detected, the touch sensitive display 118 advances through the information, thereby displaying different information. Similarly, page scrolling can be in the opposite direction to display previous information using one of the upward gestures relative to the displayed information, and wherein the origin of the gesture is in display area 202. The page scrolling can additionally occur in a horizontal direction relative to the displayed information.

Depending on the situation, the length of the gesture (depending on distance or duration) can be used to determine which portion of the information to display or to determine how far forward or backward the information is to be. Two, three or more levels of difference can be utilized. For example, a two-level system divides gestures into short gestures and long gestures, where one or more thresholds are utilized to determine whether a gesture is considered a long gesture or a short gesture. A short gesture advances or retreats the information by a certain amount, such as shown in Figure 2, and a long gesture advances or rewinds the information by a greater amount.

A long gesture can be used to jump to the end of the message or start or can be interpreted as an amount that advances or rewinds the information. The amount of scrolling can vary depending on the amount of information.

The three-level system divides gestures into short gestures, medium gestures, and long gestures, where two or more thresholds are utilized to determine whether a gesture is considered a short gesture, a medium gesture, or a long gesture. For example, a short gesture can be interpreted as a forward or backward amount, a medium gesture can be interpreted as a greater amount of forward or backward, and a long gesture can be interpreted as advancing or retreating to the end or beginning of the message. The threshold of length can be based on the size of the touch sensitive display 118. Alternatively, the long gesture can be interpreted as a gesture that begins and continues on the screen and leaves the edge of the screen 118, while the short gesture and the medium gesture are determined by a threshold and both are on the screen 118. Initiate and end.

The user can scroll through the email in the cursor scroll mode to move the cursor 206 within the message. The origin 302 is shown in the input area 204 on the touch-sensitive display 118 in FIG. 3, and the direction of the gesture is downward relative to the displayed information, reaching the end of the tip of the arrow 304. When the gesture is detected, the touch sensitive display 118 moves the cursor 206 to a new location within the message. The movement of the cursor is advantageously in the same direction as the direction of the gesture. Therefore, the cursor 206 can be moved within the information without scrolling through the page. For example, when the cursor 206 is located near the top of the display area 202 and an origin is detected in one of the input areas 204, the starting cursor scrolls. However, for example, when the cursor 206 is located near the bottom of the display area 202 and an origin is detected in one of the input areas 204, the information displayed on the touch sensitive display 118 can be displayed during cursor scrolling. Go ahead to move the cursor within the message. For example, when it is detected that the origin of the gesture is swiped up in one of the input areas 204, the cursor scrolling may also occur in the opposite direction to move the cursor up in the information. Cursor scrolling can occur horizontally to move the cursor laterally within the information. Detection of a horizontal gesture from right to left or from left to right, such as the gesture of origin 402 in input area 204, is shown in FIG.

Optionally, the length of the gesture (according to distance or duration) can be used to determine how far forward or backward the cursor 202 is within the information. Two, three or more levels of difference can be utilized. A short gesture causes the cursor to advance or retreat by one line of information or one character and a long gesture causes the cursor to advance or retreat more than one line of information or more than one character.

You can use a long gesture to move the cursor to the end or start of the message (for a vertical gesture) or use it to move the cursor to the end of a line or to start (for a horizontal gesture). Alternatively, a long gesture can be interpreted as causing the cursor to advance or rewind multiple lines or characters within the message. The number of multiple lines or characters can vary.

Figure 5 is a flow chart illustrating one method of displaying information based on a detected gesture. The method can be implemented with software executed by, for example, processor 102. In accordance with the present description, the writing of software for implementing such a method is within the skill of the art. The method may contain more or fewer processes than those shown and/or illustrated, and may be performed in a different order. The computer readable code executable by the at least one processor of the portable electronic device to implement the method can be stored in a computer readable medium. 502 information is displayed on the touch sensitive display 118 of the portable electronic device 100. In the example shown, an email is navigated through an email application. When a 504 gesture is detected, it is determined that the gesture is associated with one of the areas of the touch-sensitive display 118. For example, an origin, an endpoint, a percentage of gestures in an area, or other characteristics can be identified to determine which region (such as display area 202 or input area 204) is associated with the gesture. One direction of the gesture can also be determined, and the direction of scrolling can be based on the direction of the gesture. The 506 scroll mode is determined based on the association (such as origin, destination, region percentage, etc.). When the gesture is associated with the display area 202 of the touch-sensitive display 118, for example, when the origin of the gesture is at a location associated with the display area 202, the page scrolling mode is utilized and, for example, based on The direction of the gesture scrolls 508 information to the page. The page scrolling mode may optionally include determining a length of the gesture and displaying a different portion of the information based on the length of the gesture. When the gesture is associated with the input area 204 of the touch-sensitive display 118, for example, when the origin of the gesture is at a location associated with the input area 204, the cursor scrolling mode is utilized and the cursor 202 is scrolled 510 passed the information.

The scrolling method set forth herein facilitates, for example, the interaction and selection of one of the cursor positions within the information displayed for editing. The scrolling edge detected by one of the touch screen displays can be scrolled in either of the two modes by looking at the direction of the information. The scroll mode is determined based on the association of the gesture with a display area, and scrolling in either of the two modes is achieved without any other buttons, menus, or other more time consuming processes. As a result, different portions of the information can be displayed and/or edited more quickly, thereby reducing power requirements, increasing battery life, and providing an improved user experience.

The present invention may be embodied in other specific forms without departing from the spirit or essential characteristics of the invention. The described embodiments are to be considered in all respects as illustrative and not limiting. The scope of the invention is therefore indicated by the appended claims rather All changes that come within the meaning and scope of the equivalents of the claims are intended to be included within the scope of the claims.

100. . . Portable electronic device

102. . . processor

104. . . Communication subsystem

106. . . decoder

108. . . Random access memory (RAM)

110. . . Memory

112. . . monitor

114. . . Touch sensitive coating

116. . . Electronic controller

118. . . Touch sensitive display

120. . . Actuator

122. . . Force sensor

124. . . Auxiliary input/output (I/O) subsystem

126. . . Information埠

128. . . speaker

130. . . microphone

132. . . Short-range communication

134. . . Other device subsystem

136. . . Accelerometer

138. . . User Identity Module or Removable User Identity Module (SIM/RUIM) card

142. . . power supply

146. . . working system

148. . . Software program or component

150. . . Wireless network

202. . . Display area

204. . . Input area

206. . . cursor

208. . . origin

302. . . origin

402. . . origin

1 is a block diagram of a portable electronic device in accordance with the present invention.

2 illustrates an example of a display before and after scrolling in a first mode in accordance with the present invention.

Figure 3 illustrates an example of a display before and after scrolling in a second mode in accordance with the present invention.

Figure 4 illustrates an example of a display before and after scrolling in a second mode in accordance with the present invention.

5 is a flow chart illustrating one method of scrolling through information displayed on a portable electronic device in accordance with the present invention.

100. . . Portable electronic device

102. . . processor

104. . . Communication subsystem

106. . . decoder

108. . . Random access memory (RAM)

110. . . Memory

112. . . monitor

114. . . Touch sensitive coating

116. . . Electronic controller

118. . . Touch sensitive display

120. . . Actuator

122. . . Force sensor

124. . . Auxiliary input/output (I/O) subsystem

126. . . Information埠

128. . . speaker

130. . . microphone

132. . . Short-range communication

134. . . Other device subsystem

136. . . Accelerometer

138. . . User Identity Module or Removable User Identity Module (SIM/RUIM) card

142. . . power supply

146. . . working system

148. . . Software program or component

150. . . Wireless network

Claims (15)

A method for controlling a portable electronic device, comprising: displaying a first information for a first application in a first area of a touch sensitive display, and second in the touch sensitive display Displaying, in the area, second information for the first application, wherein the first information includes text and the second information includes a virtual keyboard; detecting a gesture on the touch sensitive display; when the gesture begins at the touch While in the first area of the display, scrolling through the text to display different text in the first area; when the gesture begins on the keyboard in the second area of the touch sensitive display, dependent on A cursor is scrolled through the text in one of the directions of one of the gestures; wherein the scroll amount is dependent on the length of the gesture. The method of claim 1, wherein the second information is not scrolled when the gesture begins in the second region. The method of claim 1, wherein the virtual keyboard is displayed while scrolling through the first information. The method of claim 1, wherein scrolling the first information comprises page scrolling. The method of claim 1, wherein detecting a gesture comprises detecting a wipe. The method of claim 1, further comprising determining an origin and a direction of the gesture. The method of claim 1, wherein the virtual keyboard is configured to receive an input for display in the first region, and the first information includes the input In. A non-transitory computer readable medium having computer readable code executable by at least one processor of the portable electronic device to perform the method of claim 1. A portable electronic device comprising: a touch sensitive display configured to display first information for a first application in a first area of one of the touch sensitive displays, and at the touch sensitive display Displaying, in a second area, second information for the first application, wherein the first information includes text and the second information includes a virtual keyboard display information; and a processor configured to: detect a gesture on the touch-sensitive display; when the gesture begins in the first region of the touch-sensitive display, scrolling the text to display different text in the first region; when the gesture begins at the touch-sensitive display When the keyboard is in the second area, a cursor is scrolled through the text in a direction that is dependent on one of the directions of the gesture; wherein the scroll amount is dependent on the length of the gesture. The portable electronic device of claim 9, wherein the second information is not scrolled when the gesture begins in the second area. The portable electronic device of claim 9, wherein the keyboard is displayed while scrolling through the first information. The portable electronic device of claim 9, wherein the scrolling through the first information includes a page scrolling. The portable electronic device of claim 9, wherein detecting a gesture comprises detecting a wipe. The portable electronic device of claim 9, wherein the virtual keyboard is configured to receive an input for display in the first region, and the first information includes the input. A method for controlling a portable electronic device, comprising: displaying text in a first area of a touch sensitive display; displaying a keyboard in a second area of one of the touch sensitive displays, wherein the The text in an area includes text input by the keyboard; detecting a gesture on the touch-sensitive display; when the gesture begins in the first area of the touch-sensitive display, scrolling the text to Displaying different characters in the first area; when the gesture starts on the keyboard in the second area of the touch-sensitive display, scrolling a cursor in the direction of one of the directions in the direction of the gesture; The amount of scrolling is dependent on the length of the gesture.