WO2012015776A1 - Methods and devices for determining user input location based on device support configuration - Google Patents
Methods and devices for determining user input location based on device support configuration Download PDFInfo
- Publication number
- WO2012015776A1 WO2012015776A1 PCT/US2011/045274 US2011045274W WO2012015776A1 WO 2012015776 A1 WO2012015776 A1 WO 2012015776A1 US 2011045274 W US2011045274 W US 2011045274W WO 2012015776 A1 WO2012015776 A1 WO 2012015776A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- input
- acoustic
- location
- support configuration
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/043—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
- G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
- G06F2200/163—Indexing scheme relating to constructional details of the computer
- G06F2200/1636—Sensing arrangement for detection of a tap gesture on the housing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/038—Indexing scheme relating to G06F3/038
- G06F2203/0381—Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
Definitions
- Embodiments of the subject matter described herein relate generally to touch sensing applications, and more particularly, embodiments of the subject matter relate to using acoustic sensing elements to locate user inputs on a surface of a device based on the current support configuration for the device.
- Some electronic devices use touch-based interfaces to receive input from the user. Some electronic devices may utilize sensors to detect acoustic waves propagating in the device and determine the location of touch inputs on a surface of the device based on the acoustic waves and known acoustic characteristics of the device, also known as the acoustic signature of the device.
- the acoustic characteristics of the device may change during operation of the device, thereby limiting the ability of the device to accurately determine the location of touch inputs.
- the acoustic characteristics of a device may change depending on where other objects are contacting the device. Accordingly, it is desirable to accurately determine the location of touch inputs on the surface of an electronic device using acoustic sensing-technologies irrespective of other contact with the device.
- FIG. 1 is a block diagram of an exemplary electronic device in accordance with one embodiment
- FIG. 2 is a flow diagram of a control process suitable for use with the electronic device of FIG. 1 in accordance with one embodiment
- FIG. 3 is a flow diagram of a support configuration identification process suitable for use with the electronic device of FIG. 1 or the control process of FIG. 2 in accordance with one or more embodiments.
- a support configuration should be understood as a predefined manner for gripping, holding, mounting, fastening, or otherwise providing physical support to the device.
- an acoustic signature of the device is obtained for each of the possible support configurations for the device.
- the device acoustic signature corresponding to the current support configuration of the device is used to resolve or otherwise determine the location of user inputs on a surface of the device based on acoustic responses measured by the acoustic sensing elements of the device, as described in greater detail below.
- FIG. 1 depicts an exemplary embodiment of electronic device 100.
- the electronic device 100 may be realized as a mobile communications device (e.g., cellular phone, tablet, personal digital assistant, and the like), a computer, a portable media player (e.g., a digital audio player, a digital video player, or the like), or another suitable electronic device capable of being held in a plurality of possible support configurations.
- the electronic device 100 includes, without limitation, a touch screen 102, one or more nonvisual output components 104, 106, a plurality of acoustic sensing elements 108, 110, a control module 1 12, and a suitable amount of memory 1 18. It should be understood that FIG.
- FIG. 1 is a simplified representation of an electronic device 100 for purposes of explanation and is not intended to limit the scope of the subject matter in any way.
- FIG. 1 depicts the electronic device 100 including two acoustic sensing elements 108, 110, practical embodiments of the electronic device 100 may include additional or fewer acoustic sensing elements to satisfy the needs of a particular application.
- the acoustic sensing elements 108, 110 measure, sense, detect, or otherwise obtain acoustic responses attributable to user input(s) on a surface of the electronic device 100.
- a user input comprises an impact, tap, stroke, movement, marking, or the like, that is imparted by a user of the electronic device 100 to a surface of the electronic device 100, for example, by applying and/or pressing an input object (e.g., a finger, stylus, digital pen, or the like) to the surface of the electronic device 100.
- a measured acoustic response by an acoustic sensing element 108, 1 10 corresponds to the amplitude and frequency (or phase) of the acoustic waves sensed or detected by the respective acoustic sensing element 108, 110 at its respective location.
- the measured acoustic response is an electrical signal provided by a respective sensing element 108, 1 10 to the control module 112 that reflects the amplitude and frequency (or phase) characteristics of the resulting acoustic waves at the location of the respective sensing element 108, 1 10.
- the measured acoustic response varies with respect to the location of the user input, and thus, measured acoustic responses may be utilized by the control module 1 12 to determine or otherwise resolve the location of contact between an input object and a surface of the electronic device 100, that is, the input location of a respective user input on the surface of the electronic device 100, as described in greater detail below.
- the touch screen 102 provides a user interface with the electronic device 100 and includes a touch panel 114 and a display device 1 16.
- the touch panel 1 14 is realized as a transparent touch panel that is responsive to user input on the surface of touch panel 114.
- the touch panel 1 14 may be realized as a resistive touch panel or a capacitive touch panel, or the touch panel 1 14 may be realized using another suitable technology.
- the touch panel 1 14 is coupled to the control module 1 12, wherein the control module 1 12 is configured to resolve user input on the touch panel 1 14 to its corresponding location on the touch panel 114.
- the touch panel 1 14 is preferably disposed proximate the display device 1 16 and aligned with respect to the display device 1 16 such that the touch panel 1 14 is interposed in the line-of-sight between a user and the display device 116 when the user views content displayed on the display device 116.
- the touch panel 1 14 is substantially planar in shape and disposed adjacent to a substantially planar surface of the display device 1 16.
- the touch panel 114 may be aligned parallel to the planar viewing area of the display device 1 16.
- the touch panel 114 is integral with the display device 1 16.
- the display device 1 16 is realized as an electronic display configured to graphically display information and/or content under control of the control module 1 12.
- the display device 1 16 may be realized as a liquid crystal display (LCD), a cathode ray tube display (CRT), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a plasma display, or another suitable electronic display.
- the control module 1 12 is coupled to the display device 1 16, and the control module 112 controls the display and/or rendering of content on the display device 116 and correlates the location of a user input received on the touch panel 114 with the location of content displayed on the display device 1 16.
- the nonvisual output components 104, 106 generally represent the components of the electronic device 100 configured to generate nonvisual feedback to a user of the electronic device 100 under control of the control module 1 12.
- the electronic device 100 includes an audio output device 104 and a haptic output device 106.
- the audio output device 104 may be realized as a speaker or another device configured to produce or otherwise generate auditory output in response to commands from the control module 1 12.
- the haptic output device 106 may be realized as a vibrator or another device configured to produce or otherwise generate haptic output in response to commands from the control module 1 12.
- the electronic device 100 includes at least two acoustic sensing elements 108, 1 10 that are disposed at different locations within the electronic device 100.
- the acoustic sensing elements 108, 1 10 are in contact with a surface of the electronic device 100 that is intended to receive user input.
- the acoustic sensing elements 108, 110 are also separated from each other by a distance that ensures decorrelation between the measured acoustic responses at the respective sensing elements 108, 110 resulting from a user input on a surface of the electronic device 100.
- the separation distance ensures that the measured acoustic responses at the respective sensing elements 108, 1 10 are equal for no more than one input location on the surface of the electronic device 100.
- the acoustic sensing elements 108, 110 are realized as piezoelectric sensors configured to measure, sense, detect, or otherwise obtain the acoustic response resulting from or otherwise attributable to a user input on a surface of the electronic device 100 and provide an electrical signal indicative of the acoustic response to the control module 112, as described in greater detail below. Accordingly, for convenience and ease of explanation, but without limitation, the acoustic sensing elements 108, 1 10 may alternatively be referred to herein as sensors.
- the control module 112 generally represents the hardware, software, and/or firmware components configured to determine or otherwise resolve the input location corresponding to user input, either on the touch screen 102 or a surface of the electronic device 100, and perform additional tasks and/or functions described in greater detail below.
- the control module 112 also includes or otherwise accesses memory 118 capable of maintaining a plurality of device acoustic signatures for the electronic device 100, as described in greater detail below.
- control module 112 may be implemented or realized with a general purpose processor, a content addressable memory, a digital signal processor, an application specific integrated circuit, a field programmable gate array, any suitable programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof, designed to perform the functions described herein.
- the control module 1 12 may also be implemented as a combination of computing devices, e.g., a combination of a digital signal processor and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a digital signal processor core, or any other such configuration.
- control module 1 12 includes processing logic that may be configured to carry out the functions, techniques, and processing tasks associated with the operation of the electronic device 100, as described in greater detail below. Furthermore, the steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in firmware, in a software module executed by the control module 1 12, or in any practical combination thereof.
- a device acoustic signature includes an acoustic signature for each respective sensor 108, 1 10 that reflects the acoustic responses measured by the respective sensor 108, 110 (or the electrical signals produced or provided by the respective sensor 108, 110) resulting from user inputs at known locations on the surface of the electronic device 100.
- each device acoustic signature is associated with a particular support configuration for the electronic device 100.
- a support configuration should be understood as a predefined manner for gripping, holding, mounting, fastening, or otherwise providing physical support to the electronic device 100.
- a support configuration corresponds to persistent physical contact points on one or more surfaces of the electronic device 100 that do not correspond to user inputs, but rather, provide substantially fixed mechanical support for the electronic device 100.
- a first support configuration may correspond to a user holding the electronic device 100 to the user's left ear with the user's left hand
- a second support configuration may correspond to the user holding the electronic device 100 to the user's right ear with the user's right hand
- a third support configuration may correspond to the user holding the electronic device 100 in front of the user (e.g., the provide input to the electronic device 100)
- a fourth support configuration may correspond to the electronic device 100 being held or gripped by a mounting apparatus or support structure (e.g., a dock, cradle, holder, or the like), and so on.
- a mounting apparatus or support structure e.g., a dock, cradle, holder, or the like
- a user input on a surface of the electronic device 100 produces a pattern of acoustic waves propagating through the electronic device 100.
- the physical contact points on the surface(s) of the electronic device 100 provided by a respective support configuration affect the acoustic characteristics of the electronic device 100, and thereby influence the manner in which acoustic waves propagate through the electronic device 100 (e.g., the manner in which the acoustic waves are attenuated) in response to the user input.
- each sensor 108, 110 has an acoustic signature for a particular support configuration that corresponds to a mapping between the measured acoustic responses and the known input locations for user inputs provided on a surface of the electronic device 100 while the electronic device 100 was in the particular support configuration, wherein the user inputs at the known input locations produce the corresponding measured acoustic responses.
- control module 1 12 obtains a device acoustic signature for each of the possible support configurations for the electronic device 100, and stores or otherwise maintains the association between the support configuration and its corresponding device acoustic signature (e.g., the set of acoustic signatures for the sensors 108, 1 10 when the electronic device 100 is in the associated support configuration).
- a first device acoustic signature for a first support configuration may be obtained by applying a series of impulse-style inputs having known input locations across one or more surfaces of the electronic device 100 while the electronic device 100 is maintained in the first support configuration, and the association between the known input locations and the measured acoustic responses at each sensor 108, 1 10 stored or otherwise maintained by the control module 1 12 as the device acoustic signature for a particular support configuration.
- the electronic device 100 may be fixedly held or gripped in a first support configuration, and a series of inputs having known locations (L L 2 , L3 . . . L consult) applied across one or more surfaces of the electronic device 100.
- the known input locations correspond to locations on the touch panel 1 14 and/or touch screen 102.
- the first sensing element 108 obtains a measured acoustic response and provides an electrical signal indicative of the acoustic response at the location of the first sensing element 108 to the control module 1 12.
- the control module 1 12 obtains the acoustic signature for the first sensing element 108 by maintaining the association between the set of acoustic responses measured by the first sensing element 108 (A L A 2 , A 3 . . . A n ) and the known input locations (Lj- L practic).
- the second sensing element 1 10 obtains a measured acoustic response and provides an electrical signal indicative of the acoustic response at the location of the second sensing element 1 10 to the control module 1 12.
- the control module 1 12 obtains the acoustic signature for the second sensing element 1 10 by maintaining the association between the set of acoustic responses measured by the second sensing element 1 10 (B L B 2 , B 3 . . . B n ) and the known input locations.
- the control module 1 12 obtains or otherwise determines the device acoustic signature for the first support configuration as the association between the known input locations (Lj-Llie) and the measured acoustic responses (Aj-Arita, Bi-B n ) at the sensors 108, 1 10.
- control module 1 12 and the sensors 108, 1 10 are cooperatively configured to obtain and maintain device acoustic signatures for one or more of the following support configurations: a user holding the electronic device 100 with a vertical orientation in his or her left hand (e.g., a left-handed vertical support configuration), a user holding the electronic device 100 with a vertical orientation in his or her right hand (e.g., a right-handed vertical support configuration), a user holding the electronic device 100 with a horizontal orientation in his or her left hand (e.g., a left-handed horizontal support configuration), a user holding the electronic device 100 with a horizontal orientation in his or her right hand (e.g., a right-handed horizontal support configuration), a support structure (e.g., a cell phone holder, a car mount, or the like) holding the electronic device 100 with a vertical orientation (e.g., a vertically-mounted support configuration), or a support structure holding the electronic device 100 with a horizontal orientation (e.g., a cell phone holder,
- an electronic device may be configured to perform a control process 200 and additional tasks, functions, and/or operations as described below.
- the various tasks may be performed by software, hardware, firmware, or any combination thereof.
- the following description may refer to elements mentioned above in connection with FIG. 1.
- the tasks, functions, and operations may be performed by different elements of the described system, such as the touch screen 102, the sensors 108, 1 10, the control module 1 12, the touch panel 1 14 and/or display device 1 16. It should be appreciated any number of additional or alternative tasks may be included, and may be incorporated into a more comprehensive procedure or process having additional functionality not described in detail herein.
- the control process 200 may be performed to enable the electronic device 100 to more accurately resolve the locations of user inputs imparted to a surface of the electronic device 100 using acoustic sensors 108, 110.
- the control process 200 begins by determining a first device acoustic signature for a first support configuration (task 202).
- the acoustic signature of the electronic device 100 for the first support configuration may be determined by placing the electronic device 100 in the first support configuration, and applying a series of impulse-style inputs having known locations across one or more surfaces of the electronic device 100 while the electronic device 100 is maintained in the first support configuration, as described above.
- the electronic device 100 may be fixedly held or gripped with a vertical orientation, either by the left hand of a user or another support structure (e.g., a dock, cradle, holder, holster, or another mounting apparatus) that provides persistent physical contact to simulate the electronic device 100 being held vertically by a left hand of a user, and a series of inputs having known locations applied across one or more surfaces of the electronic device 100.
- another support structure e.g., a dock, cradle, holder, holster, or another mounting apparatus
- control module 1 12 maintains the association between the known input locations (Li-Lute) and the resulting measured acoustic responses at the first sensor 108 (Ai-A awhile) as the acoustic signature for the first sensor 108 for the left-handed vertical support configuration, and similarly, maintains the association between the known input locations (Li-Lute) and the measured acoustic responses at the second sensor 1 10 (Bi-Bmony) as the acoustic signature for the second sensor 1 10 for the left-handed vertical support configuration.
- the set of acoustic signatures for the sensors 108, 1 10 for the left- handed vertical support configuration comprise the device acoustic signature for the electronic device 100 (e.g., the association between known input locations (Li- L n ) and their corresponding set of measured acoustic responses (Ai-Avantage, Bi-Blor) for the left-handed vertical support configuration) that is associated with the left- handed vertical support configuration.
- the device acoustic signature and its association with the left-handed vertical support configuration may be stored or otherwise maintained by the control module 1 12 in memory 118.
- the control process 200 continues by determining device acoustic signatures for one or more additional support configurations (task 204).
- a device acoustic signature for the electronic device 100 in the right-handed vertical support configuration may be determined by fixedly holding or gripping the electronic device 100 with a vertical orientation, either by the right hand of user or another object that provides persistent physical contact points to simulate the electronic device 100 being held vertically by a right hand of a user, and a series of inputs having known locations applied across one or more surfaces of the electronic device 100.
- the control module 1 12 and/or memory 1 18 maintains the association between the right- handed vertical support configuration and the device acoustic signature (e.g., the set of acoustic signatures for the sensors 108, 1 10 for the right-handed vertical support configuration), in a similar manner as described above.
- the electronic device 100 may be fixedly held or gripped with physical contact points corresponding to a horizontal orientation with a left-handed or right-handed configuration to obtain acoustic signatures for the sensors 108, 1 10 for a right- handed horizontal support configuration and/or a left-handed horizontal support configuration.
- the electronic device 100 may be placed in other mounting apparatus or support structures (e.g., a cell phone holder, a car mount, or the like) and acoustic signatures obtained for sensors 108, 110 with the electronic device 100 in various mounted support configurations.
- mounting apparatus or support structures e.g., a cell phone holder, a car mount, or the like
- acoustic signatures obtained for sensors 108, 110 with the electronic device 100 in various mounted support configurations.
- the control process 200 continues by determining or otherwise identifying the current support configuration for the electronic device during operation of the device and resolving input locations for subsequent user inputs on a surface of the device using the device acoustic signature corresponding to the current support configuration (tasks 206, 208).
- the control module 1 12 identifies the current support configuration of the electronic device 100 by correlating measured input locations for user inputs on the touch screen 102 and/or touch panel 1 14 to input locations determined using the device acoustic signatures for the various support configurations maintained by the control module 1 12, as described in greater detail below in the context of FIG. 3.
- the control module selects the device acoustic signature corresponding to the current support configuration for use in resolving input locations for user inputs based on measured acoustic responses obtained from sensors 108, 1 10.
- the control module 1 12 obtains measured acoustic responses from sensors 108, 1 10 (A m , B m ) that are attributable to a user input on a surface of the electronic device 100 and determines the location of the user input based on the selected device acoustic signature corresponding to the current support configuration.
- control module 1 12 compares the entire set of stored acoustic responses (Ai-A relie, Bi-B n ) for the current support configuration to the measured acoustic responses (A m , B m ), identifies the set of stored acoustic responses (A Bj) from the entire set of stored acoustic responses (Ai-A réelle, Bi-B n ) for the current support configuration that are closest to the measured acoustic responses (A m , B m ), and determines the location of the user input as the known input location (Li) corresponding to the set of stored acoustic responses (A Bj) that are closest to the measured acoustic responses (A m , Bm). In this manner, the device acoustic signature that corresponds to the current support configuration of the electronic device 100 is used to determine the location of user input on the surface of the electronic device 100.
- the control process 200 continues by detecting or otherwise determining whether there has been a change in the support configuration for the electronic device (task 210).
- the control module 1 12 may identify a change in the support configuration for the electronic device 100 by determining that a user input location determined a device acoustic signature for another support configuration more closely match a user input location determined using the touch screen 102 and/or touch panel 1 14, as described in greater detail below in the context of FIG. 3.
- the control module 1 12 may identify a change in the support configuration for the electronic device 100 using other means.
- the electronic device 100 may include an accelerometer or gyroscope that indicates when the change (or a rate of change) in the orientation of the electronic device 100 exceeds a threshold amount.
- the control process 200 repeats the step of identifying the current support configuration for the electronic device. Otherwise, if the support configuration for the electronic device is unchanged, the control process 200 continues resolving input locations for subsequent user inputs on the surface of the electronic device 100 using the device acoustic signature corresponding to the previously identified support configuration.
- the loop defined by tasks 206, 208 and 210 may repeat as desired throughout operation of the electronic device 100.
- an electronic device may be configured to perform a support configuration identification process 300 and additional tasks, functions, and/or operations as described below.
- the various tasks may be performed by software, hardware, firmware, or any combination thereof.
- the following description may refer to elements mentioned above in connection with FIG. 1.
- the tasks, functions, and operations may be performed by different elements of the described system, such as the touch screen 102, the sensors 108, 1 10, the control module 1 12, the touch panel 1 14 and/or display device 1 16. It should be appreciated any number of additional or alternative tasks may be included, and may be incorporated into a more comprehensive procedure or process having additional functionality not described in detail herein.
- the support configuration identification process 300 may be performed to enable the electronic device 100 to determine its current support configuration.
- the support configuration identification process 300 begins by receiving or otherwise obtaining an initial user input on a touch panel and obtaining measured acoustic responses at a plurality of acoustic sensing elements in response to the initial user input on the touch panel (tasks 302, 304).
- each sensor 108, 1 10 measures, senses, or otherwise detects the acoustic response (A m , B m ) at its respective location that is attributable to the initial user input on the touch panel 1 14 and/or touch screen 102, resulting in measured acoustic responses for the initial user input.
- the support configuration identification process 300 continues by determining the location of the initial user input on the touch panel (task 306).
- the control module 1 12 receives signals from the touch panel 1 14 and/or touch screen 102 indicative of the location of the user input and determines the location of the user input on the touch panel 1 14 and/or touch screen 102 in a conventional manner.
- the location of the initial user input on the touch panel 1 14 (L T ) corresponds to a verified input location for the initial user input that is used to determine a best fit support configuration of the plurality of possible support configurations for the electronic device 100, as described in greater detail below.
- the support configuration identification process 300 continues by determining a plurality of possible input locations for the initial user input using the measured acoustic responses corresponding to the initial user input and the device acoustic signatures for the possible support configurations for the electronic device (task 308).
- the control module 1 12 determines a possible input location for the initial user input using the measured acoustic responses attributable to the initial user input and the acoustic signatures for the sensors 108, 1 10 for that respective support configuration.
- control module 1 12 may determine a first possible input location (LLV) using the measured acoustic responses and acoustic signatures for the sensors 108, 1 10 corresponding to the left-handed vertical support configuration (e.g., the left- handed vertical grip input location) in a similar manner as described above.
- LUV first possible input location
- control module 1 12 compares the entire set of stored acoustic responses (Ai-Asewage, Bi-B n ) for the left-handed vertical support configuration to the measured acoustic responses (A m , B m ), identifies the set of stored acoustic responses (A Bj) from the entire set of stored acoustic responses (A Bj) for the left-handed vertical support configuration that are closest to the measured acoustic responses (A m , B m ), and determines the left-handed vertical grip input location (LLV) as the known input location (Li) corresponding to the set of stored acoustic responses (A Bj) that are closest to the measured acoustic responses (A m , B m ).
- LUV left-handed vertical grip input location
- control module 1 12 may determine a right-handed vertical grip input location (L RV ) by comparing the entire set of stored acoustic responses (A ⁇ - A n , Bi-B n ) for the right-handed vertical support configuration to the measured acoustic responses (A m , B m ), identifying the set of stored acoustic responses (Aj, Bj) from the entire set of stored acoustic responses (Aj, Bj) for the right-handed vertical support configuration that are closest to the measured acoustic responses (A m , Bm), and determines the right-handed vertical grip input location (L RV ) as the known input location (Li) corresponding to the set of stored acoustic responses (Aj, Bj) that are closest to the measured acoustic responses (A m , B m ).
- control module 1 12 determines additional possible input locations using the measured acoustic responses and acoustic signatures for the sensors 108, 1 10 corresponding to other possible support configurations (e.g., a right-handed horizontal grip input location, a left-handed horizontal grip input location, a vertically-mounted grip input location, a horizontally-mounted grip input location, and the like).
- other possible support configurations e.g., a right-handed horizontal grip input location, a left-handed horizontal grip input location, a vertically-mounted grip input location, a horizontally-mounted grip input location, and the like.
- the support configuration identification process 300 continues by identifying or otherwise determining the possible input location that is closest to the actual input location for the initial user input, and identifying the support configuration corresponding to the identified possible input location as the current support configuration for the electronic device (tasks 3 10, 3 12).
- the possible input location that is closest to the actual input location for the initial user input corresponds to a best fit input location for the initial user input determined using the acoustic sensors 108, 1 10, and the support configuration associated with the device acoustic signature used to determine the best fit input location corresponds to a best fit support configuration corresponding to the current support configuration of the electronic device 100.
- the control module 1 12 calculates or otherwise determines a difference metric that corresponds to the difference between the respective possible input location and the verified input location determined using the touch panel 1 14. For example, the control module 1 12 may determine the magnitude of the difference between the verified input location and each respective possible input location. The control module 1 12 identifies the possible input location having the lowest value for the difference metric as the best fit input location for the initial user input.
- control module 1 12 may determine the magnitude of the difference between the verified input location (L T ) from the touch panel 1 14 and/or touch screen 102 and the left-handed vertical grip input location (LLV) and determine the magnitude of the difference between the verified input location (L ) and the right-handed vertical grip input location (LRV).
- LUV left-handed vertical grip input location
- L LRV right-handed vertical grip input location
- the control module 1 12 identifies the left-handed vertical support configuration as the current support configuration for the electronic device 100.
- the control module 1 12 identifies the right- handed vertical support configuration as the current support configuration for the electronic device 100.
- the control module 1 12 identifies that respective support configuration as the current support configuration for the electronic device 100. In this manner, the control module 1 12 may determine the current hand of the user that is holding the electronic device 100 as well as the current orientation of the electronic device 100 based on the relationship between the possible input locations and the verified input location from the touch panel 1 14.
- the support configuration identification process 300 continues by determining or otherwise resolving the input locations for subsequent user inputs on a surface of the electronic device using the device acoustic signature for the current support configuration (task 314).
- the control module 1 12 selects the device acoustic signature corresponding to the current support configuration of the electronic device 100, and in response to subsequent user inputs on the surface of the electronic device 100, the control module 1 12 obtains measured acoustic responses from the sensors 108, 110 and determines the input locations for the subsequent user inputs using the measured acoustic responses and the selected device acoustic signature (e.g., the acoustic signatures for the sensors 108, 1 10 for the current support configuration). In this manner, the control module 112 may select the device acoustic signature corresponding to the current hand of the user holding the electronic device 100 with the current orientation of the electronic device 100 for use in determining the location of user inputs on a surface of the electronic device 100.
- the control module 112 may select the device acoustic signature corresponding to the current hand of the user holding the electronic device 100 with the current orientation of the electronic device 100 for use in determining the location of user inputs on a surface of the electronic device 100.
- control module 112 obtains measured acoustic responses from the sensors 108, 110 and determines the input locations for subsequent user inputs using the measured acoustic responses and the acoustic signatures for the sensors 108, 1 10 for the current support configuration in a similar manner as described above (e.g., comparing the entire set of stored acoustic responses for the identified current support configuration to the measured acoustic responses, identifies the set of stored acoustic responses closest to the measured acoustic responses, and determining the location of the user input as the known input location corresponding to the identified set of stored acoustic responses) throughout operation of the electronic device 100 until identifying or otherwise detecting a change in the support configuration of the electronic device 100.
- the support configuration identification process 300 may repeat to update or otherwise identify the new support configuration of the electronic device as described above in the context of FIG. 2 (e.g., tasks 206, 210).
- the control module 112 may identify a change in the support configuration for the electronic device 100 by determining that a user input location determined a device acoustic signature for another support configuration more closely match a user input location determined using the touch screen 102 and/or touch panel 1 14.
- control module 112 may repeat the steps of determining a plurality of possible input locations for the user input using the device acoustic signatures for the possible support configurations for the electronic device 100, determining the possible input location that is closest to the actual input location for the user input, and identifying the support configuration corresponding to the identified possible input location (e.g., tasks 308, 310, 312).
- the control module 1 12 detects or otherwise determines a change in the support configuration of the electronic device 100 and uses the device acoustic signature for the best fit input location to resolve the input location of subsequent user inputs on the surface of the electronic device 100.
- one advantage of the methods described above is that the device acoustic signature that reflects the physical contact points on the electronic device may be utilized to resolve the location of user input determined using measured acoustic responses. In this manner, the effect that the physical contact points have on the acoustic characteristics of the electronic device are accounted for, and allow the location of user input that does not overly a touch screen and/or touch panel to be resolved more accurately.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Acoustics & Sound (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Methods and devices are provided for determining location of an input on a surface of a device using a plurality of acoustic sensing elements. An exemplary method comprises determining a current support configuration of the device, selecting a device acoustic signature corresponding to the current support configuration, measuring acoustic response corresponding to the input at each acoustic sensing element of the plurality of acoustic sensing elements, and determining the location of the input based on the measured acoustic responses and the selected device acoustic signature for the current support configuration.
Description
METHODS AND DEVICES FOR DETERMINING USER INPUT LOCATION BASED ON DEVICE SUPPORT CONFIGURATION
TECHNICAL FIELD
[0001] Embodiments of the subject matter described herein relate generally to touch sensing applications, and more particularly, embodiments of the subject matter relate to using acoustic sensing elements to locate user inputs on a surface of a device based on the current support configuration for the device.
BACKGROUND
[0002] Many electronic devices use touch-based interfaces to receive input from the user. Some electronic devices may utilize sensors to detect acoustic waves propagating in the device and determine the location of touch inputs on a surface of the device based on the acoustic waves and known acoustic characteristics of the device, also known as the acoustic signature of the device.
[0003] In practice, the acoustic characteristics of the device may change during operation of the device, thereby limiting the ability of the device to accurately determine the location of touch inputs. For example, the acoustic characteristics of a device may change depending on where other objects are contacting the device. Accordingly, it is desirable to accurately determine the location of touch inputs on the surface of an electronic device using acoustic sensing-technologies irrespective of other contact with the device.
BRIEF DESCRIPTION OF THE DRAWINGS
[0004] A more complete understanding of the subject matter may be derived by referring to the detailed description and claims when considered in conjunction with the following figures, wherein like reference numbers refer to similar elements throughout the figures.
[0005] FIG. 1 is a block diagram of an exemplary electronic device in accordance with one embodiment;
[0006] FIG. 2 is a flow diagram of a control process suitable for use with the electronic device of FIG. 1 in accordance with one embodiment; and
[0007] FIG. 3 is a flow diagram of a support configuration identification process suitable for use with the electronic device of FIG. 1 or the control process of FIG. 2 in accordance with one or more embodiments.
DETAILED DESCRIPTION
[0008] The following detailed description is merely illustrative in nature and is not intended to limit the embodiments of the subject matter or the application and uses of such embodiments. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, or the following detailed description.
[0009] For the sake of brevity, conventional techniques related to touch sensing, touch screen calibration and/or configuration, touch screens, and other functional aspects of the systems (and the individual operating components of the systems) may not be described in detail herein. Furthermore, the connecting lines shown in the various figures contained herein are intended to represent example functional relationships and/or physical couplings between the various elements. It should be noted that many alternative or additional functional relationships or physical connections may be present in a practical embodiment.
[0010] Technologies and concepts discussed herein relate to utilizing acoustic sensing elements to locate user inputs on a surface of a device capable of being held or otherwise gripped in a plurality of possible support configurations. As used herein, a support configuration should be understood as a predefined manner for gripping, holding, mounting, fastening, or otherwise providing physical support to the device. As described in greater detail below, an acoustic signature of the device is obtained for each of the possible support configurations for the device. The device acoustic signature corresponding to the current support configuration of the device is used to resolve or otherwise determine the location of user inputs on a surface of the device based on acoustic responses measured by the acoustic sensing elements of the device, as described in greater detail below.
[0011] FIG. 1 depicts an exemplary embodiment of electronic device 100. The electronic device 100 may be realized as a mobile communications device (e.g., cellular phone, tablet, personal digital assistant, and the like), a computer, a
portable media player (e.g., a digital audio player, a digital video player, or the like), or another suitable electronic device capable of being held in a plurality of possible support configurations. In an exemplary embodiment, the electronic device 100 includes, without limitation, a touch screen 102, one or more nonvisual output components 104, 106, a plurality of acoustic sensing elements 108, 110, a control module 1 12, and a suitable amount of memory 1 18. It should be understood that FIG. 1 is a simplified representation of an electronic device 100 for purposes of explanation and is not intended to limit the scope of the subject matter in any way. In this regard, although FIG. 1 depicts the electronic device 100 including two acoustic sensing elements 108, 110, practical embodiments of the electronic device 100 may include additional or fewer acoustic sensing elements to satisfy the needs of a particular application.
[0012] In an exemplary embodiment, the acoustic sensing elements 108, 110 measure, sense, detect, or otherwise obtain acoustic responses attributable to user input(s) on a surface of the electronic device 100. As used herein, a user input comprises an impact, tap, stroke, movement, marking, or the like, that is imparted by a user of the electronic device 100 to a surface of the electronic device 100, for example, by applying and/or pressing an input object (e.g., a finger, stylus, digital pen, or the like) to the surface of the electronic device 100. The contact between the input object and the electronic device 100 results in acoustic waves propagating throughout the electronic device 100 that influence the acoustic responses measured by the acoustic sensing elements 108, 110. In this regard, a measured acoustic response by an acoustic sensing element 108, 1 10 corresponds to the amplitude and frequency (or phase) of the acoustic waves sensed or detected by the respective acoustic sensing element 108, 110 at its respective location. In an exemplary embodiment, the measured acoustic response is an electrical signal provided by a respective sensing element 108, 1 10 to the control module 112 that reflects the amplitude and frequency (or phase) characteristics of the resulting acoustic waves at the location of the respective sensing element 108, 1 10. The measured acoustic response varies with respect to the location of the user input, and thus, measured acoustic responses may be utilized by the control module 1 12 to determine or otherwise resolve the location of contact between an
input object and a surface of the electronic device 100, that is, the input location of a respective user input on the surface of the electronic device 100, as described in greater detail below.
[0013] The touch screen 102 provides a user interface with the electronic device 100 and includes a touch panel 114 and a display device 1 16. The touch panel 1 14 is realized as a transparent touch panel that is responsive to user input on the surface of touch panel 114. Depending on the embodiment, the touch panel 1 14 may be realized as a resistive touch panel or a capacitive touch panel, or the touch panel 1 14 may be realized using another suitable technology. The touch panel 1 14 is coupled to the control module 1 12, wherein the control module 1 12 is configured to resolve user input on the touch panel 1 14 to its corresponding location on the touch panel 114. The touch panel 1 14 is preferably disposed proximate the display device 1 16 and aligned with respect to the display device 1 16 such that the touch panel 1 14 is interposed in the line-of-sight between a user and the display device 116 when the user views content displayed on the display device 116. In this regard, from the perspective of a user and/or viewer of the touch screen 102 and/or display device 1 16, at least a portion of the touch panel 1 14 overlaps and/or overlies content displayed on the display device 116. In accordance with one embodiment, the touch panel 1 14 is substantially planar in shape and disposed adjacent to a substantially planar surface of the display device 1 16. For example, if the display device 116 has a substantially planar viewing area, the touch panel 114 may be aligned parallel to the planar viewing area of the display device 1 16. In accordance with one or more embodiments, the touch panel 114 is integral with the display device 1 16.
[0014] The display device 1 16 is realized as an electronic display configured to graphically display information and/or content under control of the control module 1 12. Depending on the embodiment, the display device 1 16 may be realized as a liquid crystal display (LCD), a cathode ray tube display (CRT), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a plasma display, or another suitable electronic display. The control module 1 12 is coupled to the display device 1 16, and the control module 112 controls the display and/or rendering of content on the display device 116 and
correlates the location of a user input received on the touch panel 114 with the location of content displayed on the display device 1 16.
[0015] The nonvisual output components 104, 106 generally represent the components of the electronic device 100 configured to generate nonvisual feedback to a user of the electronic device 100 under control of the control module 1 12. In this regard, in an exemplary embodiment, the electronic device 100 includes an audio output device 104 and a haptic output device 106. The audio output device 104 may be realized as a speaker or another device configured to produce or otherwise generate auditory output in response to commands from the control module 1 12. The haptic output device 106 may be realized as a vibrator or another device configured to produce or otherwise generate haptic output in response to commands from the control module 1 12.
[0016] As illustrated by FIG. 1, the electronic device 100 includes at least two acoustic sensing elements 108, 1 10 that are disposed at different locations within the electronic device 100. In an exemplary embodiment, the acoustic sensing elements 108, 1 10 are in contact with a surface of the electronic device 100 that is intended to receive user input. In addition to being disposed at different locations, the acoustic sensing elements 108, 110 are also separated from each other by a distance that ensures decorrelation between the measured acoustic responses at the respective sensing elements 108, 110 resulting from a user input on a surface of the electronic device 100. In other words, the separation distance ensures that the measured acoustic responses at the respective sensing elements 108, 1 10 are equal for no more than one input location on the surface of the electronic device 100. In an exemplary embodiment, the acoustic sensing elements 108, 110 are realized as piezoelectric sensors configured to measure, sense, detect, or otherwise obtain the acoustic response resulting from or otherwise attributable to a user input on a surface of the electronic device 100 and provide an electrical signal indicative of the acoustic response to the control module 112, as described in greater detail below. Accordingly, for convenience and ease of explanation, but without limitation, the acoustic sensing elements 108, 1 10 may alternatively be referred to herein as sensors.
[0017] The control module 112 generally represents the hardware, software, and/or firmware components configured to determine or otherwise resolve the input location corresponding to user input, either on the touch screen 102 or a surface of the electronic device 100, and perform additional tasks and/or functions described in greater detail below. The control module 112 also includes or otherwise accesses memory 118 capable of maintaining a plurality of device acoustic signatures for the electronic device 100, as described in greater detail below.
[0018] Depending on the embodiment, the control module 112 may be implemented or realized with a general purpose processor, a content addressable memory, a digital signal processor, an application specific integrated circuit, a field programmable gate array, any suitable programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof, designed to perform the functions described herein. The control module 1 12 may also be implemented as a combination of computing devices, e.g., a combination of a digital signal processor and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a digital signal processor core, or any other such configuration. In practice, the control module 1 12 includes processing logic that may be configured to carry out the functions, techniques, and processing tasks associated with the operation of the electronic device 100, as described in greater detail below. Furthermore, the steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in firmware, in a software module executed by the control module 1 12, or in any practical combination thereof.
[0019] In an exemplary embodiment, the control module 112 and the sensors 108, 110 are cooperatively configured to obtain an acoustic signature for the electronic device 100, alternatively referred to herein as a device acoustic signature. As described in greater detail below, a device acoustic signature includes an acoustic signature for each respective sensor 108, 1 10 that reflects the acoustic responses measured by the respective sensor 108, 110 (or the electrical signals produced or provided by the respective sensor 108, 110) resulting from user inputs at known locations on the surface of the electronic device 100.
[0020] In an exemplary embodiment, each device acoustic signature is associated with a particular support configuration for the electronic device 100. As set forth above, a support configuration should be understood as a predefined manner for gripping, holding, mounting, fastening, or otherwise providing physical support to the electronic device 100. In this regard, a support configuration corresponds to persistent physical contact points on one or more surfaces of the electronic device 100 that do not correspond to user inputs, but rather, provide substantially fixed mechanical support for the electronic device 100. For example, a first support configuration may correspond to a user holding the electronic device 100 to the user's left ear with the user's left hand, a second support configuration may correspond to the user holding the electronic device 100 to the user's right ear with the user's right hand, a third support configuration may correspond to the user holding the electronic device 100 in front of the user (e.g., the provide input to the electronic device 100), a fourth support configuration may correspond to the electronic device 100 being held or gripped by a mounting apparatus or support structure (e.g., a dock, cradle, holder, or the like), and so on.
[0021] As set forth above, a user input on a surface of the electronic device 100 produces a pattern of acoustic waves propagating through the electronic device 100. The physical contact points on the surface(s) of the electronic device 100 provided by a respective support configuration affect the acoustic characteristics of the electronic device 100, and thereby influence the manner in which acoustic waves propagate through the electronic device 100 (e.g., the manner in which the acoustic waves are attenuated) in response to the user input. Acoustic waves resulting from the user input produce a measurable acoustic response at each of the sensors 108, 110, and the amplitude and/or frequency characteristics of the acoustic response are influenced by the support configuration of the electronic device 100 and vary with respect to the location of the user input. Thus, each sensor 108, 110 has an acoustic signature for a particular support configuration that corresponds to a mapping between the measured acoustic responses and the known input locations for user inputs provided on a surface of the electronic device 100 while the electronic device 100 was in the particular
support configuration, wherein the user inputs at the known input locations produce the corresponding measured acoustic responses.
[0022] In an exemplary embodiment, the control module 1 12 obtains a device acoustic signature for each of the possible support configurations for the electronic device 100, and stores or otherwise maintains the association between the support configuration and its corresponding device acoustic signature (e.g., the set of acoustic signatures for the sensors 108, 1 10 when the electronic device 100 is in the associated support configuration). For example, a first device acoustic signature for a first support configuration may be obtained by applying a series of impulse-style inputs having known input locations across one or more surfaces of the electronic device 100 while the electronic device 100 is maintained in the first support configuration, and the association between the known input locations and the measured acoustic responses at each sensor 108, 1 10 stored or otherwise maintained by the control module 1 12 as the device acoustic signature for a particular support configuration. For example, the electronic device 100 may be fixedly held or gripped in a first support configuration, and a series of inputs having known locations (L L2, L3 . . . L„) applied across one or more surfaces of the electronic device 100. In an exemplary embodiment, at least some of the known input locations correspond to locations on the touch panel 1 14 and/or touch screen 102. In response to each known input, the first sensing element 108 obtains a measured acoustic response and provides an electrical signal indicative of the acoustic response at the location of the first sensing element 108 to the control module 1 12. The control module 1 12 obtains the acoustic signature for the first sensing element 108 by maintaining the association between the set of acoustic responses measured by the first sensing element 108 (AL A2, A3 . . . An) and the known input locations (Lj- L„). Similarly, in response to each known input, the second sensing element 1 10 obtains a measured acoustic response and provides an electrical signal indicative of the acoustic response at the location of the second sensing element 1 10 to the control module 1 12. The control module 1 12 obtains the acoustic signature for the second sensing element 1 10 by maintaining the association between the set of acoustic responses measured by the second sensing element 1 10 (BL B2, B3 . . . Bn) and the known input locations.
The control module 1 12 obtains or otherwise determines the device acoustic signature for the first support configuration as the association between the known input locations (Lj-L„) and the measured acoustic responses (Aj-A„, Bi-Bn) at the sensors 108, 1 10. In an exemplary embodiment, the control module 1 12 and the sensors 108, 1 10 are cooperatively configured to obtain and maintain device acoustic signatures for one or more of the following support configurations: a user holding the electronic device 100 with a vertical orientation in his or her left hand (e.g., a left-handed vertical support configuration), a user holding the electronic device 100 with a vertical orientation in his or her right hand (e.g., a right-handed vertical support configuration), a user holding the electronic device 100 with a horizontal orientation in his or her left hand (e.g., a left-handed horizontal support configuration), a user holding the electronic device 100 with a horizontal orientation in his or her right hand (e.g., a right-handed horizontal support configuration), a support structure (e.g., a cell phone holder, a car mount, or the like) holding the electronic device 100 with a vertical orientation (e.g., a vertically-mounted support configuration), or a support structure holding the electronic device 100 with a horizontal orientation (e.g., a horizontally-mounted support configuration). As described in greater detail below, during operation of the electronic device 100, the device acoustic signature corresponding to the current support configuration of the electronic device 100 is used to resolve or otherwise determine the input locations for user inputs on a surface of the electronic device 100.
[0023] Referring now to FIG. 2, in an exemplary embodiment, an electronic device may be configured to perform a control process 200 and additional tasks, functions, and/or operations as described below. The various tasks may be performed by software, hardware, firmware, or any combination thereof. For illustrative purposes, the following description may refer to elements mentioned above in connection with FIG. 1. In practice, the tasks, functions, and operations may be performed by different elements of the described system, such as the touch screen 102, the sensors 108, 1 10, the control module 1 12, the touch panel 1 14 and/or display device 1 16. It should be appreciated any number of additional or alternative tasks may be included, and may be incorporated into a more
comprehensive procedure or process having additional functionality not described in detail herein.
[0024] Referring to FIG. 2, and with continued reference to FIG. 1, the control process 200 may be performed to enable the electronic device 100 to more accurately resolve the locations of user inputs imparted to a surface of the electronic device 100 using acoustic sensors 108, 110. The control process 200 begins by determining a first device acoustic signature for a first support configuration (task 202). In this regard, the acoustic signature of the electronic device 100 for the first support configuration may be determined by placing the electronic device 100 in the first support configuration, and applying a series of impulse-style inputs having known locations across one or more surfaces of the electronic device 100 while the electronic device 100 is maintained in the first support configuration, as described above. For example, the electronic device 100 may be fixedly held or gripped with a vertical orientation, either by the left hand of a user or another support structure (e.g., a dock, cradle, holder, holster, or another mounting apparatus) that provides persistent physical contact to simulate the electronic device 100 being held vertically by a left hand of a user, and a series of inputs having known locations applied across one or more surfaces of the electronic device 100. As described above, the control module 1 12 maintains the association between the known input locations (Li-L„) and the resulting measured acoustic responses at the first sensor 108 (Ai-A„) as the acoustic signature for the first sensor 108 for the left-handed vertical support configuration, and similarly, maintains the association between the known input locations (Li-L„) and the measured acoustic responses at the second sensor 1 10 (Bi-B„) as the acoustic signature for the second sensor 1 10 for the left-handed vertical support configuration. The set of acoustic signatures for the sensors 108, 1 10 for the left- handed vertical support configuration comprise the device acoustic signature for the electronic device 100 (e.g., the association between known input locations (Li- Ln) and their corresponding set of measured acoustic responses (Ai-A„, Bi-B„) for the left-handed vertical support configuration) that is associated with the left- handed vertical support configuration. The device acoustic signature and its
association with the left-handed vertical support configuration may be stored or otherwise maintained by the control module 1 12 in memory 118.
[0025] In an exemplary embodiment, the control process 200 continues by determining device acoustic signatures for one or more additional support configurations (task 204). For example, a device acoustic signature for the electronic device 100 in the right-handed vertical support configuration may be determined by fixedly holding or gripping the electronic device 100 with a vertical orientation, either by the right hand of user or another object that provides persistent physical contact points to simulate the electronic device 100 being held vertically by a right hand of a user, and a series of inputs having known locations applied across one or more surfaces of the electronic device 100. The control module 1 12 and/or memory 1 18 maintains the association between the right- handed vertical support configuration and the device acoustic signature (e.g., the set of acoustic signatures for the sensors 108, 1 10 for the right-handed vertical support configuration), in a similar manner as described above. Similarly, the electronic device 100 may be fixedly held or gripped with physical contact points corresponding to a horizontal orientation with a left-handed or right-handed configuration to obtain acoustic signatures for the sensors 108, 1 10 for a right- handed horizontal support configuration and/or a left-handed horizontal support configuration. Additionally, the electronic device 100 may be placed in other mounting apparatus or support structures (e.g., a cell phone holder, a car mount, or the like) and acoustic signatures obtained for sensors 108, 110 with the electronic device 100 in various mounted support configurations.
[0026] In an exemplary embodiment, the control process 200 continues by determining or otherwise identifying the current support configuration for the electronic device during operation of the device and resolving input locations for subsequent user inputs on a surface of the device using the device acoustic signature corresponding to the current support configuration (tasks 206, 208). In accordance with one embodiment, the control module 1 12 identifies the current support configuration of the electronic device 100 by correlating measured input locations for user inputs on the touch screen 102 and/or touch panel 1 14 to input locations determined using the device acoustic signatures for the various support
configurations maintained by the control module 1 12, as described in greater detail below in the context of FIG. 3. In response to identifying the current support configuration of the electronic device 100, the control module selects the device acoustic signature corresponding to the current support configuration for use in resolving input locations for user inputs based on measured acoustic responses obtained from sensors 108, 1 10. The control module 1 12 obtains measured acoustic responses from sensors 108, 1 10 (Am, Bm) that are attributable to a user input on a surface of the electronic device 100 and determines the location of the user input based on the selected device acoustic signature corresponding to the current support configuration. In this regard, the control module 1 12 compares the entire set of stored acoustic responses (Ai-A„, Bi-Bn) for the current support configuration to the measured acoustic responses (Am, Bm), identifies the set of stored acoustic responses (A Bj) from the entire set of stored acoustic responses (Ai-A„, Bi-Bn) for the current support configuration that are closest to the measured acoustic responses (Am, Bm), and determines the location of the user input as the known input location (Li) corresponding to the set of stored acoustic responses (A Bj) that are closest to the measured acoustic responses (Am, Bm). In this manner, the device acoustic signature that corresponds to the current support configuration of the electronic device 100 is used to determine the location of user input on the surface of the electronic device 100.
[0027] In accordance with one embodiment, the control process 200 continues by detecting or otherwise determining whether there has been a change in the support configuration for the electronic device (task 210). For example, in one embodiment, the control module 1 12 may identify a change in the support configuration for the electronic device 100 by determining that a user input location determined a device acoustic signature for another support configuration more closely match a user input location determined using the touch screen 102 and/or touch panel 1 14, as described in greater detail below in the context of FIG. 3. In other embodiments, the control module 1 12 may identify a change in the support configuration for the electronic device 100 using other means. For example, the electronic device 100 may include an accelerometer or gyroscope that indicates when the change (or a rate of change) in the orientation of the
electronic device 100 exceeds a threshold amount. In response to determining a change in the support configuration of the electronic device, the control process 200 repeats the step of identifying the current support configuration for the electronic device. Otherwise, if the support configuration for the electronic device is unchanged, the control process 200 continues resolving input locations for subsequent user inputs on the surface of the electronic device 100 using the device acoustic signature corresponding to the previously identified support configuration. The loop defined by tasks 206, 208 and 210 may repeat as desired throughout operation of the electronic device 100.
[0028] Referring now to FIG. 3, in an exemplary embodiment, an electronic device may be configured to perform a support configuration identification process 300 and additional tasks, functions, and/or operations as described below. The various tasks may be performed by software, hardware, firmware, or any combination thereof. For illustrative purposes, the following description may refer to elements mentioned above in connection with FIG. 1. In practice, the tasks, functions, and operations may be performed by different elements of the described system, such as the touch screen 102, the sensors 108, 1 10, the control module 1 12, the touch panel 1 14 and/or display device 1 16. It should be appreciated any number of additional or alternative tasks may be included, and may be incorporated into a more comprehensive procedure or process having additional functionality not described in detail herein.
[0029] Referring to FIG. 3, and with continued reference to FIGS. 1-2, the support configuration identification process 300 may be performed to enable the electronic device 100 to determine its current support configuration. The support configuration identification process 300 begins by receiving or otherwise obtaining an initial user input on a touch panel and obtaining measured acoustic responses at a plurality of acoustic sensing elements in response to the initial user input on the touch panel (tasks 302, 304). In this regard, each sensor 108, 1 10 measures, senses, or otherwise detects the acoustic response (Am, Bm) at its respective location that is attributable to the initial user input on the touch panel 1 14 and/or touch screen 102, resulting in measured acoustic responses for the initial user input. The support configuration identification process 300 continues
by determining the location of the initial user input on the touch panel (task 306). In this regard, the control module 1 12 receives signals from the touch panel 1 14 and/or touch screen 102 indicative of the location of the user input and determines the location of the user input on the touch panel 1 14 and/or touch screen 102 in a conventional manner. The location of the initial user input on the touch panel 1 14 (LT) corresponds to a verified input location for the initial user input that is used to determine a best fit support configuration of the plurality of possible support configurations for the electronic device 100, as described in greater detail below.
[0030] In an exemplary embodiment, the support configuration identification process 300 continues by determining a plurality of possible input locations for the initial user input using the measured acoustic responses corresponding to the initial user input and the device acoustic signatures for the possible support configurations for the electronic device (task 308). In this regard, for each possible support configuration having a corresponding device acoustic signature maintained by the control module 1 12, the control module 1 12 determines a possible input location for the initial user input using the measured acoustic responses attributable to the initial user input and the acoustic signatures for the sensors 108, 1 10 for that respective support configuration. For example, the control module 1 12 may determine a first possible input location (LLV) using the measured acoustic responses and acoustic signatures for the sensors 108, 1 10 corresponding to the left-handed vertical support configuration (e.g., the left- handed vertical grip input location) in a similar manner as described above. In this regard, the control module 1 12 compares the entire set of stored acoustic responses (Ai-A„, Bi-Bn) for the left-handed vertical support configuration to the measured acoustic responses (Am, Bm), identifies the set of stored acoustic responses (A Bj) from the entire set of stored acoustic responses (A Bj) for the left-handed vertical support configuration that are closest to the measured acoustic responses (Am, Bm), and determines the left-handed vertical grip input location (LLV) as the known input location (Li) corresponding to the set of stored acoustic responses (A Bj) that are closest to the measured acoustic responses (Am, Bm). Similarly, the control module 1 12 may determine a right-handed vertical grip input location (LRV) by comparing the entire set of stored acoustic responses (A}-
An, Bi-Bn) for the right-handed vertical support configuration to the measured acoustic responses (Am, Bm), identifying the set of stored acoustic responses (Aj, Bj) from the entire set of stored acoustic responses (Aj, Bj) for the right-handed vertical support configuration that are closest to the measured acoustic responses (Am, Bm), and determines the right-handed vertical grip input location (LRV) as the known input location (Li) corresponding to the set of stored acoustic responses (Aj, Bj) that are closest to the measured acoustic responses (Am, Bm). In this manner, the control module 1 12 determines additional possible input locations using the measured acoustic responses and acoustic signatures for the sensors 108, 1 10 corresponding to other possible support configurations (e.g., a right-handed horizontal grip input location, a left-handed horizontal grip input location, a vertically-mounted grip input location, a horizontally-mounted grip input location, and the like).
[0031] In an exemplary embodiment, the support configuration identification process 300 continues by identifying or otherwise determining the possible input location that is closest to the actual input location for the initial user input, and identifying the support configuration corresponding to the identified possible input location as the current support configuration for the electronic device (tasks 3 10, 3 12). The possible input location that is closest to the actual input location for the initial user input (or the most accurate possible input location) corresponds to a best fit input location for the initial user input determined using the acoustic sensors 108, 1 10, and the support configuration associated with the device acoustic signature used to determine the best fit input location corresponds to a best fit support configuration corresponding to the current support configuration of the electronic device 100. In an exemplary embodiment, for each possible input location of the plurality of possible input locations, the control module 1 12 calculates or otherwise determines a difference metric that corresponds to the difference between the respective possible input location and the verified input location determined using the touch panel 1 14. For example, the control module 1 12 may determine the magnitude of the difference between the verified input location and each respective possible input location. The control module 1 12 identifies the possible input location having the lowest value for the difference
metric as the best fit input location for the initial user input. For example, the control module 1 12 may determine the magnitude of the difference between the verified input location (LT) from the touch panel 1 14 and/or touch screen 102 and the left-handed vertical grip input location (LLV) and determine the magnitude of the difference between the verified input location (L ) and the right-handed vertical grip input location (LRV). When the difference between the verified input location and the left-handed vertical grip input location is less than the difference between the verified input location and the right-handed vertical grip location (i.e., the device acoustic signature for the left-handed vertical support configuration results in the possible input location that is closest to the verified input location of the initial user input on the touch panel 1 14), the control module 1 12 identifies the left-handed vertical support configuration as the current support configuration for the electronic device 100. Similarly, if the device acoustic signature for the right- handed vertical support configuration results in the possible input location that is closest to the verified input location, the control module 1 12 identifies the right- handed vertical support configuration as the current support configuration for the electronic device 100. Likewise, if the device acoustic signature for the another support configuration (e.g., a right-handed horizontal grip input location, a left- handed horizontal grip input location, a vertically mounted grip input location, a horizontally mounted grip input location, or the like) result in the possible input location that is closest to the verified input location, the control module 1 12 identifies that respective support configuration as the current support configuration for the electronic device 100. In this manner, the control module 1 12 may determine the current hand of the user that is holding the electronic device 100 as well as the current orientation of the electronic device 100 based on the relationship between the possible input locations and the verified input location from the touch panel 1 14.
[0032] After identifying the current support configuration for the electronic device, the support configuration identification process 300 continues by determining or otherwise resolving the input locations for subsequent user inputs on a surface of the electronic device using the device acoustic signature for the current support configuration (task 314). In this regard, the control module 1 12
selects the device acoustic signature corresponding to the current support configuration of the electronic device 100, and in response to subsequent user inputs on the surface of the electronic device 100, the control module 1 12 obtains measured acoustic responses from the sensors 108, 110 and determines the input locations for the subsequent user inputs using the measured acoustic responses and the selected device acoustic signature (e.g., the acoustic signatures for the sensors 108, 1 10 for the current support configuration). In this manner, the control module 112 may select the device acoustic signature corresponding to the current hand of the user holding the electronic device 100 with the current orientation of the electronic device 100 for use in determining the location of user inputs on a surface of the electronic device 100. As described above, the control module 112 obtains measured acoustic responses from the sensors 108, 110 and determines the input locations for subsequent user inputs using the measured acoustic responses and the acoustic signatures for the sensors 108, 1 10 for the current support configuration in a similar manner as described above (e.g., comparing the entire set of stored acoustic responses for the identified current support configuration to the measured acoustic responses, identifies the set of stored acoustic responses closest to the measured acoustic responses, and determining the location of the user input as the known input location corresponding to the identified set of stored acoustic responses) throughout operation of the electronic device 100 until identifying or otherwise detecting a change in the support configuration of the electronic device 100.
[0033] In response to detecting a change in the support configuration, the support configuration identification process 300 may repeat to update or otherwise identify the new support configuration of the electronic device as described above in the context of FIG. 2 (e.g., tasks 206, 210). As set forth above, the control module 112 may identify a change in the support configuration for the electronic device 100 by determining that a user input location determined a device acoustic signature for another support configuration more closely match a user input location determined using the touch screen 102 and/or touch panel 1 14. In this regard, each time a user input is received on the touch screen and/or touch panel 1 14, the control module 112 may repeat the steps of determining a plurality of
possible input locations for the user input using the device acoustic signatures for the possible support configurations for the electronic device 100, determining the possible input location that is closest to the actual input location for the user input, and identifying the support configuration corresponding to the identified possible input location (e.g., tasks 308, 310, 312). When the support configuration corresponding to the best fit input location is different from the previously identified support configuration of the electronic device 100, the control module 1 12 detects or otherwise determines a change in the support configuration of the electronic device 100 and uses the device acoustic signature for the best fit input location to resolve the input location of subsequent user inputs on the surface of the electronic device 100.
[0034] To briefly summarize, one advantage of the methods described above is that the device acoustic signature that reflects the physical contact points on the electronic device may be utilized to resolve the location of user input determined using measured acoustic responses. In this manner, the effect that the physical contact points have on the acoustic characteristics of the electronic device are accounted for, and allow the location of user input that does not overly a touch screen and/or touch panel to be resolved more accurately.
[0035] Techniques and technologies may be described herein in terms of functional and/or logical block components and various processing steps. It should be appreciated that such block components may be realized by any number of hardware, software, and/or firmware components configured to perform the specified functions. For example, an embodiment of a system or a component may employ various integrated circuit components, e.g., memory elements, digital signal processing elements, logic elements, look-up tables, or the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices.
[0036] The foregoing description refers to elements or nodes or features being "coupled" together. As used herein, unless expressly stated otherwise, "coupled" means that one element/node/feature is directly or indirectly joined to (or directly or indirectly communicates with) another element/node/feature, and not necessarily mechanically. Thus, although the drawings may depict one exemplary
arrangement of elements, additional intervening elements, devices, features, or components may be present in an embodiment of the depicted subject matter. In addition, certain terminology may also be used in the following description for the purpose of reference only, and thus are not intended to be limiting. For example, the terms "first", "second" and other such numerical terms referring to structures do not imply a sequence or order unless clearly indicated by the context.
[0037] While at least one example embodiment has been presented in the foregoing detailed description, it should be appreciated that a vast number of variations exist. It should also be appreciated that the example embodiment or embodiments described herein are not intended to limit the scope, applicability, or configuration of the claimed subject matter in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient road map for implementing the described embodiment or embodiments. It should be understood that various changes can be made in the function and arrangement of elements without departing from the scope defined by the claims, which includes known equivalents and foreseeable equivalents at the time of filing this patent application.
Claims
1. A method for determining location of an input on a surface of a device using a plurality of acoustic sensing elements, the method comprising:
determining a current support configuration of the device;
selecting a device acoustic signature corresponding to the current support configuration;
obtaining measured acoustic response corresponding to the input at each acoustic sensing element of the plurality of acoustic sensing elements, resulting in measured acoustic responses for the input; and
determining the location of the input based on the measured acoustic responses and the selected device acoustic signature for the current support configuration.
2. The method of claim 1, wherein determining the current support configuration comprises identifying a best fit support configuration from a plurality of possible support configurations for the device.
3. The method of claim 1, the input being provided by a user, wherein determining the current support configuration of the device comprises determining a hand of the user currently holding the device.
4. The method of claim 3, wherein:
selecting the device acoustic signature corresponding to the current support configuration comprises selecting acoustic signatures for the respective acoustic sensing elements corresponding to the hand currently holding the device; and
determining the location of the input comprises determining the location of the input based on the measured acoustic response at a respective acoustic sensing element and the selected acoustic signature for the respective acoustic sensing element.
5. The method of claim 3, wherein determining the current support configuration of the device further comprises determining a current orientation for the device.
6. The method of claim 5, wherein:
selecting the device acoustic signature corresponding to the current support configuration comprises selecting acoustic signatures for the respective acoustic sensing elements corresponding to the hand currently holding the device with the current orientation; and
determining the location of the input comprises determining the location of the input based on the measured acoustic response at a respective acoustic sensing element and the selected acoustic signature for the respective acoustic sensing element.
7. The method of claim 1, wherein determining the current support configuration of the device comprises determining the current support configuration based on a verified input location for the input.
8. The method of claim 7, the device having a plurality of possible support configurations, each possible support configuration having a respective device acoustic signature, wherein determining the current support configuration comprises: determining a plurality of possible input locations for the input using the measured acoustic responses and the device acoustic signatures for the possible support configurations;
identifying a best fit possible input location of the plurality of possible input locations closest to the verified input location; and
identifying a best fit support configuration corresponding to the best fit possible input location as the current support configuration.
9. The method of claim 8, the device including a touch panel having the input provided thereon, wherein determining the current support configuration of the device further comprises determining the verified input location using the touch panel.
10. A device comprising:
a plurality of acoustic sensing elements; and
a control module coupled to the plurality of acoustic sensing elements, wherein the control module is configured to:
identify a current support configuration for the device from a plurality of possible support configurations for the device;
obtain measured acoustic responses from the plurality of acoustic sensing elements corresponding to an input on a surface of the device; and
determine a location of the input based on the measured acoustic responses and a device acoustic signature corresponding to the current support configuration.
11. The device of claim 10, further comprising a touch panel coupled to the control module, the input overlying the touch panel, wherein the control module is configured to:
determine an input location for the input using the touch panel; and identify the current support configuration based on the input location.
12. The device of claim 10, each possible support configuration of the plurality of possible support configurations having a respective device acoustic signature, wherein the control module is configured to:
determine possible input locations for the input using the measured acoustic responses and the device acoustic signatures for the possible support configurations; and
identify a best fit support configuration corresponding to a best fit input location of the possible input locations as the current support configuration.
13. The device of claim 12, further comprising a touch panel coupled to the control module, the input overlying the touch panel, wherein the control module is configured to:
determine a verified input location for the input using the touch panel; and identify the best fit input location based on differences between the possible input locations and the verified input location.
14. The device of claim 10, wherein the control module is configured to identify the current support configuration for the device by determining a hand of a user providing the input that is currently holding the device.
15. The device of claim 14, wherein identifying the current support configuration further comprises determining a current orientation for the device.
16. The device of claim 15, wherein the control module is configured to determine the location of the input based on the measured acoustic responses and a device acoustic signature corresponding to the hand of the user currently holding the device with the current orientation.
17. A method for resolving inputs on a surface of a device capable of being held in a first support configuration or a second support configuration using a plurality of acoustic sensing elements, the method comprising:
obtaining a first device acoustic signature corresponding to the first support configuration;
obtaining a second device acoustic signature corresponding to the second support configuration;
determining a first input location for a first input on the surface of the device using the first device acoustic signature;
determining a second input location for the first input using the second device acoustic signature;
obtaining a verified location for the first input; and when a difference between the first input location and the verified location is less than a difference between the second input location and the verified location, determining a second input location for a subsequent input on the surface of the device using the first device acoustic signature.
18. The method of claim 17, the first input being imparted on a touch panel of the device, wherein obtaining the verified location for the first input comprises determining a third input location for the first input using the touch panel.
19. The method of claim 17, further comprising obtaining a measured acoustic response resulting from the first input at each acoustic sensing element of the plurality of acoustic sensing elements, wherein:
determining the first input location comprises determining the first input location using the first device acoustic signature and the measured acoustic response at each acoustic sensing element; and
determining the second input location comprises determining the second input location using the second device acoustic signature and the measured acoustic response at each acoustic sensing element.
20. The method of claim 19, further comprising obtaining a second measured acoustic response resulting from the subsequent input at each acoustic sensing element of the plurality of acoustic sensing elements, wherein:
determining the second input location comprises determining the second input location using the first device acoustic signature and the second measured acoustic response at each acoustic sensing element.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US12/844,468 US8941623B2 (en) | 2010-07-27 | 2010-07-27 | Methods and devices for determining user input location based on device support configuration |
| US12/844,468 | 2010-07-27 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2012015776A1 true WO2012015776A1 (en) | 2012-02-02 |
Family
ID=44513150
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2011/045274 Ceased WO2012015776A1 (en) | 2010-07-27 | 2011-07-26 | Methods and devices for determining user input location based on device support configuration |
Country Status (2)
| Country | Link |
|---|---|
| US (1) | US8941623B2 (en) |
| WO (1) | WO2012015776A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11021571B2 (en) | 2016-03-30 | 2021-06-01 | Mitsubishi Gas Chemical Company, Inc. | Manufacturing method for high molecular weight aromatic polycarbonate resin |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120081337A1 (en) * | 2010-10-04 | 2012-04-05 | Sony Ericsson Mobile Communications Ab | Active Acoustic Multi-Touch and Swipe Detection for Electronic Devices |
| JP5087723B1 (en) * | 2012-01-30 | 2012-12-05 | パナソニック株式会社 | Information terminal device, control method thereof, and program |
| US9407824B2 (en) * | 2012-11-01 | 2016-08-02 | Google Inc. | Multi-directional content capture on mobile devices |
| KR102137240B1 (en) * | 2013-04-16 | 2020-07-23 | 삼성전자주식회사 | Method for adjusting display area and an electronic device thereof |
| CN108700860B (en) * | 2016-02-22 | 2021-11-19 | 亚德诺半导体无限责任公司 | System and method for configuring a measurement module |
| US10083592B1 (en) | 2017-07-28 | 2018-09-25 | Motorola Solutions, Inc. | Apparatus, method and system for acoustically detecting deployment of portable equipment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050146512A1 (en) * | 2003-12-31 | 2005-07-07 | Hill Nicholas P. | Touch sensing with touch down and lift off sensitivity |
| US20080316184A1 (en) * | 2007-06-21 | 2008-12-25 | Tyco Electronics Corporation | Method and system for calibrating an acoustic touchscreen |
Family Cites Families (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7800592B2 (en) * | 2005-03-04 | 2010-09-21 | Apple Inc. | Hand held electronic device with multiple touch sensing devices |
| US7643015B2 (en) * | 2002-05-24 | 2010-01-05 | Massachusetts Institute Of Technology | Systems and methods for tracking impacts |
| FR2841022B1 (en) | 2002-06-12 | 2004-08-27 | Centre Nat Rech Scient | METHOD FOR LOCATING AN IMPACT ON A SURFACE AND DEVICE FOR IMPLEMENTING SAID METHOD |
| US7176902B2 (en) * | 2003-10-10 | 2007-02-13 | 3M Innovative Properties Company | Wake-on-touch for vibration sensing touch input devices |
| FR2874274B1 (en) | 2004-08-11 | 2007-07-20 | Sensitive Object | METHOD FOR LOCATING AN IMPACT ON A SURFACE AND DEVICE FOR IMPLEMENTING SAID METHOD |
| US8692810B2 (en) | 2005-04-13 | 2014-04-08 | Elo Touch Solutions, Inc. | Method for determining the location of impacts by acoustic imaging |
| US7683890B2 (en) * | 2005-04-28 | 2010-03-23 | 3M Innovative Properties Company | Touch location determination using bending mode sensors and multiple detection techniques |
| US20060262104A1 (en) * | 2005-05-19 | 2006-11-23 | Sullivan Darius M | Systems and methods for distinguishing contact-induced plate vibrations from acoustic noise-induced plate vibrations |
| US7633076B2 (en) * | 2005-09-30 | 2009-12-15 | Apple Inc. | Automated response to and sensing of user activity in portable devices |
| WO2008146098A1 (en) * | 2007-05-28 | 2008-12-04 | Sensitive Object | Method for determining the position of an excitation on a surface and device for implementing such a method |
| US8378974B2 (en) * | 2007-07-02 | 2013-02-19 | Elo Touch Solutions, Inc. | Method and system for detecting touch events based on magnitude ratios |
| GB0721475D0 (en) * | 2007-11-01 | 2007-12-12 | Asquith Anthony | Virtual buttons enabled by embedded inertial sensors |
| EP2073106B1 (en) | 2007-12-21 | 2012-02-08 | Tyco Electronics Services GmbH | Method for determining the locations of at least two impacts |
| GB0801396D0 (en) * | 2008-01-25 | 2008-03-05 | Bisutti Giovanni | Electronic apparatus |
| US20090195959A1 (en) * | 2008-01-31 | 2009-08-06 | Research In Motion Limited | Electronic device and method for controlling same |
| ATE523839T1 (en) * | 2008-05-07 | 2011-09-15 | Tyco Electronics Services Gmbh | METHOD FOR DETERMINING THE POSITION OF AN IMPACT ON THE SURFACE OF AN OBJECT |
| JP4643698B2 (en) * | 2008-09-16 | 2011-03-02 | レノボ・シンガポール・プライベート・リミテッド | Tablet computer with microphone and control method |
| US8368658B2 (en) * | 2008-12-02 | 2013-02-05 | At&T Mobility Ii Llc | Automatic soft key adaptation with left-right hand edge sensing |
| EP2214082B1 (en) * | 2009-01-29 | 2012-08-15 | Tyco Electronics Services GmbH | A touch-sensing device with a touch hold function and a corresponding method |
| US8654524B2 (en) * | 2009-08-17 | 2014-02-18 | Apple Inc. | Housing as an I/O device |
| US8441790B2 (en) * | 2009-08-17 | 2013-05-14 | Apple Inc. | Electronic device housing as acoustic input device |
| KR101721533B1 (en) * | 2011-02-24 | 2017-03-30 | 삼성전자주식회사 | Method and apparatus for adjusting touch sensitivity of touch sensor in portable terminal |
| US8319746B1 (en) * | 2011-07-22 | 2012-11-27 | Google Inc. | Systems and methods for removing electrical noise from a touchpad signal |
| US8743069B2 (en) * | 2011-09-01 | 2014-06-03 | Google Inc. | Receiving input at a computing device |
| US20130300668A1 (en) * | 2012-01-17 | 2013-11-14 | Microsoft Corporation | Grip-Based Device Adaptations |
| JP5087723B1 (en) * | 2012-01-30 | 2012-12-05 | パナソニック株式会社 | Information terminal device, control method thereof, and program |
-
2010
- 2010-07-27 US US12/844,468 patent/US8941623B2/en active Active
-
2011
- 2011-07-26 WO PCT/US2011/045274 patent/WO2012015776A1/en not_active Ceased
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050146512A1 (en) * | 2003-12-31 | 2005-07-07 | Hill Nicholas P. | Touch sensing with touch down and lift off sensitivity |
| US20080316184A1 (en) * | 2007-06-21 | 2008-12-25 | Tyco Electronics Corporation | Method and system for calibrating an acoustic touchscreen |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11021571B2 (en) | 2016-03-30 | 2021-06-01 | Mitsubishi Gas Chemical Company, Inc. | Manufacturing method for high molecular weight aromatic polycarbonate resin |
Also Published As
| Publication number | Publication date |
|---|---|
| US8941623B2 (en) | 2015-01-27 |
| US20120026135A1 (en) | 2012-02-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8907930B2 (en) | Methods and devices for determining user input location using acoustic sensing elements | |
| US8941623B2 (en) | Methods and devices for determining user input location based on device support configuration | |
| KR102109649B1 (en) | Method for correcting coordination of electronic pen and potable electronic device supporting the same | |
| KR101811636B1 (en) | Display apparatus and Method for displaying object thereof | |
| US20070070046A1 (en) | Sensor-based touchscreen assembly, handheld portable electronic device having assembly, and method of determining touch location on a display panel | |
| TWI414979B (en) | Handwriting input device and angle correction method thereof | |
| JP5656307B1 (en) | Electronics | |
| US8963879B2 (en) | Positioning method for touch display panel | |
| EP3133473A1 (en) | Method of sensing pressure by touch sensor and electronic device adapted thereto | |
| US20150070297A1 (en) | Control method for touch panel | |
| CN106055157B (en) | A kind of sensitivity consistency calibration method of pressure touch equipment | |
| AU2014307237A1 (en) | Method and apparatus for recognizing grip state in electronic device | |
| US20110157083A1 (en) | Resistive touch apparatus | |
| TW201135553A (en) | Contact sensitive device for detecting temporally overlapping traces | |
| US20140210728A1 (en) | Fingerprint driven profiling | |
| US9829969B2 (en) | Method for determining bent state of electronic device, electronic device and flexible screen | |
| CN101907921A (en) | Portable equipment and state adjustment method thereof | |
| CN101852639B (en) | Method and system for weighing weight of object at mobile terminal and mobile terminal | |
| US20160179239A1 (en) | Information processing apparatus, input method and program | |
| US20180039376A1 (en) | Input device having a dimensionally configurable input area | |
| KR20110052621A (en) | System and Method for Correcting Signal Propagation Velocity Variation Through Touch Contact Surfaces | |
| CN103294381A (en) | Electronic device and volume adjustment method thereof | |
| CN103376949A (en) | Display device and method using a plurality of display panels | |
| CN107702636A (en) | Curved detection method and device, terminal | |
| JP2016006610A (en) | Electronic apparatus and control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11749032 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 11749032 Country of ref document: EP Kind code of ref document: A1 |