WO2013138675A1 - Input data type profiles - Google Patents

Input data type profiles Download PDF

Info

Publication number
WO2013138675A1
WO2013138675A1 PCT/US2013/031799 US2013031799W WO2013138675A1 WO 2013138675 A1 WO2013138675 A1 WO 2013138675A1 US 2013031799 W US2013031799 W US 2013031799W WO 2013138675 A1 WO2013138675 A1 WO 2013138675A1
Authority
WO
WIPO (PCT)
Prior art keywords
input
data
input data
application
send
Prior art date
Application number
PCT/US2013/031799
Other languages
French (fr)
Inventor
Olumuyiwa M. DUROJAIYE
Original Assignee
Microsoft Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corporation filed Critical Microsoft Corporation
Priority to CN201380014233.0A priority Critical patent/CN104169874B/en
Priority to EP13760553.1A priority patent/EP2825955B1/en
Publication of WO2013138675A1 publication Critical patent/WO2013138675A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers

Definitions

  • a laptop computer may receive input from a keyboard, as well as from a touchpad that can receive tactile input.
  • devices typically include some form of input configuration that specifies priorities for particular input types, as well as how particular input types are to be processed. While the ability to support multiple input types is useful, devices typically lack support for multiple input type configurations.
  • input data type profiles can be implemented to enable applications to receive different types and/or combinations of input data.
  • input data type profiles can specify different types of input data generated based on input to a tactile input device, such as raw touch data, processed touch data, and pen input data.
  • touch data refers to input data generated based on physical contact by a user with a tactile input device, such as a touchpad, a track pad, a touchscreen, and so on.
  • Pen input data can refer to input to a tactile input device received via a touch instrument, such as an electromagnetic stylus device.
  • techniques can be implemented to enable an application to receive multiple types of input data (e.g., combinations of touch data and/or pen input data) in parallel.
  • FIG. 1 is an illustration of an environment in an example implementation that is operable to employ techniques discussed herein.
  • FIG. 2 illustrates example implementations of input profile modules in accordance with one or more embodiments.
  • FIG. 3 illustrates an example implementation scenario in accordance with one or more embodiments.
  • FIG. 4 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
  • FIG. 5 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
  • FIG. 6 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
  • FIG. 7 illustrates an example system and computing device as described with reference to FIG. 1, which are configured to implement embodiments of techniques described herein.
  • input data type profiles can be implemented to enable applications to receive different types and/or combinations of input data.
  • input data type profiles can specify different types of input data generated based on input to a tactile input device, such as raw touch data, processed touch data, and pen input data.
  • touch data refers to input data generated based on physical contact by a user with a tactile input device, such as a touchpad, a track pad, a touchscreen, and so on.
  • Pen input data can refer to input to a tactile input device received via a touch instrument, such as an electromagnetic stylus device.
  • techniques can be implemented to enable an application to receive multiple types of input data (e.g., combinations of touch data and/or pen input data) in parallel.
  • FIG. 1 is an illustration of an environment 100 in an example implementation that is operable to employ techniques for providing input data type profiles described herein.
  • the illustrated environment 100 includes a computing device 102 that may be configured in a variety of ways.
  • the computing device 102 may be configured as a traditional computer (e.g., a desktop personal computer, laptop computer, and so on), a mobile station, an entertainment appliance, a set-top box communicatively coupled to a television, a wireless phone, a netbook, a game console, a handheld device, and so forth as further described in relation to FIG. 7.
  • the computing device 102 includes applications 104, which are representative of functionalities to perform various tasks via the computing device 102.
  • Examples of the applications 104 include a word processor application, an email application, a content editing application, a gaming application, and so on.
  • the applications 104 include application processor modules 106, which are representative of functionality to request particular types of input data, and to process received input data for the applications 104.
  • individual of the applications 104 can include their own respective implementations of the application processor modules 106 that are tailored specifically to the individual applications. Further details and implementations of the application processor modules 106 are discussed below.
  • a web browser 108 is representative of functionality to provide web browsing and/or other tasks via the computing device 102.
  • the web browser 108 can be employed to access network resources (e.g., a website) via one or more networks to which the computing device 102 may connect. Examples of such networks include the Internet, a wide area network (WAN), a local area network (LAN), a wireless network, a public telephone network, an intranet, and so on.
  • the applications 104 and/or the web browser 108 can be implemented in connection with any suitable type of hardware, software, firmware or combination thereof.
  • an operating system 110 which is representative of functionality to manage and provide access to resources of the computing device 102.
  • at least one input device 112 which is representative of a device that can be employed to receive input for the computing device 102. Examples of the input device 112 are discussed below with reference to FIG. 7.
  • the input device 112 can be implemented as a tactile input device 114, which is configured to receive touch input and pen input for the computing device 102.
  • the tactile input device 114 can be implemented as a touchpad, a track pad, a touchscreen, and so on.
  • Touch input can be received by the tactile input device 114 in response to physical contact by a user with the tactile input device 114.
  • a user can provide input to the tactile input device 114 by touching the tactile input device 114 with one or more fingers, other portions of the user's hand, and/or any other portion of the user's body.
  • Input can also be received by the tactile input device 114 via a touch instrument, such as a stylus (e.g., an electromagnetic stylus), a touch pen, and so forth.
  • a touch instrument such as a stylus (e.g., an electromagnetic stylus), a touch pen, and so forth.
  • touch input can be received via physical contact by a user with the tactile input device 114, and pen input can be received via contact by a touch instrument with the tactile input device 114.
  • the tactile input device 114 includes a digitizer 116, which is representative of functionality to receive analog data generated by input to the tactile input device 114, and convert the analog data into a digital form that can be used by various entities associated with the computing device 102.
  • the input device drivers 118 include a tactile device driver 120, which is representative of functionality to enable communication between the tactile input device 114 and various entities of the computing device 102.
  • the tactile device driver 120 can enable input data generated by the tactile input device 114 to be routed to one or more of the applications 104, the web browser 108, the operating system 110, and so forth.
  • the tactile device driver 120 can also process raw touch data received by the tactile input device 114 into processed touch data. For example, if a user places a finger on a touchscreen of the tactile input device 114, the digitizer 116 can generate raw touch data that approximately describes a total area of the screen in contact with the user's finger. As another example, if a user places the palm of their hand on the touchscreen, the digitizer 116 can generate raw touch data that includes an image (e.g., a bitmap) of the palm.
  • an image e.g., a bitmap
  • raw touch data can be processed into processed touch data that can be used to perform different tasks.
  • raw touch data that describes an area of a touchscreen in contact with a user's finger can be processed to specify a particular point on the touchscreen, such as with reference to an X- coordinate and a Y-coordinate location on the touchscreen.
  • Raw touch data generated by the digitizer 116 in response to the user dragging their finger can be processed (e.g., by the tactile device driver 120) to indicate a movement of a point across the touchscreen.
  • the movement of the point can be used (e.g., by the operating system 110) to perform a task, such as navigating through a graphical user interface displayed on the touchscreen.
  • input profile modules 122 are representative of functionality to present different types of input data to various entities of the computing device 102.
  • particular input profile modules 122 can present collections of different types of input data, such as combinations of different types of input data generated by the tactile input device 114.
  • one or more of the input profile modules 122 can include human interface device (HID) usage information for the input device 112.
  • An input configuration module 124 is provided, which is representative of functionality to enable various entities to request different types of input data, such as types of input data represented by the input profile modules 122.
  • the application processor module 106 for one of the applications 104 can send a request to the input configuration module 124 to receive a particular type of input data from the tactile input device 114.
  • the input configuration module 124 can notify the tactile device driver 120 that the tactile device driver is to send input data to the particular application 104 through one of the input profile modules 122 associated with the requested type of input data.
  • the tactile device driver 120 can send input data to the application via the appropriate input profile module 122.
  • different applications and/or entities can register with the input configuration module 124 to receive different types of input data via the input profile modules 122.
  • the computing device 102 further includes a device processor module 126, which is representative of functionality to perform processing on different types of input data received from the input devices 112.
  • the device processor module 126 can receive input data from the tactile input device 114, and can process the input data into a form that can be utilized by various entities, such as the operating system 110.
  • FIG. 2 illustrates example implementations of the input profile modules 122, introduced above in the discussion of the environment 100.
  • the input profile modules 122 include a touch module 200, a pen module
  • the touch module 200 is representative of functionality to deliver processed touch data to various entities.
  • the applications 104 and/or or the operating system 110 can receive processed touch data via the touch module 200.
  • the pen module 202 is representative of functionality to deliver pen input data to various entities.
  • an entity e.g., the applications 104 and/or or the operating system 110
  • resulting pen input data can be provided to such an entity via the pen module 202.
  • the touch plus module 204 is representative of functionality to deliver a combination of processed touch data and raw touch data.
  • the application processor module 106 can provide functionality to process these different types of data for one or more of the applications 104.
  • a particular application for instance, can use processed touch data for one purpose (e.g., moving a cursor on a screen), and raw touch data for another purpose, such as moving a larger image or collection of images on a screen.
  • an application that requests to receive input data via the touch plus module 204 can receive processed touch data and raw touch data that result from input to the tactile input device 114.
  • the pen plus module 206 is representative of functionality to deliver a combination of pen input data, processed touch data, and raw touch data.
  • instances of the application processor modules 106 can provide functionality to process these different types of input data for one or more of the applications 104.
  • a particular application for instance, can use pen input data for one purpose (e.g., generating text), and raw touch data for another purpose, such as drawing images on a display screen.
  • an application that requests to receive input data via the pen plus module 206 can receive pen input data, processed touch data, and raw touch data that result from input to the tactile input device 114.
  • the scenario 300 includes an application 302, an application 304, and an application 306.
  • the applications 302, 304, and 306 can be implementations of the applications 104, the web browser 108, the operating system 110, and/or another application or entity that can utilize input from the tactile input device 114.
  • the application 302 is configured to utilize processed touch data from the touch module 200, and pen input data from the pen module 202.
  • the application 302 can be configured to alternately receive processed touch data or pen input data.
  • a user can provide touch input to the tactile input device 114, which produces raw touch data.
  • the raw touch data can be processed (e.g., by the tactile device driver 120) to produce processed touch data.
  • the processed touch data is forwarded via the touch module 200 to the device processor module 126.
  • the device processor module 126 can further process the processed touch data to put it in a form that can be utilized by the application 302, and forward the processed touch data to the application 302.
  • the application 302 can use the processed touch data to perform various tasks.
  • the user can provide pen input to the tactile input device 114.
  • the user can provide the pen input along with the touch input discussed above, and/or subsequent to the touch input.
  • the tactile device driver 120 ascertains that the application 302 is configured to alternately receive touch input data or pen input data, and that the application prioritizes pen input data over touch input data.
  • the tactile device driver 120 stops sending touch input data to the touch module 200, and initiates sending pen input data to the pen module 202.
  • the pen module 202 delivers the pen input data to the device processor module 126, which can perform processing on the pen input data and forward the processed pen input data to the application 302.
  • touch input data can be suppressed such that touch input data generated by the tactile input device 114 is not sent to the application.
  • Such a configuration can be useful to prevent incidental touch input from causing unintentional input to an active application in a scenario where a user is providing pen input.
  • the application 304 is configured to utilize processed touch data and raw touch data.
  • an application processor module 305 included as part of the application 304 sends a request to the input configuration module 124 to receive touch data and raw touch data.
  • the application processor module 305 is an example implementation of the application processor module 106, discussed above.
  • the input configuration module 124 receives the request and notifies the tactile device driver 120 to send processed touch data and raw touch data to the application 304 via the touch plus module 204.
  • the tactile device driver 120 sends processed touch data and raw touch data to the device processor module 126 via the touch plus module 204.
  • the device processor module 126 can (optionally) perform processing on the processed touch data and/or the raw touch data, and forward the data to the application processor module 305.
  • the application processor module 305 can further process the processed touch data and/or the raw touch data such that the application 304 can use the processed touch data and raw touch data to perform various tasks. For example, as discussed below, the application processor module 305 can filter out specific types of input data that the application 304 is not configured to utilize. Thus, the application 304 can be provided with portions of the processed touch data and/or the raw touch data that the application 304 is configured to utilize.
  • the application 306 is configured to utilize processed touch data, raw touch data, and pen input data. Accordingly, an application processor module 307 included as part of the application 306 sends a request to the input configuration module 124 to receive processed touch data, raw touch data, and pen input data. In implementations, the application processor module 307 is an example implementation of the application processor module 106, discussed above.
  • the input configuration module 124 receives the request and notifies the tactile device driver 120 to send processed touch data, raw touch data, and pen input data to the application 306 via the pen plus module 206.
  • the tactile device driver 120 sends processed touch data, raw touch data, and pen input data to the device processor module 126 via the pen plus module 206.
  • the device processor module 126 can (optionally) perform processing on the processed touch data, raw touch data, and pen input data, and forward the data to the application processor module 307.
  • the application processor module 307 can further process the processed touch data, raw touch data, and pen input data such that the application 306 can use the processed touch data, raw touch data, and pen input data to perform various tasks. For example, the application processor module 307 can filter out specific types of input data that the application 306 is not configured to utilize. Thus, the application 306 can be provided with portions of the processed touch data, raw touch data, and pen input data that the application 306 is configured to utilize.
  • each of the applications is discussed as receiving input data from a particular one of the input profile modules 122.
  • the tactile device driver 118 can refrain from sending input data via others of the input profile modules 122.
  • the tactile device driver 120 can refrain from sending raw touch data, e.g., via the touch plus module 204 and/or the pen plus module 206. This can conserve system resources (e.g., processor bandwidth) that may be utilized to send raw touch data.
  • applications are illustrated as receiving input data from particular instances of the input profile modules 122, this is not intended to be limiting on the disclosed embodiments.
  • applications can receive input data from whichever of the input profile modules 122 is currently sending an input data stream, and can extract input data from the input data stream that the applications are configured to utilize to perform various tasks.
  • the application 302 is configured to utilize processed touch data and pen input data.
  • the application 302 may not be configured to utilize other forms of input data, such as raw touch data from the touch plus module 204.
  • the application 302 can extract input data from the input data stream that the application 302 is configured to utilize.
  • the application 302 can extract processed touch data from the input data stream, and can ignore raw touch data included in the input data stream.
  • the application 304 is configured to utilize processed and raw touch data.
  • the application 304 may not be configured to utilize pen input data.
  • the application 304 can extract input data from the input data stream that the application 304 is configured to utilize.
  • the application processor module 305 can process the input data stream, and can extract processed touch data and/or raw touch data from the input data stream.
  • the application processor module 305 can provide the processed touch data and/or the raw touch data to the application 304 to enable the application 304 to perform various tasks using the input data.
  • the application processor modules 106 can be configured to extract specific types of input data for particular applications.
  • the applications can be provided with types of input data that the applications are configured to utilize and/or understand.
  • FIG. 4 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
  • Step 400 receives a request from an application to receive input data according to a particular input data type profile.
  • the input configuration module 124 can receive a request from the applications 104 (e.g., from one of the application processor modules 106), the operating system 110, and so forth, to be sent input data according to a particular input data type and/or combination of input data types. Examples of input data types and combinations of input data types are discussed above with reference to the input profile modules 122.
  • Step 402 sends a notification to send input data to the application according to the particular input data type profile.
  • the input configuration module 124 can notify the tactile device driver 120 (or other of the input device drivers 118) to send input to an application or other entity via a particular one of the input profile modules 122.
  • FIG. 5 is a flow diagram that describes steps in a method in accordance with one or more embodiments. In implementations, the method describes a continuation of the method discussed above with respect to FIG. 4.
  • Step 500 receives a notification to send input data to an application according to a requested input data type profile.
  • the tactile device driver 120 can receive a notification from the input configuration module 124 to send a particular type and/or combination of tactile input data to an application.
  • Step 502 ascertains whether the requested input data type profile is currently active. For example, the tactile device driver 120 can ascertain whether it is currently sending input data based on the requested input data type profile. The tactile device driver 120, for instance, can determine whether the requested input profile matches one of the input profile modules 122 currently being used to send tactile input data.
  • step 504 sends input data according to the requested input data type profile.
  • the tactile device driver 120 can send tactile input data to the device processor module 126 and/or one of the applications 104 via one of the input profile modules 122 that corresponds to the requested input data type profile.
  • step 506 initiates sending input data accordingly to the requested input data type profile.
  • the tactile device driver 120 can switch from sending input data via one of the input profile modules 122, to sending input via a different one of the input profile modules 122 that corresponds to the requested input data type profile.
  • some input profiles specify multiple different types of input data, such as combinations of raw touch data, processed touch data, pen input data, and so on.
  • at least some input profiles can be leveraged to send multiple different types of input data in parallel.
  • FIG. 6 is a flow diagram that describes steps in a method in accordance with one or more embodiments. In implementations, the method describes a continuation of the methods discussed above with respect to FIGS. 4 and 5.
  • Step 600 receives an indication that an application associated with a particular input data type profile is inactivated.
  • the input configuration module 124 and/or the tactile device driver 120 can receive an indication that a formerly active application has become inactive.
  • the application for instance, may be closed such that the application is no longer running on a computing device.
  • a graphical user interface for the application can be visually minimized on a display screen, thus indicating that the application is not in focus as part of a user interaction.
  • the input configuration module 124 can receive a notification that the application is has become inactive, and can notify the tactile device driver 120.
  • Step 602 determines that no other applications are active to receive input via the particular input data type profile.
  • the input configuration module 124 and/or the tactile device driver 120 can determine that no other applications are active to receive input data according to a particular one of the input profile modules 122 associated with the inactivated application.
  • Step 604 stops sending input data according to the particular input data type profile. For instance, in response to the indication that the application is inactivated and/or that no other applications are active to receive input via the particular input data type profile, the tactile device driver 120 can stop sending input data that corresponds to the particular input data type profile.
  • the tactile device driver 120 for example, can stop sending input data via one of the input profile modules 122 that corresponds to the particular input data type profile.
  • device resources can be conserved by not sending input data that is not being consumed by an application or other process.
  • FIG. 7 illustrates an example system generally at 700 that includes an example computing device 702 that is representative of one or more computing systems and/or devices that may implement various techniques described herein.
  • the computing device 102 discussed above with reference to FIG. 1 can be embodied as the computing device 702.
  • the computing device 702 may be, for example, a server of a service provider, a device associated with the client (e.g., a client device), an on-chip system, and/or any other suitable computing device or computing system.
  • the example computing device 702 as illustrated includes a processing system 704, one or more computer-readable media 706, and one or more Input/Output (I/O) Interfaces 708 that are communicatively coupled, one to another.
  • the computing device 702 may further include a system bus or other data and command transfer system that couples the various components, one to another.
  • a system bus can include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures.
  • a variety of other examples are also contemplated, such as control and data lines.
  • the processing system 704 is representative of functionality to perform one or more operations using hardware. Accordingly, the processing system 704 is illustrated as including hardware element 710 that may be configured as processors, functional blocks, and so forth. This may include implementation in hardware as an application specific integrated circuit or other logic device formed using one or more semiconductors.
  • the hardware elements 710 are not limited by the materials from which they are formed or the processing mechanisms employed therein.
  • processors may be comprised of semiconductor(s) and/or transistors (e.g., electronic integrated circuits (ICs)).
  • processor-executable instructions may be electronically-executable instructions.
  • the computer-readable media 706 is illustrated as including memory/storage 712.
  • the memory/storage 712 represents memory/storage capacity associated with one or more computer-readable media.
  • the memory/storage 712 may include volatile media (such as random access memory (RAM)) and/or nonvolatile media (such as read only memory (ROM), Flash memory, optical disks, magnetic disks, and so forth).
  • RAM random access memory
  • ROM read only memory
  • Flash memory optical disks
  • magnetic disks magnetic disks, and so forth
  • the memory/storage 712 may include fixed media (e.g., RAM, ROM, a fixed hard drive, and so on) as well as removable media (e.g., Flash memory, a removable hard drive, an optical disc, and so forth).
  • the computer-readable media 706 may be configured in a variety of other ways as further described below.
  • Input/output interface(s) 708 are representative of functionality to allow a user to enter commands and information to computing device 702, and also allow information to be presented to the user and/or other components or devices using various input/output devices.
  • input devices include a keyboard, a cursor control device (e.g., a mouse), a microphone (e.g., for voice recognition and/or spoken input), a scanner, touch functionality (e.g., capacitive or other sensors that are configured to detect physical touch), a camera (e.g., which may employ visible or non-visible wavelengths such as infrared frequencies to detect movement that does not involve touch as gestures), and so forth.
  • Examples of output devices include a display device (e.g., a monitor or projector), speakers, a printer, a network card, tactile-response device, and so forth.
  • the computing device 702 may be configured in a variety of ways as further described below to support user interaction.
  • modules include routines, programs, objects, elements, components, data structures, and so forth that perform particular tasks or implement particular abstract data types.
  • module generally represent software, firmware, hardware, or a combination thereof.
  • the features of the techniques described herein are platform-independent, meaning that the techniques may be implemented on a variety of commercial computing platforms having a variety of processors.
  • Computer-readable media may include a variety of media that may be accessed by the computing device 702.
  • computer-readable media may include "computer- readable storage media” and "computer-readable signal media.”
  • Computer-readable storage media may refer to media and/or devices that enable persistent and/or non-transitory storage of information in contrast to mere signal transmission, carrier waves, or signals per se. Thus, computer-readable storage media does not include signal bearing media.
  • the computer-readable storage media includes hardware such as volatile and non-volatile, removable and non-removable media and/or storage devices implemented in a method or technology suitable for storage of information such as computer readable instructions, data structures, program modules, logic elements/circuits, or other data.
  • Examples of computer-readable storage media may include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, hard disks, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or other storage device, tangible media, or article of manufacture suitable to store the desired information and which may be accessed by a computer.
  • Computer-readable signal media may refer to a signal-bearing medium that is configured to transmit instructions to the hardware of the computing device 702, such as via a network.
  • Signal media typically may embody computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as carrier waves, data signals, or other transport mechanism.
  • Signal media also include any information delivery media.
  • modulated data signal means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.
  • communication media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, radio frequency (RF), infrared, and other wireless media.
  • RF radio frequency
  • hardware elements 710 and computer-readable media 706 are representative of instructions, modules, programmable device logic and/or fixed device logic implemented in a hardware form that may be employed in some embodiments to implement at least some aspects of the techniques described herein.
  • Hardware elements may include components of an integrated circuit or on-chip system, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), and other implementations in silicon or other hardware devices.
  • ASIC application-specific integrated circuit
  • FPGA field-programmable gate array
  • CPLD complex programmable logic device
  • a hardware element may operate as a processing device that performs program tasks defined by instructions, modules, and/or logic embodied by the hardware element as well as a hardware device utilized to store instructions for execution, e.g., the computer-readable storage media described previously.
  • Combinations of the foregoing may also be employed to implement various techniques and modules described herein. Accordingly, software, hardware, or program modules and other program modules may be implemented as one or more instructions and/or logic embodied on some form of computer-readable storage media and/or by one or more hardware elements 710.
  • the computing device 702 may be configured to implement particular instructions and/or functions corresponding to the software and/or hardware modules. Accordingly, implementation of modules that are executable by the computing device 702 as software may be achieved at least partially in hardware, e.g., through use of computer-readable storage media and/or hardware elements 710 of the processing system.
  • the instructions and/or functions may be executable/operable by one or more articles of manufacture (for example, one or more computing devices 702 and/or processing systems 704) to implement techniques, modules, and examples described herein.
  • the example system 700 enables ubiquitous environments for a seamless user experience when running applications on a personal computer (PC), a television device, and/or a mobile device. Services and applications run substantially similar in all three environments for a common user experience when transitioning from one device to the next while utilizing an application, playing a video game, watching a video, and so on.
  • PC personal computer
  • television device a television device
  • mobile device a mobile device. Services and applications run substantially similar in all three environments for a common user experience when transitioning from one device to the next while utilizing an application, playing a video game, watching a video, and so on.
  • multiple devices are interconnected through a central computing device.
  • the central computing device may be local to the multiple devices or may be located remotely from the multiple devices.
  • the central computing device may be a cloud of one or more server computers that are connected to the multiple devices through a network, the Internet, or other data communication link.
  • this interconnection architecture enables functionality to be delivered across multiple devices to provide a common and seamless experience to a user of the multiple devices.
  • Each of the multiple devices may have different physical requirements and capabilities, and the central computing device uses a platform to enable the delivery of an experience to the device that is both tailored to the device and yet common to all devices.
  • a class of target devices is created and experiences are tailored to the generic class of devices.
  • a class of devices may be defined by physical features, types of usage, or other common characteristics of the devices.
  • the computing device 702 may assume a variety of different configurations, such as for computer 714, mobile 716, and television 718 uses. Each of these configurations includes devices that may have generally different constructs and capabilities, and thus the computing device 702 may be configured according to one or more of the different device classes. For instance, the computing device 702 may be implemented as the computer 714 class of a device that includes a personal computer, desktop computer, a multi-screen computer, laptop computer, netbook, and so on.
  • the computing device 702 may also be implemented as the mobile 716 class of device that includes mobile devices, such as a mobile phone, portable music player, portable gaming device, a tablet computer, a multi-screen computer, and so on.
  • the computing device 702 may also be implemented as the television 718 class of device that includes devices having or connected to generally larger screens in casual viewing environments. These devices include televisions, set-top boxes, gaming consoles, and so on.
  • the techniques described herein may be supported by these various configurations of the computing device 702 and are not limited to the specific examples of the techniques described herein.
  • functionalities discussed with reference to the computing device 102 may be implemented all or in part through use of a distributed system, such as over a "cloud" 720 via a platform 722 as described below.
  • the cloud 720 includes and/or is representative of a platform 722 for resources 724.
  • the platform 722 abstracts underlying functionality of hardware (e.g., servers) and software resources of the cloud 720.
  • the resources 724 may include applications and/or data that can be utilized while computer processing is executed on servers that are remote from the computing device 702.
  • Resources 724 can also include services provided over the Internet and/or through a subscriber network, such as a cellular or Wi-Fi network.
  • the platform 722 may abstract resources and functions to connect the computing device 702 with other computing devices.
  • the platform 722 may also serve to abstract scaling of resources to provide a corresponding level of scale to encountered demand for the resources 724 that are implemented via the platform 722.
  • implementation of functionality described herein may be distributed throughout the system 700.
  • the functionality may be implemented in part on the computing device 702 as well as via the platform 722 that abstracts the functionality of the cloud 720.
  • aspects of the methods may be implemented in hardware, firmware, or software, or a combination thereof.
  • the methods are shown as a set of blocks that specify operations performed by one or more devices and are not necessarily limited to the orders shown for performing the operations by the respective blocks. Further, an operation shown with respect to a particular method may be combined and/or interchanged with an operation of a different method in accordance with one or more implementations. Aspects of the methods can be implemented via interaction between various entities discussed above with reference to the environment 100.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Techniques for providing input data type profiles are described. In at least some embodiments, input data type profiles can be implemented to enable applications to receive different types and/or combinations of input data. For example, input data type profiles can specify different types of input data generated based on input to a tactile input device, such as raw touch data, processed touch data, and pen input data. In at least some embodiments, techniques can be implemented to enable an application to receive multiple types of input data (e.g., combinations of touch data and/or pen input data) in parallel.

Description

Input Data Type Profiles
BACKGROUND
[0001] Many devices are configured to support multiple types of input. For example, a laptop computer may receive input from a keyboard, as well as from a touchpad that can receive tactile input. To enable devices to support multiple input types, devices typically include some form of input configuration that specifies priorities for particular input types, as well as how particular input types are to be processed. While the ability to support multiple input types is useful, devices typically lack support for multiple input type configurations.
SUMMARY
[0002] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
[0003] Techniques for providing input data type profiles are described. In at least some embodiments, input data type profiles can be implemented to enable applications to receive different types and/or combinations of input data. For example, input data type profiles can specify different types of input data generated based on input to a tactile input device, such as raw touch data, processed touch data, and pen input data. In implementations, touch data refers to input data generated based on physical contact by a user with a tactile input device, such as a touchpad, a track pad, a touchscreen, and so on. Pen input data can refer to input to a tactile input device received via a touch instrument, such as an electromagnetic stylus device. In at least some embodiments, techniques can be implemented to enable an application to receive multiple types of input data (e.g., combinations of touch data and/or pen input data) in parallel.
BRIEF DESCRIPTION OF THE DRAWINGS
[0004] The detailed description is described with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The use of the same reference numbers in different instances in the description and the figures may indicate similar or identical items.
[0005] FIG. 1 is an illustration of an environment in an example implementation that is operable to employ techniques discussed herein. [0006] FIG. 2 illustrates example implementations of input profile modules in accordance with one or more embodiments.
[0007] FIG. 3 illustrates an example implementation scenario in accordance with one or more embodiments.
[0008] FIG. 4 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
[0009] FIG. 5 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
[0010] FIG. 6 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
[0011] FIG. 7 illustrates an example system and computing device as described with reference to FIG. 1, which are configured to implement embodiments of techniques described herein.
DETAILED DESCRIPTION
Overview
[0012] Techniques for providing input data type profiles are described. In at least some embodiments, input data type profiles can be implemented to enable applications to receive different types and/or combinations of input data. For example, input data type profiles can specify different types of input data generated based on input to a tactile input device, such as raw touch data, processed touch data, and pen input data. In implementations, touch data refers to input data generated based on physical contact by a user with a tactile input device, such as a touchpad, a track pad, a touchscreen, and so on. Pen input data can refer to input to a tactile input device received via a touch instrument, such as an electromagnetic stylus device. In at least some embodiments, techniques can be implemented to enable an application to receive multiple types of input data (e.g., combinations of touch data and/or pen input data) in parallel.
[0013] Having presented an overview of example implementations in accordance with one or more embodiments, consider now an example environment in which example implementations may by employed.
Example Environment
[0014] FIG. 1 is an illustration of an environment 100 in an example implementation that is operable to employ techniques for providing input data type profiles described herein. The illustrated environment 100 includes a computing device 102 that may be configured in a variety of ways. For example, the computing device 102 may be configured as a traditional computer (e.g., a desktop personal computer, laptop computer, and so on), a mobile station, an entertainment appliance, a set-top box communicatively coupled to a television, a wireless phone, a netbook, a game console, a handheld device, and so forth as further described in relation to FIG. 7.
[0015] Thus, the computing device 102 may range from a full resource device with substantial memory and processor resources (e.g., personal computers, game consoles, slate or tablet-form factor device) to a low-resource device with limited memory and/or processing resources (e.g., traditional set-top boxes, hand-held game consoles). The computing device 102 also includes software that causes the computing device 102 to perform one or more operations as described below.
[0016] The computing device 102 includes applications 104, which are representative of functionalities to perform various tasks via the computing device 102. Examples of the applications 104 include a word processor application, an email application, a content editing application, a gaming application, and so on. The applications 104 include application processor modules 106, which are representative of functionality to request particular types of input data, and to process received input data for the applications 104. In implementations, individual of the applications 104 can include their own respective implementations of the application processor modules 106 that are tailored specifically to the individual applications. Further details and implementations of the application processor modules 106 are discussed below.
[0017] Further included as part of the computing device 102 is a web browser 108, which is representative of functionality to provide web browsing and/or other tasks via the computing device 102. For example, the web browser 108 can be employed to access network resources (e.g., a website) via one or more networks to which the computing device 102 may connect. Examples of such networks include the Internet, a wide area network (WAN), a local area network (LAN), a wireless network, a public telephone network, an intranet, and so on. The applications 104 and/or the web browser 108 can be implemented in connection with any suitable type of hardware, software, firmware or combination thereof.
[0018] Further included as part of the computing device 102 is an operating system 110, which is representative of functionality to manage and provide access to resources of the computing device 102. Also included is at least one input device 112, which is representative of a device that can be employed to receive input for the computing device 102. Examples of the input device 112 are discussed below with reference to FIG. 7. The input device 112 can be implemented as a tactile input device 114, which is configured to receive touch input and pen input for the computing device 102. For example, the tactile input device 114 can be implemented as a touchpad, a track pad, a touchscreen, and so on.
[0019] Touch input can be received by the tactile input device 114 in response to physical contact by a user with the tactile input device 114. For example, a user can provide input to the tactile input device 114 by touching the tactile input device 114 with one or more fingers, other portions of the user's hand, and/or any other portion of the user's body. Input can also be received by the tactile input device 114 via a touch instrument, such as a stylus (e.g., an electromagnetic stylus), a touch pen, and so forth. For purposes of discussion herein, input received via a touch instrument is referred to as "pen input." Thus, touch input can be received via physical contact by a user with the tactile input device 114, and pen input can be received via contact by a touch instrument with the tactile input device 114.
[0020] The tactile input device 114 includes a digitizer 116, which is representative of functionality to receive analog data generated by input to the tactile input device 114, and convert the analog data into a digital form that can be used by various entities associated with the computing device 102.
[0021] In implementations, pen input can be differentiated from touch input based on properties of the input. For example, the tactile input device 114 can detect physical properties of a means by which input is provided to the tactile input device 114. A user's finger and/or hand, for instance, can have different conductive properties than a stylus or other instrument. Thus, in a capacitive input scenario, touch input can be differentiated from pen input based on conductive properties of an input means used to provide input. This implementation is provided for purposes of example only, and a wide variety of other touch and/or pen-based input methods can be supported in accordance with one or more embodiments.
[0022] The computing device 102 further includes input device drivers 118, which are representative of functionality to enable entities associated with the computing device 102 to interact with the input devices 112, and vice-versa. For example, one of the input device drivers 118 can receive input data from a respective input device 112, and can communicate the input data to one or more of the applications 104, the web browser 108, the operating system 110, and so forth.
[0023] The input device drivers 118 include a tactile device driver 120, which is representative of functionality to enable communication between the tactile input device 114 and various entities of the computing device 102. For example, the tactile device driver 120 can enable input data generated by the tactile input device 114 to be routed to one or more of the applications 104, the web browser 108, the operating system 110, and so forth.
[0024] The tactile device driver 120 can also process raw touch data received by the tactile input device 114 into processed touch data. For example, if a user places a finger on a touchscreen of the tactile input device 114, the digitizer 116 can generate raw touch data that approximately describes a total area of the screen in contact with the user's finger. As another example, if a user places the palm of their hand on the touchscreen, the digitizer 116 can generate raw touch data that includes an image (e.g., a bitmap) of the palm.
[0025] To enable various entities to utilize touch input, raw touch data can be processed into processed touch data that can be used to perform different tasks. For example, raw touch data that describes an area of a touchscreen in contact with a user's finger can be processed to specify a particular point on the touchscreen, such as with reference to an X- coordinate and a Y-coordinate location on the touchscreen.
[0026] For instance, consider a scenario where a user drags their finger across a touchscreen of the tactile input device 114. Raw touch data generated by the digitizer 116 in response to the user dragging their finger can be processed (e.g., by the tactile device driver 120) to indicate a movement of a point across the touchscreen. The movement of the point can be used (e.g., by the operating system 110) to perform a task, such as navigating through a graphical user interface displayed on the touchscreen.
[0027] Further included as part of the computing device 102 are input profile modules 122, which are representative of functionality to present different types of input data to various entities of the computing device 102. In implementations, particular input profile modules 122 can present collections of different types of input data, such as combinations of different types of input data generated by the tactile input device 114. In at least some embodiments, one or more of the input profile modules 122 can include human interface device (HID) usage information for the input device 112. [0028] An input configuration module 124 is provided, which is representative of functionality to enable various entities to request different types of input data, such as types of input data represented by the input profile modules 122. For example, the application processor module 106 for one of the applications 104 can send a request to the input configuration module 124 to receive a particular type of input data from the tactile input device 114. In response to the request, the input configuration module 124 can notify the tactile device driver 120 that the tactile device driver is to send input data to the particular application 104 through one of the input profile modules 122 associated with the requested type of input data. Thus, when the application 104 is running and ready to receive input, the tactile device driver 120 can send input data to the application via the appropriate input profile module 122. Accordingly, different applications and/or entities can register with the input configuration module 124 to receive different types of input data via the input profile modules 122.
[0029] The computing device 102 further includes a device processor module 126, which is representative of functionality to perform processing on different types of input data received from the input devices 112. For example, the device processor module 126 can receive input data from the tactile input device 114, and can process the input data into a form that can be utilized by various entities, such as the operating system 110.
[0030] FIG. 2 illustrates example implementations of the input profile modules 122, introduced above in the discussion of the environment 100. In this example implementation, the input profile modules 122 include a touch module 200, a pen module
202, a touch plus module 204, and a pen plus module 206.
[0031] The touch module 200 is representative of functionality to deliver processed touch data to various entities. For example, the applications 104 and/or or the operating system 110 can receive processed touch data via the touch module 200. The pen module 202 is representative of functionality to deliver pen input data to various entities. In implementations, an entity (e.g., the applications 104 and/or or the operating system 110) can request to receive input data via the pen module 202. Thus, when pen input is received by the tactile input device 114, resulting pen input data can be provided to such an entity via the pen module 202.
[0032] The touch plus module 204 is representative of functionality to deliver a combination of processed touch data and raw touch data. For example, the application processor module 106 can provide functionality to process these different types of data for one or more of the applications 104. A particular application, for instance, can use processed touch data for one purpose (e.g., moving a cursor on a screen), and raw touch data for another purpose, such as moving a larger image or collection of images on a screen. Thus, an application that requests to receive input data via the touch plus module 204 can receive processed touch data and raw touch data that result from input to the tactile input device 114.
[0033] The pen plus module 206 is representative of functionality to deliver a combination of pen input data, processed touch data, and raw touch data. For example, instances of the application processor modules 106 can provide functionality to process these different types of input data for one or more of the applications 104. A particular application, for instance, can use pen input data for one purpose (e.g., generating text), and raw touch data for another purpose, such as drawing images on a display screen. Thus, an application that requests to receive input data via the pen plus module 206 can receive pen input data, processed touch data, and raw touch data that result from input to the tactile input device 114.
[0034] These examples of the input profile modules 122 are presented for purposes of illustration only, and a wide variety of different types and combinations of input data can be represented via the input profile modules 122 in accordance with one or more embodiments.
[0035] Having described an example environment in which the techniques described herein may operate, consider now a discussion of an example implementation scenario in accordance with one or more embodiments.
Example Implementation Scenario
[0036] The following discussion describes an example implementation scenario 300 in accordance with one or more embodiments. In portions of the following discussion, reference will be made to the environment 100 of FIG. 1 and the input profile modules
122.
[0037] The scenario 300 includes an application 302, an application 304, and an application 306. The applications 302, 304, and 306 can be implementations of the applications 104, the web browser 108, the operating system 110, and/or another application or entity that can utilize input from the tactile input device 114.
[0038] Further to the scenario 300, the application 302 is configured to utilize processed touch data from the touch module 200, and pen input data from the pen module 202. In implementations, the application 302 can be configured to alternately receive processed touch data or pen input data. For example, a user can provide touch input to the tactile input device 114, which produces raw touch data. The raw touch data can be processed (e.g., by the tactile device driver 120) to produce processed touch data. The processed touch data is forwarded via the touch module 200 to the device processor module 126. The device processor module 126 can further process the processed touch data to put it in a form that can be utilized by the application 302, and forward the processed touch data to the application 302. The application 302 can use the processed touch data to perform various tasks.
[0039] Further to the scenario 300, the user can provide pen input to the tactile input device 114. For example, the user can provide the pen input along with the touch input discussed above, and/or subsequent to the touch input. The tactile device driver 120 ascertains that the application 302 is configured to alternately receive touch input data or pen input data, and that the application prioritizes pen input data over touch input data. Thus, the tactile device driver 120 stops sending touch input data to the touch module 200, and initiates sending pen input data to the pen module 202. The pen module 202 delivers the pen input data to the device processor module 126, which can perform processing on the pen input data and forward the processed pen input data to the application 302.
[0040] Thus, in implementations where touch input and pen input are provided simultaneously, touch input data can be suppressed such that touch input data generated by the tactile input device 114 is not sent to the application. Such a configuration can be useful to prevent incidental touch input from causing unintentional input to an active application in a scenario where a user is providing pen input.
[0041] Continuing with the scenario 300, the application 304 is configured to utilize processed touch data and raw touch data. To enable the application 304 to receive such data, an application processor module 305 included as part of the application 304 sends a request to the input configuration module 124 to receive touch data and raw touch data. In implementations, the application processor module 305 is an example implementation of the application processor module 106, discussed above. The input configuration module 124 receives the request and notifies the tactile device driver 120 to send processed touch data and raw touch data to the application 304 via the touch plus module 204. When a user provides touch input to the tactile input device 114, the tactile device driver 120 sends processed touch data and raw touch data to the device processor module 126 via the touch plus module 204. The device processor module 126 can (optionally) perform processing on the processed touch data and/or the raw touch data, and forward the data to the application processor module 305.
[0042] The application processor module 305 can further process the processed touch data and/or the raw touch data such that the application 304 can use the processed touch data and raw touch data to perform various tasks. For example, as discussed below, the application processor module 305 can filter out specific types of input data that the application 304 is not configured to utilize. Thus, the application 304 can be provided with portions of the processed touch data and/or the raw touch data that the application 304 is configured to utilize.
[0043] Further to the scenario 300, the application 306 is configured to utilize processed touch data, raw touch data, and pen input data. Accordingly, an application processor module 307 included as part of the application 306 sends a request to the input configuration module 124 to receive processed touch data, raw touch data, and pen input data. In implementations, the application processor module 307 is an example implementation of the application processor module 106, discussed above. The input configuration module 124 receives the request and notifies the tactile device driver 120 to send processed touch data, raw touch data, and pen input data to the application 306 via the pen plus module 206. When a user provides touch input and pen input to the tactile input device 114, the tactile device driver 120 sends processed touch data, raw touch data, and pen input data to the device processor module 126 via the pen plus module 206. The device processor module 126 can (optionally) perform processing on the processed touch data, raw touch data, and pen input data, and forward the data to the application processor module 307.
[0044] The application processor module 307 can further process the processed touch data, raw touch data, and pen input data such that the application 306 can use the processed touch data, raw touch data, and pen input data to perform various tasks. For example, the application processor module 307 can filter out specific types of input data that the application 306 is not configured to utilize. Thus, the application 306 can be provided with portions of the processed touch data, raw touch data, and pen input data that the application 306 is configured to utilize.
[0045] In the scenario 300, each of the applications is discussed as receiving input data from a particular one of the input profile modules 122. In implementations, when a particular application is active and receiving input data from a particular input profile module 122, the tactile device driver 118 can refrain from sending input data via others of the input profile modules 122. For example, in a scenario where no applications that utilize raw touch data are active, the tactile device driver 120 can refrain from sending raw touch data, e.g., via the touch plus module 204 and/or the pen plus module 206. This can conserve system resources (e.g., processor bandwidth) that may be utilized to send raw touch data.
[0046] Further, although applications are illustrated as receiving input data from particular instances of the input profile modules 122, this is not intended to be limiting on the disclosed embodiments. In implementations, applications can receive input data from whichever of the input profile modules 122 is currently sending an input data stream, and can extract input data from the input data stream that the applications are configured to utilize to perform various tasks.
[0047] For example, as discussed above, the application 302 is configured to utilize processed touch data and pen input data. Thus, the application 302 may not be configured to utilize other forms of input data, such as raw touch data from the touch plus module 204. When an input data stream is being sent via the touch plus module 204, the application 302 can extract input data from the input data stream that the application 302 is configured to utilize. For example, the application 302 can extract processed touch data from the input data stream, and can ignore raw touch data included in the input data stream.
[0048] As another example and as referenced above, the application 304 is configured to utilize processed and raw touch data. Thus, in implementations, the application 304 may not be configured to utilize pen input data. When an input data stream is being sent via the pen plus module 206, the application 304 can extract input data from the input data stream that the application 304 is configured to utilize. For example, the application processor module 305 can process the input data stream, and can extract processed touch data and/or raw touch data from the input data stream. The application processor module 305 can provide the processed touch data and/or the raw touch data to the application 304 to enable the application 304 to perform various tasks using the input data.
[0049] Thus, techniques discussed herein can enable an application to utilize at least some input data extracted from various different input data streams, even if the application is not configured to utilize and/or understand all of the input data in a particular input data stream. For example, the application processor modules 106 (e.g., the application processor module 305 and/or the application processor module 307) can be configured to extract specific types of input data for particular applications. Thus, the applications can be provided with types of input data that the applications are configured to utilize and/or understand.
[0050] Having discussed an example implementation scenario, consider now some example procedures in accordance with one or more embodiments.
Example Procedures
[0051] The following discussion describes example procedures for providing input data type profiles in accordance with one or more embodiments. In portions of the following discussion, reference will be made to the environment 100 of FIG. 1 and the example implementation scenario discussed above.
[0052] FIG. 4 is a flow diagram that describes steps in a method in accordance with one or more embodiments. Step 400 receives a request from an application to receive input data according to a particular input data type profile. For example, the input configuration module 124 can receive a request from the applications 104 (e.g., from one of the application processor modules 106), the operating system 110, and so forth, to be sent input data according to a particular input data type and/or combination of input data types. Examples of input data types and combinations of input data types are discussed above with reference to the input profile modules 122.
[0053] Step 402 sends a notification to send input data to the application according to the particular input data type profile. As discussed above, the input configuration module 124 can notify the tactile device driver 120 (or other of the input device drivers 118) to send input to an application or other entity via a particular one of the input profile modules 122.
[0054] FIG. 5 is a flow diagram that describes steps in a method in accordance with one or more embodiments. In implementations, the method describes a continuation of the method discussed above with respect to FIG. 4. Step 500 receives a notification to send input data to an application according to a requested input data type profile. For example, the tactile device driver 120 can receive a notification from the input configuration module 124 to send a particular type and/or combination of tactile input data to an application.
[0055] Step 502 ascertains whether the requested input data type profile is currently active. For example, the tactile device driver 120 can ascertain whether it is currently sending input data based on the requested input data type profile. The tactile device driver 120, for instance, can determine whether the requested input profile matches one of the input profile modules 122 currently being used to send tactile input data.
[0056] If the requested input profile is currently active ("Yes"), step 504 sends input data according to the requested input data type profile. For example, the tactile device driver 120 can send tactile input data to the device processor module 126 and/or one of the applications 104 via one of the input profile modules 122 that corresponds to the requested input data type profile.
[0057] If the particular input profile is not currently active ("No"), step 506 initiates sending input data accordingly to the requested input data type profile. For example, the tactile device driver 120 can switch from sending input data via one of the input profile modules 122, to sending input via a different one of the input profile modules 122 that corresponds to the requested input data type profile. As discussed above, some input profiles specify multiple different types of input data, such as combinations of raw touch data, processed touch data, pen input data, and so on. Thus, at least some input profiles (e.g., input profile modules 122) can be leveraged to send multiple different types of input data in parallel.
[0058] FIG. 6 is a flow diagram that describes steps in a method in accordance with one or more embodiments. In implementations, the method describes a continuation of the methods discussed above with respect to FIGS. 4 and 5.
[0059] Step 600 receives an indication that an application associated with a particular input data type profile is inactivated. For example, the input configuration module 124 and/or the tactile device driver 120 can receive an indication that a formerly active application has become inactive. The application, for instance, may be closed such that the application is no longer running on a computing device. Alternatively, a graphical user interface for the application can be visually minimized on a display screen, thus indicating that the application is not in focus as part of a user interaction. In implementations, the input configuration module 124 can receive a notification that the application is has become inactive, and can notify the tactile device driver 120.
[0060] Step 602 determines that no other applications are active to receive input via the particular input data type profile. For example, the input configuration module 124 and/or the tactile device driver 120 can determine that no other applications are active to receive input data according to a particular one of the input profile modules 122 associated with the inactivated application.
[0061] Step 604 stops sending input data according to the particular input data type profile. For instance, in response to the indication that the application is inactivated and/or that no other applications are active to receive input via the particular input data type profile, the tactile device driver 120 can stop sending input data that corresponds to the particular input data type profile. The tactile device driver 120, for example, can stop sending input data via one of the input profile modules 122 that corresponds to the particular input data type profile. Thus, in implementations, device resources can be conserved by not sending input data that is not being consumed by an application or other process.
[0062] Having discussed some example procedures, consider now a discussion of an example system and device in accordance with one or more embodiments.
Example System and Device
[0063] FIG. 7 illustrates an example system generally at 700 that includes an example computing device 702 that is representative of one or more computing systems and/or devices that may implement various techniques described herein. For example, the computing device 102 discussed above with reference to FIG. 1 can be embodied as the computing device 702. The computing device 702 may be, for example, a server of a service provider, a device associated with the client (e.g., a client device), an on-chip system, and/or any other suitable computing device or computing system.
[0064] The example computing device 702 as illustrated includes a processing system 704, one or more computer-readable media 706, and one or more Input/Output (I/O) Interfaces 708 that are communicatively coupled, one to another. Although not shown, the computing device 702 may further include a system bus or other data and command transfer system that couples the various components, one to another. A system bus can include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures. A variety of other examples are also contemplated, such as control and data lines.
[0065] The processing system 704 is representative of functionality to perform one or more operations using hardware. Accordingly, the processing system 704 is illustrated as including hardware element 710 that may be configured as processors, functional blocks, and so forth. This may include implementation in hardware as an application specific integrated circuit or other logic device formed using one or more semiconductors. The hardware elements 710 are not limited by the materials from which they are formed or the processing mechanisms employed therein. For example, processors may be comprised of semiconductor(s) and/or transistors (e.g., electronic integrated circuits (ICs)). In such a context, processor-executable instructions may be electronically-executable instructions.
[0066] The computer-readable media 706 is illustrated as including memory/storage 712. The memory/storage 712 represents memory/storage capacity associated with one or more computer-readable media. The memory/storage 712 may include volatile media (such as random access memory (RAM)) and/or nonvolatile media (such as read only memory (ROM), Flash memory, optical disks, magnetic disks, and so forth). The memory/storage 712 may include fixed media (e.g., RAM, ROM, a fixed hard drive, and so on) as well as removable media (e.g., Flash memory, a removable hard drive, an optical disc, and so forth). The computer-readable media 706 may be configured in a variety of other ways as further described below.
[0067] Input/output interface(s) 708 are representative of functionality to allow a user to enter commands and information to computing device 702, and also allow information to be presented to the user and/or other components or devices using various input/output devices. Examples of input devices include a keyboard, a cursor control device (e.g., a mouse), a microphone (e.g., for voice recognition and/or spoken input), a scanner, touch functionality (e.g., capacitive or other sensors that are configured to detect physical touch), a camera (e.g., which may employ visible or non-visible wavelengths such as infrared frequencies to detect movement that does not involve touch as gestures), and so forth. Examples of output devices include a display device (e.g., a monitor or projector), speakers, a printer, a network card, tactile-response device, and so forth. Thus, the computing device 702 may be configured in a variety of ways as further described below to support user interaction.
[0068] Various techniques may be described herein in the general context of software, hardware elements, or program modules. Generally, such modules include routines, programs, objects, elements, components, data structures, and so forth that perform particular tasks or implement particular abstract data types. The terms "module," "functionality," and "component" as used herein generally represent software, firmware, hardware, or a combination thereof. The features of the techniques described herein are platform-independent, meaning that the techniques may be implemented on a variety of commercial computing platforms having a variety of processors.
[0069] An implementation of the described modules and techniques may be stored on or transmitted across some form of computer-readable media. The computer-readable media may include a variety of media that may be accessed by the computing device 702. By way of example, and not limitation, computer-readable media may include "computer- readable storage media" and "computer-readable signal media."
[0070] "Computer-readable storage media" may refer to media and/or devices that enable persistent and/or non-transitory storage of information in contrast to mere signal transmission, carrier waves, or signals per se. Thus, computer-readable storage media does not include signal bearing media. The computer-readable storage media includes hardware such as volatile and non-volatile, removable and non-removable media and/or storage devices implemented in a method or technology suitable for storage of information such as computer readable instructions, data structures, program modules, logic elements/circuits, or other data. Examples of computer-readable storage media may include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, hard disks, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or other storage device, tangible media, or article of manufacture suitable to store the desired information and which may be accessed by a computer.
[0071] "Computer-readable signal media" may refer to a signal-bearing medium that is configured to transmit instructions to the hardware of the computing device 702, such as via a network. Signal media typically may embody computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as carrier waves, data signals, or other transport mechanism. Signal media also include any information delivery media. The term "modulated data signal" means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, radio frequency (RF), infrared, and other wireless media.
[0072] As previously described, hardware elements 710 and computer-readable media 706 are representative of instructions, modules, programmable device logic and/or fixed device logic implemented in a hardware form that may be employed in some embodiments to implement at least some aspects of the techniques described herein. Hardware elements may include components of an integrated circuit or on-chip system, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), and other implementations in silicon or other hardware devices. In this context, a hardware element may operate as a processing device that performs program tasks defined by instructions, modules, and/or logic embodied by the hardware element as well as a hardware device utilized to store instructions for execution, e.g., the computer-readable storage media described previously.
[0073] Combinations of the foregoing may also be employed to implement various techniques and modules described herein. Accordingly, software, hardware, or program modules and other program modules may be implemented as one or more instructions and/or logic embodied on some form of computer-readable storage media and/or by one or more hardware elements 710. The computing device 702 may be configured to implement particular instructions and/or functions corresponding to the software and/or hardware modules. Accordingly, implementation of modules that are executable by the computing device 702 as software may be achieved at least partially in hardware, e.g., through use of computer-readable storage media and/or hardware elements 710 of the processing system. The instructions and/or functions may be executable/operable by one or more articles of manufacture (for example, one or more computing devices 702 and/or processing systems 704) to implement techniques, modules, and examples described herein.
[0074] As further illustrated in FIG. 7, the example system 700 enables ubiquitous environments for a seamless user experience when running applications on a personal computer (PC), a television device, and/or a mobile device. Services and applications run substantially similar in all three environments for a common user experience when transitioning from one device to the next while utilizing an application, playing a video game, watching a video, and so on.
[0075] In the example system 700, multiple devices are interconnected through a central computing device. The central computing device may be local to the multiple devices or may be located remotely from the multiple devices. In one embodiment, the central computing device may be a cloud of one or more server computers that are connected to the multiple devices through a network, the Internet, or other data communication link.
[0076] In one embodiment, this interconnection architecture enables functionality to be delivered across multiple devices to provide a common and seamless experience to a user of the multiple devices. Each of the multiple devices may have different physical requirements and capabilities, and the central computing device uses a platform to enable the delivery of an experience to the device that is both tailored to the device and yet common to all devices. In one embodiment, a class of target devices is created and experiences are tailored to the generic class of devices. A class of devices may be defined by physical features, types of usage, or other common characteristics of the devices.
[0077] In various implementations, the computing device 702 may assume a variety of different configurations, such as for computer 714, mobile 716, and television 718 uses. Each of these configurations includes devices that may have generally different constructs and capabilities, and thus the computing device 702 may be configured according to one or more of the different device classes. For instance, the computing device 702 may be implemented as the computer 714 class of a device that includes a personal computer, desktop computer, a multi-screen computer, laptop computer, netbook, and so on.
[0078] The computing device 702 may also be implemented as the mobile 716 class of device that includes mobile devices, such as a mobile phone, portable music player, portable gaming device, a tablet computer, a multi-screen computer, and so on. The computing device 702 may also be implemented as the television 718 class of device that includes devices having or connected to generally larger screens in casual viewing environments. These devices include televisions, set-top boxes, gaming consoles, and so on.
[0079] The techniques described herein may be supported by these various configurations of the computing device 702 and are not limited to the specific examples of the techniques described herein. For example, functionalities discussed with reference to the computing device 102 may be implemented all or in part through use of a distributed system, such as over a "cloud" 720 via a platform 722 as described below.
[0080] The cloud 720 includes and/or is representative of a platform 722 for resources 724. The platform 722 abstracts underlying functionality of hardware (e.g., servers) and software resources of the cloud 720. The resources 724 may include applications and/or data that can be utilized while computer processing is executed on servers that are remote from the computing device 702. Resources 724 can also include services provided over the Internet and/or through a subscriber network, such as a cellular or Wi-Fi network.
[0081] The platform 722 may abstract resources and functions to connect the computing device 702 with other computing devices. The platform 722 may also serve to abstract scaling of resources to provide a corresponding level of scale to encountered demand for the resources 724 that are implemented via the platform 722. Accordingly, in an interconnected device embodiment, implementation of functionality described herein may be distributed throughout the system 700. For example, the functionality may be implemented in part on the computing device 702 as well as via the platform 722 that abstracts the functionality of the cloud 720.
[0082] Discussed herein are a number of methods that may be implemented to perform techniques discussed herein. Aspects of the methods may be implemented in hardware, firmware, or software, or a combination thereof. The methods are shown as a set of blocks that specify operations performed by one or more devices and are not necessarily limited to the orders shown for performing the operations by the respective blocks. Further, an operation shown with respect to a particular method may be combined and/or interchanged with an operation of a different method in accordance with one or more implementations. Aspects of the methods can be implemented via interaction between various entities discussed above with reference to the environment 100.
Conclusion
[0083] Techniques for providing input data type profiles are described. Although embodiments are described in language specific to structural features and/or methodological acts, it is to be understood that the embodiments defined in the appended claims are not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as example forms of implementing the claimed embodiments.

Claims

CLAIMS What is claimed is:
1. One or more computer-readable storage media comprising instructions stored thereon that, responsive to execution by a computing device, cause the computing device to implement modules comprising:
a set of modules configured to specify different combinations of input data types; and
an input configuration module configured to:
receive requests from applications for input data according to input data type profiles associated with the set of modules; and
notify an input functionality to send input data to the applications based on the input data type profiles associated with the set of modules.
2. One or more computer-readable storage media as described in claim 1, wherein at least one module of the set of modules specifies a combination of raw touch data and processed touch data.
3. One or more computer-readable storage media as described in claim 1, wherein at least one module of the set of modules specifies a combination of raw touch data, processed touch data, and pen data.
4. One or more computer-readable storage media as described in claim 1, wherein the input functionality comprises an input device driver, and wherein the input device driver is configured to:
receive a notification from the input configuration module to send input data, generated by an input device, to an application, wherein the notification specifies to send the input data via a module of the set of modules that specifies a combination of multiple input data types; and
send input data based on the multiple input data types in parallel to the application.
5. One or more computer-readable storage media as described in claim 1, wherein the input functionality comprises an input device driver, and wherein the input device driver is configured to:
receive a notification from the input configuration module to send input data generated by a tactile input device to an application, wherein the notification specifies to send the input data via a module of the set of modules that specifies a combination of multiple types of input data generated via input to the tactile input device; and send the input data based on the multiple types of input data in parallel to the application.
6. One or more computer-readable storage media as described in claim 1, wherein the input functionality comprises an input device driver, and wherein the input device driver is configured to:
receive a notification from the input configuration module to send input data generated by an input device to an application, wherein the notification specifies to send the input data via a module of the set of modules that specifies a combination of raw touch data and processed touch data; and
send the raw touch data and processed touch data in parallel to the application.
7. One or more computer-readable storage media as described in claim 1, wherein the input functionality comprises an input device driver, and wherein the input device driver is configured to:
receive a notification from the input configuration module to send input data generated by an input device to an application, wherein the notification specifies to send the input data via a module of the set of modules that specifies a combination of raw touch data, processed touch data, and pen data; and
send the raw touch data, processed touch data, and pen data in parallel to the application.
8. A computer- implemented method, comprising:
receiving a request from an application to receive input data according to a particular input data type profile, the particular input data type profile being associated with multiple input data types to be sent in parallel; and
sending a notification to an input device to send input data to the application according to the particular input data type profile.
9. A method as described in claim 8, wherein the multiple input data types comprise raw touch data and processed touch data generated via input to a tactile input device.
10. A method as described in claim 8, wherein the multiple input data types comprise raw touch data, processed touch data, and pen data generated via input to a tactile input device.
PCT/US2013/031799 2012-03-15 2013-03-14 Input data type profiles WO2013138675A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201380014233.0A CN104169874B (en) 2012-03-15 2013-03-14 Input data type profiles
EP13760553.1A EP2825955B1 (en) 2012-03-15 2013-03-14 Input data type profiles

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/421,144 US9256314B2 (en) 2012-03-15 2012-03-15 Input data type profiles
US13/421,144 2012-03-15

Publications (1)

Publication Number Publication Date
WO2013138675A1 true WO2013138675A1 (en) 2013-09-19

Family

ID=49157139

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2013/031799 WO2013138675A1 (en) 2012-03-15 2013-03-14 Input data type profiles

Country Status (4)

Country Link
US (1) US9256314B2 (en)
EP (1) EP2825955B1 (en)
CN (1) CN104169874B (en)
WO (1) WO2013138675A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11330680B2 (en) 2013-05-21 2022-05-10 Goji Limited Calibration of an RF processing system

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9078091B2 (en) * 2012-05-02 2015-07-07 Nokia Technologies Oy Method and apparatus for generating media based on media elements from multiple locations
KR20140112910A (en) * 2013-03-14 2014-09-24 삼성전자주식회사 Input controlling Method and Electronic Device supporting the same
KR102157270B1 (en) 2013-04-26 2020-10-23 삼성전자주식회사 User terminal device with a pen and control method thereof
TWI578213B (en) * 2014-12-11 2017-04-11 義隆電子股份有限公司 Processing method for touch signal and computer system thereof
US20160170552A1 (en) * 2014-12-11 2016-06-16 Elan Microelectronics Corporation Processing method for touch signal and computer system thereof
US20180088786A1 (en) * 2016-09-23 2018-03-29 Microsoft Technology Licensing, Llc Capacitive touch mapping
CN106856479A (en) * 2017-01-24 2017-06-16 杭州雄伟科技开发股份有限公司 A kind of data processing method and data handling system
CN107704126A (en) * 2017-09-22 2018-02-16 广州视源电子科技股份有限公司 A kind of separation method of touch data, device, equipment and storage medium
US11954325B1 (en) 2023-04-05 2024-04-09 Honeywell International Inc. Methods and systems for assigning text entry components to cursors

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0683522A (en) * 1992-09-01 1994-03-25 Fujitsu Ltd Coordinate input system
JPH09190268A (en) * 1996-01-11 1997-07-22 Canon Inc Information processor and method for processing information
US20070288937A1 (en) 2006-05-08 2007-12-13 Microsoft Corporation Virtual Device Driver
US20080158145A1 (en) * 2007-01-03 2008-07-03 Apple Computer, Inc. Multi-touch input discrimination
US20090225037A1 (en) 2008-03-04 2009-09-10 Apple Inc. Touch event model for web pages
US20100182247A1 (en) * 2009-01-21 2010-07-22 Microsoft Corporation Bi-modal multiscreen interactivity
WO2011084156A2 (en) 2010-01-06 2011-07-14 Apple Inc. Device, method, and graphical user interface for mapping directions between search results
WO2011143720A1 (en) 2010-05-21 2011-11-24 Rpo Pty Limited Methods for interacting with an on-screen document

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6963937B1 (en) * 1998-12-17 2005-11-08 International Business Machines Corporation Method and apparatus for providing configurability and customization of adaptive user-input filtration
US7116310B1 (en) * 1999-04-06 2006-10-03 Microsoft Corporation Application programming interface that maps input device controls to software actions
US7190348B2 (en) * 2000-12-26 2007-03-13 International Business Machines Corporation Method for touchscreen data input
US8719284B2 (en) * 2002-12-18 2014-05-06 International Business Machines Corporation Method, system and program product for filtering an entry of data items
US7928964B2 (en) * 2005-04-22 2011-04-19 Microsoft Corporation Touch input data handling
US8587526B2 (en) * 2006-04-12 2013-11-19 N-Trig Ltd. Gesture recognition feedback for a dual mode digitizer
US8589824B2 (en) 2006-07-13 2013-11-19 Northrop Grumman Systems Corporation Gesture recognition interface system
US7907125B2 (en) 2007-01-05 2011-03-15 Microsoft Corporation Recognizing multiple input point gestures
US8436815B2 (en) * 2007-05-25 2013-05-07 Microsoft Corporation Selective enabling of multi-input controls
US20080313607A1 (en) 2007-06-15 2008-12-18 Microsoft Corporation Unified input stack
US8576200B2 (en) 2011-02-03 2013-11-05 Hong Kong Applied Science And Technology Research Institute Co. Ltd. Multiple-input touch panel and method for gesture recognition

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0683522A (en) * 1992-09-01 1994-03-25 Fujitsu Ltd Coordinate input system
JPH09190268A (en) * 1996-01-11 1997-07-22 Canon Inc Information processor and method for processing information
US20070288937A1 (en) 2006-05-08 2007-12-13 Microsoft Corporation Virtual Device Driver
US20080158145A1 (en) * 2007-01-03 2008-07-03 Apple Computer, Inc. Multi-touch input discrimination
US20090225037A1 (en) 2008-03-04 2009-09-10 Apple Inc. Touch event model for web pages
US20100182247A1 (en) * 2009-01-21 2010-07-22 Microsoft Corporation Bi-modal multiscreen interactivity
WO2011084156A2 (en) 2010-01-06 2011-07-14 Apple Inc. Device, method, and graphical user interface for mapping directions between search results
WO2011143720A1 (en) 2010-05-21 2011-11-24 Rpo Pty Limited Methods for interacting with an on-screen document

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11330680B2 (en) 2013-05-21 2022-05-10 Goji Limited Calibration of an RF processing system

Also Published As

Publication number Publication date
EP2825955A4 (en) 2016-03-16
US20130241840A1 (en) 2013-09-19
CN104169874B (en) 2017-04-12
CN104169874A (en) 2014-11-26
EP2825955B1 (en) 2021-02-24
EP2825955A1 (en) 2015-01-21
US9256314B2 (en) 2016-02-09

Similar Documents

Publication Publication Date Title
US9256314B2 (en) Input data type profiles
US10656750B2 (en) Touch-sensitive bezel techniques
CN108369456B (en) Haptic feedback for touch input devices
US9189147B2 (en) Ink lag compensation techniques
US10191633B2 (en) Closing applications
US10872454B2 (en) Panning animations
US9348501B2 (en) Touch modes
US9720567B2 (en) Multitasking and full screen menu contexts
US10956663B2 (en) Controlling digital input
US10365757B2 (en) Selecting first digital input behavior based on a second input
US20170277311A1 (en) Asynchronous Interaction Handoff To System At Arbitrary Time
US20190034069A1 (en) Programmable Multi-touch On-screen Keyboard

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13760553

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2013760553

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE