US20190294236A1 - Method and System for Processing Signals that Control a Device Using Human Breath - Google Patents
Method and System for Processing Signals that Control a Device Using Human Breath Download PDFInfo
- Publication number
- US20190294236A1 US20190294236A1 US16/285,647 US201916285647A US2019294236A1 US 20190294236 A1 US20190294236 A1 US 20190294236A1 US 201916285647 A US201916285647 A US 201916285647A US 2019294236 A1 US2019294236 A1 US 2019294236A1
- Authority
- US
- United States
- Prior art keywords
- controlled
- signals
- user interface
- interface
- enabled
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims abstract description 18
- 238000012545 processing Methods 0.000 title abstract description 70
- 238000001514 detection method Methods 0.000 claims abstract description 33
- 230000004044 response Effects 0.000 claims abstract description 13
- 238000004891 communication Methods 0.000 abstract description 25
- 230000000977 initiatory effect Effects 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 10
- 238000004590 computer program Methods 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 239000012530 fluid Substances 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 230000003203 everyday effect Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000005355 Hall effect Effects 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 238000000115 helium ionisation detection Methods 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000029058 respiratory gaseous exchange Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Definitions
- Certain embodiments of the invention relate to controlling a computer or electronic system. More specifically, certain embodiments of the invention relate to a method and system for processing signals that control a device using human breath.
- Mobile communications have changed the way people communicate and mobile phones have been transformed from a luxury item to an essential part of every day life.
- the use of mobile phones is today dictated by social situations, rather than hampered by location or technology.
- most mobile devices are equipped with a user interface that allows users to access the services provided via the Internet.
- some mobile devices may have browsers, and software and/or hardware buttons may be provided to enable navigation and/or control of the user interface.
- Some mobile devices such as Smartphones are equipped with touch screen capability that allows users to navigate or control the user interface via touching with one hand while the device is held in another hand.
- a system and/or method for processing signals that control a device using human breath substantially as shown in and/or described in connection with at least one of the figures, as set forth more completely in the claims.
- FIG. 1A is a block diagram of an exemplary system for controlling a user interface of a plurality of devices using human breath, in accordance with an embodiment of the invention.
- FIG. 1B is a block diagram of an exemplary sensing module to detect human breath, in accordance with an embodiment of the invention.
- FIG. 1C is a block diagram of another embodiment of an exemplary system for controlling a user interface of a device using human breath, in accordance with an embodiment of the invention.
- FIG. 1D is a block diagram of an exemplary processor interacting with a device being controlled, in accordance with an embodiment of the invention.
- FIG. 1E is a block diagram of an exemplary MEMS sensing and processing module interacting with a device being controlled, in accordance with an embodiment of the invention.
- FIG. 2 is a block diagram of an exemplary user interface interacting with a MEMS sensing and processing module and a host system, in accordance with an embodiment of the invention.
- FIG. 3 is a flowchart illustrating exemplary steps for processing signals that control a device using human breath.
- FIG. 4 is a flowchart illustrating exemplary steps for processing signals that control a device using human breath.
- Certain aspects of the invention may be found in a method and system for processing signals that control a device using human breath.
- exemplary aspects of the invention may comprise receiving at the device, one or more signals from a detection device operable to function as a human interface device (HID).
- the signals may be generated in response to detection of movement of air caused by expulsion of human breath.
- Human interfacing with a user interface such as a graphical user interface (GUI) of the device may be enabled via the received signals.
- the detection device may comprise a micro-electro-mechanical system (MEMS) detector.
- MEMS micro-electro-mechanical system
- the received signals may be formatted into a HID profile.
- the HID profile may comprise one or more drivers and/or libraries that enables the interfacing with the GUI of the device.
- the drivers may enable one or more of initiation, establishment and/or termination of communication by the device.
- FIG. 1A is a block diagram of an exemplary system for controlling a user interface of a plurality of devices using human breath, in accordance with an embodiment of the invention.
- a user 102 a micro-electro-mechanical system (MEMS) sensing and processing module 104 , and a plurality of devices to be controlled, such as a multimedia device 106 a , a cellphone/smartphone/dataphone 106 b , a personal computer (PC), laptop or a notebook computer 106 c , a display device 106 d and/or a television (TV)/game console/other platform 106 e .
- MEMS micro-electro-mechanical system
- the multimedia device 106 a may comprise a user interface 107 a
- the cellphone/smartphone/dataphone 106 b may comprise a user interface 107 b
- the personal computer (PC), laptop or a notebook computer 106 c may comprise a user interface 107 c
- the display device 106 d may comprise a user interface 107 d
- the television (TV)/game console/other platform 106 e may comprise a user interface 107 e .
- Each of the plurality of devices to be controlled may be wired or wirelessly connected to a plurality of other devices 108 for loading of information, and/or communication of information, for example, peer-to-peer and/or network communication.
- Exemplary other devices 108 may comprise game consoles, immersive or 3 D reality devices, and/or telematic devices.
- Telematic devices refers to devices comprising integrated computing, wireless communication and/or global navigation satellite system devices, which enables sending, receiving and/or storing of information over networks.
- the MEMS sensing and processing module 104 may be enabled to detect movement caused by expulsion of human breath by the user 102 . In response to the detection of movement caused by expulsion of human breath, the MEMS sensing and processing module 104 may be enabled to generate one or more controls signals.
- the MEMS sensing and processing module 104 may comprise one or more sensors, sensing segments and/or sensing members that may be operable to sense the kinetic energy generated by the expulsion of the human breath and accordingly generate the one or more control signals.
- the generated one or more control signals may be enabled to control a user interface of one or more of a plurality of devices, such as the user interface 107 a of the multimedia device 106 a , the user interface 107 b of the cellphone/smartphone/dataphone 106 b , the user interface 107 c of the PC, laptop or a notebook computer 106 c , the user interface 107 d of the display device 106 d , the user interface 107 e of the TV/game console/other platform 106 e , and the user interfaces of the mobile multimedia player and/or a remote controller.
- a user interface is a graphical user interface (GUI).
- the detection of the movement caused by expulsion of human breath may occur without use of a channel.
- the detection of the movement caused by expulsion of human breath may be responsive to the expulsion of human breath into open space, which is then sensed.
- the MEMS sensing and processing module 104 may be enabled to navigate within the user interface of one of more of the plurality of devices, such as a handheld device, for example, a multimedia device 106 a , a cellphone/smartphone/dataphone 106 b , a PC, laptop or a notebook computer 106 c , a display device 106 d , and/or a TV/game console/other platform 106 e via the generated one or more control signals.
- the MEMS sensing and processing module 104 may be enabled to select one or more components within the user interface of the plurality of devices via the generated one or more control signals.
- the generated one or more control signals may comprise one or more of a wired and/or a wireless signal.
- one or more of the plurality of devices such as a handheld device, for example, a multimedia device 106 a and/or a cellphone/smartphone/dataphone 106 b and/or a PC, laptop or a notebook computer 106 c may be enabled to receive one or more inputs defining the user interface from another device 108 .
- the other device 108 may be one or more of a PC, laptop or a notebook computer 106 c and/or a handheld device, for example, and without limitation, a multimedia device 106 a and/or a cellphone/smartphone/dataphone 106 b .
- data may be transferred from the other device 108 to the cellphone/smartphone/dataphone 106 b and this data may be associated or mapped to media content that may be remotely accessed by the cellphone/smartphone/dataphone 106 b via a service provider such as a cellular or PCS service provider.
- the transferred data that is associated or mapped to media content may be utilized to customize the user interface 107 b of the cellphone/smartphone/dataphone 106 b .
- media content associated with one or more received inputs may become an integral part of the user interface of the device being controlled.
- the associating and/or mapping may be performed on either the other device 108 and/or one the cellphone/smartphone/dataphone 106 b . In instances where the associating and/or mapping is performed on the other device 108 , the associated and/or mapped data may be transferred from the other device 108 to the cellphone/smartphone/dataphone 106 b.
- an icon transferred from the other device 108 to the cellphone/smartphone/dataphone 106 b may be associated or mapped to media content such as an RSS feed, a markup language such as HTML, and XML, that may be remotely accessed by the cellphone/smartphone/dataphone 106 b via the service provider of the cellphone/smartphone 106 b . Accordingly, when the user 102 blows on the MEMS sensing and processing module 104 , control signals generated by the MEMS sensing and processing module 104 may navigate to the icon and select the icon.
- the RSS feed or markup language may be accessed via the service provider of the cellphone/smartphone/dataphone 106 b and corresponding RSS feed or markup language content may be displayed on the user interface 107 b .
- U.S. application Ser. No. ______ (Attorney Docket No. 19454US01) discloses an exemplary method and system for customizing a user interface of a device and is hereby incorporated herein by reference in its entirety.
- a user 102 may exhale into open space and the exhaled breath may be sensed by one or more detection devices or detectors, such as one or more sensors, sensing members and/or sensing segments in the MEMS sensing and processing module 104 .
- the MEMS sensing and processing module 104 may be enabled to detect movement caused by expulsion of human breath by the user 102 .
- One or more electrical, optical and/or magnetic signals may be generated by one or more detection devices or detectors within the MEMS sensing and processing module 104 in response to the detection of movement caused by expulsion of human breath.
- the processor firmware within the MEMS sensing and processing module 104 may be enabled to process the received electrical, optical and/or magnetic signals from the one or more detection device(s) or detector(s) utilizing various algorithms and generate one or more control signals to the device being controlled, for example, the multimedia device 106 a .
- the generated one or more control signals may be communicated to the device being controlled, for example, the multimedia device 106 a via a wired and/or a wireless signal.
- the processor in the device being controlled may utilize the communicated control signals to control the user interface of the device being controlled, such as a user interface 107 a of the multimedia device 106 a , a user interface 107 b of the cellphone/smartphone/dataphone 106 b , a user interface 107 c of the personal computer (PC), laptop or a notebook computer 106 c , a user interface 107 d of the display device 106 d , a user interface 107 e of the TV/game console/other platform 106 e , and a user interface of a mobile multimedia player and/or a remote controller.
- a user interface 107 a of the multimedia device 106 a such as a user interface 107 a of the multimedia device 106 a , a user interface 107 b of the cellphone/smartphone/dataphone 106 b , a user interface 107 c of the personal computer (PC), laptop or a notebook computer 106 c , a user interface 107
- FIG. 1B is a block diagram of an exemplary detection device or detector to detect human breath, in accordance with an embodiment of the invention.
- the sensing module 110 may comprise a sensor control chip 109 and a plurality of sensors, sensing members and/or sensing segments, for example, 111 a , 111 b , 111 c , and 111 d .
- the invention may not be so limited and the sensing module 110 may comprise more or less than the number of sensors, sensing members and/or sensing segments shown in FIG. 1B without limiting the scope of the invention.
- any number of detectors and sources may be utilized according to the desired size, sensitivity, and resolution desired.
- the type of sources and detectors may comprise other sensing mechanisms, other than visible light.
- piezoelectric, ultrasonic, Hall effect, electrostatic, and/or permanent or electro-magnet sensors may be activated by deflected MEMS members to generate a signal to be communicated to the sensor control chip 109 .
- the sensing module 110 may be an electrochemical sensor or any other type of breath analyzing sensor, for example.
- the plurality of sensors, sensing members and/or sensing segments 111 a - d may be an integral part of one or more MEMS devices that may enable the detection of various velocities of air flow from the user's 102 breath.
- the plurality of sensors, sensing members and/or sensing segments 111 a - d may be enabled to detect kinetic energy and/or movement caused by the expulsion of human breath by the user 102 .
- the sensor control chip 109 may be enabled to generate an electrical, optical and/or magnetic signal that may be communicated to the processor in response to the detection of kinetic energy and/or movement caused by expulsion of human breath.
- FIG. 1C is a block diagram of another embodiment of an exemplary system for controlling a user interface of a device using human breath, in accordance with an embodiment of the invention.
- a user 102 a MEMS sensing and processing module 104 , and a device being controlled 106 , such as a multimedia device 106 a , a cellphone/smartphone/dataphone 106 b , a PC, laptop or a notebook computer 106 c , a display device 106 d and/or a TV/game console/other platform 106 e .
- the device being controlled 106 may be wired and/or wirelessly connected to a plurality of other devices 108 for loading of information via, for example, side loading or other communication comprising, peer-to-peer communication, network communication, via wired and/or wireless connection.
- the MEMS sensing and processing module 104 may comprise a sensing module 110 , a processing module 112 and passive devices 113 .
- the passive devices 113 which may comprise resistors, capacitors and/or inductors, may be embedded within a substrate material of the MEMS processing sensing and processing module 104 .
- the processing module 112 may comprise, for example, an ASIC.
- the sensing module 110 may generally be referred to as a detection device or detector, and may comprise one or more sensors, sensing members and/or sensing segments that may be enabled to detect kinetic energy and/or movement caused by the expulsion of human breath by the user 102 .
- the sensing module 110 may be enabled to generate an electrical, optical and/or magnetic signal that may be communicated to the processing module 112 in response to the detection of kinetic energy and/or movement caused by expulsion of human breath.
- the processing module 112 may comprise suitable logic, circuitry and/or code that may be enabled to receive the generated electric signal from the sensing module 110 and generate one or more control signals to the device being controlled 106 .
- the processing module 112 may comprise one or more analog to digital converters that may be enabled to translate the sensed signal to one or more digital signals, which may be utilized to generate the one or more control signals.
- the generated one or more control signals may be enabled to control a user interface of the device being controlled 106 .
- the device being controlled 106 may comprise a user interface 107 . Accordingly, the generated one or more signals from the MEMS sensing and processing module 104 may be communicated to the device being controlled 106 and utilized to control the user interface 107 . In an exemplary embodiment of the invention, the one or more signals generated by the MEMS sensing and processing module 104 may be operable to control a pointer on the device being controlled 106 such that items in the user interface 107 may be selected and/or manipulated. In an exemplary embodiment of the invention, the device being controlled may be enabled to receive one or more inputs from the other devices 108 , which may be utilized to customize or define the user interface 107 .
- the other device 108 may be one or more of a PC, laptop or a notebook computer 106 c and/or a handheld device, for example, a multimedia device 106 a and/or a cellphone/smartphone/dataphone 106 b .
- the other device 108 may be similar to or different from the type of device that is being controlled 106 .
- a processor in the other device 108 may be operable to associate or map the data to media content that is remotely accessible by the device being controlled 106 .
- a processor in the device being controlled 106 may be operable to associate or map the data to media content that is remotely accessible by the device being controlled 106 .
- U.S. application Ser. No. ______ (Attorney Docket No. 19454US01) discloses an exemplary method and system for customizing a user interface of a device and is hereby incorporated herein by reference in its entirety.
- FIG. 1D is a block diagram of an exemplary processor interacting with a device being controlled, in accordance with an embodiment of the invention.
- a processing module 112 and a device being controlled 106 such as a multimedia device 106 a , a cellphone/smartphone/dataphone 106 b , a PC, laptop or a notebook computer 106 c , a display device 106 d and/or a TV/game console/other platform 106 e .
- the processing module 112 may be an ASIC and may comprise one or more analog to digital converters (ADCs) 114 , processor firmware 116 , and a communication module 118 .
- ADCs analog to digital converters
- the processing module 112 may comprise suitable logic, circuitry and/or code that may be enabled to receive a digital sensing signal and/or an analog sensing signal from the sensing module 110 .
- the ADC 114 may comprise suitable logic, circuitry and/or code that may be enabled to receive the generated analog sensing signal from the sensing module 110 and convert the received signal into a digital signal.
- the processor firmware 116 may comprise suitable logic, and/or code that may be enabled to receive and process the digital signal from the ADC 114 and/or the digital sensing signal from the sensing module 110 utilizing a plurality of algorithms to generate one or more control signals.
- the processor firmware 116 may be enabled to read, store, calibrate, filter, modelize, calculate and/or compare the outputs of the sensing module 110 .
- the processor firmware 116 may also be enabled to incorporate artificial intelligence (AI) algorithms to adapt to a particular user's 102 breathing pattern.
- the processor firmware 116 may be enabled to generate one or more control signals to the device being controlled 106 based on processing the received digital signals.
- the generated one or more control signals may be enabled to control a user interface of the device being controlled 106 , for example, scrolling, zooming, and/or 3-D navigation within the device being controlled 106 .
- the communication module 118 may comprise suitable logic, circuitry and/or code that may be enabled to receive and communicate the generated one or more control signals to the device being controlled 106 via a wired and/or a wireless signal.
- the communication module 118 may support a plurality of interfaces.
- the communication modules 118 and 120 may support an external memory interface, a universal asynchronous receiver transmitter (UART) interface, an enhanced serial peripheral interface (eSPI), a general purpose input/output (GPIO) interface, a pulse-code modulation (PCM) and/or an inter-IC sound (I 2 S) interface, an inter-integrated circuit (I 2 C) bus interface, a universal serial bus (USB) interface, a Bluetooth interface, a ZigBee interface, an IrDA interface, and/or a wireless USB (W-USB) interface.
- the device being controlled 106 may be enabled to receive the communicated control signals via a wired and/or a wireless signal.
- the device being controlled 106 may be enabled to utilize the received one or more control signals to control the user interface.
- FIG. 1E is a block diagram of an exemplary MEMS sensing and processing module interacting with a device being controlled, in accordance with an embodiment of the invention.
- a MEMS sensing and processing module 104 and a device being controlled 106 such as a multimedia device 106 a , a cell phone/smart phone 106 b , a PC, laptop or a notebook computer 106 c , a display device 106 d and/or a TV/game console/other platform 106 e .
- the device being controlled 106 may comprise a communication module 120 , a processor 122 , memory 123 , firmware 124 , a display 126 , and a user interface 128 .
- the communication module 120 may comprise suitable logic, circuitry and/or code that may be enabled to receive the generated one or more control signals from the MEMS sensing and processing module 104 via a wired and/or a wireless signal.
- the communication module 120 may support a plurality of interfaces.
- the communication module 120 may support an external memory interface, a universal asynchronous receiver transmitter (UART) interface, an enhanced serial peripheral interface (eSPI), a general purpose input/output (GPIO) interface, a pulse-code modulation (PCM) and/or an inter-IC sound (I 2 S) interface, an inter-integrated circuit (I 2 C) bus interface, a universal serial bus (USB) interface, a Bluetooth interface, a ZigBee interface, an IrDA interface, and/or a wireless USB (W-USB) interface.
- UART universal asynchronous receiver transmitter
- eSPI enhanced serial peripheral interface
- GPIO general purpose input/output
- PCM pulse-code modulation
- I 2 S inter-IC sound
- I 2 C inter-integrated circuit
- USB universal serial bus
- Bluetooth a Bluetooth interface
- ZigBee interface ZigBee interface
- IrDA interface IrDA interface
- W-USB wireless USB
- the processor 122 may comprise suitable logic, circuitry and/or code that may be enabled to utilize the received one or more control signals to control the user interface 128 and/or the display 126 .
- the memory may comprise suitable logic, circuitry and/or code that may be enabled to store data on the device being controlled 106 .
- the firmware 124 may comprise a plurality of drivers and operating system (OS) libraries to convert the received control signals into functional commands.
- the firmware 124 may be enabled to map local functions, and convert received control signals into compatible data, such as user customization features, applets, and/or plugins to control the user interface 128 .
- OS operating system
- FIG. 2 is a block diagram of an exemplary user interface interacting with a MEMS sensing and processing module and a host system, in accordance with an embodiment of the invention.
- a device being controlled 106 may comprise a communication module 202 , a user interface 204 and a host interface 206 , a plurality of drivers and/or libraries 206 , 218 , 220 and 222 and a plurality of applets 208 , 210 , 212 and 214 .
- the user interface 204 may be a graphical user interface (GUI), for example.
- GUI graphical user interface
- the communication module 202 may comprise suitable logic circuitry, and/or code that may be enabled to receive one or more signals from the MEMS sensing and processing module 104 operable to function as a driver, and/or an interface such as a human interface device (HID).
- a driver such as a custom expulsion of air driver or a air detection driver for processing on the device being controlled 106 .
- the received signal may be processed in the device being controlled 106 using the driver.
- the one or more signals may be generated in response to detection of movement of air caused by the expulsion of human breath by user 102 .
- the communication module 202 may be enabled to receive one or more signals from the MEMS sensing and processing module 104 via a wired and/or a wireless signal.
- the communication module 202 may support a plurality of drivers, interfaces and/or HID profiles.
- the communication module 120 may support an external memory interface, a universal asynchronous receiver transmitter (UART) interface, an enhanced serial peripheral interface (eSPI), a general purpose input/output (GPIO) interface, a pulse-code modulation (PCM) and/or an inter-IC sound (I 2 S) interface, an inter-integrated circuit (I 2 C) bus interface, a universal serial bus (USB) interface and/or HID profile, a Bluetooth interface and/or HID profile, a ZigBee interface and/or HID profile, an IrDA interface and/or HID profile, and/or a wireless USB (W-USB) interface and/or a HID profile.
- UART universal asynchronous receiver transmitter
- eSPI enhanced serial peripheral interface
- the user 102 may be enabled to interface with the GUI 204 of the device being controlled 106 via the one or more received signals.
- the received one or more signals may be compliant with one or more drivers, a universal serial bus (USB) HID class and/or a wireless protocol HID class, such as wireless USB HID class and/or a ZigBee HID class, for example.
- USB universal serial bus
- the invention may not be so limited and one or more drivers and/or other wireless protocol HID classes may be utilized without limiting the scope of the invention.
- Bluetooth utilizes the USB HID class.
- the received signal may be passed to a driver such as a custom expulsion of air driver or a air detection driver for processing on the device being controlled 106 .
- the received signal may be processed in the device being controlled 106 using the driver.
- the communication module 202 may be enabled to format the received one or more signals into a HID profile.
- the HID profile may comprise one or more drivers and/or libraries 216 - 222 that may enable interfacing with the GUI 204 of the device being controlled 106 .
- the one or more drivers and/or libraries 216 - 222 may enable one or more of initiation, establishment and/or termination of communication by the device being controlled 106 with the MEMS sensing and processing module 104 .
- the HID profile may define protocols, procedures, and/or usage scenarios for using the HID, such as the MEMS sensing and processing module 104 over a wired and/or wireless link, such as Bluetooth.
- the device being controlled 106 may host a wireless protocol stack, such as the Bluetooth stack which may use the Service Discovery Protocol (SDP) to discover HIDs, such as the MEMS sensing and processing module 104 .
- SDP Service Discovery Protocol
- the device being controlled 106 may be enabled to receive from the HID, such as the MEMS sensing and processing module 104 before it is activated, device information, such as descriptors to the class drivers and/or libraries 216 - 222 .
- the drivers and/or libraries 216 - 222 may be enabled to utilize the descriptors to determine device characteristics in order to enable controls on the device being controlled 106 .
- the library, variable # 1 216 may be enabled to detect the direction of expulsion of human breath onto the HID, such as the MEMS sensing and processing module 104 and accordingly convert the received signal into a directional signal that controls one or more components of the user interface 204 .
- the library, momentum # 1 218 may be enabled to detect a puff of air exhaled by the user 102 , and accordingly utilize the corresponding received signal from the MEMS sensing and processing module 104 to scroll through one or more menus of the user interface 204 and slow down after a particular period of time.
- the library, Boolean # 1 220 may be enabled to utilize the received signal from the MEMS sensing and processing module 104 to select one or more menus and/or icons within the user interface 204 .
- the library, Boolean # 2 222 may also be enabled to utilize the received signal from the MEMS sensing and processing module 104 to select one or more menus and/or icons within the user interface 204 . Notwithstanding, the invention may not be so limited and other driver and/or libraries may be utilized without limiting the scope of the invention.
- the device being controlled 106 may be enabled to interface with the detection device, such as the MEMS sensing and processing module 104 utilizing one or more applets 208 - 214 .
- the applets 208 - 214 may comprise software components, code and/or programs that may be enabled to run in context of another program, such as a web browser, for example.
- the applet, UI skin # 1 208 may comprise a software component, code and/or program that may function as a pinwheel, where a plurality of icons may cycle through the background of the user interface 204 .
- the user 102 may be prompted to select one or more icons from the background of the user interface 204 of the device being controlled 106 .
- the applet, UI skin # 2 210 may comprise a software component, code and/or program that may enable dissolving one or more icons on the user interface 204 into dust, for example, when a user 102 blows air at the icons being displayed on the GUI 204 .
- one of the applets may comprise a software component, code and/or program that may function as a 3-D flipbook, where a user 102 may be enabled to blow air at a book on the GUI 204 to turn one or more pages within the book.
- the applet, Faves # 1 212 may comprise a software component, code and/or program that may enable morphing two or more pictures of users or friends on the GUI 204 into a single picture, when a user 102 blows air onto the two or more pictures of users or friends on the GUI 204 .
- the applet, Scroll Function 214 may comprise a software component, code and/or program that may enable scrolling through a plurality of menus, pages and/or icons on the GUI 204 .
- the GUI 204 of the device being controlled 106 may be enabled to interface with the MEMS sensing and processing module 104 based on one or more outputs generated by the applets 208 - 214 .
- the host computer interface (HCI) 206 may comprise an interface to a display, other hardware and/or processors within the device being controlled 106 for controller management, link establishment, and/or maintenance, for example.
- a HCI transport layer may be enabled to deliver HCI commands to the other hardware within the device being controlled 106 .
- the human or user 102 interfacing with the GUI 204 may be agnostic to any particular operating system (OS) platform on the device being controlled 106 .
- OS operating system
- the device being controlled 106 may be running on any one or more of a Windows OS, Symbian OS, Android OS, Palm OS, or other operating systems on mobile phones such as the iPhone or a Blackberry phone.
- the invention may not be so limited and other operating systems may be utilized without limiting the scope of the invention.
- FIG. 3 is a flowchart illustrating exemplary steps for processing signals that control a device using human breath.
- exemplary steps may begin at step 302 .
- one or more signals may be received from a detection device, operable to function as a human interface device (HID) such as the MEMS sensing and processing module 104 .
- the detection device may comprise a micro-electro-mechanical system (MEMS) detector.
- MEMS micro-electro-mechanical system
- the one or more signals may be generated in response to detection of movement of air caused by the expulsion of human breath.
- the device being controlled 106 may be enabled to format the received one or more signals into a HID profile.
- the HID profile may comprise one or more drivers and/or libraries 216 - 222 that may enable interfacing with the GUI 204 of the device being controlled 106 .
- the one or more drivers and/or libraries 216 - 222 may enable one or more of initiation, establishment and/or termination of communication by the device being controlled 106 with the MEMS sensing and processing module 104 .
- one or more applets 208 - 214 within the device being controlled 106 may be enabled to interface with the detection device, such as the MEMS sensing and processing module 104 .
- step 312 the user 102 may be enabled to interface with a graphical user interface (GUI) 128 of the device being controlled 106 via the one or more received signals utilizing one or more applets 208 - 214 . Control then passes to end step 314 .
- GUI graphical user interface
- FIG. 4 is a flowchart illustrating exemplary steps for processing signals that control a device using human breath.
- a device such as the device being controlled 106 ( FIG. 1E ) may receive a signal from the MEMS sensing and processing module 104 in response to detecting or sensing expulsion of air.
- it may be determined whether the received signal is compliant with a supported HID profile. In instances where the received signal is compliant with a supported HID profile, that is within a supported HID class, then in step 406 , the received signal may be communicated to the HID interface for processing.
- the user interface 128 of the device being controlled 106 may be controlled in accordance with the detected response to expulsion of air.
- step 408 the received signal is passed to a custom expulsion of air driver or a breath detection driver for processing on the device being controlled 106 .
- step 410 the received signal is processed in the device being controlled 106 using the custom driver.
- step 412 the user interface 128 of the device being controlled 106 may be controlled in accordance with the detected response to expulsion of air.
- a method and system for processing signals that control a device using human breath may comprise a device being controlled 106 that receives one or more signals from a detection device, operable to function as a human interface device (HID) such as the MEMS sensing and processing module 104 .
- the one or more signals may be generated in response to detection of movement of a fluid such as air, which may be caused by, for example, the expulsion of human breath.
- the user 102 may be enabled to interface with a user interface such as the graphical user interface (GUI) 128 of the device being controlled 106 via the one or more received signals.
- GUI graphical user interface
- the device being controlled 106 may be one or more of a multimedia device 106 a , a cell phone/smart phone 106 b , a PC, laptop or a notebook computer 106 c , a display device 106 d , a TV/game console/other platforms 106 e , telemetric device, a mobile multimedia player and/or a remote controller.
- the detection device may comprise a micro-electro-mechanical system (MEMS) detector.
- MEMS micro-electro-mechanical system
- the device being controlled 106 may be enabled to format the received one or more signals into a HID profile and/or a device driver formats.
- the HID profile may comprise one or more drivers and/or libraries 216 - 222 that may enable interfacing with the GUI 204 of the device being controlled 106 .
- the one or more drivers and/or libraries 216 - 222 may enable one or more of initiation, establishment and/or termination of communication by the device being controlled 106 with the MEMS sensing and processing module 104 .
- the interfacing of the MEMS sensing and processing module 104 with the device being controlled 106 may be agnostic to any particular operating system (OS) platform on the device being controlled 106 .
- the received one or more signals may comprise digital signals.
- the received one or more signals may be compliant with a universal serial bus (USB) HID class and/or a wireless protocol HID class, such as wireless USB, ZigBee protocols.
- the device being controlled 106 may be enabled to interface with the detection device, such as the MEMS sensing and processing module 104 utilizing one or more applets 208 - 214 .
- the MEMS sensing and processing module 104 may be enabled to interface with the GUI 128 of the device being controlled 106 based on one or more outputs generated by the applets 208 - 214 .
- a method for interaction may comprise interfacing with a device being controlled 106 via expulsion of air utilizing a human interface device (HID) profile.
- the source of the expulsion of air may be human breath.
- the MEMS may be enabled to detect the expulsion of any type of fluid such as air, and the source of the fluid may be an animal, a machine and/or a device.
- Certain embodiments of the invention may comprise a machine-readable storage having stored thereon, a computer program having at least one code section for processing signals that control a device using human breath, the at least one code section being executable by a machine for causing the machine to perform one or more of the steps described herein.
- aspects of the invention may be realized in hardware, software, firmware or a combination thereof.
- the invention may be realized in a centralized fashion in at least one computer system or in a distributed fashion where different elements are spread across several interconnected computer systems. Any kind of computer system or other apparatus adapted for carrying out the methods described herein is suited.
- a typical combination of hardware, software and firmware may be a general-purpose computer system with a computer program that, when being loaded and executed, controls the computer system such that it carries out the methods described herein.
- One embodiment of the invention may be implemented as a board level product, as a single chip, application specific integrated circuit (ASIC), or with varying levels integrated on a single chip with other portions of the system as separate components.
- the degree of integration of the system will primarily be determined by speed and cost considerations. Because of the sophisticated nature of modern processors, it is possible to utilize a commercially available processor, which may be implemented external to an ASIC implementation of the present system. Alternatively, if the processor is available as an ASIC core or logic block, then the commercially available processor may be implemented as part of an ASIC device with various functions implemented as firmware.
- the present invention may also be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein, and which when loaded in a computer system is able to carry out these methods.
- Computer program in the present context may mean, for example, any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after either or both of the following: a) conversion to another language, code or notation; b) reproduction in a different material form.
- other meanings of computer program within the understanding of those skilled in the art are also contemplated by the present invention.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
- This application makes reference to:
- U.S. application Ser. No. ______ (Attorney Docket No. 19449US01), which is filed on even date herewith;
U.S. application Ser. No. ______ (Attorney Docket No. 19450US01), which is filed on even date herewith;
U.S. application Ser. No. ______ (Attorney Docket No. 19451US01), which is filed on even date herewith;
U.S. application Ser. No. ______ (Attorney Docket No. 19453US01), which is filed on even date herewith; and
U.S. application Ser. No. ______ (Attorney Docket No. 19454US01), which is filed on even date herewith. - Each of the above referenced applications is hereby incorporated herein by reference in its entirety.
- Not Applicable
- Not Applicable
- Certain embodiments of the invention relate to controlling a computer or electronic system. More specifically, certain embodiments of the invention relate to a method and system for processing signals that control a device using human breath.
- Mobile communications have changed the way people communicate and mobile phones have been transformed from a luxury item to an essential part of every day life. The use of mobile phones is today dictated by social situations, rather than hampered by location or technology.
- While voice connections fulfill the basic need to communicate, and mobile voice connections continue to filter even further into the fabric of every day life, the mobile access to services via the Internet has become the next step in the mobile communication revolution. Currently, most mobile devices are equipped with a user interface that allows users to access the services provided via the Internet. For example, some mobile devices may have browsers, and software and/or hardware buttons may be provided to enable navigation and/or control of the user interface. Some mobile devices such as Smartphones are equipped with touch screen capability that allows users to navigate or control the user interface via touching with one hand while the device is held in another hand.
- Further limitations and disadvantages of conventional and traditional approaches will become apparent to one of skill in the art, through comparison of such systems with the present invention as set forth in the remainder of the present application with reference to the drawings.
- A system and/or method for processing signals that control a device using human breath, substantially as shown in and/or described in connection with at least one of the figures, as set forth more completely in the claims.
- Various advantages, aspects and novel features of the present invention, as well as details of an illustrated embodiment thereof, will be more fully understood from the following description and drawings.
-
FIG. 1A is a block diagram of an exemplary system for controlling a user interface of a plurality of devices using human breath, in accordance with an embodiment of the invention. -
FIG. 1B is a block diagram of an exemplary sensing module to detect human breath, in accordance with an embodiment of the invention. -
FIG. 1C is a block diagram of another embodiment of an exemplary system for controlling a user interface of a device using human breath, in accordance with an embodiment of the invention. -
FIG. 1D is a block diagram of an exemplary processor interacting with a device being controlled, in accordance with an embodiment of the invention. -
FIG. 1E is a block diagram of an exemplary MEMS sensing and processing module interacting with a device being controlled, in accordance with an embodiment of the invention. -
FIG. 2 is a block diagram of an exemplary user interface interacting with a MEMS sensing and processing module and a host system, in accordance with an embodiment of the invention. -
FIG. 3 is a flowchart illustrating exemplary steps for processing signals that control a device using human breath. -
FIG. 4 is a flowchart illustrating exemplary steps for processing signals that control a device using human breath. - Certain aspects of the invention may be found in a method and system for processing signals that control a device using human breath. Exemplary aspects of the invention may comprise receiving at the device, one or more signals from a detection device operable to function as a human interface device (HID). The signals may be generated in response to detection of movement of air caused by expulsion of human breath. Human interfacing with a user interface such as a graphical user interface (GUI) of the device may be enabled via the received signals. The detection device may comprise a micro-electro-mechanical system (MEMS) detector. The received signals may be formatted into a HID profile. The HID profile may comprise one or more drivers and/or libraries that enables the interfacing with the GUI of the device. The drivers may enable one or more of initiation, establishment and/or termination of communication by the device.
-
FIG. 1A is a block diagram of an exemplary system for controlling a user interface of a plurality of devices using human breath, in accordance with an embodiment of the invention. Referring toFIG. 1A , there is shown auser 102, a micro-electro-mechanical system (MEMS) sensing andprocessing module 104, and a plurality of devices to be controlled, such as amultimedia device 106 a, a cellphone/smartphone/dataphone 106 b, a personal computer (PC), laptop or anotebook computer 106 c, adisplay device 106 d and/or a television (TV)/game console/other platform 106 e. Themultimedia device 106 a may comprise auser interface 107 a, the cellphone/smartphone/dataphone 106 b may comprise auser interface 107 b, and the personal computer (PC), laptop or anotebook computer 106 c may comprise auser interface 107 c. Additionally, thedisplay device 106 d may comprise auser interface 107 d and the television (TV)/game console/other platform 106 e may comprise auser interface 107 e. Each of the plurality of devices to be controlled may be wired or wirelessly connected to a plurality ofother devices 108 for loading of information, and/or communication of information, for example, peer-to-peer and/or network communication. Exemplaryother devices 108 may comprise game consoles, immersive or 3D reality devices, and/or telematic devices. Telematic devices refers to devices comprising integrated computing, wireless communication and/or global navigation satellite system devices, which enables sending, receiving and/or storing of information over networks. - The MEMS sensing and
processing module 104 may be enabled to detect movement caused by expulsion of human breath by theuser 102. In response to the detection of movement caused by expulsion of human breath, the MEMS sensing andprocessing module 104 may be enabled to generate one or more controls signals. The MEMS sensing andprocessing module 104 may comprise one or more sensors, sensing segments and/or sensing members that may be operable to sense the kinetic energy generated by the expulsion of the human breath and accordingly generate the one or more control signals. The generated one or more control signals may be enabled to control a user interface of one or more of a plurality of devices, such as theuser interface 107 a of themultimedia device 106 a, theuser interface 107 b of the cellphone/smartphone/dataphone 106 b, theuser interface 107 c of the PC, laptop or anotebook computer 106 c, theuser interface 107 d of thedisplay device 106 d, theuser interface 107 e of the TV/game console/other platform 106 e, and the user interfaces of the mobile multimedia player and/or a remote controller. One exemplary embodiment of a user interface is a graphical user interface (GUI). Any information and/or data presented on a display including programs and/or applications may be part of the user interface. U.S. application Ser. No. ______ (Attorney Docket No. 19450US01) discloses an exemplary MEMS sensing and processing module and is hereby incorporated herein by reference in its entirety. - In accordance with an embodiment of the invention, the detection of the movement caused by expulsion of human breath may occur without use of a channel. The detection of the movement caused by expulsion of human breath may be responsive to the expulsion of human breath into open space, which is then sensed.
- In accordance with another embodiment of the invention, the MEMS sensing and
processing module 104 may be enabled to navigate within the user interface of one of more of the plurality of devices, such as a handheld device, for example, amultimedia device 106 a, a cellphone/smartphone/dataphone 106 b, a PC, laptop or anotebook computer 106 c, adisplay device 106 d, and/or a TV/game console/other platform 106 e via the generated one or more control signals. The MEMS sensing andprocessing module 104 may be enabled to select one or more components within the user interface of the plurality of devices via the generated one or more control signals. The generated one or more control signals may comprise one or more of a wired and/or a wireless signal. - In accordance with another embodiment of the invention, one or more of the plurality of devices, such as a handheld device, for example, a
multimedia device 106 a and/or a cellphone/smartphone/dataphone 106 b and/or a PC, laptop or anotebook computer 106 c may be enabled to receive one or more inputs defining the user interface from anotherdevice 108. Theother device 108 may be one or more of a PC, laptop or anotebook computer 106 c and/or a handheld device, for example, and without limitation, amultimedia device 106 a and/or a cellphone/smartphone/dataphone 106 b. In this regard, data may be transferred from theother device 108 to the cellphone/smartphone/dataphone 106 b and this data may be associated or mapped to media content that may be remotely accessed by the cellphone/smartphone/dataphone 106 b via a service provider such as a cellular or PCS service provider. The transferred data that is associated or mapped to media content may be utilized to customize theuser interface 107 b of the cellphone/smartphone/dataphone 106 b. In this regard, media content associated with one or more received inputs may become an integral part of the user interface of the device being controlled. The associating and/or mapping may be performed on either theother device 108 and/or one the cellphone/smartphone/dataphone 106 b. In instances where the associating and/or mapping is performed on theother device 108, the associated and/or mapped data may be transferred from theother device 108 to the cellphone/smartphone/dataphone 106 b. - In an exemplary embodiment of the invention, an icon transferred from the
other device 108 to the cellphone/smartphone/dataphone 106 b may be associated or mapped to media content such as an RSS feed, a markup language such as HTML, and XML, that may be remotely accessed by the cellphone/smartphone/dataphone 106 b via the service provider of the cellphone/smartphone 106 b. Accordingly, when theuser 102 blows on the MEMS sensing andprocessing module 104, control signals generated by the MEMS sensing andprocessing module 104 may navigate to the icon and select the icon. Once the icon is selected, the RSS feed or markup language may be accessed via the service provider of the cellphone/smartphone/dataphone 106 b and corresponding RSS feed or markup language content may be displayed on theuser interface 107 b. U.S. application Ser. No. ______ (Attorney Docket No. 19454US01) discloses an exemplary method and system for customizing a user interface of a device and is hereby incorporated herein by reference in its entirety. - In operation, a
user 102 may exhale into open space and the exhaled breath may be sensed by one or more detection devices or detectors, such as one or more sensors, sensing members and/or sensing segments in the MEMS sensing andprocessing module 104. The MEMS sensing andprocessing module 104 may be enabled to detect movement caused by expulsion of human breath by theuser 102. One or more electrical, optical and/or magnetic signals may be generated by one or more detection devices or detectors within the MEMS sensing andprocessing module 104 in response to the detection of movement caused by expulsion of human breath. The processor firmware within the MEMS sensing andprocessing module 104 may be enabled to process the received electrical, optical and/or magnetic signals from the one or more detection device(s) or detector(s) utilizing various algorithms and generate one or more control signals to the device being controlled, for example, themultimedia device 106 a. The generated one or more control signals may be communicated to the device being controlled, for example, themultimedia device 106 a via a wired and/or a wireless signal. The processor in the device being controlled may utilize the communicated control signals to control the user interface of the device being controlled, such as auser interface 107 a of themultimedia device 106 a, auser interface 107 b of the cellphone/smartphone/dataphone 106 b, auser interface 107 c of the personal computer (PC), laptop or anotebook computer 106 c, auser interface 107 d of thedisplay device 106 d, auser interface 107 e of the TV/game console/other platform 106 e, and a user interface of a mobile multimedia player and/or a remote controller. -
FIG. 1B is a block diagram of an exemplary detection device or detector to detect human breath, in accordance with an embodiment of the invention. Referring toFIG. 1B , there is shown auser 102 and asensing module 110. Thesensing module 110 may comprise asensor control chip 109 and a plurality of sensors, sensing members and/or sensing segments, for example, 111 a, 111 b, 111 c, and 111 d. Notwithstanding, the invention may not be so limited and thesensing module 110 may comprise more or less than the number of sensors, sensing members and/or sensing segments shown inFIG. 1B without limiting the scope of the invention. Accordingly, any number of detectors and sources may be utilized according to the desired size, sensitivity, and resolution desired. Similarly, the type of sources and detectors may comprise other sensing mechanisms, other than visible light. For example, piezoelectric, ultrasonic, Hall effect, electrostatic, and/or permanent or electro-magnet sensors may be activated by deflected MEMS members to generate a signal to be communicated to thesensor control chip 109. - The
sensing module 110 may be an electrochemical sensor or any other type of breath analyzing sensor, for example. The plurality of sensors, sensing members and/or sensing segments 111 a-d may be an integral part of one or more MEMS devices that may enable the detection of various velocities of air flow from the user's 102 breath. The plurality of sensors, sensing members and/or sensing segments 111 a-d may be enabled to detect kinetic energy and/or movement caused by the expulsion of human breath by theuser 102. Thesensor control chip 109 may be enabled to generate an electrical, optical and/or magnetic signal that may be communicated to the processor in response to the detection of kinetic energy and/or movement caused by expulsion of human breath. -
FIG. 1C is a block diagram of another embodiment of an exemplary system for controlling a user interface of a device using human breath, in accordance with an embodiment of the invention. Referring toFIG. 1C , there is shown auser 102, a MEMS sensing andprocessing module 104, and a device being controlled 106, such as amultimedia device 106 a, a cellphone/smartphone/dataphone 106 b, a PC, laptop or anotebook computer 106 c, adisplay device 106 d and/or a TV/game console/other platform 106 e. The device being controlled 106 may be wired and/or wirelessly connected to a plurality ofother devices 108 for loading of information via, for example, side loading or other communication comprising, peer-to-peer communication, network communication, via wired and/or wireless connection. - The MEMS sensing and
processing module 104 may comprise asensing module 110, aprocessing module 112 andpassive devices 113. Thepassive devices 113, which may comprise resistors, capacitors and/or inductors, may be embedded within a substrate material of the MEMS processing sensing andprocessing module 104. Theprocessing module 112 may comprise, for example, an ASIC. Thesensing module 110 may generally be referred to as a detection device or detector, and may comprise one or more sensors, sensing members and/or sensing segments that may be enabled to detect kinetic energy and/or movement caused by the expulsion of human breath by theuser 102. Thesensing module 110 may be enabled to generate an electrical, optical and/or magnetic signal that may be communicated to theprocessing module 112 in response to the detection of kinetic energy and/or movement caused by expulsion of human breath. - The
processing module 112 may comprise suitable logic, circuitry and/or code that may be enabled to receive the generated electric signal from thesensing module 110 and generate one or more control signals to the device being controlled 106. In this regard, theprocessing module 112 may comprise one or more analog to digital converters that may be enabled to translate the sensed signal to one or more digital signals, which may be utilized to generate the one or more control signals. The generated one or more control signals may be enabled to control a user interface of the device being controlled 106. - The device being controlled 106 may comprise a
user interface 107. Accordingly, the generated one or more signals from the MEMS sensing andprocessing module 104 may be communicated to the device being controlled 106 and utilized to control theuser interface 107. In an exemplary embodiment of the invention, the one or more signals generated by the MEMS sensing andprocessing module 104 may be operable to control a pointer on the device being controlled 106 such that items in theuser interface 107 may be selected and/or manipulated. In an exemplary embodiment of the invention, the device being controlled may be enabled to receive one or more inputs from theother devices 108, which may be utilized to customize or define theuser interface 107. Theother device 108 may be one or more of a PC, laptop or anotebook computer 106 c and/or a handheld device, for example, amultimedia device 106 a and/or a cellphone/smartphone/dataphone 106 b. In this regard, theother device 108 may be similar to or different from the type of device that is being controlled 106. In some embodiments of the invention, a processor in theother device 108 may be operable to associate or map the data to media content that is remotely accessible by the device being controlled 106. In other embodiments of the invention, a processor in the device being controlled 106 may be operable to associate or map the data to media content that is remotely accessible by the device being controlled 106. U.S. application Ser. No. ______ (Attorney Docket No. 19454US01) discloses an exemplary method and system for customizing a user interface of a device and is hereby incorporated herein by reference in its entirety. -
FIG. 1D is a block diagram of an exemplary processor interacting with a device being controlled, in accordance with an embodiment of the invention. Referring toFIG. 1D , there is shown aprocessing module 112, and a device being controlled 106 such as amultimedia device 106 a, a cellphone/smartphone/dataphone 106 b, a PC, laptop or anotebook computer 106 c, adisplay device 106 d and/or a TV/game console/other platform 106 e. Theprocessing module 112 may be an ASIC and may comprise one or more analog to digital converters (ADCs) 114,processor firmware 116, and acommunication module 118. - The
processing module 112 may comprise suitable logic, circuitry and/or code that may be enabled to receive a digital sensing signal and/or an analog sensing signal from thesensing module 110. TheADC 114 may comprise suitable logic, circuitry and/or code that may be enabled to receive the generated analog sensing signal from thesensing module 110 and convert the received signal into a digital signal. - The
processor firmware 116 may comprise suitable logic, and/or code that may be enabled to receive and process the digital signal from theADC 114 and/or the digital sensing signal from thesensing module 110 utilizing a plurality of algorithms to generate one or more control signals. For example, theprocessor firmware 116 may be enabled to read, store, calibrate, filter, modelize, calculate and/or compare the outputs of thesensing module 110. Theprocessor firmware 116 may also be enabled to incorporate artificial intelligence (AI) algorithms to adapt to a particular user's 102 breathing pattern. Theprocessor firmware 116 may be enabled to generate one or more control signals to the device being controlled 106 based on processing the received digital signals. The generated one or more control signals may be enabled to control a user interface of the device being controlled 106, for example, scrolling, zooming, and/or 3-D navigation within the device being controlled 106. - The
communication module 118 may comprise suitable logic, circuitry and/or code that may be enabled to receive and communicate the generated one or more control signals to the device being controlled 106 via a wired and/or a wireless signal. Thecommunication module 118 may support a plurality of interfaces. For example, thecommunication modules -
FIG. 1E is a block diagram of an exemplary MEMS sensing and processing module interacting with a device being controlled, in accordance with an embodiment of the invention. Referring toFIG. 1E , there is shown a MEMS sensing andprocessing module 104 and a device being controlled 106 such as amultimedia device 106 a, a cell phone/smart phone 106 b, a PC, laptop or anotebook computer 106 c, adisplay device 106 d and/or a TV/game console/other platform 106 e. The device being controlled 106 may comprise acommunication module 120, aprocessor 122,memory 123,firmware 124, a display 126, and auser interface 128. - The
communication module 120 may comprise suitable logic, circuitry and/or code that may be enabled to receive the generated one or more control signals from the MEMS sensing andprocessing module 104 via a wired and/or a wireless signal. Thecommunication module 120 may support a plurality of interfaces. For example, thecommunication module 120 may support an external memory interface, a universal asynchronous receiver transmitter (UART) interface, an enhanced serial peripheral interface (eSPI), a general purpose input/output (GPIO) interface, a pulse-code modulation (PCM) and/or an inter-IC sound (I2S) interface, an inter-integrated circuit (I2C) bus interface, a universal serial bus (USB) interface, a Bluetooth interface, a ZigBee interface, an IrDA interface, and/or a wireless USB (W-USB) interface. - The
processor 122 may comprise suitable logic, circuitry and/or code that may be enabled to utilize the received one or more control signals to control theuser interface 128 and/or the display 126. The memory may comprise suitable logic, circuitry and/or code that may be enabled to store data on the device being controlled 106. Thefirmware 124 may comprise a plurality of drivers and operating system (OS) libraries to convert the received control signals into functional commands. Thefirmware 124 may be enabled to map local functions, and convert received control signals into compatible data, such as user customization features, applets, and/or plugins to control theuser interface 128. -
FIG. 2 is a block diagram of an exemplary user interface interacting with a MEMS sensing and processing module and a host system, in accordance with an embodiment of the invention. Referring toFIG. 2 , there is shown a device being controlled 106. The device being controlled 106 may comprise acommunication module 202, auser interface 204 and ahost interface 206, a plurality of drivers and/orlibraries applets user interface 204 may be a graphical user interface (GUI), for example. - The
communication module 202 may comprise suitable logic circuitry, and/or code that may be enabled to receive one or more signals from the MEMS sensing andprocessing module 104 operable to function as a driver, and/or an interface such as a human interface device (HID). For example, if the received signal is not compliant with a supported HID profile, that is, the signal is not a supported HID class, then the received signal may be passed to a driver such as a custom expulsion of air driver or a air detection driver for processing on the device being controlled 106. The received signal may be processed in the device being controlled 106 using the driver. The one or more signals may be generated in response to detection of movement of air caused by the expulsion of human breath byuser 102. Thecommunication module 202 may be enabled to receive one or more signals from the MEMS sensing andprocessing module 104 via a wired and/or a wireless signal. Thecommunication module 202 may support a plurality of drivers, interfaces and/or HID profiles. For example, thecommunication module 120 may support an external memory interface, a universal asynchronous receiver transmitter (UART) interface, an enhanced serial peripheral interface (eSPI), a general purpose input/output (GPIO) interface, a pulse-code modulation (PCM) and/or an inter-IC sound (I2S) interface, an inter-integrated circuit (I2C) bus interface, a universal serial bus (USB) interface and/or HID profile, a Bluetooth interface and/or HID profile, a ZigBee interface and/or HID profile, an IrDA interface and/or HID profile, and/or a wireless USB (W-USB) interface and/or a HID profile. - The
user 102 may be enabled to interface with theGUI 204 of the device being controlled 106 via the one or more received signals. The received one or more signals may be compliant with one or more drivers, a universal serial bus (USB) HID class and/or a wireless protocol HID class, such as wireless USB HID class and/or a ZigBee HID class, for example. Notwithstanding, the invention may not be so limited and one or more drivers and/or other wireless protocol HID classes may be utilized without limiting the scope of the invention. Currently, Bluetooth utilizes the USB HID class. Furthermore, if the received signal is not compliant with a supported HID profile, that is, the signal is not a supported HID class, then the received signal may be passed to a driver such as a custom expulsion of air driver or a air detection driver for processing on the device being controlled 106. The received signal may be processed in the device being controlled 106 using the driver. - The
communication module 202 may be enabled to format the received one or more signals into a HID profile. The HID profile may comprise one or more drivers and/or libraries 216-222 that may enable interfacing with theGUI 204 of the device being controlled 106. The one or more drivers and/or libraries 216-222 may enable one or more of initiation, establishment and/or termination of communication by the device being controlled 106 with the MEMS sensing andprocessing module 104. The HID profile may define protocols, procedures, and/or usage scenarios for using the HID, such as the MEMS sensing andprocessing module 104 over a wired and/or wireless link, such as Bluetooth. The device being controlled 106 may host a wireless protocol stack, such as the Bluetooth stack which may use the Service Discovery Protocol (SDP) to discover HIDs, such as the MEMS sensing andprocessing module 104. - In accordance with an embodiment of the invention, the device being controlled 106 may be enabled to receive from the HID, such as the MEMS sensing and
processing module 104 before it is activated, device information, such as descriptors to the class drivers and/or libraries 216-222. The drivers and/or libraries 216-222 may be enabled to utilize the descriptors to determine device characteristics in order to enable controls on the device being controlled 106. - For example, the library,
variable # 1 216 may be enabled to detect the direction of expulsion of human breath onto the HID, such as the MEMS sensing andprocessing module 104 and accordingly convert the received signal into a directional signal that controls one or more components of theuser interface 204. The library,momentum # 1 218 may be enabled to detect a puff of air exhaled by theuser 102, and accordingly utilize the corresponding received signal from the MEMS sensing andprocessing module 104 to scroll through one or more menus of theuser interface 204 and slow down after a particular period of time. The library,Boolean # 1 220 may be enabled to utilize the received signal from the MEMS sensing andprocessing module 104 to select one or more menus and/or icons within theuser interface 204. The library,Boolean # 2 222 may also be enabled to utilize the received signal from the MEMS sensing andprocessing module 104 to select one or more menus and/or icons within theuser interface 204. Notwithstanding, the invention may not be so limited and other driver and/or libraries may be utilized without limiting the scope of the invention. - The device being controlled 106 may be enabled to interface with the detection device, such as the MEMS sensing and
processing module 104 utilizing one or more applets 208-214. The applets 208-214 may comprise software components, code and/or programs that may be enabled to run in context of another program, such as a web browser, for example. For example, the applet,UI skin # 1 208 may comprise a software component, code and/or program that may function as a pinwheel, where a plurality of icons may cycle through the background of theuser interface 204. Theuser 102 may be prompted to select one or more icons from the background of theuser interface 204 of the device being controlled 106. The applet,UI skin # 2 210 may comprise a software component, code and/or program that may enable dissolving one or more icons on theuser interface 204 into dust, for example, when auser 102 blows air at the icons being displayed on theGUI 204. In another embodiment, one of the applets may comprise a software component, code and/or program that may function as a 3-D flipbook, where auser 102 may be enabled to blow air at a book on theGUI 204 to turn one or more pages within the book. The applet,Faves # 1 212 may comprise a software component, code and/or program that may enable morphing two or more pictures of users or friends on theGUI 204 into a single picture, when auser 102 blows air onto the two or more pictures of users or friends on theGUI 204. The applet,Scroll Function 214 may comprise a software component, code and/or program that may enable scrolling through a plurality of menus, pages and/or icons on theGUI 204. TheGUI 204 of the device being controlled 106 may be enabled to interface with the MEMS sensing andprocessing module 104 based on one or more outputs generated by the applets 208-214. - The host computer interface (HCI) 206 may comprise an interface to a display, other hardware and/or processors within the device being controlled 106 for controller management, link establishment, and/or maintenance, for example. A HCI transport layer may be enabled to deliver HCI commands to the other hardware within the device being controlled 106.
- In accordance with an embodiment of the invention, the human or
user 102 interfacing with theGUI 204 may be agnostic to any particular operating system (OS) platform on the device being controlled 106. For example, the device being controlled 106 may be running on any one or more of a Windows OS, Symbian OS, Android OS, Palm OS, or other operating systems on mobile phones such as the iPhone or a Blackberry phone. Notwithstanding, the invention may not be so limited and other operating systems may be utilized without limiting the scope of the invention. -
FIG. 3 is a flowchart illustrating exemplary steps for processing signals that control a device using human breath. Referring toFIG. 3 , exemplary steps may begin atstep 302. Instep 304, one or more signals may be received from a detection device, operable to function as a human interface device (HID) such as the MEMS sensing andprocessing module 104. The detection device may comprise a micro-electro-mechanical system (MEMS) detector. The one or more signals may be generated in response to detection of movement of air caused by the expulsion of human breath. Instep 306, the device being controlled 106 may be enabled to format the received one or more signals into a HID profile. The HID profile may comprise one or more drivers and/or libraries 216-222 that may enable interfacing with theGUI 204 of the device being controlled 106. Instep 308, the one or more drivers and/or libraries 216-222 may enable one or more of initiation, establishment and/or termination of communication by the device being controlled 106 with the MEMS sensing andprocessing module 104. Instep 310, one or more applets 208-214 within the device being controlled 106 may be enabled to interface with the detection device, such as the MEMS sensing andprocessing module 104. Instep 312, theuser 102 may be enabled to interface with a graphical user interface (GUI) 128 of the device being controlled 106 via the one or more received signals utilizing one or more applets 208-214. Control then passes to endstep 314. -
FIG. 4 is a flowchart illustrating exemplary steps for processing signals that control a device using human breath. Referring toFIG. 4 , instep 402, a device such as the device being controlled 106 (FIG. 1E ) may receive a signal from the MEMS sensing andprocessing module 104 in response to detecting or sensing expulsion of air. Instep 404, it may be determined whether the received signal is compliant with a supported HID profile. In instances where the received signal is compliant with a supported HID profile, that is within a supported HID class, then instep 406, the received signal may be communicated to the HID interface for processing. Instep 412, theuser interface 128 of the device being controlled 106 may be controlled in accordance with the detected response to expulsion of air. - Returning to step 404, if it is determined that the received signal is not compliant with a supported HID profile, that is, the signal is not is a supported HID class, then control passes to step 408. In
step 408, the received signal is passed to a custom expulsion of air driver or a breath detection driver for processing on the device being controlled 106. Instep 410, the received signal is processed in the device being controlled 106 using the custom driver. Instep 412, theuser interface 128 of the device being controlled 106 may be controlled in accordance with the detected response to expulsion of air. - In accordance with an embodiment of the invention, a method and system for processing signals that control a device using human breath may comprise a device being controlled 106 that receives one or more signals from a detection device, operable to function as a human interface device (HID) such as the MEMS sensing and
processing module 104. The one or more signals may be generated in response to detection of movement of a fluid such as air, which may be caused by, for example, the expulsion of human breath. Theuser 102 may be enabled to interface with a user interface such as the graphical user interface (GUI) 128 of the device being controlled 106 via the one or more received signals. The device being controlled 106 may be one or more of amultimedia device 106 a, a cell phone/smart phone 106 b, a PC, laptop or anotebook computer 106 c, adisplay device 106 d, a TV/game console/other platforms 106 e, telemetric device, a mobile multimedia player and/or a remote controller. The detection device may comprise a micro-electro-mechanical system (MEMS) detector. - The device being controlled 106 may be enabled to format the received one or more signals into a HID profile and/or a device driver formats. The HID profile may comprise one or more drivers and/or libraries 216-222 that may enable interfacing with the
GUI 204 of the device being controlled 106. The one or more drivers and/or libraries 216-222 may enable one or more of initiation, establishment and/or termination of communication by the device being controlled 106 with the MEMS sensing andprocessing module 104. - In accordance with an embodiment of the invention, the interfacing of the MEMS sensing and
processing module 104 with the device being controlled 106 may be agnostic to any particular operating system (OS) platform on the device being controlled 106. The received one or more signals may comprise digital signals. The received one or more signals may be compliant with a universal serial bus (USB) HID class and/or a wireless protocol HID class, such as wireless USB, ZigBee protocols. The device being controlled 106 may be enabled to interface with the detection device, such as the MEMS sensing andprocessing module 104 utilizing one or more applets 208-214. The MEMS sensing andprocessing module 104 may be enabled to interface with theGUI 128 of the device being controlled 106 based on one or more outputs generated by the applets 208-214. - In accordance with an embodiment of the invention, a method for interaction may comprise interfacing with a device being controlled 106 via expulsion of air utilizing a human interface device (HID) profile. The source of the expulsion of air may be human breath.
- The invention is not limited to the expulsion of breath. Accordingly, in various exemplary embodiments of the invention, the MEMS may be enabled to detect the expulsion of any type of fluid such as air, and the source of the fluid may be an animal, a machine and/or a device.
- Certain embodiments of the invention may comprise a machine-readable storage having stored thereon, a computer program having at least one code section for processing signals that control a device using human breath, the at least one code section being executable by a machine for causing the machine to perform one or more of the steps described herein.
- Accordingly, aspects of the invention may be realized in hardware, software, firmware or a combination thereof. The invention may be realized in a centralized fashion in at least one computer system or in a distributed fashion where different elements are spread across several interconnected computer systems. Any kind of computer system or other apparatus adapted for carrying out the methods described herein is suited. A typical combination of hardware, software and firmware may be a general-purpose computer system with a computer program that, when being loaded and executed, controls the computer system such that it carries out the methods described herein.
- One embodiment of the invention may be implemented as a board level product, as a single chip, application specific integrated circuit (ASIC), or with varying levels integrated on a single chip with other portions of the system as separate components. The degree of integration of the system will primarily be determined by speed and cost considerations. Because of the sophisticated nature of modern processors, it is possible to utilize a commercially available processor, which may be implemented external to an ASIC implementation of the present system. Alternatively, if the processor is available as an ASIC core or logic block, then the commercially available processor may be implemented as part of an ASIC device with various functions implemented as firmware.
- The present invention may also be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein, and which when loaded in a computer system is able to carry out these methods. Computer program in the present context may mean, for example, any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after either or both of the following: a) conversion to another language, code or notation; b) reproduction in a different material form. However, other meanings of computer program within the understanding of those skilled in the art are also contemplated by the present invention.
- While the invention has been described with reference to certain embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted without departing from the scope of the present invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the present invention without departing from its scope. Therefore, it is intended that the present invention not be limited to the particular embodiments disclosed, but that the present invention will include all embodiments falling within the scope of the appended claims.
Claims (2)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/285,647 US20190294236A1 (en) | 2000-02-14 | 2019-02-26 | Method and System for Processing Signals that Control a Device Using Human Breath |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/913,398 US6574571B1 (en) | 1999-02-12 | 2000-02-14 | Method and device for monitoring an electronic or computer system by means of a fluid flow |
PCT/FR2000/000362 WO2000048066A1 (en) | 1999-02-12 | 2000-02-14 | Method and device for monitoring an electronic or computer system by means of a fluid flow |
US10/453,192 US7584064B2 (en) | 1999-02-12 | 2003-06-02 | Method and device to control a computer system utilizing a fluid flow |
US12/056,171 US10216259B2 (en) | 2000-02-14 | 2008-03-26 | Method and system for processing signals that control a device using human breath |
US16/285,647 US20190294236A1 (en) | 2000-02-14 | 2019-02-26 | Method and System for Processing Signals that Control a Device Using Human Breath |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/056,171 Continuation US10216259B2 (en) | 1999-02-12 | 2008-03-26 | Method and system for processing signals that control a device using human breath |
Publications (1)
Publication Number | Publication Date |
---|---|
US20190294236A1 true US20190294236A1 (en) | 2019-09-26 |
Family
ID=41119023
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/056,171 Expired - Fee Related US10216259B2 (en) | 1999-02-12 | 2008-03-26 | Method and system for processing signals that control a device using human breath |
US16/285,647 Abandoned US20190294236A1 (en) | 2000-02-14 | 2019-02-26 | Method and System for Processing Signals that Control a Device Using Human Breath |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/056,171 Expired - Fee Related US10216259B2 (en) | 1999-02-12 | 2008-03-26 | Method and system for processing signals that control a device using human breath |
Country Status (1)
Country | Link |
---|---|
US (2) | US10216259B2 (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9904353B2 (en) * | 2008-03-26 | 2018-02-27 | Pierre Bonnat | Mobile handset accessory supporting touchless and occlusion-free user interaction |
KR20110114042A (en) * | 2010-04-12 | 2011-10-19 | (주) 지.티 텔레콤 | Bluetooth unit of mounting type |
CN102022281A (en) * | 2010-12-22 | 2011-04-20 | 鸿富锦精密工业(深圳)有限公司 | Electronic device with wind power control function |
EP2676178B1 (en) * | 2011-01-26 | 2020-04-22 | Novodigit Sarl | Breath-sensitive digital interface |
US8521942B2 (en) | 2011-03-21 | 2013-08-27 | Microsoft Corporation | HID over simple peripheral buses |
US8725916B2 (en) | 2012-01-07 | 2014-05-13 | Microsoft Corporation | Host side implementation for HID I2C data bus |
US9939907B2 (en) * | 2015-06-15 | 2018-04-10 | Motorola Mobility Llc | Gesture detection using MEMS wind turbines |
US11099635B2 (en) * | 2019-09-27 | 2021-08-24 | Apple Inc. | Blow event detection and mode switching with an electronic device |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4383254A (en) * | 1979-09-14 | 1983-05-10 | David Gemmell | Control apparatus for a display matrix |
US6147692A (en) * | 1997-06-25 | 2000-11-14 | Haptek, Inc. | Method and apparatus for controlling transformation of two and three-dimensional images |
US6282183B1 (en) * | 1997-06-02 | 2001-08-28 | Motorola, Inc. | Method for authorizing couplings between devices in a capability addressable network |
US6421617B2 (en) * | 1998-07-18 | 2002-07-16 | Interval Research Corporation | Interface including fluid flow measurement for use in determining an intention of, or an effect produced by, an animate object |
US6574571B1 (en) * | 1999-02-12 | 2003-06-03 | Financial Holding Corporation, Inc. | Method and device for monitoring an electronic or computer system by means of a fluid flow |
US7038665B1 (en) * | 1999-12-10 | 2006-05-02 | Nmb, U.S.A. Inc. | Integrated USB input device |
US20090114079A1 (en) * | 2007-11-02 | 2009-05-07 | Mark Patrick Egan | Virtual Reality Composer Platform System |
US7739061B2 (en) * | 1999-02-12 | 2010-06-15 | Pierre Bonnat | Method and system for controlling a user interface of a device using human breath |
Family Cites Families (42)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3709213A (en) * | 1970-09-16 | 1973-01-09 | Fischer & Porter Co | Fluid-powered flowmeter for measuring low flow rates |
US4207959A (en) | 1978-06-02 | 1980-06-17 | New York University | Wheelchair mounted control apparatus |
US4433685A (en) | 1980-09-10 | 1984-02-28 | Figgie International Inc. | Pressure demand regulator with automatic shut-off |
US4521772A (en) | 1981-08-28 | 1985-06-04 | Xerox Corporation | Cursor control device |
US4746913A (en) | 1984-04-23 | 1988-05-24 | Volta Arthur C | Data entry method and apparatus for the disabled |
US4561309A (en) | 1984-07-09 | 1985-12-31 | Rosner Stanley S | Method and apparatus for determining pressure differentials |
US4713540A (en) | 1985-07-16 | 1987-12-15 | The Foxboro Company | Method and apparatus for sensing a measurand |
GB8814291D0 (en) * | 1988-06-16 | 1988-07-20 | Lamtec Medical Equipment Ltd | Monitoring & alarm apparatus |
US4929826A (en) | 1988-09-26 | 1990-05-29 | Joseph Truchsess | Mouth-operated control device |
US6040821A (en) | 1989-09-26 | 2000-03-21 | Incontrol Solutions, Inc. | Cursor tracking |
US5341133A (en) | 1991-05-09 | 1994-08-23 | The Rowland Institute For Science, Inc. | Keyboard having touch sensor keys for conveying information electronically |
JPH0627963A (en) | 1992-01-14 | 1994-02-04 | Fuerunandesu:Kk | Electronic stringed instrument |
US5422640A (en) | 1992-03-02 | 1995-06-06 | North Carolina State University | Breath actuated pointer to enable disabled persons to operate computers |
US5442640A (en) * | 1993-01-19 | 1995-08-15 | International Business Machines Corporation | Test and diagnosis of associated output logic for products having embedded arrays |
JPH06241883A (en) * | 1993-02-12 | 1994-09-02 | Yamatake Honeywell Co Ltd | Three dimensional information input device |
ATE225964T1 (en) | 1993-03-31 | 2002-10-15 | Luma Corp | INFORMATION MANAGEMENT IN AN ENDOSCOPY SYSTEM |
US5603065A (en) * | 1994-02-28 | 1997-02-11 | Baneth; Robin C. | Hands-free input device for operating a computer having mouthpiece with plurality of cells and a transducer for converting sound into electrical control signals |
US5835077A (en) | 1995-01-13 | 1998-11-10 | Remec, Inc., | Computer control device |
DE19617738C1 (en) | 1996-05-03 | 1997-06-19 | Draegerwerk Ag | Respiration sensor used with endotracheal catheter |
US6168568B1 (en) | 1996-10-04 | 2001-01-02 | Karmel Medical Acoustic Technologies Ltd. | Phonopneumograph system |
US5907318A (en) | 1997-01-17 | 1999-05-25 | Medina; Carlos A. | Foot-controlled computer mouse |
US5889511A (en) | 1997-01-17 | 1999-03-30 | Tritech Microelectronics International, Ltd. | Method and system for noise reduction for digitizing devices |
JPH10320108A (en) | 1997-05-15 | 1998-12-04 | Yuji Tsujimura | Cursor moving device |
US6085265A (en) * | 1998-01-09 | 2000-07-04 | Toshiba America Information Systems, Inc. | System for handling an asynchronous interrupt a universal serial bus device |
AU759440B2 (en) | 1998-01-26 | 2003-04-17 | Apple Inc. | Method and apparatus for integrating manual input |
US6213955B1 (en) | 1998-10-08 | 2001-04-10 | Sleep Solutions, Inc. | Apparatus and method for breath monitoring |
US6263392B1 (en) * | 1999-01-04 | 2001-07-17 | Mccauley Jack J. | Method and apparatus for interfacing multiple peripheral devices to a host computer |
US6395402B1 (en) * | 1999-06-09 | 2002-05-28 | Laird Technologies, Inc. | Electrically conductive polymeric foam and method of preparation thereof |
AU2629901A (en) | 2000-01-06 | 2001-07-16 | Rosemount Inc. | Grain growth of electrical interconnection for microelectromechanical systems (mems) |
US6396402B1 (en) | 2001-03-12 | 2002-05-28 | Myrica Systems Inc. | Method for detecting, recording and deterring the tapping and excavating activities of woodpeckers |
US6723024B2 (en) * | 2001-03-19 | 2004-04-20 | Michael Levine | Lung and breath control exercise method and apparatus |
US6664786B2 (en) | 2001-07-30 | 2003-12-16 | Rockwell Automation Technologies, Inc. | Magnetic field sensor using microelectromechanical system |
US20070048181A1 (en) | 2002-09-05 | 2007-03-01 | Chang Daniel M | Carbon dioxide nanosensor, and respiratory CO2 monitors |
EP1490971A4 (en) * | 2002-03-29 | 2009-11-04 | Pierre Bonnat | A device to control an electronic or computer system by means of a fluid flow and a method of manufacturing the same |
WO2004034159A2 (en) | 2002-10-09 | 2004-04-22 | Inputive Corporation | A method of controlling an electronic or computer system |
US20050127154A1 (en) | 2003-11-03 | 2005-06-16 | Pierre Bonnat | Device for receiving fluid current, which fluid current is used to control an electronic or computer system |
JP3875240B2 (en) | 2004-03-31 | 2007-01-31 | 株式会社東芝 | Manufacturing method of electronic parts |
US7624355B2 (en) | 2004-05-27 | 2009-11-24 | Baneth Robin C | System and method for controlling a user interface |
US7346178B2 (en) * | 2004-10-29 | 2008-03-18 | Silicon Matrix Pte. Ltd. | Backplateless silicon microphone |
US7588032B2 (en) | 2004-12-08 | 2009-09-15 | Be Intellectual Proeprty, Inc. | Oxygen conservation system for commercial aircraft |
US20080011297A1 (en) * | 2006-06-30 | 2008-01-17 | Scott Thomas Mazar | Monitoring physiologic conditions via transtracheal measurement of respiratory parameters |
US8564544B2 (en) | 2006-09-06 | 2013-10-22 | Apple Inc. | Touch screen device, method, and graphical user interface for customizing display of content category icons |
-
2008
- 2008-03-26 US US12/056,171 patent/US10216259B2/en not_active Expired - Fee Related
-
2019
- 2019-02-26 US US16/285,647 patent/US20190294236A1/en not_active Abandoned
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4383254A (en) * | 1979-09-14 | 1983-05-10 | David Gemmell | Control apparatus for a display matrix |
US6282183B1 (en) * | 1997-06-02 | 2001-08-28 | Motorola, Inc. | Method for authorizing couplings between devices in a capability addressable network |
US6147692A (en) * | 1997-06-25 | 2000-11-14 | Haptek, Inc. | Method and apparatus for controlling transformation of two and three-dimensional images |
US6421617B2 (en) * | 1998-07-18 | 2002-07-16 | Interval Research Corporation | Interface including fluid flow measurement for use in determining an intention of, or an effect produced by, an animate object |
US6574571B1 (en) * | 1999-02-12 | 2003-06-03 | Financial Holding Corporation, Inc. | Method and device for monitoring an electronic or computer system by means of a fluid flow |
US7739061B2 (en) * | 1999-02-12 | 2010-06-15 | Pierre Bonnat | Method and system for controlling a user interface of a device using human breath |
US7038665B1 (en) * | 1999-12-10 | 2006-05-02 | Nmb, U.S.A. Inc. | Integrated USB input device |
US20090114079A1 (en) * | 2007-11-02 | 2009-05-07 | Mark Patrick Egan | Virtual Reality Composer Platform System |
Also Published As
Publication number | Publication date |
---|---|
US10216259B2 (en) | 2019-02-26 |
US20090249202A1 (en) | 2009-10-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20190294236A1 (en) | Method and System for Processing Signals that Control a Device Using Human Breath | |
US7739061B2 (en) | Method and system for controlling a user interface of a device using human breath | |
US9753533B2 (en) | Method and system for controlling a user interface of a device using human breath | |
JP6083072B2 (en) | Smart air mouse | |
JP5320456B2 (en) | Method and system for processing a MEMS detector signal that allows control of the device using human exhalation | |
WO2012033312A1 (en) | Method of operating mobile device by recognizing user's gesture and mobile device using the method | |
CN110502163B (en) | Terminal device control method and terminal device | |
JP2010537588A (en) | Platform independent communication protocol | |
CN108334272B (en) | Control method and mobile terminal | |
EP2475969A2 (en) | Method and system for controlling a user interface of a device using human breath | |
KR20170049199A (en) | Display Apparatus and Display Control Method Thereof | |
CN110489045B (en) | Object display method and terminal equipment | |
AU2015312632A1 (en) | Method and apparatus for processing touch input | |
CN110489038B (en) | Interface display method and terminal equipment | |
CN110221753A (en) | Application program downloads classification method and terminal device | |
EP3331817A1 (en) | Cross-platform motion sensor control | |
US10170099B2 (en) | Electronic device and method for representing web content for the electronic device | |
CN111475069B (en) | Display method and electronic equipment | |
CN111339324A (en) | Multimedia playing method and electronic equipment | |
CN110865765A (en) | Terminal and map control method | |
CN111125602B (en) | Page construction method, device, equipment and storage medium | |
CN112130743A (en) | Smart watch and method for providing information in smart watch | |
CN111596875A (en) | Screen expansion method and electronic equipment | |
JP2023519389A (en) | Scratchpad creation method and electronic device | |
WO2013103181A1 (en) | Method of moving cursor of text editor using motion sensor, and computer-readable recording medium having program thereon for moving cursor of text editor by using motion sensor |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STCV | Information on status: appeal procedure |
Free format text: NOTICE OF APPEAL FILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |