AU2012100113A4 - Smart controller for earphone based multimedia systems - Google Patents

Description

Back ground of innovation: Numerous remote control accessories have been proposed for multimedia systems, many incorporate built-in manual controls, touch screen interfaces and etc. A particular disadvantage of these control systems is: constant requirement of user interaction with designated interfaces to Start, Pause, Stop, Turn on/off, Fast-Forward and Fast-Reverse the connected systems. These buttons-based interfaces would increase weight, complexity and delay of stop/start the streaming multi-media. These devices do not detect placement of earphone; which would be a great disadvantage to immediate response to an events or emergency. In the conventional methods, pause of the stream could be achieved by pressing a button on the streaming device or control module; and the other approach is to remove earphones from ear which would not pause the stream. In case of emergency situations the mentioned approaches would take precious time, the trace of the playing stream would be lost and hands could not be used because they are engaged to stop the stream or remove earphones. Summary of innovations: The presented innovation introduces new approaches to control multimedia devices. These methods include inserting or removing earphone in to ear. It would reduce user interaction, easier management and faster responses time. The principal object of the present invention is to provide hands-free control for Multi media systems, in which this would increase the control effectiveness of system and the necessity of user interaction reduced. In case of responding to an emergency event immediate pausing of the streaming media could be achieved by remove of any of the earphone from ear and start it back by placing them back. The same approach could be taken to answer a phone call or activation of hearing aid systems. With the stated object in view, there are a number of solutions provided, these are based on three different approaches which could be operated solely or to combine together for better accuracy. These methods are based on Position sensors and Touch sensors. The touch sensors include direct and indirect skin touch sensors. These sensors could be made as add-ons for earphones, or they could be made build-in to earphone devices. Also some of the internal elements of speaker in the earphones could be used as a part of the required sensors to reduce cost and weight.

Brief description of the drawing: Fig 1: Skin Touch sensor for single earphone Fig 2: Skin Touch sensor for single earphone Fig 3: Skin touch sensor for stereo earphone Fig 4: Stereo and Mono touch sensors (In-direct touch sensor) Fig 5: Position sensor Fig 6: Fast Forward/Fast-Reverse touch sensors Fig 7: The control logic for Single earphone systems Fig 8: The control logic for Stereo earphone systems Fig 9: Communication between earphone and Multimedia device through common channel of audio wire Fig 10: Communication between earphone and Multimedia device through separate channels of audio and signaling wire Fig 11: Communication between earphone and Multimedia device through wireless link Detailed description: The presented explanations and drawings are based on mono and stereo type of in-ear earphones; however the same approaches could be applied for other type earphones. The structure of the presented innovation could be divided in three major sections, including: 1. Control logic 2. Sensors 3. Headphones and Multimedia Controller device connection Control logic: Depend on the type of earphones, the controlling methods are generally divided in to two different categories: Mono (Single) and Stereo. The control logics would have Mono and Stereo sensor inputs categories. These logics are used to generate the control signals for related multi-media devices.

Control logic for Mono (single) earphone: The signaling output could be determined by processing of the sensor's output and comparing it to a threshold/pre-stored value. Fig 7 shows the block diagram of this controlling logic. Operating mode of the system would be determined by Path selector: Path #1: It is used for the normal system operation, in this mode the output of the system would be determined by comparing the output of the sensor with a pre stored threshold value or stored value in memory through training process. Path #2: It would be used to calibrate and train system and store new comparing values in memory for better and more accurate operation. Control logic for Stereo (two) earphones: There are two approaches to generate controlling signals for Stereo earphones. In first approach the output signal can be determined by processing of the sensors' outputs and comparing them to each other and a threshold/pre-stored value. In the second approach, the output signal can be determined by processing the sensors' outputs and comparing them individually to a threshold/pre-stored value. The block diagram of the logic has been presented in Fig 8. The path/logic selector selects the operating mode of the system. Path/Logic #1: the output from the earphone sensors would be compared with each other and a threshold value to ensuring the correct output of controller. The process of this logic is as follows: When both earphones are inserted in to the ear or taken out, the sensors would return same state/value to the controller; by comparing these values with each other and a threshold value an appropriate output would be generated. Comparison of the earphones outputs with each other and a third value would ensure accuracy of output signal generated. Path/Logic #2: In this logic the state of each earphone would be measured individually by comparing the output of each earphone's sensor to a threshold value. Based on these outputs, the appropriate output signal would be generated. With this approach the controller could be set to generate signal based on state of one earphone. Path #3: It would be used to calibrate/train the system and the store comparing values in memory for better and more accurate operation.

Sensors: There are different varieties of sensors could be used to determine placement of earphones in to ear. Numbers and combination of sensors in use could be increased for better accuracy of output. Direct skin-touch sensors: These sensors would measure changes in voltage and/or current values caused by human body conductivity characteristics. These types of sensors require minimum of two conductors; and their current/voltage should be monitored constantly. By earphone placement in to ear, the conductors would contact the skin, and it causes alteration in output current/voltage. Depending on the measured values, controlling signal could be generated by controller logic. On mono (Single) earphone both connectors should be placed on same device. Fig 1 shows the placement of two conductors (101/102) and (103/104); which are separated by non conductor spacing in between (105/106). The spacing would isolate the connection between conductors; the only path between two conductors would be through user's skin. Fig 2 draws the other suggested design for these sensors, in this case the first connector is 201/202 and the second is 205/206 and they have been separated by non-conductor spacing of 203/204. For Stereo (two) earphone systems the connectors could be placed separately on each earphone as suggested in Fig 4. In illustrated diagram two connectors are (301 and 302), each had been place on each of the earphones individually. Both earphones should be placed until the current/voltage changes could be measured and the related controlling signal would be generated. Fig 6 shows positions to place sensors (601/602) on both earphones to enable Fast Forward and Fast-Reverse of the stream; and combination of them could be used to perform any user defined tasks including Power off/on, Jump to Next/Previous songs and etc.

Touch sensors: Indirect touch sensors could include wide range of techniques to determine a touch event. These sensors could use capacitive, resistive and inductive based touch sensors. These techniques would not require direct touch of a conductive to skin to detect touch event. These sensors would determine alternation to electric/magnetic fields cause by human body or changes in voltage/current when pressed against it. These touch sensors independent of their types can offer great signaling control with no need to directly touch the skin. Fig 4 shows an example of how the earphone could be equipped with these types of sensors. Entire surface of earphone could be made sensitive with these sensors (401/402) for better accuracy. In Mono earphone systems, output of only one earphone could be used to generate the related controlling signal. In Stereo earphone systems the output of both earphones' sensors could be used to generate the related controlling signal. The inductors or capacitors in earphones' speakers could be used as sensors to reduce cost, weight and complexity. Fig 6 shows positions to place sensors (601/602) on both earphones to enable Fast Forward and Fast-Reverse of the stream; and combination of them could be used to perform any user defined tasks including Power off/on, Jump to Next/Previous songs and etc. Position sensor: Position sensor based systems, use sensors like Gyroscopes, Mercury switches or other position determining sensors in different numbers, arrangements and placements to identify the position of earphones. As it is shown on Fig 5, 501/502; these are suggestion places to mount position sensors. In mono earphone systems, depending on the position state of one earphone, the control signal would be generated. In stereo earphone systems the position of both earphones could be used to generate the controlling signal. Base and Earphone set communications: Communication between control module and sensors mounted on earphone set could be achieved through different means including: audio cable, separate set of wires or wireless communication channels. The block diagram of these communication methods has been illustrated in Figs of 9, 10 and 11. Fig 9 shows use of Combiner/Splitter systems to transmit audio and controlling signals through a shared wire. Fig 10 shows use of separate set of wires to transmit audio and controlling signals. Fig 11 shows use of wireless communication link to transmit audio and controlling signals.

Claims (5)

1. New controlling methods for Multimedia devices, Phones, Audio aids and other earphone based devices, to control the streaming media with minimum user interaction.

2. The control system in clam 1, would monitor earphones placement in to ears and would Play/Pause/Stop the streaming media based on the controller logic configuration.

3. The control system in clam 1, could use Touch sensors (Including direct and indirect) and Position sensors to determine placement of earphone in to ears and generating the related controlling signal.

4. The control system in clam 1, could be used for systems with Stereo (Double), Mono (Single) types of earphones

5. The control system in clam 1, could be used for different types of earphones including Circumaural earphone, In-ear headphones, Headsets, Wired and Wireless