SE1451410A1 - Earphones with sensor controlled audio output - Google Patents

Description

adapted to be arranged at the ear of a user and having a speaker element for converting an audio output into sound waves, a controller for controlling the audio output sent from a media player to the speaker element, a first motion sensor for detecting movements of a user, and a pulse rate detector being sized and adapted for detecting the heart rate of the user. Moreover, the controller is adapted to receive sensor data from said first motion sensor and said pulse rate detector and based on the sensor data determine a state of the user. Finally, the controller adjusts the audio output to the speaker element based on the determined state of the user.

By providing earphones according to the invention, the earphones may detect a state of the user with higher accuracy than prior art due to the two different sensor data inputs. Thereafter the determined state may control what audio output should be sent to the user. For example, if the controller determines based on sensor data that the user is falling asleep, the volume may be lowered, a specific song be selected or a playlist associated with sleeping may be activated. ln another example, if the controller determines based on sensor data that the user is starting to work out, the volume may be increased or a playlist associated with working out may be activated. More specifically, the sensors may differentiate between e.g. running and lifting weights at the gym and adjust the output accordingly. This is possible by not only monitoring the heart rate but also the movements of the user. The motion sensor may detect any change in a user's movements and the pulse rate detector may be used to determine in what state on a sleep-to-workout-scale the user is in. By combining the data from the motion sensor and the pulse rate detector, information about a user's state may be determined with higher accuracy than prior art. ln the context of the application “state of the user” is to be understood as a user's physical state or activity in a broad meaning. lt includes, but is not limited to states like being awake, resting, sleeping, working out, running, lifting weights, bicycling, climbing, dancing, jumping, etc. etc. Further, it also includes the states of going from awake to falling asleep gradually and consequently e.g. lowering the volume gradually. Moreover, the different detectable states of the user may be predefined by the user in an application on the media player or through other software. Thereby, if the user wants the earphones to be able to detect a specific state, say dancing, the user can define the state dancing and corresponding sensor data. Moreover, a software application may be used that learns the user's different states and corresponding sensor data. Thereby, the earphones will improve its ability to determine the state of the user.

Further, in the context of the application the wording “audio output” should be understood as any sound content that may be transmitted from an audio source to a speaker unit of the earphones. The audio output includes but is not limited to music, relaxation sounds, speaking, pod casts, audio books etc.

Moreover, the wording “media player” should be understood as any source from which audio output may be transmitted, including but not limited to a smart phone, music player, DVD player, radio, TV, computer, tablet etc. Thus, the inventive concept may be used for both a portable media player and a stationary media player. Further, in the context of the application “pulse rate detector” is to be understood as a sensor for detecting the heart rate.

The controller controls the audio output with regards to the determined state of the user. By combining the data from the motion sensor and the pulse rate detector, a more reliable determination of a user's state may be obtained, which is then used for the controller to set the audio output. For example, if a user is awake and walking, the pulse rate detector and the motion sensor may in combination provide sufficient data to the controller for the controller to provide the correct audio output. lf a user subsequently sits down, the pulse rate detector may detect a slower pulse and the motion detector detects a motion pattern associated with sitting, which is sufficient data for the controller to change audio output such as decrease volume or switch to a low beat (beats per minute) music audio output.

Moreover, the earphones according to the invention provide an improved sleeping function, since it is common for a user to fall asieep while listening to audio output which may be detected and the audio output altered based on the detected sleeping state of the user.

Combining data from the pulse rate detector and a motion sensor improves accuracy since data from only one of either the motion sensor or the pulse rate detector is insufficient to provide a desired audio output. For example, a user's pulse may increase due to a state of nervousness or stress. lf a user would then use the earphones and the controller in the earphones would determine a “workout-state” based on a high pulse only, and thereby choosing an up tempo audio output, the result may not be desirable since a fast beat music may only enhance the state of stress in such case. However, by combining the data from the pulse rate detector and the motion sensor, it may clarify that a user has a high pulse, but not generated by motion, which may determine a state of stress, and thus the audio output may be a calm low beat relaxing music. This may be desirable for e.g. persons having a psychological distress.

According to one embodiment, the control of the adjustment of the audio output sent to the speaker element may be handled autonomously from the controller. ln another embodiment the sensor data is sent from the controller to the media player and software in the media player determines the state of the user and/or controls the output to the earphones. Thereby, some of the calculations may be distributed from the controller integrated in the earphones to the media player having a higher calculation capacity.

According to one embodiment, the determination of the state of the user includes determining if the user is asieep or awake.

By combining a pulse rate and a motion of a user, the state of a user may be determined. A certain state may be that a user is asieep, which may mean that the pulse slows down to a rest pulse. ln one embodiment the rest pulse may be predefined by the user. ln another embodiment the rest pulse rate may be automatically detected and adjusted over time by the controller and or by software in the media player. Further, the detected pulse rate in combination with the motion sensor sensing a moving pattern associated with sleeping, the controller may be able to determine that a user is asleep.

Moreover, the moving pattern associated with sleeping may be adjusted over time as the user uses the earphones. ln other embodiments, the moving pattern associated with sleeping may be that the aggregated detected movements over time are below a threshold value. The controller may thus control the audio output according to a predetermined mode, such as decreasing volume, changing audio output to a slow beat music, or switching off the playback function. ln one embodiment, the user is able to predefine how the controller is to control the output based on the state of the user.

Some examples of controlling the output include associating a playlist with sleeping, decreasing the volume or stopping the audio output when asleep.

According to yet one embodiment, the determination of the state of the user includes determining if the user is in the process of falling asleep. Thereby, the audio output may be gradually controlled during the process of falling asleep. E.g. the volume may be gradually decreased during the time span of where the user is gradually falling asleep.

According to one embodiment, the determination of the state of the user includes determining if the user is at rest or is working out.

Thereby, the audio output may be adapted to the activity performed by the user. For instance, a combination of a low pulse and a slow motion being detected, the controller may determine that a user is in a rest state. A rest state may be distinguished from a sleep state in that the pulse rate or moving pattern is different. Moreover, a user being at rest is probable to desire a different output than when the same user is working out. ln one embodiment the detected state may be specified within the working out state, e.g. by detecting that the user is running, lifting weights, bicycling, climbing, dancing, jumping, doing yoga, stretching, etc. Further, in one embodiment the working out states that may be detected may be defined by the user in a software application on the media player. Thereby, e.g. a user visiting the gym may automatically listen to “bicycle race” by Queen in high volume while warming up on the spinning bicycle, hear “Eye of the tiger” by Survivor while bench pressing, “l will survive” by Gloria Gaynor when doing burpees and finish off with stretching to “No woman no Cry” with Bob Marley in a low volume.

According to yet one embodiment, the motion sensor is an accelerometer adapted to sense motions of the user. By allowing the motion sensor to be an accelerometer, it may be possible to instantly detect a change in the motion pattern of a user. A user may for instance at a certain time be walking, and at a time later start jogging. The accelerometer detects accelerations, i.e. changes in movements. The acceleration or movement pattern is different when the user walks, jogs or sprints. As the accelerometer detects a change, the controller receives the data and controls the earphones according to a predetermined setting.

According to one embodiment, the first motion sensor is located in the earpiece of said earphones. Thereby, motions of the users head may be registered.

According to one embodiment, the pulse rate detector is an IR-sensor adapted for detecting blood flow of the user. ln one embodiment the IR- sensor comprises an infrared light source and a light detector for measuring the light reflected from arteries beneath the surface of the skin. Thereby the blood flow of a user may be detected, and hence determine the pulse rate due to the pulsation of the blood. By using an IR sensor, it may be possible to detect the blood flow without having an external pulse rate detector device in close connection to the body, such as strapped or taped. The IR sensor may be placed on the earphone on a place to be closely positioned to a user's body. More specifically the IR sensor may be placed on an earpiece of the earphone on the piece that is being inserted into the ear, or being held close to the ear. By placing the IR sensor on an earpiece of the earphone, it may facilitate detecting the blood flow from a spot in the ear. IR sensors may further be easy to use and may not require any further installation on the body. ln further one embodiment, the first motion sensor is used for detecting minor relative motions between the earbud and the ear. Thereby, the sensor data from the pulse detection may be filtered so as to avoid disturbance sensor data resulting from relative motions between the earbud and the ear of the usen ln another embodiment the pulse rate detector may be a conductive sensor material for detecting the electrical conductivity of the user's skin and thereby determine the pulse rate of the user.

According to one embodiment, adjusting the audio output to said speaker element includes adjusting the volume of the audio output.

Thereby, the user may receive the audio output in a volume which is adapted to the state the user is in. For instance, when a change in a state of a user goes from active to resting, the controller may adjust the volume to a suitable volume. This may be an advantage since if a user falls asleep during a restful moment, the controller may adjust the volume so that the volume is low in order to not risk that the user may wake up abruptly due to high noise.

Moreover, the user is likely to prefer higher volume when running compared to when stretching after the run etc.

According to one embodiment, adjusting the audio output to said speaker element includes selecting an audio output source associated with the detected state of the user.

Thereby, the user may select music or other audio which is suitable for the detected state of the user, in addition to the possibility to adjust volume, pause or stop the audio etc. For example, in one scenario a person may be up and walking, and later sits down for a rest. When the pulse rate detector and the motion detector acknowledge a change in a user's pulse and motion pattern, i.e. the state, in this case from active to resting, the controller may control the audio output to generate a different audio output. For instance, the audio player may in an active state play an upbeat music. When the user changes the state from active to resting, the controller may change the audio output to play more relaxing low beat music, or a relaxation sound. Further, in one embodiment the user may predefine playlists to be associated with specific states of the user.

According to one embodiment, the audio output is music and wherein the audio output associated with the detected state of the user, comprises matching the music's beat per minute (bpm) with the detected activity.

Thereby, the audio output may be selecting music which has a related beat to the state of the user. E.g. when the user is running a high speed running session (having a high heart rate) a song with fast pace (high BPM) may be played, and when jogging (with a lower heart rate) a song with a slower pace (slower BPM) may be played. The controller may thereby choose music according to its properties, such as beats per minute, frequency and such in order to match a user's state with the right music that may be suitable at that time.

According to one embodiment, the audio output is based on the state of the user and further the music's beat per minute (bpm) corresponds to a detected pulse. By adapting the controller to be able to perform a matching between a user's detected pulse and a piece of music's beat per minute, it may facilitate for the user to find a piece of music suitable to the user's state. Moreover, the music's beat per minute (bpm) may correspond to a detected cadence. The cadence may be e.g. the number of revolutions of the crankset per minute if the state is bicycling, or the step frequency in the state of walking or running.

For instance, if a user is running, and periodically starts sprinting, the change in pulse/cadence may be detected and the controller may receive the data in order to adjust the music output to a music that has substantially similar or at least related beats per minute as the user's puise/cadence. Thereby the user does not have to manually adjust the music, which is desirable to avoid during a workout since any manual adjustment may be time-consuming and taking focus from the physical activity.

According to one embodiment, the earphones further comprising a remote control unit comprising said controller and a second motion sensor, wherein said remote control unit is arranged at a distance from an earpiece of said earphones.

Thereby, the user may use the remote control to manually control the audio output. Moreover, the second motion sensor may be used in combination with the first motion sensor to determine motions of the user with even higher accuracy. Further, by having two motion sensors, the first motion sensor may with an improved result be used for detecting minor relative motions between the earbud and the ear. Thereby, the sensor data from the pulse detection may be filtered so as to avoid disturbance sensor data resulting from relative motions between the earbud and the ear of the user. Moreover, the second motion detector may be a second accelerometer. Thereby the advantages as described above in relation to that the first motion sensor may be an accelerometer may be achieved for the second sensor as well.

According to one embodiment, said remote control unit comprises a wireless circuit for wireless communication with the media player. Thereby, the control communication for adjusting the audio output may be sent through a wireless communication. The remote control unit may be arranged on the cable between the earbuds and the media player. Alternatively, the remote control unit may be placed on the earbuds.

According to one embodiment, the wireless connection is a Bluetooth circuit for wireless communication with the media player. Thereby, the wireless communication may be handled by a standardized communication protocol which has low energy consumption and is supported by a wide range of media players.

According to one embodiment, said first acceierometer is further used for detecting relative motion between the earphone and the user's ear when in use, and wherein relative movement data is used for compensating data from said IR-sensor to said controller. Thereby, relative movements causing disturbances in the IR-sensor may be filtered from the sensor data and more accurate pulse detection may be provided.

According to yet one embodiment, said audio output is adjusted according to a user pre-defined setting associated with the detected state of the user.

Thereby, the user may self choose how the audio output is to be changed depending on what state of the user that is detected. The settings may be handled through a software on the media player, e.g. through an application in a smart phone. The control of the audio output may be predefined by the user for any specific state that a user may find appropriate. For instance, a user may upload a playlist of music or an audio book that may be suitable when in a resting state or choose to pause the audio if falling asleep or decreasing the volume if falling asleep etc. Another playlist of audio may be defined to be played when a work out state is detected. Alternatively, or as a complement, the user may predefine a variety of sound content which beats per minute correspond to a user's state, and the controller may control the audio output accordingly. The user may at any time manually override the state-based control of the media player, e.g. if a certain audio output may not be desirable at a given time.

According to one embodiment, the earphones are operated by means of the energy supplied from the media player. ln one embodiment the energy is taken from the microphone line using trickle charge circuitry. Thereby no internal or external battery is needed, which enables a more compact design and requires no charging of batteries. 11 According to one embodiment, the earphones comprise an energy harvesting unit for harvesting electric current from the played audio and wherein the harvested electrical current is used to drive the sensors. Thereby, less energy is needed from the mobile device since energy supplied to earphones for playing the audio may be better utilized. Thereby, the sensors may be active in longer sequences with the same amount of battery usage from the media player. ln one embodiment, the earphones are wirelessly connected to the media player. Thereby, no cable is needed and the user has increased flexibility relative the media player. However, in such an embodiment the earphones would require a separate battery to drive the speaker elements and the SGFISOFS.

According to one embodiment, the pulse rate detector is active in periods and inactive in periods, so as to save energy. Thereby, less energy is needed compared to continuously measuring the pulse. Since a pulse detector is the most energy consuming component it is the most important sensor to reduce energy consumption for. The pulse rate detector may have inactive periods lasting for between 1 second and 10 minutes. ln some examples the inactive periods lasts for five seconds, ten seconds, 30 seconds, 1 minute, 5 minutes or at any time that is considered suitable. Further, the active period for measuring the pulse may be between 1 second to 1 minute. ln some examples the active periods lasts for one second, three seconds, ten seconds, 30 seconds, 45 seconds or any other active length that may provide sufficient data. Hereby, energy may be saved and thus the media player's battery will last longer.

The motion sensor may also be inactive in periods. The inactive period of the motion sensor may last for between 5 second and 5 minutes. ln some examples the inactive periods lasts for five seconds, ten seconds, 30 seconds or 1 minute. Correspondingly, the active periods may last for between 5 12 second and 5 minutes. ln some examples the inactive periods lasts for five seconds, ten seconds, 30 seconds or 1 minute. ln one embodiment, the motion sensor in the earphones may be further used for handling manual commands of a user. For example, the controller may be programmed to control the audio output when the motion sensor detects a tap on the ear piece (comprising the motion sensor), the control command may be to pause/play for a single tap or to change song as a response to a double tap, and to activate voice control as a response of a triple tap etc. ln one embodiment the state detecting activity is disabled during the period when a manual tap action is detected, so as not to disturb the detection of user state when tapping the earplug.

Moreover, the earphones preferably comprise a microphone for recording a sound from the user. The microphone would enable the user to handle a phone call or voice commands. Moreover, the microphone may be used to further increase the reliability of the detected state of the user. Further, the microphone may be used to detect ambient sounds and based on that data the controller may control the volume of the audio output. Thereby, in a noisy environment the volume may be higher than in a silent environment.

According to another aspect of the invention, the above mention objects are achieved by a method for adjusting the audio output from a media player by means of earphones, wherein the earphones comprise a speaker element for converting an audio output into sound waves, a controller, a first motion sensor, and a pulse rate detector. The method further comprise the steps of detecting movements of a user by means of the first motion sensor, detecting a pulse rate by means of the pulse rate detector, transmitting sensor data from said first motion sensor and said pulse rate detector to said controller, determine a state of the user by means of the controller, based on said sensor data, and adjusting the audio output sent from the media player to the speaker element, based on the determined state of the user. 13 Hereby, a method for adjusting the output from a media player is achieved having advantages which are analogous to the advantages mentioned in relation to the earphones above. Further, it should be understood that any of the functions and methods explained in relation to the earphones may be implemented to the method without extending from the scope of the inventive method. For example, the sensors may have inactive and active periods as described above, the output may be selecting a song, performing a stop/pause/play action, and changing the volume or other operations.

According to another aspect of the invention, the above mention objects are achieved by a computer program product comprising a computer readable medium having stored thereon computer program means for causing a controller to adjust the audio output from a media player to earphones, wherein the earphones comprise a speaker element for converting an audio output into sound waves, a controller, a first motion sensor, and a pulse rate detector, wherein the computer program product comprise code for detecting movements of a user by means of the first motion sensor, code for detecting a pulse rate by means of the pulse rate detector, code for transmitting sensor data from said first motion sensor and said pulse rate detector to said controller. Further the computer program product comprises code for determining a state of the user by means of the controller, based on said sensor data, and code for adjusting the audio output sent from the media player (13) to the speaker element, based on the determined state of the USGF.

Hereby, the above-mention method may for adjusting the output from a media player may be performed by a computer program product and the advantages are analogous to the advantages mentioned in relation to the earphones above. Further, it should be understood that any of the functions and methods explained above may be implemented as code for performing said functions or methods without extending from the scope of the inventive concept. For example, the computer program product may comprise code for generating 14 inactive and active periods for the sensors as described above, the output may be selecting a song, performing a stop/pause/play action, and changing the volume or other operations.

The computer readable medium may be one of a removable nonvolatile random access memory, a hard disk drive, a floppy disk, a CD- ROM, a DVD-ROM, a USB memory, an SD memory card, or a similar computer readable medium known in the art (present and future). The present invention may be implemented using a combination of software and hardware elements.

According to yet another aspect of the invention, the earphones comprise at least one earpiece, each earpiece having an active side portion and a front side portion, and a cable attached to the front side portion providing signal input to the earphones, each earpiece being configured to be inserted into the entrance of the auditory canal of a users ear such that the active side is facing towards the auditory canal. Furthermore, the earpiece is sized to, when in use, be accommodated inside the users outer ear so as to prevent the earpiece from extending outside the outer ear. Moreover, the cable enters the earpiece at an entrance position and is slidably arranged in a recess located at a distance from the said entrance position of the front side portion of the earpiece, wherein the cable is adjustable and forms a loop for being retained inside the outer ear of the user. Hereby, the earphone is designed to be retained inside the outer ear and not extend outside of the ear which makes it suitable for use in a wide range of activities or states of the user. E.g. the earpiece will not disturb sleeping even if resting the ear on a support like a pillow or the alike, since the earpiece does not extend outside of the outer ear. Moreover, the cable holds the earpiece inside the ear and prevents it from falling out during for example sleeping, running, dancing etc. etc. The loop size is adjustable by means of sliding the cable in said recess. Thereby the loop size may be adapted to the user's ear and thereby have a tailored fit. ln one embodiment the active side may be formed in a soft and partially resilient material so that the earpiece provides a comfortable fit in a user's ear and as to prevent rubbing. The active side and the front side may be of different material. The front side may be of a polymer material, steel or other material. lt may be an advantage if the material of the front side may be hard and wear resistant so as to protect the components inside the earpiece. ln one embodiment the active side may be formed so that it does not enter the ear canal when in use, but rests on the user's inside of the outer ear.

Thereby, a side pressure from e.g. a pillow acting on the earphone while resting the head against the pillow will not act with a pressure on the sensitive ear canal, thus providing an earphone adapted for sleeping with.

According to one embodiment, the front side of the earpiece is provided with a recess, wherein the cable is configured to be slidably arranged in said recess such as to provide an adjustable loop arranged to run along the curve of the concha in a user's ear in order to provide stability for the earphones.

The recess may be configured to provide a grip to the cable arranged in the recess in order to prevent the recess from accidently releasing its grip. The recess may be configured such that when the earpiece is fitted in a user's ear, the cable may form an adjustable loop that may be placed along the curve of the concha in the ear such as to provide an expandable support in the ear to prevent the earpiece from accidently falling out.

According to one embodiment, the entrance position is arranged on a first side of the earpiece and the recess is arranged on an opposite side of the earpiece. By placing the entrance position on a first side of the earpiece, and the recess on an opposite side it may allow the loop to be formed as similar to the curve of the concha as possible. The recess may be arranged either on the outer potion of the earpiece or more centrally on the earpiece. The recess may be extending in a direction in line with, or at an angle to or perpendicularly relative to the cable's entrance of the earpiece. 16 According to one embodiment, the front side is convex, and configured to, when in use, be substantially leveled within a user's outer ear. Thereby, any sharp scrubbing edges may be avoided which may be uncomfortable for the user. Further such a design allows a user to rest the ear against an object, such as a pillow, without the earpiece obstructing the comfort for the user.

Further features of, and advantages with, the present invention will become apparent when studying the appended claims and the following description.

The skilled addressee realize that different features of the present invention may be combined to create embodiments other than those described in the following, without departing from the scope of the present invention.

Brief description of the drawings Further details and aspect of the present invention will become apparent from the following detailed description with reference to accompanying drawings, in which: fig. 1 s shows a side view of an earphone according to an embodiment of the present invention, fig. 2 shows a front view of an earphone according to an embodiment of the present invention, fig. 3 shows a front view of an earphone in use according to an embodiment of the present invention, fig. 4 shows a front view of an earphone in use according to an embodiment of the present invention, fig. 5 shows a perspective view of an earphone according to an embodiment of the present invention, fig. 6 shows a system overview of an earphone according to the invention with a media player, and fig. 7 shows a flow chart describing a method according to the invention, and fig. 8 shows a flow chart describing a functional overview of an earphone according to an embodiment of the invention. 17 Detailed description of embodiments The present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which currently preferred embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided for thoroughness and completeness, and fully convey the scope of the invention to the skilled addressee. Like reference characters refer to like elements throughout. ln the following, the earphones are only described in relation to in-ear earphones, however, the inventive concept is equally applicable to headphones and or a single earphone in e.g. a Bluetooth headset for a phone, a wireless communication from a stationary home audio equipment, a wireless headset to be used during guided tours, theme parks, public gyms or the like where there may be a central audio equipment available for multiple connections to earphones according t the invention.

Fig. 1 shows a side view of an earphone 1. The earphone 1 has an earpiece 2 which comprises a front side 3 and an active side portion 4. lt could also be interpreted as the earpiece has a rim 5 there between. The front side portion 3 and the active side portion 4 are opposite to each other, and joined together via the rim 5. Fig. 1 further shows a recess 6 running across the earpiece 2 at one end close to the rim 5. There is shown a cable 7 arranged in the recess 6. The active side portion 4 of the earphone is configured to be inserted in connection to an auditory canal in a user's ear 20 in order to enable the user to listen to audio output transmitted via the earphones. The active side portion 4 is slightly tapered for enabling a close fit to the user's auditory canal. The active side portion 4 may be formed by a soft and partially resilient material so that the earpiece provides a comfortable fit in a user's ear, and to prevent rubbing. 18 Fig. 2 shows a front view of an earphone. As seen, the cable 7 is attached to the rim 5 or the earpiece 2 at a first end 10. The earpiece is provided with a recess 6 on a second end 11 of the earpiece 2. ln fig. 2, the second end 11 is placed opposite to the first end 10. The recess 6 extends perpendicularly to the direction in which the cable 7 enters into the earpiece at the rim 5. Further in fig. 2 it is shown that the cable 7 is arranged in the recess 6 along the length of the cable 7. This may provide a slidable arrangement in the recess 6. By arranging the cable 7 in the recess 6, an adjustable loop 9 is provided.

The loop 9 is arranged to be placed in the concha 21 of a user's ear, as is illustrated in fig. 3 and fig.4, and may be adjustable in order to allow a pressing action against the ear 20 in order to retain the earpiece inside the ear 20 of the user. When comparing fig. 3 with fig. 4 the function of adjusting the loop size to have a tailored fit for the user's ear 20 and Fig. 5 shows an assembly over an earphone connected to a media player 13.

As shown the assembly comprises earphones 1 according to the invention.

Fig. 6 further shows a remote control unit 12 being arranged along the cable 7 of the earphones. The remote control unit 12 is connected via a cable 7 to a media player 13 for the audio output.

Fig. 7 illustrates an overview of the earphones in an embodiment comprising a remote control unit 12 attached on a cable 7 used to connect the earphones to the media player 13. Moreover, a dashed line illustrates that the control unit 12 may communicate via a wireless protocol with the media player 13. The wireless communication in this setting is control data used to control the output of the audio output to be played by the earphones 1. The wireless communication may also comprise sensor data to be analyzed in the media player or on a remote server via the media player so as to determine a state of the user which can subsequently be used to control the output of the audio output. The control data (or control of the audio output) may comprise selecting specific tracks, playlists, genres, BPM-tracks, adjusting volume, pausing, stopping, playing etc. 19 Fig. 7 illustrates the method steps for adjusting the audio output from a media player by means of earphones. The method is to be used with earphones comprising a speaker element 24 for converting an audio output into sound waves, a controller 120, a first motion sensor 25, and a pulse rate detector 26, 27. The method comprise the steps of detecting 201 movements of a user by means of the first motion sensor 25, detecting a pulse rate 202 by means of the pulse rate detector, transmitting sensor data 203 from said first motion sensor and said pulse rate detector to said controller, determine a state of the user 204 by means of the controller, based on said sensor data, and adjusting the audio output 205 sent from the media player 13 to the speaker element, based on the determined state of the user.

Fig. 8 illustrates a functional overview of components in one embodiment of the invention. In this overview the ear piece 2 comprise a speaker element 24 for playback of audio output. The ear piece 2 further comprise motion sensor being an accelerometer 25, and a pulse rate detector comprising an IR led 26 and a IR sensor 27. The accelerometer may be a 3D accelerometer which is adapted to sense motions of the users head when in use. Further, the IR- sensor 27 sense the reflected light from the IR led 26 and from the reflection it can be used to calculate the blood flow and consequently the pulse rate. The IR led 26 preferably uses a wavelength of about 800-900 nm, e.g. about 850 nm. It is possible to have a double set up of sensors, i.e. on in each ear piece 2, but it has been found that it is not necessary for the accuracy, especially not ifa second accelerometer is implemented in the remote control unit as described above. By only having the sensors in one earphone the costs may be kept lower. Moreover, the data from the IR-sensor may be analogue data, but may be sent as either analogue signals or digital signals to the controller.

Moreover, the earphones 1 comprise a control unit, in this case being a micro controller 120 being communicatively connected to the earphones.

Preferably, the communication is handled through the cable 7 as illustrated in fig. 6. The cable 7 may comprise a signal cable dedicated for digital communication. Preferably a dedicated cable for the sensor data is used. The control unit may be arranged in the remote control unit 12 (not shown in fig. 8). The micro controller 120 may comprise an l2C circuit 121 for enabling communication between the micro controller 120 and the remote control buttons 123 and/or from the sensors 26, 27. Moreover, the micro controller 120 may comprise a Bluetooth circuit in this case being a Bluetooth low energy (BLE) 122 circuit for enabling communication with the media player as discussed above.

Moreover, a power control unit 28 may be included in the system for controlling when the different components are to be activated and inactivated.

The power control 28 unit may also electrically coupled to an energy harvesting component 30 comprising an energy storage circuit 31 and a boost converter circuit 32. The energy storage circuit 31 may be a micro capacitor.

The energy harvesting component may be used to harvest energy from the phone connection 33, e.g. being a 3,5mm plug, and also potentially harvesting energy from the played audio as explained above. By having a local energy storage circuit 31 and a boost converter circuit 32 the sensors may be run with enough energy during active periods, and then during inactive periods the energy harvesting unit may start storing energy for the next active period.

Moreover, the earphones preferably comprise a microphone 35 so that the earphones may be used to record a sound from the user, e.g. for handling a phone call or voice commands. Moreover, the microphone 35 may be used to further increase the reliability of the detected state of the user. E.g. if the user is detected to be running (based on the sensor data), the microphone may be used for confirming that the environmental sound correlates to a sound associated with running, and if the users is detected (based on the sensor data) to be sleeping, the microphone may be used for confirming that the environmental sound correlates to a sound associated with sleeping. Further, 21 it would be possible to use the microphone to detect ambient sounds and based on that data control the volume of the audio output.

Moreover, the remote control unit 12 may comprise an on/off switch for enabling or disabling the control of the audio output based on the user's detected state. Thereby, the user can avoid having the audio output changed when the user changes activity, if the user so desires. ln other embodiments, the on/off switch may be implemented as software setting in an application on the media player.

The present disclosure contemplates products, methods and program products on any machine-readable media for accomplishing various operations. The embodiments of the present disclosure may be implemented using existing computer processors, or by a special purpose computer processor for an appropriate system, incorporated for this or another purpose, or by a hardwired system. Embodiments within the scope of the present disclosure include program products comprising machine-readable media for carrying or having machine-executable instructions or data structures stored thereon. Such machine-readable media can be any available media that can be accessed by a general purpose or special purpose computer or other machine with a processor. By way of example, such machine-readable media can comprise RAM, ROM, EPROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium, specifically including a non-transitory computer-readable storage medium, which can be used to carry or store desired program code in the form of machine-executable instructions or data structures and which can be accessed by a general purpose or special purpose computer or other machine with a processor. When information is transferred or provided over a network or another communications connection (either hardwired, wireless, or a combination of hardwired or wireless) to a machine, the machine properly views the connection as a machine-readable medium. Thus, any such connection is properly termed a machine-readable medium. Combinations of 22 the above are also included within the scope of machine-readable media.

Machine-executable instructions include, for example, instructions and data which cause a general purpose computer, special purpose computer, or special purpose processing machines to perform a certain function or group of functions.

Although exemplary embodiments of the present invention have been shown and described, it will be apparent to the person skilled in the art that a number of changes and modifications, or alterations of the invention as described herein may be made. Thus, it is to be understood that the above description of the invention and the accompanying drawing is to be regarded as a non- limiting example thereof and that the scope of the invention is defined in the appended patent claims.

Claims (4)

1 HORLURAR MED SENSORSTYRD AUDIELL UTDATA 1. Horlurar (1) for atergivning av audiell utdata fran en mediaspelare (13) innefattande: 1. atminstone ett lurelement (2), storleksformat och anpassat att anordnas vid Orat (20) hos en anvandare, och som har ett hogtalarelement (24) for att omvandla audiell utdata till ljudvagor, 2. en styrenhet (120) fOr styrning av den audiella utdatan som sands fran en mediaspelare (13) till hOgtalarelementet, 3. en forsta rOrelsesensor fOr att avkanna rOrelse hos en anvandare, och - en pulsratdetektor som är storleksformad och konfigurerad att avkanna hjartfrekvens hos en anvandare, varvid 4. namnda rorelsesensor är en accelerometer konfigurerad att avkanna rorelse hos anvandaren, - nannnda styrenhet (120) är konfigurerad att ta ennot sensordata fran namnda forsta rorelsesensor och namnda pulsratdetektor och att baserat pa namnda sensordata bestamma tillstandet hos en anvandare, och 5. namnda styrenhet (120) justerar den audiella utdatan till namnda hogtalarelement (24) baserat pa det bestamda tillstandet hos anvandaren f6r att anpassa den audiella utdatan till en aktivitet som utfors av anvandaren sadant att antingen nar namnda sensordata pavisar ett lagaktivt tillstand hos anvandaren sa justerar styrenheten (120) den audiella utdatan att passa ett lagaktivt tillstand och/eller nar namnda sensordata pavisar ett hogaktivt tillstand hos anvandaren sa justerar styrenheten (120) den audiella utdatan att passa ett hOgaktivt tillstand, varvid justering av audiell utdata innefattar nagot eller en kombination av ett eller flera av foljande f6rfaranden: stoppa/pausa/spela, Oka/minska volym, styra audiell utdata baserat pa slag per minut (BPM), takt, rytm, styra audiell utdata baserat pa 2 forbestannt val, genre, fordefinierat urval sasom en spellista eller sarskilt spar. 2. Florlurar (1) enligt krav 1, varvid bestamning av tillstandet hos en anvandare inkluderar att bestamma om anvandaren sover eller är vaken. 3. Florlurar (1) enligt krav 1 eller 2, varvid bestamning av tillstandet hos en anvandare inkluderar att bestamma om anvandaren vilar eller tranar. 4. HOrlurar (1) enligt nagot av fOregaende krav, varvid pulsratdetektorn är en IR-sensor konfigurerad att avkanna blodflode has anvandaren. 5. Florlurar (1) enligt nagot av foregaende krav, varvid justering av audiell utdata till namnda hogtalarelement (24) inkluderar att justera volymen hos den audiella utdatan. 6. Florlurar (1) enligt nagot av foregaende krav, vilka vidare innefattar en fjarrkontrollenhet (12) innefattande namnda styrenhet (120) och en andra accelerometer, varvid namnda fjarrkontrollenhet (12) är anordnad pa ett avstand frail ett lurelennent (2) has nannnda horlurar (1). 7. Florlurar (1) enligt nagot av foregaende krav, varvid pulsratdetektorn är aktiv i perioder och inaktiv i perioder for att spara energi. 8. Metod for att justera audiell utdata fran en media spelare (13) med hjalp av horlurar, varvid horlurarna innefattar: - ett hogtalarelement (24) for omvandlig av en audiell utdata till ljudvagor, -en styrenhet (120), -en fOrsta rOrelsesensor (25), och 3 1. en pulsratdetektor, varvid namnda rorelsesensor är en accelerometer anpassad att avkanna rorelser hos anvandaren, varvid metoden innefattar stegen - att avkanna (201) rorelser hos en anvandare med hjalp av den forsta rorelsesensorn, 2. att avkanna (202) en pulsrat med hjalp av pulsratdetektorn, 3. att overfora (203) sensordata Than namnda forsta rorelsesensor och namnda pulsratdetektor till namnda styrenhet, - att bestamma (204) ett tillstand hos anvandaren med hjalp av styrenheten baserat pa namnda sensordata, och 4. att justera (205) den audiella utdatan som skickas fran mediaspelaren (13) till hogtalarelementet, baserat pa det bestamda tillstandet hos anvandaren for att anpassa den audiella utdatan till aktiviteten som utfors av anvandaren sadant att ant ingen nar sensordatat pavisar ett lagaktivt tillstand hos anvandaren sa justerar styrenheten den audiella utdatan att passa ett lagaktivt tillstand och/eller nar sensordatat pavisar ett hogaktivt tillstand hos anvandaren sa justerar styrenheten den audiella utdatan att passa ett hogaktivt tillstand, varvid justering i audiell utdata innefattar nagot eller en kombination av en eller flera av foljande forfaranden: stoppa/pausa/spela, oka/nninska volynn, styra audiell utdata baserat pa slag per minut (BPM), takt, rytm, styra audiell utdata baserat pa forbestamt val, genre, fordefinierat urval sasom en spellista eller sarskilt spar. 9. Datorprogramprodukt innefattande ett datorlasbart medium som darpa har lagrat ett datorprogrammedel for att orsaka en styrenhet (120) att justera den audiella utdatan tan en mediaspelare (13) till horlurar, varvid horlurarna innefattar ett hogtalarelement (24) for att omvandla audiell utdata till ljudvagor, en styrenhet, en forsta rorelsesensor, och en pulsratdetektor, varvid namnda fOrsta rOrelsedetektor är en accelerometer anpassad att 4 avkanna rorelser hor anvandaren, varvid datorprogramprodukten innefattar:

1. kod for att avkanna (201) rorelser hos en anvandare med hjalp av den forsta rorelsesensorn. - kod for att avkanna (202) en pulsrat med hjalp av pulsratdetektorn,

2. kod for att overfora (203) sensordata tan namnda forsta rorelsesensor och namnda pulsratdetektor till namnda styrenhet,

3. kod for att bestamma (204) ett tillstand hos anvandaren med hjalp av styrenheten, baserat pa namnda sensordata, och - kod for att justera (205) den audiella utdatan som skickas Than mediaspelaren (13) till hogtalarelementet, baserat pa det bestamda tillstandet hos anvandaren fOr att anpassa den audiella utdatan till aktiviteten som utfors av anvandaren saciant att antingen nar sensordatat pavisar ett lagaktivt tillstand hos anvandaren sa justerar styrenheten den audiella utdatan att passa ett lagaktivt tillstand och/eller nar sensordatat pavisar ett hogaktivt tillstand hos anvandaren sá justerar styrenheten den audiella utdatan att passa ett hogaktivt tillstand, varvid justering i audiell utdata innefattar nagot eller en kombination av en eller flera av foljande forfaranden: stoppa/pausa/spela, oka/minska volym, styra audiell utdata baserat pa slag per nninut (BPM), takt, rytnn, styra audiell utdata baserat pa forbestamt val, genre, fordefinierat urval sasom en spellista eller sarskilt spar. 1 / 6 kl) 10.1 2 / 6 -,.., 44:''/ /.........-- ....---' ,--4 r .t, i., !..,:i /; ...' ----------- ----- / \ / '3 , ----------- -------;I / _.,.. Lc) 3/6 (3) 9 '2!d ET 6 - L I L 'S! d Energy Harvesting Boost Converter Energy Storage :ti on 31 Power :Contro NACU BLE 12C 28 Tot ans 123