EP3499910B1 - Device and method for detecting removal of an in-the-ear headphone from a user's ear - Google Patents

Device and method for detecting removal of an in-the-ear headphone from a user's ear Download PDF

Info

Publication number
EP3499910B1
EP3499910B1 EP17207463.5A EP17207463A EP3499910B1 EP 3499910 B1 EP3499910 B1 EP 3499910B1 EP 17207463 A EP17207463 A EP 17207463A EP 3499910 B1 EP3499910 B1 EP 3499910B1
Authority
EP
European Patent Office
Prior art keywords
ear
capacitance
fitting headphone
user
headphone
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP17207463.5A
Other languages
German (de)
French (fr)
Other versions
EP3499910A1 (en
Inventor
Baran ÇUBUKÇU
Mustafa Caner ÖZBAY
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vestel Elektronik Sanayi ve Ticaret AS
Original Assignee
Vestel Elektronik Sanayi ve Ticaret AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vestel Elektronik Sanayi ve Ticaret AS filed Critical Vestel Elektronik Sanayi ve Ticaret AS
Priority to EP17207463.5A priority Critical patent/EP3499910B1/en
Priority to TR2017/22638A priority patent/TR201722638A2/en
Publication of EP3499910A1 publication Critical patent/EP3499910A1/en
Application granted granted Critical
Publication of EP3499910B1 publication Critical patent/EP3499910B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1016Earpieces of the intra-aural type
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2420/00Details of connection covered by H04R, not provided for in its groups
    • H04R2420/07Applications of wireless loudspeakers or wireless microphones

Definitions

  • the present disclosure relates to a device and method for detecting an ear-fitting headphone being removed from an ear of a user wearing the ear-fitting headphone.
  • Ear-fitting headphones also known as earbuds, earphones or in-ear headphones
  • Ear-fitting headphones are known to fall out of a wearer's ear from time to time.
  • ear-fitting headphones are particularly susceptible to fall out of the wearer's ear(s) when exercising, dancing, or in crowded places where they may be accidently knocked out of the ear by another person.
  • Another cause of ear-fitting headphones being accidentally removed from a wearer's ear is when the wearer has fallen asleep whilst using the ear-fitting headphone.
  • the problem is particularly undesirable when wearing wireless headphones as a single ear-fitting headphone is neither attached to the other headphone or to a user device that provides the audio, such as a mobile phone or music player. This can result in the wearer losing the ear-fitting headphone.
  • WO2012/167234A1 discloses an earphones system that provides insert detection that operates by sensing changes in capacitance, and a hearing aid system that also provides insert detection that operates by sensing changes in capacitance.
  • the hearing aid system is operative to send insert detection information to an external device such as a computer or mobile phone.
  • the external device is configured to generate an alarm or other notification alerting a user that the hearing aid has come out the ear.
  • WO2010/046504A2 discloses a method for monitoring a link between a hearing device and at least one further device and indicating an interruption of the link to a user of the hearing device.
  • EP3151584A2 discloses an earbud that includes a housing having an ear portion and a stem portion, the housing comprising a driver assembly positioned within the housing forming a front volume in front of the driver and a back volume behind the driver.
  • An acoustic insert is positioned behind the driver assembly and attached to an interior surface of the housing such that it forms a bass channel that is routed from the back volume to a vent in the housing, the vent being part of a multiport vent.
  • a method of detecting an ear-fitting headphone being removed from an ear of a user wearing the ear-fitting headphone comprising: determining that a capacitance of a capacitive sensor of the ear-fitting headphone has changed; characterised by: if it is determined that the capacitance of the capacitive sensor has changed over a first time period by an amount greater than a first threshold, notifying the user that the ear-fitting headphone has been removed from the ear, wherein determining that the capacitance of the capacitive sensor of the ear-fitting headphone has changed comprises determining an amount of change in capacitance of the capacitive sensor relative to a capacitance of a capacitance sensor of a second ear-fitting headphone in the user's other ear.
  • determining that the capacitance of the capacitive sensor of the ear-fitting headphone has changed comprises determining an amount of change in capacitance of the capacitive sensor from one time instant to another time instant.
  • the method comprises: determining that a capacitance of a second capacitive sensor of the ear-fitting headphone has changed; and if it is determined that the capacitance of the second capacitive sensor has changed over a second time period by an amount less than a second threshold, notifying the user that the ear-fitting headphone has been removed from the ear.
  • determining that the capacitance of the second capacitive sensor of the ear-fitting headphone has changed comprises determining an amount of change in capacitance of the second capacitive sensor from one time instant to another time instant.
  • the method comprises notifying the user that the ear-fitting headphone that has been removed from the ear is a left-hand ear-fitting headphone or a right-hand ear-fitting headphone.
  • notifying the user that the ear-fitting headphone has been removed from the ear comprises displaying a notification on a user device connected to the ear-fitting headphone.
  • notifying the user that the headphone has been removed from the ear comprises playing out a notification through the ear-fitting headphone that has been removed.
  • notifying the user that the ear-fitting headphone has been removed from the ear comprises playing out a notification through an ear-fitting headphone that has not been removed from the wearer's ear.
  • a computer program comprising instructions such that when the computer program is executed on the user device, the user device is arranged to carry out a method as described above.
  • a user device constructed and arranged to detect an ear-fitting headphone being removed from an ear of a user wearing the ear-fitting headphone, the user device being configured to: determine whether a capacitance of a capacitive sensor of the ear-fitting headphone has changed, characterised in that the user device is configured to: transmit an audio signal to the ear-fitting headphone for playback of the audio by the ear-fitting headphone; determine that the capacitance of the capacitive sensor of the ear-fitting headphone has changed by determining an amount of change in capacitance of the capacitive sensor relative to a capacitance of a capacitive sensor of a second ear-fitting headphone in the user's other ear; and cause a notification to be presented to notify the user that the ear-fitting headphone has been removed from the ear if it is determined that the capacitance of the capacitive sensor has changed over a first time period by an amount greater than
  • the user device is configured to determine whether a capacitance of a capacitive sensor of the ear-fitting headphone has changed by determining an amount of change in capacitance of the capacitive sensor from one time instant to another time instant.
  • the user device is configured to: determine whether a capacitance of a second capacitive sensor of the ear-fitting headphone has changed; and cause a notification to be presented to the user to notify the user that the ear-fitting headphone has been removed from the ear if it is determined that the capacitance of the second capacitive sensor has changed over a second time period by an amount less than a second threshold.
  • the user device is configured to notify the user that the ear-fitting headphone that has been removed from the ear is a left-hand ear-fitting headphone or a right-hand ear-fitting headphone.
  • the user device is configured to receive a notification notifying the user that the ear-fitting headphone has been removed from the ear.
  • the user device is the ear-fitting headphone and is configured to cause a notification to be presented by a second user device to notify the user that the ear-fitting headphone has been removed from the ear.
  • a user device as described above, the user device being configured to receive information associated with the capacitance of the capacitive sensor of the ear-fitting headphone; and use the received information to determine whether the capacitance of the capacitive sensor of the ear-fitting headphone has changed.
  • an ear-fitting headphone constructed and arranged to detect if the ear-fitting headphone has been removed from an ear of a user wearing the ear-fitting headphone, the ear-fitting headphone comprising: a capacitive sensor configured to detect a change in capacitance of the capacitive sensor, wherein the ear-fitting headphone is configured to:
  • system comprising: i) a user device constructed and arranged to detect an ear-fitting headphone being removed from an ear of a user wearing the ear-fitting headphone, the user device being configured to: transmit an audio signal to the ear-fitting headphone for playback of the audio by the ear-fitting headphone; determine whether a capacitance of a capacitive sensor of the ear-fitting headphone has changed; determine that the capacitance of the capacitive sensor of the ear-fitting headphone has changed by determining an amount of change in capacitance of the capacitive sensor relative to a capacitance of a capacitive sensor of a second ear-fitting headphone in the user's other ear; and cause a notification to be presented to notify the user that the ear-fitting headphone has been removed from the ear if it is determined that the capacitance of the capacitive sensor has changed over a first time period by an amount greater than a first threshold, and
  • Figure 1 shows schematically an example of a pair of ear-fitting headphones connected to a user device.
  • headphone as used herein is used as a generic term for a small loudspeaker driver worn on or around the head over a user's ear or directly within the user's ear.
  • headphone covers on the one hand, “circumaural headphones” and “supra-aural headphones”, and on the other hand, “ear-fitting” headphones.
  • circumaural and “supra-aural” headphones are used herein to mean headphones that use a band over the top of or around the side of the user's head to hold the loudspeakers in place.
  • Ear-fitting headphone is used herein to mean a headphone that does not use a band to hold the loudspeakers in place.
  • Ear-fitting headphones as used herein are individual loudspeakers that are connected by a wire or by a wireless connection to each other and/or a user device.
  • Ear-fitting headphones as used herein include “earphones” and “earbuds”.
  • earphones (or “in-ear headphones”) is used herein to mean headphones that are inserted directly into the ear canal.
  • earbuds is used herein to mean headphones that are placed into the (outer) ear and rest outside of the ear canal, typically being held in place by the concha ridge at the centre of the outer ear.
  • Ear-fitting headphones including in-ear headphones, earbuds, earphones, etc. are often small and discreet. Ear-fitting headphones can be connected to an audio source device over a wired or wireless connection. Due to their small nature, and for wireless ear-fitting headphones in particular, such headphones are likely to become lost if they are accidentally removed from a wearer's ear(s) without the wearer noticing. The likelihood of the user not realising that an ear-fitting headphone has been accidentally removed from their ear is increased if the headphone is not outputting sound at the time the ear-fitting headphone is removed. In that situation, there is no change from sound being played out to the ear to sound not being played out to the ear for the user to notice.
  • Examples described herein notify the wearer when an ear-fitting headphone is removed from the ear, which helps to prevent the loss of an ear-fitting headphone.
  • the wearer will of course deliberately remove an ear-fitting headphone from his/her ear during use. Informing the wearer each and every time an ear-fitting headphone is removed from the ear may cause annoyance to the wearer. Some examples described herein help to avoid informing the wearer of the removable of an ear-fitting headphone when the removal is intentional or likely to have been intentional.
  • FIG. 1 shows schematically an example of a first ear-fitting headphone 100 and a second ear-fitting headphone 100 (collectively a pair of ear-fitting headphones 100) connected to a user device 102.
  • Each headphone 100 may be any type of ear-fitting headphone that can be placed in a user's (outer) ear.
  • each ear-fitting headphone 100 may be an earbud that sits directly outside the user's ear canal.
  • each headphone 100 may be an earphone that is placed directly into the user's ear canal.
  • Each ear-fitting headphone 100 has a loudspeaker or other driver 104 for outputting sound to the user.
  • the ear-fitting headphone 100 also has at least one capacitive sensor 106.
  • the ear-fitting headphone 100 to the left has two capacitive sensors 106 and the second ear-fitting headphone 100 to the right 100 has a single capacitive sensor 106.
  • the capacitive sensor(s) 106 may generate an electric field and detect nearby objects by sensing whether the field has been disrupted.
  • the capacitive sensor 106 may have two "plates" and detect an object that is conductive or that has a different dielectric property from air, like a human ear or finger. That is, a change in capacitance occurs when an object interacts with the material between the plates. The object does not have to intrude into the capacitive sensor 106 itself to cause a change in capacitance since the capacitive sensor's electric field extends into the environment surrounding the capacitive sensor 106.
  • the capacitive sensor 106 may have a single plate. In that case, an object (such as a finger or ear) acts as a second plate. A change in capacitance of the capacitive sensor 106 will be caused when a finger or ear comes into contact with (or close proximity to) the capacitive sensor 106. Such an arrangement is common in capacitive touch sensors as used in for example many touch screen devices.
  • the capacitive sensor 106 may be made from a metal, including for example copper or indium tin oxide.
  • the capacitive sensor 106 may appear (relatively) transparent to the human eye.
  • the ear-fitting headphone 100 may optionally have additional capacitive sensors.
  • the ear-fitting headphone 100 may have two, three, four, or more capacitive sensors.
  • Each headphone 100 may be connected to a user device 102.
  • the user device 102 may be for example a media device such as a television set, a set top box, a DVD player, a Blu-Ray player, a personal computing device such as a laptop or desktop or tablet computer, a video game console, a cellular phone (including a so-called “smart phone”), a dedicated media player (e.g. an MP3 or similar player), a wearable communication device (including so-called “smart watches”), etc.
  • the ear-fitting headphone(s) 100 may each be (logically and optionally physically) connected to the user device 102 over a wired or wireless connection.
  • only one ear-fitting headphone 100 is (logically and optionally physically) connected to the user device 102, with the other ear-fitting headphone 100 being (logically and optionally physically) connected to the first ear-fitting headphone 100 which is connected to the user device 102.
  • the user device 102 has a controller 108, such as a processor, operatively coupled to a user interface 110 of the user device 102.
  • the user interface 110 may be for example a display in the form of a screen for receiving inputs from the user.
  • the user interface 110 may comprise a touch screen, or a point-and-click user interface 110 comprising a mouse, track pad, or tracker ball or the like.
  • the user interface 110 is configured to present information to a user of the user device 102.
  • the controller 108 is also operatively coupled to a wireless transceiver 112 for communicating via any suitable wireless medium, e.g. a radio transceiver for communicating via a radio channel (though other forms are not excluded, e.g. an infrared transceiver).
  • the wireless transceiver 112 may comprise a Wi-Fi, Bluetooth, etc. interface for enabling the user device 102 to communicate wirelessly with a different user device 102. Additionally or alternatively, the wireless transceiver 112 may communicate with a different user device 102 via a wireless router or a server (not shown), for example, over a local area network such as a WLAN or a wide area network such as the internet.
  • the user device 102 has an interface for connecting to the headphones 100. There may be a wired interface and/or a wireless interface for connecting to the headphones 100. Examples described herein are particularly useful in the case that the headphones 100 connect wirelessly to the user device 102.
  • the or each ear-fitting headphone 100 transmits a signal representative of the capacitance of the capacitive sensor 106 to the user device 102.
  • the user device 102 (specifically the controller 108) determines that there has been a change in capacitance of the capacitive sensor 106.
  • the user device 102 then causes a notification to be presented at the user device 102 (e.g. a visible a notification displayed on a display screen and/or an audible a notification played out through a loudspeaker).
  • the user device 102 may also transmit an audible notification to be played out through the first ear-fitting headphone 100 and/or the second ear-fitting headphone 100.
  • the ear-fitting headphone 100 may itself determine that there has been a change in capacitance of the capacitive sensor 106.
  • the ear-fitting headphone 100 may also transmit a notification to the user device 102 to be presented at the user device 102.
  • the ear-fitting headphone 100 may cause the notification to be played out of either ear-fitting headphone 100.
  • an ear-fitting headphone 100 is detected as being removed from an ear of a user.
  • a change in capacitance of a capacitive sensor 106 of the ear-fitting headphone 100 may be determined. The change may be, for example, due to the ear-fitting headphone 100 no longer being in contact with the user's ear.. If the capacitance of the capacitive sensor 106 has changed over a time period by an amount greater than a threshold, the user is notified that the ear-fitting headphone 100 has been removed from the ear.
  • the capacitive sensor 106 when the ear-fitting headphone 100 is worn by the user, the capacitive sensor 106 will have a first capacitive value and, when the ear-fitting headphone 100 is removed from the ear, the capacitive sensor 106 will have a second capacitive value.
  • the change in capacitance of the capacitive sensor 106 may be caused by the change in the dielectric constant of the material between the plates of the capacitive sensor 106.
  • human skin has different dielectric characteristics from air. Therefore when the ear-fitting headphone 100 is in the ear of the user, the dielectric constant of the capacitive sensor 106 is influenced by human skin.
  • the dielectric constant of the capacitive sensor 106 When the ear-fitting headphone 100 is removed from the ear of the user, the dielectric constant of the capacitive sensor 106 is no longer influenced by human skin and therefore the capacitance of the capacitive sensor 106 will change.
  • the user may only be notified if the ear-fitting headphone 100 has been accidentally removed from the ear (that is, not deliberately by the user). For example, if within the time period, the user removes the ear-fitting headphone 100 from the ear (e.g. to readjust the position of the ear-fitting headphone 100 in the ear) but subsequently returns the ear-fitting headphone 100 to the ear, the capacitance of the capacitive sensor 106 will not have changed by an amount greater than a threshold.
  • the capacitance of the capacitive sensor 106 will not change by an amount greater than the threshold and therefore the user will needlessly not be notified that the ear-fitting headphone 100 has been removed from the ear.
  • the time period for determining if the change in capacitance of the capacitive sensor 106 breaches the threshold may be user defined.
  • the time period may be set to ensure the user has enough time to remove an ear-fitting headphone 100 from the ear and replace the ear-fitting headphone 100 in order to readjust the ear-fitting headphone's position.
  • the time period may also be set to ensure the user has enough time to return the ear-fitting headphone 100 to the ear upon realising that the ear-fitting headphone 100 has been accidentally removed from the ear.
  • the time period may be a few seconds, such as in the range of three to five or ten seconds or so.
  • the threshold may be set (e.g. by the user or the manufacturer) such that a change in capacitance due to the capacitive sensor 106 going from being in contact with human skin to air will change by an amount greater than the threshold.
  • the capacitive sensor 106 may be placed on the side of the ear-fitting headphone 100 that faces the user when the ear-fitting headphone 100 is worn by the user.
  • An advantage of the capacitive sensor 106 being on the inner side of the ear-fitting headphone 100 is that it increases the likelihood of a change in capacitance when the ear-fitting headphone 100 is removed from the ear, e.g. due to the change in contact with skin to air. That is, it is more likely that the capacitive sensor 106 is in contact with user's the ear during use.
  • the change when looking for a change in capacitance of the capacitive sensor 106, the change may be determined by comparing the capacitance at different times, i.e. from one time instant to another. That is, the capacitance of the capacitive sensor 106 at the first time instant (e.g. at the start of the time period) is compared to the capacitance of the capacitive sensor 106 at the second time instant (e.g. at the end of the time period). The user will be notified that the ear-fitting headphone has fallen out of the ear if the difference in capacitance between the two time instants is greater than the threshold.
  • the ear-fitting headphone 100 may be in the user's ear (with a capacitance value determined at least in part by human skin) and at another time instant the ear-fitting headphone 100 may have fallen to the ground (with a capacitance value at least in part determined by air).
  • the change is determined by comparing the capacitance of the capacitive sensor 106 with a capacitance of a capacitance sensor 106 of a second ear-fitting headphone 100 in the user's other ear. If the two ear-fitting headphones are in the user's ears, their capacitance values would be similar (or within a small threshold of each other). If the first ear-fitting headphone 100 is removed from the user's ear, the capacitance of the ear-fitting headphone 100 will differ from that that of the second ear-fitting headphone 106.
  • the (inner) capacitive sensor 106 will come into contact with (or very close proximity to) the user's skin.
  • the capacitance of the two ear-fitting headphones 100 will be similar.
  • the capacitance will change from the initial value due to no longer being in contact with the user's skin. The user is therefore notified that the ear-fitting headphone 100 has been removed.
  • An advantage of this is that the change in capacitance will only be greater than the threshold if something happens to one ear-fitting headphone 100 but not the other. Therefore the user will not be unnecessarily notified if they intentionally take both headphones 100 out of their ear.
  • the ear-fitting headphone(s) 100 may have a second capacitive sensor 106.
  • the second capacitive sensor 106 may be placed on the side of the ear-fitting headphone 100 that faces away from the user when the ear-fitting headphone 100 is worn by the user.
  • the second capacitive sensor 106 may be on the opposite side of the ear-fitting headphone 100 compared to the (first) capacitive sensor 106.
  • the second capacitive sensor 106 may be on either side of the ear-fitting headphone 100, i.e. between the inner and outer facing sides of the ear-fitting headphone 100.
  • Some examples may include determining a change in capacitance of the second capacitive sensor 106 of the ear-fitting headphone 100. Rather than notifying the user if the change in capacitance is greater than a threshold, the user will only be notified if the change in capacitance is less than a threshold.
  • An option for determining the change in capacitance may involve comparing the capacitance of the second capacitive sensor 106 at one time instance and another time instance. For example, when the ear-fitting headphone 100 is in use in the wearer's ear, the capacitance of the second capacitive sensor 106 will be influenced by air.
  • the capacitance of the second capacitive sensor 106 will still be influenced by air. That is, the change in capacitance over the time period will be relatively small or negligible, i.e. an amount less than a threshold. If the change is greater than the threshold due to, for example, a finger touching the capacitive sensor 106, the user will not be notified.
  • An advantage with this is that the user will not be notified if the user intentionally removes the ear-fitting headphone 100.
  • the user device 102 may display a notification on a display screen of the user interface 110. That is, the user interface 110 of the user device 102 is configured to present a textual or graphical notification to the user of the user device 102.
  • the notification may be transmitted from the ear-fitting headphone 100 or generated and presented directly at the user device 102.
  • the notification may be automatically displayed on the user device 102 in response to detecting that the ear-fitting headphone 100 has been removed.
  • An advantage of this is that the displayed notification will alert the user of the accidental removal of the ear-fitting headphone 100 without the need to pause or stop the second ear-fitting headphone 100 playing out the sound that it may have been playing out at the time of removal of the first ear-fitting headphone 100.
  • the user may be notified that the ear-fitting headphone 100 has been removed or fallen out by playing out a notification through the ear-fitting headphone 100 that has been removed.
  • the ear-fitting headphone 100 may emit a notification sound (e.g. an alarm) at a volume loud enough for the user to hear the sound when the ear-fitting headphone 100 is not in the user's ear.
  • the sound can also help the user to locate the removed ear-fitting headphone 100.
  • the user may be notified that the ear-fitting headphone 100 has been removed or fallen out by playing out a notification through the ear-fitting headphone 100 that has not been removed, i.e. the second ear-fitting headphone 100 that is still in the user's ear 106.
  • the notification may be spoken words or an alarm or jingle indicative of an accidental removal of the other ear-fitting headphone 100.
  • the sound (e.g. a song) that was previously being played out of the ear-fitting headphone(s) 100 may be paused whilst the notification is being presented or until the ear-fitting headphone 100 has been inserted back into the user's ear.
  • the sound may also be paused until the user selects to continue playing the sound, e.g. via the user device 102.
  • An advantage of this is that the abrupt stoppage may serve to quickly alert the user that an ear-fitting headphone 100 has been accidentally removed.
  • the user is told which ear-fitting headphone 100 has been removed or fallen from the ear. That is, the notification displayed on the display screen or played out through either ear-fitting headphone 100 to the user may contain information indicating that the ear-fitting headphone 100 that has been removed is a left or right ear-fitting headphone.
  • the user device 102 determines whether a capacitance of a capacitive sensor 106 of the ear-fitting headphone 100 has changed. If the capacitance of the capacitive sensor 106 has changed over a time period by an amount greater than a threshold, the user device 102 causes a notification to be presented to the user. For example, the notification may be displayed on a display screen or played out through the (first) or second ear-fitting headphone 100.
  • controller 108 and its components as shown in Figure 1 are represented as a schematic block diagram for the purposes of explaining the functionality of the controller 108 only. Hence, it is understood that each component of the controller 108 is a functional block for performing the functionality ascribed to it herein. Each component may be implemented in hardware, software, firmware, or a combination thereof. Additionally, although described as separate components of the controller 108, some or all of the functionality may be performed by a single piece of hardware, software, or firmware.
  • processor or processing system or circuitry referred to herein may in practice be provided by a single chip or integrated circuit or plural chips or integrated circuits, optionally provided as a chipset, an application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), digital signal processor (DSP), graphics processing units (GPUs), etc.
  • the chip or chips may comprise circuitry (as well as possibly firmware) for embodying at least one or more of a data processor or processors, a digital signal processor or processors, baseband circuitry and radio frequency circuitry, which are configurable so as to operate in accordance with the exemplary embodiments.
  • the exemplary embodiments may be implemented at least in part by computer software stored in (non-transitory) memory and executable by the processor, or by hardware, or by a combination of tangibly stored software and hardware (and tangibly stored firmware).
  • the invention also extends to computer programs, particularly computer programs on or in a carrier, adapted for putting the invention into practice.
  • the program may be in the form of non-transitory source code, object code, a code intermediate source and object code such as in partially compiled form, or in any other non-transitory form suitable for use in the implementation of processes according to the invention.
  • the carrier may be any entity or device capable of carrying the program.
  • the carrier may comprise a storage medium, such as a solid-state drive (SSD) or other semiconductor-based RAM; a ROM, for example a CD ROM or a semiconductor ROM; a magnetic recording medium, for example a floppy disk or hard disk; optical memory devices in general; etc.
  • SSD solid-state drive
  • ROM read-only memory
  • magnetic recording medium for example a floppy disk or hard disk
  • optical memory devices in general etc.

Description

    Technical Field
  • The present disclosure relates to a device and method for detecting an ear-fitting headphone being removed from an ear of a user wearing the ear-fitting headphone.
  • Background
  • Ear-fitting headphones (also known as earbuds, earphones or in-ear headphones) are known to fall out of a wearer's ear from time to time. For example, ear-fitting headphones are particularly susceptible to fall out of the wearer's ear(s) when exercising, dancing, or in crowded places where they may be accidently knocked out of the ear by another person. Another cause of ear-fitting headphones being accidentally removed from a wearer's ear is when the wearer has fallen asleep whilst using the ear-fitting headphone. The problem is particularly undesirable when wearing wireless headphones as a single ear-fitting headphone is neither attached to the other headphone or to a user device that provides the audio, such as a mobile phone or music player. This can result in the wearer losing the ear-fitting headphone.
  • WO2012/167234A1 discloses an earphones system that provides insert detection that operates by sensing changes in capacitance, and a hearing aid system that also provides insert detection that operates by sensing changes in capacitance. The hearing aid system is operative to send insert detection information to an external device such as a computer or mobile phone. The external device is configured to generate an alarm or other notification alerting a user that the hearing aid has come out the ear.
  • WO2010/046504A2 discloses a method for monitoring a link between a hearing device and at least one further device and indicating an interruption of the link to a user of the hearing device.
  • EP3151584A2 discloses an earbud that includes a housing having an ear portion and a stem portion, the housing comprising a driver assembly positioned within the housing forming a front volume in front of the driver and a back volume behind the driver. An acoustic insert is positioned behind the driver assembly and attached to an interior surface of the housing such that it forms a bass channel that is routed from the back volume to a vent in the housing, the vent being part of a multiport vent.
  • Summary
  • According to a first aspect disclosed herein, there is provided a method of detecting an ear-fitting headphone being removed from an ear of a user wearing the ear-fitting headphone, the method comprising: determining that a capacitance of a capacitive sensor of the ear-fitting headphone has changed; characterised by: if it is determined that the capacitance of the capacitive sensor has changed over a first time period by an amount greater than a first threshold, notifying the user that the ear-fitting headphone has been removed from the ear, wherein determining that the capacitance of the capacitive sensor of the ear-fitting headphone has changed comprises determining an amount of change in capacitance of the capacitive sensor relative to a capacitance of a capacitance sensor of a second ear-fitting headphone in the user's other ear.
  • In an example, determining that the capacitance of the capacitive sensor of the ear-fitting headphone has changed comprises determining an amount of change in capacitance of the capacitive sensor from one time instant to another time instant.
  • In an example, the method comprises: determining that a capacitance of a second capacitive sensor of the ear-fitting headphone has changed; and if it is determined that the capacitance of the second capacitive sensor has changed over a second time period by an amount less than a second threshold, notifying the user that the ear-fitting headphone has been removed from the ear.
  • In an example, determining that the capacitance of the second capacitive sensor of the ear-fitting headphone has changed comprises determining an amount of change in capacitance of the second capacitive sensor from one time instant to another time instant.
  • In an example, the method comprises notifying the user that the ear-fitting headphone that has been removed from the ear is a left-hand ear-fitting headphone or a right-hand ear-fitting headphone.
  • In an example, notifying the user that the ear-fitting headphone has been removed from the ear comprises displaying a notification on a user device connected to the ear-fitting headphone.
  • In an example, notifying the user that the headphone has been removed from the ear comprises playing out a notification through the ear-fitting headphone that has been removed.
  • In an example, notifying the user that the ear-fitting headphone has been removed from the ear comprises playing out a notification through an ear-fitting headphone that has not been removed from the wearer's ear.
  • According to a second aspect disclosed herein, there is provided a computer program comprising instructions such that when the computer program is executed on the user device, the user device is arranged to carry out a method as described above.
  • According to a third aspect disclosed herein, there is provided a user device constructed and arranged to detect an ear-fitting headphone being removed from an ear of a user wearing the ear-fitting headphone, the user device being configured to: determine whether a capacitance of a capacitive sensor of the ear-fitting headphone has changed, characterised in that the user device is configured to: transmit an audio signal to the ear-fitting headphone for playback of the audio by the ear-fitting headphone; determine that the capacitance of the capacitive sensor of the ear-fitting headphone has changed by determining an amount of change in capacitance of the capacitive sensor relative to a capacitance of a capacitive sensor of a second ear-fitting headphone in the user's other ear; and cause a notification to be presented to notify the user that the ear-fitting headphone has been removed from the ear if it is determined that the capacitance of the capacitive sensor has changed over a first time period by an amount greater than a first threshold.
  • In an example, the user device is configured to determine whether a capacitance of a capacitive sensor of the ear-fitting headphone has changed by determining an amount of change in capacitance of the capacitive sensor from one time instant to another time instant.
  • In an example, the user device is configured to: determine whether a capacitance of a second capacitive sensor of the ear-fitting headphone has changed; and cause a notification to be presented to the user to notify the user that the ear-fitting headphone has been removed from the ear if it is determined that the capacitance of the second capacitive sensor has changed over a second time period by an amount less than a second threshold.
  • In an example, the user device is configured to notify the user that the ear-fitting headphone that has been removed from the ear is a left-hand ear-fitting headphone or a right-hand ear-fitting headphone.
  • In an example, wherein the user device is connected to the ear-fitting headphone over a wireless connection, the user device is configured to receive a notification notifying the user that the ear-fitting headphone has been removed from the ear.
  • In an example, the user device is the ear-fitting headphone and is configured to cause a notification to be presented by a second user device to notify the user that the ear-fitting headphone has been removed from the ear.
  • There is also provided a user device as described above, the user device being configured to receive information associated with the capacitance of the capacitive sensor of the ear-fitting headphone; and use the received information to determine whether the capacitance of the capacitive sensor of the ear-fitting headphone has changed.
  • According to another aspect disclosed herein, there is provided an ear-fitting headphone constructed and arranged to detect if the ear-fitting headphone has been removed from an ear of a user wearing the ear-fitting headphone, the ear-fitting headphone comprising:
    a capacitive sensor configured to detect a change in capacitance of the capacitive sensor, wherein the ear-fitting headphone is configured to:
    • receive an audio signal from a user device for playback of the audio by the ear-fitting headphone;
    • determine that a capacitance of the capacitive sensor of the ear-fitting headphone has changed by determining an amount of change in capacitance of the capacitive sensor relative to a capacitance of a capacitive sensor of a second ear-fitting headphone in the user's other ear; and
    • cause a notification to be presented to a user to notify the user that the ear-fitting headphone has been removed from the ear if the determined change in capacitance of the capacitive sensor over a time period is greater than a threshold.
  • According to another aspect disclosed herein, there is provided system comprising: i) a user device constructed and arranged to detect an ear-fitting headphone being removed from an ear of a user wearing the ear-fitting headphone, the user device being configured to: transmit an audio signal to the ear-fitting headphone for playback of the audio by the ear-fitting headphone; determine whether a capacitance of a capacitive sensor of the ear-fitting headphone has changed; determine that the capacitance of the capacitive sensor of the ear-fitting headphone has changed by determining an amount of change in capacitance of the capacitive sensor relative to a capacitance of a capacitive sensor of a second ear-fitting headphone in the user's other ear; and cause a notification to be presented to notify the user that the ear-fitting headphone has been removed from the ear if it is determined that the capacitance of the capacitive sensor has changed over a first time period by an amount greater than a first threshold, and ii) an ear-fitting headphone comprising a capacitance sensor,
    wherein the user device is configured to transmit the notification to the ear-fitting headphone as an audible notification to be played out by the ear-fitting headphone, wherein the ear-fitting headphone is configured to: transmit information associated with a capacitance of the capacitance sensor of the ear-fitting headphone to the user device; receive from the user device the audible notification; and play out the audible notification through the ear-fitting headphone.
  • Brief Description of the Drawings
  • To assist understanding of the present disclosure and to show how embodiments may be put into effect, reference is made by way of example to the accompanying drawings in which:
    Figure 1 shows schematically an example of a pair of ear-fitting headphones connected to a user device.
  • Detailed Description
  • Whilst the terms are used somewhat inconsistently in the art, the following terms will be used herein to mean the following, unless the context requires otherwise.
  • The term "headphone" as used herein is used as a generic term for a small loudspeaker driver worn on or around the head over a user's ear or directly within the user's ear. The term headphone covers on the one hand, "circumaural headphones" and "supra-aural headphones", and on the other hand, "ear-fitting" headphones.
  • The terms "circumaural" and "supra-aural" headphones are used herein to mean headphones that use a band over the top of or around the side of the user's head to hold the loudspeakers in place.
  • The term "ear-fitting headphone" is used herein to mean a headphone that does not use a band to hold the loudspeakers in place. Ear-fitting headphones as used herein are individual loudspeakers that are connected by a wire or by a wireless connection to each other and/or a user device. Ear-fitting headphones as used herein include "earphones" and "earbuds".
  • The term "earphones" (or "in-ear headphones") is used herein to mean headphones that are inserted directly into the ear canal. The term "earbuds" is used herein to mean headphones that are placed into the (outer) ear and rest outside of the ear canal, typically being held in place by the concha ridge at the centre of the outer ear.
  • Ear-fitting headphones, including in-ear headphones, earbuds, earphones, etc. are often small and discreet. Ear-fitting headphones can be connected to an audio source device over a wired or wireless connection. Due to their small nature, and for wireless ear-fitting headphones in particular, such headphones are likely to become lost if they are accidentally removed from a wearer's ear(s) without the wearer noticing. The likelihood of the user not realising that an ear-fitting headphone has been accidentally removed from their ear is increased if the headphone is not outputting sound at the time the ear-fitting headphone is removed. In that situation, there is no change from sound being played out to the ear to sound not being played out to the ear for the user to notice.
  • Examples described herein notify the wearer when an ear-fitting headphone is removed from the ear, which helps to prevent the loss of an ear-fitting headphone.
  • In addition, the wearer will of course deliberately remove an ear-fitting headphone from his/her ear during use. Informing the wearer each and every time an ear-fitting headphone is removed from the ear may cause annoyance to the wearer. Some examples described herein help to avoid informing the wearer of the removable of an ear-fitting headphone when the removal is intentional or likely to have been intentional.
  • Figure 1 shows schematically an example of a first ear-fitting headphone 100 and a second ear-fitting headphone 100 (collectively a pair of ear-fitting headphones 100) connected to a user device 102. Each headphone 100 may be any type of ear-fitting headphone that can be placed in a user's (outer) ear. For example, each ear-fitting headphone 100 may be an earbud that sits directly outside the user's ear canal. In another example, each headphone 100 may be an earphone that is placed directly into the user's ear canal. Each ear-fitting headphone 100 has a loudspeaker or other driver 104 for outputting sound to the user. The ear-fitting headphone 100 also has at least one capacitive sensor 106. In Figure 1, the ear-fitting headphone 100 to the left has two capacitive sensors 106 and the second ear-fitting headphone 100 to the right 100 has a single capacitive sensor 106.
  • The capacitive sensor(s) 106 may generate an electric field and detect nearby objects by sensing whether the field has been disrupted.
  • For example, the capacitive sensor 106 may have two "plates" and detect an object that is conductive or that has a different dielectric property from air, like a human ear or finger. That is, a change in capacitance occurs when an object interacts with the material between the plates. The object does not have to intrude into the capacitive sensor 106 itself to cause a change in capacitance since the capacitive sensor's electric field extends into the environment surrounding the capacitive sensor 106.
  • Alternatively, the capacitive sensor 106 may have a single plate. In that case, an object (such as a finger or ear) acts as a second plate. A change in capacitance of the capacitive sensor 106 will be caused when a finger or ear comes into contact with (or close proximity to) the capacitive sensor 106. Such an arrangement is common in capacitive touch sensors as used in for example many touch screen devices.
  • The capacitive sensor 106 may be made from a metal, including for example copper or indium tin oxide. The capacitive sensor 106 may appear (relatively) transparent to the human eye. The ear-fitting headphone 100 may optionally have additional capacitive sensors. For example, the ear-fitting headphone 100 may have two, three, four, or more capacitive sensors.
  • Each headphone 100 may be connected to a user device 102. The user device 102 may be for example a media device such as a television set, a set top box, a DVD player, a Blu-Ray player, a personal computing device such as a laptop or desktop or tablet computer, a video game console, a cellular phone (including a so-called "smart phone"), a dedicated media player (e.g. an MP3 or similar player), a wearable communication device (including so-called "smart watches"), etc. The ear-fitting headphone(s) 100 may each be (logically and optionally physically) connected to the user device 102 over a wired or wireless connection. In other examples, only one ear-fitting headphone 100 is (logically and optionally physically) connected to the user device 102, with the other ear-fitting headphone 100 being (logically and optionally physically) connected to the first ear-fitting headphone 100 which is connected to the user device 102.
  • The user device 102 has a controller 108, such as a processor, operatively coupled to a user interface 110 of the user device 102. The user interface 110 may be for example a display in the form of a screen for receiving inputs from the user. For example, the user interface 110 may comprise a touch screen, or a point-and-click user interface 110 comprising a mouse, track pad, or tracker ball or the like. The user interface 110 is configured to present information to a user of the user device 102.
  • The controller 108 is also operatively coupled to a wireless transceiver 112 for communicating via any suitable wireless medium, e.g. a radio transceiver for communicating via a radio channel (though other forms are not excluded, e.g. an infrared transceiver). The wireless transceiver 112 may comprise a Wi-Fi, Bluetooth, etc. interface for enabling the user device 102 to communicate wirelessly with a different user device 102. Additionally or alternatively, the wireless transceiver 112 may communicate with a different user device 102 via a wireless router or a server (not shown), for example, over a local area network such as a WLAN or a wide area network such as the internet.
  • The user device 102 has an interface for connecting to the headphones 100. There may be a wired interface and/or a wireless interface for connecting to the headphones 100. Examples described herein are particularly useful in the case that the headphones 100 connect wirelessly to the user device 102.
  • In one configuration, the or each ear-fitting headphone 100 transmits a signal representative of the capacitance of the capacitive sensor 106 to the user device 102. The user device 102 (specifically the controller 108) determines that there has been a change in capacitance of the capacitive sensor 106. The user device 102 then causes a notification to be presented at the user device 102 (e.g. a visible a notification displayed on a display screen and/or an audible a notification played out through a loudspeaker). The user device 102 may also transmit an audible notification to be played out through the first ear-fitting headphone 100 and/or the second ear-fitting headphone 100.
  • In an alternative configuration, the ear-fitting headphone 100 may itself determine that there has been a change in capacitance of the capacitive sensor 106. The ear-fitting headphone 100 may also transmit a notification to the user device 102 to be presented at the user device 102. Alternatively or additionally, the ear-fitting headphone 100 may cause the notification to be played out of either ear-fitting headphone 100.
  • In examples described herein, an ear-fitting headphone 100 is detected as being removed from an ear of a user. A change in capacitance of a capacitive sensor 106 of the ear-fitting headphone 100 may be determined. The change may be, for example, due to the ear-fitting headphone 100 no longer being in contact with the user's ear.. If the capacitance of the capacitive sensor 106 has changed over a time period by an amount greater than a threshold, the user is notified that the ear-fitting headphone 100 has been removed from the ear. That is, when the ear-fitting headphone 100 is worn by the user, the capacitive sensor 106 will have a first capacitive value and, when the ear-fitting headphone 100 is removed from the ear, the capacitive sensor 106 will have a second capacitive value. The change in capacitance of the capacitive sensor 106 may be caused by the change in the dielectric constant of the material between the plates of the capacitive sensor 106. For example, human skin has different dielectric characteristics from air. Therefore when the ear-fitting headphone 100 is in the ear of the user, the dielectric constant of the capacitive sensor 106 is influenced by human skin. When the ear-fitting headphone 100 is removed from the ear of the user, the dielectric constant of the capacitive sensor 106 is no longer influenced by human skin and therefore the capacitance of the capacitive sensor 106 will change.
  • By determining if the capacitance of the capacitive sensor 106 has changed over a time period by an amount greater than a threshold, the user may only be notified if the ear-fitting headphone 100 has been accidentally removed from the ear (that is, not deliberately by the user). For example, if within the time period, the user removes the ear-fitting headphone 100 from the ear (e.g. to readjust the position of the ear-fitting headphone 100 in the ear) but subsequently returns the ear-fitting headphone 100 to the ear, the capacitance of the capacitive sensor 106 will not have changed by an amount greater than a threshold.
  • Similarly, if the user touches the capacitive sensor 106 with their finger, for example, the capacitance of the capacitive sensor 106 will not change by an amount greater than the threshold and therefore the user will needlessly not be notified that the ear-fitting headphone 100 has been removed from the ear.
  • The time period for determining if the change in capacitance of the capacitive sensor 106 breaches the threshold may be user defined. For example, the time period may be set to ensure the user has enough time to remove an ear-fitting headphone 100 from the ear and replace the ear-fitting headphone 100 in order to readjust the ear-fitting headphone's position. The time period may also be set to ensure the user has enough time to return the ear-fitting headphone 100 to the ear upon realising that the ear-fitting headphone 100 has been accidentally removed from the ear. For example, the time period may be a few seconds, such as in the range of three to five or ten seconds or so.
  • In some examples, the threshold may be set (e.g. by the user or the manufacturer) such that a change in capacitance due to the capacitive sensor 106 going from being in contact with human skin to air will change by an amount greater than the threshold. An advantage of this is that the user will not be notified if there is a small change in capacitance not caused by an air to skin difference. This threshold may be changed at a later time, e.g. via the user device 102.
  • The capacitive sensor 106 may be placed on the side of the ear-fitting headphone 100 that faces the user when the ear-fitting headphone 100 is worn by the user. An advantage of the capacitive sensor 106 being on the inner side of the ear-fitting headphone 100 is that it increases the likelihood of a change in capacitance when the ear-fitting headphone 100 is removed from the ear, e.g. due to the change in contact with skin to air. That is, it is more likely that the capacitive sensor 106 is in contact with user's the ear during use.
  • As an option, when looking for a change in capacitance of the capacitive sensor 106, the change may be determined by comparing the capacitance at different times, i.e. from one time instant to another. That is, the capacitance of the capacitive sensor 106 at the first time instant (e.g. at the start of the time period) is compared to the capacitance of the capacitive sensor 106 at the second time instant (e.g. at the end of the time period). The user will be notified that the ear-fitting headphone has fallen out of the ear if the difference in capacitance between the two time instants is greater than the threshold. For example, at one time instant the ear-fitting headphone 100 may be in the user's ear (with a capacitance value determined at least in part by human skin) and at another time instant the ear-fitting headphone 100 may have fallen to the ground (with a capacitance value at least in part determined by air). An advantage of this is that the difference in capacitance at the two time instances will be relatively large and likely to breach the threshold.
  • According to the invention, when looking for a change in capacitance of the capacitive sensor 106, the change is determined by comparing the capacitance of the capacitive sensor 106 with a capacitance of a capacitance sensor 106 of a second ear-fitting headphone 100 in the user's other ear. If the two ear-fitting headphones are in the user's ears, their capacitance values would be similar (or within a small threshold of each other). If the first ear-fitting headphone 100 is removed from the user's ear, the capacitance of the ear-fitting headphone 100 will differ from that that of the second ear-fitting headphone 106. For example, when the ear-fitting headphones are placed in the user's ears, the (inner) capacitive sensor 106 will come into contact with (or very close proximity to) the user's skin. The capacitance of the two ear-fitting headphones 100 will be similar. When the first ear-fitting headphone 100 is removed from the ear, the capacitance will change from the initial value due to no longer being in contact with the user's skin. The user is therefore notified that the ear-fitting headphone 100 has been removed. An advantage of this is that the change in capacitance will only be greater than the threshold if something happens to one ear-fitting headphone 100 but not the other. Therefore the user will not be unnecessarily notified if they intentionally take both headphones 100 out of their ear.
  • As mentioned, the ear-fitting headphone(s) 100 may have a second capacitive sensor 106. For example, the second capacitive sensor 106 may be placed on the side of the ear-fitting headphone 100 that faces away from the user when the ear-fitting headphone 100 is worn by the user. In this example, the second capacitive sensor 106 may be on the opposite side of the ear-fitting headphone 100 compared to the (first) capacitive sensor 106. In other examples, the second capacitive sensor 106 may be on either side of the ear-fitting headphone 100, i.e. between the inner and outer facing sides of the ear-fitting headphone 100.
  • Some examples may include determining a change in capacitance of the second capacitive sensor 106 of the ear-fitting headphone 100. Rather than notifying the user if the change in capacitance is greater than a threshold, the user will only be notified if the change in capacitance is less than a threshold. An option for determining the change in capacitance may involve comparing the capacitance of the second capacitive sensor 106 at one time instance and another time instance. For example, when the ear-fitting headphone 100 is in use in the wearer's ear, the capacitance of the second capacitive sensor 106 will be influenced by air. When the ear-fitting headphone 100 is accidentally removed from the user's ear, the capacitance of the second capacitive sensor 106 will still be influenced by air. That is, the change in capacitance over the time period will be relatively small or negligible, i.e. an amount less than a threshold. If the change is greater than the threshold due to, for example, a finger touching the capacitive sensor 106, the user will not be notified. An advantage with this is that the user will not be notified if the user intentionally removes the ear-fitting headphone 100.
  • As an example of notifying the user of the removal of a headphone, the user device 102 may display a notification on a display screen of the user interface 110. That is, the user interface 110 of the user device 102 is configured to present a textual or graphical notification to the user of the user device 102. The notification may be transmitted from the ear-fitting headphone 100 or generated and presented directly at the user device 102. The notification may be automatically displayed on the user device 102 in response to detecting that the ear-fitting headphone 100 has been removed. An advantage of this is that the displayed notification will alert the user of the accidental removal of the ear-fitting headphone 100 without the need to pause or stop the second ear-fitting headphone 100 playing out the sound that it may have been playing out at the time of removal of the first ear-fitting headphone 100.
  • As an option, the user may be notified that the ear-fitting headphone 100 has been removed or fallen out by playing out a notification through the ear-fitting headphone 100 that has been removed. For example, the ear-fitting headphone 100 may emit a notification sound (e.g. an alarm) at a volume loud enough for the user to hear the sound when the ear-fitting headphone 100 is not in the user's ear. As well as informing the user of the headphone removal, the sound can also help the user to locate the removed ear-fitting headphone 100.
  • Alternatively or additionally, the user may be notified that the ear-fitting headphone 100 has been removed or fallen out by playing out a notification through the ear-fitting headphone 100 that has not been removed, i.e. the second ear-fitting headphone 100 that is still in the user's ear 106. For example, the notification may be spoken words or an alarm or jingle indicative of an accidental removal of the other ear-fitting headphone 100. An advantage of this is that the user will be made aware of the removal without having to look at the user device 102 and this is made in a discreet manner via the ear-fitting headphone 100 that has not been removed.
  • In some examples, as part of the notification, the sound (e.g. a song) that was previously being played out of the ear-fitting headphone(s) 100 may be paused whilst the notification is being presented or until the ear-fitting headphone 100 has been inserted back into the user's ear. The sound may also be paused until the user selects to continue playing the sound, e.g. via the user device 102. An advantage of this is that the abrupt stoppage may serve to quickly alert the user that an ear-fitting headphone 100 has been accidentally removed.
  • In some options, the user is told which ear-fitting headphone 100 has been removed or fallen from the ear. That is, the notification displayed on the display screen or played out through either ear-fitting headphone 100 to the user may contain information indicating that the ear-fitting headphone 100 that has been removed is a left or right ear-fitting headphone.
  • In examples, the user device 102 determines whether a capacitance of a capacitive sensor 106 of the ear-fitting headphone 100 has changed. If the capacitance of the capacitive sensor 106 has changed over a time period by an amount greater than a threshold, the user device 102 causes a notification to be presented to the user. For example, the notification may be displayed on a display screen or played out through the (first) or second ear-fitting headphone 100.
  • The controller 108 and its components as shown in Figure 1 are represented as a schematic block diagram for the purposes of explaining the functionality of the controller 108 only. Hence, it is understood that each component of the controller 108 is a functional block for performing the functionality ascribed to it herein. Each component may be implemented in hardware, software, firmware, or a combination thereof. Additionally, although described as separate components of the controller 108, some or all of the functionality may be performed by a single piece of hardware, software, or firmware.
  • It will be understood that the processor or processing system or circuitry referred to herein may in practice be provided by a single chip or integrated circuit or plural chips or integrated circuits, optionally provided as a chipset, an application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), digital signal processor (DSP), graphics processing units (GPUs), etc. The chip or chips may comprise circuitry (as well as possibly firmware) for embodying at least one or more of a data processor or processors, a digital signal processor or processors, baseband circuitry and radio frequency circuitry, which are configurable so as to operate in accordance with the exemplary embodiments. In this regard, the exemplary embodiments may be implemented at least in part by computer software stored in (non-transitory) memory and executable by the processor, or by hardware, or by a combination of tangibly stored software and hardware (and tangibly stored firmware).
  • Reference is made herein to data storage for storing data. This may be provided by a single device or by plural devices. Suitable devices include for example a hard disk and non-volatile semiconductor memory.
  • Although at least some aspects of the embodiments described herein with reference to the drawings comprise computer processes performed in processing systems or processors, the invention also extends to computer programs, particularly computer programs on or in a carrier, adapted for putting the invention into practice. The program may be in the form of non-transitory source code, object code, a code intermediate source and object code such as in partially compiled form, or in any other non-transitory form suitable for use in the implementation of processes according to the invention. The carrier may be any entity or device capable of carrying the program. For example, the carrier may comprise a storage medium, such as a solid-state drive (SSD) or other semiconductor-based RAM; a ROM, for example a CD ROM or a semiconductor ROM; a magnetic recording medium, for example a floppy disk or hard disk; optical memory devices in general; etc.

Claims (14)

  1. A method of detecting an ear-fitting headphone (100) being removed from an ear of a user wearing the ear-fitting headphone (100), the method comprising:
    determining that a capacitance of a capacitive sensor (106) of the ear-fitting headphone (100) has changed;
    characterised by:
    if it is determined that the capacitance of the capacitive sensor (106) has changed over a first time period by an amount greater than a first threshold, notifying the user that the ear-fitting headphone (100) has been removed from the ear, wherein determining that the capacitance of the capacitive sensor (106) of the ear-fitting headphone (100) has changed comprises determining an amount of change in capacitance of the capacitive sensor (106) relative to a capacitance of a capacitive sensor (106) of a second ear-fitting headphone (100) in the user's other ear.
  2. A method according to claim 1, wherein determining that the capacitance of the capacitive sensor (106) of the ear-fitting headphone (100) has changed comprises determining an amount of change in capacitance of the capacitive sensor (106) from one time instant to another time instant.
  3. A method according to claim 1 or claim 2, comprising:
    determining that a capacitance of a second capacitive sensor (106) of the ear-fitting headphone (100) has changed; and
    if it is determined that the capacitance of the second capacitive sensor (106) has changed over a second time period by an amount less than a second threshold, notifying the user that the ear-fitting headphone (100) has been removed from the ear.
  4. A method according to any of claims 1 to 3, comprising:
    notifying the user that the ear-fitting headphone (100) that has been removed from the ear is a left-hand ear-fitting headphone or a right-hand ear-fitting headphone.
  5. A method according to any of claims 1 to 4, wherein notifying the user that the ear-fitting headphone (100) has been removed from the ear comprises displaying a notification on a user device (102) connected to the ear-fitting headphone (100).
  6. A method according to any of claims 1 to 5, wherein notifying the user that the ear-fitting headphone (100) has been removed from the ear comprises playing out a notification through the ear-fitting headphone (100) that has been removed.
  7. A computer program comprising instructions such that when the computer program is executed on a user device (102) according to claim 8, the user device (102) is arranged to carry out a method according to any of claims 1 to 6.
  8. A user device (102) constructed and arranged to detect an ear-fitting headphone (100) being removed from an ear of a user wearing the ear-fitting headphone (100), the user device (102) being configured to:
    transmit an audio signal to the ear-fitting headphone (100) for playback of the audio by the ear-fitting headphone (100);
    determine whether a capacitance of a capacitive sensor (106) of the ear-fitting headphone (100) has changed;
    characterised in that the user device (102) is configured to:
    determine that the capacitance of the capacitive sensor (106) of the ear-fitting headphone (100) has changed by determining an amount of change in capacitance of the capacitive sensor (106) relative to a capacitance of a capacitive sensor (106) of a second ear-fitting headphone (100) in the user's other ear; and
    cause a notification to be presented to notify the user that the ear-fitting headphone (100) has been removed from the ear if it is determined that the capacitance of the capacitive sensor (106) has changed over a first time period by an amount greater than a first threshold.
  9. A user device (102) according to claim 8, the user device (102) being configured to determine whether the capacitance of the capacitive sensor (106) of the ear-fitting headphone (100) has changed by determining an amount of change in capacitance of the capacitive sensor (106) from one time instant to another time instant.
  10. A user device (102) according to any of claims 8 to 9, the user device (102) being configured to:
    determine whether a capacitance of a second capacitive sensor (106) of the ear-fitting headphone (100) has changed; and
    cause a notification to be presented to the user to notify the user that the ear-fitting headphone (100) has been removed from the ear if it is determined that the capacitance of the second capacitive sensor (106) has changed over a second time period by an amount less than a second threshold.
  11. A user device (102) according to any of claims 8 to 10, the user device (102) being configured to notify the user that the ear-fitting headphone (100) that has been removed from the ear is a left-hand ear-fitting headphone or a right-hand ear-fitting headphone.
  12. A user device (102) according to claim 8, the user device (102) being configured to:
    receive information associated with the capacitance of the capacitive sensor (106) of the ear-fitting headphone (100); and
    use the received information to determine whether the capacitance of the capacitive sensor (106) of the ear-fitting headphone (100) has changed.
  13. An ear-fitting headphone (100) constructed and arranged to detect if the ear-fitting headphone (100) has been removed from an ear of a user wearing the ear-fitting headphone (100), the ear-fitting headphone (100) comprising:
    a capacitive sensor (106) configured to detect a change in capacitance of the capacitive sensor (106), wherein the ear-fitting headphone (100) is configured to:
    receive an audio signal from a user device (102) for playback of the audio by the ear-fitting headphone (100);
    determine that a capacitance of the capacitive sensor (106) of the ear-fitting headphone (100) has changed by determining an amount of change in capacitance of the capacitive sensor (106) relative to a capacitance of a capacitive sensor (106) of a second ear-fitting headphone (100) in the user's other ear; and
    cause a notification to be presented to the user to notify the user that the ear-fitting headphone (100) has been removed from the ear if the determined change in capacitance of the capacitive sensor (106) over a time period is greater than a threshold.
  14. A system comprising:
    the user device (102) according to claim 8; and
    an ear-fitting headphone (100) comprising a capacitance sensor (106),
    wherein the user device (102) is configured to transmit the notification to the ear-fitting headphone (100) as an audible notification to be played out by the ear-fitting headphone (100), and
    wherein the ear-fitting headphone (100) is configured to:
    transmit information associated with a capacitance of the capacitance sensor (106) of the ear-fitting headphone (100) to the user device (102);
    receive from the user device (102) the audible notification; and
    play out the audible notification through the ear-fitting headphone (100).
EP17207463.5A 2017-12-14 2017-12-14 Device and method for detecting removal of an in-the-ear headphone from a user's ear Active EP3499910B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP17207463.5A EP3499910B1 (en) 2017-12-14 2017-12-14 Device and method for detecting removal of an in-the-ear headphone from a user's ear
TR2017/22638A TR201722638A2 (en) 2017-12-14 2017-12-28 Device and method for detecting removal of an ear-fitting headphone from a user`s ear.

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP17207463.5A EP3499910B1 (en) 2017-12-14 2017-12-14 Device and method for detecting removal of an in-the-ear headphone from a user's ear

Publications (2)

Publication Number Publication Date
EP3499910A1 EP3499910A1 (en) 2019-06-19
EP3499910B1 true EP3499910B1 (en) 2022-12-28

Family

ID=60673608

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17207463.5A Active EP3499910B1 (en) 2017-12-14 2017-12-14 Device and method for detecting removal of an in-the-ear headphone from a user's ear

Country Status (2)

Country Link
EP (1) EP3499910B1 (en)
TR (1) TR201722638A2 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4047946A1 (en) 2021-02-17 2022-08-24 Nokia Technologies Oy Avoiding unintentional operation of touch sensors on earphones
CN113473292B (en) * 2021-06-29 2024-02-06 芯海科技(深圳)股份有限公司 State detection method, earphone and computer readable storage medium
JP2023102074A (en) * 2022-01-11 2023-07-24 パナソニックIpマネジメント株式会社 Wireless headphones and control method for wireless headphones

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010046504A2 (en) * 2010-02-23 2010-04-29 Phonak Ag Method for monitoring a link between a hearing device and a further device as well as a hearing system
WO2012167234A1 (en) * 2011-06-02 2012-12-06 Cedars-Sinai Medical Center Earphones and hearing aids
US9961431B2 (en) * 2015-09-30 2018-05-01 Apple Inc. Earbud case with wireless radio shutdown feature

Also Published As

Publication number Publication date
EP3499910A1 (en) 2019-06-19
TR201722638A2 (en) 2019-07-22

Similar Documents

Publication Publication Date Title
US20210027617A1 (en) Designer control devices
US9949008B2 (en) Reproduction of ambient environmental sound for acoustic transparency of ear canal device system and method
US9924255B2 (en) On/off head detection using magnetic field sensing
US10045111B1 (en) On/off head detection using capacitive sensing
US9451351B2 (en) In-ear headphone
CN108810693B (en) Wearable device and device control device and method thereof
US20190238968A1 (en) Headphones With Orientation Sensors
US9538302B2 (en) Detecting headphone earpiece location and orientation based on differential user ear temperature
US10157037B2 (en) Performing an operation at a headphone system
EP3499910B1 (en) Device and method for detecting removal of an in-the-ear headphone from a user's ear
US9041545B2 (en) Audio awareness apparatus, system, and method of using the same
EP2293589B1 (en) Electronic circuit for a headset and method thereof
US20130345842A1 (en) Earphone removal detection
EP3001422A1 (en) Media player automated control based on detected physiological parameters of a user
EP3419258A1 (en) Controlling power for a headset
WO2014061578A1 (en) Electronic device and acoustic reproduction method
JP2018060403A (en) Sound output device and portable device
JP2017519383A (en) Apparatus, method and computer program for establishing wireless connection
US10045117B2 (en) Earpiece with modified ambient environment over-ride function
US20150382098A1 (en) Proximity ear buds for earphone listening
US11282492B2 (en) Smart-safe masking and alerting system
US20150117688A1 (en) Hybrid hearing device
JP6522105B2 (en) Audio signal reproduction apparatus, audio signal reproduction method, program, and recording medium
TWM503720U (en) Intelligent volume control earphone
CN114945120A (en) Control of earphone device

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20191216

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20201112

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

INTG Intention to grant announced

Effective date: 20221025

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602017064981

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1541217

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230328

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20221228

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1541217

Country of ref document: AT

Kind code of ref document: T

Effective date: 20221228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230329

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230428

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230428

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602017064981

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20230929

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231220

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221228

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: TR

Payment date: 20231211

Year of fee payment: 7

Ref country code: DE

Payment date: 20231214

Year of fee payment: 7