KR20230110920A - Wireless sound convertor - Google Patents

Abstract

The present invention relates to a wireless sound conversion device which may determine a wearing position on a user's body by analyzing a plurality of temperature detection values using an artificial neural network. The inventor of the present invention is a wireless sound conversion device comprising a main body equipped with a power source unit, microphone, speaker, and communication unit in an internal space, including: a temperature sensor which detects a first temperature detection value, which is the temperature of the external target of the main body, in a non-contact manner, detects a second temperature detection value, which is the temperature of the internal space, corrects the first temperature detection value using the second temperature detection value, and applies the corrected temperature detection value to a data processor; a proximity sensor which calculates the distance to the external target of the main body and applies the distance detection value to the data processor; and a data processor which determines the wearing position using an artificial intelligence module which performs machine learning using the corrected temperature detection value from the temperature sensor and the distance detection value from the proximity sensor as input values and outputs the wearing position of the wireless acoustic conversion device.

Description

Wireless sound conversion device {WIRELESS SOUND CONVERTOR}

The present invention relates to a wireless sound conversion device, and more particularly, to a wireless sound conversion device capable of determining a wearing position on a user's body by analyzing a plurality of detected values using an artificial neural network.

Cellular telephones, computers and other electronic equipment may generate audio signals during media playback operations and phone calls. Users often use the microphones and speakers in these devices to handle phone calls and media playback. Sometimes earbuds have a cord that allows the earbuds to be plugged into an electronic device.

Wireless earbuds offer users more flexibility than wired earbuds, but can be cumbersome to use. It is not always clear whether a wireless earbud is placed in a pocket, resting on a table, or in the user's ear or held in the user's hand. There is a problem in that the sound expression function (media playback) is performed even when the wireless earbuds are not worn on the ears.

An object of the present invention is to provide a wireless sound conversion device capable of determining a wearing position in a user's body by analyzing a plurality of detected values using an artificial neural network, and performing a sound expression function according to the determined position.

According to the present invention, a wireless sound conversion device including a main body including a power supply unit, a microphone, a speaker, and a communication unit in an internal space detects a first temperature detection value, which is the temperature of an external target object of the main body, in a non-contact manner, detects a second temperature detection value, which is the temperature of the internal space, corrects the first temperature detection value using the second temperature detection value, and applies the corrected temperature detection value to a data processor; It is configured to include a data processor for determining the worn position by using an artificial intelligence module that performs machine learning using the corrected temperature detection value from the sensor and the distance detection value from the proximity sensor as input values and outputs the worn position of the wireless sound conversion device.

In addition, it is preferable that the wireless sound conversion device additionally includes a touch sensor for contacting the target object to detect a touch detection value corresponding to a current flowing in the target object and applying the detected touch value to a data processor.

In addition, it is preferable that the wireless sound conversion device additionally includes a pressure sensor for generating a pressure sensing value corresponding to an external pressure and applying the generated pressure to a data processor.

Also, the data processor preferably uses at least one of the touch detection value and the pressure detection value as an input value of the artificial intelligence module together with the correction temperature detection value and the distance detection value from the proximity sensor.

In addition, the data processor preferably determines the worn position in a state where the power supply is electrically separated from the charging cradle.

Also, the data processor preferably transmits the determined wearing position to the electronic device through the communication unit.

The present invention analyzes a plurality of sensed values using an artificial neural network to accurately determine the worn position on the user's body, thereby reducing unnecessary power consumption, as well as allowing the sound emission function and phone call function to be performed independently in the electronic device.

1 is a perspective view of a wireless sound conversion device according to the present invention.
FIG. 2 is a configuration diagram of a sound control system including the wireless sound conversion device of FIG. 1 and an electronic device.

Hereinafter, the present invention will be described in detail through examples and drawings. However, it should be understood that this is not intended to limit the present invention to the specific embodiments, and includes various modifications, equivalents, and/or alternatives of the embodiments of the present invention. In connection with the description of the drawings, like reference numerals may be used for like elements.

In this document, expressions such as "has", "may have", "includes", or "may include" indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.

In this document, expressions such as "A or B", "at least one of A and/and B", or "one or more of A or/and B" may include all possible combinations of the items listed together. For example, "A or B", "at least one of A and B", or "at least one of A or B" can refer to (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.

Expressions such as "first", "second", "first", or "second" used in this document may modify various elements, regardless of order and/or importance, and are used to distinguish one element from another element, but do not limit the elements. For example, a first user device and a second user device may represent different user devices regardless of order or importance. For example, without departing from the scope of rights described in this document, a first element may be called a second element, and similarly, the second element may also be renamed to the first element.

When it is said that an element (eg, a first element) is "(functionally or communicatively) coupled with/to" or "connected to" another element (eg, a second element), it will be understood that the element may be directly connected to the other element or connected through another element (eg, a third element). On the other hand, when an element (eg, a first element) is referred to as being “directly connected” or “directly connected” to another element (eg, a second element), it may be understood that no other element (eg, a third element) exists between the element and the other element.

As used herein, the expression “configured (or configured to)” may be used interchangeably with, for example, “suitable for”, “having the capacity to”, “designed to”, “adapted to”, “made to”, or “capable of” depending on the circumstances. The term "configured (or set) to" may not necessarily mean only "specifically designed to" hardware. Instead, in some contexts, the phrase "device configured to" may mean that the device is "capable of" in conjunction with other devices or components. For example, the phrase “a processor configured (or configured) to perform A, B, and C” may refer to a dedicated processor (e.g., an embedded processor) for performing the corresponding operation, or a generic-purpose processor (e.g., CPU or application processor) capable of performing the corresponding operations by executing one or more software programs stored in a memory device.

Terms used in this document are only used to describe a specific embodiment, and may not be intended to limit the scope of other embodiments. Singular expressions may include plural expressions unless the context clearly dictates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by a person of ordinary skill in the technical field described in this document. Among the terms used in this document, terms defined in general dictionaries may be interpreted as having the same or similar meanings as those in the context of the related art, and unless explicitly defined in this document, they are not interpreted in ideal or excessively formal meanings. In some cases, even terms defined in this document cannot be interpreted to exclude the embodiments of this document.

1 is a perspective view of a wireless sound conversion device according to the present invention. The wireless sound conversion device is composed of a main body 10 having an internal space in which a control circuit is installed and seated, an insertion tube 20, one end of which communicates with the internal space of the main body 10 and at least a portion of the other end of which can be inserted into the ear canal, and an ear tip 30 of an elastic member that is seated at the other end of the insertion tube 20 and is detachable so that it can be gently adhered to the user's ear (ear canal). However, the insertion tube 20 and the ear tip 30 may be selectively provided, and the body portion 10 and the insertion tube 20 may be referred to as one body.

The body portion 10 accommodates a control circuit in an internal space, and has at least one through hole 11 communicating the outside and the internal space on a first side surface, so that sound from the outside of the body portion 10 is easily acquired.

The insertion tube 20 protrudes outward from a second side opposite to the first side of the main body 10, and at least one channel is formed inside the insertion tube 20 to transmit sound generated by a speaker of the control circuit to the user's ear. The passage of the insertion tube 20 and the internal space of the main body 10 communicate with each other so that sound is transmitted.

FIG. 2 is a configuration diagram of a sound control system including the wireless sound conversion device of FIG. 1 and an electronic device.

The sound control system includes one or a pair of wireless sound conversion devices 1 and an electronic device 300 that performs wireless communication with the wireless sound conversion device 1 .

The control circuit of the wireless sound conversion device 1 receives power from a charging cradle (not shown), charges a built-in battery, and supplies power from the battery to each element of the control circuit; An input unit 114 applied to the processor 200, a display unit 116 displaying information such as a power state, a speaker 118 receiving an electrical signal from the data processor 200 and emitting sound, a microphone 120 acquiring sound and applying the electrical signal to the data processor 200, respectively, a first detected temperature value, which is the temperature of a target object (object or skin), and a second temperature, which is the ambient temperature of the internal space of the main body unit 10 2 Temperature sensor 122 measuring temperature detection value, correcting (compensating) the first temperature detection value using the second temperature detection value and applying the corrected temperature detection value to the data processor 200, a proximity sensor 124 mounted on the main body 10 or insertion tube 20 to measure the distance to an external target object and applying the distance detection value to the data processor 200, and mounted on the outer surface of the main body 10 or insertion tube 20 The touch sensor 128 generates a touch detection value and applies it to the data processor 200, the pressure sensor 130 formed on the outer surface of the main body 10 or the insertion tube 20 to generate a pressure detection value and applies it to the data processor 200, and the electric signal, which is an acoustic signal, from the electronic device 300 while performing communication with the electronic device 300 by controlling the above-described components while power is supplied from the power supply unit 110 A data processor 200 receives and applies the received electrical signal to the speaker 118 to perform a sound emission function and a phone call function by controlling the speaker 118 and the microphone 120, but receives at least one or more sensing values (a correction temperature sensing value, a distance sensing value, a touch sensing value, a pressure sensing value, etc.) to determine the wearing position of the wireless sound conversion device using a built-in artificial intelligence module, and transmits the determined wearing position to the electronic device 300. However, the power supply unit 110, the communication unit 112, the input unit 114, the display unit 116, the speaker 118, the microphone 120, etc. are of course recognized by those skilled in the art to which the present invention belongs. As such, detailed descriptions thereof are omitted.

In detail, the temperature sensor 122 is mounted on the outer surface of the main body 10 or the insertion tube 20 or on the channel of the insertion tube 20 to detect a first temperature sensing value, which is the temperature of a target object outside the main body 10 or the insertion tube 20, in a non-contact manner (for example, an infrared method), and detects a second temperature sensing value, which is the ambient temperature, which is the air temperature in the inner space of the main body 10 or the insertion tube 20. Since the first sensed temperature value is the temperature of the target object affected by the air temperature, the temperature sensor 122 calculates the actual temperature of the target object by correcting (compensating) the first sensed temperature value using the second sensed temperature value to remove the influence of the ambient temperature, and applies the corrected sensed temperature value, which is the calculated actual temperature, to the data processor 200. The temperature sensor 122 includes, for example, an FIR sensor. The temperature sensor 122 may apply different corrected temperature detection values to the data processor 200 when the wireless sound conversion device 1 is worn on the ear or held in the hand, for example.

The proximity sensor 124 calculates the distance to the target object and applies the detected distance value to the data processor 200 . For example, the proximity sensor 124 may apply different distance sensing values to the data processor 200 when the wireless sound conversion device 1 is worn on the ear and when the wireless sound conversion device 1 is held in the hand.

The touch sensor 128 contacts the target object in an electrostatic manner, detects a touch detection value corresponding to a current flowing through the target object, and applies the detected touch value to the data processor 200 . For example, different touch detection values are applied to the data processor 200 when the touch sensor 128 contacts human skin (including ears) and when it contacts only air.

The pressure sensor 130 generates a pressure sensing value corresponding to an external pressure and applies the pressure sensing value to the data processor 200 . For example, when the wireless sound conversion device 1 is worn on the ear and when the wireless sound conversion device 1 is held in the hand, different pressure detection values may be applied to the data processor 200 .

The data processor 200 performs wireless communication with the electronic device 300 through the communication unit 112 to perform a sound emission function and a phone call function, and a processor (e.g., CPU, MCU, etc.) performing a wearing position determination function that determines the wearing position of the wireless sound conversion device 1 from at least one or more detected values using an artificial intelligence module and transmits it to the electronic device 300, and an artificial intelligence module that learns the relationship between the detected values and the worn position using an artificial intelligence method and outputs the worn position; It consists of an electrical and/or electronic circuit consisting of a storage space (eg, memory, etc.) for storing sensed values and the like.

The artificial intelligence module includes, for example, a CNN model effective for classification, the input value is at least two or more of the above-described detection values, and the output value is the wearing position of the wireless sound conversion device 10 in the body. That is, the data processor 200 drives the artificial intelligence module so that the artificial intelligence module performs machine learning on the relationship or relationship between at least one or more sensed values and the worn position. By such machine learning, the artificial intelligence module outputs the wearing position (eg, ear, hand, etc.) of the wireless sound conversion device 10 when at least one or more sensed values are input. Alternatively, the artificial intelligence module may output only whether or not the wearing position is the ear as an output value.

The artificial intelligence module may use the distance detection value and the corrected temperature detection value as input values and output the wearing position based on the corrected temperature detection value only when the distance detection value is within the reference distance value. In another embodiment, the artificial intelligence module uses the touch detection value, the corrected temperature detection value, and the distance detection value as input values, and only when it is determined that the wireless sound conversion device 1 is in contact with the skin based on the touch detection value, the wearing position may be output based on the corrected temperature detection value. In another embodiment, the artificial intelligence module uses the pressure detection value, the corrected temperature detection value, and the distance detection value as input values, and only when it is not determined that the wireless sound conversion device 1 is held in the hand based on the pressure detection value, the wearing position may be output based on the corrected temperature detection value. The artificial intelligence module outputs the worn position of the wireless sound conversion device 1 using at least two or more detected values among a plurality of detected values.

In the following, the wearing position determination function is described in detail.

The electronic device 300 is, for example, an information communication device such as a smart phone or a tablet pc, and includes a communication unit 312 that performs wireless communication with the wireless sound conversion device 1, an input unit 314 that obtains input from a user (eg, selection of a sound emission function, selection of a phone call function, etc.) and applies the obtained input to the data processor 320, and receives information (eg, a wearing position, etc.) from the data processor 320 and displays it visually and/or audibly. It is configured to include a display unit 316 and a data processor 320 that controls the above-described components to communicate with the wireless acoustic conversion device 1 to perform a sound emission function or a phone call function. However, the power supply unit (not shown), the communication unit 312, the input unit 314, the display unit 316, etc. are merely technologies that are naturally recognized by those skilled in the art to which the present invention belongs, and detailed description thereof will be omitted.

The data processor 320 controls the communication unit 312 to perform wireless communication with the wireless sound conversion device 1, and performs a sound emission function or a phone call function. The data processor 320 receives wearing position information from the wireless sound conversion device 1, and when the current wearing position of the wireless sound conversion device 1 is not the ear according to the received wearing position information, the sound emission function being performed and/or the transmission of electric signals for the phone call function is stopped, and the sound emission function and the phone call function are independently and/or self-performed through the built-in display unit 316 and a microphone (not shown). That is, the data processor 320 allows the wireless sound conversion device 1 to perform a sound emission function and a phone call function through the communication unit 312 only when the current wearing position of the wireless sound conversion device 1 according to the received wearing position information is the ear.

The wearing position determination function will be described in detail.

The data processor 200 does not perform the wearing position determination function while the power supply unit 110 is connected to the charging cradle and performs a charging operation. That is, the data processor 200 confirms that the power supply unit 110 is electrically and/or mechanically separated from the charging cradle, and performs a worn position determination function in this separated state. A technique for confirming that the power supply unit 110 is electrically separated from the charging cradle corresponds to a technique naturally recognized by those skilled in the art to which the present invention belongs, and thus a description thereof will be omitted.

In addition, when the power supply unit 110 supplies power, the wireless sound conversion device 1 is activated.

Also, the data processor 200 controls the communication unit 112 to perform wireless communication with the electronic device 300 . The data processor 320 controls the communication unit 312 to perform wireless communication with the wireless sound conversion device 1 .

The data processor 200 acquires a plurality of sensed values among the corrected temperature sensed value from the temperature sensor 122, the distance sensed value from the proximity sensor 124, the touch sensed value from the touch sensor 128, and the pressure sensed value from the pressure sensor 130, and drives the artificial intelligence module. The data processor 200 inputs a plurality of sensed values as input values of the artificial intelligence module, and acquires the wearing position as an output value of the artificial intelligence module.

The data processor 200 transmits the worn position information including the worn position to the electronic device 300 through the communication unit 112 .

The data processor 320 receives wearing position information from the wireless sound conversion device 1 through the communication unit 312, and according to the wearing position included in the received wearing position information, if the current wearing position of the wireless sound conversion device 1 is not an ear, stops transmission of electric signals for the sound emission function and phone call function being performed, and performs the sound emission function and the phone call function by itself through the built-in display unit 316 and a microphone (not shown).

The data processor 200 performs a wearing position determination function while performing a sound emission function or a phone call function with the electronic device 300 .

As another embodiment, the data processor 200 may store wearing position determination data (eg, lookup data) machine-learned by artificial intelligence instead of the artificial intelligence module. The data processor 200 may read the wearing position determination data and determine a wearing position corresponding to a plurality of detection values in the read wearing position determination data.

At least some of devices (eg, processors or functions thereof) or methods (eg, operations) according to various embodiments may be implemented as instructions stored in computer-readable storage media in the form of, for example, program modules. When the command is executed by a processor, the one or more processors may perform a function corresponding to the command. A computer-readable storage medium may be, for example, a memory.

A computer-readable recording medium may include a hard disk, a floppy disk, magnetic media (eg, magnetic tape), optical media (eg, CD-ROM, DVD (Digital Versatile Disc)), magnetooptical media (eg, floptical disk), hardware devices (eg, ROM, RAM, flash memory, etc.), etc. In addition, program commands include not only machine code generated by a compiler but also an interpreter. It may include high-level language code that can be executed by a computer using a computer, etc. The above-described hardware device may be configured to operate as one or more software modules to perform operations of various embodiments, and vice versa.

Processors or functions by processors according to various embodiments may include at least one or more of the aforementioned elements, some may be omitted, or additional elements may be further included. Operations performed by modules, program modules, or other components according to various embodiments may be executed in a sequential, parallel, repetitive, or heuristic manner. Also, some actions may be performed in a different order, omitted, or other actions may be added.

As described above, the present invention is not limited to the specific preferred embodiments described above, and those skilled in the art without departing from the subject matter of the present invention claimed in the claims can make various modifications, of course, and such changes are within the scope of the claims.

1: wireless sound conversion device 300: electronic device

Claims (7)

A wireless sound conversion device comprising a main body having a power supply unit, a microphone, a speaker and a communication unit in an inner space, the wireless sound conversion device comprising:
A temperature sensor that senses a first temperature detection value, which is the temperature of an external target object of the main body, in a non-contact manner, detects a second temperature detection value, which is the temperature of the internal space, corrects the first temperature detection value using the second temperature detection value, and applies the corrected temperature detection value to a data processor;
a proximity sensor for calculating a distance between the main body and an external target object and applying a detected distance value to a data processor;
A data processor configured to include a data processor configured to perform machine learning using the corrected temperature detection value from the temperature sensor and the distance detection value from the proximity sensor as input values and determine the wearing position using an artificial intelligence module that outputs the wearing position of the wireless sound conversion device. According to claim 1,
The wireless sound conversion device further comprises a touch sensor for contacting the target object, detecting a touch detection value corresponding to a current flowing in the target object, and applying the detected touch value to a data processor. According to claim 1 or 2,
The wireless sound conversion device further comprises a pressure sensor for generating a pressure detection value corresponding to an external pressure and applying it to a data processor. According to claim 3,
The data processor uses at least one of the touch detection value and the pressure detection value as an input value of the artificial intelligence module together with the correction temperature detection value and the distance detection value from the proximity sensor. According to claim 1,
The data processor determines the wearing position in a state where the power supply is electrically separated from the charging cradle. According to claim 1,
The data processor transmits the determined wearing position to the electronic device through the communication unit. a wireless sound conversion device according to claim 6;
An electronic device that communicates with the wireless acoustic conversion device and stops transmission of an electrical signal for a sound emission function or a phone call function performed with the wireless acoustic conversion device according to the wearing position transmitted from the wireless acoustic conversion device. A sound control system comprising: