KR20220139103A - Wireless earphone device and control method thereof - Google Patents

Abstract

A wireless earphone device according to one embodiment disclosed in the present document includes two ear units. At least one ear unit of the two ear units comprises: a communication module; at least one sensor; a plurality of microphones; at least one processor operatively connected to the communication module, the at least one sensor, and the plurality of microphones; and a memory operatively coupled to the at least one processor. When executed, the memory may store instructions to allow the at least one processor to check the wearing state of the ear units based on a first sensing signal of the at least one sensor and a second sensing signal received from another ear unit through the communication module, select one of the ear units based on the wearing state of the ear units when it is confirmed that the wearing state of the ear units does not correspond to the reference state, detect a declination of the ear unit based on a sensing signal of the selected ear unit, and compensate for a delay of a signal input to one of the plurality of microphones included in the ear unit based on the detected declination. In addition, various embodiments identified through the present document are possible. Accordingly, user satisfaction with a wireless earphone product can be improved.

Description

Wireless earphone device and its control method

Various embodiments disclosed in this document relate to a technology for controlling a voice signal to be corrected in consideration of a wearing state of a wireless earphone device.

With the development of communication technology, the use of wireless earphone devices is gradually increasing. In recent years, as true wireless stereo (TWS) products that do not have any cables or connectors between ear units have become mainstream, various functions can be provided by interworking with electronic devices such as smart phones, tablet devices, or computers. For example, if the user receives a call while listening to music using the wireless earphone device connected to the smartphone, the user may make a phone call using the wireless earphone device.

In the case of TWS products, because each user has a different preferred wearing posture or wearing habit, a situation of incorrect wearing may occur frequently. When the ear unit is worn, the wearing state such as the angle at which the ear unit is inserted into the user's ear, whether the right and left directions are appropriate, or the degree of close contact may affect the function of the wireless earphone device.

Although the penetration rate of wireless earphones such as TWS products is increasing due to the growth of the wireless earphone market, users may still find it difficult to receive a guide for proper wearing of wireless earphones. If the user does not recognize whether it is appropriate for the user to wear the wireless earphone, the voice recognition function using the wireless earphone and call quality may be deteriorated.

Accordingly, in various embodiments of the present document, the voice recognition function and call quality of the wireless earphone product can be improved by checking the user's wearing state of the wireless earphone and providing a guide for misuse. In addition, when the guide for the wireless earphone misuse is not improved despite providing a guide for incorrect use of the wireless earphone more than a specified number of times, various embodiments for improving the quality of the wireless earphone product can be provided by compensating for the delay of the voice signal due to the wearing deviation. .

The technical problems to be achieved in the embodiments disclosed in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned are to those of ordinary skill in the art to which the present invention belongs from the description below. can be clearly understood.

A wireless earphone device according to an embodiment disclosed in this document includes two ear units, wherein at least one ear unit of the two ear units includes a communication module, at least one sensor, a plurality of microphones, and the a communication module, at least one processor operatively coupled to the at least one sensor and the plurality of microphones, and a memory operatively coupled to the at least one processor, wherein the memory, when executed, comprises: the processor of the at least one sensor confirms whether the ear units are worn and the wearing state of the ear units based on a first sensing signal of the at least one sensor and a second sensing signal received from another ear unit through the communication module, If it is confirmed that the wearing state of the ear units does not correspond to the reference state, one ear unit is selected from among the ear units based on the wearing state of the ear units, and based on a sensing signal for the selected ear unit and storing instructions for detecting a declination angle of the ear unit, and compensating for a delay for a signal input to one of a plurality of microphones included in the ear unit based on the detected declination angle, wherein the declination angle is determined by the ear unit It may be an error angle caused by a difference between the reference state of the ear unit and the worn state confirmed for the ear unit.

An operation method in one ear unit among ear units constituting the wireless earphone device according to an embodiment disclosed in this document includes the operation of detecting wearing of the ear units and the operation of checking the wearing state of the ear units. , when it is confirmed that the wearing state of the ear units does not correspond to the reference state, selecting one ear unit among the ear units based on the wearing state of the ear units, detecting the declination angle of the ear unit and compensating for a delay with respect to a signal input to one of a plurality of microphones included in the ear unit based on the detected declination angle, wherein the declination angle corresponds to a reference state of the ear unit and the ear unit. It may be an error angle due to a difference in the confirmed wearing state.

According to various embodiments disclosed in this document, the voice recognition function and call quality of the wireless earphone product can be improved by checking the user's wearing state of the wireless earphone and providing a guide for misuse. In addition, when the user speaks while wearing the wireless earphone, by compensating for the delay of the voice signal due to the wearing deviation, user satisfaction with the wireless earphone product can be improved.

In addition, various effects directly or indirectly identified through this document may be provided.

1 is a block diagram of an electronic device in a network environment according to an exemplary embodiment.
2 is a conceptual diagram illustrating a method of checking a wearing state of a wireless earphone device according to an exemplary embodiment.
3 is a block diagram illustrating a configuration of a wireless earphone device according to an embodiment.
4 is a block diagram illustrating a configuration of an electronic device according to an embodiment.
5 is a view for explaining a method of guiding wearing of a wireless earphone device in an electronic device, according to an embodiment.
6A and 6B are diagrams illustrating values of sensing signals that change according to a wearing state of an ear unit, according to an exemplary embodiment.
7 is a diagram illustrating values of sensing signals that change according to wearing of an ear unit in the left and right directions, according to an exemplary embodiment.
8 is a diagram illustrating a waveform of a sensing signal that changes according to a wearing strength of an ear unit, according to an exemplary embodiment.
9 is a diagram for describing a method of calculating a delay for a microphone output signal based on a wearing state of an ear unit, according to an embodiment.
10 is a view for explaining a method of compensating for a delay of a microphone input signal of an ear unit, according to an embodiment.
11 is a flowchart illustrating a method of controlling a wireless earphone device, according to an embodiment.
12 is a view for explaining a method of guiding a wearing state of a wireless earphone device and correcting an output signal, according to an embodiment.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

Hereinafter, various embodiments disclosed in this document will be described with reference to the accompanying drawings. For convenience of description, the sizes of the components shown in the drawings may be exaggerated or reduced, and the present invention is not necessarily limited to the illustrated ones.

The electronic device according to various embodiments disclosed in this document may be a device of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C," each of which may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may simply be used to distinguish an element from other elements in question, and may refer elements to other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively”. When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of the present document may include a unit implemented in hardware, software, or firmware, for example, and interchangeably with terms such as logic, logic block, component, or circuit. can be used A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to an embodiment, the method according to various embodiments disclosed in this document may be provided by being included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. . According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, omitted, or , or one or more other operations may be added.

1 is a diagram illustrating an electronic device in a network environment 100 according to an embodiment.

Referring to FIG. 1 , in a network environment 100 , the electronic device 101 communicates with the electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with at least one of the electronic device 104 and the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 . In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or operations. According to an embodiment, as at least part of data processing or operation, the processor 120 stores a command or data received from another component (eg, the sensor module 176 or the communication module 190 ) into the volatile memory 132 . may be stored in , process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is a main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 uses less power than the main processor 121 or is set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The secondary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or when the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the auxiliary processor 123 (eg, image signal processor or communication processor) may be implemented as a part of another functionally related component (eg, camera module 180 or communication module 190). have. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted Boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to an embodiment, the receiver may be implemented separately from or as a part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 or an external electronic device (eg, a sound output module 155 ) directly or wirelessly connected to the electronic device 101 . The electronic device 102) (eg, a speaker or headphones) may output a sound.

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to an embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : LAN (local area network) communication module, or a power line communication module) may be included. A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (Wi-Fi) direct, or infrared data association (IrDA)) or a second network 199 (eg, : It is possible to communicate with the external electronic device 104 through a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a telecommunication network such as a computer network (eg, LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology is a high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) in order to achieve a high data rate, for example. The wireless communication module 192 uses various techniques for securing performance in a high frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. Technologies such as full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna may be supported. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 includes a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: Downlink (DL) and uplink (UL) may support 0.5 ms or less, or 1 ms or less round trip respectively).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by, for example, the communication module 190 . can be A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to an embodiment, the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the designated high frequency band. have.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations performed by the electronic device 101 may be performed by one or more external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. The server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

2 is a conceptual diagram illustrating a method of checking a wearing state of a wireless earphone device according to an exemplary embodiment.

In FIG. 2 , the wireless earphone device 200 may be connected to the electronic device 210 through a short-range wireless network. A short-range wireless network for establishing a connection between the wireless earphone device 200 and the electronic device 210 may be appropriately selected. For example, including Bluetooth (Bluetooth), BLE (Bluetooth Low Energy), Wi-Fi direct, NFC (near field communication), UWB (ultra-wide band) communication, or infrared (infra-red) communication wireless earphone It may be used to establish a wireless connection between the device 200 and the electronic device 210 . When a wireless connection with the electronic device 210 is established, the wireless earphone device 200 may check the wearing state of the ear units constituting the wireless earphone device 200 by interworking with the electronic device 210 .

According to various embodiments, the electronic device 210 may be a mobile communication device such as a smart phone or a tablet device, and the description of the electronic device 101 described with reference to FIG. 1 is the electronic device 210 . can be appropriately applied to The wireless earphone device 200 is a device that outputs an audio signal related to a function provided by the electronic device 210 or generates a voice signal, and is displayed on the display module 160 in the description of the electronic device 101 of FIG. 1 . Other descriptions except for the part may be appropriately applied to the wireless earphone device 200 .

In an embodiment, the wireless earphone device 200 may include two ear units 201 and 202 . One of the two ear units 201 and 202 may be a left unit mounted on the left ear, and the other may be a right unit mounted on the right ear. Each of the two ear units 201 and 202 may include at least one sensor, and use the at least one sensor to measure whether the ear unit is worn on the user's ear and/or the wearing state. According to various embodiments of the present disclosure, the electronic device 210 may perform a test for checking the wearing state of the ear units 201 and 202 in conjunction with the wireless earphone device 200 . When receiving a user request for a wear test of the wireless earphone device 200 , the electronic device 210 may display a user interface for performing a wear test on the display. For example, the electronic device 210 may provide a user interface including a guide phrase instructing to maintain an upright posture while measuring the wearing state of the ear units 201 and 202 . While the user interface is displayed on the electronic device 210 , the wireless earphone device 200 may output a voice message having the same content as the guide phrase through each ear unit.

In an embodiment, when the wireless earphone device 200 receives a request for checking the wearing state of the ear units 201 and 202 from the electronic device 210 , at least one sensor provided in the ear units 201 and 202 . can be used to measure the wearing state of each ear unit, and check whether the measured wearing state corresponds to the reference wearing state. The reference wearing state may represent state data proposed to provide optimized sound quality in the wireless earphone device 200 . According to various embodiments of the present disclosure, the at least one sensor may include an acceleration sensor. For example, the wireless earphone device 200 determines how much the wearing angle of each ear unit is shifted based on the reference wearing angle, based on the gravitational acceleration signal measured from the acceleration sensor included in each ear unit, and whether each ear unit is left and right. It can be checked whether the ear unit is worn in the correct direction or how closely each ear unit is worn to the user's ear. The wireless earphone device 200 may transmit information about the confirmed wearing state of each ear unit to the electronic device 200 .

In an embodiment, the electronic device 210 may provide wearing guide information corresponding to the wearing state of each ear unit obtained from the wireless earphone device 200 . For example, if information indicating that the wearing angle of the left ear unit is rotated by 15 degrees counterclockwise based on the reference wearing angle is received, the electronic device 210 sets the wearing angle of the left ear unit clockwise by 15 It is also possible to display wearing guide information instructing to rotate. For another example, if information indicating that the wearing strength of the right ear unit is lower than the reference wearing strength is received, the electronic device 210 may display wearing guide information instructing to wear the right ear unit closer to the user's ear. can be displayed. According to various embodiments of the present disclosure, the wearing guide information may be provided through the wireless earphone device 210 . While the wearing guide information is displayed on the electronic device 210 , the wireless earphone device 200 may output a voice message related to the wearing guide information through each ear unit.

In an embodiment, the wireless earphone device 200 re-measures the wearing state of the ear units 201 and 202 changed after providing the wearing guide information using at least one sensor included in each ear unit, and It may be checked whether the measured wearing state corresponds to the reference wearing state. As a result of the check, if the changed wearing state of the ear units 201 and 202 corresponds to the reference wearing state, the wearing test may be ended. As a result of the check, if the changed wearing state of the ear units 201 and 202 still does not correspond to the standard wearing state, the wireless earphone device 200 and the electronic device 210 use the ear units 201 and 202 as the standard wearing state. Wearing guide information regarding how to change the current wearing state with the goal of the state may be additionally provided. According to various embodiments of the present disclosure, the electronic device 210 may perform a process of checking the wearing state of the ear units 201 and 202 and providing corresponding wearing guide information a specified number of times. After providing the wearing guide information for the specified number of times, the wireless earphone device 200 determines that the changed wearing state of the ear units 201 and 202 still does not correspond to the standard wearing state, 202), one of the ear units can be selected. For example, the wireless earphone device 200 selects an ear unit whose current wearing state is confirmed to be close to the reference wearing state from among the two ear units 201 and 202, and selects a plurality of ear units included in the selected ear unit. A voice signal may be acquired using a microphone. In this process, the wireless earphone device 200 compensates for the delay between the plurality of microphones in consideration of a wearing deviation according to the wearing state of the selected ear unit compared to the reference wearing state, thereby compensating for the call quality of the wireless earphone device 200 . can improve

3 is a block diagram illustrating the configuration of the wireless earphone device 200 according to an embodiment.

Referring to FIG. 3 , the wireless earphone device 200 is a device that outputs an audio signal or obtains a user's voice signal, and may be composed of two ear units. The two ear units may correspond to a left ear unit or a right ear unit, respectively. At least one ear unit of the two ear units may include a communication module 310 , at least one sensor 320 , a plurality of microphones 330 , a speaker 340 , at least one processor 350 or a memory 360 . ) may be included. In FIG. 3 , the wireless earphone device 200 may correspond to the wireless earphone device 200 shown in FIG. 2 , and in the description of the electronic device 101 described with reference to FIG. 1 , the display 160 is Descriptions other than the part may be appropriately applied to the wireless earphone device 200 .

In an embodiment, the communication module 310 (eg, the wireless communication module 192 of FIG. 1 ) communicates with an electronic device (eg, the electronic devices 102 and 104 of FIG. 1 or the electronic device 210 of FIG. 2 ). You can establish a communication connection and send/receive various data. For example, the communication module 310 may support at least one communication method among wireless-fidelity (Wi-Fi), Bluetooth, near field communication (NFC), and ultra-wide band (UWB) communication.

In an embodiment, the at least one sensor 320 (eg, the sensor module 176 of FIG. 1 ) may measure whether the wireless earphone device 200 is worn and/or a wearing state. For example, the at least one sensor 320 may include an acceleration sensor. In this case, based on the gravitational acceleration signal measured from the acceleration sensor, at least one of a wearing angle, a left-right direction, or a wearing strength of each ear unit is determined. can be checked

In an embodiment, the plurality of microphones 330 (eg, the input module 150 of FIG. 1 ) may acquire a user's voice signal.

In an embodiment, the speaker 340 (eg, the sound output module 155 of FIG. 1 ) is provided by an electronic device (eg, the electronic device 210 of FIG. 2 ) in which a wireless connection is established with the wireless earphone device 200 . It is possible to output an acoustic signal related to the function.

In one embodiment, memory 360 (eg, memory 130 of FIG. 1 ), when executed, causes at least one processor 350 (eg, processor 120 of FIG. 1 ) to perform various operations. Controlling instructions can be stored. For example, the at least one processor 350 may check the wearing state of the ear units, provide wearing guide information corresponding thereto, and correct the voice signal in consideration of the wearing deviation.

In an embodiment, the at least one processor 350 may obtain a first sensing signal related to a wearing state of the first ear unit, which is one of the two ear units, from the at least one sensor 320 . The first sensing signal may be a gravitational acceleration signal sensed by the at least one sensor 320 while the first ear unit is worn on the user's ear.

In an embodiment, the at least one processor 350 may receive a second sensing signal related to a wearing state of a second ear unit that is the other one of the two ear units through the communication module 310 . The second sensing signal may be a gravitational acceleration signal sensed by a sensor included in the second ear unit while the second ear unit is worn on the user's ear. According to various embodiments of the present disclosure, the at least one processor 350 receives the wear test request for the ear units from the electronic device 210 , the first sensing signal and the second sensing signal can be obtained.

In an embodiment, the at least one processor 350 may check the wearing state of the ear units based on the first sensing signal and the second sensing signal. According to various embodiments of the present disclosure, the at least one processor 350 includes a first time period in which the user wearing ear units maintains a front posture without uttering, and a second time period in which the user maintains the front posture while uttering. The state of the ear units may be checked based on the sensing signals respectively acquired for two time periods. For example, the at least one processor 350 obtains a first gravitational acceleration signal measured with respect to the first ear unit during the first time period from the at least one sensor 320 , and from the communication module 310 . A second gravitational acceleration signal measured with respect to the second ear unit during the first time period may be obtained. The at least one processor 350 may identify at least one of a wearing angle or a left and right direction of the ear units based on the first gravitational acceleration signal and the second gravitational acceleration signal. For another example, the at least one processor 350 obtains a third gravitational acceleration signal measured with respect to the first ear unit during the second time period from the at least one sensor 320 , and the communication module 310 . A fourth gravitational acceleration signal measured with respect to the second ear unit during the second time period may be obtained from . The at least one processor 350 may determine the wearing strength of the ear units based on the third gravitational acceleration signal and the fourth gravitational acceleration signal.

In an embodiment, the at least one processor 350 may determine whether the wearing state of the ear units corresponds to a reference wearing state based on the first sensing signal and the second sensing signal. The reference wearing state may indicate a state data range in which the wireless earphone device 200 can provide optimal voice quality. For example, the at least one processor 350 compares the first sensing signal and the second sensing signal with a reference signal that is a signal measured in response to the reference wearing state, and based on the comparison result, the ear unit It can be checked whether the wearing state of the people corresponds to the reference wearing state. As another example, the at least one processor 350 may determine whether the first sensing signal and the second sensing signal are included in a range of a reference signal defined as the reference wearing state. As a result of the check, if the wearing state of the ear units corresponds to the reference wearing state, the at least one processor 350 determines that the ear units are properly worn on the user's ear, and indicates that the ear units are properly worn. A signal may be transmitted to the electronic device 210 . As a result of the check, if the wearing state of the ear units does not correspond to the reference wearing state, the at least one processor 350 may transmit information about the wearing state of the ear units to the electronic device 210 . According to various embodiments of the present disclosure, the at least one processor 350 may obtain wearing guide information corresponding to the wearing state of the ear units from the electronic device 210 . For example, when it is confirmed that the first ear unit and the second ear unit are worn with the left and right directions reversed, wearing guide information instructing the first ear unit and the second ear unit to be worn interchangeably is provided in the current wearing state can be The at least one processor 350 may control to output a voice message regarding the acquired wearing guide information through the speaker 340 . While a voice message regarding the wearing guide information is output from the ear units, a user interface including the wearing guide information may be displayed on the display of the electronic device 210 . According to various embodiments of the present disclosure, checking the wearing state of the ear units and providing wearing guide information corresponding to the confirmed wearing state may be repeatedly performed a specified number of times. After providing the wearing guide information, the at least one processor 350 may again acquire a first sensing signal measured with respect to the first ear unit and a second sensing signal measured with respect to the second ear unit. The at least one processor 350 determines whether the changed wearing state of the ear units corresponds to the reference wearing state based on the re-acquired first and second sensing signals, and according to the confirmation result, the Wearing guide information corresponding to the changed wearing state may be provided again. If the worn state of the ear units checked after providing the wearing guide information a specified number of times is still different from the reference wearing state, the at least one processor 350 determines that the wearing state of the ear units corresponds to the reference wearing state. It may be determined not to do so, and the wearing guide information may no longer be provided.

In an embodiment, when it is determined that the wearing state of the ear units does not correspond to the reference wearing state, the at least one processor 350 determines that one of the ear units is worn based on the wearing state of the ear units. can be selected. The selected ear unit may be used to obtain a user's voice signal in conjunction with the electronic device 210 . For example, the at least one processor 350 selects an ear unit whose wearing state is found to be close to the reference wearing state from among the first ear unit and the second ear unit, and selects a plurality of ear units included in the selected ear unit. A user's voice signal may be acquired using the microphones.

In an embodiment, the at least one processor 350 may detect a declination angle of the ear unit based on a sensing signal measured with respect to the selected ear unit. The declination angle is an error angle due to a difference between the confirmed current wearing state and the reference wearing state with respect to the ear unit. can indicate

In an embodiment, the at least one processor 350 may compensate for a delay with respect to a signal input to one of a plurality of microphones included in the ear unit based on the detected declination angle. When the user's voice signal is acquired using the ear unit, the voice uttered by the user is transmitted from the user's mouth to each of the plurality of microphones due to a difference in distance between the user's mouth and each microphone time may vary. For example, if a second microphone among the microphones included in the ear unit is farther from the user's mouth than the first microphone, a signal input to the second microphone is transmitted to the first microphone when the user speaks. The input signal may be delayed compared to the input signal. The at least one processor 350 may calculate a delay for the input signal of the second microphone based on a distance between the first microphone and the second microphone and the declination angle. The at least one processor 350 may obtain an input signal whose delay has been compensated for the input signal of the second microphone by applying a function for compensating for the calculated delay to the input signal of the second microphone. . According to various embodiments of the present disclosure, at least one processor 350 may generate a voice signal by synthesizing the delay-compensated input signal of the second microphone with an input signal of another microphone included in the ear unit. . At least one processor 350 may transmit the generated voice signal to the electronic device 210 .

4 is a block diagram illustrating a configuration of an electronic device 210 according to an embodiment.

Referring to FIG. 4 , the electronic device 210 is a device that provides wearing guide information corresponding to the wearing state of the ear units checked by the wireless earphone device 200 , and includes a communication module 410 , a display 420 , and at least One processor 430 or memory 440 may be included. In FIG. 4 , the electronic device 210 may correspond to the electronic device 101 shown in FIG. 1 or the electronic device 210 shown in FIG. 2 .

In an embodiment, the communication module 410 (eg, the communication module 190 of FIG. 1 ) is a wireless earphone device (eg, the electronic devices 102 and 104 of FIG. 1 or the wireless earphone device 200 of FIG. 2 ) You can establish a communication connection with and send/receive various data. For example, the communication module 410 may support at least one communication method among cellular, wireless-fidelity (Wi-Fi), Bluetooth, near field communication (NFC), and ultra-wide band (UWB) communication.

In an embodiment, the display 420 (eg, the display module 160 of FIG. 1 ) may display the wearing state of the ear units included in the wireless earphone device 200 or wearing guide information corresponding thereto. According to various embodiments of the present disclosure, the display 420 may display information about a posture or precautions to be taken by the user in the process of measuring the wearing state of the ear units.

In one embodiment, memory 440 (eg, memory 130 of FIG. 1 ), when executed, causes at least one processor 430 (eg, processor 120 of FIG. 1 ) to perform various operations. Controlling instructions can be stored. For example, the at least one processor 430 may perform operations for guiding the user to properly wear the wireless earphone device 200 .

In an embodiment, when a wireless connection with the wireless earphone device 200 is established through the communication module 410 , the at least one processor 430 displays 420 that the wireless connection to the wireless earphone device 200 is normally established. ) can be displayed on the Also, when the at least one processor 430 determines that the wireless connection with the wireless earphone device 200 fails, the at least one processor 430 may display a guide message to check the surrounding network environment on the display 420 .

In an embodiment, the at least one processor 430 may receive a request for checking the wearing state of the ear units of the wireless earphone device 200 to which the wireless connection is established. For example, when the at least one processor 430 receives a user request for checking the wearing state of the ear units, the at least one processor 430 transmits the user request to the wireless earphone device 200, You can run test mode. While the test mode is being executed, the at least one processor 430 may display on the display 420 a guide message for guiding to maintain the front posture while wearing the ear units for accurate measurement. According to various embodiments of the present disclosure, the at least one processor 430 outputs a voice signal having the same content as the guide message through the ear units while the guide message is displayed on the display 420 , the guide The message may be shared with the wireless earphone device 200 .

In an embodiment, the at least one processor 430 may acquire, from the wireless earphone device 200 , information about the wearing state of the ear units checked in response to the user request. According to various embodiments of the present disclosure, upon receiving the user request from the electronic device 210 , the wireless earphone device 200 measures the gravitational acceleration signal of the ear units, and based on the measured gravitational acceleration signal Then, it is possible to check the wearing state of the units. The wearing state may include at least one of a wearing angle, a left-right direction, or a wearing strength of each ear unit. The wireless earphone device 200 may transmit the checked information on the worn state of the ear units to the electronic device 200 .

In an embodiment, the at least one processor 430 may provide wearing guide information for the ear units based on the information about the wearing state of the ear units obtained from the wireless earphone device 200 . For example, if the at least one processor 430 determines that the wearing angle of the left ear unit is rotated by 15 degrees counterclockwise based on the reference wearing state based on the information on the wearing state, the left ear A message instructing the unit to rotate 15 degrees clockwise in the current worn state may be output on the display 420 . As another example, when it is determined that the current wearing state of the ear units corresponds to the reference wearing state, the at least one processor 430 may output a message indicating that the ear units are properly worn. According to various embodiments of the present disclosure, at least one processor 430 may transmit wearing guide information on the ear units to the wireless earphone device 200 . While the wearing guide information is displayed on the display 420 of the electronic device 210 , a voice message including the same content as the wearing guide information may be output through the ear units.

5 is a view for explaining a method of guiding wearing of the wireless earphone device 200 in the electronic device 210, according to an embodiment.

Referring to FIG. 5 , the electronic device 210 may check the wearing state of the ear units 201 and 202 by interworking with the wireless earphone device 200 to which the wireless communication connection is established. In an embodiment, when a wireless connection with the wireless earphone device 200 is established, the electronic device 210 displays that the wireless earphone device 200 is successfully connected, and provides a user guide for wearing the wireless earphone device 200 . An interface 510 may be provided. The user interface 510 for guiding the wearing may include information on how to wear the ear units 201 and 202 and a menu button 515 for performing a wearing test.

In an embodiment, the electronic device 210 may perform a wearing test on the wireless earphone device 200 in response to detecting a user input for the menu button 515 . While performing the wearing test, the electronic device 210 displays messages 520 and 530 related to measurement of wearing states of the ear units 201 and 202 of the wireless earphone device 200 (eg, in FIG. 1 ). may be displayed on the display module 160 or the display 420 of FIG. 4 . According to various embodiments of the present disclosure, the electronic device 210 is configured to minimize the influence of other environmental factors while measuring the wearing state of the ear units 201 and 202. Messages 520 and 530 for guiding the user 500 to maintain the front posture to do so may be output. For example, the electronic device 210 displays a message 520 instructing to maintain the front state in a state in which the ear units 201 and 202 are worn for a first time, and the ear unit 210 for the first time period. The wearing angle and/or left and right directions of the ear units 201 and 202 may be checked based on the acceleration signals measured with respect to the units 201 and 202 . The wearing angle may indicate how much the ear units 201 and 202 are rotated when the current wearing state is compared with the reference wearing state. The left and right directions may indicate whether the left and right directions according to the current wearing state of the ear units 201 and 202 are properly worn. For another example, the electronic device 210 displays a message 530 inducing the user to utter while maintaining the front state while wearing the ear units 201 and 202 for a second time period, and the second time period During the operation, the wearing strength of the ear units 201 and 202 may be checked based on the measured acceleration signal for the ear units 201 and 202 . The wearing strength may indicate whether the ear units 201 and 202 are properly worn in close contact with the user's 500 ear.

In an embodiment, the electronic device 210 may provide wearing guide information corresponding to the confirmed wearing state of the ear units 201 and 202 . For example, the electronic device 210 confirms that the wearing angle of the left ear unit among the ear units 201 and 202 according to the current wearing state is rotated by 15 degrees counterclockwise based on the reference wearing state. Then, a message for guiding the left ear unit to rotate 15 degrees clockwise in the current wearing state may be provided. For another example, if the electronic device 210 determines that the wearing strength of the right ear unit among the ear units 201 and 202 according to the current wearing state is lower than that of the reference wearing state, the electronic device 210 sets the right ear unit to the user ( 500) may provide a message guiding to wear it more closely to the ear.

6A and 6B are diagrams illustrating values of sensing signals that change according to a wearing state of an ear unit, according to an exemplary embodiment. In an embodiment, the wireless earphone device 200 may check the wearing state of the ear units based on a sensing signal measured while the user wears the ear units. The wireless earphone device 200 may acquire the sensing signal from at least one sensor included in each ear unit. According to various embodiments of the present disclosure, the at least one sensor may include an acceleration sensor, and the sensing signal may be an acceleration signal measured using the acceleration sensor. The wireless earphone device 200 provides an acceleration signal sensed for each ear unit using an acceleration sensor included in each ear unit while the user wearing the ear units maintains a front-facing posture without firing. can be obtained. The acceleration signal may include different values according to the wearing state of each ear unit.

6A illustrates an X-axis value of a sensing signal according to a beamforming angle of an ear unit. The beamforming angle indicates a direction in which the ear unit detects a sound generated by a user's utterance, and may be related to positions of a plurality of microphones included in the ear unit. The beamforming angle described in FIG. 6A may mean at which angle the direction in which the ear unit senses sound is formed based on a straight axis connecting any one of the plurality of microphones and the user's mouth. When the beamforming angle of the ear unit is 33 degrees (601), it can be seen that the normalized value in the X-axis direction of the sensing signal represents a value 611 of -0.09 slightly lower than 0 indicated by a dotted line. In addition, when the beamforming angle of the ear unit is 68 degrees (602), the X-axis value of the sensing signal indicates a value 612 of 0.05 slightly higher than 0 indicated by a dotted line, and the beamforming angle of the ear unit is 162 In the case of FIG. 603 , it can be seen that the X-axis value of the sensing signal represents a value 613 of 0.2. As such, it can be confirmed that the normalized value in the X-axis direction of the sensing signal changes according to the beamforming angle of the ear unit.

6B shows X, Y, and Z-axis values of a sensing signal according to a wearing angle of the ear unit. The wearing angle indicates how much the wearing angle according to the wearing state of the ear unit is rotated compared to the standard wearing state, and may be determined based on a straight axis connecting the two microphones included in the ear unit. Referring to FIG. 6B , in the case of the sensing signal 621 measured when the ear unit corresponds to the reference wearing state, a normalized value in the X-axis direction may have a value greater than 0 indicated by a dotted line. When the wearing angle of the ear unit is rotated 90 degrees clockwise based on the reference wearing state, a sensing signal 631 having an X-axis value slightly lower than 0 indicated by a dotted line may be obtained. When the wearing angle of the ear unit is rotated 90 degrees counterclockwise based on the reference wearing state, a sensing signal 641 having an X-axis value substantially similar to 0 indicated by a dotted line may be obtained. As described above, it can be confirmed that the X-axis value of the sensing signal is different according to the wearing angle of the ear unit. According to various embodiments of the present disclosure, the spatial position of the ear unit may be checked in more detail based on the Y-axis value or the Z-axis value in addition to the X-axis value of the sensing signal. When the user wears the ear unit corresponding to the reference wearing state, the wireless earphone device 200 may obtain a sensing signal 622 having a Y-axis value of a level slightly lower than 0. The Y-axis value of the sensing signal 632 obtained in a wearing state in which the wearing angle of the ear unit is rotated 90 degrees in a clockwise direction and sensing obtained in a wearing state in which the wearing angle of the ear unit is rotated 90 degrees in a counterclockwise direction It can be seen that the Y-axis value of the signal 642 is different from the Y-axis value of the sensing signal 622 measured in the reference wearing state. Similarly, the Z-axis value of the sensing signal 623 measured in the ear unit in the standard wearing state has a level almost similar to 0, but the sensing obtained in the wearing state in which the wearing angle of the ear unit is rotated clockwise by 90 degrees It can be seen that the Z-axis value of the signal 633 and the Z-axis value of the sensing signal 643 obtained in a worn state in which the wearing angle of the ear unit is rotated counterclockwise by 90 degrees is a level greater than zero. In this way, the wireless earphone device 200 may check the current wearing angle of the ear unit by comparing the sensing signal measured in the state of wearing the ear unit with the sensing signal of the reference wearing state, and through the analysis of the confirmation result, the Then, it is possible to generate and provide wearing guide information regarding the direction in which the wearing angle of the unit should be rotated.

7 is a diagram illustrating values of sensing signals that change according to wearing of an ear unit in the left and right directions, according to an exemplary embodiment. In an embodiment, the wireless earphone device 200 may determine whether the left and right directions of the ear units are properly worn based on a sensing signal measured while the user wears the ear units. According to various embodiments of the present disclosure, the sensing signal may be an acceleration signal measured for each ear unit while the user wearing the ear units maintains a front-facing posture without uttering.

Referring to FIG. 7 , the first sensing signal obtained when the left ear unit is worn on the user's left ear and the second sensing signal obtained while the left ear unit is worn on the user's right ear may include different values. can Normalized values for each of the X-axis, Y-axis, and Z-axis directions of the first sensing signal measured while the user wears the left ear unit on their left ear may be identified as shown in graphs 711, 712, and 713. When the left ear unit is worn on the user's left ear, the X-axis direction value 711 of the first sensing signal indicates a level greater than 0 indicated by a dotted line, and the Y-axis direction value 712 and the Z value of the first sensing signal The axial value 713 may represent a level lower than zero indicated by the dashed line. On the other hand, when the left ear unit is worn on the user's right ear, the X-axis direction value 721 of the second sensing signal indicates a level smaller than 0 indicated by a dotted line, and the Y-axis direction value of the second sensing signal ( 722 ) and the Z-axis direction value 723 may represent a level of 0 . In this way, the wireless earphone device 200 can confirm whether the left and right directions of the ear unit are properly worn based on the sensing signal measured while the ear unit is worn, and based on the result of the confirmation, the ear unit It is possible to provide guide information regarding left and right wearing.

8 is a diagram illustrating a waveform of a sensing signal that changes according to a wearing strength of an ear unit, according to an exemplary embodiment. In an embodiment, the wireless earphone device 200 may determine whether the ear units are worn in close contact with the user's ear with an appropriate strength based on a sensing signal measured while the user wears the ear units. According to various embodiments of the present disclosure, the sensing signal may be an acceleration signal measured for each ear unit while the user wearing the ear units maintains a front-facing posture while uttering.

Referring to FIG. 8 , in the case of the first sensing signal 811 measured when the user speaks while the ear unit is worn in close contact with the user's ear with an appropriate wearing strength, it is confirmed that the amplitude of the signal waveform is changed within a relatively large range. can be The amplitude of the second sensing signal 812 measured when the user speaks while the ear unit is worn on the user's ear with a lower wearing strength compared to the standard wearing state is changed within a smaller range compared to the first sensing signal 811 can be checked In this way, the wireless earphone device 200 can confirm whether the ear unit is worn in close contact with the user's ear with an appropriate strength based on the sensing signal measured when the user utters the ear unit while wearing the ear unit, and based on the confirmation result As a result, guide information regarding the wearing strength of the ear unit may be provided.

9 is a diagram for describing a method of calculating a delay for a microphone input signal based on a wearing state of an ear unit, according to an exemplary embodiment. In an embodiment, if the wireless earphone device 200 determines that the wearing state of the ear units does not correspond to the reference wearing state even after providing the wearing guide information for the ear units a specified number of times, one of the ear units You can select the ear unit of For example, the wireless earphone device 200 may select an ear unit whose current wearing state is confirmed to be close to the reference wearing state from among the ear units.

Referring to FIG. 9 , in the process in which the wireless earphone device 200 generates a voice signal by the user's utterance, the first microphone 901 and the second microphone 902 included in the selected ear unit detect a time difference. and may receive a signal by the user's utterance. For example, when the user's mouth 903 is positioned on a straight line with the first microphone 901 and the second microphone 902 as shown on the left side of FIG. 9 , the first microphone 901 and the second microphone 902 ), a signal generated by the user's utterance may be input to the second microphone 902 with a delay of d1 911 from the first microphone 901 . When the user's mouth 903 is positioned on a straight line with the first microphone 901 and the second microphone 902 , the distance to the first microphone 901 and the second microphone with respect to the user's mouth 903 Since the distance difference to 902 is the largest, the wireless earphone device 200 can confirm that d1 911 corresponds to the maximum time delay. In FIG. 9 , it is assumed that the maximum time delay d1 911 applied to the input signal of the second microphone 902 is equal to the time for the signal by the user's speech to move from the first microphone 901 to the second microphone 902 . can do. Also, time can be calculated using the formula for dividing distance by speed. By substituting the distance d between the first microphone 901 and the second microphone 902 and the speed of sound (342 m/s) into the above formula, respectively, the maximum time delay d1 (911) is obtained as in Equation 1 below. can be calculated.

In one embodiment, when the linear axis connecting the first microphone 901 and the second microphone 902 included in the selected ear unit rotates clockwise by θ as shown on the right side of FIG. 9 , the second microphone 902 The time delay applied to the input signal of ) can be changed. In this case, the signal generated by the user's utterance may be input to the second microphone 902 with a delay of d2 ( 912 ) from the first microphone ( 901 ). The wireless earphone device 200 may determine the rotation angle θ of the ear unit based on a sensing signal measured with respect to the ear unit. The wireless earphone device 200 may calculate d2 912 as shown in Equation 2 below by reflecting the rotation angle θ of the ear unit based on the maximum time delay d1 911 .

In an embodiment, the wireless earphone device 200 calculates and compensates for a time delay for the input signal of the second microphone 902 according to the wearing state of the ear unit, so that the wireless earphone device 200 such as a call or voice recognition ) can be improved.

10 is a view for explaining a method of compensating for a delay of a microphone input signal of an ear unit, according to an embodiment. A function or operation described with reference to FIG. 10 may be understood as a function performed by at least one processor 350 included in the ear unit of the wireless earphone device 200 of FIG. 3 . The at least one processor 350 may execute instructions (eg, an instruction) stored in the memory 360 to implement the software modules shown in FIG. 10 , and may execute hardware associated with a function (eg, FIG. 3 ). of the communication module 310 , at least one sensor 320 , or a plurality of microphones 330 ).

Referring to FIG. 10 , the wireless earphone device 200 may use a plurality of microphones included in one ear unit selected from among two ear units to generate a voice signal according to a user's utterance. In an embodiment, the ear unit may include at least one acceleration sensor 1001 , a first microphone 901 , a second microphone 902 , or a third microphone 1002 . According to various embodiments, the first microphone 901 and the second microphone 902 may be external microphones mounted on the ear unit, and the third microphone 1002 may be an internal microphone mounted on the ear unit.

In an embodiment, the rotation angle detection module 1010 of the wireless earphone device 200 obtains an acceleration signal measured with respect to the ear unit using at least one acceleration sensor 1001, and receives the obtained acceleration signal. Based on the base, it is possible to detect a declination angle indicating how much the linear axis connecting the first microphone 901 and the second microphone 902 is rotated based on the reference wearing state.

In an embodiment, the delay compensation module 1020 of the wireless earphone device 200 calculates a time delay for the input signal of the second microphone 902 in consideration of the detected declination, and compensates for the calculated time delay. By applying a function to the input signal to the input signal, the time delay for the input signal of the second microphone 902 can be compensated.

In an embodiment, the Beamformer and Noise suppression module 1030 of the wireless earphone device 200 receives signals respectively input to the first microphone 901 , the second microphone 902 , or the third microphone 1002 when the user speaks. can be synthesized. For example, the Beamformer and Noise suppression module 1030 receives the input signal of the second microphone 902 for which the time delay is compensated, the input signal of the first microphone 901 and/or the input of the third microphone 1002 . It can be combined with signals. The beamformer and noise suppression module 1030 may generate a clearer voice signal by removing a noise component from the synthesized signal.

11 is a flowchart illustrating a method of controlling the wireless earphone device 200 according to an embodiment. According to an embodiment, the wireless earphone device 200 is a device that outputs an audio signal or obtains a user's voice signal, and is the electronic device 101 shown in FIG. 1 or the wireless earphone device 200 shown in FIG. 2 . ) can be matched. The operations of FIG. 11 include at least one processor (eg, the processor 120 of FIG. 1 or the at least one processor 350 of FIG. 3 ) included in at least one ear unit among the ear units constituting the wireless earphone device 200 . )) can be done by

Referring to FIG. 11 , in operation 1110 , the wireless earphone device 200 may acquire sensing signals of ear units (eg, ear units 201 and 202 of FIG. 2 ). For example, the wireless earphone device 200 uses at least one sensor (eg, at least one sensor 320 of FIG. 3 ) included in each of the ear units to set the first ear unit measured for the first ear unit. A sensing signal and a second sensing signal measured with respect to the second ear unit may be obtained. According to various embodiments of the present disclosure, the wireless earphone device 200 may be worn on the ear units from an electronic device (eg, the electronic device 210 of FIG. 2 ) in which a wireless connection is established with the wireless earphone device 200 . The first sensing signal and the second sensing signal may be obtained in response to receiving the test request. According to various embodiments of the present disclosure, the first sensing signal and the second sensing signal include a first time interval in which the user wearing the ear units maintains a frontal posture without uttering, and a frontal position while the user utters utterance. Each of the second time intervals for maintaining the posture may be obtained. For example, the wireless earphone device 200 may include a first sensing signal measured for the first ear unit during the first time period and a second sensing signal measured with respect to the second ear unit during the first time period. At least one of a wearing angle or a left and right direction of the ear units may be checked based on the . For another example, the wireless earphone device 200 may provide a first sensing signal measured for the first ear unit during the second time period and a second sensing signal measured with respect to the second ear unit during the second time period. Based on the signal, it is possible to check the wearing strength of the ear units.

According to an embodiment, in operation 1120 , the wireless earphone device 200 may check the wearing state of the ear units based on the first sensing signal and the second sensing signal. The wearing state may include at least one of a wearing angle, a left-right direction, or a wearing strength of each ear unit.

According to an embodiment, in operation 1130 , the wireless earphone device 200 may determine whether the wearing state of the ear units corresponds to the reference wearing state based on the first sensing signal and the second sensing signal. The reference wearing state may indicate a state data range in which the wireless earphone device 200 can provide optimal voice quality. For example, the wireless earphone device 200 compares the first sensing signal and the second sensing signal with a reference signal that is a signal measured in response to the reference wearing state, and based on the comparison result, It may be checked whether the wearing state corresponds to the reference wearing state. As another example, the wireless earphone device 200 may determine whether the first sensing signal and the second sensing signal are included in a range of a reference signal defined as the reference wearing state. As a result of the check, if the wearing state of the ear units corresponds to the reference wearing state (operation 1130 - Yes), the wireless earphone device 200 determines that the ear units are properly worn on the user's ear, and It is possible to end the wearing status check procedure for. As a result of the check, if the wearing state of the ear units does not correspond to the reference wearing state (operation 1130 - NO), the wireless earphone device 200 transmits information on the wearing state of the ear units to the electronic device 210 . can The wireless earphone device 200 acquires wearing guide information corresponding to the wearing state of the ear units from the electronic device 210, and uses the acquired wearing guide information from a speaker (eg, in FIG. 2 ) included in each ear unit. It can be output through the speaker 340). For example, when it is confirmed that the first ear unit and the second ear unit are worn with the left and right directions reversed, wearing guide information instructing the first ear unit and the second ear unit to be worn interchangeably is provided in the current wearing state can be As another example, if it is determined that the wearing strength of the second ear unit is lower than the reference wearing strength, wearing guide information instructing to wear the right ear unit closer to the user's ear may be provided. While the wearing guide information is output from the ear units, a user interface including the wearing guide information may be displayed on the display of the electronic device 210 . According to various embodiments of the present disclosure, checking the wearing state of the ear units and providing wearing guide information corresponding to the confirmed wearing state may be repeatedly performed a specified number of times. After providing the wearing guide information, the wireless earphone device 200 re-measures a first sensing signal for the first ear unit and a second sensing signal for the second ear unit, and the re-measured first sensing signal It may be determined whether the changed wearing state of the ear units corresponds to the reference wearing state based on the signal and the second sensing signal. The wireless earphone device 200 may provide again wearing guide information corresponding to the changed wearing state according to the confirmation result. If the wearing state of the ear units checked after providing the wearing guide information a specified number of times is still different from the reference wearing state, the wireless earphone device 200 may determine that the wearing state of the ear units does not correspond to the reference wearing state. It is determined that no, one ear unit to be used for generating the user's voice signal among the ear units may be determined.

According to an embodiment, in operation 1140 , the wireless earphone device 200 may select one ear unit from among the ear units based on the confirmed current wearing state of the ear units. For example, the wireless earphone device 200 selects, among the first ear unit and the second ear unit, an ear unit whose wearing state is found to be close to the reference worn state as the ear unit for acquiring the user's voice signal. can

According to an embodiment, in operation 1150 , the wireless earphone device 200 may detect a declination of the ear unit based on a sensing signal measured with respect to the selected ear unit. The declination angle is an error angle due to a difference between the confirmed current wearing state and the reference wearing state with respect to the ear unit. can indicate

According to an embodiment, in operation 1160 , the wireless earphone device 200 may compensate for a delay of a signal input to one of a plurality of microphones included in the ear unit based on the detected declination angle. According to various embodiments of the present disclosure, if a second microphone among the microphones included in the ear unit is farther from the user's mouth than the first microphone, the signal input to the second microphone when the user speaks is The signal may be input with a delay compared to the signal input to the first microphone. The wireless earphone device 200 calculates a delay for the input signal of the second microphone based on the distance and the declination between the first microphone and the second microphone, and calculates the delay for the input signal of the second microphone. By applying a function for compensating for the delay, delay compensation can be performed on the input signal of the second microphone. According to various embodiments of the present disclosure, the wireless earphone device 200 generates a voice signal by synthesizing the delay-compensated input signal of the second microphone with the input signal of another microphone included in the ear unit, and the generated A voice signal may be transmitted to the electronic device 210 .

12 is a view for explaining a method of guiding a wearing state of the wireless earphone device 200 and correcting an output signal, according to an embodiment.

Referring to FIG. 12 , a wireless connection between the wireless earphone 200 and the electronic device 210 may be established in operation 1201 . The wireless connection is a short-range wireless network such as Bluetooth, Bluetooth Low Energy (BLE), Wi-Fi direct, near field communication (NFC), ultra-wide band (UWB) communication, or infrared (infra-red) communication. can be set based on

According to an embodiment, in operation 1203 , the wireless earphone device 200 may detect that two ear units constituting the wireless earphone device 200 are worn on the user's ear. The wireless earphone device 200 may determine whether each ear unit is worn based on a sensing signal detected from at least one sensor included in each ear unit.

According to an embodiment, in operation 1205 , the electronic device 210 may obtain a user request for measuring the wearing state of the wireless earphone device 200 . According to various embodiments of the present disclosure, the electronic device 210 may transmit the obtained user request to the wireless earphone device 200 and execute a test mode for measuring the wearing state of the wireless earphone device 200 . The electronic device 210 may display a user interface for measuring the wearing state of the wireless earphone device 200 in response to the user request. For example, the electronic device 210 may display a message guiding to maintain the front posture while wearing the ear units while the test mode is executed. The electronic device 210 may control to output a voice message including the same content as the message through the ear units while the test mode is executed.

According to an embodiment, in operation 1207 , the wireless earphone device 200 may check the wearing state of the ear units based on sensing signals sensed for each ear unit. For example, based on the acceleration signal measured for each ear unit, the wireless earphone device 200 determines how much the wearing angle of each ear unit is shifted based on the reference wearing angle and whether each ear unit is worn in the left and right directions. , or how closely each ear unit is worn to the user's ear can be checked. In operation 1207 , the wireless earphone device 200 may transmit the checked information regarding the wearing state of each ear unit to the electronic device 200 .

According to an embodiment, in operation 1209 , the electronic device 210 may provide wearing guide information corresponding to the wearing state of the ear units based on the information about the wearing state obtained from the wireless earphone device 200 . . For example, if information indicating that the wearing angle of the left ear unit is rotated by 15 degrees counterclockwise based on the reference wearing angle is received, the electronic device 210 sets the wearing angle of the left ear unit clockwise by 15 It is also possible to display wearing guide information instructing to rotate. For another example, if information indicating that the wearing strength of the right ear unit is lower than the reference wearing strength is received, the electronic device 210 may display wearing guide information instructing to wear the right ear unit closer to the user's ear. can be displayed. According to various embodiments of the present disclosure, while displaying the wearing guide information, the electronic device 210 may control to output a voice message including the same content as the wearing guide information through the ear units.

According to various embodiments of the present disclosure, operations 1207 to 1209 may be repeatedly performed a specified number of times while the test mode for measuring the wearing state of the ear units is executed. The wireless earphone device 200 may re-measure the wearing state of the ear units changed after the provision of the wearing guide information, and check whether the re-measured wearing state corresponds to the reference wearing state. As a result of the check, if the changed wearing state of the ear units corresponds to the reference wearing state, the wearing test may be ended. As a result of the check, if the changed wearing state of the ear units still does not correspond to the reference wearing state, wearing guide information corresponding to the changed wearing state may be additionally provided.

According to an embodiment, if the wireless earphone device 200 determines that the changed wearing state of the ear units still does not correspond to the reference wearing state after providing the wearing guide information for the specified number of times in operation 1211, in operation 1213 One of the ear units may be selected. For example, the wireless earphone device 200 may acquire the user's voice signal by selecting an ear unit whose current wearing state is confirmed to be close to the reference wearing state from among the ear units.

According to an embodiment, in operation 1215 , the wireless earphone device 200 may detect a declination angle of the selected ear unit. The declination angle is an error angle due to a difference between the current wearing state and the reference wearing state confirmed with respect to the ear unit, and may indicate how much the current wearing angle of the ear unit is rotated based on the reference wearing state. . The wireless earphone device 200 may detect the declination angle based on a sensing signal measured with respect to the ear unit.

According to an embodiment, in operation 1217 , the wireless earphone device 200 may compensate for a delay of a signal input to one of a plurality of microphones included in the selected ear unit based on the detected declination angle. For example, the wireless earphone device 200 may calculate a delay for a signal input to the second microphone based on a distance between the first microphone and the second microphone included in the ear unit and the detected declination angle. . The wireless earphone device 200 compensates for the delay with respect to the input signal of the second microphone by applying a function for compensating for the calculated delay to the input signal of the second microphone, and transmits the delay-compensated input signal to the second microphone. 1 It is possible to obtain a voice signal by synthesizing it with the input signal of the microphone. The wireless earphone device 200 may transmit the obtained voice signal to the electronic device 210 .

The wireless earphone device (eg, the wireless earphone device 200) according to an embodiment includes two ear units (eg, the ear units 201 and 202), and at least one of the two ear units The ear unit of the communication module (eg, communication module 310), at least one sensor (eg, sensor 320), a plurality of microphones (eg, microphone 330), the communication module, the at least one at least one processor (eg, 350) operatively coupled to a sensor and the plurality of microphones, and a memory (eg, 360) operatively coupled to the at least one processor, the memory comprising: The at least one processor checks the wearing state of the ear units based on a first sensing signal of the at least one sensor and a second sensing signal received from another ear unit through the communication module, If it is confirmed that the wearing state does not correspond to the reference state, one of the ear units is selected based on the wearing state of the ear units, and the ear unit is moved based on a sensing signal for the selected ear unit. and storing instructions for detecting a declination angle and compensating for a delay for a signal input to one of a plurality of microphones included in the ear unit based on the detected declination angle, wherein the declination angle corresponds to a reference state of the ear unit It may be an error angle due to a difference in the worn state identified with respect to the ear unit.

In an embodiment, the instructions include, by the at least one processor, obtaining a first gravitational acceleration signal measured for a first time period using the at least one sensor, and obtaining the first gravitational acceleration signal from the other ear unit in the first time period acquiring a second gravitational acceleration signal measured while , may be a time period in which the user wearing the ear units maintains a front-facing posture without uttering.

In an embodiment, the instructions include, by the at least one processor, to obtain a third gravitational acceleration signal measured using the at least one sensor during a second time interval, and to obtain the third gravitational acceleration signal from the other ear unit during the second time interval acquire a fourth gravitational acceleration signal measured during It may be a time period in which the wearing user maintains a front-facing posture while uttering.

In an embodiment, the instructions include, by the at least one processor, comparing the first sensing signal and the second sensing signal with a reference signal indicating the measurement signal of the reference state, and based on the comparison result Then, it is possible to check the wearing state of the units.

In an embodiment, the instructions receive, by the at least one processor, a wear test request for the ear units from an electronic device (eg, the electronic device 200 ) to which a wireless connection is established through the communication module, The first sensing signal and the second sensing signal are obtained based on the wearing test request, and information on the wearing state of the ear units checked based on the first sensing signal and the second sensing signal is transmitted to the electronic device. It can be sent to the device.

In an embodiment, the at least one ear unit further includes a speaker (eg, a speaker 340 ), and the instructions are configured such that the at least one processor responds to a wearing state of the ear units from the electronic device. It is possible to receive wearing guide information and output the received wearing guide information through the speaker.

In an embodiment, the instructions include, by the at least one processor, a first sensing signal obtained from the at least one sensor after outputting the wearing guide information, and a second sensing received from the other ear unit through the communication module It is possible to check the wearing state of the ear units based on the signal, and determine whether the checked wearing state of the ear units corresponds to the reference state.

In an embodiment, the instructions include, when the at least one processor outputs the wearing guide information a specified number of times and determines that the wearing state of the ear units does not correspond to the reference state, the ear unit Among them, an ear unit whose wearing state is close to the reference state may be selected.

In an embodiment, the instructions include, by the at least one processor, a first microphone (eg, a first microphone 901) and a second microphone (eg, a second microphone) among a plurality of microphones included in the selected ear unit. The second microphone 902) calculates a delay with respect to the input signal of the second microphone based on the distance and the declination angle, and applies a function for compensating for the calculated delay to the input signal of the second microphone. 2 It is possible to obtain an input signal that is delay-compensated with respect to the input signal of the microphone.

In an embodiment, the instructions include: the at least one processor synthesizes the delay-compensated input signal with the input signal of the first microphone to generate a voice signal, and transmits the generated voice signal to the ear units and the wireless connection can be transmitted to the established electronic device.

According to another exemplary embodiment, the method of operating in one ear unit among ear units constituting the wireless earphone device includes a first sensing signal measured in the ear unit and a second sensing signal received from the other ear unit. If the operation of detecting the wearing of the ear units, the operation of confirming the wearing state of the ear units based on the first sensing signal and the second sensing signal, and confirming that the wearing state of the ear units does not correspond to the reference state, , an operation of selecting one ear unit among the ear units based on a wearing state of the ear units, an operation of detecting a declination angle of the selected ear unit, and a plurality of pieces included in the ear unit based on the detected declination angle and compensating for a delay for a signal input to one of the microphones, wherein the declination angle may be an error angle caused by a difference between a reference state of the ear unit and a worn state of the ear unit.

In an embodiment, the checking of the wearing state of the ear units includes: obtaining a first gravitational acceleration signal measured during a first time period using at least one sensor included in the ear unit; Acquiring the second gravitational acceleration signal measured during the first time period from the and the first time period may be a time period in which the user wearing the ear units maintains a front-facing posture without uttering.

In an embodiment, the checking of the wearing state of the ear units includes obtaining a third gravitational acceleration signal measured for a second time period using the at least one sensor, the second time from another ear unit Acquiring a fourth gravitational acceleration signal measured during the section, and checking the wearing strength of the ear units based on the third gravitational acceleration signal and the fourth gravitational acceleration signal, wherein the second time section , may be a time period in which a user wearing the ear units maintains a front-facing posture while uttering.

In an embodiment, the operation of checking the wearing state of the ear units includes an operation of comparing the first sensing signal and the second sensing signal with a reference signal indicating the measurement signal of the reference state, and the comparison result based on the operation of checking the wearing state of the ear units.

In an embodiment, the method includes receiving a wear test request for the ear units from an electronic device in which a wireless connection is established with the ear units, and the first sensing signal and the second sensor based on the wear test request. The method may further include an operation of acquiring a second sensing signal, and an operation of transmitting, to the electronic device, information about a wearing state of the ear units checked based on the first sensing signal and the second sensing signal.

In an embodiment, the method includes receiving, from the electronic device, wearing guide information corresponding to the wearing state of the ear units, and outputting the received wearing guide information through a speaker included in the ear units. It may further include an action.

In an embodiment, the method includes: After outputting the wearing guide information, checking the wearing state of the ear units based on a first sensing signal measured by the ear unit and a second sensing signal received from the other ear unit , and determining whether the identified wearing state of the ear units corresponds to the reference state.

In an embodiment, if it is determined that the worn state of the ear units checked after outputting the wearing guide information a specified number of times does not correspond to the reference state, the wearing state among the ear units is the The method may further include selecting an ear unit close to the reference state.

In an embodiment, compensating for a delay for a signal input to one of the plurality of microphones may include: based on a distance between a first microphone and a second microphone included in the selected ear unit, and the declination angle Calculating a delay with respect to the input signal of the second microphone, and applying a function for compensating for the calculated delay to the input signal of the second microphone to obtain a delay-compensated input signal with respect to the input signal of the second microphone It may include an action to

In one embodiment, the method includes generating a voice signal by synthesizing the delay-compensated input signal with the input signal of the first microphone, and using the generated voice signal to establish a wireless connection with the ear units The operation of transmitting to the electronic device may be further included.

The electronic device according to various embodiments disclosed in this document may be a device of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C," "at least one of A, B and C," and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as “first”, “second”, or “first” or “second” may simply be used to distinguish the component from other such components, and refer to those components in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present document, one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101) may be implemented as software (eg, the program 140) including For example, the processor (eg, the processor 120 ) of the device (eg, the electronic device 101 ) may call at least one of the one or more instructions stored from the storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term refers to the case where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to an embodiment, the method according to various embodiments disclosed in this document may be provided by being included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store™) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly or online between smartphones (eg smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, omitted, or , or one or more other operations may be added.

Claims (20)

In the wireless earphone device,
Includes two ear units,
At least one ear unit of the two ear units,
communication module;
at least one sensor;
a plurality of microphones;
at least one processor operatively coupled to the communication module, the at least one sensor, and the plurality of microphones; and
a memory operatively coupled to the at least one processor;
The memory, when executed, the at least one processor,
checking the wearing state of the ear units based on a first sensing signal of the at least one sensor and a second sensing signal received from another ear unit through the communication module;
If it is confirmed that the wearing state of the ear units does not correspond to the reference state, selecting one ear unit among the ear units based on the wearing state of the ear units,
detecting a declination angle of the ear unit based on a sensing signal for the selected ear unit;
storing instructions for compensating for a delay for a signal input to one of a plurality of microphones included in the ear unit based on the detected declination angle;
The declination angle is an error angle caused by a difference between a reference state of the ear unit and a worn state confirmed for the ear unit. The method according to claim 1,
The instructions, the at least one processor,
Obtaining a first gravitational acceleration signal measured for a first time period using the at least one sensor,
obtaining a second gravitational acceleration signal measured during the first time period from the other ear unit;
to check at least one of a wearing angle or a left and right direction of the ear units based on the first gravitational acceleration signal and the second gravitational acceleration signal,
The first time period is a time period in which the user wearing the ear units maintains a front-facing posture without uttering, the wireless earphone device. The method according to claim 1,
The instructions, the at least one processor,
Obtaining a third gravitational acceleration signal measured using the at least one sensor during a second time period,
obtaining a fourth gravitational acceleration signal measured during the second time period from the other ear unit;
to check the wearing strength of the ear units based on the third gravitational acceleration signal and the fourth gravitational acceleration signal,
The second time interval is a time interval in which the user wearing the ear units maintains a front-facing posture while speaking. The method according to claim 1,
The instructions, the at least one processor,
comparing the first sensing signal and the second sensing signal with a reference signal indicating the measurement signal of the reference state;
and to check the wearing state of the ear units based on the comparison result. The method according to claim 1,
The instructions, the at least one processor,
receiving a wear test request for the ear units from an electronic device in which a wireless connection is established through the communication module;
Obtaining the first sensing signal and the second sensing signal based on the wear test request,
and transmits, to the electronic device, information on a wearing state of the ear units, which is confirmed based on the first sensing signal and the second sensing signal. 6. The method of claim 5,
The at least one ear unit further comprises a speaker,
The instructions, the at least one processor,
Receive wearing guide information corresponding to the wearing state of the ear units from the electronic device,
and outputting the received wearing guide information through the speaker. 7. The method of claim 6,
The instructions, the at least one processor,
After outputting the wearing guide information, the wearing state of the ear units is checked based on a first sensing signal obtained from the at least one sensor and a second sensing signal received from the other ear unit through the communication module,
and to check whether the confirmed wearing state of the ear units corresponds to the reference state. 8. The method of claim 7,
The instructions, the at least one processor,
After outputting the wearing guide information for a specified number of times, if it is confirmed that the worn state of the ear units does not correspond to the reference state, select an ear unit whose wearing state is close to the reference state among the ear units which is a wireless earphone device. The method according to claim 1,
The instructions, the at least one processor,
calculating a delay for an input signal of the second microphone based on a distance between a first microphone and a second microphone among a plurality of microphones included in the selected ear unit and the declination angle;
and applying a function for compensating for the calculated delay to the input signal of the second microphone to obtain a delay-compensated input signal with respect to the input signal of the second microphone. 10. The method of claim 9,
The instructions, the at least one processor,
generating a voice signal by synthesizing the delay-compensated input signal with the input signal of the first microphone;
A wireless earphone device for transmitting the generated voice signal to an electronic device in which a wireless connection with the ear units is established. A method of operating in one ear unit among ear units constituting a wireless earphone device, the method comprising:
obtaining a first sensing signal measured by the ear unit and a second sensing signal received from another ear unit;
checking the wearing state of the ear units based on the first sensing signal and the second sensing signal;
selecting one of the ear units based on the wearing state of the ear units when it is confirmed that the wearing state of the ear units does not correspond to the reference state;
detecting a declination angle of the selected ear unit; and
Compensating for a delay for a signal input to one of a plurality of microphones included in the ear unit based on the detected declination angle;
The declination angle is an error angle caused by a difference between a reference state of the ear unit and a worn state confirmed for the ear unit. 12. The method of claim 11,
The operation of checking the wearing state of the ear units is,
obtaining a first gravitational acceleration signal measured during a first time period using at least one sensor included in the ear unit;
acquiring a second gravitational acceleration signal measured during the first time period from another ear unit; and
and checking at least one of a wearing angle or a left and right direction of the ear units based on the first gravitational acceleration signal and the second gravitational acceleration signal,
The first time interval is a time interval in which the user wearing the ear units maintains a front-facing posture without uttering. 13. The method of claim 12,
The operation of checking the wearing state of the ear units is,
obtaining a third gravitational acceleration signal measured during a second time period using the at least one sensor;
acquiring a fourth gravitational acceleration signal measured during the second time period from another ear unit; and
and checking the wearing strength of the ear units based on the third gravitational acceleration signal and the fourth gravitational acceleration signal,
The second time interval is a time interval in which the user wearing the ear units maintains a front-facing posture while speaking. 12. The method of claim 11,
The operation of checking the wearing state of the ear units is,
comparing the first sensing signal and the second sensing signal with a reference signal indicating the measurement signal of the reference state; and
and checking a wearing state of the ear units based on the comparison result. 12. The method of claim 11,
receiving a wear test request for the ear units from an electronic device in which a wireless connection is established with the ear units;
obtaining the first sensing signal and the second sensing signal based on the wear test request; and
The method further comprising the operation of transmitting, to the electronic device, information about the wearing state of the ear units, which is confirmed based on the first sensing signal and the second sensing signal. 16. The method of claim 15,
receiving, from the electronic device, wearing guide information corresponding to the wearing state of the ear units; and
The method further comprising outputting the received wearing guide information through a speaker included in the ear units. 17. The method of claim 16,
checking the wearing state of the ear units based on a first sensing signal measured by the ear unit and a second sensing signal received from the other ear unit after outputting the wearing guide information; and
The method further comprising the operation of confirming whether the identified wearing state of the ear units corresponds to the reference state. 18. The method of claim 17,
After outputting the wearing guide information for a specified number of times, if it is confirmed that the worn state of the ear units does not correspond to the reference state, selecting an ear unit whose wearing state is close to the reference state among the ear units A method further comprising an action. 12. The method of claim 11,
Compensating for a delay for a signal input to one of the plurality of microphones comprises:
calculating a delay with respect to an input signal of the second microphone based on a distance between a first microphone and a second microphone included in the selected ear unit and the declination angle; and
and obtaining a delay-compensated input signal with respect to the input signal of the second microphone by applying a function for compensating for the calculated delay to the input signal of the second microphone. 20. The method of claim 19,
generating a voice signal by synthesizing the delay-compensated input signal with the input signal of the first microphone; and
Transmitting the generated voice signal to an electronic device having a wireless connection with the ear units
A method further comprising:

Images