KR20220103543A - Wearable device and method performing automatic sound control - Google Patents

Abstract

A wearable device in one embodiment comprises: a microphone; a communication circuit that transmits/receives a control signal to an external device; and at least one processor in electrical connection with the microphone and the communication circuit, wherein the at least one processor obtains a first audio signal from an external device using a microphone in a state in which the wearable device is worn to the body of a user, obtains a second audio signal from the external device using the microphone in response to a lapse of a set time, determines a type of wearing space of the user based on the first audio signal and the second audio signal, and enables a volume of the external device to be controlled using the communication circuit based on the audio output control method corresponding to the type of wearing space. Therefore, the present invention is capable of increasing a user convenience.

Description

WEARABLE DEVICE AND METHOD PERFORMING AUTOMATIC SOUND CONTROL

Various embodiments according to the present disclosure relate to a wearable device that controls the volume of an external device that outputs a sound, and more particularly, controls the volume of the external device based on the location and space of a user wearing the wearable device It's about technology.

Wearable electronic devices that are worn on the user's body (eg, wrist) to control external electronic devices (eg, headset, earphone, smart glasses, head mounted device: HMD); Smart watch (smart watch) is becoming popular. The number of users who use various services (eg, listening to music, watching a video, and making a voice call) by using a wearable electronic device is increasing. For example, a wearable device connects to an external electronic device (eg, a TV, Bluetooth speaker, smart phone, tablet PC, notebook, desktop, or wearable device) wired or wirelessly to provide various services (eg: Watching broadcasts, listening to music, watching videos) can be provided.

The wearable device may provide various services by being connected to an external electronic device that outputs audio by wire or wirelessly. However, the position of the user wearing the wearable device may continuously change, but when the external electronic device is in a fixed position, an obstacle may occur in effective service provision. For example, the size of the audio volume recognized by the user may vary according to the user's distance from the external electronic device including the video display device or the audio device. When the user moves away from the external electronic device, a perceived volume based on a sound output from the external electronic device may decrease. Also, when the user approaches the external electronic device, a perceived volume based on a sound output from the external electronic device may increase. As another example, since the external electronic device is in a fixed position, the user does not have the will to listen to the sound output from the external electronic device, so even when the user moves to a different space from the external electronic device, the external electronic device continues to output sound and makes unnecessary noise. This can happen.

When a user hears a sound using a plurality of external electronic devices, a perceived volume of a sound output from a specific external electronic device may vary according to a distance between the plurality of external electronic devices and the user.

When a user speaks for a conversation with another while listening to music or watching an image using the external electronic device, the conversation may be interrupted by the sound of the external electronic device.

The technical problems to be achieved in various embodiments of the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned are clear to those of ordinary skill in the art to which the present invention belongs from the description below. will be able to understand

The wearable device according to an embodiment includes a microphone, a communication circuit for transmitting and receiving a control signal to and from an external device, and at least one processor electrically connected to the microphone and the communication circuit, wherein the at least one processor is configured to allow the wearable device to operate on the user's body. A first audio signal is obtained from an external device using a microphone in a state of being worn, and a second audio signal is obtained from an external device using a microphone in response to the lapse of a set time, and a first audio signal and a second audio signal may determine the type of the user's wearing space based on the , and control the volume of the external device using the communication circuit based on the audio output control method corresponding to the type of the wearing space.

According to an embodiment, in a method of operating a wearable device including a microphone and a communication circuit for transmitting and receiving a control signal to and from an external device, the wearable device receives a first audio signal from an external device using a microphone while the wearable device is worn on a user's body. an operation of acquiring, an operation of acquiring a second audio signal from an external device using a microphone in response to the lapse of a set time, an operation of determining the type of the user's wearing space based on the first audio signal and the second audio signal, and It may include an operation of controlling a volume of an external device using a communication circuit based on an audio output control method corresponding to the type of the wearing space.

A wearable device according to an embodiment includes a microphone, a communication circuit for transmitting and receiving control signals to and from a plurality of external devices, and at least one processor electrically connected to the microphone and the communication circuit, wherein the at least one processor includes the wearable device A third audio signal is obtained from each of a plurality of devices using a microphone in a state worn on the user's body, and a fourth audio signal is obtained from each of a plurality of external devices using a microphone in response to the lapse of a set time, , determine the distances between the user and the plurality of external devices based on the third audio signal and the fourth audio signal, and control the volume of at least one of the plurality of external devices using a communication circuit based on the determination result have.

A wearable device according to various embodiments of the present disclosure may automatically control an audio output of an external device including an audio device or an image display device.

A wearable device according to various embodiments of the present disclosure may automatically control the volume of an external device only with a microphone and a processor included in the wearable device without a separate sensor in the space for detecting or calculating the user's space or location. The wearable device according to the present disclosure may increase the user's convenience by controlling the volume of the external device using a different control method according to the type of the user's wearing space.

According to various embodiments of the present disclosure, the wearable device may output a sound capable of providing a perceived volume similar to the initially set volume without receiving a user input for adjusting the volume of the external device even if the location of the user changes. can

The wearable device according to various embodiments of the present disclosure may control the volume of the external device so that the sound output by the external device does not interfere with conversation.

Effects obtainable in the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those of ordinary skill in the art to which the present disclosure belongs from the description below. will be.

1 is a diagram illustrating an example of a system including a wearable device and an external device connected through wireless communication according to an embodiment.
2 is a block diagram illustrating a configuration of a wearable device according to an exemplary embodiment.
3 is a diagram illustrating an example of a type of wearing space divided based on an external device.
4A is a diagram illustrating controlling a volume of an external device based on a change in a user's position in a first space, according to an exemplary embodiment.
4B is a diagram illustrating a change in an audio signal based on a user's movement in a first space according to an exemplary embodiment.
5 is a diagram for describing a signal processing method for determining a distance between a user and an external device based on acquired audio signals, according to an exemplary embodiment.
6A is a diagram illustrating movement of a user from a first space to a second space, according to an exemplary embodiment.
6B is a diagram illustrating a change in a received audio signal as a user moves from a first space to a second space, according to an embodiment.
7A is a diagram illustrating movement of a user from a first space to a third space, according to an exemplary embodiment.
7B is a diagram illustrating a change in a received audio signal as a user moves from a first space to a third space, according to an exemplary embodiment.
8 is a flowchart of a process of controlling a volume of an external device based on a user's location in a wearable device according to an exemplary embodiment.
9 is a flowchart of a process of controlling a volume of an external device by classifying a user's space type in a wearable device according to an exemplary embodiment.
10 is a diagram illustrating control of a volume of an external device according to a user's utterance in a wearable device according to an exemplary embodiment.
11A is a diagram illustrating a location of a user with respect to a plurality of external devices, according to an exemplary embodiment.
11B is a diagram illustrating controlling a volume of at least one external device based on a distance from a plurality of external devices, according to an exemplary embodiment.
12 is a block diagram of an electronic device in a network environment according to an embodiment.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

1 is a diagram illustrating an example in which a wearable device is connected to an external device by wireless communication according to an exemplary embodiment.

According to an embodiment, the wearable device 100 of FIG. 1 may be a smart watch as shown. The present invention is not limited thereto, and the wearable device 100 may be a device of various types that can be used while being attached to a user's body. For example, the wearable device 100 may include a head mounted device (HMD) or smart glasses.

According to an embodiment, the wearable device 100 may include the strap 130 , and the strap 130 may be attached to the user's body by being wound around the user's wrist. The present invention is not limited thereto, and the wearable device 100 may be attached to various body parts of the user according to the shape and size of the wearable device 100 . For example, the wearable device 100 may also be attached to a hand, the back of a hand, a finger, a fingernail, a fingertip, or the like.

According to an embodiment, the external device 110 of FIG. 1 may be a speaker as shown. However, the present invention is not limited thereto, and the external device 110 may be various types of electronic devices that output sound at a temporarily fixed position. For example, it may include an audio device (eg, a connected speaker) and an image display device (eg, a network TV, HBBTV, smart TV, smart phone, notebook computer, tablet PC).

According to an embodiment, the external device 110 may output audio data (eg, music data, audio data included in a moving picture) stored in the internal memory. According to an embodiment, the external device 110 may establish a wireless communication channel with the wearable device 100 . For example, the communication circuit 230 is a communication module of Bluetooth (Bluetooth), RF (Radio Frequency) communication, infrared (IR) communication, Wi-Fi (WIFI), UWB (Ultra-wideband) and / or Zigbee (Zigbee) communication module. is available. In an embodiment, the external device 110 may receive and output audio data from the wearable device 100 through a channel connection.

2 is a block diagram illustrating a configuration of a wearable device according to an exemplary embodiment.

Referring to FIG. 2 , the wearable device 100 may include a processor 210 , a microphone 220 , a communication circuit 230 , and a memory 240 . In various embodiments, the wearable device 100 may include additional components in addition to the components illustrated in FIG. 2 or may omit at least one of the components illustrated in FIG. 2 . The components listed above may be operatively or electrically connected to each other. The wearable device 100 may omit at least some of the components illustrated in FIG. 2 or may further include other components. Some of the components of the wearable device 100 illustrated in FIG. 2 may be replaced with other components performing similar functions. The components illustrated in FIG. 2 may include at least one piece of hardware.

According to an embodiment, the processor 210 may control the overall operation of the wearable device 100 . For example, the processor 210 may be electrically connected to the microphone 220 , the communication circuit 230 , and the memory 240 to perform a specified operation. According to an embodiment, the processor 210 may execute an operation or data processing related to control and/or communication of at least one other component of the wearable device 100 using instructions stored in the memory 240 . According to an embodiment, the processor 210 includes a central processing unit (CPU), a graphics processing unit (GPU), a micro controller unit (MCU), a sensor hub, a supplementary processor, a communication processor, and an application. It may include at least one of a processor (application processor), application specific integrated circuit (ASIC), and field programmable gate arrays (FPGA), and may have a plurality of cores.

According to an embodiment, the microphone 220 may acquire an external sound and analyze the acquired external sound. For example, the microphone 220 may obtain a sound from the external device 110 and convert it into an audio signal. According to an embodiment, the microphone 220 may receive the user's utterance of the wearable device 100 and convert it into an electrical signal.

According to an embodiment, the communication circuit 230 may communicate with the external device 110 described with reference to FIG. 1 . For example, the wearable device 100 may transmit a control signal to the external device 110 using the communication circuit 230 . Also, the wearable device 100 may transmit audio data to the external device 110 using the communication circuit 230 .

According to an embodiment, the memory 240 may store various data acquired or used by at least one component (eg, a processor, a microphone) of the wearable device 100 . For example, the memory 240 may store audio data to be output through the external device 110 . In addition, the memory 240 may store information about the user's utterance of the wearable device 100 acquired using the microphone 220 .

According to an embodiment, the processor 210 may obtain an audio signal from the external device 110 using the microphone 220 while the wearable device 100 is worn on the user's body. For example, when the external device 110 outputs sound (audio data), the microphone 220 may convert the detected sound into an electrical signal and provide it to the processor 210 . According to an embodiment, the external device 110 may output a sound based on audio data stored in an internal memory of the external device 110 or audio data received from the wearable device 100 .

According to an embodiment, the processor 210 may control the volume of the external device 110 using the communication circuit 230 . In an embodiment, the processor 210 may control the volume of the external device 110 based on a user input (eg, a volume control button touch input, a voice signal input) for controlling the volume of the external device 110 . have. For example, the processor 210 transmits a volume control signal to the external device 110 using the communication circuit 230 , and the external device 110 adjusts the volume of the output sound based on the received volume control signal. can

According to an embodiment, the processor 210 may acquire the first audio signal through the microphone 220 based on the volume control of the external device 110 through a user input. For example, when there is no user input for a predetermined time after continuous user input for volume control, the processor 210 may obtain the first audio signal through the microphone 220 . Accordingly, the processor 210 includes information on the sound detected by the wearable device 100 through the microphone 220 while the external device 110 outputs the sound based on the volume adjusted by the user input. A first audio signal may be obtained. That is, when the processor 210 performs an input for controlling the volume of the external device 110 according to the user's desired volume, the first audio signal from the external device 110 through the microphone 220 based on the user input can be obtained. The processor 210 may store the first audio signal in the memory 240 .

In an embodiment, after obtaining the first audio signal, the processor 210 may obtain the second audio signal from the external device 110 using the microphone 220 . According to an embodiment, the processor 210 may acquire the second audio signal after a set time elapses after acquiring the first audio signal. For example, the processor 210 may periodically acquire the second audio signal every 10 seconds after there is a user input for volume control. According to another embodiment, the processor 210 may continuously acquire the second audio signal from the external device 110 using the microphone 220 . According to another embodiment, the processor 210 may acquire the second audio signal in response to the movement of the wearable device 100 . For example, the processor 210 detects movement information (eg, an acceleration value) of the wearable apparatus 100 using a motion sensor included in the wearable apparatus 100 , and the size of the movement information is critical. When the value is greater than or equal to the value, the second audio signal may be acquired.

According to an embodiment, the processor 210 may determine the type of the user's wearable device 100 wearing space based on the first audio signal and the second audio signal. A description of the type of the wearing space according to an embodiment will be described later with reference to FIG. 3 .

The processor 210 according to an embodiment may determine the type of the wearing space of the wearable device 100 by comparing the first audio signal and the second audio signal. For example, it may be determined whether it is in the same space as the external device 110 among a plurality of separated spaces. According to an embodiment, the processor 210 may determine the distance from the external device 110 to the user wearing the wearable device 100 by comparing the first audio signal and the second audio signal. For example, the processor 210 may determine the distance between the user and the external device 110 when acquiring the first audio signal and the distance between the user and the external device 110 when acquiring the second audio signal. have. Accordingly, the processor 210 may determine a change in the distance of the user from the external device 110 according to the time point at which the first audio signal is obtained and the time point at which the second audio signal is obtained.

According to an embodiment, the processor 210 controls the volume of the external device 110 using the communication circuit 230 based on a volume control method corresponding to the type of the wearing space of the user wearing the wearable device 100 . can be controlled According to an embodiment, the processor 210 sets the types of the wearing space of the plurality of wearable devices 100 and stores data on the volume control method of the external device 110 corresponding to each of the types of the wearing space in memory. (240) can be stored. In an embodiment, the processor 210 may control the volume of the external device 110 in a volume control method corresponding to the determined type of wearing space based on the volume control method stored in the memory 240 . That is, the processor 210 may transmit the volume control signal to the external device 110 through the communication circuit 230 based on the volume control method corresponding to the type of the wearing space. The external device 110 may receive a volume control signal and output a sound based on the received volume control signal.

3 is a diagram illustrating an example of a type of wearing space divided based on an external device.

Referring to FIG. 3 , the type of the wearing space of the user who wears the wearable device 100 may be divided into a plurality of types. According to various embodiments, the type of the wearing space is not limited to the type of the wearing space described with reference to FIG. 3 , and may be distinguished through various criteria.

According to various embodiments, the type of the wearing space may be classified based on various criteria. For example, the type of the wearing space may be classified based on the size of the space and the existence of an object disposed in the space. According to an embodiment, the type of the wearing space may be classified based on the location of the external device 300 (eg, the external device 110 of FIG. 1 ) in the space and the location of the user. According to an embodiment, the type of the wearing space may be divided into a first space 310 , a second space 320 , and a third space 330 .

According to an embodiment, the first space 310 may represent an open space in which there is no object such as a wall disposed between the external device 300 and the user. For example, if the wearable device 100 user's general home is described as a reference, the first space 310 may represent a living space in which the external device 300 for outputting audio is located.

According to an embodiment, the second space 320 may represent a space in which an object such as a wall is disposed between the external device 300 and the user. Specifically, the second space 320 may represent a space in which an audio signal output from the external device 300 is refracted and delivered to the user by being blocked by a structure such as a wall between the external device 300 and the user. According to an embodiment, the second space is a space partially blocked by a structure such as a wall between the external device 300 and the user, and may represent a half opened space. For example, if the wearable device 100 user's general home is described as a reference, the second space 310 is a living room through a structure such as a wall while the external device 300 for outputting audio is located in the living space. and may represent a partially separated kitchen.

According to an embodiment, the third space 330 may represent a space completely separated by an object such as a wall between the external device 300 and the user. Specifically, the third space 330 may represent a space blocked in all directions by a structure such as a wall between the external device 300 and the user. According to an embodiment, the third space 330 is a space between the external device 300 and a user blocked by a structure such as a wall, and may represent a closed space. For example, if the wearable device 100 user's general home is described as the basis, the third space 330 is separated through a structure such as a wall while the external device 300 for outputting audio is located in the living space. This can represent a room that can be accessed through a door. Accordingly, when the user is located in the third space 330 , it may be assumed that the user has no intention to listen to the audio output through the external device 110 .

The wearable device 100 may identify whether the type of space in which the wearable device 100 is located has changed based on a comparison result between audio signals received through the microphone 220 .

The division of the wearing space shown in FIG. 3 is for explaining an embodiment, and the type of space divided by the wearable device 100 may be divided into other forms.

4A is a diagram illustrating controlling a volume of an external device based on a change in a user's position in a first space, according to an exemplary embodiment. 4B is a diagram illustrating a change in an audio signal based on a user's movement in a first space according to an exemplary embodiment.

Referring to FIG. 4B , an audio signal may be expressed based on a frequency. The vertical axis of the graph shown in FIG. 4B may represent the volume, and the horizontal axis may represent the frequency. The horizontal axis of the graph may represent the low-pitched sound part LF to the high-pitched sound part HF.

According to an embodiment, a user wearing the wearable device 100 on the body may move in the first space 310 . For example, the user may move from the first location 410 to the second location 420 away from the external device 300 by a first distance a. In an embodiment, the second location 420 may indicate a location separated by a second distance b from the external device 300 .

According to an embodiment, the processor 210 may obtain the first audio signal 411 from the external device 300 using the microphone 220 at the first location 410 . According to an embodiment, the processor 210 may determine a position where the volume of the external device 300 is controlled as the first position 410 based on a user input received by the wearable device 100 . For example, the processor 210 obtains at least one user input for controlling the volume of the external device 300 at the first location 410 , and a specified time after the at least one user input is obtained. If an additional user input is not obtained during this time, the first audio signal 411 may be obtained. For example, the processor 210 repeatedly receives a user input for increasing the volume of the external device 300 in three steps to increase the volume by three steps, and then, if the user input is not received for 2 seconds, the microphone 220 ) to obtain an audio signal.

According to an embodiment, the processor 210 may obtain the second audio signal 421 from the external device 300 using the microphone 220 at the second location 420 . According to an embodiment, as the user moves from the first location 410 to the second location 420 , the size of the audio signal output from the external device 300 acquired through the microphone 220 may change. have. For example, the volume of the audio signal received through the microphone 220 may be decreased or increased. In an embodiment, the processor 210 may determine that the user's location has changed based on a change in the volume of the received audio signal. For example, the processor 210 may determine that the user's location has changed with respect to the external device 300 based on the first audio signal 411 and the second audio signal 421 . In an embodiment, the processor 210 may determine that the volume of the low-pitched sound part LF and the high-pitched sound part HF has been reduced in the second audio signal 421 as compared to the first audio signal 411 . Accordingly, the processor 210 may determine that the distance of the user from the external device 300 has increased based on the overall decrease in the volume. For convenience of explanation, only the second audio signal 421 based on the user's distance from the external device 300 is shown through FIG. 4B , but the distance between the user and the external device 300 may be variously changed.

According to an embodiment, the processor 210 may identify a change in the distance between the user and the external device 300 based on the second audio signal 421 . For example, the processor 210 may determine the distance between the external device 300 and the user based on a time or volume difference between the first audio signal 411 and the second audio signal 421 . According to an embodiment, the content of determining the change in the user's location will be described later with reference to FIG. 5 .

According to an embodiment, the processor 210 may transmit a control signal for controlling the volume of the external device 300 based on a change in the distance between the external device 300 and the user through the communication circuit 230 . In an embodiment, when the first distance a is smaller than the second distance b (or when the volume of the first audio signal is greater than the volume of the second audio signal, or when the first audio signal is 2, when a time delay occurs in the audio signal), that is, as the user's location from the external device 300 changes from the first location 410 to the second location 420, it may be assumed that the user moves away from each other. According to an embodiment, when the user's distance from the external device 300 increases, the volume of the audio output from the external device 300 recognized by the user may be reduced. Accordingly, the processor 210 receives a control signal for increasing the volume of the external device 300 when the user's location is further away from the external device 300 in the second location 420 compared to the first location 410 . It can be transmitted to the external device 300 . According to an embodiment, the external device 300 may increase the volume based on the received control signal.

In an embodiment, when the first distance (a) is greater than the second distance (b), that is, as the user's location from the external device 300 changes from the first location 410 to the second location 420 , It can be assumed that close According to an embodiment, when the distance of the user from the external device 300 is increased, the volume of the audio output from the external device 300 recognized by the user may be increased. Accordingly, when the position of the wearable device in the second position 420 is closer to the external device 300 than in the first position 410 , the processor 210 decreases the volume of the external device 300 . may be transmitted to the external device 300 . According to an embodiment, the external device 300 may reduce the volume based on the received control signal.

According to an embodiment, as the processor 210 determines a change in the user's position based on the audio signal of the external device 300 acquired through the microphone 220 and automatically controls the volume, the wearable device 100 A user of can listen to the audio output from the external device 300 at a similar perceived volume. According to an embodiment, the processor 210 may control the volume of the external device 300 within a predetermined range. For example, the processor 210 may set a minimum volume and a maximum volume of the volume of the external device 300 , and may control the volume of the external device 300 in a range from the minimum volume to the maximum volume. According to an embodiment, the minimum volume and the maximum volume may be set based on a user input received by the wearable device 100 .

5 is a diagram illustrating determination of a distance between a user and an external device based on acquired audio signals 500 according to an exemplary embodiment.

Referring to FIG. 5 , the acquired audio signals 500 include an original audio signal 510 of audio data output through the external device 300 , a first audio signal 520 acquired at a first position, and a change in position. It may include the second audio signal 523 obtained according to .

According to an embodiment, the processor 210 may determine the distance between the user and the external device 300 based on the acquired audio signals 500 . According to an embodiment, when the external device 300 outputs audio data stored in the internal memory, the processor 210 controls the original audio signal ( 510) can be obtained. According to another embodiment, when the external device 300 receives and outputs audio data from the wearable device 100 , the processor 210 may acquire the original audio signal 510 stored in the memory 240 . According to another embodiment, the processor 210 may receive the original audio signal 510 from the external device 300 or a separate external server (not shown) through the communication circuit 230 .

According to an embodiment, the processor 210 may remove the first noise 521 included in the first audio signal 520 with reference to the original audio signal 510 . According to an embodiment, the processor 210 may obtain the second audio signal 523 from which noise has been removed by referring to the original audio signal 510 . Accordingly, the processor 210 may obtain the first audio signal and the second audio signal from which the noise has been removed.

According to an embodiment, the processor 210 determines the type of the user's wearing space based on the noise-removed first audio signal and the noise-removed second audio signal 523 , and communicates with the external device 300 and the external device 300 . The user's distance can be determined. For example, based on the time difference t or the volume difference a between the noise-removed first audio signal and the noise-removed second audio signal 523, the external device 300 and the user distance can be determined.

According to various embodiments, the processor 210 may determine the distance between the user and the external device 300 by using the acquired audio signals 500 and various distance measurement techniques. For example, the processor 210 may determine the distance between the electronic device 100 and the external device 300 using ultra-wideband communication with the external device 300 . As another example, the processor 210 may perform a communication between the electronic device 100 and the external device 300 based on a received signal strength indicator (RSSI) of a wireless communication signal received from the external device 300 . You can also judge the distance.

6A is a diagram illustrating movement of a user from a first space to a second space, according to an exemplary embodiment. 6B is a diagram illustrating a change in a received audio signal as a user moves from a first space to a second space, according to an embodiment.

According to an embodiment, a user wearing the wearable device 100 on the body may move from the first space 310 to the second space 320 . For example, the user may move from a first location 410 in the first space 310 to a third location 610 in the second space 320 .

According to an embodiment, the processor 210 may obtain the first audio signal 411 from the external device 300 using the microphone 220 at the first location 410 . The processor 210 according to an embodiment may acquire the third audio signal 611 from the external device 300 using the microphone 220 at the third location 610 .

According to an embodiment, as the user moves from the first location 410 to the third location 610 , the size of the audio output of the external device 300 obtained through the microphone 220 may be changed. Also, as the user moves from the first space 310 to the second space 320 . The audio signal may be received with a different volume for each frequency. For example, as the type of the user's wearing space of the wearable device 100 is changed to the second space 320 which is a semi-open/closed space, the sound wave in the low frequency band is transmitted to the microphone 220 by the diffraction phenomenon and , high-frequency band sound waves can be blocked. According to an embodiment, the treble frequency region may indicate a frequency region of 1 kHz or more.

According to an embodiment, the processor 210 determines the type of the user's wearing space based on the change in the volume for each frequency of the third audio signal 611 acquired using the microphone 220 at the third location 610 . It may be determined that the first space 310 is changed to the second space 320 . For example, the processor 210 compares the first audio signal 411 with the type of the wearing space based on the difference between the volume decay rate of the high-pitched frequency region and the volume decay rate of the low-pitched frequency region of the third audio signal 611 . It may be determined that this is the second space 320 .

According to an embodiment, the processor 210 is configured to allow the external device 300 to maintain the volume based on the change of the user's wearing space from the first space 310 to the second space 320, so that the communication circuit 230 ) to transmit a control signal. For example, if the type of the user's wearing space corresponds to the second space 320 , the processor 210 determines that the wearable device 100 receives the external device ( The external device 300 may be controlled to maintain the volume of the sound output from the 300 . Accordingly, even if the user's location changes with respect to the external device 300 , the processor 210 may adjust the volume of the external device 300 within a predetermined range. For example, when the high-frequency band volume of the third audio signal 611 is attenuated, the electronic device 100 may increase the high-frequency band volume of the sound output from the external device 300 .

7A is a diagram illustrating movement of a user from a first space to a third space, according to an exemplary embodiment. 7B is a diagram illustrating a change in a received audio signal as a user moves from a first space to a third space, according to an exemplary embodiment.

According to an embodiment, a user wearing the wearable device 100 on the body may move from the first space 310 to the third space 330 . For example, the user may move from the first location 410 to the fourth location 710 in the third space 330 .

According to an embodiment, the processor 210 may acquire the first audio signal 411 from the external device 300 using a microphone at the first location 410 . In an embodiment, the processor 210 may obtain the fourth audio signal 711 from the external device 300 using the microphone 220 at the fourth location 710 .

According to an embodiment, as the user moves from the first location 410 to the fourth location 710 , the size of the audio output of the external device 300 obtained through the microphone 220 may be changed. For example, as the type of the wearing space is changed from the first space 310 which is an open space to the third space 330 which is a closed space, the audio output of the external device 300 obtained through the microphone 220 is The volume can be greatly reduced. For example, compared to the first audio signal 411 , the volume level of the fourth audio signal 711 for each frequency may be greatly reduced.

According to an embodiment, the processor 210 determines the type of the user's wearing space to be the first based on the change in the volume of the fourth audio signal 711 acquired using the microphone 220 at the fourth location 710 . It may be determined that the space 310 is changed to the third space 330 . For example, the processor 210 may set a threshold value for determining that it is the third space 330 . The processor 210 may determine that the user's location is changed from the first space 310 to the third space 330 when the volume of the fourth audio signal 711 for each frequency is equal to or less than a threshold value. According to various embodiments, the threshold value may be set in various ways. According to an embodiment, the threshold value may be determined based on the first audio signal 411 . For example, a value (eg, a quarter value of a volume) reduced by a predetermined level based on the first audio signal 411 may be set as a threshold value.

The processor 210 according to an embodiment communicates so that the external device 300 sets the volume to the minimum volume based on the change in the type of the user's wearing space from the first space 310 to the third space 330 . A control signal may be transmitted through the circuit 230 . For example, if the type of the user's wearing space corresponds to the third space 330 , the processor 210 determines that the user no longer has a will to listen, and controls the volume of the external device 300 to the minimum volume. can According to various embodiments, the reference of the minimum volume may be preset to various values by the processor 210 . The processor 210 according to an embodiment may reduce unnecessary sound output by controlling the volume of the external device 300 to the minimum volume based on the change in the type of the user's wearing space to the third space 330 . have.

8 is a flowchart 800 of a process of controlling a volume of an external device based on a user's location in a wearable device according to an embodiment.

Referring to FIG. 8 , the processor 210 of the wearable device 100 may acquire a first audio signal at a first location through the microphone 220 in operation 801 . According to an embodiment, the first audio signal may be obtained from the external device 300 through the microphone 220 . In an embodiment, the microphone 220 may obtain a sound output from the external device 300 and convert the obtained sound into a first audio signal. According to an embodiment, the first location may be determined based on a user input controlling the volume of the external device 300 . According to an embodiment, in operation 801 , the processor 210 sets a first position based on a user input for controlling the volume of the external device 300 and obtains a first position using the microphone 220 at the first position. A first audio signal may be obtained based on the sound. According to an embodiment, when a user input for controlling the volume of the external device 300 is continuously performed for a predetermined time, the processor 210 may acquire the first audio signal based on the last user input. . According to another embodiment, when starting audio reproduction through the external device 300 , the processor 210 may acquire the first audio signal.

In operation 803 , the processor 210 according to an embodiment may acquire a second audio signal from the external device 300 at a second location using the microphone 220 . According to an embodiment, the second location may indicate a location of the first space 310 , the second space 320 , or the third space 330 described with reference to FIG. 3 .

According to an embodiment, in operation 805 , the processor 210 may determine the type of the wearable space of the user of the wearable device 100 based on the first audio signal and the second audio signal. For example, the processor 210 obtains a sound output from the external device 300 using the microphone 220 , and determines the type of the wearing space based on a first audio signal and a second audio signal based on the obtained sound. can judge The processor 210 may determine the type of the wearing space based on the change amount of the second audio signal based on the first audio signal. According to an embodiment, the type of the wearing space may include the first space 310 , the second space 320 , or the third space 330 .

According to an embodiment, in operation 807 , the processor 210 may control the volume of the external device 300 based on the audio output control method of the external device 300 corresponding to the determined type of wearing space. . In an embodiment, the processor 210 may transmit a control signal through the communication circuit 230 based on an audio output control method corresponding to the type of the wearing space. According to an embodiment, the external device 300 may control the audio output based on the received control signal. According to an embodiment, the processor 210 may control the audio output of the external device 300 differently according to the type of the wearing space.

9 is a flowchart 900 of a process of controlling a volume of an external device by classifying a user's space type in a wearable device according to an embodiment.

According to an embodiment, in operation 901 , the processor 210 may acquire the first audio signal in response to the user's volume setting. In an embodiment, the processor 210 may obtain the first audio signal from the external device 300 using the microphone 220 . For example, the processor 210 sets a position at which the volume of the external device 300 is controlled to a first position based on a user input of the wearable device 100 , and the audio signal obtained from the first position is the second position. 1 may be an audio signal.

According to an embodiment, in operation 903 , the processor 210 may share information related to the original audio signal with the external device 300 . According to an embodiment, audio data stored in the internal memory of the external device 300 may be output. In another embodiment, the external device 300 may receive and output audio data from the wearable device 100 . According to an embodiment, when the external device 300 outputs audio data stored in the internal memory, the processor 210 may receive information about the original audio data from the external device 300 using the communication circuit 230 . can In another embodiment, when the external device 300 receives and outputs audio data from the wearable device 100 , the processor 210 may omit operation 903 . According to another embodiment, when the external device 300 outputs sound through a streaming service provided from an external server, the wearable device 100 receives audio data from the external server or the external device 300 . You may.

According to an embodiment, the processor 210 may acquire the second audio signal from the external device 300 using the microphone 220 in operation 905 . According to an embodiment, the processor 210 may acquire the second audio signal as a set time elapses after acquiring the first audio signal. In an embodiment, the processor 210 may continuously acquire the second audio signal.

According to an embodiment, in operation 907 , the processor 210 may determine whether the type of the user's wearing space is the first space 310 based on the first audio signal and the second audio signal. For example, when the volume of the second audio signal is decreased or increased compared to the first audio signal, the processor 210 may determine that the type of the user's wearing space is the first space 310 . According to an embodiment, when it is determined that the user is in the first space 310 , the processor 210 may determine the distance between the user and the external device 300 in operation 909 . According to an embodiment, the processor 210 may separate noise from the first audio signal based on the information related to the original audio signal obtained in operation 903 . Also, the processor 210 may separate noise from the second audio signal based on information related to the original audio signal. According to an embodiment, the processor 210 may determine the distance between the external device 300 and the user based on the first audio signal and the second audio signal from which the noise is separated. For example, the processor 210 compares the distance between the user and the external device 300 when acquiring the first audio signal to determine whether the distance between the external device 300 and the user is greater when acquiring the second audio signal. You can determine whether it is close or not. In an embodiment, when the volume of the second audio signal is increased compared to the first audio signal, the processor 210 may determine that the distance between the external device 300 and the user is getting closer. In another embodiment, when the volume of the second audio signal is reduced compared to the first audio signal, the processor 210 may determine that the distance between the external device 300 and the user is increased.

According to an embodiment, the processor 210 may control the volume of the external device 300 based on the determined distance in operation 911 . According to an embodiment, the processor 210 may transmit a control signal for controlling the volume of the external device 300 through the communication circuit 230 based on the determined distance. In an embodiment, when the distance between the user and the external device 300 is closer than when obtaining the first audio signal, the processor 210 generates a control signal for reducing the volume of the external device 300, The communication circuit 230 may be used to transmit. In another embodiment, when the distance between the user and the external device 300 is greater than when acquiring the first audio signal, the processor 210 generates a control signal for increasing the volume of the external device 300, The communication circuit 230 may be used to transmit. Accordingly, the user may listen at a perceived volume similar to that when acquiring the first audio signal without directly controlling the volume of the external device 300 .

According to an embodiment, when the type of the user's wearing space is not the first space 310 , in operation 913 , the processor 210 determines whether the type of the user's wearing space is the second space 320 . can According to an embodiment, the processor 210 may determine whether the type of the user's wearing space is the second space 320 based on the first audio signal and the second audio signal. According to an embodiment, when the low-pitched frequency region of the second audio signal is refracted compared to the first audio signal and the high-pitched frequency region is lost, the processor 210 determines the type of the user's wearing space. It may be determined that it is the second space 320 . According to an embodiment, in operation 915 , the processor 210 may transmit a control signal through the communication circuit 230 so that the volume of the external device 300 is not increased or decreased even when the user's location changes. According to an embodiment, the processor 210 may control the external device 300 to maintain the last volume before it is determined as the second space 320 . According to an embodiment, the external device 300 may maintain the volume based on a control signal for maintaining the volume.

According to an embodiment, when it is determined that the type of the user's wearing space is not the second space 320 , the processor 210 may determine that the type of the user's wearing space is the third space 330 . According to an embodiment, when the volume of the second audio signal is reduced to less than or equal to a threshold value in comparison with the first audio signal, the processor 210 determines that the type of the user's wearing space is the third space 330 . It can be judged that According to an embodiment, the threshold value may be a value predefined by the processor 210 . For example, the processor 210 may set a threshold value based on the first audio signal. According to an embodiment, in operation 917 , the processor 210 may generate a control signal to control the volume of the external device 300 to a minimum volume, and transmit the control signal through the communication circuit 230 . In an embodiment, the processor 210 may set the minimum volume. The external device 300 may output audio at a minimum volume based on the received control signal.

10 is a diagram illustrating control of a volume of an external device according to a user's utterance in a wearable device according to an exemplary embodiment.

Referring to FIG. 10 , a graph 1000 indicating the volume of the external device 300 according to time is shown. According to an embodiment, the processor 210 may determine whether the user's utterance is included in the second audio signal described with reference to FIG. 9 . According to an embodiment, when the user speaks, the processor 210 may acquire the sound of the user and the external device 300 through the microphone 220 . In an embodiment, the processor 210 may use the user's utterance information stored in the memory 240 to determine whether the user's utterance is included. For example, the memory 240 may store information about the user's voice of the wearable device 100 . The information about the voice may be obtained when the user makes a utterance.

According to an embodiment, in response to the user's utterance being included in the second audio signal, the processor 210 may control the volume of the external device 300 to be less than or equal to a reference value. According to an embodiment, the processor 210 may set the reference value at a volume level that does not interfere with the user's utterance. In an embodiment, the processor 210 may generate a control signal for controlling the volume of the external device 300 to be less than or equal to a reference value, and transmit the generated control signal through the communication circuit 230 . In an embodiment, the processor 210 reduces the volume of the external device 300 to a reference value or less when the user's speech starts, and determines when the speech ends to reduce the volume of the external device 300 to the original volume. can be controlled with For example, when the user's voice included in the audio signal acquired through the microphone 220 is identified, the processor 210 may determine that the user's speech has started. In addition, when the user's voice is not included in the audio signal acquired through the microphone 220 for a specified time, the processor 210 may determine that the user's utterance has ended.

11A is a diagram illustrating a location of a user with respect to a plurality of external devices, according to an exemplary embodiment. 11B is a diagram illustrating controlling a volume of at least one external device based on a distance from a plurality of external devices, according to an exemplary embodiment.

Referring to FIG. 11A , according to an embodiment, the user of the wearable device 100 may listen to audio output from the plurality of external devices A to D using the plurality of external devices A to D. have. According to an embodiment, the user's location may change to the first location 1110 , the second location 1120 , and/or the third location 1130 based on the plurality of external devices A to D. .

According to an embodiment, the first location 1110 may indicate a location where the distance of the user from each of the plurality of external devices A to D is the same. According to an embodiment, the second location 1120 has a shorter distance between the first external device A and the user, and the second to fourth external devices B, C, and D, compared to the first location 1110 . Fields and distances may indicate distant locations. According to an embodiment, the third location 1130 is closer to the third and fourth external devices C and D than the first location 1110 , and the first and second external devices A , B) and the distance can represent distant locations. According to the present disclosure, for convenience of explanation, the four external devices A to D and the first to third positions 1110 to 1130 have been described as the basis, but the number of external devices and the location of the user are not limited thereto. can be varied.

According to an embodiment, as the user's location changes to the first location 1110 , the second location 1120 , and/or the third location 1130 , the user's Perceived loudness can vary.

In an embodiment, referring to the first location graph 1111 indicating the distance and the volume of the plurality of external devices A to D based on the first location, when the user's location is the first location 1110 The distance between the plurality of external devices A to D and the user may be the same. Accordingly, the perceived volume of each of the plurality of external devices A to D perceived by the user may be the same. In an embodiment, the processor 210 acquires the sound output from the plurality of external devices A to D using the microphone 220 , and uses an audio signal based on the acquired sound to determine the user's position at the first position ( 1110) can be determined. In an exemplary embodiment, the processor 210 may set the plurality of external devices A to D so that the volumes of the plurality of external devices A to D are all the same based on the user's location being the first location 1110 . can be controlled.

In an embodiment, referring to the second location graph 1121 indicating the distance and the volume of the plurality of external devices A to D based on the second location, when the user's location is the second location 1120 , compared to the first location 1110 , the distance between the first external device A and the user may be close, and the distance from the second to fourth external devices B, C, and D may be greater. Accordingly, the perceived volume of each of the plurality of external devices A to D perceived by the user may be different. For example, as the user's position changes to the second position 1120 , the perceived volume of the sound output from the first external device A increases, and the second to fourth external devices B to D The perceived volume of the output sound may be decreased. In an embodiment, the processor 210 acquires the sound output from the plurality of external devices A to D using the microphone 220, and uses an audio signal based on the acquired sound to determine the user's position at the second position ( 1120) can be determined. In an embodiment, the processor 210 reduces the volume of the first external device A and the volume of the second to fourth external devices B to D based on the user's location being the second location 1120 . may control the plurality of external devices A to D to increase the .

In an embodiment, referring to the third location graph 1131 indicating the distance and the volume of the plurality of external devices A to D based on the third location, when the user's location is the third location 1130 The distance from the third and fourth external devices C and D may be close, and the distance from the first and second external devices A and B may be far. Accordingly, the perceived volume of each of the plurality of external devices A to D perceived by the user may be different. For example, as the user's location changes to the third location 1130 , the perceived volume of sounds output from the third and fourth external devices C and D increases, and the first and second external devices C and D increase. The perceived volume of the sound output from (A, B) may be reduced. In one embodiment, the processor 210 acquires the sound output from the plurality of external devices A to D using the microphone 220, and uses an audio signal based on the acquired sound to determine the user's position at the third position ( 1130) can be determined. In an embodiment, the processor 210 increases the volume of the first and second external devices A and B based on the user's location being the third location 1130, and increases the volume of the third and fourth external devices ( The plurality of external devices A to D may be controlled to increase the volume of C and D).

According to various embodiments, the processor 210 may utilize various distance measurement techniques to determine the user's location. For example, the processor 210 may utilize not only the audio signal acquired through the microphone 220 but also the ultra-wideband wireless distance measurement technology.

12 is a block diagram of an electronic device 1201 in a network environment 1200, according to various embodiments.

Referring to FIG. 12 , in a network environment 1200 , the electronic device 1201 communicates with the electronic device 1202 through a first network 1298 (eg, a short-range wireless communication network) or a second network 1299 . It may communicate with at least one of the electronic device 1204 and the server 1208 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 1201 may communicate with the electronic device 1204 through the server 1208 . According to an embodiment, the electronic device 1201 includes a processor 1220 , a memory 1230 , an input module 1250 , a sound output module 1255 , a display module 1260 , an audio module 1270 , and a sensor module ( 1276), interface 1277, connection terminal 1278, haptic module 1279, camera module 1280, power management module 1288, battery 1289, communication module 1290, subscriber identification module 1296 , or an antenna module 1297 . In some embodiments, at least one of these components (eg, the connection terminal 1278 ) may be omitted or one or more other components may be added to the electronic device 1201 . In some embodiments, some of these components (eg, sensor module 1276, camera module 1280, or antenna module 1297) are integrated into one component (eg, display module 1260). can be

The processor 1220, for example, executes software (eg, a program 1240) to execute at least one other component (eg, a hardware or software component) of the electronic device 1201 connected to the processor 1220. It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 1220 may store commands or data received from other components (eg, the sensor module 1276 or the communication module 1290 ) into the volatile memory 1232 . may be stored in , process commands or data stored in the volatile memory 1232 , and store the result data in the non-volatile memory 1234 . According to an embodiment, the processor 1220 is the main processor 1221 (eg, a central processing unit or an application processor) or a secondary processor 1223 (eg, a graphics processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 1201 includes a main processor 1221 and a sub-processor 1223 , the sub-processor 1223 uses less power than the main processor 1221 or is set to be specialized for a specified function. can The secondary processor 1223 may be implemented separately from or as part of the main processor 1221 .

The coprocessor 1223 may be, for example, on behalf of the main processor 1221 while the main processor 1221 is in an inactive (eg, sleep) state, or the main processor 1221 is active (eg, executing an application). ), together with the main processor 1221, at least one of the components of the electronic device 1201 (eg, the display module 1260, the sensor module 1276, or the communication module 1290) It is possible to control at least some of the related functions or states. According to one embodiment, coprocessor 1223 (eg, image signal processor or communication processor) may be implemented as part of another functionally related component (eg, camera module 1280 or communication module 1290). have. According to an embodiment, the auxiliary processor 1223 (eg, a neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 1201 itself on which the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 1208). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 1230 may store various data used by at least one component (eg, the processor 1220 or the sensor module 1276) of the electronic device 1201 . The data may include, for example, input data or output data for software (eg, a program 1240 ) and instructions related thereto. The memory 1230 may include a volatile memory 1232 or a non-volatile memory 1234 .

The program 1240 may be stored as software in the memory 1230 , and may include, for example, an operating system 1242 , middleware 1244 , or an application 1246 .

The input module 1250 may receive a command or data to be used by a component (eg, the processor 1220 ) of the electronic device 1201 from the outside (eg, a user) of the electronic device 1201 . The input module 1250 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 1255 may output a sound signal to the outside of the electronic device 1201 . The sound output module 1255 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 1260 may visually provide information to the outside (eg, a user) of the electronic device 1201 . The display module 1260 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the display module 1260 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 1270 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 1270 acquires a sound through the input module 1250 or an external electronic device (eg, a sound output module 1255 ) directly or wirelessly connected to the electronic device 1201 . The electronic device 1202) (eg, a speaker or headphones) may output a sound.

The sensor module 1276 detects an operating state (eg, power or temperature) of the electronic device 1201 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 1276 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 1277 may support one or more specified protocols that may be used for the electronic device 1201 to directly or wirelessly connect with an external electronic device (eg, the electronic device 1202 ). According to an embodiment, the interface 1277 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 1278 may include a connector through which the electronic device 1201 can be physically connected to an external electronic device (eg, the electronic device 1202 ). According to an embodiment, the connection terminal 1278 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 1279 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 1279 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 1280 may capture still images and moving images. According to one embodiment, the camera module 1280 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 1288 may manage power supplied to the electronic device 1201 . According to an embodiment, the power management module 1288 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 1289 may supply power to at least one component of the electronic device 1201 . According to one embodiment, battery 1289 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 1290 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 1201 and an external electronic device (eg, the electronic device 1202, the electronic device 1204, or the server 1208). It can support establishment and communication performance through the established communication channel. The communication module 1290 operates independently of the processor 1220 (eg, an application processor) and may include one or more communication processors supporting direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 1290 may include a wireless communication module 1292 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 1294 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 1298 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 1299 (eg, legacy). It may communicate with the external electronic device 1204 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 1292 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 1296 within a communication network, such as the first network 1298 or the second network 1299 . The electronic device 1201 may be identified or authenticated.

The wireless communication module 1292 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology is a high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low -latency communications)). The wireless communication module 1292 may support a high frequency band (eg, mmWave band) in order to achieve a high data rate, for example. The wireless communication module 1292 uses various techniques for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. Technologies such as full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna may be supported. The wireless communication module 1292 may support various requirements defined in the electronic device 1201 , an external electronic device (eg, the electronic device 1204 ), or a network system (eg, the second network 1299 ). According to an embodiment, the wireless communication module 1292 includes a peak data rate (eg, 20 Gbps or more) for realization of eMBB, loss coverage (eg, 164 dB or less) for realization of mMTC, or U-plane latency (for URLLC realization) ( Example: Downlink (DL) and uplink (UL) may support 0.5 ms or less, or 1 ms or less round trip respectively).

The antenna module 1297 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 1297 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 1297 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 1298 or the second network 1299 is connected from the plurality of antennas by, for example, the communication module 1290 . can be selected. A signal or power may be transmitted or received between the communication module 1290 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 1297 .

According to various embodiments, the antenna module 1297 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 1201 and the external electronic device 1204 through the server 1208 connected to the second network 1299 . Each of the external electronic devices 1202 or 1204 may be the same or a different type of the electronic device 1201 . According to an embodiment, all or a part of the operations executed in the electronic device 1201 may be executed in one or more of the external electronic devices 1202 , 1204 , or 1208 . For example, when the electronic device 1201 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 1201 may perform the function or service by itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 1201 . The electronic device 1201 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 1201 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 1204 may include an Internet of things (IoT) device. The server 1208 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 1204 or the server 1208 may be included in the second network 1299 . The electronic device 1201 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C," each of which may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may simply be used to distinguish an element from other elements in question, and may refer elements to other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively”. When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 1236 or external memory 1238) readable by a machine (eg, electronic device 1201). may be implemented as software (eg, a program 1240) including For example, a processor (eg, processor 1220 ) of a device (eg, electronic device 1201 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided in a computer program product (computer program product). Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store™) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. , or one or more other operations may be added.

As described above, the wearable device (eg, the wearable device 100 of FIG. 2 ) according to an embodiment includes a microphone (eg, the microphone 220 of FIG. 2 ) and a communication circuit for transmitting and receiving a control signal to and from an external device ( For example: the communication circuit 23 of FIG. 2 ), the microphone, and at least one processor electrically connected to the communication circuit (eg, the processor 210 of FIG. 2 ), wherein the at least one processor is the wearable In a state in which the device is worn on the user's body, obtaining a first audio signal from the external device using the microphone, and in response to the lapse of a set time, obtaining a second audio signal from the external device using the microphone, The type of the user's wearing space is determined based on the first audio signal and the second audio signal, and the volume level of the external device is determined using the communication circuit based on an audio output control method corresponding to the type of the wearing space. can be controlled.

According to an embodiment, the at least one processor receives an original audio signal from the external device using the communication circuit, and generates noise from each of the first audio signal and the second audio signal based on the original audio signal. may be separated, and the type of the wearing space may be determined based on the first audio signal and the second audio signal from which the noise is separated.

According to an embodiment, in response to the type of the wearing space being the first type, the at least one processor, based on a time or volume difference between the first audio signal and the second audio signal, the external device and a change in the distance between the user and the user may be determined, and the volume of the external device may be adjusted based on the change in the distance.

According to an embodiment, the at least one processor may determine the type of the wearing space as the third type in response to a volume level of the second audio signal being equal to or less than a first reference value.

According to an embodiment, in response to determining that the type of the wearing space is the third type, the at least one processor may control the volume of the external device to a minimum volume.

In an embodiment, the at least one processor may determine whether the type of the wearing space is the second type, based on a result of comparing the volume of each frequency of the first audio signal and the second audio signal. have.

The at least one processor of an embodiment is, in response to determining that the type of the wearing space is the second type, a control signal to maintain the volume for each frequency of the second audio signal as the volume for each frequency of the first audio signal can be transmitted.

According to an embodiment, the at least one processor is configured to respond to a difference between a first volume decay rate of a high-pitched frequency region included in the second audio signal and a second volume decay rate of a low-pitched frequency region included in the second audio signal. It may be determined based on whether the type of the wearing space is the second type.

According to an embodiment, the at least one processor may control the microphone to acquire the first audio signal in response to receiving a user input for adjusting the volume of the external device.

According to an embodiment, the at least one processor may determine the location of the electronic device with respect to the external device using ultra-wideband communication with the external device.

According to an embodiment, the at least one processor, in response to determining whether the user's utterance is included in the second audio signal, and determining that the user's utterance is included in the second audio signal, The volume of the external device may be controlled to be less than or equal to a third reference value.

In an embodiment, the at least one processor identifies the end of the user's speech based on the second audio signal, and sets the volume of the external device to be less than or equal to the third reference value based on the identification of the end of the speech. It can be controlled to change to the previous volume level.

As described above, the method of operating a wearable device including a microphone (eg, the microphone 220 of FIG. 2 ) and a communication circuit (eg, the communication circuit 230 of FIG. 2 ) for transmitting and receiving a control signal to and from an external device, An operation of acquiring a first audio signal from the external device using the microphone while the wearable device is worn on the user's body, and receiving a second audio signal from the external device using the microphone in response to a set time elapses Based on an operation of acquiring, an operation of determining the type of the user's wearing space based on the first audio signal and the second audio signal, and an audio output control method corresponding to the type of the wearing space, using the communication circuit It may include an operation of controlling the volume of the external device.

According to an embodiment, the operation of controlling the volume of the external device may include, in response to the type of the wearing space being the first type, the external device and the second audio signal based on the first audio signal and the second audio signal. It may include an operation of determining the user's distance and an operation of adjusting a volume of the external device to be proportional to the determined distance.

According to an embodiment, the determining of the type of the wearing space includes determining the type of the wearing space as the third type in response to a volume level of the second audio signal being less than or equal to a first reference value, , The operation of controlling the volume of the external device may include controlling the volume of the external device to a predetermined minimum volume in response to determining that the type of the wearing space is the third type.

According to an embodiment, the determining of the type of the wearing space may include setting the type of the wearing space to the second type based on a first frequency of the first audio signal and a second frequency of the second audio signal. and determining, wherein the controlling of the volume of the external device may include: in response to determining that the type of the wearing space is the second type, the volume of the second audio signal for each frequency of the first audio signal It may include an operation of transmitting a control signal to maintain the volume for each frequency.

According to an embodiment, the operation of acquiring the first audio signal may be an operation of acquiring the first audio signal in response to the user adjusting the volume of the external device.

According to an embodiment of the present disclosure, the method of operating the wearable device may include determining whether the user's utterance is included in the second audio signal, and responding to determining whether the user's utterance is included in the second audio signal Thus, the method may further include controlling the volume of the external device to be less than or equal to a third reference value.

According to an embodiment, the determining of the distance of the user may include determining the location of the electronic device with respect to the external device using ultra-wideband communication with the external device. can

A wearable device (eg, the wearable device 100 of FIG. 2 ) according to an embodiment includes a microphone (eg, the microphone 220 of FIG. 2 ) and a communication circuit (eg, a communication circuit for transmitting and receiving a control signal to and from a plurality of external devices: The communication circuit 230 of FIG. 2), the microphone, and at least one processor (eg, the processor 210 of FIG. 2 ) electrically connected to the communication circuit, wherein the at least one processor is configured to enable the wearable device A third audio signal is obtained from each of the plurality of devices using the microphone in a state worn on the user's body, and in response to the lapse of a set time, a fourth audio signal is obtained from each of the plurality of external devices using the microphone acquire a signal, determine distances between the user and each of the plurality of external devices based on the third audio signal and the fourth audio signal, and use the communication circuit based on the determination result to determine the plurality of external devices The volume of at least one of the devices may be controlled.

Claims (20)

In the wearable device,
MIC;
a communication circuit for transmitting and receiving control signals to and from an external device;
at least one processor electrically connected to the microphone and the communication circuit;
The at least one processor comprises:
obtaining a first audio signal from the external device using the microphone while the wearable device is worn on the user's body;
In response to the lapse of a set time, acquiring a second audio signal from the external device using the microphone,
determining the type of the user's wearing space based on the first audio signal and the second audio signal;
A wearable device for controlling a volume of the external device using the communication circuit based on an audio output control method corresponding to the type of the wearing space. The method according to claim 1,
The at least one processor receives an original audio signal from the external device using the communication circuit,
separating noise from each of the first audio signal and the second audio signal based on the original audio signal;
A wearable device for determining the type of the wearing space based on a first audio signal and a second audio signal from which the noise is separated. The method according to claim 1,
The at least one processor, in response to the type of the wearing space being the first type,
determining a change in the distance between the external device and the user based on a time or volume difference between the first audio signal and the second audio signal,
A wearable device for adjusting a volume of the external device based on a change in the distance. The method according to claim 1,
The at least one processor is configured to determine the type of the wearing space as a third type in response to a volume level of the second audio signal being equal to or less than a first reference value. 5. The method according to claim 4,
The at least one processor is configured to control a volume of the external device to a minimum volume in response to determining that the type of the wearing space is the third type. The method according to claim 1,
The at least one processor is configured to determine whether the type of the wearing space is a second type, based on a result of comparing the volume of each frequency of the first audio signal and the second audio signal. 7. The method of claim 6,
The at least one processor, in response to determining that the type of the wearing space is the second type, transmits a control signal so that the volume for each frequency of the second audio signal is maintained as the volume for each frequency of the first audio signal wearable devices. 7. The method of claim 6,
The at least one processor is configured to: Based on a difference between a first volume decay rate of the high-pitched frequency region included in the second audio signal and a second volume decay rate of the low-pitched frequency region included in the second audio signal, A wearable device that determines whether the type is the second type. The method according to claim 1,
The at least one processor controls the microphone to acquire the first audio signal in response to receiving a user input for adjusting a volume of the external device. The method according to claim 1,
The at least one processor is configured to determine a position of the wearable device with respect to the external device using ultra-wideband communication with the external device. The method according to claim 1,
the at least one processor,
determining whether a user's utterance is included in the second audio signal,
In response to determining that the second audio signal includes the user's utterance, the wearable device controls the volume of the external device to be less than or equal to a third reference value. 12. The method of claim 11,
the at least one processor,
identifying the end of the user's speech based on the second audio signal;
A wearable device for controlling the volume of the external device to be changed to a volume before controlling the volume of the external device to be less than or equal to the third reference value based on the identification of the end of the speech. A method of operating a wearable device comprising a microphone and a communication circuit for transmitting and receiving a control signal to and from an external device, the method comprising:
acquiring a first audio signal from the external device using the microphone while the wearable device is worn on the user's body;
acquiring a second audio signal from the external device using the microphone in response to the lapse of a set time;
determining the type of the user's wearing space based on the first audio signal and the second audio signal; and
and controlling a volume of the external device using the communication circuit based on an audio output control method corresponding to the type of the wearing space. 14. The method of claim 13,
The operation of controlling the volume of the external device may include determining a distance between the external device and the user based on the first audio signal and the second audio signal in response to the type of the wearing space being the first type. movement; and
and adjusting a volume of the external device in proportion to the determined distance. 14. The method of claim 13,
The determining of the type of the wearing space includes determining the type of the wearing space as the third type in response to a volume level of the second audio signal being less than or equal to a first reference value,
The operation of controlling the volume of the external device includes controlling the volume of the external device to a predetermined minimum volume in response to determining that the type of the wearing space is the third type. . 14. The method of claim 13,
The determining of the type of the wearing space includes determining the type of the wearing space as the second type based on a first frequency of the first audio signal and a second frequency of the second audio signal, ,
The operation of controlling the volume of the external device may include controlling the frequency-specific volume of the second audio signal to be maintained as the frequency-specific volume of the first audio signal in response to determining that the type of the wearing space is the second type. A method of operating a wearable device, comprising the operation of transmitting a signal. 14. The method of claim 13,
The operation of acquiring the first audio signal is an operation of acquiring the first audio signal in response to the user adjusting a volume of the external device. The method of claim 13 , further comprising: determining whether a user's utterance is included in the second audio signal;
and controlling a volume of the external device to be less than or equal to a third reference value in response to determining that the second audio signal includes the user's utterance. 15. The method of claim 14,
The operation of determining the distance of the user includes determining a position of the wearable device with respect to the external device using ultra-wideband communication with the external device. In the wearable device,
MIC;
a communication circuit for transmitting and receiving control signals to and from a plurality of external devices;
at least one processor electrically connected to the microphone and the communication circuit;
The at least one processor comprises:
obtaining a third audio signal from each of the plurality of devices using the microphone while the wearable device is worn on the user's body;
In response to the lapse of a set time, obtaining a fourth audio signal from each of the plurality of external devices using the microphone,
determining distances between the user and each of the plurality of external devices based on the third audio signal and the fourth audio signal;
A wearable device for controlling a volume of at least one of the plurality of external devices by using the communication circuit based on the determination result.

Images