KR20230017666A - Electronic device and controlling method of electronic device - Google Patents

Abstract

Disclosed is an electronic device. The electronic device of the present invention comprises a transmission unit, a reception unit, a speaker, and a processor which controls the transmission unit such that signals can be transmitted to the surroundings of the electronic device while audio is outputted through the speaker, performs fast Fourier transform (FFT) on a received signal to convert the received signal to a signal in the frequency band when the transmitted signal is reflected around the electronic device and received by the reception unit, identifies the energy of a first frequency band and the energy of a second frequency band in the signal of the frequency band, and identifies the presence or absence of an object around the electronic device, based on a difference and a threshold between the energy of the first frequency band and the energy of the second frequency band.

Description

Electronic device and control method of electronic device { ELECTRONIC DEVICE AND CONTROLLING METHOD OF ELECTRONIC DEVICE }

The present disclosure relates to an electronic device and a control method of the electronic device, and more particularly, to an electronic device and a method of controlling the electronic device for identifying whether an object around the electronic device exists.

Recently, various electronic products, such as smart TVs and air conditioners, provide various functions by detecting a user's motion through a sensor. However, in the case of using a camera to detect a user, there are problems in that aesthetics may be degraded because the lens of the camera is drawn from the electronic product, and that exposure of personal information is concerned by photographing through the camera.

Accordingly, a method of detecting a user using a non-detecting sensor such as an RF radar sensor is being used. However, in the case of an electronic product such as a TV including a speaker, vibration generated when audio is output from the speaker may affect the signal of the RF radar sensor.

Therefore, when an electronic product detects a user using a non-sensing sensor, it is important to prevent misrecognition of user detection caused by vibration of the electronic product.

The present disclosure has been made in accordance with the above-described need, and is to provide an electronic device and a control method thereof for identifying the presence or absence of an object around the electronic device in a situation where there is motion of the electronic device due to audio output from a speaker. .

An electronic device according to an embodiment of the present disclosure for achieving the above object is an electronic device configured to transmit a signal to surroundings of the electronic device while audio is output through a transmitter, a receiver, a speaker, and the speaker. Controls the transmitter, and when the transmitted signal is reflected around the electronic device and received through the receiver, the received signal is converted into a signal of a frequency band by performing a fast fourier transform (FFT) on the received signal. and identifying energy of a first frequency band and energy of a second frequency band in the signal of the frequency band, and based on a difference between the energy of the first frequency band and the energy of the second frequency band and a threshold value, the electronic and a processor for identifying the presence or absence of an object around the device.

The processor may determine whether a value obtained by subtracting the energy of the second frequency band from the energy of the first frequency band is greater than the threshold value, or a value obtained by subtracting the energy of the first frequency band from the energy of the second frequency band. If it is greater than the threshold value, it may be identified that the object exists.

In this case, the first frequency band includes a negative frequency band among the frequency bands based on the center frequency of the FFT, and the second frequency band includes the frequency band based on the center frequency of the FFT. A positive frequency band may be included.

Meanwhile, the processor may calculate the energy of the frequency band by applying a relatively large weight to a frequency having a smaller frequency among the frequency bands.

In addition, the processor identifies a threshold value corresponding to the volume level of the speaker among a plurality of threshold values corresponding to a plurality of volume levels of the speaker, and determines the energy of the first frequency band and the energy of the second frequency band. Based on the difference between the energies and the identified threshold value, it may be identified whether a user exists around the electronic device.

In this case, the plurality of threshold values may be preset to a higher value as the volume level increases, and may be preset to a lower value as the volume level decreases.

Meanwhile, an electronic device according to an embodiment of the present disclosure for achieving the above object transmits a signal to the vicinity of the electronic device while audio is output through a transmitter, a receiver, a speaker, and the speaker. When the transmitted signal is reflected around the electronic device and received through the receiver, FFT (fast fourier transform) is performed on the received signal to transform the received signal into a frequency band signal. and a processor for identifying the presence or absence of an object around the electronic device based on the signal of the frequency band, the processor configured to: identifies the energy of the first frequency band and the energy of the second frequency band, and whether there is an object around the electronic device based on the difference between the energy of the first frequency band and the energy of the second frequency band and a threshold value is identified, and if the volume level of the speaker is less than a preset level, whether an object around the electronic device exists is identified based on the total energy of the frequency band.

Meanwhile, a control method of an electronic device according to an embodiment of the present disclosure includes transmitting a signal to a surrounding area of the electronic device while audio is output through a speaker, and reflecting the transmitted signal around the electronic device to the electronic device. When received, converting the received signal into a signal of a frequency band by performing fast fourier transform (FFT) on the received signal, energy of a first frequency band and energy of a second frequency band in the signal of the frequency band and identifying whether an object around the electronic device exists based on a difference between the energy of the first frequency band and the energy of the second frequency band and a threshold value.

In addition, the step of identifying whether the object exists may include a value obtained by subtracting the energy of the second frequency band from the energy of the first frequency band is greater than the threshold value, or the first frequency band from the energy of the second frequency band. When the value obtained by subtracting the energy of the frequency band is greater than the threshold value, it may be identified that the object exists.

In this case, the first frequency band includes a negative frequency band among the frequency bands based on the center frequency of the FFT, and the second frequency band includes the frequency band based on the center frequency of the FFT. A positive frequency band may be included.

Meanwhile, in the step of identifying the energy of the first and second frequency bands, the energy of the frequency band may be calculated by applying a relatively large weight to a frequency having a smaller frequency level among the frequency bands.

The method may further include identifying a threshold value corresponding to a volume level of the speaker among a plurality of threshold values corresponding to a plurality of volume levels of the speaker, and identifying whether the object exists may include the first step. Based on the difference between the energy of the frequency band and the energy of the second frequency band and the identified threshold value, it is possible to identify whether a user exists around the electronic device.

Here, the plurality of threshold values may be preset to a higher value as the volume level increases, and may be preset to a lower value as the volume level decreases.

According to various embodiments of the present disclosure, even when audio is output from a speaker of the electronic device and motion occurs in the electronic device, the false recognition rate for object detection is reduced by removing signal components generated by the motion of the electronic device. can reduce

1 is a diagram for explaining an electronic device according to an embodiment of the present disclosure;
2A to 2C are diagrams illustrating signals of frequency bands depending on whether an object exists around an electronic device according to an embodiment of the present disclosure;
3 is a block diagram for explaining the configuration of an electronic device according to an embodiment of the present disclosure;
4 is a flowchart for explaining a method of identifying whether an object exists around an electronic device according to an embodiment of the present disclosure;
5, 6a and 6b are diagrams for explaining a method of determining whether an object exists according to an embodiment of the present disclosure;
7 is a diagram for explaining an example of a threshold value corresponding to a volume level of a speaker according to an embodiment of the present disclosure;
8 is a flowchart for explaining a method for identifying whether an object exists or not by an electronic device according to an embodiment of the present disclosure;
9 is a block diagram for explaining a detailed configuration of an electronic device according to an embodiment of the present disclosure, and
10 is a flowchart illustrating a control method of an electronic device including a speaker according to an embodiment of the present disclosure.

Since the present embodiments can apply various transformations and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope to the specific embodiments, and should be understood to include various modifications, equivalents, and/or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, like reference numerals may be used for like elements.

In describing the present disclosure, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present disclosure, a detailed description thereof will be omitted.

In addition, the following embodiments may be modified in many different forms, and the scope of the technical idea of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the spirit of the disclosure to those skilled in the art.

Terms used in this disclosure are only used to describe specific embodiments, and are not intended to limit the scope of rights. Singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present disclosure, expressions such as “has,” “can have,” “includes,” or “can include” indicate the presence of a corresponding feature (eg, numerical value, function, operation, or component such as a part). , which does not preclude the existence of additional features.

In this disclosure, expressions such as “A or B,” “at least one of A and/and B,” or “one or more of A or/and B” may include all possible combinations of the items listed together. . For example, “A or B,” “at least one of A and B,” or “at least one of A or B” (1) includes at least one A, (2) includes at least one B, Or (3) may refer to all cases including at least one A and at least one B.

Expressions such as "first," "second," "first," or "second," used in the present disclosure may modify various elements regardless of order and/or importance, and may refer to one element as It is used only to distinguish it from other components and does not limit the corresponding components.

A component (e.g., a first component) is "(operatively or communicatively) coupled with/to" another component (e.g., a second component); When referred to as "connected to", it should be understood that the certain component may be directly connected to the other component or connected through another component (eg, a third component).

On the other hand, when an element (eg, a first element) is referred to as being “directly connected” or “directly connected” to another element (eg, a second element), the element and the above It may be understood that other components (eg, a third component) do not exist between the other components.

The expression “configured to (or configured to)” as used in this disclosure means, depending on the situation, for example, “suitable for,” “having the capacity to.” ," "designed to," "adapted to," "made to," or "capable of." The term "configured (or set) to" may not necessarily mean only "specifically designed to" hardware.

Instead, in some contexts, the phrase "device configured to" may mean that the device is "capable of" in conjunction with other devices or components. For example, the phrase "a processor configured (or configured) to perform A, B, and C" may include a dedicated processor (eg, embedded processor) to perform the operation, or by executing one or more software programs stored in a memory device. , may mean a general-purpose processor (eg, CPU or application processor) capable of performing corresponding operations.

In an embodiment, a 'module' or 'unit' performs at least one function or operation, and may be implemented with hardware or software, or a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'units' may be integrated into at least one module and implemented by at least one processor, except for 'modules' or 'units' that need to be implemented with specific hardware.

Meanwhile, various elements and regions in the drawings are schematically drawn. Therefore, the technical spirit of the present invention is not limited by the relative size or spacing drawn in the accompanying drawings.

Hereinafter, with reference to the accompanying drawings, an embodiment according to the present disclosure will be described in detail so that those skilled in the art can easily implement it.

1 is a diagram for explaining an electronic device according to an embodiment of the present disclosure.

The electronic device 100 may identify whether objects around the electronic device 100 exist. In this case, the electronic device 100 may be implemented as various types of devices such as TVs, air conditioners, and refrigerators. Also, the objects may include people, animals, and the like.

Specifically, the electronic device 100 may identify whether a moving object exists around the electronic device 100 .

To this end, the electronic device 100 may transmit a signal around the electronic device 100 . And, the electronic device 100 may receive a signal generated by reflecting the transmitted signal around the electronic device 100 .

Meanwhile, when the reflected signal 20 is received, the electronic device 100 performs a fast fourier transform (FFT) on the received signal 20 to convert the received signal 20 into a signal of a frequency band. can In this case, the electronic device 100 performs quadrature demodulation on the received signal 20 to generate an I signal (in-phase signal) and a Q signal (quadrature-phase signal) of the received signal 20. ) can be obtained. In addition, the electronic device 100 may convert the received signal 20 into a signal of a frequency band by performing FFT on a signal obtained by adding the I signal and the Q signal.

Also, the electronic device 100 may identify whether an object exists around the electronic device 100 based on the signal converted into a frequency band.

Specifically, when a signal is reflected by a moving object, a frequency shift may occur in the reflected signal according to the Doppler effect. Here, the Doppler effect is a physical phenomenon in which a phase of a reflected signal for a stationary object is constant, but a phase of a reflected signal for a moving object changes.

Therefore, when there is no moving object around the electronic device 100, the frequency shift may not occur in the received signal 20 due to the Doppler effect. Accordingly, for example, as shown in FIG. 2A , when no object moving around the electronic device 100 exists, shifted frequency signal components do not exist in the signal 210 of the frequency band.

On the other hand, when a moving object exists around the electronic device 100, a frequency shift may occur in the received signal 20 due to the Doppler effect. Accordingly, a shifted frequency signal component may exist in a signal of a frequency band.

In this case, for example, when an object approaching the electronic device 100 exists, as shown in FIG. 2B , positive frequency signal components 220 may exist in the signal of the frequency band. Also, for example, as shown in FIG. 2C , when an object moving away from the electronic device 100 exists, negative frequency signal components 230 exist in a signal of a frequency band.

Accordingly, whether or not a moving object exists may be identified according to whether a frequency signal component shifted in a frequency band exists.

Meanwhile, the electronic device 100 includes a speaker 130 . In this case, when audio is output through the speaker 130, the speaker 130 vibrates, and the electronic device 100 may vibrate due to the vibration of the speaker 130.

In this case, even if there is no moving object around the electronic device 100, a shifted frequency signal component may exist in the signal 20 received by the electronic device 100 due to the vibration of the electronic device 100 itself. .

Therefore, when the vibration of the electronic device 100 according to the vibration of the speaker 130 is not considered, even when there is no moving object around the electronic device 100, an object moving by the shifted frequency signal component may be misrecognized as existing.

Accordingly, the electronic device 100 according to an embodiment of the present disclosure removes the shifted frequency signal component generated by the vibration of the electronic device 100 from the signal in the frequency band, and then uses the electronic device 100 based on the signal in the frequency band. The presence or absence of a moving object around the device 100 is identified. Accordingly, according to an embodiment of the present disclosure, it is possible to prevent misrecognition of the existence of an object.

3 is a block diagram for explaining the configuration of an electronic device according to an embodiment of the present disclosure.

Referring to FIG. 3 , the electronic device 100 includes a transmitter 110 , a receiver 120 and a speaker 130 .

The transmitter 110 may transmit a signal. To this end, the transmitter 110 may include an antenna and transmit signals to the vicinity of the electronic device 100 . Here, the signal may be a Radio Frequency (RF) signal. The RF signal may include a Continuous Wave (CW) signal having a specific frequency. To this end, the transmitter 110 may include an RF signal generator (not shown) for generating an RF signal using a circuit.

The receiver 120 may receive a signal. To this end, the receiver 120 includes an antenna, and when a signal transmitted by the transmitter 110 is reflected around the electronic device 100, the receiver 120 may receive the reflected signal.

In this case, the receiver 120 may perform quad demodulation on the received signal to generate I and Q signals of the received scene. To this end, the receiver 120 includes a phase shifter (not shown) that shifts the signal transmitted from the transmitter 110 by a predetermined phase, and a first mixer that mixes the received signal and the transmitted signal to output an I signal ( (not shown) and a second mixer (not shown) for outputting a Q signal by mixing the received signal and the transmitted signal whose phase is shifted.

The speaker 130 may output audio. In this case, the speaker 130 may be built into the electronic device 100 or attached to the outside of the electronic device 100 .

The processor 140 may control overall operations and functions of the electronic device 100 . To this end, the processor 140 may be electrically connected to the transmitter 110 , the receiver 120 and the speaker 130 . Also, the processor 140 may include a central processing unit (CPU) or an application processor (AP). In this case, the processor 140 may execute one or more software programs stored in the memory according to one or more instructions to control operations of various hardware included in the electronic device 100 and support various functions.

Meanwhile, the processor 140 transmits a signal through the transmitter 110, and when the transmitted signal is reflected and received through the receiver 120, the processor 140 determines whether an object exists around the electronic device 100 using the received signal. In particular, it is possible to identify whether a moving object exists, which will be described in more detail with reference to FIG. 4 .

4 is a flowchart illustrating a method of identifying whether an object exists around an electronic device according to an embodiment of the present disclosure.

First, the processor 140 may control the transmission unit 110 to transmit a signal around the electronic device 100 while audio is output through the speaker 130 (S410).

For example, the processor 140 may output audio through the speaker 130, output an image through the display unit of the electronic device 100, and output audio related to the image through the speaker 130.

While audio is output through the speaker 130 as described above, the processor 140 may control the transmission unit 110 to transmit a signal around the electronic device 100 .

Then, when the transmitted signal is reflected around the electronic device 100 and received through the receiver 120, the processor 140 performs FFT on the received signal to convert the received signal into a signal of a frequency band. It can (S420).

Specifically, the processor 140 may obtain the I and Q signals of the received signal by controlling the receiver 120 to perform quad demodulation on the received signal. Also, the processor 140 may sum the I signal and the Q signal and perform FFT on the summed signal to convert the received signal into a signal of a frequency band.

And, the processor 140 may identify the energy of the first frequency band and the energy of the second frequency band from the signal of the frequency band (S430).

Here, the energy of the frequency band may be calculated by summing the magnitudes of frequency signal components within the frequency band.

Also, the first frequency band may include a negative frequency band based on the center frequency of the FFT, and the second frequency band may include a positive frequency band based on the center frequency of the FFT. Specifically, the signal of the frequency band may include a negative frequency band to a positive frequency band based on 0, which is the center frequency of the FFT. In this case, the first frequency band may mean a negative frequency band, and the second frequency band may mean a positive frequency band.

Accordingly, the processor 140 calculates energy of a negative frequency band among signals in a frequency band to identify energy in a first frequency band, and calculates energy in a positive frequency band among signals in a frequency band to identify energy in a second frequency band. of energy can be identified.

Also, the processor 140 may calculate a difference between the energy of the first frequency band and the energy of the second frequency band, and identify whether the difference value is greater than or equal to a threshold value.

In this case, when the difference value is greater than or equal to the threshold value (S440-Y), the processor 140 may identify that an object exists around the electronic device 100 (S450). However, when the difference value is less than the threshold value, the processor 140 may identify that there is no object around the electronic device 100 .

Specifically, the processor 140 determines whether the value obtained by subtracting the energy of the second frequency band from the energy of the first frequency band is equal to or greater than the threshold value, or the value obtained by subtracting the energy of the first frequency band from the energy of the second frequency band is greater than or equal to the threshold value. In this case, it may be identified that an object exists around the electronic device 100 .

As such, according to an embodiment of the present disclosure, the existence of an object is determined by comparing the energy difference between frequency bands with a threshold value, which will be described in more detail with reference to FIGS. do.

Specifically, when audio is output through the speaker 130, the electronic device 100 may vibrate due to the vibration of the speaker 130. In this case, when the electronic device 100 transmits a signal to the surroundings, it can be regarded as transmitting a signal while the electronic device 100 moves due to vibration of the electronic device 100 . Accordingly, even when an object around the electronic device 100 does not move, a signal reflected from the object and received may include a shifted frequency signal component.

On the other hand, in that the vibration of the speaker 130 is a vibration generated in the process of reciprocating the diaphragm when an AC signal is applied to the diaphragm for outputting audio, the vibration of the speaker 130 is related to its direction and speed. may have a certain regularity. In this case, since the electronic device 100 is affected by the vibration of the speaker 130, the vibration of the electronic device 100 may also have a certain regularity in its direction and speed.

Accordingly, the shifted frequency signal component generated as the electronic device 100 vibrates may have a shape substantially symmetrical on the left and right with respect to the center frequency of the FFT in the frequency band.

For example, it is assumed that there is no moving object around the electronic device 100 . In this case, while audio is output from the speaker 130, a signal transmitted from the electronic device 100 is reflected around the electronic device 100 and received by the electronic device 100, and the received signal is converted into a frequency band. If so, a signal waveform as shown in FIG. 5 can be obtained. Referring to FIG. 5 , signals in a frequency band have a substantially symmetrical form between signals 510 in a negative frequency domain and signals 520 in a positive frequency domain based on a center frequency.

Therefore, in the present disclosure, in consideration of this symmetry, in order to remove the shifted frequency signal component generated as the electronic device 100 vibrates, the difference between the energy of the first frequency band and the energy of the second frequency band is calculated, It is identified whether an object exists around the electronic device 100 .

Meanwhile, as described above, when a moving object exists around the electronic device 100, a shifted frequency signal component is generated. Therefore, when there is a moving object around the electronic device 100 while audio is output through the speaker 130, the received signal includes the shifted frequency signal component generated by the movement of the object and the electronic device 100. All of the shifted frequency signal components generated by the motion of may be included.

For example, it is assumed that an object approaching the electronic device 100 exists while audio is being output through the speaker 130 .

In this case, as shown in FIG. 6A , a shifted frequency signal component generated by an object and a shifted frequency signal component generated according to vibration of the electronic device 100 may exist in a negative frequency band of the received signal.

In this case, when the energy of the positive frequency band 610-2 is subtracted from the energy of the negative frequency band 610-1, the shifted frequency signal component generated according to the vibration of the electronic device 100 is removed, Only energy of a shifted frequency signal component generated by an object approaching the electronic device 100 exists.

Accordingly, the processor 140 calculates a value obtained by subtracting the energy of the positive frequency band 610-2 from the energy of the negative frequency band 610-1, compares the calculated value with a threshold value, and If the value is greater than the threshold value, it may be determined that an object approaching the electronic device 100 exists, and it may be determined that an object exists around the electronic device 100 .

As another example, it is assumed that an object moving away from the electronic device 100 exists while audio is being output through the speaker 130 .

In this case, as shown in FIG. 6B , a shifted frequency signal component generated by an object and a shifted frequency signal component generated according to vibration of the electronic device 100 may exist in a positive frequency band of the received signal.

In this case, when the energy of the positive frequency band 620-2 is subtracted from the energy of the negative frequency band 620-1, the shifted frequency signal component generated according to the vibration of the electronic device 100 is removed, Only energy of a shifted frequency signal component generated by an object moving away from the electronic device 100 exists.

Accordingly, the processor 140 calculates a value obtained by subtracting the energy of the negative frequency band 620-1 from the energy of the positive frequency band 620-2, compares the calculated value with a threshold value, and If the value is greater than the threshold, it may be determined that an object moving away from the electronic device 100 exists, and it may be determined that an object exists around the electronic device 100.

As such, according to an embodiment of the present disclosure, the electronic device 100 removes components of the shifted frequency signal generated according to the vibration of the electronic device 100, and objects and electronic devices approaching the electronic device 100 are removed. An object moving away from the device 100 can be detected.

Meanwhile, the processor 140 may calculate the energy of the frequency band by applying a relatively larger weight to a frequency having a smaller frequency among the frequency bands of the signal of the converted frequency band.

Specifically, the processor 140 calculates the energy of the first frequency band by applying a relatively large weight to the magnitude of the frequency signal as the absolute value of the magnitude of the frequency of the first frequency band decreases, and calculates the energy of the second frequency band. As the absolute value of the magnitude decreases, the energy of the second frequency band may be calculated by applying a relatively large weight to the magnitude of the frequency signal.

Also, the processor 140 may identify whether an object exists around the electronic device based on the calculated difference between the energy of the first frequency band and the energy of the second frequency band and the threshold value.

As described above, according to an embodiment of the present disclosure, the energy of a frequency band is calculated by applying a relatively larger weight to a frequency having a smaller frequency, for the following reason.

Specifically, when a frequency shift is generated by a moving object, the amount of frequency shift, that is, the shift amount is proportional to the speed of the moving object. That is, as the moving speed of the object increases, the amount of frequency shift increases, and as the speed of moving the object decreases, the amount of frequency shift decreases.

Meanwhile, for example, when the electronic device 100 is a TV, in order to watch TV, the user approaches the TV and then watches the TV in a stopped state. Also, when viewing of the TV ends, the user in a stopped state may move away from the TV. In this case, the user's movement speed is relatively low before and after the stationary state, and accordingly, the frequency shift amount of the frequency signal generated by the user's movement at that time becomes relatively smaller than after the movement. Therefore, in the present disclosure, considering the movement characteristics of these objects, the shifted frequency signal components generated at the time when the user in a stationary state started to move (ie, frequency signal components with a relatively small shift) Since the energy is calculated by applying a large weight, it is possible to more accurately identify the existence of an object existing around the electronic device 100 .

Meanwhile, as described above, the processor 140 may compare the difference between the energy of the first frequency band and the energy of the second frequency band with a threshold value to determine whether an object exists around the electronic device 100 .

Here, the threshold value may be a predetermined value according to the degree of normal movement of a person around the electronic device 100 .

In addition, the processor 140 normalizes the difference between the energy of the first frequency band and the energy of the second frequency band, compares the normalized difference with a threshold value, and determines whether an object exists around the electronic device 100. can also be identified. In this case, the processor 140 may perform normalization by dividing the difference between the energy of the first frequency band and the energy of the second frequency band by the energy of the entire frequency band.

Meanwhile, as described above, in the present disclosure, it is determined whether an object exists around the electronic device 100 by considering the vibration of the electronic device 100 according to the vibration of the speaker 130 . At this time, in that the degree of movement of the electronic device 100 may vary according to the volume level of the speaker 130 (for example, as the volume level of the speaker 130 increases, the vibration of the speaker 130 increases, and accordingly vibration of the electronic device 100 may increase), the electronic device 100 stores a threshold value corresponding to each volume level for each of a plurality of volume levels of the speaker 130, and determines the volume level of the speaker 130 It may be determined whether an object around the electronic device 100 exists using a corresponding threshold value.

To this end, the electronic device 100 may store a plurality of threshold values corresponding to a plurality of volume levels of the speaker 130 . In this case, the plurality of threshold values may be preset to a higher value as the volume level increases, and may be preset to a smaller value as the volume level decreases.

For example, as shown in FIG. 7, when the volume level of the speaker 130 is 20 or less, the threshold value is set to 0.2, and when the volume level of the speaker 130 is greater than 20 and less than or equal to 50, the threshold value is set to 0.3. . When the volume level of the speaker 130 is greater than 50 and less than 70, the threshold value is set to 0.4. When the volume level of the speaker 130 exceeds 70, the threshold value may be set to 0.5. In this case, the threshold value may be an example of values set for comparison with the normalized energy value.

Then, the processor 140 identifies a threshold value corresponding to the volume level of the speaker 130 among a plurality of threshold values corresponding to the plurality of volume levels of the speaker 130, and determines the energy of the first frequency band and the second threshold value. Based on the difference between the energies of the frequency band and the identified threshold value, it may be identified whether a user exists around the electronic device 100 .

In the above example, when the current volume level of the speaker 130 outputting audio is 30, the processor 140 determines that the threshold value corresponding to the volume level of the speaker 130 is 0.3, and the first frequency band A value obtained by dividing the difference between the energy of the second frequency band and the energy of the entire frequency band by the energy of the entire frequency band is compared with 0.3 to determine whether a user is present around the electronic device 100 .

Meanwhile, the vibration of the electronic device 100 generated according to the vibration of the speaker 130 may not have perfect symmetry in its direction and speed due to various factors. In this case, the shifted frequency signal component generated by the vibration of the electronic device 100 may not be completely symmetrical on the left and right with respect to the center frequency of the FFT.

Accordingly, even when the difference between the energy of the first frequency band and the energy of the second frequency band is calculated, the energy of the shifted frequency signal component generated by the vibration of the electronic device 100 may remain without being completely removed. . At this time, since the vibration of the electronic device 100 increases as the volume level of the speaker 130 increases, the size of the remaining energy that is not removed may increase. In this case, due to the remaining energy, the electronic device 100 It may be misrecognized as having an object in the vicinity.

Therefore, in the present disclosure, by setting the threshold value to be proportional to the audio volume level of the speaker 130, it is possible to lower the false recognition rate.

8 is a diagram for explaining a method for an electronic device to identify whether an object exists according to an embodiment of the present disclosure.

Since S810, S820, S830, S860, and S870 of FIG. 8 are the same as S410, S420, S430, S440, and S450 of FIG. 4, overlapping descriptions will be omitted.

The processor 140 may identify whether the volume level of the speaker 130 is equal to or greater than a preset level.

Further, when the processor 140 identifies that the volume level of the speaker 130 is less than a preset level (S840-N), it can identify whether the sum of all energies of the frequency band is greater than or equal to a threshold value. Also, if the sum of the total energies of the frequency band is equal to or greater than the threshold value (S850-Y), the processor 140 may identify that an object around the electronic device 100 exists (S870).

Specifically, as described above, when present in an object moving around the electronic device 100, a shifted frequency signal component may exist in a negative frequency domain or a positive frequency domain. Accordingly, the processor 140 may calculate the sum of energy in the entire frequency band and compare the calculated sum of energy with a threshold value to identify whether an object exists.

Meanwhile, when the processor 140 identifies that the volume level of the speaker 130 is equal to or greater than a predetermined level (S840-Y), the processor 140 identifies whether the difference between the energy of the first frequency band and the energy of the second frequency band is greater than or equal to a threshold value. can In addition, when the difference between the energy of the first frequency band and the energy of the second frequency band is greater than or equal to a threshold value (S860-Y), the processor 140 may identify that an object around the electronic device 100 exists ( S870). Meanwhile, since steps S860 and S870 are the same as those described in FIG. 4 , overlapping descriptions are omitted.

In this way, according to the volume level of the speaker 130, in the present disclosure, the entire energy of the frequency band is compared with a threshold value or the difference between the energies of the first frequency band and the second frequency band is compared with the threshold value to determine whether an object exists or not. will identify

Specifically, when an object approaching the electronic device 100 and an object moving away from the electronic device 100 exist at the same time, shifted frequency signal components may exist in both the negative frequency domain and the positive frequency domain.

In this case, if the difference between the energy of the negative frequency band and the energy of the positive frequency band is calculated, even the energy of the shifted frequency signal component generated by the movement of the object may be removed. The recognition rate for existence may be lowered.

On the other hand, when the sum of the energies of the entire frequency band is calculated, the energy of the shifted frequency signal component generated by the motion of the object is not removed. However, in this case, even the energy of the shifted frequency signal component generated by the vibration of the electronic device 100 may be included in the sum of the energies of the entire frequency band.

Meanwhile, as the volume level of the speaker 130 decreases, the vibration of the electronic device 100 decreases, and the energy of the shifted frequency signal component generated by the vibration of the electronic device 100 occupies in the sum of all frequency band energies. The ratio also goes down. Therefore, when the volume level of the speaker 130 is low, the false recognition rate is reduced even when the presence or absence of an object is identified based on the sum of all frequency band energies in that the vibration of the electronic device 100 is less affected. can be lowered Here, the false recognition rate may refer to a probability of recognizing that an object does not exist around the electronic device 100 but does exist.

Accordingly, according to an embodiment of the present disclosure, in that the electronic device 100 differentiates a method for identifying whether an object exists according to the volume level of the speaker 130, erroneous recognition of the existence of an object is prevented and at the same time recognition rate can be increased.

9 is a block diagram for explaining a detailed configuration of an electronic device according to an embodiment of the present disclosure.

Referring to FIG. 9 , the electronic device 100 includes a transmitter 110, a receiver 120, a speaker 130, a processor 140, a display unit 150, a communication interface 160, a user input unit 170, and A memory 180 may be included. Here, these components may be controlled by the processor 140 . Meanwhile, the components shown in FIG. 9 are only examples, and it goes without saying that at least some components may be omitted or other components may be added according to embodiments.

In addition, since the transmission unit 110, the reception unit 120, the speaker 130, and the processor 140 have been described in FIGS. 1 to 8, detailed descriptions of overlapping parts will be omitted.

The display unit 150 may display various screens. For example, the display unit 150 may display various images provided by the electronic device 100 . Also, the processor 140 may display information on whether objects around the electronic device 100 exist or not on the display unit 150 .

To this end, the display unit 150 may be implemented with various types of displays such as LCD, LED, or OLED. Meanwhile, the display unit 150 may be implemented as a touch screen. In this case, the processor 140 may receive various user commands through touch manipulation on the touch screen.

The communication interface 160 may perform communication with an external device. For example, the communication interface 160 may communicate with an external electronic device (not shown) and a server (not shown).

In this case, the processor 140 may transmit and receive various data with an external electronic device (not shown) and a server (not shown) through the communication interface 160 . For example, the processor 140 may receive video and audio through a server (not shown) using the communication interface 160 .

To this end, the communication interface 160 includes a Wi-Fi communication module, and can perform communication with an external device using a Wi-Fi communication method.

The user input unit 170 is a component for receiving various user commands. For example, the user input unit 170 may include a touch panel and physical buttons, and the user input unit 170 may include a voice recognition unit that recognizes a user's voice command for controlling the electronic device 100, and the like. can include Accordingly, the processor 140 may perform the various operations described above according to a user command input through the user input unit 170 . For example, when a user command for adjusting the volume level of the speaker 130 is input through the user input unit 170, the processor 140 sets the volume level of the speaker 130 according to the input user command, The speaker 130 may be controlled to output audio in a size corresponding to the volume level.

The memory 180 may store various commands, programs, or data related to the operation of the electronic device 100 . For example, the memory 180 may include information about a plurality of threshold values corresponding to a plurality of volume levels and a predetermined level.

To this end, the memory 180 may be implemented as a non-volatile memory, a volatile memory, a flash-memory, a hard disk drive (HDD), or a solid state drive (SSD). Here, the memory 180 is accessed by the processor 140, and data can be read/written/modified/deleted/updated by the processor 140.

10 is a flowchart illustrating a control method of an electronic device including a speaker according to an embodiment of the present disclosure.

First, while audio is output through a speaker, a signal is transmitted around the electronic device (S1010).

Then, when the transmitted signal is reflected around the electronic device and received by the electronic device, FFT is performed on the received signal to convert the received signal into a signal of a frequency band (S1020).

Then, the energy of the first frequency band and the energy of the second frequency band are identified in the signal of the frequency band (S1030).

Then, based on the difference between the energy of the first frequency band and the energy of the second frequency band and the threshold value, whether or not an object around the electronic device is identified is identified (S1040).

Specifically, in step S1040, the value obtained by subtracting the energy of the second frequency band from the energy of the first frequency band is greater than the threshold, or the value obtained by subtracting the energy of the first frequency band from the energy of the second frequency band is greater than the threshold. In this case, it can be identified that the object exists.

Here, the first frequency band may include a negative frequency band among the frequency bands based on the center frequency of the FFT, and the second frequency band may include a positive frequency band among the frequency bands based on the center frequency of the FFT. can

Further, in step S1030, the energy of the frequency band may be calculated by applying a relatively large weight to a frequency having a small frequency among the frequency bands.

Meanwhile, among a plurality of threshold values corresponding to a plurality of volume levels of the speaker, a threshold value corresponding to the volume level of the speaker may be identified. Here, the plurality of threshold values may be preset to a higher value as the volume level increases and to a smaller value as the volume level decreases. In this case, operation S1040 may identify whether a user exists around the electronic device based on the difference between the energy of the first frequency band and the energy of the second frequency band and the identified threshold value.

Meanwhile, the detailed method for identifying whether an object around the electronic device exists has been described above. Accordingly, according to the present disclosure, even when audio is output from a speaker of the electronic device and motion occurs in the electronic device, the false recognition rate for object detection is reduced by removing signal components generated by the motion of the electronic device. It can be.

Meanwhile, according to an exemplary embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage medium (eg, a computer). A device is a device capable of calling a command stored from a storage medium and operating according to the called command, and may include a device according to the disclosed embodiments. When a command is executed by a processor, the processor directly or A function corresponding to a command may be performed using other components under the control of the processor. A command may include code generated or executed by a compiler or an interpreter. A device-readable storage medium is a non-temporary It can be provided in the form of a (non-transitory) storage medium, where 'non-transitory storage medium' only means that it is a tangible device and does not contain a signal (e.g. electromagnetic wave), This term does not differentiate between a case where data is stored semi-permanently and a case where data is temporarily stored in a storage medium.For example, 'non-temporary storage medium' may include a buffer in which data is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store™) or on two user devices (e.g. It can be distributed (eg downloaded or uploaded) online, directly between smartphones. In the case of online distribution, at least a part of a computer program product (eg, a downloadable app) is stored on a device-readable storage medium such as a memory of a manufacturer's server, an application store's server, or a relay server. It can be temporarily stored or created temporarily.

Although the preferred embodiments of the present disclosure have been shown and described above, the present disclosure is not limited to the specific embodiments described above, and is common in the technical field belonging to the present disclosure without departing from the gist of the present disclosure claimed in the claims. Of course, various modifications and implementations are possible by those with knowledge of, and these modifications should not be individually understood from the technical spirit or perspective of the present disclosure.

100: electronic device 110: transmission unit
120: receiver 130: speaker
140: processor

Claims (13)

In electronic devices,
transmission unit;
receiver;
speaker; and
Controlling the transmission unit to transmit a signal around the electronic device while audio is output through the speaker;
When the transmitted signal is reflected around the electronic device and received through the receiver, converting the received signal into a signal of a frequency band by performing a fast fourier transform (FFT) on the received signal;
Identifying energy in a first frequency band and energy in a second frequency band in the signal in the frequency band;
and a processor configured to identify whether an object around the electronic device exists based on a difference between the energy of the first frequency band and the energy of the second frequency band and a threshold value. According to claim 1,
the processor,
A value obtained by subtracting the energy of the second frequency band from the energy of the first frequency band is greater than the threshold value, or a value obtained by subtracting the energy of the first frequency band from the energy of the second frequency band is greater than the threshold value If so, the electronic device identifies that the object exists. According to claim 1,
The first frequency band,
Based on the center frequency of the FFT, including a negative frequency band among the frequency bands,
The second frequency band,
An electronic device including a positive frequency band among the frequency bands based on the center frequency of the FFT. According to claim 3,
the processor,
An electronic device that calculates the energy of the frequency band by applying a relatively large weight to a frequency having a smaller frequency level among the frequency bands. According to claim 1,
the processor,
Identifying a threshold value corresponding to the volume level of the speaker among a plurality of threshold values corresponding to a plurality of volume levels of the speaker;
The electronic device for identifying whether a user exists around the electronic device based on the difference between the energy of the first frequency band and the energy of the second frequency band and the identified threshold value. According to claim 5,
The plurality of threshold values are preset to a higher value as the volume level increases and to a lower value as the volume level decreases. In electronic devices,
transmission unit;
receiver;
speaker; and
Controlling the transmission unit to transmit a signal around the electronic device while audio is output through the speaker;
When the transmitted signal is reflected around the electronic device and received through the receiver, converting the received signal into a signal of a frequency band by performing a fast fourier transform (FFT) on the received signal;
A processor for identifying the presence or absence of an object around the electronic device based on the signal of the frequency band;
the processor,
When the volume level of the speaker is equal to or greater than a preset level, the energy of the first frequency band and the energy of the second frequency band are identified in the signal of the frequency band, and the energy of the first frequency band and the energy of the second frequency band are identified. Identifying whether an object around the electronic device exists based on a difference between and a threshold value;
When the volume level of the speaker is less than a predetermined level, the electronic device identifies the presence or absence of an object around the electronic device based on the total energy of the frequency band. A control method of an electronic device including a speaker,
transmitting a signal around the electronic device while audio is output through the speaker;
converting the received signal into a signal of a frequency band by performing a fast fourier transform (FFT) on the received signal when the transmitted signal is reflected around the electronic device and received by the electronic device;
identifying energy in a first frequency band and energy in a second frequency band in the signal in the frequency band; and
and identifying whether an object around the electronic device exists based on a difference between the energy of the first frequency band and the energy of the second frequency band and a threshold value. According to claim 8,
The step of identifying whether the object exists,
A value obtained by subtracting the energy of the second frequency band from the energy of the first frequency band is greater than the threshold value, or a value obtained by subtracting the energy of the first frequency band from the energy of the second frequency band is greater than the threshold value If the object exists, the control method of the electronic device identifying that the object exists. According to claim 8,
The first frequency band,
Based on the center frequency of the FFT, including a negative frequency band among the frequency bands,
The second frequency band,
A control method of an electronic device including a positive frequency band among the frequency bands based on the center frequency of the FFT. According to claim 10,
Identifying the energy of the first and second frequency bands,
A method of controlling an electronic device in which energy of a frequency band is calculated by applying a relatively large weight to a frequency having a smaller frequency level among the frequency bands. According to claim 8,
Identifying a threshold value corresponding to the volume level of the speaker among a plurality of threshold values corresponding to a plurality of volume levels of the speaker;
The step of identifying whether the object exists,
The electronic device control method of identifying whether a user exists around the electronic device based on the difference between the energy of the first frequency band and the energy of the second frequency band and the identified threshold value. According to claim 12,
The plurality of threshold values are preset to a higher value as the volume level increases and preset to lower values as the volume level decreases.

Images