KR20230075781A - Electronic apparatus for audio signal processing and control method thereof - Google Patents

Abstract

An electronic device includes: a speaker which outputs audio; and a processor configured to: output audio at a first volume level through the speaker; obtain a noise level around the electronic device; identify an adjustment width corresponding to the difference between the first volume level and the noise level, in response to receiving an input with respect to the adjustment of the volume level of the audio through a user input unit; and output the audio through the speaker at a second volume level identified based on basic adjustment amount according to the input and identified adjustment width.

Description

Electronic device for audio signal processing and its control method {ELECTRONIC APPARATUS FOR AUDIO SIGNAL PROCESSING AND CONTROL METHOD THEREOF}

The present invention relates to an electronic device having a speaker that outputs audio and a method for controlling the same, and more particularly, to an electronic device that allows a user to manually manipulate a user input unit such as a remote controller to adjust the volume of audio output from a speaker. It relates to an electronic device and its control method.

In order to calculate and process predetermined information according to a specific process, electronic devices that basically include electronic components such as a CPU, chipset, and memory for calculation are various types depending on the information to be processed or the purpose of use. can be distinguished by For example, electronic devices include an information processing device such as a PC (personal computer) or server that processes general-purpose information, an image processing device that processes image data, an audio device that processes audio, and performs household chores. There are household appliances to do. The image processing device may be implemented as a display device that displays processed image data as an image on a display panel provided therewith. Among these electronic devices, there are those that include a speaker that outputs audio, for example, a TV capable of outputting the audio of a corresponding image while displaying an image, a sound bar capable of outputting only audio, and the like.

An electronic device may provide various user interface environments in which a user can manually adjust the volume of audio output from a speaker of the electronic device. Representative examples of such various user interface environments include a volume-up button and a volume-down button of a remote controller. The electronic device allows the user to direct the volume adjustment through these buttons.

However, even if the audio volume is the same, the perceived level heard by the user's ears is different according to the noise level generated in the surrounding environment of the electronic device. Because of this, a user under the influence of noise will try to adjust the audio volume as soon as possible by operating the remote controller. If the noise level is high and the audio volume is low, the user will not be able to hear the audio well because of the noise, so the user will want to increase the audio volume quickly. On the other hand, if the noise level is low and the audio volume is high, the audio volume will sound too loud to the user, and the user will want to quickly lower the audio volume. However, in this situation, if the audio volume is to be adjusted to a level desired by the user, the number of manipulations of the above-mentioned buttons increases or the time required to press the buttons becomes longer.

In this regard, an electronic device providing an environment in which a user can adjust audio volume to a desired level with less manipulation under an environment in which the user manually adjusts the audio volume may be required.

An electronic device according to an embodiment of the present invention includes a speaker that outputs audio, outputs audio at a first volume level through the speaker, obtains a noise level around the electronic device, and outputs the audio through a user input unit. In response to receiving an input regarding adjustment of the volume level, an adjustment width corresponding to a difference between the first volume level and the noise level is identified, and identification is made based on a basic adjustment amount according to the input and the identified adjustment width. and a processor for outputting the audio through the speaker at a second volume level.

Also, the second volume level may be identified by adjusting the first volume level by reflecting the adjustment width in the basic adjustment amount.

In addition, the adjustment width may increase as the difference between the first volume level and the noise level increases, and may decrease as the difference between the first volume level and the noise level decreases.

In addition, when the input increases the audio volume level in a state where the noise level is higher than the reference noise level or the input decreases the audio volume level in a state in which the noise level is lower than the reference noise level, In a state where the adjustment width is a first adjustment width and the noise level is higher than the reference noise level, the input lowers the audio volume level, or in a state in which the noise level is lower than the reference noise level, the input lowers the audio volume level. The adjustment width when is raised is a second adjustment width, and the first adjustment width may be greater than the second adjustment width.

In addition, the adjustment width corresponds to a third adjustment width corresponding to a difference between the volume level of the high frequency component of the audio and the noise level, and a difference between the volume level of the low frequency component of the audio and the noise level, and the third adjustment width corresponds to the difference between the volume level of the high frequency component of the audio and the noise level. and a fourth adjustment width different from the adjustment width, wherein the processor may assign the third adjustment width to a high-frequency component of the audio and the fourth adjustment width to a low-frequency component of the audio.

The user input unit may include a remote controller, and the remote controller may include a volume control button provided to increase or decrease the volume level of the audio, and a microphone to collect noise around the electronic device.

The electronic device may further include a microphone, and the microphone may be activated to collect sounds around the electronic device in response to the input being performed through the user input unit while in a deactivated state.

Also, the processor may display a UI notifying that the second volume level is identified by reflecting the identified adjustment width.

Also, the processor may display the color of the UI differently in response to the identified change in the adjustment width.

In addition, the processor may identify a current context of a predefined condition and adjust the identified adjustment width in response to the identified context.

In addition, the processor may perform scene analysis on the audio signal, and adjust the identified adjustment width in response to a result of the scene analysis.

In addition, a control method of an electronic device according to an embodiment of the present invention includes outputting audio at a first volume level through a speaker, obtaining a noise level around the electronic device, and receiving through a user input unit. identifying an adjustment amount corresponding to a difference between the first volume level and the noise level in response to receiving an input relating to the adjustment of the volume level of the audio; and outputting the audio through the speaker at a second volume level identified based on the adjustment width.

Also, the second volume level may be identified by adjusting the first volume level by reflecting the adjustment width in the basic adjustment amount.

In addition, the adjustment width may increase as the difference between the first volume level and the noise level increases, and may decrease as the difference between the first volume level and the noise level decreases.

In addition, a UI indicating that the level adjustment amount is identified by reflecting the identified second volume level may be displayed.

1 is an exemplary diagram of an electronic device.
2 is a configuration block diagram of an electronic device.
3 is an exemplary diagram of a remote controller.
4 is a graph showing the relationship between the output gain corresponding to the audio volume level.
5 is a flowchart illustrating a control method of an electronic device.
6 is a block diagram illustrating a process in which an electronic device adjusts a volume level of an audio signal.
7 is an example of a state in which an electronic device displays a UI related to a setting state of an adjustment amount of an audio volume level.
8 is a flowchart illustrating operations when an electronic device considers a context of a current point of view.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. Embodiments described with reference to each drawing are not mutually exclusive configurations unless otherwise specified, and a plurality of embodiments may be selectively combined and implemented in one device. A combination of these plurality of embodiments may be arbitrarily selected and applied by a person skilled in the art in implementing the spirit of the present invention.

If there are terms including ordinal numbers, such as the first element and the second element in the embodiment, these terms are used to describe various elements, and the term distinguishes one element from other elements. As used to do, these components are not limited in meaning by terms. Terms used in the embodiments are applied to describe the corresponding embodiments and do not limit the spirit of the present invention.

In addition, when the expression "at least one" among a plurality of components in the present specification appears, this expression refers to not only the entire plurality of components, but also each one or these excluding the rest of the plurality of components. refers to all combinations of

1 is an exemplary diagram of an electronic device.

2 is a configuration block diagram of an electronic device.

As shown in FIGS. 1 and 2 , this embodiment relates to an electronic device 1 . The electronic device 1 according to the present embodiment may be implemented as various types of devices within a range capable of outputting audio. For example, the electronic device 1 is an information processing device including a PC, server, and the like; fixed display devices including TVs, monitors, digital signage, electronic blackboards, electronic photo frames, and the like; It is a mobile device including a smart phone, tablet device, portable multimedia player, and the like; It is an image processing device including a set-top box, an optical media player, and the like; household appliances including refrigerators, washing machines, clothing management devices, air conditioners, and the like; A gateway, hub, host device, or slave device that builds an IoT (internet of things) environment; It may be implemented as a wearable device that can be worn by a person.

The electronic device 1 includes various hardware elements for operation. In this embodiment, a case in which the electronic device 1 is implemented as a display device will be described. However, as described above, since the electronic device 1 can be implemented as various types of devices, the configuration described below is only one of various implementation examples.

The electronic device 1 may include an interface unit 10 . The interface unit 10 includes interface circuits for the electronic device 1 to communicate with various types of external devices 200 and to transmit/receive data. The interface unit 10 includes at least one of one or more wired interface units 11 for wired communication connection or one or more wireless interface units 12 for wireless communication connection according to a connection method.

The wired interface unit 11 includes a connector or port to which a cable of a predefined transmission standard is connected. For example, the wired interface unit 11 includes a port connected to a terrestrial or satellite broadcasting antenna or a cable of cable broadcasting to receive a broadcasting signal. Alternatively, the wired interface unit 11 provides a port to which cables of various wire transmission standards such as HDMI, DP (DisplayPort), DVI, component, composite, S-Video, and Thunderbolt are connected to connect to various image processing devices. include Alternatively, the wired interface unit 11 includes a USB standard port for connection with a USB device. Alternatively, the wired interface unit 11 includes an optical port to which an optical cable is connected. Alternatively, the wired interface unit 11 includes an audio input port to which an external microphone is connected, and an audio output port to which a headset, earphone, external speaker, etc. are connected. Alternatively, the wired interface unit 11 includes an Ethernet port connected to a gateway, router, hub, or the like to access a wide area network.

The wireless interface unit 12 includes a bidirectional communication circuit including at least one of components such as communication modules and communication chips corresponding to various types of wireless communication protocols. For example, the wireless interface unit 12 includes a Wi-Fi communication chip that performs wireless communication with an AP (Access Point) according to a Wi-Fi method, Bluetooth, Zigbee, Z-Wave, WirelessHD, WiGig, NFC, etc. It includes a communication chip for performing wireless communication, an IR module for IR communication, a mobile communication chip for performing mobile communication with the mobile device 200, and the like.

The electronic device 20 may include a display unit 20 . The display unit 20 forms a screen for displaying the image signal processed by the processor 70 as an image. The display unit 20 includes a display panel, and various design methods may be applied to the structure of the display panel. For example, the display unit 20 may include a display panel having a light-receiving structure such as a liquid crystal and a backlight providing light to the display panel. Alternatively, the display unit 20 may include a display panel having a self-emitting structure such as organic light emitting diodes (OLEDs). Alternatively, the display unit 20 may have a structure in which a plurality of micro LED modules are combined in a tile form to form a large screen.

The electronic device 1 may include a user input unit 30 . The user input unit 30 includes various types of user input interface-related circuits prepared to be manipulated by the user in order to perform user input. The user input unit 30 can be configured in various forms according to the type of the electronic device 1, for example, a mechanical button or electronic button of the electronic device 1; various types of sensors; touchpad; a touch screen installed on the display unit 20; There are external input devices such as a keyboard, a mouse, and the like that are separated from the electronic device 1 and connected through the interface unit 10 . The user input unit 30 according to this embodiment includes a remote controller 100. The remote controller 100 will be described later.

The electronic device 1 may include a storage unit 40 . The storage unit 40 stores digitized data. The storage unit 40 may include one or more memories 41 loaded with data to be processed by the processor 70 and having a volatile property in which data cannot be stored unless power is provided. The memory 41 includes a buffer, random access memory (RAM), and the like. In addition, the storage unit 40 may include one or more storages 42 having non-volatile properties capable of preserving data regardless of whether or not power is provided. The storage 42 includes a flash-memory, a hard-disc drive (HDD), a solid-state drive (SSD), and a read only memory (ROM).

The electronic device 1 may include a speaker 50 . When the processor 70 reproduces predetermined content, the speaker 50 outputs audio of the corresponding content. The speaker 50 may be installed in the electronic device 1 or provided as a separate device such as a sound bar. When the speaker 50 is provided as a separate device, the speaker 50 is connected to the interface unit 10, and an audio signal is transmitted to the speaker 50 through the interface unit 10.

The electronic device 1 may include a microphone set or a microphone 60 . The microphone 60 collects sound generated in the surrounding environment of the electronic device 1 and transfers data of the collected sound to the processor 70 . In this embodiment, the microphone 60 has been described as a separate component from the user input unit 30, but the microphone 60 may be considered as a component included in the user input unit 30 depending on the design method. The microphone 60 does not necessarily have to be provided in the electronic device 1, and depending on the design method, the electronic device 1 may receive collected data from the remote controller 100, the mobile terminal 200, and the like. . A description of this will be given later.

The electronic device 1 may include a processor 70 . The processor 70 includes one or more hardware processors implemented as a CPU, chipset, buffer, circuit, etc. mounted on a printed circuit board, and may be implemented as an SOC depending on a design method. When the electronic device 1 is a display device, the processor 70 includes modules corresponding to various processes such as a demultiplexer, a decoder, a scaler, an audio digital signal processor (DSP), and an amplifier to display video content as an image. do. Here, some or all of these modules may be implemented as an SOC. For example, modules related to image processing, such as a demultiplexer, a decoder, and a scaler, may be implemented as an image processing SOC, and an audio DSP may be implemented as a separate chipset from the SOC. The processor 70 reproduces predetermined content so that an image of the content is displayed on the display unit 20, while audio of the content is output through the speaker 50 as sound.

When the processor 70 receives a volume adjustment input representing a basic adjustment amount for adjusting the volume level of audio through the user input unit 30, the audio volume output through the speaker 50 according to the received volume adjustment input. adjust the level The user may perform the volume adjustment input by manipulating the user input unit 30 provided in the electronic device 1, or may perform the volume adjustment input using a separate input device such as the mobile device 200.

The mobile device 200 may perform an operation associated with the electronic device 1 by installing software associated with the electronic device 1 . For example, when the electronic device 1 is a TV, a dedicated application for controlling the TV may be installed on the operating system of the mobile device 200 . The mobile device 200 displays a UI for controlling the electronic device 1 under the environment in which the corresponding application operates, and transmits a volume adjustment input signal to the wireless interface unit 12 according to a user's manipulation input through the UI. can

The user input unit 30 may include, for example, the remote controller 100 . Hereinafter, the remote controller 100 will be described.

3 is an exemplary diagram of a remote controller.

As shown in FIGS. 1 , 2 and 3 , the remote controller 100 is one implementation example of the user input unit 30 and is physically separated from the main body of the electronic device 1 . The remote controller 100 provides a user input interface that can be manipulated by a user, and transmits a signal corresponding to a user's manipulation of the user input interface to the main body of the electronic device 1, specifically, to the interface unit 10. . The above signal transmission method is not limited to any one, and for example, the signal is transmitted from the remote controller 100 to the wireless interface unit 12 using a wireless transmission method such as Bluetooth or infrared. A signal received by the wireless interface unit 12 is transmitted to the processor 70, and the processor 70 performs an operation corresponding to a command indicated by the received signal.

The user input interface of the remote controller 100 includes, for example, a plurality of buttons 110, 120, 130, 140, 150, and 170 provided to be pressed or touched by the user. In this embodiment, the remote controller 100 includes, for example, a volume increase button 110 for increasing the audio volume level output from the speaker 50 and a volume decrease button for decreasing the audio volume level output from the speaker 50. It includes a button 120, channel switching buttons 130 and 140 for converting broadcast channel numbers forward and backward, respectively, and an enter button 150 for determining and executing a user's selection. The plurality of buttons 110, 120, 130, 140, 150, and 170 may additionally include various buttons in addition to the above examples, but descriptions of configurations not directly related to the present embodiment will be omitted.

The remote controller 100 includes a microphone 160 for collecting sound. In addition, the remote controller 100 includes a microphone activation button 170 for converting the microphone 160 in an inactive state (ie, a state in which sound cannot be collected) to an active state (ie, a state in which sound can be collected). can do. The remote controller 100 deactivates the microphone 160 while the microphone activation button 170 is not pressed, and activates the microphone 160 while the microphone activation button 170 is pressed by the user. Alternatively, the remote controller 100 activates the microphone 160 when the microphone activation button 170 is pressed once when the microphone 160 is inactive, and when the microphone 160 is activated, the microphone activation button 170 If this is pressed once, the microphone 160 may be deactivated. Alternatively, the microphone 160 may be automatically activated when the noise level of the surrounding environment rises above a certain level after being in an inactive standby state.

Meanwhile, various examples of a structure in which the electronic device 1 collects sound from the surrounding environment will be described.

As one example of collecting the noise of the surrounding environment, the electronic device 1 collects the sound of the surrounding environment through the microphone 60 provided in the main body of the electronic device 1 . The microphone 60 transmits data obtained by collecting sounds of the surrounding environment to the processor 70 . The microphone 60 can always be activated to collect sounds of the surrounding environment. Alternatively, the microphone 60 may be in a deactivated or standby mode so as not to collect sound, and then activated to collect sound when a specific condition is met. Various conditions are possible depending on the design method, and for example, a case in which the noise level generated in the surrounding environment exceeds a predetermined threshold value may be applicable. Of course, switching between activation and deactivation of the microphone 60 may be performed by user input.

As another example of collecting the noise of the surrounding environment, the sound of the surrounding environment may be collected through the microphone 160 provided in the remote controller 100 . Since the remote controller 100 is usually close to the user, the microphone 160 provided in the remote controller 100 is more sensitive to noise around the user than the microphone 60 installed in the main body of the electronic device 1. can clearly be collected. The remote controller 100 converts sound data collected through the microphone 160 into a carrier signal based on a predetermined transmission standard and transmits the converted signal to the wireless interface unit 12 . The carrier signal received by the wireless interface unit 112 is converted into sound data and transmitted to the processor 70 .

Alternatively, as another example of collecting the noise of the surrounding environment, when the mobile device 200 such as a smartphone or tablet device is equipped with a microphone, the sound of the surrounding environment may be collected through the microphone. For example, a dedicated application for controlling the electronic device 1 is installed on the operating system of the mobile device 200, and the mobile device 200 receives sound data collected through a microphone under an environment in which the corresponding application operates. It can be delivered to the electronic device 1. The mobile device 200 converts the above data into a carrier signal and wirelessly transmits the data to the wireless interface unit 12 . The carrier signal received by the wireless interface unit 12 is converted into sound data and transmitted to the processor 70 .

As such, the electronic device 1 may obtain data obtained by collecting sounds of the surrounding environment through various methods.

Meanwhile, a method for the user to manipulate the remote controller 100 to adjust the audio volume level output from the speaker 50 is as follows.

When the user operates the volume up button 110 or the volume down button 120, the remote controller 100 generates a volume adjustment input signal according to the user's button operation. The remote controller 100 transmits the above signal to the wireless interface unit 12, and the signal received by the wireless interface unit 12 is transmitted to the processor 70. The processor 70 identifies a basic adjustment amount according to the transmitted signal, and adjusts the audio volume level by adding the identified basic adjustment amount to the current audio volume level.

The processor 70 identifies the number of times the user presses (or clicks) the volume up button 110 or the volume down button 120 from the transmitted signal. For example, it is assumed that the basic adjustment amount per click of the volume increase button 110 by the user is 1, the basic adjustment amount per click of the volume decrease button 120 is -1, and the current audio volume level is 30. At this time, if the user presses the volume increase button 110 five times, the corresponding basic adjustment amount is 5, and the audio volume level is adjusted to 30+5=35. After that, if the user presses the volume down button 120 7 times, the corresponding basic adjustment amount is -7, and the audio volume level is adjusted to 35 - 7 = 28.

4 is a graph showing the relationship between the audio volume level and the corresponding output gain.

As shown in FIGS. 2 , 3 and 4 , the audio volume level output from the speaker 50 is adjusted according to the number of times the user presses the volume up button 110 or the volume down button 120 . In the graph of FIG. 4, the system volume on the horizontal axis represents the audio volume level determined by the electronic device 1, and the level is adjusted according to the value input by the user pressing the volume up button 110 or the volume down button 120. do. The attenuation level on the vertical axis represents the gain for the audio volume level output through the speaker 50 . For example, the electronic device 1 identifies a gain (a minus value in this embodiment) corresponding to the indicated audio volume level, and sets the maximum value of the audio volume level that can be output through the speaker 50 to the identified gain. add

In this graph, there are curves #A and #B. First, the gain of curve #B changes linearly with respect to the audio volume level. In the electronic device 1 to which curve #B is applied, the amount of change in gain relative to the change in audio volume level is the same for both the amount of change when the audio volume level is relatively low and the amount of change when the audio volume level is relatively high. For example, when the gain change amount is 10dB when the audio volume level changes by 10 levels from 10 to 20, the gain change amount when the audio volume level changes by 10 levels from 70 to 80 is also the same as 10dB. .

On the other hand, in curve #A, the gain does not change linearly with respect to the audio volume level, but changes curvedly in a specific section of the audio volume level. The gain in curve #A, for example, changes abruptly in response to a change in the case of a low audio volume level, whereas it changes slowly in response to a change in the case of a high audio volume level (when the audio volume level is 30). It changes almost linearly over the interval). When the amount of change in gain when the audio volume level changes by 5 levels from 5 to 10 is approximately 20 dB, the amount of change in gain when the audio volume level changes by 5 levels from 60 to 65 is less than 5 dB.

In addition to the two curves shown in this embodiment, various types of curves may be applied to the electronic device 1 . However, no matter what type of curve is applied, there may occur a case in which a large number of manipulations by the user are required in a situation where the user wants to rapidly raise or lower the audio volume level in the electronic device 1 . An example of a cause of this situation is noise in the surrounding environment of the electronic device 1 . For example, when the user wants to adjust the audio volume level by pressing the volume up button 110 or the volume down button 120, the user will want to quickly raise the audio volume level in a noisy environment, In low environments, you'll want to quickly lower the audio volume level.

Accordingly, the electronic device 1 according to the present embodiment operates as follows.

5 is a flowchart illustrating a control method of an electronic device.

As shown in FIGS. 2 , 3 and 5 , the following operations are performed by the processor 70 of the electronic device 1 .

In step 310, the electronic device 1 outputs audio at a first volume level through the speaker 50.

In step 320, the electronic device 1 acquires the noise level of the surroundings. The electronic device 1 can obtain the ambient noise level by various methods described above, for example, the microphone 60 of the electronic device 1 itself, the microphone 160 of the remote controller 100, a mobile device, and the like. can

In step 330, the electronic device 1 receives a volume adjustment input indicating a basic adjustment amount of the audio volume level through the user input unit 30. The volume adjustment input is generated by user manipulation of the volume increase button 110 or the volume decrease button 120 of the remote controller 100, for example.

In step 340, the electronic device 1 identifies an adjustment width corresponding to the difference between the first volume level and the noise level. Considering that the basic adjustment amount is reflected in the audio volume level step by step according to the number of operations corresponding to one operation of the volume up button 110 or the volume down button 120 by the user, this adjustment range is the step size. It can also be referred to as (step-size).

In step 350, the electronic device 1 outputs the audio at the second volume level identified based on the identified adjustment width and the basic adjustment amount through the speaker 50. For example, the electronic device 1 may calculate the final adjustment amount by reflecting the adjustment width to the basic adjustment amount, and identify the second volume level by adding the calculated final adjustment amount to the first volume level.

For example, if there is no step 340, the electronic device 1 will adjust the audio output through the speaker 50 to a predetermined third volume level by reflecting only the basic adjustment amount according to the volume adjustment input to the first volume level. . However, according to the present embodiment, the electronic device 1 additionally reflects the adjustment width corresponding to the difference between the first volume level (the audio volume level output at the current time) and the noise level to the basic adjustment amount. As a result, audio output through the speaker 50 is adjusted to a second volume level different from the third volume level.

Thus, the electronic device 1 according to the present embodiment can provide an environment in which the user can adjust the audio volume level to a desired level with less user manipulation in an environment in which the user adjusts the audio volume through manual manipulation. there is.

Specifically, in response to a volume adjustment input operation in which the user clicks the volume up button 110 or the volume down button 120 of the remote controller 100 once, the audio volume level is "v1" to the first volume level "v1". (x+k)” is adjusted to the second volume level “v2” reflected. When the user performs a volume increase input once (ie, when the volume increase button 110 is pressed once), "v2=v1+(x+k)", and when the user performs a volume decrease input once (That is, when the volume down button 120 is pressed once), "v2 = v1 - (x + k)". Such a calculation is performed for each click operation in which the user performs a volume adjustment input each time.

“x”, which is a basic adjustment amount according to a volume adjustment input from the user, may be a constant (eg, curve #B in FIG. 4) or a variable (eg, curve #A in FIG. 4). "k" is an adjustment width corresponding to the difference between the first volume level and the noise level, and is a variable proportional to the difference. That is, “k” is a value that increases as the difference between the audio volume level and the noise level increases, and decreases as the difference between the audio volume level and the noise level decreases. Since “k” is a value proportional to the difference between the first volume level and the noise level, if the difference is large, the audio volume level adjusted per user operation is relatively large, and if the difference is small, the user operation operation is relatively large. The audio volume level adjusted per level is relatively small.

In this embodiment, the case of “(x+k)” has been described as an example in which the adjustment width is reflected in the basic adjustment amount, but the reflected method is not necessarily limited to the case where the adjustment width is added to the basic adjustment amount. Depending on the design method, it is also possible to multiply the adjustment width by the basic adjustment amount, such as “(x*k)”, and various other mathematical relationships may be applied.

Therefore, the electronic device 1 provides a way to quickly reach a desired audio volume level with a relatively small number of user manipulations when the above difference is large. In addition, when the difference is small, the electronic device 1 allows the user to more precisely and finely adjust the audio volume level.

When the noise level of the surrounding environment is higher or lower than the predetermined reference noise level (various values may be applied depending on the design method), and the case of each direction in which the volume adjustment input is performed is combined, A number of k" can be considered. Adjust the adjustment range when the volume adjustment input increases the audio volume level when the current noise level is higher than the reference noise level, or when the volume adjustment input decreases the audio volume level when the current noise level is lower than the reference noise level. For convenience, it is referred to as "k1". On the other hand, when the volume adjustment input lowers the audio volume level in a state where the current noise level is higher than the reference noise level, or when the volume adjustment input raises the audio volume level in a state where the current noise level is lower than the reference noise level The adjustment width is referred to as "k2" for convenience. When “k1” is applied, the audio volume level needs to be quickly adjusted, whereas when “k2” is applied, the audio volume level does not need to be adjusted quickly. Therefore, the relationship between the two adjustment widths is set to satisfy "k1 > k2".

Hereinafter, a process of adjusting and outputting the volume level of an audio signal input from the electronic device 1 will be described.

6 is a block diagram illustrating a process in which an electronic device adjusts a volume level of an audio signal.

As shown in FIGS. 2 and 6 , the electronic device 1 adjusts and outputs the volume level of the input audio signal according to the volume control input. In FIG. 6, a pre-signal processor 410, a main signal processor 420, an ambient noise analyzer 430, a look-up table (LUT) 440, a system volume controller ( 450) and a post signal processor 460 are shown. These components divide the roles performed by the processor 70 for convenience. It doesn't have to include them. The processor 70 may perform all of the roles of these components, or a dedicated or general-purpose controller other than the processor 70 may perform some of the roles.

The electronic device 1 performs preprocessing of the input audio signal by the signal preprocessor 410 . Pre-processing is a preliminary work performed before the main processing of an audio signal, and includes noise removal of the audio signal.

The electronic device 1 performs main processing of the pre-processed audio signal by the signal main processor 420 . The main processing processes audio signals in various aspects such as sound mixing and equalization according to various audio modes set in the electronic device 1, for example.

The electronic device 1 adjusts the volume level of the audio signal on which the main processing has been performed by the system volume controller 450 and transfers it to the signal post-processor 460. For example, when receiving a volume adjustment input from the user input unit 30, the electronic device 1 identifies a basic adjustment amount indicated by the volume adjustment input, and adjusts the volume level of the audio signal according to the identified basic adjustment amount. .

The electronic device 1 post-processes the audio signal by the signal post-processor 460 and outputs it. Post-processing is a final process that is reflected in the step immediately before the audio signal is transmitted to the speaker 50, and includes, for example, audio amplification.

Here, according to the present embodiment, the electronic device 1 uses the ambient noise analyzer 430 in the step before the system volume controller 450 transfers the audio signal to the signal post-processor 460, and the sound of the surrounding environment. Measure the noise level of the surrounding environment from

The electronic device 1 identifies, by the LUT 440 , an adjustment width corresponding to a difference between the current audio volume level and the noise level measured by the ambient noise analyzer 430 . Here, the LUT 440 stores information of various adjustment widths corresponding to differences between various audio volume levels and noise levels within an available range in the form of a table. In this embodiment, it is expressed that the LUT 440 in the form of a table is applied, but instead of the LUT 440, various examples such as equations and functions having variables of the current audio volume level and noise level can be applied.

As described above, the electronic device 1 additionally reflects the adjustment width to the basic adjustment amount when adjusting the volume level of the audio signal according to the volume adjustment input by the system volume controller 450. Thus, in the present embodiment, when the volume level of the audio signal is adjusted by the system volume controller 450 according to the volume adjustment input, the amount of change in the volume level can be relatively increased in consideration of ambient noise (or, adjustment can be made faster).

Meanwhile, in the LUT 440 of FIG. 6, the audio signal is divided into a high-frequency component and a low-frequency component, and adjustment widths corresponding to differences between the volume level and noise level of each component may be stored. That is, the electronic device 1 determines, in the LUT 440, the first adjustment width corresponding to the difference between the volume level and the noise level of the high-frequency component of the audio signal and the difference between the volume level and the noise level of the low-frequency component of the audio signal. Obtain second adjustment widths corresponding to . When the electronic device 1 receives a volume adjustment input indicating the basic adjustment amount, the system volume controller 450 reflects the first adjustment width to the basic adjustment amount of the high-frequency component of the audio signal, and the low-frequency component of the audio signal. The second adjustment range is reflected in the basic adjustment amount of .

Here, the first adjustment width corresponding to the high frequency component is larger than the second adjustment width corresponding to the low frequency component. In general, noise that the user does not want to hear is a low frequency component, and the sound that the user wants to hear is a high frequency component. For example, when audio is output from the electronic device 1 while the vacuum cleaner is operating, the high-frequency components of the audio signal are hard to hear by the user due to the cleaner's sound, which is mainly a low-frequency component. If the first adjustment width is set to be greater than the second adjustment width, the volume level of the high-frequency component in the audio signal is adjusted faster than the volume level of the low-frequency component. Accordingly, the electronic device 1 can provide the user with a clearer sound while the volume level of the audio signal is rapidly adjusted.

7 is an example of a state in which an electronic device displays a UI related to a setting state of an adjustment amount of an audio volume level.

As shown in FIGS. 3 and 7 , when the electronic device 1 outputs audio of a second volume level adjusted by reflecting the basic adjustment amount and adjustment width to the first volume level according to the user's volume adjustment input, Various types of UIs 510 and 520 may be displayed to inform whether or not the adjustment width is reflected or the current state regarding the size of the adjustment width.

For example, when adjusting the audio volume level according to the received volume control input, the electronic device 1 displays the UI 510 including a bar visually representing the current audio volume level. The bars of the UI 510 include a first bar extending to indicate the entire audio volume level, and a second bar extending to indicate the current audio volume level within the first bar. Here, the bar of the UI 510, for example, the second bar may have a color corresponding to the size of the adjustment width. For example, the color of the second bar of the UI 510 is red if the size of the adjustment width is relatively large, blue if the size of the adjustment width is relatively small, and green if the size of the adjustment width is 0. In this way, the user can intuitively recognize how much the adjustment width is being reflected. Also, the UI 510 may display the number of changing audio volume levels of the electronic device 1 in real time.

Alternatively, the electronic device 1 determines whether or not the adjustment width is reflected (the adjustment width is set to be reflected in the basic adjustment amount), or the size of the adjustment width (the size of the adjustment width is large, the size of the adjustment width is small, or the specific change value of the adjustment width, etc. ) may display a UI 520 including a message notifying. At this time, the message of the UI 520 may specify that the adjustment width is reflected in the adjustment of the audio volume level in consideration of the current ambient noise. In this embodiment, the electronic device 1 is expressed as displaying two UIs 510 and 520 together, but depending on a design method, only one of the two UIs 510 and 520 may be displayed.

Alternatively, the electronic device 1 may inform the user of the reflected state of the adjustment width in a manner different from the above-described embodiment. For example, whenever the user presses the volume up button 110 or the volume down button 120 to adjust the system volume, the electronic device 1 may output a beep sound, and the beep sound corresponds to whether the adjustment width is reflected. The volume level, tone, or type of may be different.

Meanwhile, in reflecting the adjustment width to the basic adjustment amount according to the volume adjustment input, the electronic device 1 not only determines the adjustment width in response to the difference between the current volume level and the noise level, but also considers other conditions additionally. You can also determine the adjustment range.

8 is a flowchart illustrating operations when an electronic device considers a context of a current point of view.

As shown in FIGS. 2 and 8 , the following operations are performed by the processor 70 of the electronic device 1 .

In step 610, the electronic device 1 outputs audio at a first volume level through the speaker 50.

In step 620, the electronic device 1 acquires the noise level of the surrounding environment.

In step 630, the electronic device 1 receives a volume adjustment input through the user input unit 30.

In step 640, the electronic device 1 identifies an adjustment width corresponding to the difference between the first volume level and the noise level.

In step 650, the electronic device 1 identifies whether the current context of the predefined condition is a predetermined first value. Various design changes are possible for the predefined condition, and as an example, the electronic device 1 may identify whether the current time point is low. To this end, the electronic device 1 may acquire the current time from a server connected through the Internet or check the current time through its built-in clock.

If the context of the current time is identified as the first value (for example, if the current time is identified as day) (“Yes” in step 650), the electronic device 1 changes the first value corresponding to the first value in step 660. Change the adjustment width by amount.

On the other hand, if the context of the current time is identified as a second value rather than the first value (for example, if the current time is identified as night) ("No" in step 650), the electronic device 1 in step 670 The adjustment width is changed by the second change amount corresponding to 2 values. Here, the first change amount is prepared to be different from the second change amount. For example, since people may be more sensitive to noise at night than during the day, the second change amount when the current time is night may be greater than the first change amount when the current time is daytime.

In step 680, the electronic device 1 outputs the audio of the second volume level identified based on the basic adjustment amount and the changed adjustment width.

That is, the electronic device 1 according to the present embodiment changes the adjustment width in consideration of the new condition to the adjustment width determined based on the difference between the first volume level and the noise level (corresponding to steps 650, 660, and 670), 2Identifies the volume level.

Here, in this embodiment, the case of identifying whether the current time is day or night has been described as an example of the above new condition, but various examples other than the present embodiment may be applied to this new condition. That is, the contents of steps 650, 660, and 670 of this embodiment may vary according to the design method.

For example, the electronic device 1 may identify the content characteristics or context of the audio signal through audio scene analysis of the audio signal. The audio signal may have various types of sound characteristics, such as a human voice, an animal's cry, an airplane sound, an automobile sound, a sound of equipment, and a sound of a musical instrument. In addition, even in the case of a human voice, voice characteristics can be classified into various forms, such as the sound of one person singing, the sound of a man/woman singing, the sound of several people singing together, and the voice of an announcer in news. In this way, the change amount of the adjustment width is determined in advance in response to the content characteristics of various audio signals. The electronic device 1 may change the adjustment width by identifying a change amount corresponding to the content characteristic of the input audio signal and reflecting the identified change amount to the adjustment width.

In the previous embodiment, the case where the volume adjustment input is the number of times the user presses the volume increase button 110 or the volume decrease button 120 of the remote controller 100 has been described. In this case, the level adjustment amount depends on the number of times the volume increase button 110 or the volume decrease button 120 is pressed, and is determined based on the difference between the current volume level and the noise level.

However, since the spirit of the present invention is not limited thereto, the volume adjustment input may be the duration of the user pressing and holding the volume up button 110 or the volume down button 120. In this case, the level adjustment amount is determined based on the difference between the current volume level and the noise level, depending on the duration for which the volume up button 110 or the volume down button 120 is pressed.

On the other hand, the processor of the electronic device identifies the adjustment width in response to the difference between the first volume level and the noise level as described above, readjusts the adjustment width in consideration of additional conditions, or noise among audio collected from the surrounding environment of the electronic device. At least some of the data analysis, processing, and resulting information generation to perform operations such as extracting noise components for measuring levels are rule-based or artificial intelligence (AI) algorithms, machine learning, neural networks , or at least one of deep learning algorithms.

For example, the processor of the electronic device may perform functions of a learning unit and a recognizing unit together. The learning unit may perform a function of generating a learned neural network, and the recognizing unit may perform a function of recognizing (or inferring, predicting, estimating, or judging) data using the learned neural network. The learning unit may create or update a neural network. The learning unit may acquire learning data to generate a neural network. For example, the learning unit may acquire learning data from a storage unit of the electronic device or from the outside. The learning data may be data used for learning of the neural network, and the neural network may be trained by using data on which the above operations are performed as learning data.

The learning unit may perform pre-processing on the acquired training data before training the neural network using the training data, or may select data to be used for learning from among a plurality of training data. For example, the learning unit may process the learning data into a form of data suitable for learning by processing the learning data in a preset format, filtering, or adding/removing noise. The learning unit may generate a neural network set to perform the above operation using the preprocessed training data.

A learned neural network may be composed of a plurality of neural networks (or layers). Nodes of a plurality of neural network networks have weights, and the plurality of neural network networks may be connected to each other so that an output value of one neural network network is used as an input value of another neural network network. Examples of neural network networks include Convolutional Neural Network (CNN), Deep Neural Network (DNN), Recurrent Neural Network (RNN), Restricted Boltzmann Machine (RBM), Deep Belief Network (DBN), Bidirectional Recurrent Deep Neural Network (BRDNN), and It may include models such as Deep Q-Networks.

Meanwhile, the recognizer may obtain target data to perform the above operation. The target data may be acquired from a storage unit of the electronic device or from the outside. The target data may be data to be recognized by a neural network. Before applying the target data to the learned neural network, the recognizer may perform preprocessing on the acquired target data or select data to be used for recognition from among a plurality of target data. For example, the recognizer may process the target data into a form of data suitable for recognition by processing the target data into a preset format, filtering, or adding/removing noise. The recognizer may obtain an output value output from the neural network by applying the preprocessed target data to the neural network. The recognition unit may obtain a probability value or a reliability value together with the output value.

Methods according to exemplary embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer readable medium. Such computer readable media may include program instructions, data files, data structures, etc. alone or in combination. For example, computer readable media, whether removable or rewritable, include non-volatile storage devices such as USB memory devices, or memory such as RAM, ROM, flash memory, memory chips, integrated circuits, or For example, it may be stored in an optically or magnetically recordable and machine-readable storage medium such as a CD, DVD, magnetic disk, or magnetic tape. It will be appreciated that a memory that may be included in a mobile terminal is one example of a machine-readable storage medium suitable for storing a program or programs including instructions implementing embodiments of the present invention. Program instructions recorded on this storage medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in the art of computer software. Alternatively, the present computer program instructions may be implemented by a computer program product.

1: electronic device
30: user input unit
50: speaker
60: microphone
70: processor

Claims (15)

In electronic devices,
A speaker that outputs audio;
Outputting audio at a first volume level through the speaker;
Obtaining a noise level around the electronic device;
Identifying an adjustment width corresponding to a difference between the first volume level and the noise level in response to receiving an input related to the adjustment of the volume level of the audio through a user input unit;
and a processor configured to output the audio through the speaker at a second volume level identified based on the basic adjustment amount according to the input and the identified adjustment width. According to claim 1,
The second volume level is identified by adjusting the first volume level by reflecting the adjustment width in the basic adjustment amount. According to claim 2,
The adjustment width increases as the difference between the first volume level and the noise level increases, and decreases as the difference between the first volume level and the noise level decreases. According to claim 2,
The adjustment width when the input increases the audio volume level when the noise level is higher than the reference noise level or when the input decreases the audio volume level when the noise level is lower than the reference noise level It is the first adjustment width,
The adjustment width when the input decreases the audio volume level when the noise level is higher than the reference noise level or when the input increases the audio volume level when the noise level is lower than the reference noise level is the second adjustment width,
The first adjustment width is greater than the second adjustment width. According to claim 2,
The adjustment width corresponds to a third adjustment width corresponding to a difference between the volume level of the high-frequency component of the audio and the noise level, and a difference between the volume level of the low-frequency component of the audio and the noise level, and the third adjustment width Including a different fourth adjustment width,
the processor,
An electronic device that assigns the third adjustment width to a high-frequency component of the audio, and assigns the fourth adjustment width to a low-frequency component of the audio. According to claim 1,
The user input unit includes a remote controller,
The remote controller,
A volume control button provided to increase or decrease the volume level of the audio;
An electronic device comprising a microphone for collecting noise around the electronic device. According to claim 1,
Including more microphones,
The electronic device of claim 1 , wherein the microphone is activated to collect sound around the electronic device in response to the input being performed through the user input unit while in a deactivated state. According to claim 1,
The processor displays a UI notifying that the second volume level is identified by reflecting the identified adjustment width. According to claim 8,
The processor displays the color of the UI differently in response to the change in the identified adjustment width. According to claim 1,
The electronic device of claim 1 , wherein the processor identifies a current context of a predefined condition and adjusts the identified adjustment width in response to the identified context. According to claim 1,
The electronic device of claim 1 , wherein the processor performs scene analysis on the audio signal and adjusts the identified adjustment width in response to a result of the scene analysis. In the control method of the electronic device,
outputting audio at a first volume level through a speaker;
obtaining a noise level around the electronic device;
Identifying an adjustment width corresponding to a difference between the first volume level and the noise level in response to receiving an input related to adjustment of the volume level of the audio received through a user input unit;
and outputting the audio through the speaker at a second volume level identified based on a basic adjustment amount according to the input and the identified adjustment width. According to claim 12,
The second volume level is identified by adjusting the first volume level by reflecting the adjustment width in the basic adjustment amount. According to claim 13,
The adjustment width increases as the difference between the first volume level and the noise level increases, and decreases as the difference between the first volume level and the noise level decreases. According to claim 12,
A control method of an electronic device for displaying a UI notifying that the level adjustment amount is identified by reflecting the identified second volume level.

Images