WO2019004745A1

WO2019004745A1 - Device and method for optimizing sound volume on basis of user and environment information

Info

Publication number: WO2019004745A1
Application number: PCT/KR2018/007344
Authority: WO
Inventors: 주상현
Original assignee: (주)엠포러스
Priority date: 2016-06-28
Filing date: 2018-06-28
Publication date: 2019-01-03
Also published as: KR20180002064A

Abstract

A device for optimizing sound volume on the basis of user and environment information, according to one embodiment, comprises: a user hearing analysis module for acquiring, storing and maintaining hearing ability information and sound volume preference information on a user; a real-time noise measurement module for measuring, in real time, the noise in a space in which the user is positioned; a user point-of-view noise prediction module for predicting transformed noise transformed when the measured noise enters the ears of the user; and a user-customized sound volume optimization module for automatically controlling a sound volume level of a multimedia file provided to the user, on the basis of the transformed noise and the hearing ability information and the sound volume preference information on the user.

Description

Device and method for volume optimization based on user and environment information

The following description relates to a volume optimizing apparatus and method thereof, and more particularly, to a technique for controlling the volume of a multimedia file provided to a user based on user and environment information.

The multimedia service is a service for providing a multimedia file, which is a mixed content of various types of information such as voice and video, to a user. In such a multimedia service, the volume level at which the multimedia file is provided to the user is generally controlled by manual operation of the user.

On the other hand, due to the release and spread of smart electronic devices carried by users, multimedia services are being provided to users without restriction of space.

Therefore, when the user moves from a small space to a noisy space in a process of receiving a multimedia service, it is troublesome to manually control the volume level at which the multimedia file is provided.

In addition, since the multimedia file has the effect of significantly increasing the volume level in a specific section, the multimedia file may be provided at a high level level without the user being able to cope with the problem, which may cause a problem of hearing.

Therefore, there is a need for a technique for controlling the volume level of a multimedia file adaptively to a changing noise environment.

In one embodiment, the noise in the space in which the user is located is measured in real time, the distortion noise that is measured when the measured noise enters the user's ear is predicted, And a method and apparatus for automatically controlling the volume level of the sound.

Particularly, in one embodiment, by acquiring, storing and maintaining the hearing ability information and the volume preference information of the user, in the process of automatically controlling the volume level of the multimedia file based on the variation noise, A method and apparatus for reflecting preference information are proposed.

In particular, the embodiments may be configured to acquire and store the auditory capability information and the volume preference information of the user regarding the sound source characteristics of each of the plurality of multimedia files, to confirm the sound source characteristics of the multimedia file provided to the user, A method for controlling the volume level of the multimedia file according to the determination result by determining whether the volume level calculated based on the user's hearing ability information and the volume preference information for the identified sound source characteristics overwhelms the volume level of the variation noise, Device.

In this case, in one embodiment, the sound source characteristics of each of the plurality of multimedia files includes the volume level control information of each of the plurality of multimedia files. As a result, the sound source characteristics of the multimedia file provided to the user are checked. And notifies the user of an alarm about a change in the volume level of the multimedia file based on the volume level control information included in the multimedia file.

According to an embodiment, the user volume and environment information volume optimizing apparatus includes a user's hearing capacity analyzing module for acquiring, storing and maintaining auditory ability information and volume preference information of a user; A real-time noise measurement module for measuring real-time noise in a space where the user is located; A user perspective noise prediction module for predicting a variation noise to be deformed when the measured noise flows into the user's ear; And a user-customized volume optimization module for automatically controlling the volume level of the multimedia file provided to the user based on the deformation noise, the auditory capability information of the user, and the volume preference information.

According to one aspect of the present invention, the user's hearing analysis module acquires and stores the auditory capability information and the volume preference information for the sound source characteristics of each of the plurality of multimedia files, and the user- And may automatically control the volume level of the multimedia file based on the audible capability information and the volume preference information of the user with respect to the identified sound source characteristics.

According to another aspect of the present invention, the sound source characteristics of each of the plurality of multimedia files include a genre of each of the plurality of multimedia files, a kind of sound signals included in each of the plurality of multimedia files, Or a volume level control information of each of the plurality of multimedia files.

According to another aspect of the present invention, sound source characteristics of each of the plurality of multimedia files are stored and held in meta information of each of the plurality of multimedia files, and the user- And analyze the meta information to check the sound source characteristics of the multimedia file.

According to another aspect of the present invention, the user-customized volume optimization module may notify the user of an alarm about a change in volume level of the multimedia file based on volume level control information included in the identified sound source characteristics.

According to another aspect of the present invention, the user-customized volume optimization module determines whether or not the volume level calculated by the user's auditory capability information and the volume preference information over the multimedia file provided to the user overwhelms the volume level of the variation noise And when the calculated volume level exceeds the volume level of the deformation noise as a result of the determination, the volume level of the multimedia file can be controlled to the calculated volume level.

According to another aspect of the present invention, the user-customized volume optimization module may be configured such that, when it is determined that the calculated volume level does not overwhelm the volume level of the variation noise, the volume level of the multimedia file corresponds to the audio- The user can be informed of an alarm that the user is elevated to a high level exceeding the volume level calculated by the information.

According to another aspect of the present invention, the user-customized volume optimization module generates and outputs an offset signal canceling the deformation noise to reduce the deformation noise, thereby reducing the deformation noise, the user's hearing ability information, and the volume preference information The volume level of the multimedia file provided to the user can be automatically controlled.

According to another aspect of the present invention, the volume and volume optimization apparatus based on the user and environment information further includes an earphone noise cancellation ability measurement module for measuring the noise cancellation capability of the earphone when the multimedia file is provided to the user through an earphone And the user viewpoint noise prediction module can predict a variation noise to be deformed when noise measured in the real time noise measurement module flows into the user's ear based on the noise cancellation capability of the earphone.

According to another aspect of the present invention, the user's hearing analysis module acquires, stores and maintains the hearing ability information of the user with respect to the noise characteristics of each of the plurality of noises, and the user- And to estimate a volume level of the deformation noise that is modified when the measured noise is introduced into the user's ear based on the user's hearing ability information on the identified noise characteristics .

According to another aspect of the present invention, the user-customized volume optimization module may automatically control the volume level of the multimedia file provided to the user in real time in response to predicting the variation noise in real time in the user- .

According to one embodiment, a method for volume optimization based on user and environment information includes the steps of acquiring, storing, and maintaining audio capability information and volume preference information of a user; Measuring in real time the noise in the space where the user is located; Predicting a variation noise to be deformed when the measured noise flows into the user's ear; And automatically controlling the volume level of the multimedia file provided to the user based on the deformation noise, the auditory capability information of the user, and the volume preference information.

According to one aspect of the present invention, the step of acquiring, storing and maintaining the auditory capability information and the volume preference information of the user acquires and stores the auditory capability information and the volume preference information of the user for each sound source characteristic of the plurality of multimedia files, Wherein the step of automatically controlling the volume level of the multimedia file provided to the user comprises: checking sound source characteristics of a multimedia file provided to the user; And automatically controlling the volume level of the multimedia file based on the audible capability information and the volume preference information of the user with respect to the identified sound source characteristics.

According to another aspect of the present invention, the sound source characteristics of each of the plurality of multimedia files are stored and held in meta information of each of the plurality of multimedia files, and the step of checking the sound source characteristics of the multimedia file provided to the user, Analyzing the meta information of the multimedia file provided to the user and checking the sound source characteristics of the multimedia file.

According to another aspect of the present invention, the step of automatically controlling the volume level of the multimedia file based on the audible capability information and the volume preference information of the user with respect to the identified sound source characteristic may include: And notifying the user of an alarm about a change in volume level of the multimedia file based on the control information.

According to another aspect of the present invention, the step of automatically controlling the volume level of the multimedia file provided to the user includes the steps of: determining whether the volume level calculated by the user's hearing ability information and the volume preference information Determining whether the volume level of the deformation noise is overwhelmed; And controlling the volume level of the multimedia file to the calculated volume level when the calculated volume level overwhelms the volume level of the deformation noise.

In one embodiment, the noise in the space in which the user is located is measured in real time, the distortion noise that is measured when the measured noise enters the user's ear is predicted, A method and an apparatus for automatically controlling the volume level of the audio signal can be proposed.

Particularly, in one embodiment, by acquiring, storing and maintaining the hearing ability information and the volume preference information of the user, in the process of automatically controlling the volume level of the multimedia file based on the variation noise, A method and apparatus for reflecting preference information can be proposed.

In particular, the embodiments may be configured to acquire and store the auditory capability information and the volume preference information of the user regarding the sound source characteristics of each of the plurality of multimedia files, to confirm the sound source characteristics of the multimedia file provided to the user, A method for controlling the volume level of the multimedia file according to the determination result by determining whether the volume level calculated based on the user's hearing ability information and the volume preference information for the identified sound source characteristics overwhelms the volume level of the variation noise, Device can be proposed.

In this case, in one embodiment, the sound source characteristics of each of the plurality of multimedia files includes the volume level control information of each of the plurality of multimedia files. As a result, the sound source characteristics of the multimedia file provided to the user are checked. It is possible to propose a method and apparatus for notifying a user of an alarm about a change in volume level of a multimedia file based on volume level control information included in the multimedia file.

FIG. 1 is a view for explaining a volume level control operation of a volume optimization apparatus based on user and environment information according to an embodiment.

2 is a block diagram illustrating a volume optimization apparatus based on user and environment information according to an embodiment.

3A and 3B are diagrams for explaining a process of reflecting auditory ability information and volume preference information of a user regarding a sound source characteristic of a multimedia file during a volume level control operation of a user and environment information volume optimizing apparatus according to an exemplary embodiment to be.

4 is a diagram for explaining a process of reflecting a user's hearing ability information on a noise characteristic in a volume level control operation of a volume optimization device based on user and environment information according to an exemplary embodiment.

FIG. 5 is a flowchart illustrating a method for optimizing volume based on user and environment information according to an embodiment.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to or limited by the embodiments. In addition, the same reference numerals shown in the drawings denote the same members.

Also, terminologies used herein are terms used to properly represent preferred embodiments of the present invention, which may vary depending on the viewer, the intention of the operator, or the custom in the field to which the present invention belongs. Therefore, the definitions of these terms should be based on the contents throughout this specification.

FIG. 1 is a view for explaining a volume level control operation of a user and environment information volume optimizing apparatus according to an embodiment. FIG. 2 is a block diagram illustrating a volume optimizing apparatus based on user and environment information according to an embodiment to be.

1 and 2, a volume optimization apparatus (hereinafter referred to as a volume optimization apparatus) 110 based on user and environment information according to an embodiment calculates a noise level of a user 111 of the multimedia file.

Hereinafter, the volume optimization apparatus 110 is described as being a device installed in a user terminal carried by a user 111, but is not limited thereto and may be implemented as a separate device independently provided for a user terminal .

The volume optimizer 110 includes a user's hearing analysis module 210, a real-time noise measurement module 220, a user-perspective noise estimation module 230 and a user-customized volume optimization module 240, A volume level control operation can be performed.

Specifically, the volume optimizer 110 measures in real time the noises in the

spaces

112 and 113 where the user 111 is located through the real-time noise measurement module 220, The volume level of the multimedia file provided to the user 111 based on the variation noise is estimated by using the user-customized volume optimization module 240 by predicting the deformation noise to be deformed when the noise is introduced into the user's 111 through the user- .

For example, when the user 111 is located in the first space 112 with low noise, the real-time noise measurement module 220 measures the noise in the first space 112 in real time, The controller 230 can predict a distortion to be deformed when the noise transmitted from the real-time noise measurement module 220 is introduced into the user's ear. Accordingly, the user-customized volume optimization module 240 can automatically control the volume level of the multimedia file provided to the user 111 to overwhelm the volume level of the distortion noise transmitted from the user- If the distortion level is 20 dB in the first space 112 with a low noise level, the user-customized volume optimization module 240 may adjust the volume level of the multimedia file provided to the user 111 so that the volume level of the multimedia file, The volume level can be controlled to a level of 50 dB.

On the other hand, when the user 111 moves from the first space 112 to the second space 113 filled with noises, the real-time noise measurement module 220 calculates the noise in the second space 113 in real time And the user perspective noise prediction module 230 predicts the distortion noise that is distorted when the noise transmitted from the real time noise measurement module 220 is introduced into the user's ear. Accordingly, the user-customized volume optimization module 240 can automatically control the volume level of the multimedia file provided to the user 111 to overwhelm the volume level of the distortion noise transmitted from the user- If the distortion level is 60 dB in the second space 113 where the noise is full, the user-customized volume optimization module 240 may adjust the volume level of the multimedia file provided to the user 111 so that the volume level of the multimedia file exceeds 60 dB. The volume level can be controlled to 80dB.

Hereinafter, the volume level of the multimedia file overwhelms the volume level of the variation noise means that the volume level of the multimedia file exceeds the volume level of the variation noise by the reference value. Therefore, controlling the volume level of the multimedia file such that the volume level of the multimedia file overwhelms the volume level of the variation noise means that the volume level of the multimedia file is set to a high level so that the volume level of the multimedia file exceeds the volume level of the variation noise. It means adjusting. For example, when the reference value is set to 30 dB, if the volume level of the multimedia file is controlled to overcome the volume level of the variation noise of 20 dB, the volume level of the multimedia file can be adjusted as high as 50 dB. As another example, when the reference value is set to 20 dB, if the volume level of the multimedia file is controlled to overwhelm the volume level of the variation noise of 60 dB, the volume level of the multimedia file can be adjusted as high as 80 dB.

As described above, the reference value described above can be adaptively set by the volume optimizer 110. [ For example, the reference value may be adaptively adjusted to the extent that the volume level of the multimedia file does not cause a problem in the hearing of the user 111, such that the controlled value is overwhelmed by the volume level of the deformation noise. More specifically, for example, in the first space 112 with low noise, the reference value may be set to a value of 30 dB, but in the second space 113 where the noise is full, The value controlled to overwhelm the volume level of the noise may be set to a value of 20 dB so as to be less than 90 dB which causes a problem with the hearing of the user 111. [

In addition, the volume optimizing apparatus 110 according to the embodiment further includes an earphone noise cancellation capability measurement module (not shown in the figure), so that when the multimedia file is provided to the user 111 through the earphone, The blocking ability measuring module can measure the noise blocking ability of the earphone. Accordingly, in the process of predicting the deformation noise to be deformed when the noise measured by the real-time noise measurement module 220 is introduced into the ear of the user 111, the user- The noise shielding ability of the measured earphone can be considered.

In this way, the volume optimizing apparatus 110 according to an embodiment measures the noise in the

spaces

112 and 113 in which the user 111 is located in real time, and measures the noise of the multimedia file By automatically controlling the volume level, it is possible to prevent the user 111 from having to control the volume level by manual operation in a changing noisy environment, and it is possible to prevent the user 111 from having a high level of volume level It is possible to prevent multimedia from being provided.

In addition, the volume optimizing apparatus 110 according to an exemplary embodiment may use the user's hearing analysis module 210 to automatically adjust the volume level of the multimedia file, Information can be reflected.

In this case, the volume optimizing device 110 acquires and stores the auditory capability information and the volume preference information of the user 111 through the user's hearing analysis module 210, By measuring in real time the noises in the

spaces

112 and 113 where the user 111 is located and estimating the deformation noises that are deformed when the noise is introduced into the user's 111 through the user's perspective noise prediction module 230 And automatically adjusts the volume level of the multimedia file provided to the user 111 based on the variation noise, the auditory capability information of the user 111, and the volume preference information using the user-customized volume optimization module 240.

In detail, if the user's hearing ability analysis module 210 acquires and stores the auditory capability information and the volume preference information of the user 111 with respect to the sound source characteristics of each of the multimedia files, From the user's hearing ability analysis module 210, the sound source characteristics of the multimedia file provided to the user 111 and the auditory capability information and the volume preference information of the user 111 with respect to the confirmed sound source characteristics. Thus, the user-customized volume optimization module 240 determines whether or not the multimedia file is to be generated based on the audible capability information and the volume preference information of the user 111 with respect to the predicted noise transmitted from the user- The volume level can be controlled automatically.

More specifically, the user-customized volume optimization module 240 determines whether or not the user 111 is a user based on the audible capability information and the volume preference information of the user 111 with respect to the identified sound source characteristics (sound source characteristics of the multimedia file provided to the user 111) When the calculated volume level overwhelms the volume level of the deformation noises by determining whether the calculated volume level is overwhelmed with the volume level of the deformation noises or not by comparing the volume level of the multimedia file with the calculated volume level Level control.

In this case, the sound source characteristics of each of the plurality of multimedia files may include a genre of each of the plurality of multimedia files, a kind of sound signals included in each of the plurality of multimedia files, a sound signal included in each of the plurality of multimedia files Frequency band, or volume level control information of each of a plurality of multimedia files.

Accordingly, the user's hearing analysis module 210 acquires and stores the auditory capability information and the volume preference information of the user 111 for each genre of the plurality of multimedia files, and stores and holds the sound included in each of the plurality of multimedia files Acquires and stores auditory capability information and loudness preference information of the user 111 according to the types of signals, and acquires and stores auditory capability information and loudness preference information of the user 111 according to frequency bands included in each of the plurality of multimedia files, Acquires and stores preference information, acquires and stores the auditory capability information and the volume preference information of the user 111 for each volume level control information of each of the plurality of multimedia files, and stores the user preference information and the volume preference information, The genre of the multimedia file provided to the user 111, the kind of the sound signals, The hearing ability information and the volume preference information of the user 111 with respect to the frequency band and the volume level control information are obtained from the user's hearing analysis module 210 and the appropriate volume level Can be calculated.

Here, the sound source characteristics of the multimedia file are stored and held in the meta information of the multimedia file. Accordingly, the user-customized volume optimization module 240 can check the sound source characteristics of the multimedia file by analyzing the meta information of the multimedia file provided to the user 111. [

On the other hand, if the calculated volume level does not overwhelm the volume level of the deformation noise, the user-customized volume optimization module 240 determines whether the volume level of the multimedia file corresponds to the auditory capability information and the volume preference information of the user 111 The user 111 can be informed by an alarm that the user has been raised to a high level exceeding the volume level calculated by the user.

The details of the process of reflecting the auditory capability information and the volume preference information of the user 111 to the sound source characteristics of the multimedia file during the volume level control operation will be described with reference to FIGS. 3A to 3B.

In addition, the user-customized volume optimization module 240 generates and outputs a cancel signal that cancels the predicted deformation noise from the user-perspective noise prediction module 230, thereby reducing the deformation noise, The volume level of the multimedia file may be automatically controlled based on the auditory capability information and the volume preference information of the multimedia file.

In addition, the user's hearing analysis module 210 acquires and stores the auditory capability information and the volume preference information of the user 111 on the sound source characteristics of each of the plurality of multimedia files, The auditory capability information of the user 111 with respect to the noise characteristics can be acquired, stored and maintained. Accordingly, the user-viewpoint noise prediction module 230 checks the noise characteristics of the noise measured by the real-time noise measurement module 220 and determines the measured noise based on the hearing capability information of the user 111 with respect to the identified noise characteristics It is possible to predict the volume level of the deformation noise that is deformed when the user 111 enters the ear of the user. A detailed description thereof will be described with reference to FIG.

Such a volume level control operation can be performed in real time. This is because the noise measurement module 220 measures the noise in the

spaces

112 and 113 where the user 111 is located in real time so that the user's perspective noise prediction module 230 predicts the variation noise in real time, The user-customized volume optimization module 240 automatically controls the volume level of the multimedia file provided to the user 111 in real time in response to the user-perspective noise prediction module 230 predicting the variation noise in real time .

3A and 3B illustrate a process of reflecting auditory capability information and volume preference information of a user on a sound source characteristic of a multimedia file during a volume level control operation of a user and environment information volume optimizing apparatus according to an exemplary embodiment FIG. More specifically, FIG. 3A is a diagram for explaining a process of reflecting a genre included in a sound source characteristic of a multimedia file, a kind of sound signals, a user's hearing ability information on a frequency band of sound signals, and a volume preference information, FIG. 3B is a diagram for explaining a process of reflecting auditory capability information and volume preference information of a user with respect to volume level control information included in a sound source characteristic of a multimedia file.

Referring to FIG. 3A, a volume optimizing apparatus according to an exemplary embodiment of the present invention includes a user's hearing analysis module, a user's hearing ability analyzing module, a user's hearing ability analyzing module, 310, 320, and 330 and the

volume preference information

340, 350, and 360, respectively.

At this time, the user's hearing capability information 310 for each genre of the plurality of multimedia files may be information indicating whether the user is audible to a volume level preset for each genre of the plurality of multimedia files. Hereinafter, whether or not the user is audible means whether or not the user can hear the volume level under the limitation that does not cause a problem in the hearing of the user. For example, when the genre of the first multimedia file is " jazz ", the hearing ability information 310 of the user for the first multimedia file is a preset sound volume level of the first multimedia file, Lt; / RTI > may be information indicating whether the user can hear 50-60 dB.

Likewise, the user's audible capability information 320 about the types of sound signals included in each of the plurality of multimedia files is stored in the user's audible ability level 320 for a predetermined volume level for each type of sound signals included in each of the plurality of multimedia files. Or < / RTI > For example, if the type of the sound signals included in the second multimedia file is " male voice ", the user's hearing capability information 320 for the second multimedia file is composed of sound signals of & And information indicating whether the user can listen to the predetermined volume level of 40-50 dB possessed by the second multimedia file.

In addition, the user's hearing capability information 330 for the frequency band of the sound signals included in each of the plurality of multimedia files may include information indicating whether or not the user is audible to the frequency band of the sound signals included in each of the plurality of multimedia files. Information. For example, if the frequency band of the sound signals included in the third multimedia file is " 5-6 kHz ", the auditory capability information 330 of the user for the third multimedia file is " 5 Quot; -6 kHz ". < / RTI >

In addition, the user's volume preference information 340 for each genre of the plurality of multimedia files may be information indicating a volume level preferred by the user for each genre of the plurality of multimedia files. For example, when the genre of the first multimedia file is " jazz ", the volume preference information 340 of the user for the first multimedia file is the volume of the first multimedia file, Level, i.e., 60 dB.

Likewise, the user's volume preference information 350 for the types of sound signals contained in each of the plurality of multimedia files is information about the type of the sound signals included in each of the plurality of multimedia files, Lt; / RTI > For example, when the kind of the sound signals included in the second multimedia file is " male voice ", the user's volume preference information 340 for the second multimedia file is composed of sound signals of & And information indicating a user's preferred volume level of 70 dB when reproducing the second multimedia file.

In addition, the user's volume preference information 360 for the frequency band of the sound signals included in each of the plurality of multimedia files may indicate the user's preference for the frequency band of the sound signals contained in each of the plurality of multimedia files Information. For example, when the frequency band of the sound signals included in the third multimedia file is " 5-6 kHz ", the user's volume preference information 360 for the third multimedia file is " 5 Quot; -6 kHz ". < / RTI >

As described above, the user's hearing analysis module according to an exemplary embodiment of the present invention includes a user's hearing ability information 310, 320 (see FIG. 3) for each genre of sound source characteristics of each of the plurality of multimedia files, 330 and the

volume preference information

340, 350, 360 are acquired in advance and stored and maintained, so that the user-customized volume optimization module confirms the sound source characteristics of the multimedia file provided to the user, It is possible to acquire the auditory capability information and the volume preference information of the user.

For example, if the multimedia file provided to the user is a first multimedia file, the user-customized volume optimization module analyzes the meta information of the first multimedia file, and analyzes the meta information of the first multimedia file The user's hearing ability information 310 and the volume preference information 340 for the genre as the sound source characteristic of the user. Therefore. The user's auditory capability information 310 for the first multimedia file is " possible " indicating that the user can hear 50-60 dB, which is the preset volume level of the first multimedia file, The user-customized volume optimization module determines that the user of the first multimedia file is the user of the first multimedia file based on the auditory capability information 310 and the volume preference information 340 of the user, Can be calculated at a volume level of 60 dB. Therefore, the user-customized volume optimization module determines whether or not the calculated volume level of 60 dB overwhelms the volume level of the distortion noise of 30 dB, and since the calculated volume level of 60 dB overwhelms the volume level of the variation noise of 30 dB, 1 The volume level of the multimedia file can be controlled to the calculated 60dB.

In another example, if the multimedia file provided to the user is a second multimedia file, the user-customized volume optimization module analyzes the meta information of the second multimedia file and stores the meta information of the second multimedia file The user's hearing ability information 320 and the volume preference information 350 for the genre as the sound source characteristics of the file can be confirmed. Therefore. The user's audible capability information 320 for the second multimedia file is " impossible " indicating that the user can not hear 40-50 dB, which is the preset volume level of the second multimedia file, The user-customized volume optimization module determines that the user of the second multimedia file is a user of the second multimedia file based on the auditory capability information 320 and the volume preference information 350 of the user, Can be calculated at a sound level of 70 dB. Therefore, the user-customized volume optimization module determines whether or not the calculated volume level of 70 dB overwhelms the volume level of 60 dB of the deformation noise, and the calculated volume level of 70 dB does not overwhelm the volume level of the deformation noise of 60 dB , The volume level of the second multimedia file is controlled to be 90dB at a high level exceeding the calculated volume level of 70dB, and the user can be notified of this by an alarm.

Referring to FIG. 3B, the volume optimization apparatus according to an embodiment of the present invention includes a user's hearing ability analysis module 371, a user's hearing ability information 371 for the volume level control information 370 among the sound source characteristics of the plurality of multimedia files, And volume preference information 372 can be acquired, stored and maintained.

In this case, the volume level control information 370 of each of the plurality of multimedia files may be information indicating the degree to which the volume level is changed during the reproduction of each of the plurality of multimedia files. Generally, the volume level control information 370 may be generated by a maker who manufactures the multimedia file or a supplier that supplies the volume level control information 370, and may be included in the meta information of the multimedia file. For example, when the volume level control information 370 of the fourth multimedia file is as shown in the drawing, the volume level control information 370 of the fourth multimedia file is increased to 80 dB in a period of one minute of reproduction, Lt; RTI ID = 0.0 > 50dB. &Lt; / RTI >

Therefore, the user's auditory capability information 371 for the volume level control information 370 of each of the plurality of multimedia files indicates whether or not the user is audible to the volume level control information 370 of each of the plurality of multimedia files Information. For example, as described above, when the volume control information 370 of the fourth multimedia file is information indicating that the volume level is increased to 80 dB and the volume level is maintained at 50 dB in the remaining interval And the user's hearing ability information 371 for the volume control information 370 of the fourth multimedia file may be information indicating whether or not the user can hear the change of the volume level.

The user's volume preference information 372 for the volume level control information 370 of each of the plurality of multimedia files determines whether or not the user prefers the volume level control information 370 of each of the plurality of multimedia files Lt; / RTI > For example, as described above, when the volume control information 370 of the fourth multimedia file is information indicating that the volume level is raised to 80 dB in the section where reproduction is one minute and the volume level is maintained at 50 dB in the remaining section , The volume preference information 372 of the user for the volume control information 370 of the fourth multimedia file may be information such as " preference " indicating whether or not the user prefers such a change in the volume level .

The user's hearing analysis module according to one embodiment stores the auditory ability information 371 and the volume preference information 372 of the user for the volume level control information 370 among the sound source characteristics of each of the plurality of multimedia files The user-customized volume optimization module can acquire the auditory capability information and the volume preference information of the user with respect to the confirmed sound source characteristics after confirming the sound source characteristics of the multimedia file provided to the user.

For example, if the multimedia file provided to the user is a fourth multimedia file, the user-customized volume optimization module analyzes the meta information of the fourth multimedia file, and stores the fourth multimedia file The user's hearing ability information 371 and the volume preference information 372 for the volume level control information 370, which is the sound source characteristics of the user. Therefore. When the user's hearing capability information 371 for the fourth multimedia file is "enabled" and the user's preference volume information 372 for the fourth multimedia file is found to be "preferred", the user- The volume level of the user for the fourth multimedia file can be controlled to be the same as the volume level control information 370 of the fourth multimedia file on the basis of the auditory capability information 371 and the volume preference information 372 of the user have.

In addition, the user-customized volume optimization module may notify the user of an alarm on the volume level change of the multimedia file based on the volume level control information 370 included in the identified sound source characteristics. For example, when the user's volume level of the fourth multimedia file is controlled to be the same as the volume level control information 370 of the fourth multimedia file, the user-customized volume optimization module sets the volume level of the fourth multimedia file According to the volume level control information 370, it is possible to notify the user in advance of an alarm that the volume level is raised to 80 dB in an interval of one minute of reproduction (for example, an audible alarm sounds in a period of playback of 55 seconds) .

Referring to FIG. 4, the volume optimizing apparatus according to an exemplary embodiment may acquire, store, and maintain the user's hearing ability information 410 for the noise characteristics of each of a plurality of noises through the user's hearing analysis module.

At this time, the user's hearing ability information 410 regarding the noise characteristics of each of the plurality of noises may be information indicating a change in the volume level that the user actually receives for each type of the plurality of noises. For example, if the user's hearing ability information 411 on the noise characteristics of the first noise having a volume level of 50 dB is " -10 dB ", the user's hearing ability information 411 on the first noise- Means that the volume level of the noise actually received by the user when the first noise is introduced into the user's ear is -10 dB (accepting the first noise at 40 dB from the user's point of view). For example, if the user's hearing ability information 412 for the second noise noises having a volume level of 40 dB is " + 10 dB ", the user's hearing ability information 412 Means that the volume level of the noise actually received by the user when the second noise is introduced into the user's ear is + 10dB (that the second noise from the user's point is accepted at 50dB).

As described above, the user's hearing ability analysis module according to one embodiment acquires and stores the user's hearing ability information 410 for the noise characteristics of each of the plurality of noises in advance, thereby storing and maintaining the user's hearing ability information 410, It is possible to check the noise characteristics of the noise measured by the noise measurement module and acquire the user's hearing ability information on the confirmed noise characteristics.

For example, if the noise measured by the real-time noise measurement module is a first noise with a corresponding noise of 50 dB, the user-based noise prediction module calculates the noise characteristics of the first noise, which is stored and maintained by the user's hearing analysis module, The user's auditory capability information 410 can be confirmed. Therefore. When the user's hearing ability information 410 for the first noise is confirmed to be " -10 dB ", the user-viewpoint noise prediction module determines that the user- Noise can be predicted at 40dB.

Referring to FIG. 5, a method for optimizing volume based on user and environment information according to an exemplary embodiment is performed by the volume optimizing apparatus described above with reference to FIGS.

First, the volume optimizer acquires, stores, and maintains the user's hearing ability information and volume preference information (510).

Then, the volume optimizer measures the noise in the space where the user is located in real time (520).

The volume optimizer then predicts (530) the deformation noise that is transformed when the measured noise is introduced into the user's ear.

If the multimedia file is provided to the user through the earphone, the volume optimizer measures the noise cancellation capability of the earphone, thereby determining, based on the noise cancellation capability of the earphone in step 530, It is possible to predict the strain noise to be deformed.

In addition, the volume optimization apparatus obtains the user's hearing ability information on the noise characteristics of each of the plurality of noises in step 510, stores and maintains the information on the hearing ability information of the user, checks the noise characteristics of the noise measured in step 530, Based on the hearing ability information of the user with respect to the user's ears.

Thereafter, the volume optimizer automatically controls the volume level of the multimedia file provided to the user based on the deformation noise, the user's hearing ability information, and the volume preference information (540).

In more detail, the volume optimizing apparatus acquires and stores the auditory capability information and the volume preference information of the user regarding the sound source characteristics of each of the plurality of multimedia files, and stores and maintains the sound preference information in step 510. In step 540, The volume level of the multimedia file can be automatically controlled based on the audible capability information and the volume preference information of the user regarding the confirmed sound source characteristics.

Here, the sound source characteristics of each of the plurality of multimedia files may include a genre of each of the plurality of multimedia files, a kind of sound signals included in each of the plurality of multimedia files, a frequency of sound signals included in each of the plurality of multimedia files Band or volume level control information of each of a plurality of multimedia files.

Since the sound source characteristics of each of the plurality of multimedia files are stored and held in the meta information of each of the plurality of multimedia files, in the process of checking the sound source characteristics of the multimedia file provided to the user during step 540, , And analyze the meta information of the multimedia file provided to the user, thereby confirming the sound source characteristics of the multimedia file.

In addition, the volume optimizing device checks the sound source characteristics of the multimedia file provided to the user during step 540, and then, based on the volume level control information included in the identified sound source characteristics, issues an alarm about the volume level change of the multimedia file to the user Can be notified.

In addition, in step 540, the volume optimizing device determines whether the volume level calculated by the user's hearing ability information and volume preference information overwhelms the volume level of the variation noise, with respect to the multimedia file provided to the user, When the calculated volume level overwhelms the volume level of the distortion noise, the volume level of the multimedia file can be controlled to the calculated volume level.

On the other hand, when the calculated volume level does not overwhelm the volume level of the deformation noise, the volume optimization apparatus determines that the volume level of the multimedia file exceeds the volume level calculated by the user's hearing ability information and volume preference information It is possible to notify the user of an alarm by a high level.

In addition, in step 540, the volume optimizer generates and outputs an offset signal canceling the deformation noise to reduce deformation noise, thereby providing the user with the deformation noises, the user's hearing ability information, and the volume preference information It is also possible to automatically control the volume level of the multimedia file.

In response to the steps 520 through 530 being performed in real time, step 540 may also be performed in real time.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims

A user's hearing ability analysis module for acquiring, storing and maintaining auditory ability information and volume preference information of a user;

A real-time noise measurement module for measuring real-time noise in a space where the user is located;

A user perspective noise prediction module for predicting a variation noise to be deformed when the measured noise flows into the user's ear; And

A user-customized volume optimization module for automatically controlling the volume level of the multimedia file provided to the user based on the deformation noise, the hearing ability information of the user, and the volume preference information,

And a volume optimizer based on user and environment information.
The method according to claim 1,

The user's hearing analysis module includes:

Acquiring, storing and maintaining the auditory capability information and the volume preference information of the user for the sound source characteristics of each of the plurality of multimedia files,

Wherein the user-customized volume optimization module comprises:

And a control unit for automatically controlling the volume level of the multimedia file based on the audible capability information and the volume preference information of the user with respect to the identified sound source characteristic, Based volume optimization device.
3. The method of claim 2,

Wherein the sound source characteristics of each of the plurality of multimedia files include:

A genre of each of the plurality of multimedia files, a kind of sound signals included in each of the plurality of multimedia files, a frequency band of sound signals contained in each of the plurality of multimedia files, or a frequency band of each of the plurality of multimedia files And volume level control information. &Lt; Desc / Clms Page number 24 >
3. The method of claim 2,

Wherein the sound source characteristics of each of the plurality of multimedia files include:

Storing and maintaining the meta information of each of the plurality of multimedia files,

Wherein the user-customized volume optimization module comprises:

And analyzing meta information of the multimedia file provided to the user to confirm sound source characteristics of the multimedia file.
3. The method of claim 2,

Wherein the user-customized volume optimization module comprises:

And notifies the user of an alarm on a change in volume level of the multimedia file based on volume level control information included in the identified sound source characteristics.
The method according to claim 1,

Wherein the user-customized volume optimization module comprises:

Determining whether the volume level calculated by the auditory capability information and the volume preference information of the user for the multimedia file provided to the user is overwhelmed by the volume level of the deformation noise, and if the calculated volume level is the deformation And controls the volume level of the multimedia file to the calculated volume level when overwriting the volume level of the noise.
The method according to claim 6,

Wherein the user-customized volume optimization module comprises:

When the calculated volume level does not overwhelm the volume level of the deformation noise, the volume level of the multimedia file is increased to a high level exceeding the volume level calculated by the user's auditory capability information and volume preference information And notifies the user of an alarm as an alarm.
The method according to claim 1,

Wherein the user-customized volume optimization module comprises:

A volume level of a multimedia file provided to the user based on the reduced deformation noise, the auditory capability information of the user, and the volume preference information by generating and outputting an offset signal canceling the deformation noise, A volume optimization device based on user and environment information.
The method according to claim 1,

An earphone noise cancellation capability measuring module for measuring a noise cancellation capability of the earphone when the multimedia file is provided to the user through an earphone,

Further comprising:

Wherein the user perspective noise prediction module comprises:

And estimates a deformation noise to be deformed when the noise measured in the real-time noise measurement module is introduced into the user's ear, based on the noise cancellation capability of the earphone.
The method according to claim 1,

The user's hearing analysis module includes:

Acquiring, storing and maintaining the user's hearing ability information on the noise characteristics of each of the plurality of noises,

Wherein the user perspective noise prediction module comprises:

Wherein the control unit checks the noise characteristics of the noise measured by the real-time noise measurement module and calculates a volume of the deformation sound when the measured noise is introduced into the user's ear based on the hearing ability information of the user with respect to the identified noise characteristic A volume optimization device based on user and environment information that predicts levels.
The method according to claim 1,

Wherein the user-customized volume optimization module comprises:

Wherein the user-perspective noise prediction module automatically controls the volume level of the multimedia file provided to the user in real time in response to prediction of the variation noise in real time.
Acquiring, storing and maintaining audio capability information and volume preference information of a user;

Measuring in real time the noise in the space where the user is located;

Predicting a variation noise to be deformed when the measured noise flows into the user's ear; And

Automatically controlling the volume level of the multimedia file provided to the user based on the deformation noise, the hearing ability information of the user, and the volume preference information

And a volume optimization method based on user and environment information.
13. The method of claim 12,

Acquiring, storing and maintaining the hearing ability information and the volume preference information of the user,

Acquiring, storing and maintaining the auditory capability information and the volume preference information of the user regarding the sound source characteristics of each of the plurality of multimedia files

Lt; / RTI >

Wherein the step of automatically controlling the volume level of the multimedia file provided to the user comprises:

Checking a sound source characteristic of a multimedia file provided to the user; And

Automatically controlling the volume level of the multimedia file based on the audible capability information and the volume preference information of the user with respect to the identified sound source characteristics

And a volume optimization method based on user and environment information.
14. The method of claim 13,

Wherein the sound source characteristics of each of the plurality of multimedia files include:

A genre of each of the plurality of multimedia files, a kind of sound signals included in each of the plurality of multimedia files, a frequency band of sound signals contained in each of the plurality of multimedia files, or a frequency band of each of the plurality of multimedia files And volume level control information. &Lt; Desc / Clms Page number 19 >
14. The method of claim 13,

Wherein the sound source characteristics of each of the plurality of multimedia files include:

Storing and maintaining the meta information of each of the plurality of multimedia files,

Wherein the step of verifying the sound source characteristics of the multimedia file provided to the user comprises:

And analyzing meta information of the multimedia file provided to the user to check sound source characteristics of the multimedia file.
14. The method of claim 13,

Wherein the step of automatically controlling the volume level of the multimedia file based on the audible capability information and the volume preference information of the user with respect to the identified sound source characteristics comprises:

Notifying the user of an alarm on a change in volume level of the multimedia file based on volume level control information included in the identified sound source characteristics

Further comprising: a user and environment information based volume optimization method.
13. The method of claim 12,

Wherein the step of automatically controlling the volume level of the multimedia file provided to the user comprises:

Determining whether a volume level calculated by the user's auditory capability information and volume preference information for a multimedia file provided to the user overwhelms a volume level of the variation noise; And

Controlling the volume level of the multimedia file to be the calculated volume level when the calculated volume level exceeds the volume level of the deformation noise

And a volume optimization method based on user and environment information.