TW202324386A - Audio modulation system and audio modulation method - Google Patents

Abstract

An audio modulation system includes a headphone, a mobile computing apparatus and a cloud server. The headphone is configured to a first state or a second state. The mobile computing apparatus is configured to record a first audio and a second audio. The cloud server is configured to receive the first audio and the second audio, and obtain a standard audio distribution. An audio modulation method is also provided in the disclosure.

Description

Audio adjustment system and audio adjustment method

The invention relates to an audio adjustment system and an audio adjustment method, especially an audio adjustment system and an audio adjustment method that can be applied to mobile devices and do not require pre-calibration.

For a long time, as the problems of aging societies in various countries have gradually emerged, various degenerative problems or diseases have gradually been paid attention to. The audio devices or music playback devices that are commonly used in smart homes and connected digital electronic products with various functions have not been adjusted for people with poor hearing or impairment. In other words, it is easy to cause troubles in interaction and various inconveniences in life when using general voice devices or music playback devices. For this reason, it is necessary to perform a hearing test on the user.

However, the hearing testing methods in the prior art must first use fully calibrated professional equipment (such as sound sources and pickups with special specifications) for users to obtain accurate hearing curves corresponding to different users. For general users, it is not easy to obtain professional equipment, which may cause time or financial troubles.

For this reason, how to design an audio adjustment system and audio adjustment method, especially to solve the aforementioned technical problems of the prior art, is an important topic studied by the inventor of the present case.

One of the objectives of the present invention is to provide an audio adjustment system and audio adjustment method, which can solve the technical problem in the prior art that requires fully calibrated professional equipment to obtain hearing curves corresponding to different users, and can help users save time. and the cost of funds to achieve the purpose of allowing users to carry out hearing tests conveniently.

In order to achieve the aforementioned object, the audio adjustment method proposed by the present invention includes the following steps: providing earphones; adjusting the volume of the earphones to the first state; recording the first audio frequency of the earphones in the first state; adjusting the volume of the earphones to The second state; recording the second audio of the earphone in the second state; obtaining the standard audio distribution according to the first audio and the second audio; and adjusting the equalized audio distribution of the earphone according to the standard audio distribution.

Further, in some embodiments, the frequency of the second audio frequency is between 20 Hz and 20000 Hz, and the second state is 50% of the maximum volume of the earphone.

Further, in some embodiments, the frequency of the first audio frequency is between 20 Hz and 20000 Hz, and the first state is the lowest volume of the earphone.

Furthermore, in some embodiments, the following steps are further included: adjusting the volume of the earphone to the third state; and recording the third audio of the earphone in the third state.

Furthermore, in some embodiments, the frequency of the third audio frequency is between 20 Hz and 20000 Hz, and the third state is the maximum volume of the earphone.

In order to achieve the foregoing objectives, the audio adjustment system proposed by the present invention includes: earphones, a mobile computing device, and a cloud server. Wherein, the mobile computing device is removably coupled with the earphone, and includes a sound pickup unit to record the first audio and the second audio of the earphone. The cloud server is coupled with the mobile computing device. The mobile computing device transmits the first audio and the second audio to the cloud server. The cloud server outputs standard audio according to the first audio and the second audio and distributes them to the mobile computing device. The mobile computing device adjusts the equalized audio distribution of the headset according to the standard audio distribution.

Further, in some embodiments, the first audio corresponds to the first state of the earphone, and the first state is that the volume of the earphone is the lowest volume; and the second audio corresponds to the second state of the earphone, and the second state 50% of the maximum volume of the earphone.

Further, in some embodiments, the sound pickup unit further records a third audio to the earphone; and the third audio corresponds to a third state of the earphone, and the third state is the maximum volume of the earphone.

Further, in some embodiments, the mobile computing device further includes an equalizer and a storage unit, the equalizer adjusts the equalized audio distribution to the earphone according to the standard audio distribution, and the storage unit stores at least the first audio and the second audio one.

In summary, when using the audio adjustment system and audio adjustment method of the present invention, by adjusting the volume of the earphone output (such as mute, 50% of the maximum volume, the maximum volume), the audio under different states can be obtained. Headphone audio. Then, the audio is calculated by the cloud server to obtain the standard audio distribution, and the equalized audio distribution of the earphone is adjusted through the mobile computing device. Therefore, a common mobile computing device such as a laptop or a mobile phone can be used together with a pluggable earphone to conduct further hearing detection and other operations.

In addition, the mobile computing device can dynamically adjust different earphones (for example, purchased by each user) according to the standard audio distribution, so that the personal hygiene conditions of different users can be considered (between different users) There is no need to share earphones), and at the same time, it is exempt from the time-consuming situation that users need to make special appointments and go to professional testing units or purchase expensive professional testing equipment.

In order to further understand the technology, means and effects adopted by the present invention to achieve the predetermined purpose, please refer to the following detailed description and accompanying drawings of the present invention. It is believed that the characteristics and characteristics of the present invention should be able to gain a deep and specific understanding. , however, the accompanying drawings are provided for reference and illustration only, and are not intended to limit the present invention.

The implementation of the present invention is described below through specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific examples, and various modifications and changes can be made to the details in the description of the present invention based on different viewpoints and applications without departing from the spirit of the present invention.

It should be noted that the structure, proportion, size, number of components, etc. shown in the drawings attached to this specification are only in line with the content disclosed in the specification, for those who are familiar with this technology to understand and read, and are not limiting conditions for the implementation of the present invention , so it has no technical substantive meaning, and any modification of structure, change of proportional relationship or adjustment of size shall fall within the scope of the disclosure of the present invention without affecting the effect and purpose of the present invention. The technical content must be within the scope covered.

Hereby, the technical content and detailed description of the present invention are described as follows in conjunction with the drawings.

Please refer to FIG. 1 , which is a system architecture diagram of the audio adjustment system of the present invention. In some embodiments, the audio adjustment system proposed by the present invention includes: an earphone 10 , a mobile computing device 20 and a cloud server 30 .

The earphone 10 can be, for example, a headphone, an earphone or other earphones. The earphone 10 can be, for example, a bluetooth earphone, a wired earphone or an earphone connected in other ways.

The mobile computing device 20 is removably coupled to the earphone 10 . Coupling means a wired electrical connection or a wireless electrical connection. In some embodiments, the mobile computing device 20 can be a desktop computer, a notebook computer, a tablet computer or a wearable multimedia player. In some embodiments, the mobile computing device 20 may include a processor 21 , a pickup unit 22 , a storage unit 23 and an equalizer 24 , which are not intended to limit the present invention.

The processor 21 is coupled to the pickup unit 22 , the storage unit 23 and the equalizer 24 . The processor 21 may include one of a microcontroller (MCU), a microprocessor (MPU), a central processing unit (CPU), an application specific integrated circuit (ASIC), or a system on a chip (SoC). Microcontrollers can also include boards based on the Arduino machine code framework. The SoC can be a Raspberry Pi, and its model can be Type 1A, Type 1A+, Type 1B, Type 1B+, Type 2B, Type 3B, Type 3B+, Type 3A+ or Type 4B. However, the foregoing is illustrative only, and the present invention is not limited by the foregoing.

The sound pickup unit 22 can record the first audio and the second audio to the earphone 10 . The frequency of the first audio frequency is between 20 Hz and 20000 Hz, and the frequency of the second audio frequency is between 20 Hz and 20000 Hz. In some embodiments, the first audio corresponds to a first state of the earphone 10 . For example, the first state may be that the volume of the earphone is the lowest volume (for example, mute), the volume of the earphone is 50% of the maximum volume, or the volume of the earphone is the maximum volume. In some embodiments, the first state is described with the volume of the earphone 10 being the lowest volume, but it is not limiting. In some embodiments, the second audio corresponds to a second state of the earphone 10 . The second state can be, for example, that the volume of the earphone is the lowest volume (for example, mute), the volume of the earphone is 50% of the maximum volume of the earphone, or the volume of the earphone is the maximum volume. In this embodiment, the volume of the earphone 10 is 50% of the maximum volume of the earphone 10 for illustration in the second state, but it is not limiting. It should be noted that the first state and the second state must be different volume states. The pickup unit 22 can be, for example, a dynamic microphone, a condenser microphone, an electret condenser microphone, a mems microphone, or a ribbon microphone. ), carbon microphone (carbon microphone), and can be omnidirectional (omnidirectional), single-directional (cardioid/hypercardioid) or bi-directional (bi-directional/figure-of-8) mode of operation, but it is not restrictive.

In other words, the sound pickup unit 22 records the first audio for the earphone 10 set to mute (lowest volume), and records the second audio for the earphone 10 set to 50% of the maximum volume.

It is worth mentioning that in physics, sound pressure refers to the amount of pressure change caused by vibration when sound waves pass through the medium. When sound waves propagate in the air as a longitudinal wave, the density of air particles and the pressure will change. Changes with the sound wave, this change is the sound pressure. In the International System of Units, the unit of sound pressure is Pascal/Pa (Pa). Further, the sound pressure level (sound pressure level, SPL) refers to the size of the "effective sound pressure" measured on a logarithmic scale relative to a reference value, and the unit is decibel (dB). For normal human hearing, the most sensitive frequency range is between 2000 Hz and 5000 Hz, and the threshold of hearing is about 2×10-5 Pa, so it is usually As a reference value for sound pressure level. That is to say, for a young and middle-aged person with normal hearing, the sound needs to generate a pressure of at least about 2×10-5 Pa before it can be felt. Sound pressure in air can be measured with a microphone, and sound pressure in water can be measured with a hydrophone. In some embodiments, the first audio and the second audio are a collection of sound pressure level (dB) data of each frequency (Hz) in the frequency range between 20 Hz and 20000 Hz.

In some embodiments, the storage unit 23 is, for example, a memory of the mobile computing device 20, which can be used to store the first audio and the second audio.

The equalizer 24 outputs the equalized audio distribution to the earphone 10 according to a standard audio distribution (not shown in the figure). In some embodiments, the equalizer 24 may exist in the mobile computing device 20 in the form of software or firmware, and the equalizer 24 is connected to the endpoint effects (EFX) interface and the mixing module ( Mixer) control.

The cloud server 30 is coupled to the mobile computing device 20, the mobile computing device 20 transmits the first audio and the second audio to the cloud server 30, and the cloud server 30 can perform calculations on the first audio and the second audio to obtain standard audio distributed and output to the mobile computing device 20 . The mobile computing device 20 adjusts the equalized audio distribution of the earphone 10 according to the standard audio distribution. In some embodiments, the operation is to extract the feature value of each sound pressure level by at least one convolution layer and at least one pooling layer of a convolutional neural network (R-CNN), And according to the feature value, each sound pressure level is classified and marked to obtain a standard audio distribution. In some embodiments, the first audio and the second audio are a collection of sound pressure level (dB) data of each frequency (Hz) in the frequency range between 20 Hz and 20,000 Hz, so the calculation system extracts the frequency Eigenvalues for each frequency in the range 20 Hz to 20000 Hz and used to obtain a standard audio distribution.

In some embodiments, the transmission of the first audio and the second audio can be through a wired network or a wireless network. Furthermore, the wireless network is compatible with infrared (infrared, IR), Bluetooth (Bluetooth), radio frequency (radio frequency, RF), near field communication (near field communication, NFC), Wi-Fi, Zigbee and LoRa one of the

FIG. 2 is a schematic flowchart of the first embodiment of the audio adjustment method of the present invention. Please refer to Fig. 1 and shown in Fig. 2 at the same time, the audio regulation method that the present invention proposes can be applied to hearing test program, and described method comprises the following steps: provide earphone (step S1); Adjust the sound volume of earphone 10 to the first State (being mute) (step S2); Sound pickup unit 22 is set to the earphone 10 recording first audio frequency (step S3) of first state; The sound volume of earphone 10 is adjusted to second state (being 50 of maximum volume %) (step S4); sound pickup unit 22 records the second audio frequency (step S5) to the earphone 10 that is set to the second state; receives the first audio frequency and the second audio frequency, and calculates the first audio frequency and the second audio frequency, Then obtain the standard audio distribution (step S6); adjust the equalized audio distribution of the earphone according to the standard audio distribution (step S7).

Therefore, when using the audio adjustment system and audio adjustment method of the present invention, the earphone audio in different states can be obtained by adjusting the volume of the earphone output (such as mute, 50% of the maximum volume, and maximum volume). Then, the audio is calculated by the cloud server to obtain the standard audio distribution, and the equalized audio distribution of the earphone is adjusted through the mobile computing device. Therefore, a common mobile computing device such as a laptop or a mobile phone can be used together with a pluggable earphone to conduct further hearing detection and other operations.

In addition, the mobile computing device can dynamically adjust different earphones (for example, purchased by each user) according to the standard audio distribution, so that the personal hygiene conditions of different users can be considered (between different users) There is no need to share earphones), and at the same time, it is exempt from the time-consuming situation that users need to make special appointments and go to professional testing units or purchase expensive professional testing equipment.

FIG. 3 is a schematic flowchart of a second embodiment of the audio adjustment method of the present invention. Please refer to Fig. 1 and shown in Fig. 3, the second embodiment of the present invention is substantially the same as the aforementioned first embodiment, but further comprises the following steps: the volume of the earphone 10 is adjusted to the third state (step S8); The unit 22 records the third audio to the earphone 10 set to the third state (step S9). Then, receive the first audio, the second audio and the third audio, and perform operations on the first audio, the second audio and the third audio, and then obtain the second standard audio distribution (step S10); adjust according to the second standard audio distribution The second equalized audio distribution of the earphone (step S11). In some embodiments, the third audio corresponds to the third state of the earphone. For example, the third state can be that the volume of the earphone is the maximum volume (for example, mute), the volume of the earphone is 50% of the maximum volume, or the earphone The sound volume is the maximum volume. In this embodiment, the third state is described with the volume of the earphone being the maximum volume, but it is not limiting. It should be noted that the first state, the second state and the third state must be different volume states. In some embodiments, the frequency of the third audio is between 20 Hz and 20000 Hz, and is stored in the storage unit 23 . In some embodiments, the third audio is a compilation of sound pressure level (dB) data for each frequency (Hz) in a frequency range between 20 Hz and 20,000 Hz.

FIG. 4 is a schematic diagram of digital spectrum data of the audio adjustment method of the present invention. Please refer to Fig. 1, Fig. 3 and Fig. 4, when using the audio adjustment system and method thereof of the present invention, the earphone 10 is by adjusting the volume of the earphone output (such as mute, 50% of the maximum volume, maximum volume, etc.) amount) to obtain the headphone response curves in different states.

For example, the curve 100 is the headphone response curve obtained by the sound pickup unit 22 recording the first audio to the headphone 10 when the headphone 10 is in the first state (ie mute). The curve 200 is the earphone response curve obtained by the sound pickup unit 22 recording the second audio to the earphone 10 when the volume of the earphone 10 is adjusted to 50% of the maximum volume and the earphone 10 is in the second state. The curve 300 is the earphone response curve obtained by the sound pickup unit 22 recording the third audio to the earphone 10 when the volume of the earphone 10 is adjusted to the maximum volume and the earphone 10 is in the third state. At this time, it can be observed from FIG. 3 that when the earphone is muted, the curve 100 has a peak at the frequency spectrum at 100 Hz, which is the background noise that must be corrected before the hearing test.

Then, the first audio, the second audio, and the third audio (including the aforementioned curve 100, curve 200, and curve 300) are calculated by the cloud server 30 to obtain a standard audio distribution, and adjust the earphones according to the standard audio distribution. Optimize audio distribution for further hearing detection and other operations. Since the selected earphone 10 is not limited, a general mobile computing device such as a laptop or a mobile phone can be used, and any pluggable earphone 10 can be used to operate the device and the method of the present invention. The standard audio distribution allows the mobile computing device 20 to dynamically adjust according to different earphones 10 (for example, purchased by each user), allowing the mobile computing device 20 to continuously generate audio when the earphone 10 is removably plugged in. Standard audio distribution. It can take into account the personal hygiene conditions of multiple users (the earphone 10 does not need to be shared between different users), and at the same time avoid the situation that the user needs to make a special appointment and go to a professional testing unit to waste time or purchase expensive professional testing equipment. It is convenient for multiple users to perform hearing tests.

In some embodiments, the above audio adjustment method can be executed by a computer readable medium configured on the mobile computing device 20, that is to say, the audio adjustment method of the first embodiment and the second embodiment can be It is performed by an application software (App) installed in the mobile computing device 20 . In other words, the mobile computing device 20 can also directly adjust the audio of the earphone 10 without going through the cloud server. Thereby, the applicability of the present invention can be increased. However, the foregoing is illustrative only, and the present invention is not limited by the foregoing.

For this reason, the audio adjustment system and method thereof described in the present invention can solve the technical problem in the prior art that requires fully calibrated professional equipment to obtain hearing curves corresponding to different users, and can help users save time and money Cost, to achieve the purpose of allowing users to carry out hearing testing conveniently.

The above is only a detailed description and drawings of the preferred specific embodiments of the present invention, but the features of the present invention are not limited thereto and do not limit the present invention. The scope of the present invention shall be subject to the scope of the following patent application , all embodiments that conform to the spirit of the patent scope of the present invention and its similar changes should be included in the scope of the present invention, and any changes or modifications that can be easily conceived by those familiar with the art in the field of the present invention are all Can be covered in the scope of the following patents in this case.

10: Headphones 20:Mobile Computing Device 21: Processor 22:Pickup unit 23: storage unit 24: Equalizer 30: Cloud server 100: curve 200: curve 300: curve S1~S11: Steps

1 is a system architecture diagram of the audio adjustment system of the present invention;

FIG. 2 is a schematic flow chart of the first embodiment of the audio adjustment method of the present invention;

FIG. 3 is a schematic flowchart of a second embodiment of the audio adjustment method of the present invention; and

FIG. 4 is a schematic diagram of digital spectrum data of the audio adjustment method of the present invention.

10: Headphones

20:Mobile Computing Device

21: Processor

22:Pickup unit

23: storage unit

24: Equalizer

30:Cloud server

Claims (10)

An audio adjustment method, comprising: provide a headset; Adjust the sound volume of the earphone to a first state; recording a first audio of the earphone in the first state; adjusting the volume of the earphone to a second state; recording a second audio of the earphone in the second state; obtaining a standard audio distribution according to the first audio and the second audio; and An equalized audio distribution of the headset is adjusted according to the standard audio distribution. The audio adjustment method according to claim 1, wherein the frequency of the second audio frequency is between 20 Hz and 20000 Hz, and the second state is 50% of a maximum volume of the earphone. The audio adjustment method according to claim 1, wherein the frequency of the first audio frequency is between 20 Hz and 20000 Hz, and the first state is a minimum volume of the earphone. The audio adjustment method described in claim 1 further includes the following steps: adjusting the volume of the earphone to a third state; and A third audio of the earphone in the third state is recorded. The audio adjustment method according to claim 4, wherein the frequency of the third audio is between 20 Hz and 20000 Hz, and the third state is a maximum volume of the earphone. A computer-readable medium configured on a mobile computing device, the computer-readable medium executes the audio adjustment method described in any one of claims 1 to 5. An audio conditioning system comprising: a headset; A mobile computing device, removably coupled to the earphone, and includes a sound pickup unit to record a first audio and a second audio of the earphone; and A cloud server, coupled with the mobile computing device, the mobile computing device transmits the first audio and the second audio to the cloud server, and the cloud server outputs a standard according to the first audio and the second audio audio distribution to the mobile computing device; Wherein, the mobile computing device adjusts an equalized audio distribution of the earphone according to the standard audio distribution. The audio adjustment system according to claim 7, wherein the first audio frequency corresponds to a first state of the earphone, and the first state is that the volume of the earphone is a minimum volume; and The second audio corresponds to a second state of the earphone, and the second state is 50% of the maximum volume of the earphone. The audio adjustment system as described in claim 7, wherein the sound pickup unit further records a third audio to the earphone; and The third audio corresponds to a third state of the earphone, and the third state is a maximum volume of the earphone. The audio adjustment system as described in Claim 7, wherein the mobile computing device further includes an equalizer and a storage unit, the equalizer adjusts the equalized audio distribution to the earphone according to the standard audio distribution, and the storage unit At least one of the first audio and the second audio is stored.

Images