CN111355841A

CN111355841A - Hearing assistance method and device based on smart phone and computer equipment

Info

Publication number: CN111355841A
Application number: CN202010064424.XA
Authority: CN
Inventors: 陈旋; 王冲; 张平; 於为定
Original assignee: Jiangsu Aijia Household Products Co Ltd
Current assignee: Jiangsu Aijia Household Products Co Ltd
Priority date: 2020-01-20
Filing date: 2020-01-20
Publication date: 2020-06-30

Abstract

The invention discloses a hearing assistance method, a device, computer equipment and a storage medium based on a smart phone, wherein a left ear and a right ear of a user are respectively tested by adopting a plurality of pure music to obtain a left ear test result and a right ear test result, a left ear hearing loss result is determined according to the left ear test result, a right ear hearing loss result is determined according to the right ear test result, a hearing compensation rule is generated according to the left ear hearing loss result and the right ear hearing loss result, a sound playing mode of the smart phone is detected, a currently played sound file is processed according to the sound playing mode and the hearing compensation rule to obtain played data to be played, so that the played data can be adjusted according to the characteristics of the user, the adjustment effect can be improved, the corresponding assistance effect is improved, and the user experience is improved.

Description

Hearing assistance method and device based on smart phone and computer equipment

Technical Field

The invention relates to the technical field of sound signal processing, in particular to a hearing assistance method and device based on a smart phone, computer equipment and a storage medium.

Background

The existing barrier-free mode of the smart phone lacks an auxiliary function specially serving for the hearing-impaired person, the hearing-impaired person can only simply turn up the volume for acquiring the sound information, the hearing impairment has the conditions that the hearing of different frequency bands is impaired differently and the hearing of the left ear and the right ear is impaired differently, the audio signal is simply amplified, the actual acquired sound of the hearing-impaired person is suddenly high or suddenly low, the listening effect is influenced, and the effective hearing of the hearing-impaired person can be damaged. It can be seen that the traditional hearing assistance scheme has the problem of poor assistance effect.

Disclosure of Invention

In view of the above problems, the present invention provides a hearing assistance method based on a smart phone, a computer device and a storage medium.

In order to achieve the purpose of the invention, the invention provides a hearing assistance method based on a smart phone, which comprises the following steps:

s10, testing the left ear and the right ear of the user by adopting a plurality of pure music respectively to obtain a left ear test result and a right ear test result; wherein, the sound parameters of each pure music are different;

s20, determining a left ear hearing loss result according to the left ear test result, and determining a right ear hearing loss result according to the right ear test result;

s30, generating a hearing compensation rule according to the hearing loss result of the left ear and the hearing loss result of the right ear; the hearing compensation rule records the sound signal intensity adjustment rule under the mobile phone loudspeaker and mobile phone earphone modes respectively;

and S40, detecting the sound playing mode of the smart phone, processing the currently played sound file according to the sound playing mode and the hearing compensation rule, and playing the sound file according to the obtained playing data.

In one embodiment, the process of testing the left ear and the right ear of the user with pure music comprises:

respectively playing the pure music to the left ear and the right ear in sequence according to a plurality of preset frequencies to enable the sound intensity to start from 30dB, clicking buttons which cannot be heard, have small sound and normal sound or have overlarge sound respectively by the user aiming at the left ear and the right ear according to an actual listening result, adjusting the volume by the smart phone according to the buttons clicked by the user until the user inputs the buttons which are clicked normally respectively aiming at the left ear and the right ear, and obtaining operation records of the user on the buttons respectively aiming at the left ear and the right ear in sequence; wherein the operation record for the left ear is used for generating a left ear test result; the operational record for the right ear is used to generate a right ear test result.

As an embodiment, determining the result of the hearing loss of the left ear according to the result of the left ear test and determining the result of the hearing loss of the right ear according to the result of the right ear test comprises:

determining a sound reference standard under each frequency according to the operation record of the left ear under each frequency, obtaining the difference value between the actual volume selected by the user aiming at the left ear and the sound reference standard by taking the actual volume of the user from the hearing effect correction to the sound normal as a base number, obtaining the hearing loss of the left ear under each frequency, summarizing the hearing loss of the left ear under each frequency, and obtaining the hearing loss result of the left ear;

determining a sound reference standard under each frequency according to the operation record of the right ear under each frequency, obtaining the difference value between the actual volume selected by the user aiming at the right ear and the sound reference standard by taking the actual volume of the user from the correction listening effect to the normal sound as a base number, obtaining the hearing loss of the right ear under each frequency, summarizing the hearing loss of the right ear under each frequency, and obtaining the hearing loss result of the right ear.

In one embodiment, the process of processing the currently played sound file according to the sound playing mode and the hearing compensation rules comprises:

and according to the sound playing mode and the hearing compensation rule, performing signal enhancement on the sound files in each frequency range which are played currently, and synthesizing the enhanced sound signals according to the sound playing mode.

As an embodiment, the process of synthesizing the enhanced sound signal according to the sound playing mode includes:

if the sound playing mode is the loudspeaker mode, synthesizing the enhanced sound signals into single-channel playing data;

if the sound playing mode is the earphone mode, the enhanced sound signals are synthesized into the play data of the dual-channel.

A smartphone-based hearing assistance device comprising:

the system comprises an adoption module, a left ear testing module and a right ear testing module, wherein the adoption module is used for adopting a plurality of pure music to respectively test the left ear and the right ear of a user to obtain a left ear testing result and a right ear testing result; wherein, the sound parameters of each pure music are different;

the determining module is used for determining a left ear hearing loss result according to the left ear test result and determining a right ear hearing loss result according to the right ear test result;

the generating module is used for generating a hearing compensation rule according to the hearing loss result of the left ear and the hearing loss result of the right ear; the hearing compensation rule records the sound signal intensity adjustment rule under the mobile phone loudspeaker and mobile phone earphone modes respectively;

and the detection module is used for detecting the sound playing mode of the smart phone, processing the currently played sound file according to the sound playing mode and the hearing compensation rule, and playing the obtained playing data.

In one embodiment, the employing module is further configured to:

respectively playing the pure music to the left ear and the right ear in sequence according to a plurality of preset frequencies to enable the sound intensity to start from 30dB, clicking buttons which cannot be heard, have small sound and normal sound or have overlarge sound respectively for the left ear and the right ear by a user according to an actual listening result, and repeatedly operating the buttons with the strengthened or weakened sound volume until the user respectively hits the buttons with normal sound aiming at the input points of the left ear and the right ear to obtain operation records of the user on the buttons respectively aiming at the left ear and the right ear in sequence; wherein the operation record for the left ear is used to generate a left ear test result; the operational record for the right ear is used to generate a right ear test result.

As one embodiment, the determining module is further configured to:

A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the smartphone-based hearing assistance method of any of the above embodiments when executing the computer program.

A computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the smartphone-based hearing assistance method of any of the above embodiments.

According to the hearing assistance method, the hearing assistance device, the computer equipment and the storage medium based on the smart phone, the left ear and the right ear of the user are respectively tested by adopting a plurality of pure music to obtain a left ear test result and a right ear test result, the hearing loss result of the left ear is determined according to the left ear test result, the hearing loss result of the right ear is determined according to the right ear test result, the hearing compensation rule is generated according to the hearing loss result of the left ear and the hearing loss result of the right ear, the sound playing mode of the smart phone is detected, the currently played sound file is processed according to the sound playing mode and the hearing compensation rule, the played data is obtained and played, the played data can be adjusted according to the characteristics of the user, the adjustment effect can be improved, the corresponding assistance effect is improved, and the user experience is improved.

Drawings

FIG. 1 is a flow diagram of a smartphone-based hearing assistance method of an embodiment;

FIG. 2 is a schematic diagram of a smartphone-based hearing assistance system, according to an embodiment;

FIG. 3 is a flow diagram of a smartphone-based hearing assistance method of another embodiment;

FIG. 4 is a schematic diagram of a smartphone-based hearing assistance device configuration according to one embodiment;

FIG. 5 is a schematic diagram of a computer device of an embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

In one embodiment, as shown in fig. 1, there is provided a smartphone-based hearing assistance method, comprising the steps of:

s10, testing the left ear and the right ear of the user by adopting a plurality of pure music respectively to obtain a left ear test result and a right ear test result; wherein the sound parameters of the pure music are different from one another.

The sound parameters include sound intensity and sound frequency. Each pure music has a different sound intensity and a different sound frequency. The smart phone can play each pure music through modes of speaker playing or external earphone playing, so that the user can realize the hearing self-test of the left ear and the right ear. The hearing ability of the left ear and the right ear of the user is rapidly tested by pure music based on different sound intensities and sound frequencies.

And S20, determining the hearing loss result of the left ear according to the left ear test result, and determining the hearing loss result of the right ear according to the right ear test result.

The hearing loss analysis can be realized through the steps, the hearing loss conditions of the left ear and the right ear of the user are analyzed according to the hearing self-test result, and the hearing loss results corresponding to different frequencies of the left ear and the right ear are output.

S30, generating a hearing compensation rule according to the hearing loss result of the left ear and the hearing loss result of the right ear; and the hearing compensation rule records the sound signal intensity adjustment rule under the mobile phone loudspeaker and mobile phone earphone modes respectively.

The above steps can automatically generate a hearing assistance rule (hearing compensation rule) of the corresponding ear according to the hearing impairment analysis result of each ear, so as to provide a sound signal intensity adjustment rule based on the mobile phone loudspeaker and the mobile phone earphone mode.

The steps can detect the playing mode, the sound frequency and the sound volume of the sound played by the mobile phone, and preprocess the played sound file (playing data) according to the currently used hearing assistance rule so as to perform corresponding signal enhancement on the sound under different frequencies.

Specifically, the sound playing mode includes a handset speaker mode and a handset earphone mode. Under the mobile phone earphone mode, the hearing compensation values under different audios are the hearing loss under the corresponding frequency of the ear; under the loudspeaker mode of the mobile phone, the hearing compensation value of different audios is the smaller value of the hearing loss of double ears under the frequency. For edge audio below 250Hz and above 4000Hz, the hearing compensation values take the average of the hearing loss in this interval.

According to the hearing assistance method based on the smart phone, the left ear and the right ear of the user are respectively tested by adopting a plurality of pure music to obtain a left ear test result and a right ear test result, the left ear hearing loss result is determined according to the left ear test result, the right ear hearing loss result is determined according to the right ear test result, the hearing compensation rule is generated according to the left ear hearing loss result and the right ear hearing loss result, the sound playing mode of the smart phone is detected, the currently played sound file is processed according to the sound playing mode and the hearing compensation rule, the played data is played, the played data can be adjusted according to the characteristics of the user, the adjustment effect can be improved, the corresponding assistance effect is improved, and the user experience is improved.

Specifically, the process of testing the left ear and the right ear of the user provided by this embodiment may be executed for each pure music to obtain an operation record of each pure music for the left ear and an operation record for the sum ear, a left ear test result is generated according to each operation record corresponding to the left ear, and a right ear test result is generated according to each operation record corresponding to the right ear.

The process that the smart phone adjusts the volume according to the button clicked by the user comprises the following steps: if the user clicks the button which is inaudible or has small sound, the volume is turned up, for example, the volume is increased by 5dB each time, and if the user clicks the button which has too large sound, the volume is turned down, for example, the volume is turned down by 5dB each time.

The predetermined plurality of frequencies may include 1000Hz, 2000Hz, 4000Hz, 8000Hz, 1000Hz, 500Hz, 250Hz, 125Hz, and the like. The sound emphasis range during the test may be 30dB to 90 dB. At this time, the hearing self-test provides a pure tone hearing test in which the frequency range includes 1000Hz, 2000Hz, 4000Hz, 8000Hz, 1000Hz, 500Hz, 250Hz, 125Hz, and the sound pressure intensity range is 30dB to 90dB, and the left and right ear test modes are supported. A tester (user) utilizes a smart phone and earphone equipment to respectively and sequentially carry out hearing self-test on left and right ears according to the frequency sequence, the sound intensity starts from 30dB, the user carries out click operation (cannot hear, the sound is small, the sound is normal, the sound is too large) according to an actual listening result, and corresponding sound volume enhancement or reduction (5dB per gear) is carried out according to the user operation.

The acoustic reference standard may be 50 dB.

In one example, the difference between the actual volume of the user correcting the listening effect and the actual volume of the user with normal sound is used as a base number according to the operation record of the user during self-time measurement, the difference is the hearing loss at the frequency, the hearing loss conditions at different frequencies are summarized and analyzed, and the corresponding hearing loss result is determined. Alternatively, the hearing loss results may be as shown in table 1.

TABLE 1

Frequency (Hz)

125

250

500

1000

2000

4000

6000

8000

Left ear hearing loss (dbspl)

a1

b1

c1

d1

e1

f1

g1

h1

Right ear hearing loss (dbspl)

a2

b2

c2

d2

e2

f2

g2

h2

Further, the hearing compensation rules in the speaker mode and the earphone mode can be determined according to the hearing loss result, the application hearing range and the hearing sensitivity range. The hearing sensitivity range may include the following: the human hearing frequency range is 20-20000Hz, wherein the human hearing frequency range is most sensitive to sound waves of 1000Hz-3000 Hz; the most commonly used hearing audio frequency range of human ears is about 500 Hz-4000 Hz, and the audio frequency interval is divided and the compensation rule is set by combining the hearing sensitivity range and the common hearing application range. Under the earphone mode, the hearing compensation values under different audio frequencies are the hearing loss of the corresponding frequency of the ear; under the loudspeaker mode, the hearing compensation value of different audios is a small value of the binaural hearing loss under the frequency; for edge tones below 250Hz and above 4000Hz, the hearing compensation values take the average of the hearing loss in this interval. If the volume is 50dB, the actual listening effect is sound normal as the standard for hearing correction, and the difference between the actual volume from the user corrected listening effect to sound normal is the base number, which is the hearing loss at the frequency, for example, a1 is equal to (125Hz listening effect is sound normal actual volume minus 50 dB). The marginal audio may employ the average hearing loss as the hearing loss value in the frequency range; in speaker mode, the smaller of the two-ear hearing loss values can be taken as the function representation.

In one example, the compensation rules corresponding to table 1 may be as shown in table 2.

TABLE 2

Specifically, the Sound file may be processed by a mobile phone that requires a built-in software (such as Sound Amplifier or Premiere), and the processing may be divided into four parts, namely, original Sound signal detection, Sound signal separation, Sound signal enhancement, and Sound signal synthesis.

And detecting the sound signal, namely detecting the volume, the audio frequency and the playing mode of the sound file played by the mobile phone.

The audio signal is separated, and the audio is separated in accordance with the audio sensitivity frequency range to generate a plurality of audio tracks.

And enhancing the sound signal, namely performing corresponding signal enhancement on the sound in different frequency ranges according to the playing mode and the compensation rule. Like in a frequency interval (non-edge frequency), the hearing loss value is equal to a hearing compensation value, the current sound audio frequency is 1000Hz, the hearing loss of the user is 20dB at the frequency, and when the original sound volume is 50dB, the enhanced sound volume is equal to 50dB +20 dB.

And synthesizing sound signals, namely synthesizing the enhanced sound signals according to a playing mode, synthesizing a single sound channel in a loudspeaker mode and playing and outputting the single sound channel, and synthesizing a double sound channel in an earphone mode and playing and outputting the double sound channel.

The hearing assistance method based on the smart phone has the following technical effects:

the blank that the hearing assistance system of the existing smart phone is lost is made up, the steps of obtaining the hearing damage condition of the user, intelligently generating the hearing compensation rule, automatically enhancing the sound signal and the like are adopted, the sound is effectively adjusted automatically according to the hearing damage condition, and the experience of the hearing-impaired user in using the mobile phone is improved.

In one embodiment, the hearing assistance system based on the smart phone, which executes the hearing assistance method based on the smart phone, provides an assistance function for automatically adjusting the intensity of the sound signal according to the hearing-impaired condition for the hearing-impaired user. The specific structure can be seen in fig. 2, and includes a hearing self-test module, a hearing analysis module, a compensation rule module, and a sound signal processing module.

Wherein, the user needs to complete the hearing self-test first, analyze to obtain different frequency hearing impaired structures and generate corresponding hearing compensation rules. After the sound signal is input, stripping the sound according to the frequency range; performing corresponding frequency signal enhancement according to the hearing compensation rule and the playing mode; and synthesizing and outputting the sound according to the playing mode.

In one example, the implementation steps are described in detail in conjunction with fig. 3 and the specific examples, as follows:

step 1, as shown in fig. 3, a user uses the hearing assistance function for the first time to guide and complete the hearing self-test based on pure sound. The hearing self-testing function provides pure tone hearing tests with frequency ranges of 1000Hz, 2000Hz, 4000Hz, 8000Hz, 1000Hz, 500Hz, 250Hz and 125Hz and sound pressure intensity ranges of 30 dB-90 dB, and supports a left ear test mode and a right ear test mode. The user uses the smart phone and the earphone device to respectively and sequentially carry out hearing self-test on the left ear and the right ear according to the frequency sequence, the sound intensity starts from 30bB, the user carries out click operation (cannot hear, the sound is small, the sound is normal, the sound is too large) according to the actual listening result, corresponding sound volume enhancement or reduction (5dB per gear) is carried out according to the user operation, and the corresponding operation result is recorded.

Step 2, according to the user self-testing operation and the operation record according to the user self-testing, taking 50bB as a sound normal standard and taking the actual volume from the user to correct the listening effect to the sound normal as a base number, obtaining the difference value of the two as the hearing loss under the frequency, summarizing and analyzing the hearing loss conditions under different frequencies, and inputting the hearing loss results shown in the table 3:

TABLE 3

Frequency (Hz)	125	250	500	1000	2000	4000	6000	8000
									Left ear hearing loss	0	20	20	40	10	0	0	0
Right ear hearing loss	0	0	40	40	20	20	0	0

Step 3, outputting a compensation rule shown in table 4 according to the hearing loss result and the hearing sensitivity range of the current test, wherein in the earphone mode, the hearing compensation values under different audio frequencies are the hearing loss values under the corresponding frequency of the ear; under the loudspeaker mode, the hearing compensation value of different audios is the smaller value of the binaural hearing loss under the frequency; below the edge tones 250Hz and above 4000Hz, the hearing compensation values are averaged over the hearing loss in this interval.

TABLE 4

Step 4, as shown in the sound compensation implementation process of fig. 3, the user needs to select the hearing compensation rule and activate the hearing assistance function.

Step 5, detecting the volume, audio frequency and play mode of the sound signal output by the mobile phone in real time;

and 6, separating the sound signals according to the sound sensitive frequency range. For example, see table 5 below:

TABLE 5

Frequency (Hz)	20-250	251-500	501-1000	1001-2000	2001-4000	4001-20000
							Raw signal strength	50	50	50	50	50	50

And 7, enhancing the separated signals according to the corresponding compensation rules and the playing modes according to the corresponding frequencies.

And 8, synthesizing the sound signal according to the corresponding compensation rule and the playing mode.

And 9, outputting the enhanced sound according to the corresponding play mode to obtain a final result shown in the table 6.

In one embodiment, referring to fig. 4, there is provided a smartphone-based hearing assistance device comprising:

the adoption module 10 is used for adopting a plurality of pure music to respectively test the left ear and the right ear of the user to obtain a left ear test result and a right ear test result; wherein, the sound parameters of each pure music are different;

a determining module 20, configured to determine a left-ear hearing loss result according to the left-ear test result, and determine a right-ear hearing loss result according to the right-ear test result;

a generating module 30, configured to generate a hearing compensation rule according to the left ear hearing loss result and the right ear hearing loss result; the hearing compensation rule records the sound signal intensity adjustment rule under the mobile phone loudspeaker and mobile phone earphone modes respectively;

and the detection module 40 is configured to detect a sound playing mode of the smart phone, process a currently played sound file according to the sound playing mode and the hearing compensation rule, and obtain playing data for playing.

In one embodiment, the employing module is further configured to:

As one embodiment, the determining module is further configured to:

For specific limitations of the smartphone-based hearing assistance device, reference may be made to the above limitations of the smartphone-based hearing assistance method, which are not described in detail herein. The various modules in the smartphone-based hearing assistance device described above may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independently arranged in a processor in the computer equipment, or can be stored in a memory in the computer equipment in a software form, so that the processor can call and execute operations corresponding to the modules.

In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 5. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a smartphone-based hearing assistance method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.

Those skilled in the art will appreciate that the architecture shown in fig. 5 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

Based on the examples described above, there is also provided in one embodiment a computer device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor when executing the program implements any of the smartphone-based hearing assistance methods as described in the embodiments above.

It will be understood by those skilled in the art that all or part of the processes in the methods of the above embodiments may be implemented by a computer program, which may be stored in a non-volatile computer readable storage medium, and in the embodiments of the present invention, the program may be stored in a storage medium of a computer system and executed by at least one processor in the computer system to implement the processes of the embodiments including the smartphone-based hearing assistance method described above. The storage medium may be a magnetic disk, an optical disk, a Read-only Memory (ROM), a Random Access Memory (RAM), or the like.

Accordingly, in an embodiment there is also provided a computer storage medium, a computer readable storage medium, having a computer program stored thereon, wherein the program, when executed by a processor, implements any of the smartphone-based hearing assistance methods described in the embodiments above.

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

It should be noted that the terms "first \ second \ third" referred to in the embodiments of the present application merely distinguish similar objects, and do not represent a specific ordering for the objects, and it should be understood that "first \ second \ third" may be interchanged under a specific order or sequence where permitted. It should be understood that "first \ second \ third" distinct objects may be interchanged under appropriate circumstances such that the embodiments of the application described herein may be implemented in an order other than those illustrated or described herein.

The terms "comprising" and "having" and any variations thereof in the embodiments of the present application are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product, or device that comprises a list of steps or modules is not limited to the listed steps or modules, but may alternatively include other steps or modules not listed or inherent to such process, method, product, or device.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. A hearing assistance method based on a smart phone is characterized by comprising the following steps:

2. The smartphone-based hearing assistance method of claim 1, wherein in one embodiment, the process of testing the user's left and right ears separately with a pure music comprises:

respectively playing the pure music to the left ear and the right ear in sequence according to a plurality of preset frequencies to enable the sound intensity to start from 30dB, clicking buttons which cannot be heard, have small sound and normal sound or have overlarge sound respectively by the user aiming at the left ear and the right ear according to an actual listening result, adjusting the volume by the smart phone according to the buttons clicked by the user until the user inputs the buttons which are clicked normally according to the left ear and the right ear respectively, and obtaining operation records of the user on the buttons respectively aiming at the left ear and the right ear in sequence; wherein the operation record for the left ear is used for generating a left ear test result; the operational record for the right ear is used to generate a right ear test result.

3. The smartphone-based hearing assistance method of claim 2, wherein in one embodiment, determining the left-ear hearing loss result from the left-ear test result comprises:

determining a sound reference standard under each frequency according to the operation record of the left ear under each frequency, solving the difference between the actual volume selected by the user aiming at the left ear and the sound reference standard by taking the actual volume from the correction of the listening effect of the user to the sound normality as a base number to obtain the hearing loss of the left ear under each frequency, summarizing the hearing loss of the left ear under each frequency to obtain the hearing loss result of the left ear;

determining a sound reference standard under each frequency according to the operation record of the right ear under each frequency, obtaining the difference value between the actual volume selected by the user aiming at the right ear and the sound reference standard by taking the actual volume of the user from the correction listening effect to the sound normal as a base number, obtaining the hearing loss of the right ear under each frequency, summarizing the hearing loss of the right ear under each frequency, and obtaining the hearing loss result of the right ear.

4. The smartphone-based hearing assistance method of claim 1, wherein in one embodiment, processing the currently playing sound file according to the sound playing mode and the hearing compensation rules comprises:

and according to the sound playing mode and the hearing compensation rule, performing signal enhancement on the sound files in each frequency range played currently, and synthesizing the enhanced sound signals according to the sound playing mode.

5. The smartphone-based hearing assistance method of claim 4, wherein in one embodiment, the process of synthesizing the enhanced sound signal in a sound playback mode comprises:

6. A hearing assistance device based on a smartphone, comprising:

7. The smartphone-based hearing assistance device of claim 6, wherein the adoption module, in one embodiment, is further configured to:

respectively playing the pure music to the left ear and the right ear in sequence according to a plurality of preset frequencies to enable the sound intensity to start from 30dB, clicking buttons which cannot be heard, have small sound, have normal sound or have overlarge sound respectively by the user aiming at the left ear and the right ear according to an actual listening result, and repeatedly operating the buttons with the strengthened volume or the weakened volume until the user inputs the buttons with the normal sound aiming at the left ear and the right ear respectively to obtain operation records of the user on the buttons respectively aiming at the left ear and the right ear in sequence; wherein the operation record for the left ear is used for generating a left ear test result; the operational record for the right ear is used to generate a right ear test result.

8. The smartphone-based hearing assistance device of claim 7, wherein in one embodiment the determination module is further configured to:

9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the smartphone-based hearing assistance method of any one of claims 1-5 when executing the computer program.

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the augmented reality interaction method of any one of claims 1 to 5.