CN110544532B - Sound source space positioning capability detection system based on APP - Google Patents

Sound source space positioning capability detection system based on APP Download PDF

Info

Publication number
CN110544532B
CN110544532B CN201910685380.XA CN201910685380A CN110544532B CN 110544532 B CN110544532 B CN 110544532B CN 201910685380 A CN201910685380 A CN 201910685380A CN 110544532 B CN110544532 B CN 110544532B
Authority
CN
China
Prior art keywords
sound source
app
subject
app client
sound
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910685380.XA
Other languages
Chinese (zh)
Other versions
CN110544532A (en
Inventor
余光正
崔冬
谢菠荪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to CN201910685380.XA priority Critical patent/CN110544532B/en
Publication of CN110544532A publication Critical patent/CN110544532A/en
Application granted granted Critical
Publication of CN110544532B publication Critical patent/CN110544532B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/12Audiometering
    • A61B5/121Audiometering evaluating hearing capacity
    • A61B5/123Audiometering evaluating hearing capacity subjective methods
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/20ICT specially adapted for the handling or processing of patient-related medical or healthcare data for electronic clinical trials or questionnaires
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Abstract

The invention discloses a sound source space positioning capability detection system based on APP, which comprises an APP client, a server and a computer management terminal, wherein the APP client is in communication connection with the Internet, and the APP client is in communication connection with the computer management terminal through the server; the APP client comprises a space hearing detection and recovery training, acquisition of test environment acoustic parameters, subject information input, operation training, a detection module and data transmission; the server is mainly used for sorting received data and storing the selected position and the true position of the received subject in a list form; the computer management terminal is used for managing subject information, storing or processing hearing signals, downloading analysis experiment data and experiment error correction. The system reduces the influence of interference factors on experimental results, improves the efficiency of sound source space localization, and provides a scientific and efficient experimental platform for the research of sound source localization audiology.

Description

Sound source space positioning capability detection system based on APP
Technical Field
The invention relates to the technical field of electroacoustic, in particular to a sound source space positioning capability detection system based on APP.
Background
Nowadays, the hearing ability of more and more people is continuously reduced or even risked to be lost due to the pollution of noise, the long-term wearing of electronic equipment and the aggravation of the aged society. The localization cues of a person with impaired hearing are often degraded (due to reduced hearing ability and due to the configuration of the hearing aid worn by the hearing impaired person), which means a degradation of the ability to determine from which direction a given sound comes. This presents great inconvenience and danger to their normal life, such as the inability to correctly perceive vehicles coming and going sideways and behind on roads where vision is not timely available. Early discovery and treatment of loss of spatial localization is therefore necessary for patients suffering from hearing loss.
At present, detection of spatial localization capability and provision of therapeutic and restorative means have been studied early, but most remain in the laboratory stage. The existing space hearing and recovery training device mainly has the following defects:
1. conventional hearing test devices are time consuming and laborious to operate, and expensive instruments are not readily available for use in some general hospitals.
2. Hearing screening must be performed using specific equipment and tools, with specialized trained personnel, and requires the construction of a complex speaker array and associated control system for spatial sound source localization.
3. With the aggravation of population aging, the proportion of the aged patients with hearing loss is largest, and the trip difficulty is larger for some patients with senior age and inconvenient bodies.
Disclosure of Invention
In order to overcome the defects, the system for detecting the spatial positioning capability of the sound source based on the APP is provided.
The invention is realized at least by one of the following technical schemes.
The sound source space positioning capability detection system based on the APP comprises an APP client, a server and a computer management terminal, wherein the APP client is in communication connection with the computer management terminal through the server; the APP client comprises space hearing detection, recovery training on the crowd with damaged space positioning capability through virtual sound source positioning, acquisition of acoustic parameters of a test environment, input of subject information, operation training, a detection module and data transmission;
collecting acoustic parameters of the test environment, and acquiring background noise of the test environment in real time and judging whether an experiment is proper or not;
entering subject information includes filling in registration information of a user on line, wherein the registration information of the user includes name, age, gender, threshold of hearing, telephone and hearing condition;
operation training for familiarizing a subject with the operation of an APP client and with a virtual spatial sound source;
the detection module is used for detecting and training the spatial positioning capability of the subject and simulating different noise environments through the background noise with different signal to noise ratios;
data transmission, mainly transmitting registration information and sound source position information to a server for storage;
the server is mainly used for sorting received data, storing the position selected by a received subject and the real position of a virtual space sound source in a list form, and serving as a transfer station for data transmission between an APP client and a computer management terminal;
the computer management terminal is used for managing subject information, replacing or deleting audible signals, downloading analysis experiment data and experiment error correction.
Further, the APP client also includes an experiment bulletin including informing the purpose of the experiment, the duration required, the untimely approach taken by the subject and the experimental place.
Further, the experiment for judging whether the experiment is proper is specifically: when the background noise is larger than a set value, the APP client reminds that the experiment is not suitable, and suggests to select a quiet environment for testing; and when the background noise is not larger than the set value, judging that the experimental condition is satisfied.
Further, the spatial hearing detection process of the APP client is as follows:
1) Providing a training sound source to familiarize the subject with virtual sounds in space;
2) Randomly playing a virtual sound at a certain position in the horizontal direction, wherein the virtual sound source is a detection sound source in the detection module; the method comprises the steps of carrying out a first treatment on the surface of the
3) And the subject selects a perception position on an APP client interface, and the APP client automatically records the selected position and the real position information of the virtual sound and sends the data to a server for storage.
Further, the server comprises a data receiving and storing module;
the data receiving is used for receiving registration information and position information sent by the APP client;
and the storage module is used for storing the subject information and experimental data and storing the received selected position and the received real position of the subject in a list form.
Further, the computer management terminal specifically includes information management, audio management, result summarization, security management module, wherein:
information management, which is used for realizing management of subject information, experimental detection and error correction;
audio management, which is used for replacing or deleting the audio required by the APP client;
the result summarization is used for counting experimental data of each subject, and is convenient to derive and analyze;
and the safety management module is used for guaranteeing the safety of the subject data.
Further, the detection module includes four detection sound sources, which are pure tones, and pure tones containing background noise with signal to noise ratios of 0, 5 and 10.
Further, each detected sound source has 24 sound clips, each sound clip representing a virtual sound of a different azimuth.
Further, the sound propagation process of the APP client adopts a linear time-invariant system to process signals, the HRTF is used as a transfer function of the linear time-invariant system, filtering is carried out through the transfer function, and the obtained binaural signals are:
wherein E is 0 Frequency domain signal of single path E L And E is R The signals are respectively left ear signals and right ear signals, r represents the distance between a point sound source and the head center, namely the origin of coordinates O, the azimuth angle theta is the included angle between the projection of the direction vector of the origin of coordinates O to the sound source S on the horizontal plane and the y axis, and the value range of theta is more than or equal to 0 DEG and less than or equal to 360 deg. Elevation angleIs the included angle between the sound source direction vector and the horizontal plane, and the value range is +.>f represents sound source frequency, a represents physiological structure parameters (including shape, size and the like of physiological structures such as head, trunk and the like), and a is different among different individuals.
The present invention includes, but is not limited to, virtual sound source localization supporting static virtual auditory playback and dynamic virtual auditory playback, and real sound source localization supporting speaker playback, and the APP client can serve as a data acquisition platform.
The method can be suitable for psychoacoustic behavioral testing of absolute sound source positions (directions and distances) through selecting points on the screen of the smart phone, can also be used for a distinguishing experiment for judging relative distances through judging modes such as two-to-one and the like, and can be widely suitable for psychoacoustic testing similar to the experiment through grabbing the directions and the distances of the points selected by the subject on the screen.
The system mainly realizes the data acquisition of acoustic source space auditory localization at the far end, provides a complete self-feedback experimental network (the experimental condition input, signal selection, auditory localization behavioural experiment and the judgment of localization results are all independently completed by a subject) for listeners, thereby reducing the influence of other interference factors on the experimental results; on the other hand, the system can improve the efficiency of sound source space localization, is suitable for primary detection of sound source space auditory localization of remote or large-scale subjects, and provides a scientific and efficient experimental platform for research of sound source localization audiology.
Compared with the prior art, the invention has the following beneficial effects:
(1) The APP client is convenient to install and simple to operate, integrates signals required by space hearing detection and recovery training on the portable intelligent mobile phone, does not need professional personnel and equipment, can screen a large number of people, is not limited by time and place, and is low in cost and convenient to popularize.
(2) The APP client is in communication connection with the server, can realize real-time synchronization of position data, can store and feed back data information of the selected position and the real position in real time, and plays a good feedback correction role in recovery training.
(3) The management client provided by the invention can enable a user to read the detection result at any time and master the hearing level of the user. For scientific researchers, through analysis of the whole database, hearing situations of all ages can be mastered, and corresponding guidance comments are given by analyzing reasons.
Drawings
FIG. 1 is a schematic diagram of the spatial hearing detection system according to the present embodiment;
FIG. 2 is a schematic diagram of an interface for APP client location selection in the present embodiment;
fig. 3 is a schematic diagram of a sound source space positioning capability detection system based on APP in the present embodiment;
FIG. 4 is a schematic diagram of a virtual free-field sound image of the present embodiment;
FIG. 5 is a flow chart of the spatial hearing detection of the present embodiment;
wherein: 1-APP client, 2-server, 3-management client.
Detailed Description
The objects, technical solutions and advantages of the present invention will be further described below with reference to the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating the invention, are not intended to limit the scope of the invention.
The invention can be used as a set of independent sound source positioning capability test system for collecting test data of a subject without being limited by time and place.
The system for detecting the sound source space positioning capability based on the APP as shown in fig. 1 and 3 comprises an APP client 1 in communication connection with the Internet, a server 2 in communication connection with the APP client 1, and a management client 3, namely a computer management terminal, in communication connection with the server 2.
The APP client 1 comprises the functions of space hearing detection, recovery training on the crowd with damaged space positioning capability through virtual sound source positioning, acquisition of acoustic parameters of a test environment, subject information input, operation training, a detection module, an experiment notice and sending of experiment data to the server 2;
collecting acoustic parameters of the test environment, and acquiring background noise of the test environment in real time and judging whether an experiment is proper or not; reminding the user of unsuitable experiments when the background noise is greater than 40dB, and suggesting to select and judge whether the experiments are suitable; testing; subsequent steps may be performed when the background noise is not greater than 40dB, and the experimental condition is determined to be satisfied.
The subject information input is used for filling in registration information of a user on line, wherein the registration information of the user comprises names, ages, sexes, threshold hearing values, telephones and hearing situations;
operation training for familiarizing a subject with the operation of the APP client 1 and with a virtual spatial sound source;
the detection module is used for detecting and training the spatial positioning capability of the subject and simulating different noise environments through the background noise with different signal to noise ratios;
data transmission for transmitting the registration information, the sound source position selected by the subject, and the sound source actual position to the server 2 for storage;
experimental bulletins for informing experimental purposes. The experiment is based on the purpose of scientific research, data of different people for judging the azimuth of the horizontal plane sound source and required duration are collected, and the total duration of the experiment is about 90 minutes. Experiment place: selecting a quieter environment such as a noiseless bedroom or office as far as possible, and immediately stopping the experiment when dizziness and nausea occur;
the spatial hearing detection process of the APP client 1 is as follows:
1) APP client 1 provides a training sound source to familiarize the subject with virtual sounds in space;
2) Randomly playing a virtual sound at a certain position in the horizontal direction, wherein the virtual sound source is a detection sound source in the detection module;
3) The subject selects a sensing position on the interface of the APP client 1, and the APP client 1 automatically records the selected position and the real position information and sends the data to the server 2 for storage.
When the user uses the device, the user first knows the basic information of the experiment through the experiment bulletin, so that the subject has a certain mind to prepare and select a proper place (such as a noise-free bedroom or office) to improve the accuracy of the result. The acquisition of the acoustic parameters of the test environment can remind the test subject whether the background noise of the test environment is suitable for the experiment (the background noise is not suitable for the experiment when the background noise is more than 40 dB), so that the reliability of the test result is ensured. By entry of the personal related information a memory address of the user is formed in the server 2 for storing the data synchronously uploaded by the user. The operation training before the beginning of the formal experiment is to help the user to be familiar with the operation method of the software, feel the direction of the virtual sound source played through the earphone, and provide a familiar process before the beginning of the experiment. In the detection module, the test scheme of different signal to noise ratios can be selected by the subject, and the positioning capability under the background noise with different intensities is detected. And through data transmission, the collected data information is stored in real time, so that the subsequent downloading analysis is convenient.
The position selection interface of the APP client 1 is shown in fig. 2, the middle of the turntable is the position of a person, the peripheral turntable is a scale for describing a circle of people on the horizontal plane, 3 degrees are used as intervals, and the position where the upper 0 degrees are located is the right front. When a subject perceives a sound source in a certain direction, a small circle on the frequency screen rotating disc is dragged to a perception direction, the current angle below the character can display the selected degree in real time, the precision is 1 degree, and a confirmation or return interface can also appear after the hand is loosened. The sense direction may be reselected to prevent misconnection if the selection is returned, and the selected data saved to the next signal test if the selection is determined.
The server 2 comprises a data receiving and storing module, wherein the data receiving is mainly used for sorting received data, and particularly receiving registration information and position information sent by the APP client 1; and the storage module is used for storing the subject information and experimental data and storing the received selected position and the received real position of the subject in a list form.
The server 2 is used as a transfer station for data transmission between the APP client 1 and the computer terminal, can manage user information of the registration module, can save a list of data selected by a user of the detection module, and is convenient for later export.
The computer management terminal is used for managing subject information, replacing or deleting listening signals, downloading analysis experiment data and experiment error correction; the system specifically comprises an information management module, an audio management module, a result summarizing module and a safety management module, wherein:
the information management is used for managing subject information, including name, gender, age, hearing condition, bilateral pure tone threshold value and mobile phone number, and can modify places with errors and perform experimental detection and error correction;
audio management, which is used for replacing or deleting audio required by the APP;
results are summarized and used for counting experimental data of each subject, and are convenient to derive and analyze. Summarizing and sorting the results of each subject, detecting whether the data are wrong, removing the data subjected to misoperation, and timely supplementing the missing data for experiments;
the safety management module is used for guaranteeing the safety of the subject data;
in order to ensure the safety of the experimental data of the subject, after the management client 3 logs in through the password, an administrator can check the experimental data of the subject according to the date or name and delete or modify the errors in the experiment. The sound source file stored on the server 2 can be replaced or deleted according to the need, and positioning experiments under other conditions, such as frequency, loudness and positioning difference under personalized and non-personalized HRTF, are performed on the system of the invention.
Fig. 4 is a schematic diagram of a virtual free field sound image, and according to signal and system theory, the process of sound propagation can be regarded as a linear time-invariant system, wherein the sound source signal is input, the sound signal of the left ear or the right ear is output, and the HRTF is the transfer function of the linear time-invariant system. Thus, the sound signal at the human ear can be synthesized by convolving (or multiplying) the sound source signal and the HRTF in the time domain. One sound source in space corresponds to a pair of HRTF data (one for each of the left and right ears); different spatial orientations correspond to different HRTF pairs. In binaural signal synthesis, acoustic events from different spatial orientations can be simulated by convolving HRTFs of different orientations with the sound source signal. Since binaural signals contain the main information of the sound, the listener can create a subjective sensation as if they were in a particular acoustic environment by manually simulating the binaural signals and playing them back with headphones or speakers.
Frequency domain signal E of single path 0 Filtering with a pair of HRTFs, resulting in a binaural signal:
wherein E is 0 Frequency domain signal of single path E L And E is R The left ear signal and the right ear signal are respectively, and r represents the distance between a sound source and the center of the head, namely the distance between the origin of coordinates of the sound source and the origin of coordinates of the center of the head; the azimuth angle theta is the included angle between the projection of the direction vector of the origin of the head center coordinate to the sound source S on the horizontal plane and the y axis, and the value range of theta is more than or equal to 0 degree and less than or equal to 360 degrees; elevation angleIs the included angle between the sound source direction vector and the horizontal plane, and the value range is +.>f represents the sound source frequency, a represents the physiological structure parameter, the parameter comprises the shape and the size of the physiological structure of the head and the trunk, and a is different among different individuals.
The convolution process of this embodiment is: reading time domain data from an HRTF database, and outputting a single-channel frequency domain signal E 0 Multiplying a pair of HRTFs in space to obtain binaural signal E at corresponding position L 、E R And then the double-channel signals are fed back to the left ear and the right ear respectively through the replay of the loudspeaker, so that the subject generates a space hearing sense. Determining position by subjective determination, at boundarySelecting a corresponding position on the surface; the HRTF database is the basis for virtual sound synthesis.
The flow of the spatial hearing test is shown in fig. 5, and before starting the test, the user selects a comfortable sound volume on the APP client 1 according to his hearing situation, so as to perform the test in the best state.
Before the detection is started, an operation training process is further provided, so that a user can know an experiment flow and how to use the flat panel selection points, and the operation method is suitable for the operation of a virtual sound source and familiar with an APP client 1 interface.
The detection function of the APP client 1 is realized through a detection module, wherein the detection module comprises four detection sound sources, namely pure tones and pure tones with signal to noise ratios of 0, 5 and 10, wherein the pure tones comprise background noise, and the detection function is used for simulating the environmental noise with different intensities. The subject may select four detected sound sources.
Each group of detected sound sources contains 24 virtual sounds in different directions, 24 sound fragments A1-A24 are divided into 24 sound fragments A1-A24 at 15-degree intervals in a circle 360 degrees, then a random sequence is generated, each fragment of the 24 sound fragments A1-A24 is contained in the random sequence, sound playing is carried out according to the random sequence, and a user can repeatedly play the sound until selection is made on the interface of the APP client side 1, and the selection position and the actual position of the sound source are synchronized into the server 2 in real time.
After one detection sound source is selected, the system of the invention judges whether the group of all sound fragments and the four groups of detection sound sources are finished, when the selected group of sound fragments are not finished, the rest fragments are continuously played, when the group of all sound fragments are finished, the system judges whether the four groups of detection sound sources are all finished, if not finished, the system selects the group of non-played sound sources to continue the experiment until the detection is finished.
After the detection is finished, the user can acquire a detection result, mainly the position data input by the user and the corresponding real position data through the management client 3, and can timely master the hearing situation of the user through the comparison of the two.
The system can be used as a platform for controlling sound source playing and result discrimination (coordinate point selection). Whether modifying the audio signal stored in the server 2 or performing experiments related to sound source localization by using a speaker, the system can be used as a controller to control the audio device to play the audio signal and then perform a point selection operation on the interface, as shown in fig. 2. Compared with the traditional sound source positioning test method, the test method not only can improve the experimental efficiency and reduce the manpower investment, but also can reduce the influence of human factors on the result.
According to the embodiment, the system can be used for detecting the space hearing of people in need at any time and any place, has high efficiency and low cost, is easy to popularize, and enables users with hearing problems to find out and take corresponding treatment measures early. The whole system is simple to operate, the page is clear, and a new user can be applied proficiently after simple training. Compared with the traditional laboratory loudspeaker array, the loudspeaker array has the advantages that the user does not need to be limited to a specific place and has great convenience in use.
The foregoing detailed description of the preferred embodiments of the invention will be understood to be merely illustrative of the presently preferred embodiments of the invention, and it is to be understood that the invention is not limited to the specific embodiments disclosed, as various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims.

Claims (7)

1. The sound source space positioning capability detection system based on the APP comprises an APP client, a server and a computer management terminal, wherein the APP client is in communication connection with the computer management terminal through the server;
collecting acoustic parameters of the test environment, and acquiring background noise of the test environment in real time and judging whether an experiment is proper or not;
entering subject information includes filling in registration information of a user on line, wherein the registration information of the user includes name, age, gender, threshold of hearing, telephone and hearing condition;
operation training for familiarizing a subject with the operation of an APP client and with a virtual spatial sound source;
the detection module is used for providing space hearing detection and operation training sound sources and simulating different noise environments through background noise with different signal to noise ratios;
data transmission, which is used for transmitting the registration information and the sound source position information to a server for storage;
the server is used for sorting the received data, storing the position selected by the received subject and the real position of the virtual space sound source in a list form, and taking the position as a transfer station for data transmission between the APP client and the computer management terminal;
the computer management terminal is used for managing subject information, replacing or deleting listening signals, downloading analysis experiment data and experiment error correction;
the sound propagation process of the APP client adopts a linear time-invariant system to process signals, the HRTF is used as a transmission function of the linear time-invariant system, filtering is carried out through the transmission function, and the obtained binaural signals are obtained:
wherein E is 0 Frequency domain signal of single path E L And E is R The left ear signal and the right ear signal are respectively, and r represents the distance between a sound source and the center of the head, namely the distance between the origin of coordinates of the sound source and the origin of coordinates of the center of the head; the azimuth angle theta is the included angle between the projection of the direction vector of the origin of the head center coordinate to the sound source S on the horizontal plane and the y axis, and the value range of theta is more than or equal to 0 degree and less than or equal to 360 degrees; elevation angleIs the included angle between the sound source direction vector and the horizontal plane, and the value range is +.>f represents sound source frequency, a represents physiological structure parameters, the parameters comprise the shape and the size of physiological structures of the head and the trunk, and a is different among different individuals; the spatial hearing detection process of the APP client is as follows:
1) Providing a training sound source to familiarize the subject with virtual sounds in space;
2) Randomly playing virtual sound at a certain position in the horizontal direction, wherein the virtual sound is a detection sound source in the detection module;
3) And the subject selects a perception position on an APP client interface, and the APP client automatically records the selected position and the real position information of the virtual sound and sends the data to a server for storage.
2. The APP-based sound source spatial positioning capability detection system of claim 1, wherein determining whether an experiment is appropriate is specifically: when the background noise is larger than a set value, the APP client reminds that the experiment is not suitable, and suggests to select a quiet environment for testing; and when the background noise is not larger than the set value, judging that the experimental condition is satisfied.
3. The APP-based sound source spatial positioning capability detection system of claim 1, wherein the APP client further comprises an experimental bulletin including notification of the purpose of the experiment, the duration of the experiment required, the approach taken by the subject in the untimely manner, and the experimental location.
4. The APP-based sound source spatial location capability detection system of claim 1 wherein said server comprises a data receiving and storage module;
the data receiving is used for receiving registration information and position information sent by the APP client;
and the storage module is used for storing the subject information and experimental data, storing the received selected position of the subject and the real position of the virtual sound in a list form.
5. The APP-based sound source spatial positioning capability detection system of claim 1, wherein the computer management terminal specifically comprises an information management, audio management, result summarization, security management module, wherein:
information management, which is used for realizing management, experimental detection and error correction of subject information;
audio management, which is used for replacing or deleting the audio required by the APP client;
the result summarization is used for counting experimental data of each subject, and is convenient to derive and analyze;
and the safety management module is used for guaranteeing the safety of the subject data.
6. The APP-based sound source spatial localization capability detection system of claim 1, wherein the detection module comprises four detection sound sources, which are pure tones, and pure tones with signal-to-noise ratios of 0, 5, and 10, respectively, and containing background noise.
7. The APP-based sound source spatial positioning capability detection system of claim 6, wherein each detected sound source has 24 sound segments, each sound segment representing a virtual sound of a different orientation.
CN201910685380.XA 2019-07-27 2019-07-27 Sound source space positioning capability detection system based on APP Active CN110544532B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910685380.XA CN110544532B (en) 2019-07-27 2019-07-27 Sound source space positioning capability detection system based on APP

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910685380.XA CN110544532B (en) 2019-07-27 2019-07-27 Sound source space positioning capability detection system based on APP

Publications (2)

Publication Number Publication Date
CN110544532A CN110544532A (en) 2019-12-06
CN110544532B true CN110544532B (en) 2023-07-18

Family

ID=68710304

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910685380.XA Active CN110544532B (en) 2019-07-27 2019-07-27 Sound source space positioning capability detection system based on APP

Country Status (1)

Country Link
CN (1) CN110544532B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111372167B (en) * 2020-02-24 2021-10-26 Oppo广东移动通信有限公司 Sound effect optimization method and device, electronic equipment and storage medium
CN112168177A (en) * 2020-09-10 2021-01-05 首都医科大学附属北京朝阳医院 Method for testing sound source positioning capability, tester terminal and tester terminal
CN112190259A (en) * 2020-09-10 2021-01-08 首都医科大学附属北京朝阳医院 Method for testing sound source positioning capability, tester terminal and tester terminal
CN113180649A (en) * 2021-05-06 2021-07-30 北京百特声学科技有限公司 Sound source direction identification test system
CN113520377B (en) * 2021-06-03 2023-07-04 广州大学 Virtual sound source positioning capability detection method, system, device and storage medium
CN115460526B (en) * 2022-11-11 2023-03-28 荣耀终端有限公司 Method for determining hearing model, electronic equipment and system

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0868830A4 (en) * 1995-12-20 2006-03-22 K S Himpp Virtual electroacoustic audiometry for unaided, simulated aided, and aided hearing evaluation
JP2004065734A (en) * 2002-08-08 2004-03-04 National Institute Of Advanced Industrial & Technology Mobile audiometer
CN101266593A (en) * 2008-02-25 2008-09-17 北京理工大学 Voice and audio frequency quality subjective evaluation method based on network opinion collection
CN102572676B (en) * 2012-01-16 2016-04-13 华南理工大学 A kind of real-time rendering method for virtual auditory environment
CN103237287B (en) * 2013-03-29 2015-03-11 华南理工大学 Method for processing replay signals of 5.1-channel surrounding-sound headphone with customization function
US9326706B2 (en) * 2013-07-16 2016-05-03 iHear Medical, Inc. Hearing profile test system and method
GB2535990A (en) * 2015-02-26 2016-09-07 Univ Antwerpen Computer program and method of determining a personalized head-related transfer function and interaural time difference function
CN106491081B (en) * 2016-09-28 2019-12-03 北京大学 It is a kind of based on the sense of hearing-spatial match method Alzheimer's disease patient's screening system
CN106846211A (en) * 2017-03-20 2017-06-13 上海交通大学医学院附属第九人民医院 Children's universal newborn hearing screening system based on Internet of Things
CN107292789A (en) * 2017-05-16 2017-10-24 广州嘿麦医疗科技有限公司 Artificial cave infant is assessed and APP systems are applied in training
EP3413589B1 (en) * 2017-06-09 2022-11-16 Oticon A/s A microphone system and a hearing device comprising a microphone system
CN107569236B (en) * 2017-09-06 2020-03-06 杨捷 Multifunctional hearing test and hearing aid system and hearing test method thereof
CN107647874A (en) * 2017-11-06 2018-02-02 南京萌宝睿贝心理咨询有限公司 A kind of method of child attention evaluation and test and training
CN109998553B (en) * 2019-04-29 2022-04-19 天津大学 Parametric detection system for auditory space positioning capability and method for minimum audible angle

Also Published As

Publication number Publication date
CN110544532A (en) 2019-12-06

Similar Documents

Publication Publication Date Title
CN110544532B (en) Sound source space positioning capability detection system based on APP
Middlebrooks Virtual localization improved by scaling nonindividualized external-ear transfer functions in frequency
US9055382B2 (en) Calibration of headphones to improve accuracy of recorded audio content
Stitt et al. Auditory accommodation to poorly matched non-individual spectral localization cues through active learning
CN105578379B (en) Device and method for generating the output signal at least two output channels
Olive et al. The effects of loudspeaker placement on listener preference ratings
US9769585B1 (en) Positioning surround sound for virtual acoustic presence
Lindau Binaural resynthesis of acoustical environments: technology and perceptual evaluation
US11595766B2 (en) Remotely updating a hearing aid profile
TW202028929A (en) Spatial repositioning of multiple audio streams
Menzer et al. Investigations on an early-reflection-free model for BRIRs
Geronazzo et al. Auditory navigation with a tubular acoustic model for interactive distance cues and personalized head-related transfer functions: An auditory target-reaching task
JP2022130662A (en) System and method for generating head transfer function
Pausch et al. Localization performance in a binaural real-time auralization system extended to research hearing aids
Lelo de Larrea-Mancera et al. Remote auditory assessment using Portable Automated Rapid Testing (PART) and participant-owned devices
del Solar Dorrego et al. A study of the just noticeable difference of early decay time for symphonic halls
Crispien et al. Evaluation of the-cocktail-party effect-for multiple speech stimuli within a spatial auditory display
Sivonen et al. Binaural loudness for artificial-head measurements in directional sound fields
Lindau Binaural resynthesis of acoustical environments
Gupta et al. Study on differences between individualized and non-individualized hear-through equalization for natural augmented listening
Müller et al. Perceptual differences for modifications of the elevation of early room reflections
Evans et al. Perceived performance of loudspeaker-spatialized speech for teleconferencing
Hiipakka et al. Localization in binaural reproduction with insert headphones
Griesinger Accurate reproduction of binaural recordings through individual headphone equalization and time domain crosstalk cancellation
US20240015462A1 (en) Voice processing system, voice processing method, and recording medium having voice processing program recorded thereon

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant