CN112164442A - Language disorder training system - Google Patents
Language disorder training system Download PDFInfo
- Publication number
- CN112164442A CN112164442A CN202010909960.5A CN202010909960A CN112164442A CN 112164442 A CN112164442 A CN 112164442A CN 202010909960 A CN202010909960 A CN 202010909960A CN 112164442 A CN112164442 A CN 112164442A
- Authority
- CN
- China
- Prior art keywords
- target
- game
- difficulty
- value
- processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012549 training Methods 0.000 title claims abstract description 78
- 208000011977 language disease Diseases 0.000 title claims abstract description 29
- 230000009471 action Effects 0.000 claims abstract description 48
- 230000004888 barrier function Effects 0.000 claims abstract description 14
- 238000004364 calculation method Methods 0.000 claims description 5
- 230000002452 interceptive effect Effects 0.000 claims 2
- 238000011156 evaluation Methods 0.000 abstract description 9
- 238000000034 method Methods 0.000 abstract description 8
- 230000008569 process Effects 0.000 abstract description 8
- 230000000694 effects Effects 0.000 abstract description 7
- 238000005070 sampling Methods 0.000 description 15
- 238000004891 communication Methods 0.000 description 8
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 5
- 239000010931 gold Substances 0.000 description 5
- 229910052737 gold Inorganic materials 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 235000013399 edible fruits Nutrition 0.000 description 4
- 238000013500 data storage Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 241000289581 Macropus sp. Species 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000002420 orchard Substances 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 235000019640 taste Nutrition 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4803—Speech analysis specially adapted for diagnostic purposes
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/54—Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Acoustics & Sound (AREA)
- Public Health (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Biophysics (AREA)
- Medical Informatics (AREA)
- Primary Health Care (AREA)
- Epidemiology (AREA)
- Physical Education & Sports Medicine (AREA)
- Computational Linguistics (AREA)
- Human Computer Interaction (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Veterinary Medicine (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention discloses a language barrier training system, which comprises: the voice acquisition equipment is used for acquiring user voice information; the processor is used for converting the user voice information into a corresponding target game action instruction and sending the target game action instruction to the controller; the controller is used for controlling a target object in the target game to execute a corresponding target action according to the target game action instruction; and the display is used for performing display operation on the game interface of the target object executing the target action. By applying the technical scheme provided by the embodiment of the invention, the target game is introduced into the language disorder training of the user, so that the user is willing to train, the boring and mechanical training process is avoided, the user is attracted to voluntarily train by self, and the evaluation training effect of the language disorder is improved.
Description
Technical Field
The invention relates to the field of medical equipment, in particular to a language disorder training system.
Background
When a patient with language disorder is evaluated and trained, whether the pronunciation of the patient is standard or not and whether the semantic expression is accurate or not need to be judged.
At present, when a patient carries out language disorder training in a hospital, one mode is that a doctor accompanies the patient in the whole course, and the other mode is that a voice recognition technology is adopted to replace the doctor to accompany the patient for evaluation and judgment. However, the simple question answering and question answering process is tedious and mechanical, the language disorder disease has the characteristics of slow recovery and long recovery time, the patient is difficult to insist on training, and the training effect is not high.
In summary, how to effectively solve the problems of the existing language disorder training mode, such as boring and mechanical training process, difficult consistent training of patients, and low training effect, is a problem which needs to be solved urgently by technical personnel in the field at present.
Disclosure of Invention
The invention aims to provide a language disorder training system, which gets rid of the tediousness and the mechanicalness of the training process, attracts users to be capable of training voluntarily by self, and improves the evaluation training effect of language disorders.
In order to solve the technical problems, the invention provides the following technical scheme:
a language barrier training system comprising:
the voice acquisition equipment is used for acquiring user voice information;
the processor is used for converting the user voice information into a corresponding target game action instruction and sending the target game action instruction to the controller;
the controller is used for controlling a target object in a target game to execute a corresponding target action according to the target game action instruction;
and the display is used for displaying and operating a game interface for executing the target action on the target object.
In a specific embodiment of the present invention, the processor is further configured to analyze the user voice information to obtain preset voice parameters; acquiring weight parameters corresponding to the preset sound parameters respectively; according to each weight parameter, performing weighted calculation on each preset sound parameter to obtain target training difficulty; converting the target training difficulty into a target game difficulty; and adjusting the difficulty of the target game according to the difficulty of the target game.
In a specific embodiment of the present invention, the processor is specifically configured to obtain a current game difficulty level; calculating a target difficulty difference value between the target game difficulty and the current game difficulty; calculating a target proportion value of the target difficulty difference value in the current game difficulty; when the absolute value of the target proportion value is higher than a preset proportion value, performing multiplication operation on the current game difficulty and the target proportion value to obtain target adjustment difficulty; summing the current game difficulty and the target adjustment difficulty to obtain an actual game difficulty; and adjusting the target game to the actual game difficulty.
In a specific embodiment of the present invention, the processor is further configured to generate first bonus information when it is determined that the actual game difficulty is higher than the current game difficulty; sending the first reward information to the display;
the display is further used for displaying the first reward information.
In a specific embodiment of the present invention, the processor is further configured to invoke a target spoken language communication environment game when it is detected that the actual game difficulty exceeds a preset difficulty value; sending the target spoken interpersonal environment game to the display;
the display is also used for displaying a game interface corresponding to the target spoken language interpersonal environment game.
In a specific embodiment of the present invention, the voice collecting device is further configured to collect answer voice information of the user participating in the target spoken language communication environment game;
further comprising:
the voice recognition equipment is used for recognizing the answering voice information to obtain a voice recognition result; sending the voice recognition result to the processor;
the processor is further used for generating second incentive information when the answer of the user is determined to be correct according to the voice recognition result; sending the second reward information to the display;
the display is also used for displaying the second reward information.
In a specific embodiment of the present invention, the processor is further configured to, when it is determined that the absolute value of the target proportion value is lower than the preset proportion value, maintain the difficulty level of the target game as the current game difficulty level.
In an embodiment of the present invention, the processor is specifically configured to convert a target volume value into the target game action command; wherein the target volume value is one of the preset sound parameters.
In an embodiment of the present invention, the processor is specifically configured to convert a target sound intensity value into the target game action command; the target sound intensity value is one of the preset sound parameters.
In an embodiment of the present invention, the processor is specifically configured to convert the target duration value into the target game action command; the target sound length value is one of the preset sound parameters.
The system provided by the embodiment of the invention comprises the following components: the voice acquisition equipment is used for acquiring user voice information; the processor is used for converting the user voice information into a corresponding target game action instruction and sending the target game action instruction to the controller; the controller is used for controlling a target object in the target game to execute a corresponding target action according to the target game action instruction; and the display is used for performing display operation on the game interface of the target object executing the target action. By introducing the target game into the language disorder training of the user, the user is willing to train, the boring and mechanical training process is avoided, the user is attracted to voluntarily train by self, and the language disorder evaluation training effect is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a block diagram of a language barrier training system according to an embodiment of the present invention;
FIG. 2 is a block diagram of another language barrier training system according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the disclosure, the invention will be described in further detail with reference to the accompanying drawings and specific embodiments. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The first embodiment is as follows:
referring to fig. 1, fig. 1 is a block diagram illustrating a language disorder training system according to an embodiment of the present invention, where the system may include:
the voice acquisition equipment 1 is used for acquiring user voice information;
the processor 2 is used for converting the user voice information into a corresponding target game action instruction and sending the target game action instruction to the controller 3;
the controller 3 is used for controlling a target object in the target game to execute a corresponding target action according to the target game action instruction;
and the display 4 is used for performing display operation on a game interface of the target object executing the target action.
The embodiment of the invention provides a language disorder training system, which comprises a voice acquisition device 1, a processor 2, a controller 3 and a display 4. And the voice acquisition equipment 1 is used for acquiring the voice information of the user. And the processor 2 is used for converting the user voice information into a corresponding target game action instruction and sending the target game action instruction to the controller 3. And the controller 3 is used for controlling a target object in the target game to execute a corresponding target action according to the target game action instruction. And the display 4 is used for performing display operation on a game interface of the target object executing the target action.
For example, the processor 2 may extract a volume value from the user voice information, and convert the volume value into an instruction of the moving amplitude or distance of the target object in the target game; or extracting the sound intensity value from the user sound information, and converting the sound intensity value into an instruction of the moving amplitude or distance of the target object in the target game; and extracting a voice length value from the voice information of the user, and converting the voice length value into an instruction of the moving amplitude or distance of the target object in the target game. The controller 3 controls the target object in the target game to move by a corresponding magnitude or distance. The display 4 displays a game interface in which the target object moves by a corresponding magnitude or distance in the target game.
Specifically, for example, the pronunciation of the language disorder user is trained, the purpose is to make the language disorder user speak loudly, the pronunciation is simple to a certain vowel or only needs to be done with voice, and by collecting the voice information of the language disorder user, the larger the volume is, the higher the fountain in the target game is sprayed, or the higher a kangaroo is bounced, and the like, the language disorder user is attracted to continue to pronounce. By introducing the intelligent mini game to the evaluation training process, language disorder users can be attracted to insist on language disorder training, and the evaluation training interest of the language disorder users is improved.
The system provided by the embodiment of the invention comprises the following components: the voice acquisition equipment is used for acquiring user voice information; the processor is used for converting the user voice information into a corresponding target game action instruction and sending the target game action instruction to the controller; the controller is used for controlling a target object in the target game to execute a corresponding target action according to the target game action instruction; and the display is used for performing display operation on the game interface of the target object executing the target action. By introducing the target game into the language disorder training of the user, the user is willing to train, the boring and mechanical training process is avoided, the user is attracted to voluntarily train by self, and the language disorder evaluation training effect is improved.
In a specific embodiment of the present invention, the processor 2 is further configured to analyze the user voice information to obtain each preset voice parameter; acquiring weight parameters corresponding to the preset sound parameters respectively; according to the weight parameters, carrying out weighted calculation on the preset sound parameters to obtain target training difficulty; converting the target training difficulty into a target game difficulty; and adjusting the difficulty of the target game according to the difficulty of the target game.
The processor 2 provided by the embodiment of the present invention is further configured to analyze the user voice information to obtain each preset voice parameter, such as a volume value, a sound intensity value, and a sound length value. The weighting parameters corresponding to the preset sound parameters are preset, and if the preset sound parameters are set to be 60% in volume weight, 20% in sound intensity weight and 20% in sound length weight, the weighting parameters corresponding to the preset sound parameters are obtained. And according to the weight parameters, performing weighted calculation on the preset sound parameters to obtain target training difficulty, converting the target training difficulty into target game difficulty, and performing difficulty adjustment on the target game according to the target game difficulty.
For example, shooting, grabbing dolls and other small clearance-passing games, different training contents are divided into different levels according to difficulty, and training questions are integrated into the games from easy to difficult, so that users with language barriers can train in the games. For example: the shooting training can not only improve the concentration of the user with language barrier, but also improve the abilities of directionality, hand-eye coordination and the like. The simple checkpoint can set the target to be a little larger and the moving speed to be a little slower, and the larger the difficulty is, the smaller the target is, and the larger the moving speed is. The difficulty of the corresponding training questions is also increased, for example, the syllable pinyin is read with the beginning, and the syllable syllables, the whole syllables, the double-word, the three-word, the sentence short texts are increased gradually.
In addition, similar to the training difficulty adjustment mode, the training duration may be adjusted accordingly, which is not described in detail in the embodiments of the present invention.
The game difficulty and the game duration of the target game are gradually adjusted according to the pronunciation condition of the user. And when training next time, the system automatically selects a matched game from the games set by the system to continue training according to the game name, the target game difficulty and the target game duration in the last training record. The game difficulty is adjusted according to the pronunciation condition of the user, so that the training difficulty is adjusted, the user is attracted to voluntarily carry out continuous training, and the language barrier assessment training effect is improved.
It should be noted that, when training begins, it is determined whether there is a training record, and no training record exists, first training parameters are generated according to system settings, and a game is opened and parameters are transmitted to the smart game to begin training.
In one embodiment of the present invention, the processor 2 is specifically configured to obtain a current game difficulty level; calculating a target difficulty difference value between the target game difficulty and the current game difficulty; calculating a target proportion value of the target difficulty difference value in the current game difficulty; when the absolute value of the target proportion value is higher than the preset proportion value, performing product operation on the current game difficulty and the target proportion value to obtain target adjustment difficulty; summing the current game difficulty and the target adjustment difficulty to obtain the actual game difficulty; and adjusting the target game to the actual game difficulty.
The processing is specifically used for obtaining the current game difficulty; and calculating a target difficulty difference value between the target game difficulty and the current game difficulty, and calculating a target proportion value of the target difficulty difference value in the current game difficulty. And presetting a proportional value as a boundary condition for adjusting whether the game difficulty is carried out, and when the absolute value of the target proportional value is higher than the preset proportional value (namely the target proportional value can be a positive number or a negative number), carrying out product operation on the current game difficulty and the target proportional value to obtain the target adjustment difficulty. And summing the current game difficulty and the target adjustment difficulty to obtain the actual game difficulty, and adjusting the target game to the actual game difficulty. Through setting the preset proportion value, the preset proportion value is used as a boundary condition for judging whether the game difficulty is required to be adjusted or not, namely whether the training difficulty is required to be adjusted or not, so that the game difficulty and the training difficulty are prevented from being adjusted too frequently, and the system performance is improved.
It should be noted that the preset proportional value may be set and adjusted according to actual conditions, which is not limited in the embodiment of the present invention.
In one embodiment of the present invention, the processor 2 is further configured to generate first bonus information when it is determined that the actual game difficulty is higher than the current game difficulty; sending the first reward information to the display 4;
and the display 4 is also used for displaying the first reward information.
The processor 2 is further configured to, when it is determined that the actual game difficulty is higher than the current game difficulty, indicate that the game difficulty is increased, that is, the training difficulty is increased, generate first bonus information, and send the first bonus information to the display 4, where the display 4 performs a display operation on the first bonus information. If the game difficulty is increased by a preset proportion value, the number of the gold coins is correspondingly increased, when the game difficulty is determined to be increased, the corresponding gold coins of the user are rewarded, and the total number of the accumulated gold coins can be further calculated. The user is rewarded after the game difficulty is increased, namely the training difficulty is increased, so that the user is encouraged to voluntarily carry out continuous training by self, and the evaluation training interest of the language disorder user is improved.
In a specific embodiment of the present invention, the processor 2 is further configured to invoke a target spoken language communication environment game when it is detected that the actual game difficulty exceeds a preset difficulty value; sending the target spoken language interplay environment game to the display 4;
and the display 4 is also used for displaying and operating a game interface corresponding to the target spoken language interpersonal environment game.
A game difficulty value is preset to be used as a trigger condition for calling the target spoken language communication environment game. The processor 2 is also used for calling the target spoken language interpersonal environment game and sending the target spoken language interpersonal environment game to the display 4 when the actual game difficulty is detected to exceed the preset difficulty value. The display 4 is also used for displaying and operating a game interface corresponding to the target spoken language interpersonal environment game.
Presetting a theme set of a spoken interpersonal environment game, wherein the theme subset corresponding to different games is different, the theme content in each theme subset is different, the corresponding theme type is also different, each theme type is provided with a cartoon character name, such as a supermarket game, and each theme comprises a commodity name, a commodity classification, a commodity picture, a commodity introduction, a price, a characteristic and information (follow-up and purchase quantity) required to be responded by a user; the casino game comprises a project name, a project purpose, a play introduction, a gold coin number and information (repeated play introduction and action demonstration) needing user response; the orchard game comprises different fruits, the user knows the fruits, follows and reads the names of the fruits, introduces the tastes of the fruits and other related knowledge, and the spoken language communication ability of the user can be exercised through manual picking, price inquiry, price purchasing, calculation, payment and other modes. And different spoken language communication environment games can be switched back and forth according to the preference of the user.
By setting up the spoken language interpersonal environment game, the user is brought into the spoken language interpersonal environment that the user likes to carry out language obstacle training, the user is guided to communicate with cartoon characters in the game, and the spoken language expression ability and the interpersonal ability of the user are improved by communicating with different cartoon characters.
In a specific embodiment of the present invention, the voice collecting device 1 is further configured to collect answer voice information of the user participating in the target spoken language communication environment game;
the system may further comprise:
the voice recognition device 5 is used for recognizing the answering voice information to obtain a voice recognition result; sending the speech recognition result to the processor 2;
the processor 2 is further used for generating second reward information when the answer of the user is determined to be correct according to the voice recognition result; sending the second reward information to the display 4;
the display 4 is also used for displaying the second reward information.
The voice collecting device 1 is also used for collecting answering voice information of the user participating in the target spoken language communication environment game. Referring to fig. 2, fig. 2 is a block diagram of another language disorder training system according to an embodiment of the present invention, where the system may further include a speech recognition device 5, and the speech recognition device 5 is configured to recognize the answering speech information to obtain a speech recognition result, and send the speech recognition result to the processor 2. And the processor 2 is further configured to generate second incentive information when it is determined that the user answers the question correctly according to the voice recognition result, and send the second incentive information to the display 4. The display 4 is also used for displaying the second reward information. If the user says the correct payment amount in the supermarket for purchasing the article, the user is judged to answer the question correctly, and the number of the gold coins consumed by the user for purchasing the article is recovered to be used as second reward information for rewarding the user. The second reward information is displayed and operated through the display 4, the user is rewarded, the user is encouraged to voluntarily carry out continuous training, and the evaluation training interest of the language disorder user is improved.
In an embodiment of the present invention, the processor 2 is further configured to, when it is determined that the absolute value of the target proportion value is lower than the preset proportion value, maintain the difficulty level of the target game as the current game difficulty level.
The processor 2 is further configured to keep the difficulty of the target game as the current game difficulty when it is determined that the absolute value of the target proportion value is lower than the preset proportion value, and not punish the user when it is determined that the absolute value of the target proportion value is lower than the preset proportion value, thereby encouraging the user to continue training with patience.
In one embodiment of the present invention, the processor 2 is specifically configured to convert the target volume value into a target game action command; wherein, the target volume value is one of the preset sound parameters.
Each preset sound parameter includes a target volume value, and the processor 2 is specifically configured to convert the target volume value into a target game action instruction. The process of collecting the user voice information and obtaining the target volume value through the user voice information analysis may include: the microphone device is obtained by calling an operating system bottom layer interface, meanwhile, voice information of a user is recorded to form a voice file (wav file), and the voice file is opened to obtain voice Pulse Code Modulation (PCM) data. According to the audio PCM data storage format, the value of each sampling point is respectively accumulated from the PCM data according to the audio data storage format, the value is divided by the number of the sampling points to obtain the average sound energy value of one sampling, and then the average sound energy value is subjected to equal ratio quantization between 100 and 32767 to obtain a quantized value of 1-100. Generally, human voice is distributed in a lower energy range, so that quantized data are approximately distributed in a smaller interval of 1-20 times, the quantized data are amplified by 5 times, a value larger than 100 is calculated, the value is assigned to 100, and finally, all sampling average values are calculated to be target volume values.
It should be noted that, the one-time sampling refers to performing multiple continuous sampling on multiple sampling points, where the continuous sampling is that a sampling interval between two adjacent sampling points is smaller than a preset time length, and the preset time length may be set and adjusted according to an actual situation, which is not limited in the embodiment of the present invention.
In an embodiment of the present invention, the processor 2 is specifically configured to convert the target sound intensity value into a target game action command; the target sound intensity value is one of the preset sound parameters.
Each preset sound parameter comprises a target sound intensity value, and the processor 2 is specifically configured to convert the target sound intensity value into a target game action instruction. Taking the example of obtaining the volume value, the absolute value of the value of each sampling point is respectively accumulated from the PCM data (the negative number is converted into the positive number, the sound wave amplitude) and divided by the number of the samples to obtain the average value of the sound of one sampling, and finally the average value of the sound of all the samples is calculated, namely the sound intensity value.
In an embodiment of the present invention, the processor 2 is specifically configured to convert the target duration value into a target game action command; wherein, the target sound length value is one of the preset sound parameters.
Each preset sound parameter includes a target duration value, and the processor 2 is specifically configured to convert the target duration value into a target game action instruction. And taking an example of obtaining the volume value, counting from the condition that the average value of one sampling is not zero until the next value is zero, dividing the obtained number of sampling points by the sampling frequency to obtain the effective sound duration, and circulating all PCM data to convert the average effective sound duration into the target volume value.
The embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same or similar parts among the embodiments are referred to each other.
The principle and the implementation of the present invention are explained in the present application by using specific examples, and the above description of the embodiments is only used to help understanding the technical solution and the core idea of the present invention. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.
Claims (10)
1. A language barrier training system, comprising:
the voice acquisition equipment is used for acquiring user voice information;
the processor is used for converting the user voice information into a corresponding target game action instruction and sending the target game action instruction to the controller;
the controller is used for controlling a target object in a target game to execute a corresponding target action according to the target game action instruction;
and the display is used for displaying and operating a game interface for executing the target action on the target object.
2. A language disorder training system according to claim 1, wherein the processor is further configured to parse the user voice information to obtain preset voice parameters; acquiring weight parameters corresponding to the preset sound parameters respectively; according to each weight parameter, performing weighted calculation on each preset sound parameter to obtain target training difficulty; converting the target training difficulty into a target game difficulty; and adjusting the difficulty of the target game according to the difficulty of the target game.
3. A language barrier training system according to claim 2 wherein the processor is specifically configured to obtain a current game difficulty level; calculating a target difficulty difference value between the target game difficulty and the current game difficulty; calculating a target proportion value of the target difficulty difference value in the current game difficulty; when the absolute value of the target proportion value is higher than a preset proportion value, performing multiplication operation on the current game difficulty and the target proportion value to obtain target adjustment difficulty; summing the current game difficulty and the target adjustment difficulty to obtain an actual game difficulty; and adjusting the target game to the actual game difficulty.
4. A language barrier training system according to claim 3 wherein the processor is further configured to generate first reward information when it is determined that the actual game difficulty level is greater than the current game difficulty level; sending the first reward information to the display;
the display is further used for displaying the first reward information.
5. A language barrier training system according to claim 3, wherein the processor is further configured to invoke a target spoken interactive environment game when the actual game difficulty is detected to exceed a preset difficulty value; sending the target spoken interpersonal environment game to the display;
the display is also used for displaying a game interface corresponding to the target spoken language interpersonal environment game.
6. The language disorder training system of claim 5, wherein the voice collecting device is further configured to collect answer voice information of the user participating in the target spoken interactive environment game;
further comprising:
the voice recognition equipment is used for recognizing the answering voice information to obtain a voice recognition result; sending the voice recognition result to the processor;
the processor is further used for generating second incentive information when the answer of the user is determined to be correct according to the voice recognition result; sending the second reward information to the display;
the display is also used for displaying the second reward information.
7. A language barrier training system according to claim 3, wherein the processor is further configured to maintain the difficulty level of the target game as the current game difficulty level when it is determined that the absolute value of the target proportion value is lower than the preset proportion value.
8. A language handicap training system according to any one of claims 2 to 7, wherein the processor is specifically configured to convert a target volume value into the target game action command; wherein the target volume value is one of the preset sound parameters.
9. A language barrier training system according to any one of claims 2 to 7 wherein the processor is specifically configured to translate a target sound intensity value into the target game action command; the target sound intensity value is one of the preset sound parameters.
10. A language barrier training system according to any one of claims 2 to 7 wherein the processor is specifically configured to translate the target duration value into the target game action command; the target sound length value is one of the preset sound parameters.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010909960.5A CN112164442A (en) | 2020-09-02 | 2020-09-02 | Language disorder training system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010909960.5A CN112164442A (en) | 2020-09-02 | 2020-09-02 | Language disorder training system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112164442A true CN112164442A (en) | 2021-01-01 |
Family
ID=73857685
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010909960.5A Pending CN112164442A (en) | 2020-09-02 | 2020-09-02 | Language disorder training system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112164442A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114931747A (en) * | 2022-07-25 | 2022-08-23 | 深圳市景创科技电子股份有限公司 | Game controller and intelligent voice control method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104933278A (en) * | 2014-03-20 | 2015-09-23 | 中国科学院软件研究所 | Multi-channel interactive method and system used for speech disorder rehabilitation training |
| JP2019086742A (en) * | 2017-11-10 | 2019-06-06 | 株式会社レイトロン | Language function training system, apparatus, and program |
| CN110013594A (en) * | 2019-04-23 | 2019-07-16 | 王宁远 | Rehabilitation platform in a kind of hearing and speech intelligent rehabilitation equipment and line |
| CN110782962A (en) * | 2019-11-05 | 2020-02-11 | 杭州南粟科技有限公司 | Hearing language rehabilitation device, method, electronic equipment and storage medium |
| CN111091887A (en) * | 2019-08-27 | 2020-05-01 | 上海必问企业管理咨询有限公司 | Multi-element sensory sensation integrated training system |
-
2020
- 2020-09-02 CN CN202010909960.5A patent/CN112164442A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104933278A (en) * | 2014-03-20 | 2015-09-23 | 中国科学院软件研究所 | Multi-channel interactive method and system used for speech disorder rehabilitation training |
| JP2019086742A (en) * | 2017-11-10 | 2019-06-06 | 株式会社レイトロン | Language function training system, apparatus, and program |
| CN110013594A (en) * | 2019-04-23 | 2019-07-16 | 王宁远 | Rehabilitation platform in a kind of hearing and speech intelligent rehabilitation equipment and line |
| CN111091887A (en) * | 2019-08-27 | 2020-05-01 | 上海必问企业管理咨询有限公司 | Multi-element sensory sensation integrated training system |
| CN110782962A (en) * | 2019-11-05 | 2020-02-11 | 杭州南粟科技有限公司 | Hearing language rehabilitation device, method, electronic equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 司博宇: "基于声控游戏的儿童言语障碍康复系统设计", 《现代教育技术》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114931747A (en) * | 2022-07-25 | 2022-08-23 | 深圳市景创科技电子股份有限公司 | Game controller and intelligent voice control method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Gerosa et al. | A review of ASR technologies for children's speech | |
| Tahon et al. | Towards a small set of robust acoustic features for emotion recognition: challenges | |
| CN104732977B (en) | A kind of online spoken language pronunciation quality evaluating method and system | |
| Cen et al. | A real-time speech emotion recognition system and its application in online learning | |
| JP2021510851A (en) | Intelligent interaction methods, devices, computer devices and computer readable storage media | |
| CN105989842B (en) | The method, apparatus for comparing vocal print similarity and its application in digital entertainment VOD system | |
| US20150302866A1 (en) | Speech affect analyzing and training | |
| CN106851216A (en) | A kind of classroom behavior monitoring system and method based on face and speech recognition | |
| Kostoulas et al. | Affective speech interface in serious games for supporting therapy of mental disorders | |
| KR101973791B1 (en) | Method for correcting voice | |
| CN102426834A (en) | Method for testing rhythm level of spoken English | |
| AU2012200812B2 (en) | Measuring cognitive load | |
| Ming et al. | A Mandarin edutainment system integrated virtual learning environments | |
| CN115713875A (en) | Virtual reality simulation teaching method based on psychological analysis | |
| CN110652294B (en) | Creativity personality trait measuring method and device based on electroencephalogram signals | |
| CN112164442A (en) | Language disorder training system | |
| CN114916921A (en) | Rapid speech cognition assessment method and device | |
| CN108175426A (en) | A kind of lie detecting method that Boltzmann machine is limited based on depth recursion type condition | |
| TWI615796B (en) | Learning progress monitoring system | |
| Anjos et al. | Sibilant consonants classification comparison with multi‐and single‐class neural networks | |
| CN107452370A (en) | A kind of application method of the judgment means of Chinese vowel followed by a nasal consonant dysphonia patient | |
| Anjos et al. | A serious mobile game with visual feedback for training sibilant consonants | |
| CN114974312B (en) | Virtual human emotion generation method and system | |
| WO2022156974A1 (en) | Method, system and apparatus for measuring the cognitive load of a user | |
| CN108681412B (en) | Emotion recognition device and method based on array type touch sensor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210101 |
|
| RJ01 | Rejection of invention patent application after publication |