KR101276097B1 - Simulator and simulation method for treating adhd - Google Patents

Abstract

PURPOSE: A multi simulator for a developmental disorder treatment and a simulation method thereof are provided to cure developmental disorder through various simulations like sense, recognition, language and playing, as providing the same optimum simulation environment as an actual situation to a user who suffers from the developmental disorder. CONSTITUTION: A multi simulator for a developmental disorder treatment includes a display part, a user reaction monitoring device(41), an audio processing part, and a control part. The display part displays images. The user reaction monitoring device monitors the reaction of a user watching the images, and outputs information about the reaction of the user. The audio processing part receives and outputs the voice of the user through a microphone, and outputs an action induction guide voice according to contents through a speaker. The control part stores numerous contents for the developmental disorder treatment, and displays images of the selected contents on the display part, and outputs the action induction guide voice inducing the action of the user in correspondence to the images to the speaker through the audio processing part, and judges whether the user performs the induced action by analyzing the reaction of the user corresponding to the action induction guide voice by the information inputted from the user reaction monitoring device, and then performs a treatment according to the scenario of the contents. The display part comprises a sphere screen(31) and a projector(32). The sphere screen displays images, and the sphere shape thereof is bent up, down, right, and left. The projector projects the image data according to the scenario of the contents from the control part to the sphere screen with the form of light. The projector performs NLCD(Nonlinear Distortion Correction) so that the image is not distorted when the image is displayed on the sphere screen.

Description

Multiple simulator and simulation method for treating developmental disorders

The present invention relates to an apparatus and method for the treatment of developmental disorders, and more particularly, attention deficit hyperactivity disorder (ADHD) and developmental disorders (autism) (hereinafter referred to as ADHD, brain lesions and developmental disorders). It is used to collectively use the term "developmental disability" to provide users with the best simulation environment in real life and to train children through various simulations such as sensory, cognition, language, and play. The present invention relates to a multiple simulator and simulation method for the treatment of developmental disorders.

Development refers to the functional development process as it grows, usually a dynamic process that proceeds in a constant and predictable manner. A developmental disability does not refer to a specific disease or disorder, but refers to a case in which development to be performed at a corresponding age is not achieved, and the developmental screening test is 25% behind the normal expectation of the age. Overall developmental delay is a delay in two or more of the gross motor, fine motor, cognition, language, sociality and everyday life.

As described above, the developmental disorder is delayed compared with age, and thus can be improved by learning and learning with the body.

Therapeutic simulators are used to treat people with developmental disabilities suffering from these developmental disorders. In general, as a method for treating developmental disorders, a method for improving cognitive ability by providing visual and auditory stimuli, such as a previously filed Patent Registration No. 10-1008541, [a cognitive ability improving device for providing an auditory stimulus], and a display device are provided. Through the use of simulation to provide treatment, visual stimulation and physical vestibular stimulation to the brain, treatment, and drug inhalation are being applied.

However, the conventional apparatus for changing brain waves using visual and auditory stimuli supplies only a predetermined stimulus signal to a user to induce brain waves at a specific frequency, so it is difficult to improve cognitive ability by analyzing the user's state and training results. There was this.

In addition, the conventional treatment device using visual stimulation has a problem that it is not possible to immerse the developmentally disabled person under treatment because the image is displayed through a simple flat display screen.

In addition, the conventional developmental disorder treatment apparatus through the stimulation, there is a problem that can not improve the overall function, such as practical motor skills, cognitive ability, concentration and sociality can not induce the interaction of the developmental disorder.

The treatment method using the simulation device through the display device is mostly for simulation rather than treatment, and even for the treatment, treatment is performed only for a specific function because it provides treatment by the display of a simple image in the same way as the above-described visual stimulus. Most of them, there was a problem that can not immerse people with developmental disabilities into treatment.

Accordingly, an object of the present invention is to provide a user with a developmental disorder with an optimal simulation environment as in actual situations, and to train children through various simulations such as sensation, cognition, language, and play to develop and cure a developmental disorder. The present invention provides multiple simulators and simulation methods for treating disorders.

Multi-simulator for treatment of developmental disorders of the present invention for achieving the above object comprises: a display unit for displaying an image; A user response monitoring device for monitoring a user's response to view the image and outputting information on the user's response; An audio processor for receiving a user's voice through a microphone and outputting the voice, and outputting a behavior guidance voice according to content through a speaker; Stores a plurality of contents for treatment of developmental disorders, receives at least one or more of the contents selected, displays an image of the selected content on the display, guides the behavior of inducing a user's response in response to the image The voice is output to the speaker through the audio processor, and the response of the user corresponding to the image and the behavior guidance voice is analyzed by the information input from the user response monitoring device to determine whether the user has performed the induced action. It characterized in that it comprises a control unit for performing the treatment according to the scenario of the content.

The display unit may include: a spherical screen formed in a spherical shape curved up, down, left, and right to display an image; And a projector for irradiating image data according to a scenario of the content from the controller to the concrete screen as an image in the form of light.

The projector performs non-linear distortion correction (NLDC) so that the image is not distorted when the image is displayed on the spherical screen.

The therapeutic multiple simulator is characterized in that it further comprises a rider configured to sit the user.

The rider is one of a chair, a model horse, and a bicycle, and is characterized by being a replaceable type that can be replaced according to the contents of the contents. (Description: This part corresponds to the claims, and in the claims, " Etc. "is not available.

The content for treatment of developmental disabilities is a sense-integrated content for training the correlation between the user's sense of balance, vestibular stimulation, center of gravity, body movement and gaze, and consists of one shape of the horse and bicycle shape so that the user can sit A rider which is controlled and moves left, right, front, back, left and right; And a rider control unit configured to move left, right, front, rear, left and right under control according to the sensory integrated content of the controller.

The rider controller may include: a rider driver configured to control movement and inclination of the front, rear, left, and right directions of the rider; And a rider interface unit configured to receive operation data according to the rider's manipulation from the rider and output the manipulation data to the controller.

The controller may display an image according to the scenario of the sensory integrated content on the concrete screen and induce a user's behavior by outputting a balance and direction change guide voice that is a behavior guidance voice according to the scenario of the sensory integrated content. By analyzing the information on the user's response through the user response monitoring device, if the user fails to perform the induced action, the user may monitor the concrete screen and the speaker to improve the guided image and sound that may improve the user's motion and gaze. It is characterized by including a sensory integration training module to output through.

The user response monitoring apparatus may be a behavior photographing camera which photographs the body of the user, and the information may be image data photographed by the behavior photographing camera.

The content for treating a developmental disorder is cognitive content for training a user's cognitive ability, and the controller displays a tracking object on the concrete screen according to a scenario of the cognitive content, and then moves the tracking object. Outputs the movement and tracking guidance voice, which is the behavior guidance voice, which induces the gaze to track the object to be tracked, analyzes the information input from the user response monitoring device to track the user's gaze, Determining whether to track the tracking target object, which is an induced action, and if the tracking target object is not tracked, a cognitive training module for repeatedly moving the tracking target object and performing cognitive training for tracking the tracking target object of the user's eyes. It features.

The recognition module of the controller may display and guide the number of successes when the user gaze succeeds in tracking the tracking target object.

The apparatus for monitoring user response may be a gaze tracking camera for capturing the eyes of the user, and the information may be image data photographed by the gaze tracking camera.

The content for treating a developmental disability is a language education content for training a user's language ability, and the controller loads a pronunciation to be taught according to a scenario of the language education content and displays it on the concrete screen, and then the user for the pronunciation. Outputs a pronunciation guide voice for guiding a voice, and when the user speaks to the voice guide voice, simultaneously displays the shape of the user's mouth at the time of speech and the shape of the teacher's mouth for the pronunciation stored in advance. Displayed in, characterized in that it comprises a language training module for training the user's speech to match the mouth shape of the user and the teacher's mouth to match.

The language education module displays a word associated with the pronunciation when the mouth shape of the user and the teacher's mouth match, and then outputs a pronunciation guide voice for inducing a user's utterance for the pronunciation of the word. When the user speaks about the pronunciation of the word, the audio processor performs voice recognition to check whether the word is pronounced correctly. If the user pronounces the word correctly, the user pronounces the word correctly.

The user response monitoring apparatus may be a behavior photographing camera photographing a user's mouth, and the information may be image data photographing a user's mouth.

The simulator is characterized in that it further comprises a rider formed in a chair shape, having a vibrating speaker on the back and generating a vibration corresponding to the intensity and wavelength of the pronunciation guide voice through the vibrating speaker.

The rider further comprises a switch for turning on / off the vibrating speaker.

The content for treating a developmental disorder is game content for inducing a user's exercise and training a user's sociality, and the controller displays a game image of a selected game content on the concrete screen and moves the user in conjunction with the game image. It outputs a motion induction guidance voice to guide the user and analyzes the information input from the user response monitoring device to determine whether the user has acted in response to the motion induction, and induces success notification and continuous user motion according to the result. Characterized in that it comprises a game module.

The game is a touch game that touches the image displayed on the sphere screen, the user response monitoring device is a sensor for recognizing the position touched on the sphere screen, the information is the position information of the touched position It is done.

User response monitoring device, the sensor for detecting and outputting the touch position of the specific screen; An action photographing camera which outputs image data photographing a user's body; And a gaze tracking camera for outputting image data photographing the user's eyes.

In order to achieve the above object, the multi-simulation method for treating developmental disorder of the present invention includes: a content selection process of determining, by a controller, at least one selected content from among a plurality of contents for treating developmental disorder; A rider necessity determining step of determining, by a controller, whether the selected content is a content requiring a rider; A user response monitoring device setting process of setting, by the controller, a user response monitoring device according to whether the rider is required and the user's body; The control unit displays an image of the selected content on a display unit, and outputs a behavior guidance voice for inducing a user's response in response to the image to a speaker through an audio processor, and the user corresponding to the image and the behavior guidance voice. And a content execution process of analyzing a response based on information input from the user response monitoring device to determine whether the user has performed an induced action, and performing a treatment according to the scenario of the content.

The content selection process may include a simulation start determination step of checking whether a simulation start event occurs; A device initialization step of initializing the user response monitoring device; And a content selection step of selecting a content by displaying a content setting screen.

The simulation method may include: a rider initialization process of initializing a rider when it is determined that a rider is needed in the rider need determination process; And a user seating determination process of determining whether the user is seated on the rider.

The content selected in the content selection process is sensory integrated content, and the content execution process includes: a rider information obtaining step of loading rider information; An image display step of loading a driving image corresponding to the obtained rider information from a corresponding content and displaying the same on a concrete screen; A behavior derivation step of outputting a behavior guidance voice for inducing balance and direction change in stages in response to the displayed image; A user behavior analysis step of analyzing the image data input from the user response monitoring device and the input information input from the rider to analyze the behavior and gaze of the user corresponding to the induced image; An operation determining step of determining whether the user has acted in response to the induced video and audio; And if the user fails to perform an action corresponding to the induced video and audio, the user may improve the user's behavior by outputting an improved guided video and guided voice corresponding to the user's behavior and gaze, and then respond to the induced video and audio. If it is characterized in that it comprises a repetitive training step to perform the next step.

The content selected in the content selection process is cognitive content, and the content execution process includes: a tracking object display step of displaying a tracking object of the selected cognitive content on a specific screen; An action derivation step of outputting a movement and tracking guidance voice of the displayed tracking object; A user behavior analysis step of analyzing whether the user views and tracks the object to be tracked by analyzing image data photographing the eye of the user input through a gaze tracking camera to a user reaction monitoring device; And a notification step of notifying a user of whether the tracking target thing has been successfully tracked.

The notifying step may include a tracking success display step of counting the number of successes when tracking the tracking target object and displaying the counted number on the concrete screen to indicate the success or failure.

The notifying step may further include a final tracking success notification step of displaying the total number of successful tracking and the total number of tracking target objects together when the tracking of the tracking target object is completed.

The content selected in the content selection process is language education content, and the content execution process includes: a sound display step of loading a sound to be trained step by step from the language education content and displaying it on a specific screen; A pronunciation inducing step of outputting a pronunciation guide voice for inducing a pronunciation of the displayed sound; A behavior monitoring step of starting photographing a mouth of a user through a behavior photographing camera of a user response monitoring unit after the pronunciation inducing step and monitoring whether a user speaks through a microphone; A mouth shape comparison display step of capturing the user's mouth when the user speaks to the displayed sound and displaying the mouth mouth on the concrete screen together with the teacher mouth shape for the sound previously stored; And a pronunciation success determination step of determining whether or not the user's pronunciation success is determined by comparing the captured user's mouth shape with the teacher's mouth pattern.

The content execution process may include: a word pronunciation derivation step of outputting a pronunciation guide voice for deriving the utterance of the words after displaying at least one word for the successful sound when the pronunciation succeeds in the pronunciation success determination step; Checking whether a user's pronunciation of the word is input through the microphone and checking a user's pronunciation; A speech success determination step of checking whether the user pronounces the word correctly by voice recognition of the pronounced pronunciation when the user speaks about the word; And a success notification display step of writing the corresponding word in the writing column of the word when the utterance of the word is successful.

The content execution process may further include a vibration stimulation step of generating a vibration corresponding to the pronunciation guide voice by outputting the pronunciation guide voice to the vibration speaker of the rider in the pronunciation guide step.

The selected content is game content, and the game is a touch game for inducing a user to touch objects displayed on a sphere screen.

The present invention has the effect of improving the immersion of the developmental disabled and learning ability by applying the spherical screen to configure the optimal simulation environment as the actual situation.

In addition, the present invention, because the user with a developmental disability performs a simulation on the rider, inducing an action for manipulating the rider in response to the content has the effect of improving the learning ability and treatment performance of the user.

In addition, the present invention analyzes the user's behavior, gaze corresponding to the content of the simulation provided through the image taken by the camera, and analyzes the user's pronunciation through a microphone, etc., so that the user's wrong behavior, gaze and pronunciation It can be determined that has the effect of more clearly analyzing the user's response.

In addition, the user's response can be analyzed more clearly, thereby providing accurate content to the user, and providing a more accurate simulation (video, audio, etc.) of the user's wrong reaction, thereby improving the user's learning ability. It has an effect that can be made.

1 is a view showing the configuration of a multi-simulator for the treatment of developmental disorders according to the present invention.
2 is a view showing the configuration of a control device of a multi-simulator for the treatment of developmental disorders according to the present invention.
3 is a view showing riders that can be applied to the multi-simulator for the treatment of developmental disorders according to the present invention.
4 is a flowchart illustrating a multi-simulation method in a multi-simulator for treating a developmental disorder according to the present invention.
5 is a flowchart illustrating a sensory integration training method of a multiple simulation method according to an embodiment of the present invention.
6 is a view for explaining a sensory integration training method using a rider according to an embodiment of the present invention.
7 is a flowchart illustrating a cognitive training method of a multiple simulation method according to an embodiment of the present invention.
8 is a view showing an example of a cognitive training method according to an embodiment of the present invention.
9 is a flowchart illustrating a language teaching method of a multi-simulation method according to an embodiment of the present invention.
10 is a view showing an example of a language teaching method according to an embodiment of the present invention.
11 is a flowchart illustrating a play method of a multi-simulation method according to an embodiment of the present invention.
12 is a diagram showing examples of a play method according to an embodiment of the present invention.
13 is a view showing the configuration of a chair rider provided in a vibration speaker according to an embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings will be described the configuration and operation of the multi-simulator for the treatment of developmental disorders of the present invention and the simulation method in the multi-simulator.

1 is a view showing the configuration of a multi-simulator for the treatment of developmental disorders according to the present invention, Figure 3 is a view showing the riders that can be applied to the multi-simulator for the treatment of developmental disorders according to the present invention, Figure 13 is one of the present invention According to an embodiment, a diagram illustrating a configuration of a chair rider included in a vibrating speaker.

1, 3, and 13, the therapeutic multiple simulator of the present invention includes a control device 100, a concrete screen 31, a projector 32, a user response monitoring device 41, a microphone (MIC) ( 51, a speaker 52, and a rider 70.

The control device 100 of the present invention controls the overall operation of the various contents for the multi-simulation according to the present invention. The configuration and operation of the control device 100 will be described in detail with reference to FIG. 2 to be described later.

The screen 31 displays the image irradiated from the projector 32. Screen 31 of the present invention is a spherical surface of the image display surface as shown in Figure 1 so as to increase the immersion of the user, that is, the child, and the situation of the content displayed on the screen can feel the same as the actual situation (Spherical) The screen is applied.

The projector 32 receives the image data corresponding to the content from the control device 100, converts the image according to the degree of curvature of the screen so that it can be displayed without distortion on the concrete screen 31 to the concrete screen 31 Examine the converted image. The image displayed on the sphere screen 31 is corrected by a non-linear distortion correction (NLDC) method in order to display an image without distortion on the screen surface which is a sphere. However, the correction may be configured to be made in the control device 100. In this case, the projector 32 receives the corrected image data, converts it into an image in the form of light, and irradiates the concrete screen 31.

The speaker 52 outputs the guide voice corresponding to the content from the control device 100.

The user response monitoring device 41 monitors a user's behavior and gaze, and includes a sensor 42, a behavior photographing camera 43, and a gaze tracking camera 44. In detail, the sensor 42 recognizes a user's motion and movement. The sensor 42 may be a sensor for the user to recognize the touch position of the concrete screen 31 and output the recognized touch position information. The action photographing camera 43 photographs and outputs the entire body of the user, and the gaze tracking camera 44 photographs and outputs the user's eyes under the control of the control apparatus 100. The behavior photographing camera 43 and the gaze tracking camera 44 are PTZ (Pan / Tilt / Zoom) cameras.

The microphone 51 may be functionally included in the user response monitoring unit 40 by converting the pronunciation spoken by the user into an electrical signal and outputting the converted signal to the control device 100.

The rider 70 is a seat for the user to sit comfortably using the simulation, and may be configured in the form of a chair, a horse, a bicycle, and the like as shown in FIG. 3. However, the shape of the rider 70 may be configured in various ways depending on the content, it is not limited to the form of FIG. For example, the rider 70 may be configured as a horse-shaped seat as shown in (b) of FIG. 3 in order to have a feeling of riding on a horse when the riding content is executed, and bicycle content for training a sense of balance. When executed, it may be configured as a bicycle-shaped seat as shown in (c) of FIG. That is, the rider 70 is configured in harmony with the content of the content, and by creating a similar environmental conditions to make the user feel like a real situation. In addition, as shown in FIG. 13, the rider 70 vibrates the speaker 71 on the back of the chair rider 70 in order to create a realistic environmental condition for the user in the contents stimulating by the vibration, such as language education content. It may be configured to include). This is for the teacher or user teaching in the content to make the wavelength and trembling of the voice felt by the passenger's body when the character (syllable) is pronounced. For example, when you pronounce 'ah' and 'right', you can feel and understand that each syllable is different in intensity, wavelength, and vibration, and transmit the trembling from the vocal cords to your body. Improves learning performance by recognizing that the strength, wavelength and vibration of each syllable are different. The vibrating speaker 71 may be connected to a power source and configured to be turned on / off through a switch installed at an arbitrary position of the rider 70.

Hereinafter, the configuration and operation of the control device 100 will be described in detail with reference to FIG. 2.

2 is a view showing the configuration of a control device of a multi-simulator for the treatment of developmental disorders according to the present invention.

The control device 100 according to the present invention includes a control unit 10, an input unit 20, a display unit 30, a user response monitoring unit 40, an audio processing unit 50, and a rider control unit 60.

The input unit 20 may be a keyboard including a plurality of keys such as a number key, a character key, and a direction key, and outputs a key signal corresponding to a key pressed by a user or an administrator to the controller 10. In addition to the keyboard, the input unit 20 may further include user response means that may be configured as buttons for receiving a response in response to the content.

The display unit 30 may be configured of the concrete screen 31 and the projector 32 described in FIG. 1, or may be a separate CRT monitor or LCD monitor, etc. in addition to the concrete screen 31 and the projector 32. It may be configured to include all. However, in order to create a condition similar to the actual situation for the user, it may be desirable to apply the spherical screen 31 to the screen that the user sees. And it would be desirable to have a CRT monitor or LCD monitor available to the administrator.

The user reaction monitoring unit 40 is connected to the user reaction monitoring devices 41 to adjust the photographing direction of the behavior photographing camera 43 and the gaze tracking camera 44, and controls the image data photographed through the respective cameras. 10), and outputs the sensing data detected through the sensor 42 to the controller 10. In detail, the user reaction monitoring unit 40 is connected to the sensor 42 and receives the sensing signal from the sensor 42, converts the sensing data into the sensing data, and outputs the control unit 10 to the control unit 10 and the action photographing camera 43. ) And a camera tilting unit 46 for controlling the direction of the gaze tracking camera 44, and the image data captured by the behavior photographing camera 43 and the gaze tracking camera 44 to be processed by the controller 10. And an image processor 47 for outputting. In detail, the camera tilting unit 46 controls the pan, tilt, and zoom of the behavior photographing camera 43 and the gaze tracking camera 44 under the control of the controller 10. .

The audio processor 50 receives guide voice data such as a behavior guidance voice according to the content from the controller 10 and outputs it through the speaker 52, and an electrical signal is output through the microphone 51. Is converted into voice data and output to the control unit 10. In addition, the audio processor 50 recognizes the voice of the user input through the microphone 51 and outputs the voice to the controller 10.

The rider controller 60 controls the operation of the rider 70 under the control of the controller 10, and the rider interface unit 63 that outputs data input from the rider 70 to the controller 10. ). Specifically, the rider driver 62 drives a motor configured to move the rider 70 to control the rider in front, rear, left, right, and inclination. The rider interface unit 63 receives data corresponding to the operation of the rider 70 of the user who rides on the rider 70 and outputs the data to the controller 10. When the rider 70 is a bicycle, the data according to the manipulation may be left and right steering data, brake data, pedal rotation speed data, left and right tilt angle data of the bicycle, and the like. In addition, when the vibration speaker 71 is configured in the rider 70, the rider interface unit 63 is the same as the pronunciation guide voice from the controller 10, but receives voice data and converts it into an analog voice signal to convert the vibration speaker ( 71 may be configured to be outputted to the vibrating speaker 71 by receiving a pronunciation guide voice signal, which is connected to the audio processor 50 and is an analog signal output through the speaker 52 of the audio processor 50. It may be configured to output.

The control unit 10 includes a simulation module 11, a user response recognition module 16, and a content DB 17 to control the overall operation of the therapeutic multiple simulator according to the present invention.

Specifically, the content DB 17 stores a plurality of contents such as sensory integration training contents, cognitive training contents, language education contents, and a plurality of play contents for treating a developmental disorder. The contents include training scenarios for various situations and images, still images and / or images according to the scenarios, behavior guidance voice data, rider control data, and the like.

The simulation module 11 displays the corresponding image on the concrete screen 31 through the projector 32 in response to the selected content, and responds to the user response monitoring unit 40, the audio processing unit 50, and the corresponding image of the content. The rider controller 60 induces and monitors the user's response, and performs training according to the corresponding content based on the analyzed information input from the user response recognition module 16.

The simulation module 11 includes a sensory integration training module 12, a cognitive training module 13, a language education module 14, a play module 15, and the like.

The sensory integration training module 12 loads the sensory integration training content from the content DB 17, displays an image on the concrete screen 31 according to the loaded sensory integration training content, and controls the rider 70 accordingly. And monitors the user's response through the user's response and the user's response monitoring device 41 accordingly, and responds to the monitored user's response and operation through the rider 70 and the concrete screen 31. Provide continuous training based on the scenario of the content. In detail, users with mental and behavioral disorders are not easy to achieve behavioral development through actual experiences unlike general people. For example, there is a high likelihood of a dangerous accident, such as a bicycle or a horse, requiring a sense of balance at the same time as showing a fear, avoidance, or inadequacy, falling or falling. Therefore, by holding the handle through the rider 70 and turning the pedal, the user is guided to look forward through the image displayed on the concrete screen 31 so that the user can balance and experience the situation in advance. Through these repeated exercises, the user learns the senses and the center of gravity, and naturally trains the correlation between the movement of the body and the eyes.

The cognitive training module 13 loads cognitive training content from the content DB 17, displays an image on the concrete screen 31 according to the loaded cognitive training content, and correspondingly through the user response monitoring device 41. Monitor and analyze the movement of the user's gaze, and perform cognitive training according to the scenario of the content corresponding to the analyzed gaze of the user. In detail, the cognitive training module 13 recognizes the eye (iris) of the user through the gaze tracking camera 44 and moves the recognized user gaze according to the movement of the object displayed on the sphere screen 31. Train to induce wider viewing angles.

The language teaching module 14 loads language teaching content from the content DB 17, displays a language teaching image on the concrete screen 31 according to the loaded language teaching content, and displays the user's behavior and voice corresponding thereto. Analyzes through the reaction monitoring device 41 and the microphone 51, and performs language training according to the scenario of the content corresponding to the analyzed user's behavior and speech.

The play module 15 loads game content inducing the active action of the user from the content DB 17, displays an image on the concrete screen 31 according to the loaded game content, and induces the active action of the user. The user's behavior by the induction is analyzed through the user response monitoring device 41, and the game is performed according to the scenario of the content corresponding to the analyzed user's behavior. In other words, the fingers are stretched and stretched, hands and legs stretched and shaked, the body moves around, and the user's actions are induced and executed to improve sociality.

The user response recognition module 16 analyzes the information input from the user response monitoring unit 40 or the user response monitoring unit 40 and the rider interface unit 63 to recognize the user response and then simulates the corresponding response module 11. )

4 is a flowchart illustrating a multi-simulation method in a multi-simulator for treating a developmental disorder according to the present invention. Hereinafter, a description will be given with reference to Figs. 1 to 4. Fig.

First, the control unit 10 of the control device 100 checks whether a simulation start event occurs (S411). The simulation start event may occur when an administrator initiates a simulation start command through the input unit 20, or may occur when a user is seated on the rider 70 or stands in front of the concrete screen 31 while the simulator is driven. There will be. In the latter case, the controller 10 may determine whether the user is standing in front of the concrete screen 31 by one of the user response monitoring device 41 and the microphone 51.

When the simulation start event occurs, the controller 10 sets the photographing direction and the position of the user response monitoring device 41 and the microphone 51 to fit the user (S413). The initial user response monitoring device 41 and the microphone 51 may be set automatically by information monitored through the user response monitoring device 41 or may be manually set by an administrator.

After device initialization, the controller 10 displays a content setting screen (S415). The content setting screen may be displayed on the concrete screen 31 through the projector 32 or may be displayed on a separate display device such as a separate LCD. The content setting screen may be a screen for selecting one or more of a plurality of contents, setting the order, and the like.

After the content setting screen is displayed, the controller 10 checks whether arbitrary content is selected (S417).

If any content is selected, the controller 10 determines whether the selected content is a content that requires the rider 70 (S419).

If it is determined that the content requires the rider 70, the controller 10 determines whether the rider 70 corresponding to the selected content is applied (S421). To this end, each content stored in the content DB 17 has content need information, and if the content is needed, the content should have identification information of the necessary rider 70. And each rider 70 should have identification information for each type. Then, when selecting the content, the controller 10 compares the identification information of the necessary rider included in the content with the identification information input from the rider 70 through the rider interface unit 63, and determines whether it is the same rider. It is determined whether the corresponding rider 70 has been applied.

When the rider corresponding to the selected content is not applied, the controller 10 displays content corresponding rider information including rider information (including identification information) of the currently applied rider 70 and rider information corresponding to the content to correspond to the content. Request to apply the rider 70 to (S423).

When a rider corresponding to the selected content is applied, the controller 10 controls the rider driver 62 to initialize the rider 70 (S425).

When the rider is initialized, the controller 10 determines whether the user is seated in the rider 70 (S427). Whether the user's rider 70 is seated can be determined through the image captured by the behavior photographing camera 43 and the gaze tracking camera 44 of the user reaction monitoring device 41, and is installed in the rider 70 It may be determined through a sensor (not shown).

If the user is seated on the rider 70, the controller 10 sets the user response monitoring device 41 to fit the user (S429). For example, the behavior shooting camera 43 is adjusted so that the entire body of the user seated in the rider 70 or the whole body of the user standing or sitting on the floor can be photographed, and the gaze tracking camera 44 is the user. Your eyes are adjusted so that they can be taken.

When the setting of the user response monitoring device 41 is completed, the controller 10 executes the selected content and performs training corresponding to the corresponding content until a simulation end event occurs (S431 and S433). The simulation end event may be generated when the selected content is completed or when the administrator executes a simulation type command through the input unit 20.

FIG. 5 is a flowchart illustrating a sensory integration training method of a multi-simulation method according to an embodiment of the present invention, and FIG. 6 is a diagram illustrating a sensory integration training method using a rider according to an embodiment of the present invention. Hereinafter, the sensory integration training method will be described with reference to FIGS. 5 and 6.

First, the controller 10 activates the sensory integration training module 12 when the content selected in FIG. 4 is the sensory integration training content and setting of the user response monitoring device 41 is completed (S429).

The activated sensory integration training module 12 loads rider information of the rider 70 through the rider interface unit 63 (S511). The reason for loading the rider information is that various riders may be applied as shown in FIG. 6 even in the sense-integrated training content, and the image and the scenario may vary depending on the type of rider.

When the rider information is loaded, the integrated training module 12 loads the sensory integrated content scenario corresponding to the rider 70 of the loaded rider information from the sensory integrated content, and displays the driving image according to the scenario as the display unit 30. The display is displayed on the spherical screen 31 through the projector 32 (S513).

When the image starts to be displayed, the sensory integration training module 12 outputs a guide voice for requesting the user's operation in response to the image (scenario) through the speaker 52 to induce the user to step by step balance and direction change. (S515).

After inducing the behavior of the user, the sensory integration training module 12 receives an image received from the user response monitoring device 41 through the user response monitoring unit 40 and the rider 70 input through the rider interface unit 63. The operation information is analyzed (S517), and the eyes of the user are analyzed and tracked (S519).

Sensory integration training module 12 determines whether the user responds to the image derived from the analyzed information (S521).

If the user did not respond in response to the induced image, the sensory integration training module 12 loads the improved guidance image and the voice corresponding to the user's motion and gaze from the sensory integrated content, and then displays the sphere screen 31 and the speaker 52. After outputting through (S523), it is determined again whether the user made the induced reaction (S521).

If the user has responded in response to the induced image, the sensory integration training module 12 determines whether all the steps of the content have been completed (S525), and according to the image (scenario) of the content until the completion of all the steps S517 described above. To S523 are repeatedly performed.

7 is a flowchart illustrating a cognitive training method of a multiple simulation method according to an embodiment of the present invention, and FIG. 8 is a diagram illustrating an example of a cognitive training method according to an embodiment of the present invention. Hereinafter, the cognitive training method will be described with reference to FIGS. 7 and 8.

First, when the content selected in FIG. 4 is the cognitive training content, and the setting of the user response monitoring device 41 is completed (S429), the controller 10 activates the cognitive training module 13.

The activated cognitive training module 13 displays a tracking target object such as (b) for cognitive training in the center of the spherical screen 31 composed of basic coordinates as shown in FIG. 8 (A) (S711).

After displaying the object to be tracked, the cognitive training module 13 outputs the guide voice for inducing the movement of the object to be tracked and the user's eye tracking through the speaker 52 through the audio processor 50 (S713).

The cognitive training module 13 after the output of the tracking guidance guidance voice analyzes and tracks the gaze of the user through the gaze tracking camera 44 of the user response monitoring device 41 (S715). Specifically, referring to FIG. 8, after focusing on the object displayed at the center of the sphere screen 31, that is, the apple tree in FIG. 8 (b), if the user concentrates on the apple tree, Pick up the dog and move it to the outer corner as shown in (c) and induce the user's eyes to move to the left. At this time, whether the user's gaze is concentrated on the apple tree and the user's gaze moves to the position of the moved apple is made by analyzing the image photographed by the gaze tracking camera 44 of the user reaction monitoring device 41.

When the user gaze analysis and tracking is performed as described above, the cognitive training module 13 determines whether the object tracking is successful by determining whether the user's gaze has moved to the position where the object has moved (S717).

As a result of the determination, if the object tracking is successful, the cognitive training module 13 notifies the tracking success and counts and displays the number of successes (S719).

On the other hand, if the object tracking fails, the cognitive training module 13 counts the number of tracking failures (S721), and repeatedly outputs a guide voice for guiding the user's eyes to the moved object (S713). The counted number of tracking failures may be used later as data for the manager.

When the number of successful tracking is counted, the cognitive training module 13 checks whether the number of successful tracking exceeds a preset reference number, and repeatedly performs the steps S713 to S717 until the number of successful tracking exceeds the reference number. (S723, S725).

If the number of successful tracking exceeds the reference number, the cognitive training module 13 displays the number of successful tracking on the concrete screen 31 (S727).

Referring to S719 to S727 with reference to FIG. 8, as shown in (c) of FIG. 8, an apple, which is a tracking target object, is moved to one corner, and if the user moves the eye to the apple and succeeds in tracking the object, the number 1 is counted. After the apple is moved from the apple position of (C) as shown in (D), if the user's eyes move to the position where the apple is moved, 2 is counted and displayed. And if the reference number is set to two times, the cognitive training module 13 indicates the number of successful tracking as shown in Figure 8 (bar) since the number of successful tracking is 2, and informs.

In the above description, when the tracking success count exceeds the reference count, the tracking success count is displayed to complete the process. However, the final tracking is performed when the number of movements of the tracking target object exceeds the reference count regardless of success or failure. It may be configured to inform the user by displaying the number of successes.

9 is a flowchart illustrating a language teaching method of a multi-simulation method according to an embodiment of the present invention, and FIG. 10 is a diagram illustrating an example of a language teaching method according to an embodiment of the present invention. Hereinafter, a language teaching method will be described with reference to FIGS. 9 and 10.

First, when the content selected in FIG. 4 is language education content and setting of the user response monitoring device 41 is completed (S429), the controller 10 activates the language education module 14.

The activated language teaching module 13 loads the pronunciation to be taught from the selected language teaching content and displays it on the spherical screen 31 (S911).

After displaying the pronunciation to be taught, the language teaching module 13 outputs a pronunciation guide voice guiding the voice of the displayed language through the speaker 52 (S913).

After outputting the guide pronunciation guide voice, the language training module 13 starts capturing the user's mouth through the behavior photographing camera 43 of the user response monitoring device 41 (S915).

When the photographing of the user's mouth is started, the language teaching module 13 checks whether the user speaks through the microphone 51 (S917), and inputs from the microphone 51 through the audio processor 50 when the user speaks. The voice recognition is performed on the voice (S918), and the shape of the mouth when the user speaks is captured through the action photographing camera 43 (S919).

When the shape of the user's mouth by the user's utterance is captured, the language education module 14 loads the shape of the teacher's mouth included in the content for the displayed pronunciation (S921), and the shape of the teacher's mouth and the user's mouth. Is displayed as shown in FIG. 10A (S923).

After displaying the teacher's mouth shape and the user's mouth shape, the language education module 14 determines whether the teacher's mouth shape and the user's mouth shape match within an error range (S925). Whether the mouth shape matches may be achieved by comparing the respective mouth shape patterns.

If it matches within the error range, the language teaching module 14 displays at least one or more related words as shown in FIG. 10 (b), and outputs a pronunciation guide voice to guide pronunciation of the displayed related words through the speaker 52. (S927).

After outputting the pronunciation guidance voice, the language education module 14 checks whether the pronunciation is input through the microphone 51 (S929).

When the pronunciation is input through the microphone 51, the language education module 14 performs voice recognition (S930), and then determines whether the recognized result matches the displayed word (S931).

If there is a match, the language education module 14 highlights the corresponding word displayed on the spherical screen 31 in bold letters or the like to indicate that the pronunciation of the matched word is correct (S933). The emphasizing expression may be to indicate the writing column in bold letters as shown in FIG. For example, if the pronunciation guidance voice was [milk] as shown in (b) of FIG. 10, and the user pronounced correctly for this, [milk] will be displayed in bold letters as shown in (b) of FIG.

The language learning module 14 repeats the above processes by displaying the next words until all the language learning is completed for the displayed words until the process ends (S935, S937). The end of the process may be configured to terminate when a certain time passes, or may be configured to terminate when learning certain words, or may be terminated by an administrator's termination command.

11 is a flowchart illustrating a play method of a multi-simulation method according to an embodiment of the present invention, and FIG. 12 is a diagram illustrating examples of a play method according to an embodiment of the present invention. Hereinafter, a training method using play will be described with reference to FIGS. 11 and 12.

As shown in FIG. 12, various games such as (a) catching a butterfly, (b) basketball, and (c) listening to and acting according to instructions may be registered as play contents.

Referring to FIG. 11, the controller 10 activates the play module 15 when the content selected in FIG. 4 is play content and setting of the user response monitoring device 41 is completed (S429).

The activated play module 13 displays game contents in the form of a list (S1111). The game content list may be displayed on the concrete screen 31 through the projector 32, or may be displayed on a separate display device which only an administrator sees.

When the game list is displayed, the game module 15 checks whether one of a plurality of game contents is selected (S1113).

When one game content is selected, the game module 15 activates the sensor 42 of the user response monitoring device 41 (S1114), and then loads the selected game to display the game image through the projector 32 through the spherical screen ( And display game audio through the speaker 52 to play the game (S1115).

When the game is played, the game module outputs an image and a guide voice for inducing a user's movement (S1117), and checks whether the user performs a corresponding operation through the user response monitoring device 41 (S1119). Games according to the present invention should induce active actions of the user, so that the user acts adjacent to the concrete screen 31 as shown in FIGS. 12A and 12B. It would be desirable to sense a location on the screen that touches.

If the user does not perform an appropriate response in response to the guided image and the guided voice, the game module 15 outputs an improved motion guided image and the guided voice for inducing the user's improved operation (S1123), and then the user again selects an appropriate action. It is determined whether a corresponding operation is performed (S1119).

When the user performs an appropriate response operation, the game module 15 outputs a success notification and a complimentary guidance voice through the concrete screen 31 and the speaker 52 (S1121).

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. It will be easily understood. It is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, it is intended to cover various modifications within the scope of the appended claims.

10: control unit 11: simulation module
12: Sensory Integration Training Module 13: Cognitive Training Module
14: Language Teaching Module 15: Play Module
16: User response recognition module 17: Content DB
20: input unit 30: display unit
40: user response monitoring unit 41: user response monitoring device
42: sensor 43: action shooting camera
44: eye tracking camera 45: interface unit
46: camera tilting unit 47: image processing unit
50: audio processor 51: microphone
52: speaker 60: rider control unit
62: rider drive unit 63: rider interface unit
70: Rider 71: Vibration Speaker

Claims (31)

A display unit for displaying an image;
A user response monitoring device for monitoring a user's response to view the image and outputting information on the user's response;
An audio processor for receiving a user's voice through a microphone and outputting the voice, and outputting a behavior guidance voice according to content through a speaker;
Stores a plurality of contents for treatment of developmental disorders, receives at least one or more of the contents selected, displays an image of the selected content on the display, guides the behavior of inducing a user's response in response to the image The voice is output to the speaker through the audio processor, and the response of the user corresponding to the image and the behavior guidance voice is analyzed by the information input from the user response monitoring device to determine whether the user has performed the induced action. To include a control unit for performing the treatment according to the scenario of the content,
The display unit includes:
A spherical screen that is curved up, down, left, and right to display an image; And
The projector is configured to project the image data according to the scenario of the content from the control unit to the concrete screen in the form of light,
And the projector performs non-linear distortion correction (NLDC) so as not to be distorted when the image is displayed on the spherical screen.
delete delete The method of claim 1,
Multiple simulator for treatment of developmental disorders further comprising a rider configured to sit by the user.
5. The method of claim 4,
The rider,
A chair, a model horse, or a bicycle, the multi-simulator for the treatment of developmental disorders, characterized in that the replacement can be replaced according to the content of the content.
A display unit for displaying an image;
A user response monitoring device for monitoring a user's response to view the image and outputting information on the user's response;
An audio processor for receiving a user's voice through a microphone and outputting the voice, and outputting a behavior guidance voice according to content through a speaker;
Stores a plurality of contents for treatment of developmental disorders, receives at least one or more of the contents selected, displays an image of the selected content on the display, guides the behavior of inducing a user's response in response to the image The voice is output to the speaker through the audio processor, and the response of the user corresponding to the image and the behavior guidance voice is analyzed by the information input from the user response monitoring device to determine whether the user has performed the induced action. To include a control unit for performing the treatment according to the scenario of the content,
The display unit includes:
A spherical screen that is curved up, down, left, and right to display an image; And
The projector is configured to project the image data according to the scenario of the content from the control unit to the concrete screen in the form of light,
The content for treatment of developmental disorders is a sense-integrated content for training the correlation between the user's sense of balance, center of gravity, vestibular stimulation, body movement and gaze,
A rider configured in one shape of a horse and a bicycle shape so that a user can sit, and moving left, right, front, rear, left and right under control; And
And a rider controller for moving left, right, front, rear, left, and right under control according to the sensory integrated content of the controller.
The method according to claim 6,
The rider control unit,
A rider driver for controlling movement and inclination in the front, rear, left, and right directions of the rider; And
And a rider interface unit for receiving operation data according to the rider's operation from the rider and outputting the rider interface to the controller.
The method according to claim 6,
The control unit,
After displaying the image according to the scenario of the sensory integrated content on the concrete screen and inducing the user's behavior by outputting a balance and direction guidance guidance voice which is a behavior guidance voice according to the scenario of the sensory integrated content, the user response Sense of analyzing the above information about the user's response through the monitoring device and outputting the guided video and audio through the sphere screen and the speaker to improve the user's motion and gaze if the user fails to perform the induced action. Simulator for the developmental disorders comprising an integrated training module.
9. The method according to claim 6 or 8,
The user response monitoring device is a behavior photographing camera to photograph the user's body,
The information is a simulator for the treatment of developmental disorders, characterized in that the image data photographed by the behavior photographing camera.
A display unit for displaying an image;
A user response monitoring device for monitoring a user's response to view the image and outputting information on the user's response;
An audio processor for receiving a user's voice through a microphone and outputting the voice, and outputting a behavior guidance voice according to content through a speaker;
Stores a plurality of contents for treatment of developmental disorders, receives at least one or more of the contents selected, displays an image of the selected content on the display, guides the behavior of inducing a user's response to the image The voice is output to the speaker through the audio processor, and the response of the user corresponding to the image and the behavior guidance voice is analyzed by the information input from the user response monitoring device to determine whether the user has performed the induced action. To include a control unit for performing the treatment according to the scenario of the content,
The display unit includes:
A spherical screen that is curved up, down, left, and right to display an image; And
The projector is configured to project the image data according to the scenario of the content from the control unit to the concrete screen in the form of light,
The content for treating developmental disorders is cognitive content for training a user's cognitive ability,
The control unit,
According to the scenario of the cognitive content, the tracking target object is displayed on the concrete screen, and then the movement guidance tracking voice, which is the behavior guidance voice, which guides the user's eyes to track the tracking target object while moving the tracking target object. Outputting a voice and analyzing the information input from the user response monitoring device to track the user's gaze to determine whether the user's gaze tracks the tracking object, which is an induced behavior, and fails to track the tracking object, And a cognitive training module that repeatedly moves a tracking target object and performs cognitive training for tracking a tracking target object of the user's gaze.
The method of claim 10,
Recognition module of the control unit,
Simulator for treating a developmental disorder, characterized in that if the user gaze is successful in tracking the tracking object to display and guide the number of successes.
The method according to claim 10 or 11,
The user response monitoring device is a gaze tracking camera for capturing the eyes of the user,
The information is a simulator for the treatment of developmental disorders, characterized in that the image data taken by the gaze tracking camera.
A display unit for displaying an image;
A user response monitoring device for monitoring a user's response to view the image and outputting information on the user's response;
An audio processor for receiving a user's voice through a microphone and outputting the voice, and outputting a behavior guidance voice according to content through a speaker;
Stores a plurality of contents for treatment of developmental disorders, receives at least one or more of the contents selected, displays an image of the selected content on the display, guides the behavior of inducing a user's response in response to the image The voice is output to the speaker through the audio processor, and the response of the user corresponding to the image and the behavior guidance voice is analyzed by the information input from the user response monitoring device to determine whether the user has performed the induced action. To include a control unit for performing the treatment according to the scenario of the content,
The display unit includes:
A spherical screen that is curved up, down, left, and right to display an image; And
The projector is configured to project the image data according to the scenario of the content from the control unit to the concrete screen in the form of light,
The content for the treatment of developmental disabilities is language training content for training the user's language skills,
The control unit,
According to the scenario of the language education content, the pronunciation to be taught is loaded and displayed on the concrete screen, and a pronunciation guide voice for inducing a user's utterance for the pronunciation is output, and the user speaks for the pronunciation guide voice. The user's mouth shape during speech and the teacher's mouth shape for the pronunciation stored in advance are simultaneously displayed on the concrete screen, and the user's speech is trained to match by comparing the user's mouth shape with the teacher's mouth shape. Simulator for the developmental disorders comprising a language education module.
The method of claim 13,
The language education module,
If the user's mouth shape matches the teacher's mouth shape, a word associated with the pronunciation is displayed, and a pronunciation guide voice for inducing the user's utterance for the pronunciation of the word is output. When the voice is spoken, the audio processing unit performs voice recognition to check whether the word is correctly pronounced, and if it is pronounced correctly, the simulator for treating a developmental disorder, characterized in that it is displayed correctly.
The method according to claim 13 or 14,
The user response monitoring device is a behavior photographing camera to photograph the user's mouth,
The information is a simulator for treatment of developmental disorders, characterized in that the image data of the user's mouth.
The method of claim 13,
It is formed in the shape of a chair, having a vibration speaker on the back and further comprising a rider for generating a vibration corresponding to the intensity and wavelength of the pronunciation guide voice through the vibration speaker further comprising a rider.
17. The method of claim 16,
The rider simulator for the developmental disorders further comprises a switch for turning on / off the vibrating speaker.

A display unit for displaying an image;
A user response monitoring device for monitoring a user's response to view the image and outputting information on the user's response;
An audio processor for receiving a user's voice through a microphone and outputting the voice, and outputting a behavior guidance voice according to content through a speaker;
Stores a plurality of contents for treatment of developmental disorders, receives at least one or more of the contents selected, displays an image of the selected content on the display, guides the behavior of inducing a user's response in response to the image The voice is output to the speaker through the audio processor, and the response of the user corresponding to the image and the behavior guidance voice is analyzed by the information input from the user response monitoring device to determine whether the user has performed the induced action. To include a control unit for performing the treatment according to the scenario of the content,
The display unit includes:
A spherical screen that is curved up, down, left, and right to display an image; And
The projector is configured to project the image data according to the scenario of the content from the control unit to the concrete screen in the form of light,
The content for treatment of developmental disorders is game content that induces the user's movement and trains the user's sociality,
The control unit,
The game image of the selected game content is displayed on the concrete screen, the motion guidance guide voice for guiding the user's movement in conjunction with the game image is output, and the user analyzes the information input from the user reaction monitoring device. And a game module for determining whether an action corresponding to judo has been performed and inducing success notification and continuous user movement according to the result.
19. The method of claim 18,
The game is a touch game to touch the image displayed on the sphere screen,
The user response monitoring device is a sensor for recognizing a position touched on the concrete screen,
The information is a simulator for treatment of developmental disorders, characterized in that the position information of the touched position.
A display unit for displaying an image;
A user response monitoring device for monitoring a user's response to view the image and outputting information on the user's response;
An audio processor for receiving a user's voice through a microphone and outputting the voice, and outputting a behavior guidance voice according to content through a speaker;
Stores a plurality of contents for treatment of developmental disorders, receives at least one or more of the contents selected, displays an image of the selected content on the display, guides the behavior of inducing a user's response in response to the image The voice is output to the speaker through the audio processor, and the response of the user corresponding to the image and the behavior guidance voice is analyzed by the information input from the user response monitoring device to determine whether the user has performed the induced action. To include a control unit for performing the treatment according to the scenario of the content,
The display unit includes:
A spherical screen that is curved up, down, left, and right to display an image; And
The projector is configured to project the image data according to the scenario of the content from the control unit to the concrete screen in the form of light,
User response monitoring device,
A sensor for detecting and outputting a touch position of the concrete screen;
An action photographing camera which outputs image data photographing a user's body; And
Simulator for treating developmental disorders, comprising a gaze tracking camera for outputting image data of the user's eyes.
A content selection process of the control unit determining whether at least one selected content from among the plurality of contents for treating the developmental disorder is selected;
A rider necessity determining step of determining, by a controller, whether the selected content is content requiring a rider;
A user response monitoring device setting process of setting, by the controller, a user response monitoring device according to whether the rider is required and the user's body;
The control unit displays an image of the selected content on a display unit, and outputs a behavior guidance voice for inducing a user's response in response to the image to a speaker through an audio processor, and responds to the video and the behavior guidance voice. And a content execution process of performing a treatment according to the scenario of the content by determining whether the user performed the induced behavior by analyzing the response of the response based on the information input from the user response monitoring apparatus.
The content selection process,
A simulation start determining step of checking whether a simulation start event occurs;
A device initialization step of initializing the user response monitoring device; And
And a content selection step of selecting a content by displaying a content setting screen.
delete A content selection process of the control unit determining whether at least one selected content from among the plurality of contents for treating the developmental disorder is selected;
A rider necessity determining step of determining, by a controller, whether the selected content is a content requiring a rider;
A user response monitoring device setting process of setting, by the controller, a user response monitoring device according to whether the rider is required and the user's body;
The control unit displays an image of the selected content on a display unit, and outputs a behavior guidance voice for inducing a user's response in response to the image to a speaker through an audio processor, and responds to the video and the behavior guidance voice. And a content execution process of performing a treatment according to the scenario of the content by determining whether the user performed the induced behavior by analyzing the response of the response based on the information input from the user response monitoring apparatus.
A rider initialization process of initializing a rider if it is determined that a rider is needed in the rider need determination process; And
Simulation method for treatment of developmental disorders further comprising a user seating determination process for determining whether the user is seated on the rider.
A content selection process of the control unit determining whether at least one selected content from among the plurality of contents for treating the developmental disorder is selected;
A rider necessity determining step of determining, by a controller, whether the selected content is a content requiring a rider;
A user response monitoring device setting process of setting, by the controller, a user response monitoring device according to whether the rider is required and the user's body;
The control unit displays an image of the selected content on a display unit, and outputs a behavior guidance voice for inducing a user's response in response to the image to a speaker through an audio processor, and responds to the video and the behavior guidance voice. And a content execution process of performing a treatment according to the scenario of the content by determining whether the user performed the induced behavior by analyzing the response of the response based on the information input from the user response monitoring apparatus.
The content selected in the content selection process is sensory integrated content,
The content execution process,
A rider information obtaining step of loading rider information;
An image display step of loading a driving image corresponding to the obtained rider information from a corresponding content and displaying the same on a concrete screen;
A behavior derivation step of outputting a behavior guidance voice for inducing balance and direction change in stages in response to the displayed image;
A user behavior analysis step of analyzing the image data input from the user response monitoring device and the input information input from the rider to analyze the behavior and gaze of the user corresponding to the induced image;
An operation determining step of determining whether the user has acted in response to the induced video and audio; And
If the user fails to respond to the induced video and audio, the user can improve the user's behavior by outputting an improved guided video and guided voice corresponding to the user's behavior and gaze, and then If done, the simulation method for the treatment of developmental disorders, characterized in that it comprises a repeating training step of performing the next step.
A content selection process of the control unit determining whether at least one selected content from among the plurality of contents for treating the developmental disorder is selected;
A rider necessity determining step of determining, by a controller, whether the selected content is a content requiring a rider;
A user response monitoring device setting process of setting, by the controller, a user response monitoring device according to whether the rider is required and the user's body;
The control unit displays an image of the selected content on a display unit, and outputs a behavior guidance voice for inducing a user's response in response to the image to a speaker through an audio processor, and responds to the video and the behavior guidance voice. And a content execution process of performing a treatment according to the scenario of the content by determining whether the user performed the induced behavior by analyzing the response of the response based on the information input from the user response monitoring apparatus.
The content selected in the content selection process is cognitive content,
The content execution process,
A tracking object display step of displaying a tracking object of the selected cognitive content on a specific screen;
An action derivation step of outputting a movement and tracking guidance voice of the displayed tracking object;
A user behavior analysis step of analyzing whether the user views and tracks the object to be tracked by analyzing image data photographing the eye of the user input through a gaze tracking camera to a user reaction monitoring device; And
And a notification step of notifying the user of whether or not the tracking target object has been successfully tracked.
26. The method of claim 25,
Wherein the notifying step comprises:
And a tracking success displaying step of counting the number of successes when the tracking target object is successful and displaying the counted number on the concrete screen to indicate whether the success is successful.
The method of claim 26,
Wherein the notifying step comprises:
And a final tracking success notification step of displaying the total number of successful tracking and the total number of tracking target objects together when the tracking of the target object tracking of the cognitive content is completed.
A content selection process of the control unit determining whether at least one selected content from among the plurality of contents for treating the developmental disorder is selected;
A rider necessity determining step of determining, by a controller, whether the selected content is a content requiring a rider;
A user response monitoring device setting process of setting, by the controller, a user response monitoring device according to whether the rider is required and the user's body;
The control unit displays an image of the selected content on a display unit, and outputs a behavior guidance voice for inducing a user's response in response to the image to a speaker through an audio processor, and responds to the video and the behavior guidance voice. And a content execution process of performing a treatment according to the scenario of the content by determining whether the user performed the induced behavior by analyzing the response of the response based on the information input from the user response monitoring apparatus.
The content selected in the content selection process is language education content,
The content execution process,
A sound display step of loading a sound to be trained step by step from the language education content and displaying the same on a concrete screen;
A pronunciation inducing step of outputting a pronunciation guide voice for inducing a pronunciation of the displayed sound;
A behavior monitoring step of starting photographing a mouth of a user through a behavior photographing camera of a user response monitoring unit after the pronunciation inducing step and monitoring whether a user speaks through a microphone;
A mouth shape comparison display step of capturing the user's mouth when the user speaks to the displayed sound and displaying the mouth mouth on the concrete screen together with the teacher mouth shape for the sound previously stored; And
And a pronunciation success determination step of determining whether the user's pronunciation succeeds by comparing the captured user's mouth shape with the teacher's mouth pattern and determining whether the pattern matches.
29. The method of claim 28,
A word pronunciation derivation step of outputting a pronunciation guide voice for deriving utterance of the words after displaying at least one word for the successful sound when the pronunciation succeeds in the pronunciation success determination step;
Checking whether a user's pronunciation of the word is input through the microphone and checking a user's pronunciation;
A speech success determination step of checking whether the user pronounces the word correctly by voice recognition of the pronounced pronunciation when the user speaks about the word; And
And a success notification display step of writing the word in the writing column of the word when the utterance of the word succeeds.
30. The method of claim 28 or 29,
And a vibration stimulation step of generating a vibration corresponding to the pronunciation guidance voice by outputting the pronunciation guidance voice to the vibration speaker of the rider in the pronunciation induction step.
A content selection process of the control unit determining whether at least one selected content from among the plurality of contents for treating the developmental disorder is selected;
A rider necessity determining step of determining, by a controller, whether the selected content is a content requiring a rider;
A user response monitoring device setting process of setting, by the controller, a user response monitoring device according to whether the rider is required and the user's body;
The control unit displays an image of the selected content on a display unit, and outputs a behavior guidance voice for inducing a user's response in response to the image to a speaker through an audio processor, and responds to the video and the behavior guidance voice. And a content execution process of performing a treatment according to the scenario of the content by determining whether the user performed the induced behavior by analyzing the response of the response based on the information input from the user response monitoring apparatus.
The selected content is a game content, the game is a simulation method for treatment of developmental disorders, characterized in that the touch game to induce to touch the objects displayed on the sphere screen.

Images