CN107519622A - Spatial cognition rehabilitation training system and method based on virtual reality and the dynamic tracking of eye - Google Patents
Spatial cognition rehabilitation training system and method based on virtual reality and the dynamic tracking of eye Download PDFInfo
- Publication number
- CN107519622A CN107519622A CN201710719123.4A CN201710719123A CN107519622A CN 107519622 A CN107519622 A CN 107519622A CN 201710719123 A CN201710719123 A CN 201710719123A CN 107519622 A CN107519622 A CN 107519622A
- Authority
- CN
- China
- Prior art keywords
- training
- eye
- module
- task
- person
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0003—Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B69/00—Training appliances or apparatus for special sports
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
Abstract
The invention discloses a kind of spatial cognition rehabilitation training system based on virtual reality and the dynamic tracking of eye, including virtual reality device, it includes situation display module, for display virtual real scene and training mission situation；The dynamic tracking component of infrared ray eye obtains the person of being trained to and is required to complete the eye movement data in task process according to training mission in real time, and transmits to data analysis module；Eye of the data analysis person of being trained to that data analysis module obtains according to the dynamic tracking component of eye when completing situation task moves index, evaluates the visual space machining feature of testee, and transmits the result to the dynamic guiding cognitive training module of eye；The dynamic guiding cognitive training module of eye calls different eyes to move prompting mode and guides processing according to the visual space machining feature.The present invention carries out spatial cognition training using virtual reality scenario, and targetedly guides processing, validity more ecological compared with prior art and operability.
Description
Technical field
The present invention relates to field of virtual reality, more particularly to a kind of spatial cognition health based on virtual reality and the dynamic tracking of eye
System and method are practiced in refreshment.
Background technology
Spatial cognitive Abilities are the important components of intelligence, have important work to many abilities in daily life
With.Visual space obstacle caused by brain damage and brain diseases directly influences the rehabilitation efficacy for the person of being trained to, daily life energy
Power and social adaptation.At present, the systematic training specifically for spacial ability obstacle is clinically lacked.Part is nested in cognition
Spacial ability training in rehabilitation system is mainly two-dimensional space ability training, lacks the training in real environment.Also, brain damages
Wound or brain diseases are using limbs disturbance as main clinical manifestation, and the cognitive training system operated by limb motion
System is not suitable for the various persons that occur limbs disturbance.Research finds the dynamic inside psychology that on the one hand can reflect visual information of eye
Process, it on the other hand can substitute operation of the limb function realization to training mission.
Therefore, it is necessary to which the technical problem that those skilled in the art urgently solve is：How to develop it is more ecological, have
The spatial cognition rehabilitation training system and method for effect property and operability, to be adapted to the spatial cognition health with limbs disturbance person
Refreshment is practiced.
The content of the invention
In order to solve the above problems, the present invention provides a kind of spatial cognition obstacle health based on virtual reality and the dynamic tracking of eye
Multiple training system, it is that the person of being trained to sets the spatial cognition of different difficulty to train situation using virtual reality, is moved by recording eye
The index analysis person's of being trained to space tasks machining feature, start different spatial cognition training systems according to performance, and draw
Lead the person of being trained to and task is completed using optimal policy.Relative to traditional cognitive training based on two-dimentional abstract situation, the present invention
Rehabilitation system is more ecological, operability and validity.
To achieve these goals, the present invention adopts the following technical scheme that：
A kind of spatial cognition rehabilitation training system based on virtual reality and the dynamic tracking of eye, including：
Virtual reality device, it includes situation display module, for display virtual real scene and training mission situation；
The dynamic tracking component of infrared ray eye, requires to complete in task process for obtaining the person of being trained in real time according to training mission
Eye movement data, and transmit to data analysis module；
Data analysis module, the data analysis person of being trained to for being obtained according to the dynamic tracking component of eye complete situation task
When eye move index, evaluate the visual space machining feature of testee, and transmit the result to the dynamic guiding cognitive training mould of eye
Block；
The dynamic guiding cognitive training module of eye, for calling different eyes to move prompting mode according to the visual space machining feature
Guide task processing.
Further, the system also includes behavioral data acquisition component, for gathering the limbs behavioral data of trainer
And transmit to data analysis module.
Further, the eye, which moves index, includes blinkpunkt position, interest region, to interest region when watching attentively first
Between, fixation times, duration of fixation, twitching of the eyelid amplitude and watch track attentively.
Further, the visual space machining feature is complete independently situation of the trainer for current training mission,
The performance is represented by way of scoring；The determination method of the scoring is：Obtained from the dynamic guiding cognitive training module of eye
The prompt sequence of current task is taken, eye when trainer completes task is calculated and moves between sequence and the sequence of prompt
Distance；Fixation times, region of interest first fixation duration, duration of fixation and twitching of the eyelid amplitude that trainer completes task are obtained,
Scoring using the weighted sum of above index as training result.
Further, the virtual reality device also includes housing and is placed in the optical frames cup of enclosure interior；It is described infrared
The dynamic tracking component of line eye is integrated in virtual reality device, that is, the enclosure interior of virtual reality device is placed in, in order to wear.
Further, the display module shows the requirement of the training mission when training mission starts；Or
The system can also include voice module, and when training mission starts, training mission described in speech play will
Ask；Or
The display module shows the requirement of the training mission when training mission starts, while the voice module is broadcast
The requirement of the training mission is put, now the system also includes voice module.
Further, the training mission module of spatial cognition includes：Space experience task module, space judge task module
With spatial operation task module, three task module grade of difficulty strengthen successively, and are also provided with different difficulties in each task module
The task of easy degree.
Based on said system, present invention also offers a kind of spatial cognition recovery training method, comprise the following steps：
Step 1：Receive selection of the user to virtual reality scenario and selection training mission scene；
Step 2：The virtual reality scenario and the training mission are shown, and starts eye-tracking component；
Step 3：Gather the eye during trainer requires completion task according to current training mission and move index；
Step 4：The optimal completion result that index and current training mission are moved based on the eye is analyzed and processed, and is instructed
Practice result, if training result calls the dynamic guiding cognitive training module of eye, into step 5, conversely, carrying out next less than expection
Training mission；
Step 5：The dynamic guiding cognitive training module of the eye shows guidance information, trainer in current training mission picture
The training mission is completed according to the guidance information；
Step 6：The training mission is only shown, by trainer's complete independently, according to trainer's complete independently situation, is judged
Continue current training mission and still carry out next training mission.
Further, whether training of judgement result includes less than expection in the step 4：From the dynamic guiding cognitive training mould of eye
Block obtains the prompt sequence of current task, calculate eye when trainer completes task move sequence and prompt sequence it
Between distance；Obtain fixation times, region of interest first fixation duration, duration of fixation and twitching of the eyelid width that trainer completes task
Degree, the scoring using the weighted sum of above index as training result；The prompt sequence of the current task is optimal completion
As a result.
Further, the implementation according to guidance information completion training mission is：Display reminding on display module
Symbol, when the person's of being trained to blinkpunkt overlaps with prompt, into next prompt；When the person's of being trained to blinkpunkt and prompting
When symbol is inconsistent, prompt flicker, the person of being trained to is reminded to pay attention to prompt；Or
One section of eye movement is presented on display module, the person of being trained to repeats this track, and the person's of being trained to eye movement is with presenting
Track is consistent, and track disappears, inconsistent with track, is flashed at inconsistent place, prompts to repeat to watch this track attentively, until complete weight
Close.
Beneficial effects of the present invention：
1st, the present invention carries out the training of spatial cognition based on virtual reality scenario to the person of being trained to, using the teaching of the invention it is possible to provide true field
Scape, the person of being trained to is set to have the sense of reality, thus relative to two-dimension picture or figure, more ecological and validity；
2nd, the present invention is analyzed the performance of training mission based on the person of being trained to, and the obstacle for analyzing the person of being trained to is special
Point, the obstacle feature based on the person of being trained to targetedly are aiminged drill, thus the present invention can be empty to different visions
Between obstacle crowd, adaptive adjustment boot policy.
Brief description of the drawings
Fig. 1 is rehabilitation training system block diagram of the present invention based on virtual reality and the dynamic tracking of eye；
Fig. 2 is recovery training method flow chart of the present invention based on virtual reality and the dynamic tracking of eye.
Embodiment
The invention will be further described with embodiment below in conjunction with the accompanying drawings.
Below in conjunction with drawings and examples, the technical scheme in the embodiment of the present invention is clearly and completely described.
It is noted that described further below is all exemplary, it is intended to provides further instruction to the application.It is unless another
Indicate, all technologies used herein and scientific terminology are with usual with the application person of an ordinary skill in the technical field
The identical meanings of understanding.
It should be noted that term used herein above is merely to describe embodiment, and be not intended to restricted root
According to the illustrative embodiments of the application.As used herein, unless the context clearly indicates otherwise, otherwise singulative
It is also intended to include plural form, additionally, it should be understood that, when in this manual using term "comprising" and/or " bag
Include " when, it indicates existing characteristics, step, operation, device, component and/or combinations thereof.
Virtual reality technology
Virtual reality is the synthesis of multiple technologies, including real-time three-dimensional computer graphics techniques, and wide-angle (the wide visual field) is three-dimensional
Display Technique, feedback, stereo, network transmission, voice are defeated to be felt to the tracking technique of observer's head, eye and hand, and tactile/power
Enter export technique etc..
Tracer technique is moved using eye in virtual reality, interaction can be allowed to become more natural, more easily, just at last at one
Environment based on software is also such.The dynamic tracking interactive software of eye has used the algorithm based on scene, has made a complete base
In the user interface of blinkpunkt control, user is allowed to complete common task, such as：Scanning, slip, amplification, selection etc..
Eye-tracking technology
Eye is dynamic mainly three kinds of forms：Watch, beat and smoothly trail tracking attentively；Watch attentively, show as in observed target
Stop at least continue more than 100-200ms；Bounce, the jump at full speed between blinkpunkt, it is that a kind of joint eye moves, i.e., eyes are simultaneously
It is mobile；Smooth to trail tracking, the tracing movement speed that eyes can be smooth is the target of 1 to 30 degrees seconds, it is necessary to has one slowly to move
Dynamic target.
The major parameter of eye-tracking technology：Total fixation times, it is an index for weighing search efficiency；When watching lasting attentively
Between, the complexity of reaction extraction information；Fixation times, a mark of region significance level；Watch point sequence attentively, blinkpunkt exists
Conversion between region of interest；The time of target region of interest is reached for the first time, is arrived for the first time when feature target is searched in viewing area
Up to the time of target area.
Basic eye-movement measurement technology mainly has：Electroencephalography (EEG), electroculogram method or EOG methods (Electro-
Oculograph eyepiece method, search coil method, infrared electro bounce technique or Infrared TV Method), are contacted.
For the spatial cognition processing obstacle caused by brain damage, often with the obstacle of limb function, it can limit
Its space operation is made, therefore the dynamic one side of eye can reflect its limb activity, on the other hand can substitute the behaviour realized to situation
Make.
The present invention basic ideas be：First, the training of two-dimentional Spatial cognitive Abilities tends not to effectively move to very
Truth border, it is not notable for the real-life ability effect that improves the person of being trained to, and the training of the situation based on virtual reality can be with
Preferably improve the application power in its real situation；The function of the dynamic guiding of eye is according to the barrier to spatial cognition dysfunction person
Feature is hindered to be processed guiding according to optimal policy to its Information procession.After there is obstacle in cognitive function, its spatial information
Processing Strategies it is possible that obstacle, such as, it is mixed and disorderly to the processing sequence of environmental information or environment effective information is ignored.Profit
Moving guiding with eye can guide it effectively to be processed.
Embodiment one
A kind of spatial cognition rehabilitation training system based on virtual reality and the dynamic tracking of eye is present embodiments provided, including：
Virtual reality device, it includes situation display module, for display virtual real scene and training mission situation；
The dynamic tracking component of infrared ray eye, requires to complete in task process for obtaining the person of being trained in real time according to training mission
Eye movement data, and transmit to data analysis module；
Data analysis module, the data analysis person of being trained to for being obtained according to the dynamic tracking component of eye complete situation task
When eye move index, evaluate the visual space machining feature of testee, and transmit the result to the dynamic guiding cognitive training mould of eye
Block；
The dynamic guiding cognitive training module of eye, for calling different eyes to move prompting mode according to the visual space machining feature
Guide processing.Its advantage is one side feedback result, and on the other hand, the dynamic guiding cognitive training module of eye is according to test
As a result targetedly guided.
Alternatively, user selects virtual reality scenario and training mission feelings via the user interface on situation display module
Border.
Alternatively, the virtual reality device also includes housing and is placed in the optical frames cup of enclosure interior.
Alternatively, the dynamic tracking component of the infrared ray eye can be integrated in virtual reality device, that is, is placed in virtual reality and is set
Standby enclosure interior.
Alternatively, the eye-tracking component includes infrared reflective device, camera and infrared light supply.Infrared light supply is set
Put on the display device close to the side of human eye, be active light source, the infrared light of ocular reflex enters by infrared reflective device
Infrared camera, so as to obtain eye movement data.
Alternatively, the system also includes behavioral data acquisition component, for gathering the limbs behavioral data of trainer simultaneously
Transmit to data analysis module.
The alternative eye-tracking component of behavioral data acquisition component, training mission is completed based on limb action；Also may be used
To be used with eye-tracking component simultaneously, eye movement data and limbs behavioral data are gathered and analyzed simultaneously.
Alternatively, the eye, which moves index, includes blinkpunkt position, interest region, the first fixation duration to region of interest, note
Depending on number, duration of fixation, twitching of the eyelid amplitude and watch track attentively.
Alternatively, the visual space machining feature can be complete independently feelings of the trainer for current training mission
Condition, the performance are represented by way of scoring；The determination method of the scoring is：From the dynamic guiding cognitive training module of eye
The prompt sequence of current task is obtained, eye when trainer completes task is calculated and moves between sequence and the sequence of prompt
Distance；Obtain fixation times, region of interest first fixation duration, duration of fixation and twitching of the eyelid width that trainer completes task
Degree, the scoring using the weighted sum of above index as training result.
Alternatively, the virtual reality scenario includes but is not limited to the virtual reality scenarios such as room, cell, street, city.
Alternatively, the display module shows the requirement of the training mission when training mission starts；Instructed as informing
Practice a kind of alternative of mission requirements, the system can also include voice module, for the voice when training mission starts
Play the requirement of the training mission；As another alternative, the display module shows institute when training mission starts
The requirement of training mission is stated, while the voice module plays the requirement of the training mission.
Alternatively, the training mission module of spatial cognition includes：Space experience task module, space judge task module and
Spatial operation task module, three task module grade of difficulty strengthen successively, and different difficulty or ease are also provided with each task module
Degree.Embodiment two
Based on above-mentioned rehabilitation training system, present embodiments provide a kind of space that tracking is moved based on virtual reality and eye and recognize
Know recovery training method, comprise the following steps：
Step 1：Receive selection of the user to virtual reality scenario and selection training mission scene；
Step 2：The virtual reality scenario and the training mission are shown, and starts eye-tracking component；
Step 3：Gather the eye during trainer requires completion task according to current training mission and move index；
Step 4：The optimal completion result that index and current training mission are moved based on the eye is analyzed and processed, and is instructed
Practice result, if training result calls the dynamic guiding cognitive training module of eye, into step 5, conversely, carrying out next less than expection
Training mission；
Step 5：The dynamic guiding cognitive training module of the eye shows guidance information, trainer in current training mission picture
The training mission is completed according to the guidance information；
Step 6：The training mission is only shown, by trainer's complete independently, according to trainer's complete independently situation, is judged
Continue current training mission and still carry out next training mission.
Alternatively, the system also includes behavioral data acquisition component, for gathering the limbs behavioral data of trainer.
The alternative eye-tracking component of behavioral data acquisition component, training mission is completed based on limb action；Also may be used
To be used with eye-tracking component simultaneously, eye movement data and limbs behavioral data are gathered and analyzed simultaneously.
Alternatively, the eye-tracking component includes infrared reflective device, camera and infrared light supply.Infrared light supply is set
Put on the display device close to the side of human eye, be active light source, the infrared light of ocular reflex enters by infrared reflective device
Infrared camera, so as to obtain eye movement data.
Alternatively, the eye, which moves index, includes blinkpunkt position, interest region, the first fixation duration to region of interest, note
Depending on number, duration of fixation, twitching of the eyelid amplitude and watch point sequence (or track) attentively.
Alternatively, the virtual reality scenario includes but is not limited to the virtual reality scenarios such as room, cell, street, city.
Alternatively, the display module shows the requirement of the training mission when training mission starts；Instructed as informing
Practice a kind of alternative of mission requirements, the system can also include voice module, for the voice when training mission starts
Play the requirement of the training mission；As another alternative, the display module shows institute when training mission starts
The requirement of training mission is stated, while the voice module plays the requirement of the training mission.
Alternatively, the training mission module of spatial cognition includes：Space experience task module, space judge task module and
Spatial operation task module, three task module grade of difficulty strengthen successively, and different difficulty or ease are also provided with each task module
Degree.
Alternatively, next training mission is relative to the higher task of current training mission difficulty.
Alternatively, whether training of judgement result includes less than expection in the step 4：From the dynamic guiding cognitive training module of eye
The prompt sequence of current task is obtained, eye when trainer completes task is calculated and moves between sequence and the sequence of prompt
Distance；Obtain fixation times, region of interest first fixation duration, duration of fixation and twitching of the eyelid width that trainer completes task
Degree, the scoring using the weighted sum of above index as training result；The prompt sequence of the current task is optimal completion
As a result；By the way that scoring is compared to judge whether less than expection with predetermined threshold value.
It is according to a kind of implementation of guidance information completion training mission in the step 5：Display carries on display module
Show symbol, when the person's of being trained to blinkpunkt overlaps with prompt, (according to different tasks, prompted into next prompt
Symbol is presented successively according to optimal policy)；When the person's of being trained to blinkpunkt and prompt are inconsistent, prompt flicker, carry
The person of being trained to that wakes up pays attention to prompt.
It is according to another implementation of guidance information completion training mission in the step 5：Presented on display module
One section of eye movement (track length is determined by the human-subject test for the person of being trained to), the person of being trained to repeat this track, the person's of being trained to eye
Dynamic rail mark is consistent with track is presented, and track disappears, inconsistent with track, is flashed by inconsistent, prompts to repeat to watch this track attentively,
Until being completely superposed.
According to trainer's complete independently situation in the step 6, judge that continuing current training mission still carries out next instruction
It is identical with step 4 to practice the mode of task, can also be simplified, watches sequence attentively with carrying when only calculating trainer's complete independently task
Show the distance between sequence of symbol, if distance exceedes certain threshold value, continue current training mission, conversely, carrying out next instruction
Practice task.
In order to more clearly illustrate the present invention, the task and its guiding of three task modules are illustrated below.
Experience module in space
Size：For training the size perception for the person of being trained to, different size of object or sky are set in training mission
Between for user select.For example, placing multiple cups of different sizes on desk, training mission requirement can be that " please pick up maximum
Cup ", when detecting that the person of being trained to watches one of cup attentively, and when fixation time exceedes certain threshold value, this cup is made
For the selection result for the person of being trained to, judge whether the selection result is correct.Alternatively, can in order to strengthen user-interaction experience
So that after the selection result for the person of being trained to is judged, the action of " picking up " is simulated to the result.If the completion for the person of being trained to
Situation does not meet expection, calls the dynamic guiding cognitive training module of eye, display reminding marks in current task picture, it is preferable that
According to a graded, display reminding marks on the multiple cup successively, and the guiding person of being trained to follows mark to be searched, directly
Display reminding mark on to the cup in maximum, so as to guide the person of being trained to find the cup of maximum.
Density：For training the person of being trained to set multiple skies of different densities in training mission to how many recognition capabilities
Between.For example, setting multiple rooms, how much different the number of articles put is, and training mission requirement can be that " come in, and to enter thing minimum
Room ", when detecting that the person of being trained to watches one of room attentively, and when fixation time exceedes certain threshold value, this room is made
For the selection result for the person of being trained to, judge whether the selection result is correct.It is alternatively possible to judging the choosing for the person of being trained to
After selecting result, the effect in room is come into simulation.If the performance for the person of being trained to does not meet expection, call eye to move guiding and recognize
Know training module, display reminding marks in current task picture, it is preferable that according to a graded successively in the multiple room
Upper display reminding mark, the guiding person of being trained to follow mark to be searched, until the display reminding mark on the minimum room of density
Note, so as to guide the person of being trained to find the minimum room of thing.
Just/length：For training the person of being trained to set different length in training mission to length or the recognition capability of height
Short object.For example, the broom of different length is placed in corner, training mission requirement is " please select the broom most grown ", equally will
Fixation time exceedes the broom alternatively result of certain threshold value.Alternatively, upon selection, what simulation broom was lifted is dynamic
Make.If the performance for the person of being trained to does not meet expection, the dynamic guiding cognitive training module of eye is called, is shown in current task picture
Show cue mark, it is preferable that according to a graded successively on the multiple broom display reminding mark, guiding the person of being trained to
Searched with mark, until display reminding marks on most long broom, so as to guide the person of being trained to find most long broom.
Shape：For training the person of being trained to the recognition capability of shape, set in training mission object of different shapes or
Space, for example, object of different shapes is placed in room, for example (,) ball, cup, desk etc., training mission requirement " selection roundel
Body ", fixation time is equally exceeded to the object alternatively result of certain threshold value.Alternatively, upon selection, spheroid is simulated to jump
Dynamic action.If the performance for the person of being trained to does not meet expection, the dynamic guiding cognitive training module of eye is called, is drawn in current task
Display reminding marks in face, it is preferable that according to a graded, display reminding marks on the multiple object successively, guides and is instructed
White silk person follows mark to be searched, until display reminding marks on ball, so as to guide the person of being trained to find ball.
Space judge module
The space judge module is higher compared with space experience module difficulty.It is main to include with task：
Spatial relationship：For training the person of being trained to identify the object of particular orientation, including dimensional orientation and space length
Training.
Wherein, the dimensional orientation is used for the direction discernment ability for training the person of being trained to, including the side using itself as reference
To identification, and the direction discernment using specified object as reference.For example, setting the crossroad scene of road, training mission will
Ask as " please turn right ", after the person of being trained to performs selection operation, scene is changed according to the person of being trained to visual angle；For another example
Multiple different fruit placed side by side on table, training mission require " fruit that please pick up the apple left side ", and the person of being trained to performs selection
After operation, pick-up is performed to selection result.If the performance for the person of being trained to does not meet expection, the dynamic guiding cognition of eye is called
Training module, in current task picture display reminding mark, it is preferable that at the parting of the ways in scene current location left and right two
Display reminding marks repeatedly for side, and the guiding person of being trained to follows mark to watch attentively, eventually stops at right side, or, directly in current location
Right side flash for prompting mark, so as to guide the person of being trained to remember which side right side is.
The space length is used for the perception for training the person's of being trained to distance, the same distance included using itself as reference
Identified with the distance using specified object as reference.Such as street scene is set, training mission requirement is that " please come into nearest apart from you
House ", the person's of being trained to fixation time is exceeded to the house alternatively result of certain threshold value, and simulate the effect for coming into house
Fruit.If the performance for the person of being trained to does not meet expection, the dynamic guiding cognitive training module of eye is called, is shown in current task picture
Show cue mark, it is preferable that the house on current location periphery is marked according to certain order successively display reminding, guiding is trained to
Person follows mark to watch attentively, eventually stops on nearest house.
Object connects：For training cognitive ability of the person of being trained to order, multiple objects are set in training mission, instructed
White silk person need to sort to these objects as requested；For example, there is the child of different height in cell scenario, mission requirements " please be helped
These children are helped to be lined up ", the person of being trained to watches these children attentively according to order from high in the end or from low to high successively, from
And complete task.If the performance for the person of being trained to does not meet expection, the dynamic guiding cognitive training module of eye is called, in current task
Display reminding marks in picture, it is preferable that all children is marked according to certain order successively display reminding, guiding is trained to
Person follows mark to watch attentively, eventually stops at highest child, and the child falls out；Then most remaining child is according to one
Display reminding marks fixed order successively, and the guiding person of being trained to follows mark to watch attentively, eventually stops at wherein with highest child,
The child falls out, and stands before first child to fall out, by that analogy.
Embedded figure：For training recognition capability of the person of being trained to certain objects, an object is given in training mission,
With a scene comprising the object, it is desirable to which the person of being trained to finds the object in the scene.For example, give a vase
Picture and a room for placing many objects, it is desirable to which the person of being trained to finds the vase in picture in the room.If
The performance for the person of being trained to does not meet expection, calls the dynamic guiding cognitive training module of eye, shows and carry in current task picture
Indicating is remembered, it is preferable that the object in room successively display reminding is marked according to certain order (such as since nearest), drawn
Lead the person of being trained to and follow label lookup, eventually stop on the vase in room.
Instruction walking：For training the person's of being trained to dimensional orientation recognition capability, the destination of walking is given in training mission.
For example, in room scene, walked over to the window from current location.If the performance for the person of being trained to does not meet expection, eye is called to move
Cognitive training module guiding, display reminding marks in current task picture, it is preferable that display reminding marks first before window,
The guiding person of being trained to watches the destination attentively, and then to current location before window, display reminding mark, the guiding person of being trained to obtain successively
Know this paths.
Spatial operation module
The spatial operation module is difficulty highest task module.Mainly include following task：
Mobile object：For training the person's of being trained to spatial cognition integration capability, one or more things are given in training mission
Body, training mission are that the object is moved into ad-hoc location.For example, placing a desk in room, one is set on ground
Cup, training mission requirement is " please cup is placed on desk ".If the performance for the person of being trained to does not meet expection, call
The dynamic guiding cognitive training module of eye, display reminding marks in current task picture, it is preferable that the display reminding first on cup
Mark, the guiding person of being trained to watch attentively, and when fixation time exceedes certain threshold value, the cup is lifted, and then watches desktop attentively, is watched attentively
When time exceedes certain threshold value, the cup is placed on desktop.
Select optimal walking path：For training the social adaptation for the person of being trained to, for example, giving quilt in training mission
The virtual scene of cell where trainer, mission requirements is " please arrive supermarket ".Can be that task sets different complexities, example
Such as, difficulty one：As long as the person of being trained to has gone to supermarket i.e. completion task；Difficulty two：The path of the person's of being trained to selection is most convenient
Path be completion task；Difficulty three：Roadblock is set to inform the person of being trained to dead end on road, the person of being trained to can identify
And actively reselect other paths and reach supermarket's ability completion task.If the performance for the person of being trained to does not meet expection, call
The dynamic guiding cognitive training module of eye, display reminding marks in current task picture, it is preferable that to super since current location
Display reminding marks successively on the path in city, and the guiding person of being trained to follows the mark to watch attentively, completes walking motion；Can be with a plurality of
Path is all prompted, and knowing the person of being trained to has a plurality of optional path.
The user interface meets hospital's diagnosis and therapy system interface, and it is anti-to may also include the person's of being trained to state of an illness enquiry module, result
Present module etc..
The data obtained in rehabilitation training and analysis obtains can be realized data sharing by the system by LAN, from
And the person of being trained to can also be carried out continuing to train based on previous historical data on different devices.
The present invention carries out the training of spatial cognition based on virtual reality scenario to the person of being trained to, using the teaching of the invention it is possible to provide real scene,
The person of being trained to is set to have the sense of reality, thus relative to two-dimension picture or figure, it is more ecological；The present invention is based on the person of being trained to instruction
The performance for practicing task is analyzed, and differentiates the obstacle feature for the person of being trained to, and the obstacle feature based on the person of being trained to is carried out
Targetedly aiming drill, thus the present invention can be to the crowd of different dysopias, adaptive adjustment boot policy.
It will be understood by those skilled in the art that above-mentioned each module of the invention or each step can use general computer
Device realizes that alternatively, they can be realized with the program code that computing device can perform, it is thus possible to they are deposited
Storage performed in the storage device by computing device, either they are fabricated to respectively each integrated circuit modules or by it
In multiple modules or step be fabricated to single integrated circuit module to realize.The present invention is not restricted to any specific hardware
With the combination of software.
Although above-mentioned the embodiment of the present invention is described with reference to accompanying drawing, model not is protected to the present invention
The limitation enclosed, one of ordinary skill in the art should be understood that on the basis of technical scheme those skilled in the art are not
Need to pay various modifications or deformation that creative work can make still within protection scope of the present invention.
Claims (10)
- A kind of 1. spatial cognition rehabilitation training system based on virtual reality and the dynamic tracking of eye, it is characterised in that including：Virtual reality device, it includes situation display module, for display virtual real scene and training mission situation；Infrared ray eye moves tracking component, for obtaining eye of the person of being trained in training mission requirement completion task process in real time Dynamic data, and transmit to data analysis module；Data analysis module, for the data analysis person of being trained to that is obtained according to the dynamic tracking component of eye when completing situation task The dynamic index of eye, evaluates the visual space machining feature of testee, and transmits the result to the dynamic guiding cognitive training module of eye；The dynamic guiding cognitive training module of eye, carried out for calling different eyes to move prompting mode according to the visual space machining feature Guiding processing.
- 2. spatial cognition rehabilitation training system as claimed in claim 1, it is characterised in that the system also includes behavioral data Acquisition component, for gathering the limbs behavioral data of trainer and transmitting to data analysis module.
- 3. spatial cognition rehabilitation training system as claimed in claim 1, it is characterised in that the eye, which moves index, includes blinkpunkt Position, interest region, the first fixation duration to interest region, fixation times, duration of fixation, twitching of the eyelid amplitude and watch rail attentively Mark.
- 4. spatial cognition rehabilitation training system as claimed in claim 1, it is characterised in that the visual space machining feature is For the complete independently situation of current training mission, the performance represented trainer by way of scoring；The scoring Determination method be：The prompt sequence of current task is obtained from the dynamic guiding cognitive training module of eye, trainer is calculated and completes Eye during task moves the distance between sequence of sequence and prompt；Obtain trainer and complete the fixation times of task, interest Area's first fixation duration, duration of fixation and twitching of the eyelid amplitude, the scoring using the weighted sum of above index as training result.
- 5. spatial cognition rehabilitation training system as claimed in claim 1, it is characterised in that the virtual reality device also includes Housing and the optical frames cup for being placed in enclosure interior；The dynamic tracking component of the infrared ray eye is integrated in virtual reality device, that is, is put In the enclosure interior of virtual reality device.
- 6. spatial cognition rehabilitation training system as claimed in claim 1, it is characterised in that the display module is in training mission The requirement of the training mission is shown during beginning；OrThe system can also include voice module, the requirement of training mission described in speech play when training mission starts；OrThe display module shows the requirement of the training mission when training mission starts, while the voice module plays institute The requirement of training mission is stated, now the system also includes voice module.
- 7. spatial cognition rehabilitation training system as claimed in claim 1, it is characterised in that the training mission module of spatial cognition Including：Space experience task module, space judge task module and spatial operation task module, three task module grade of difficulty Strengthen successively, and the task of different complexities is also provided with each task module.
- 8. a kind of spatial cognition recovery training method based on any one of claim 1-7 system, it is characterised in that including following Step：Step 1：Receive selection of the user to virtual reality scenario and selection training mission scene；Step 2：The virtual reality scenario and the training mission are shown, and starts eye-tracking component；Step 3：Gather the eye during trainer requires completion task according to current training mission and move index；Step 4：The optimal completion result that index and current training mission are moved based on the eye is analyzed and processed, and obtains training knot Fruit, if training result calls the dynamic guiding cognitive training module of eye, into step 5, conversely, carrying out next training less than expection Task；Step 5：The dynamic guiding cognitive training module of the eye shows guidance information in current training mission picture, trainer according to The guidance information completes the training mission；Step 6：The training mission is only shown, by trainer's complete independently, according to trainer's complete independently situation, judges to continue Current training mission still carries out next training mission.
- 9. spatial cognition recovery training method as claimed in claim 8, it is characterised in that training of judgement knot in the step 4 Whether fruit includes less than expection：The prompt sequence of current task is obtained from the dynamic guiding cognitive training module of eye, calculates training Eye when person completes task moves the distance between sequence of sequence and prompt；It is secondary to obtain watching attentively for trainer's completion task Number, region of interest first fixation duration, duration of fixation and twitching of the eyelid amplitude, using the weighted sum of above index as training result Scoring；The prompt sequence of the current task is optimal completion result.
- 10. spatial cognition recovery training method as claimed in claim 8, it is characterised in that described to be completed according to guidance information The implementation of training mission is：Display reminding symbol on display module, when the person's of being trained to blinkpunkt overlaps with prompt, enter Enter next prompt；When the person's of being trained to blinkpunkt and prompt are inconsistent, prompt flicker, the person of being trained to is reminded Pay attention to prompt；OrOne section of eye movement is presented on display module, the person of being trained to repeats this track, and the person's of being trained to eye movement is with being presented track Unanimously, track disappears, inconsistent with track, is flashed at inconsistent place, prompts to repeat to watch this track attentively, until being completely superposed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710719123.4A CN107519622A (en) | 2017-08-21 | 2017-08-21 | Spatial cognition rehabilitation training system and method based on virtual reality and the dynamic tracking of eye |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710719123.4A CN107519622A (en) | 2017-08-21 | 2017-08-21 | Spatial cognition rehabilitation training system and method based on virtual reality and the dynamic tracking of eye |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107519622A true CN107519622A (en) | 2017-12-29 |
Family
ID=60681563
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710719123.4A Pending CN107519622A (en) | 2017-08-21 | 2017-08-21 | Spatial cognition rehabilitation training system and method based on virtual reality and the dynamic tracking of eye |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107519622A (en) |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108309327A (en) * | 2018-01-30 | 2018-07-24 | 中国人民解放军海军总医院 | A kind of test and appraisal of vision attention distribution capability and training method |
| CN108345386A (en) * | 2018-02-09 | 2018-07-31 | 万间网络科技（天津）有限公司 | The method and apparatus for realizing construction safety examination based on virtual reality technology |
| CN108542404A (en) * | 2018-03-16 | 2018-09-18 | 成都虚实梦境科技有限责任公司 | Attention appraisal procedure, device, VR equipment and readable storage medium storing program for executing |
| CN109192278A (en) * | 2018-08-28 | 2019-01-11 | 齐辉 | Interactive approach and system based on virtual reality |
| CN109394246A (en) * | 2018-10-26 | 2019-03-01 | 中国人民解放军第0医院 | A kind of neuropsychological cognition assessment system |
| CN109445578A (en) * | 2018-10-12 | 2019-03-08 | 上海陈天桥脑疾病研究所 | A kind of cognitive ability assessment system and method |
| CN109616193A (en) * | 2018-12-21 | 2019-04-12 | 杭州颐康医疗科技有限公司 | A kind of virtual reality cognitive rehabilitation method and system |
| CN109840943A (en) * | 2019-01-25 | 2019-06-04 | 天津大学 | Three-dimensional visualization analysis method and system |
| CN109925678A (en) * | 2019-03-01 | 2019-06-25 | 北京七鑫易维信息技术有限公司 | A kind of training method based on eye movement tracer technique, training device and equipment |
| CN109933193A (en) * | 2019-03-01 | 2019-06-25 | 北京体育大学 | Intelligent auxiliary training system based on sportsman's eye movement information real-time capture |
| CN109976530A (en) * | 2019-04-08 | 2019-07-05 | 贵州大学 | A kind of VR system cognizant load quantitative estimation method |
| CN110095825A (en) * | 2019-06-06 | 2019-08-06 | 安徽砺剑防务科技有限公司 | A kind of public place safety check contraband identifying system and identification device |
| CN110213568A (en) * | 2019-04-16 | 2019-09-06 | 浙江大学 | A kind of eyes protecting system based on augmented reality and data analysis |
| CN110673719A (en) * | 2019-08-21 | 2020-01-10 | 东北大学 | VR-based spatial cognitive ability training method and system |
| CN110786825A (en) * | 2019-09-30 | 2020-02-14 | 浙江凡聚科技有限公司 | Spatial perception detuning training system based on virtual reality visual and auditory pathway |
| CN110970130A (en) * | 2019-12-30 | 2020-04-07 | 段新 | Data processing method for attention defect hyperactivity disorder |
| CN111223363A (en) * | 2020-02-11 | 2020-06-02 | 杭州同绘科技有限公司 | Incremental attention training method based on VR and eye tracker |
| CN111249596A (en) * | 2020-02-11 | 2020-06-09 | 杭州同绘科技有限公司 | Attention training method based on VR and eye tracker |
| CN111260984A (en) * | 2020-01-20 | 2020-06-09 | 北京津发科技股份有限公司 | Multi-person cooperative cognitive ability training method and device and storage medium |
| CN111317448A (en) * | 2020-03-03 | 2020-06-23 | 南京鼓楼医院 | Method and system for analyzing visual space cognition |
| US10726584B2 (en) | 2018-11-28 | 2020-07-28 | International Business Machines Corporation | Displaying a virtual eye on a wearable device |
| CN112735192A (en) * | 2020-12-10 | 2021-04-30 | 东南大学 | Image interpretation ability training system and method based on expert eye movement signal guidance |
| CN113256126A (en) * | 2021-05-31 | 2021-08-13 | 樊天放 | System and method for detecting training effect based on eye focus position |
| CN113842290A (en) * | 2020-06-28 | 2021-12-28 | 北京清华长庚医院 | Ankle training system, method, apparatus and storage medium |
| CN114190891A (en) * | 2021-12-02 | 2022-03-18 | 杭州极智医疗科技有限公司 | Unilateral neglect evaluation system based on eye movement tracking and immersive driving platform |
| CN114305420A (en) * | 2021-12-30 | 2022-04-12 | 上海卓道医疗科技有限公司 | Cognitive rehabilitation training evaluation system and method |
| WO2023245696A1 (en) * | 2022-06-23 | 2023-12-28 | 东南大学 | Robot-assisted hand-eye coordination training system based on smooth eye-movement pursuit and guiding force field |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010102037A2 (en) * | 2009-03-03 | 2010-09-10 | The Ohio State University | Gaze tracking measurement and training system and method |
| CN103748599A (en) * | 2011-05-20 | 2014-04-23 | 爱福露恩斯公司 | Systems and methods for measuring reactions of head, eyes, eyelids and pupils |
| US20160220439A1 (en) * | 2015-01-30 | 2016-08-04 | Magno Processing Systems, Inc. | Visual rehabilitation systems and methods |
| CN205721634U (en) * | 2016-05-16 | 2016-11-23 | 上海青研科技有限公司 | A kind of wear-type eye control virtual reality device |
| CN206162388U (en) * | 2016-08-31 | 2017-05-10 | 博睿康科技（常州）股份有限公司 | Mutual wearing system of brain machine |
| CN106843500A (en) * | 2017-02-27 | 2017-06-13 | 南通大学 | Human-subject test rehabilitation training system based on the dynamic tracer technique of eye |
| CN106923785A (en) * | 2017-02-17 | 2017-07-07 | 大辅科技（北京）有限公司 | Vision screening system based on virtual reality technology |
| CN107028738A (en) * | 2017-06-21 | 2017-08-11 | 常州快来信息科技有限公司 | Vision-training system, intelligent terminal and the helmet moved based on eye |
-
2017
- 2017-08-21 CN CN201710719123.4A patent/CN107519622A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010102037A2 (en) * | 2009-03-03 | 2010-09-10 | The Ohio State University | Gaze tracking measurement and training system and method |
| CN103748599A (en) * | 2011-05-20 | 2014-04-23 | 爱福露恩斯公司 | Systems and methods for measuring reactions of head, eyes, eyelids and pupils |
| US20160220439A1 (en) * | 2015-01-30 | 2016-08-04 | Magno Processing Systems, Inc. | Visual rehabilitation systems and methods |
| CN205721634U (en) * | 2016-05-16 | 2016-11-23 | 上海青研科技有限公司 | A kind of wear-type eye control virtual reality device |
| CN206162388U (en) * | 2016-08-31 | 2017-05-10 | 博睿康科技（常州）股份有限公司 | Mutual wearing system of brain machine |
| CN106923785A (en) * | 2017-02-17 | 2017-07-07 | 大辅科技（北京）有限公司 | Vision screening system based on virtual reality technology |
| CN106843500A (en) * | 2017-02-27 | 2017-06-13 | 南通大学 | Human-subject test rehabilitation training system based on the dynamic tracer technique of eye |
| CN107028738A (en) * | 2017-06-21 | 2017-08-11 | 常州快来信息科技有限公司 | Vision-training system, intelligent terminal and the helmet moved based on eye |
Non-Patent Citations (4)
| Title |
|---|
| 励建安等: "《康复治疗技术新进展》", 31 July 2015 * |
| 杨霞等: "《儿童感觉综合训练实用手册》", 31 March 2006 * |
| 王茂斌: "《康复医学科》", 31 October 2014 * |
| 黄世敬: "《老年痴呆早期信号及防治》", 31 August 2014 * |
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108309327A (en) * | 2018-01-30 | 2018-07-24 | 中国人民解放军海军总医院 | A kind of test and appraisal of vision attention distribution capability and training method |
| CN108345386A (en) * | 2018-02-09 | 2018-07-31 | 万间网络科技（天津）有限公司 | The method and apparatus for realizing construction safety examination based on virtual reality technology |
| CN108542404A (en) * | 2018-03-16 | 2018-09-18 | 成都虚实梦境科技有限责任公司 | Attention appraisal procedure, device, VR equipment and readable storage medium storing program for executing |
| CN108542404B (en) * | 2018-03-16 | 2021-02-12 | 成都虚实梦境科技有限责任公司 | Attention evaluation device, VR device, and readable storage medium |
| CN109192278A (en) * | 2018-08-28 | 2019-01-11 | 齐辉 | Interactive approach and system based on virtual reality |
| CN109445578A (en) * | 2018-10-12 | 2019-03-08 | 上海陈天桥脑疾病研究所 | A kind of cognitive ability assessment system and method |
| CN109394246A (en) * | 2018-10-26 | 2019-03-01 | 中国人民解放军第0医院 | A kind of neuropsychological cognition assessment system |
| US11151750B2 (en) | 2018-11-28 | 2021-10-19 | International Business Machines Corporation | Displaying a virtual eye on a wearable device |
| US10726584B2 (en) | 2018-11-28 | 2020-07-28 | International Business Machines Corporation | Displaying a virtual eye on a wearable device |
| CN109616193A (en) * | 2018-12-21 | 2019-04-12 | 杭州颐康医疗科技有限公司 | A kind of virtual reality cognitive rehabilitation method and system |
| CN109840943A (en) * | 2019-01-25 | 2019-06-04 | 天津大学 | Three-dimensional visualization analysis method and system |
| CN109933193A (en) * | 2019-03-01 | 2019-06-25 | 北京体育大学 | Intelligent auxiliary training system based on sportsman's eye movement information real-time capture |
| CN109925678A (en) * | 2019-03-01 | 2019-06-25 | 北京七鑫易维信息技术有限公司 | A kind of training method based on eye movement tracer technique, training device and equipment |
| CN109976530A (en) * | 2019-04-08 | 2019-07-05 | 贵州大学 | A kind of VR system cognizant load quantitative estimation method |
| CN110213568A (en) * | 2019-04-16 | 2019-09-06 | 浙江大学 | A kind of eyes protecting system based on augmented reality and data analysis |
| CN110095825B (en) * | 2019-06-06 | 2020-11-13 | 安徽砺剑防务科技有限公司 | Contraband identification system and identification device for public place security inspection |
| CN110095825A (en) * | 2019-06-06 | 2019-08-06 | 安徽砺剑防务科技有限公司 | A kind of public place safety check contraband identifying system and identification device |
| CN110673719A (en) * | 2019-08-21 | 2020-01-10 | 东北大学 | VR-based spatial cognitive ability training method and system |
| CN110786825A (en) * | 2019-09-30 | 2020-02-14 | 浙江凡聚科技有限公司 | Spatial perception detuning training system based on virtual reality visual and auditory pathway |
| CN110786825B (en) * | 2019-09-30 | 2022-06-21 | 浙江凡聚科技有限公司 | Spatial perception detuning training system based on virtual reality visual and auditory pathway |
| CN110970130A (en) * | 2019-12-30 | 2020-04-07 | 段新 | Data processing method for attention defect hyperactivity disorder |
| CN111260984A (en) * | 2020-01-20 | 2020-06-09 | 北京津发科技股份有限公司 | Multi-person cooperative cognitive ability training method and device and storage medium |
| CN111260984B (en) * | 2020-01-20 | 2022-03-01 | 北京津发科技股份有限公司 | Multi-person cooperative cognitive ability training method and device and storage medium |
| CN111223363A (en) * | 2020-02-11 | 2020-06-02 | 杭州同绘科技有限公司 | Incremental attention training method based on VR and eye tracker |
| CN111249596A (en) * | 2020-02-11 | 2020-06-09 | 杭州同绘科技有限公司 | Attention training method based on VR and eye tracker |
| CN111317448A (en) * | 2020-03-03 | 2020-06-23 | 南京鼓楼医院 | Method and system for analyzing visual space cognition |
| CN111317448B (en) * | 2020-03-03 | 2024-01-02 | 南京鼓楼医院 | Method and system for analyzing visual space cognition |
| CN113842290A (en) * | 2020-06-28 | 2021-12-28 | 北京清华长庚医院 | Ankle training system, method, apparatus and storage medium |
| CN113842290B (en) * | 2020-06-28 | 2022-09-16 | 北京清华长庚医院 | Ankle training system, method, apparatus and storage medium |
| CN112735192A (en) * | 2020-12-10 | 2021-04-30 | 东南大学 | Image interpretation ability training system and method based on expert eye movement signal guidance |
| CN113256126A (en) * | 2021-05-31 | 2021-08-13 | 樊天放 | System and method for detecting training effect based on eye focus position |
| CN114190891A (en) * | 2021-12-02 | 2022-03-18 | 杭州极智医疗科技有限公司 | Unilateral neglect evaluation system based on eye movement tracking and immersive driving platform |
| CN114190891B (en) * | 2021-12-02 | 2023-11-10 | 杭州极智医疗科技有限公司 | Unilateral neglect evaluation system based on eye tracking and immersive driving platform |
| CN114305420A (en) * | 2021-12-30 | 2022-04-12 | 上海卓道医疗科技有限公司 | Cognitive rehabilitation training evaluation system and method |
| WO2023245696A1 (en) * | 2022-06-23 | 2023-12-28 | 东南大学 | Robot-assisted hand-eye coordination training system based on smooth eye-movement pursuit and guiding force field |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107519622A (en) | Spatial cognition rehabilitation training system and method based on virtual reality and the dynamic tracking of eye | |
| US11367364B2 (en) | Systems and methods for movement skill analysis and skill augmentation | |
| JP5356690B2 (en) | Method, system, and program for tracking a range of physical movement of a user | |
| US9345957B2 (en) | Enhancing a sport using an augmented reality display | |
| US10755466B2 (en) | Method and apparatus for comparing two motions | |
| US7878945B2 (en) | Adaptive training system with aerial mobility system | |
| US9498720B2 (en) | Sharing games using personal audio/visual apparatus | |
| CN110739040A (en) | rehabilitation evaluation and training system for upper and lower limbs | |
| CN105027030A (en) | Wireless wrist computing and control device and method for 3d imaging, mapping, networking and interfacing | |
| KR101317383B1 (en) | Cognitive ability training apparatus using robots and method thereof | |
| CN107080932A (en) | Reconditioning method and system based on recognition of face and motion capture | |
| KR20210121616A (en) | Health care device, system and method | |
| CN113709411A (en) | Sports auxiliary training system of MR intelligent glasses based on eye movement tracking technology | |
| KR20090045640A (en) | System and method for a correcting pose of golfer using an artificial intelligence caddy | |
| CN110989839B (en) | System and method for man-machine fight | |
| CN109701229A (en) | User for body-building moves completeness assessment system | |
| JP7012631B2 (en) | Object identification device, identification system and identification method | |
| US20230285806A1 (en) | Systems and methods for intelligent fitness solutions | |
| CN110929595A (en) | System and method for training or entertainment with or without ball based on artificial intelligence | |
| KR20210000170A (en) | Brain virtual reality system | |
| Ramsay et al. | Body pose sonification for a view-independent auditory aid to blind rock climbers | |
| Yao et al. | RETRACTED ARTICLE: A smart position optimization scheme for badminton doubles based on human–computer interactive training in wireless sensor networks | |
| CN114581835A (en) | Intelligent video teaching method and system for realizing motion recognition | |
| CN111625098A (en) | Intelligent virtual avatar interaction method and device based on multi-channel information fusion | |
| CN115712405B (en) | Picture presentation method and device, intelligent body-building display equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171229 |