CN113012513A

CN113012513A - Training method and system for shopping ability of autism patient

Info

Publication number: CN113012513A
Application number: CN202110261812.1A
Authority: CN
Inventors: 杜亚松
Original assignee: Shanghai Mental Health Center (shanghai Psychological Counseling Training Center)
Current assignee: Shanghai Mental Health Center (shanghai Psychological Counseling Training Center)
Priority date: 2021-03-10
Filing date: 2021-03-10
Publication date: 2021-06-22

Abstract

According to the training method and system for the shopping ability of the autism patient, the shopping ability of the autism patient is evaluated in detail, and a training scene for training task difficulty step by step is set according to the detailed evaluation, wherein the method comprises the steps of evaluating the shopping ability level of the patient; then providing virtual reality training contents of corresponding levels according to the shopping capacity levels of the patients, wherein the training contents are used for providing scenes of immersive training and training tasks thereof; and finally, acquiring a patient action instruction, and estimating the shopping capacity grade of the patient again according to the action instruction so as to determine the virtual reality training content accepted by the patient again and having the corresponding grade.

Description

Training method and system for shopping ability of autism patient

Technical Field

The invention relates to the field of auxiliary rehabilitation training, in particular to a training method and a training system for shopping capacity of an autism patient.

Background

Autism Spectrum Disorder (ASD) is a neurodevelopmental Disorder with core symptoms of persistent deficits in social communication and social interaction, as well as restricted, repetitive, stereotyped patterns of behavior, interests, activities. Most ASD patients have severe intellectual and life-skill deficits in addition to core symptoms. Daily shopping is one of the most basic living skills of people in social life, but many ASD patients cannot finish the shopping independently. Training for shopping this living skill presents challenges to this segment of patients. Training in a real environment has certain risks, such as loss, cheating and the like, and professional personnel or family personnel are required to be equipped for accompanying, so that a large amount of manpower and material resources are consumed. If the classroom environment simulation training is carried out, real scenes of real markets, supermarkets and the like are difficult to restore, and even if some skills are acquired, the real scenes are difficult to really apply.

With the continuous development of Virtual Reality (VR) technology, VR systems increasingly emphasize operator interactivity and immersion. The immersive Virtual Reality (VR) technology is a technology that uses a head-mounted virtual reality device to isolate the real visual and auditory senses of a user and generate a virtual visual and auditory sense. The user can also interact with the virtual world using a dedicated glove or handle, thereby creating a feeling of being completely in a virtual environment. The scholars believe that the stimulation and experience received by the subject in the immersive VR scene is better, and that immersive VR is more advantageous in social interaction and more suitable for psychosocial applications than traditional VR. Also started for the training of ASD.

With the increasing commercialization of the related industries in the field of virtual reality, the cost and price of the related virtual reality devices are reduced, making possible the larger-scale use of virtual reality in combination with training aids and treatment of autism.

Disclosure of Invention

The invention aims to provide a method and a system for training the shopping capacity of an autistic patient, so as to solve the problems in the prior art.

In order to achieve the above object, the present invention provides a training method for shopping ability of an autism patient, comprising the following steps:

assessing a patient shopping ability level;

providing virtual reality training contents of corresponding levels according to the shopping capacity level of a patient, wherein the training contents are used for providing scenes of immersive training and training tasks thereof;

and acquiring a patient action instruction, and evaluating the shopping capacity grade of the patient again according to the action instruction so as to determine that the patient accepts the virtual reality training content of the corresponding grade again.

Further, the method generates a virtual reality training scene according to the combination of different scene models, wherein the scene models comprise an equipment model, a tool model and an auxiliary model.

Furthermore, the training task provides training prompts in a training scene, the training prompts comprise voice prompts, text prompts and arrow on/off selections, and the action feedback of the patient is acquired through the walking control device, the upper limb interaction device and the human eye movement track acquisition device.

Further, the method records and scores the completion time and accuracy of the training task according to the action instruction of the patient.

Further, the training task comprises a plurality of task nodes, and the completion degree of the training task is evaluated according to the completion degree and the timing of the task nodes.

In another aspect, the present invention further provides a system for training shopping ability of an autism patient, including:

the interaction module is used for acquiring action instructions of a patient and providing human-computer interaction with a virtual reality training scene;

the scene model is used for providing different virtual reality training scenes, and the virtual reality training scenes are called and established through the task module;

and the task module is used for evaluating the shopping ability level of the patient and providing a virtual reality training task with a corresponding level.

Further, the interaction module comprises:

the view audio unit is used for providing voice prompt, scene sound effect, marking prompt and text description in a scene;

and the control and interaction unit is used for connecting and controlling the human-computer interaction equipment, and the human-computer interaction equipment comprises a VR helmet, a treadmill, a sensing glove, a hand positioning device and an eye movement tracking device.

Further, the scene model generates a virtual reality training scene according to a combination of different scene models, and the scene models include an equipment model, a tool model and an auxiliary model.

Further, the task module includes:

the task deployment unit is used for setting the difficulty level of the virtual reality training task and characters in the scene;

and the task monitoring unit is used for collecting user feedback data and carrying out statistics.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.

FIG. 1 is a flowchart of a method for training shopping ability of an autistic patient according to an embodiment of the present invention;

fig. 2 is a block diagram of a system for training shopping ability of an autistic patient according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The following describes a virtual reality technology-based autism emotion placating method and system according to an embodiment of the present invention with reference to the accompanying drawings, and first, a virtual reality technology-based autism emotion placating method according to an embodiment of the present invention will be described with reference to the accompanying drawings.

Fig. 1 is a flowchart of an autism emotion soothing method based on a virtual reality technology according to an embodiment of the invention.

As shown in fig. 1, the self-virtual reality technology-based autism emotion placating method comprises the following steps:

the invention provides a training method for shopping ability of an autism patient on one hand, which comprises the following steps:

and S100, evaluating the shopping ability level of the patient.

Specifically, the system first provides a shopping ability assessment questionnaire, and evaluates the shopping ability of the patient before training according to a questionnaire scoring standard.

For example, the questionnaire is subdivided one by one according to the behaviors that need to be reached and completed for completing shopping, and the questionnaire is scored according to whether the patient can complete, and is scored as 0 point when the patient cannot complete, and can complete as 1 point. The questionnaire is embedded into the training system and is completed by the patient according to the interface prompts.

S200, providing virtual reality training contents of corresponding levels according to the shopping capacity levels of the patients, wherein the training contents are used for providing scenes of immersive training and training tasks thereof.

In one embodiment, the virtual reality trained scene is generated from a combination of different scene models, including a device model, a tool model, and an auxiliary model. The device model comprises virtual devices such as a cash desk, an electric door, a shopping machine and a mobile phone, the tool model comprises a shopping cart and various commodities, and the auxiliary model is a building structure, a warning sign, a goods shelf, a billboard, a cashier and the like.

For example, based on supermarket buildings, the model sets are filled in the scenes to generate different scenes. Since the scene involves self-service cash registers and manual cash registers, the devices are changed at the cash register according to the task content.

In one embodiment, the training task is established according to daily shopping needs, corresponding skill training is established according to the difficulty of the user, the user needs to complete the indicating task in sequence, the scene is provided with voice, arrows, highlights and the like to prompt the user to complete the task, auxiliary prompt can be provided for prompting the user that the task is failed to complete, and the scene is faded in and faded out to the previous step.

Specifically, the training task has ten difficulty levels, including: payment training, scanning payment, purchasing single-piece goods, purchasing bulk products, mixed goods purchasing, shopping cart training, self-service cash register single-goods purchase training, self-service cash register multi-goods purchase training, help seeking and comprehensive training. The training of each difficulty level comprises different instructions for guiding a patient to complete corresponding task nodes in a virtual scene, and the interaction of the patient is realized through equipment such as VR helmets, treadmills, sensing gloves, hand positioning devices and eye movement tracking devices.

For example, the payment training task is embodied as the following table:

s300, acquiring a patient action instruction, and re-evaluating the shopping capacity level of the patient according to the action instruction to determine the virtual reality training content accepted by the patient and having the corresponding level again.

In one embodiment, scoring the patient is accomplished by recording the completion time of each task node.

For example, the completion time of each node of the payment training task is shown in the following table:

the task record and scoring rules for payment training are as follows:

the method judges the shopping capacity of the patient by calculating the average score of the task completion of the patient, and the specific calculation method is as follows:

(total number of completed tasks this task score)/number of tasks

And finally, judging the training effect according to the task completion time and the training scoring result after the subject trains:

wherein, in the time dimension, the time of the patient for improving more than or equal to 25% in a single task is judged to be advanced, and the time for improving more than or equal to 50% is judged to be obviously advanced.

In the ability dimension, a patient is judged to have progress by upgrading one training task and is judged to have significant progress by upgrading two training tasks.

Fig. 2 is a block diagram of a system for training shopping ability of an autistic patient according to an embodiment of the present invention. As shown in fig. 2, the training system for shopping ability of autistic patient of the present invention comprises: an interaction module 1, a scene model 2 and a task module 3.

And the interaction module 1 is used for acquiring action instructions of a patient and providing human-computer interaction with a virtual reality training scene.

Wherein, the interaction module 1 comprises:

the view audio unit 11 is used for providing voice prompts, scene sound effects, annotation prompts and text descriptions in scenes;

and the control and interaction unit 12 is used for connecting and controlling human-computer interaction equipment, and the human-computer interaction equipment comprises a VR helmet, a treadmill, a sensing glove, a hand positioning device and an eye movement tracking device.

And the scene model 2 is used for providing different virtual reality training scenes, and the virtual reality training scenes are called and established through the task module.

Specifically, the scene model 2 generates a virtual reality training scene according to a combination of different scene models, and the scene model 2 includes an equipment model 21, a tool model 22, and an auxiliary model 23.

And the task module 3 is used for evaluating the shopping ability level of the patient and providing a virtual reality training task with a corresponding level.

Specifically, the task module includes:

the task deployment unit 31 is used for setting the difficulty level of the virtual reality training task and the characters in the scene.

And the task monitoring unit 32 is used for collecting user feedback data and carrying out statistics.

Specifically, the integrated processing device 3 includes at least one processor and at least one storage medium, and the storage medium stores an operating program. Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or terminal. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A training method for shopping ability of an autism patient is characterized by comprising the following steps:

assessing a patient shopping ability level;

2. The training method for the shopping ability of the autism patient, as claimed in claim 1, wherein the virtual reality training scenario is generated according to a combination of different scenario models, wherein the scenario models comprise a device model, a tool model and an auxiliary model.

3. The training method for the shopping ability of the autistic patient as claimed in claim 2, wherein the training task provides training prompts in the training scene, the training prompts comprise voice, text prompts, arrow on/off selection, and the action feedback of the patient is obtained by the walking control device, the upper limb interaction device and the human eye movement track acquisition device.

4. The method of claim 3, wherein the completion time and accuracy of the training task are recorded and scored according to the action commands of the patient.

5. The method of claim 4, wherein the training task comprises a plurality of task nodes, and the completion of the training task is evaluated according to the completion and timing of the task nodes.

6. An autistic patient shopping ability training system, comprising:

7. The autistic patient shopping ability training system of claim 6, wherein the interaction module comprises:

8. The training system for the shopping ability of the autistic patient according to claim 6, wherein the scenario model generates a virtual reality training scenario according to a combination of different scenario models, and the scenario models include a device model, a tool model and an auxiliary model.

9. The system of claim 6, wherein the task module comprises: