CN117133409A - Auxiliary child autism spectrum disorder rehabilitation system based on VR interaction technology - Google Patents

Auxiliary child autism spectrum disorder rehabilitation system based on VR interaction technology Download PDF

Info

Publication number
CN117133409A
CN117133409A CN202311008664.8A CN202311008664A CN117133409A CN 117133409 A CN117133409 A CN 117133409A CN 202311008664 A CN202311008664 A CN 202311008664A CN 117133409 A CN117133409 A CN 117133409A
Authority
CN
China
Prior art keywords
virtual reality
children
data
module
child
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311008664.8A
Other languages
Chinese (zh)
Inventor
周浩
罗林荫
杨再兰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guizhou Provincial Peoples Hospital
Original Assignee
Guizhou Provincial Peoples Hospital
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guizhou Provincial Peoples Hospital filed Critical Guizhou Provincial Peoples Hospital
Priority to CN202311008664.8A priority Critical patent/CN117133409A/en
Publication of CN117133409A publication Critical patent/CN117133409A/en
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/369—Electroencephalography [EEG]
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235—Details of waveform analysis
    • A61B5/7253—Details of waveform analysis characterised by using transforms
    • A61B5/726—Details of waveform analysis characterised by using transforms using Wavelet transforms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235—Details of waveform analysis
    • A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • A61B5/7267—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
    • G06F18/2131—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on a transform domain processing, e.g. wavelet transform
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/243—Classification techniques relating to the number of classes
    • G06F18/2431—Multiple classes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/048—Activation functions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/469—Contour-based spatial representations, e.g. vector-coding
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/56—Extraction of image or video features relating to colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/70—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mental therapies, e.g. psychological therapy or autogenous training
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00—Evaluating a particular growth phase or type of persons or animals
    • A61B2503/06—Children, e.g. for attention deficit diagnosis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0044—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense
    • A61M2021/005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense images, e.g. video
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • Medical Informatics (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Biophysics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Molecular Biology (AREA)
  • Psychiatry (AREA)
  • Pathology (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Social Psychology (AREA)
  • Computational Linguistics (AREA)
  • Surgery (AREA)
  • Databases & Information Systems (AREA)
  • Psychology (AREA)
  • Physiology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Signal Processing (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Physical Education & Sports Medicine (AREA)

Abstract

The invention discloses a Virtual Reality (VR) -interaction-based system for assisting child autism spectrum disorder rehabilitation, which particularly relates to the technical field of VR interaction, and comprises a virtual reality module, a personalized setting module, an interaction module, an environment control module, a real-time feedback module, a data collection and analysis module and an auxiliary matching module.

Description

Auxiliary child autism spectrum disorder rehabilitation system based on VR interaction technology
Technical Field
The invention relates to the technical field of VR interaction, in particular to a system for assisting in recovery of autism spectrum disorders of children based on VR interaction technology.
Background
Along with the development of virtual reality technology, the guidance and supervision of professional medical team combines the virtual reality technology with a rehabilitation system, and can utilize the scientific technology to the greatest extent to better promote the effect of the rehabilitation of the autism spectrum disorder of children.
The current VR interaction technology has the problem that the specific requirements of each patient cannot be met, more personalized adjustment and customization contents are needed to achieve the optimal effect, sufficient clinical data is lacked to support the rehabilitation effect, and meanwhile, the children autism spectrum disorder is different due to the different symptoms and requirements of each ASD child, and a standardized treatment scheme is lacked, so that the rehabilitation service which is continuously supported is needed.
Disclosure of Invention
In order to overcome the above-mentioned drawbacks of the prior art, embodiments of the present invention provide a VR-interaction-based system for assisting in the rehabilitation of autism spectrum disorders in children, which solves the problems set forth in the above-mentioned background art by means of a virtual reality module, an interaction module and a data collection and analysis module.
In order to achieve the above purpose, the present invention provides the following technical solutions: the system comprises a virtual reality module, a personalized setting module, an interaction module, an environment control module, a real-time feedback module, a data collection and analysis module and an auxiliary matching module;
virtual reality module: the virtual reality system comprises a basic platform and a framework, wherein the basic platform and the framework are used for creating and providing virtual reality experience, and the virtual reality experience is provided through a virtual reality platform, and the basic platform and the framework comprise two subunits of hardware and software;
and the individuation setting module is used for: analyzing the state and the characteristics of the child through sensor data and an image processing technology, correlating the related characteristics with the interests and the rehabilitation demands of the child, and providing different types of virtual scenes and activities;
and an interaction module: detecting the actions of the children in real time through virtual reality hardware, classifying and identifying the characteristics by utilizing a deep learning neural network model, and culturing the interaction capability of children society;
an environment control module: according to the progress and the capability of the children, the difficulty and the challenge of the environment are dynamically adjusted, and the situations of inappropriateness and danger of the children are limited;
and the real-time feedback module is used for: the progress tracking real-time feedback is utilized to evaluate the development of the rehabilitation of the child and make a target of the next step, based on the data analysis of the progress tracking, the system carries out self-adaptive adjustment according to the progress condition of the child;
and the data collection and analysis module is used for: collecting relevant data of children in the personalized setting module and the interaction module, and capturing rapid fluctuation and trend change of the data by an exponential smoothing method through calculating standard deviation of the children in different tasks and frequency distribution of specific skill behaviors;
auxiliary matching module: the virtual reality system is used in an auxiliary mode by using the treatment scheme of the professional doctor through supervision and guidance of behaviors and reactions of the child when the virtual reality technology is used.
In a preferred embodiment, the virtual reality module is used to create and provide a virtual reality experience, comprising two subunits, hardware and software:
step 1, a hardware unit: the device and the facility for creating and transmitting virtual reality experience are characterized in that key devices for providing visual experience by utilizing a head-mounted display comprise a display screen, a sensor, an earphone and an interface connected with a computer and a console, a virtual scene is projected into eyes of a user, the motion and the position of the user are perceived through a perception device, the device comprises a tracker, a camera and a gyroscope, interaction of the virtual scene is realized, the controller and the input device are used for interaction and operation of the user and the virtual environment, the handle, the glove and the touch pen are used for tracking hand actions and gesture recognition.
Step 2, a software unit: the virtual reality system comprises a basic platform and a framework, wherein the basic platform and the framework are used for providing virtual reality experience through a virtual reality platform, the basic platform comprises an operating system, a development tool and an application program interface, the basic platform and the framework are used for constructing virtual reality scenes and functions, three-dimensional models, scenes and roles in a virtual environment are created and designed through 3D modeling and rendering software, developers are helped to establish realistic and high-interactivity virtual reality scenes, the interaction and game engine is utilized for providing core functions of the virtual reality application program, the core functions comprise physical simulation, collision detection and graphic rendering, the development process is simplified through the engine, and various interaction and game characteristics are provided.
In a preferred embodiment, the personalized setting module analyzes the state and the characteristics of the child by using sensor data and an image processing technology, monitors the brain electrical activity of the child through virtual reality hardware, estimates the concentration, the relaxation and the cognitive state of the child according to the electroencephalogram signal of the child, and performs spectrum analysis, wavelet change and time analysis on the electroencephalogram signal by using a state estimation algorithm, wherein the state estimation algorithm is a gaussian kernel density estimation method, and the specific formula is as follows:
where f (x) represents the probability density function estimate at the location, x i The method comprises the steps of representing an ith sample point in a data set, wherein k (x) represents a Gaussian kernel function, h represents a bandwidth parameter, N represents the number of electroencephalogram data, wavelet transformation is continuous wavelet transformation, signals are continuously transformed by utilizing different scales and translation parameters to generate continuous scale images, transformation information of the electroencephalogram at different frequencies and times is provided, time domain analysis is used for analyzing the waveform, amplitude and frequency characteristics of the electroencephalogram, extracting the time domain parameters of the electroencephalogram, observing the periodicity and trend of the signals, performing time analysis and description on the electroencephalogram, extracting characteristics related to cognitive states, associating the related characteristics with interests and rehabilitation requirements of children, providing different types of virtual scenes and activities and guaranteeing content individuation of virtual reality.
In a preferred embodiment, the interaction module is used for interaction between a child and virtual reality, cultivating interaction capability of a child society, collecting a data set of actions performed by the child, including gesture data, expression data, language data and action data, detecting the actions performed by the child in real time through virtual reality hardware, performing graying and clipping processing on the data, extracting colors, shapes and motion characteristics, classifying and identifying the characteristics by using a deep learning neural network model, wherein the deep learning neural network model is a cyclic neural network, and the specific formula is as follows:
Y t ＝g(W h *y*h t +b h )
h t ＝f(W xh *x t +W hh *h t-1 +b h )
wherein W is xh Representing a weight matrix input to the hidden state, W hh The weight matrix representing hidden states to hidden states, f (x) representing an activation function, W h * y represents a weight matrix hiding state to output, b h And (3) representing the bias term, wherein g (x) represents an activation function, dividing the signal data set into a training set, a test set and a verification set, inputting batch data in the training set for iterative training, repeating the iterative training to reach a certain convergence condition, and carrying out parameter adjustment, scale adjustment and structural improvement according to the result of the verification set.
In a preferred embodiment, the environment control module dynamically adjusts the difficulty and challenge of the environment according to the progress and the capability of the child, provides social training suitable for the capability level of the child, monitors the behavior and the response of the child in the virtual reality environment in real time, the system acquires performance data about the child by using virtual reality hardware, analyzes the acquired data, explores the association and trend therein, discovers the characteristics and changes in the social skill level and the development requirement of the child by using statistical analysis and visualization technology, adjusts the roles, moods and tasks in the scene according to the performance of the child, provides a safe and stress-free social exercise place through the virtual reality environment, shields and filters unsuitable speech behaviors through a neural network model of language data, protects the safety and psychological health of the child, limits the contact unsuitable and dangerous situations of the child by using the characteristic of good controllability of the virtual reality system, sets specific scenes and roles, and ensures the social training of the child in the safe environment.
In a preferred embodiment, the real-time feedback module utilizes progress tracking real-time feedback to evaluate the development of children in rehabilitation and make the next target, the system records the behavior data of the children in a virtual reality scene, including their interaction mode, emotional response and accuracy of completing tasks, the system is used for evaluating the performance and progress of the children, the system provides a virtual reality visual interface for displaying the progress and performance of the children, including charts, graphs and statistical information, clearly showing the development of the children in different aspects, makes a personal archive storage cloud by utilizing a database, records the progress history and achievement of the children, the guardian looks at the personal archive of the children at any time, knows the development track of the children, and makes the next target together with a rehabilitation doctor, the system provides feedback and advice related to the progress of the children for the guardian and the doctor, the performance of the children is known through the visual interface of the system, intervention and guidance are performed according to needs, and the system is self-adaptive adjusted according to the progress situation of the children based on the data analysis of the progress tracking.
In a preferred embodiment, the data collection and analysis module collects relevant data of the children in the personalized setting module and the interaction module, the structured data records are subjected to statistical analysis, and the collected data are summarized and described by calculating standard deviation of the children in different tasks and frequency distribution of specific skill behaviors by using descriptive statistical analysis, wherein the formula of the calculated standard deviation is as follows:
wherein S represents the standard deviation of the reaction time, x i Representing the ith data in the sample data set, and n represents the number of sample data points, wherein the frequency distribution formula is as follows:
wherein V represents the frequency distribution, x represents the number of times a particular behavioral classification occurs in the sample, C represents the total number of samples, and for long-term tracked data, using time series analysis to help detect trends and periodic changes in rehabilitation progress, using exponential smoothing to capture rapid fluctuations and trend changes in the data, calculating a smoothed value by a weighted average based principle, the calculated smoothed value having the specific formula:
N＝α*M+(1-α)*m
wherein N represents a smooth value of a time point, alpha represents a smooth parameter, M represents a current observed value, M represents a last smooth value, repeatedly calculating the smooth values of all the time points by iteration, using the last smooth value as a reference, deducing the change trend of future rehabilitation data by weighted average, and knowing the long-term change and short-term fluctuation in the rehabilitation process of the child.
In a preferred embodiment, the auxiliary coordination module monitors and guides the behaviors and reactions of the child when using the virtual reality technology through a professional doctor, ensures that the child uses equipment correctly, performs rehabilitation actions, corrects wrong postures and improper operations in time, provides real-time feedback and adjustment, ensures optimal effects in the rehabilitation process, enables professionals to provide necessary support and resources for the child and parents, solves problems related to the virtual reality technology, provides instructions and notes, assists in solving technical or operational difficulties, provides psychosocial support and education, helps the child and family adapt to changes and challenges in the rehabilitation process, monitors and evaluates the rehabilitation progress of the child regularly by using standardized evaluation tools and methods, tracks functional improvement, rehabilitation effect and treatment effect of the child, optimizes virtual reality treatment scheme through evaluation results, adjusts rehabilitation plan, and provides basis for further intervention.
In a preferred embodiment, the method specifically comprises the following steps:
101. devices and facilities for creating and transmitting virtual reality experiences by using a head-mounted display, a sensing device, a controller and an input device, and a basic platform and a framework for providing the virtual reality experiences through a virtual reality platform;
102. analyzing the states and the characteristics of the children by utilizing sensor data and an image processing technology, correlating the related characteristics with the interests and the rehabilitation demands of the children, providing different types of virtual scenes and activities, and ensuring the individuation of the contents of the virtual reality;
103. collecting a data set of the actions of the children, detecting the actions of the children in real time through virtual reality hardware, classifying and identifying the characteristics by using a deep learning neural network model, and culturing interaction capability of children society;
104. according to the development and the capability of the children, the difficulty and the challenge of the environment are dynamically adjusted, and the situation that the children are unsuitable and dangerous to touch is limited by utilizing the characteristic that a virtual reality system has good controllability;
105. the progress tracking real-time feedback is utilized to evaluate the development of the rehabilitation of the child and make a target of the next step, based on the data analysis of the progress tracking, the system carries out self-adaptive adjustment according to the progress condition of the child;
106. collecting relevant data of children in the personalized setting module and the interaction module, and capturing rapid fluctuation and trend change of the data by an exponential smoothing method through calculating standard deviation of the children in different tasks and frequency distribution of specific skill behaviors;
107. the virtual reality system is used in an auxiliary mode by using the treatment scheme of the professional doctor through supervision and guidance of behaviors and reactions of the child when the virtual reality technology is used.
The invention has the technical effects and advantages that:
according to the invention, a basic platform and a framework of virtual reality experience are provided through a virtual reality platform, the virtual reality experience can be created and provided, the state and the characteristics of children are analyzed through sensor data and an image processing technology, the characteristics are classified and identified by utilizing a deep learning neural network model to interact, the difficulty and the challenge of a control environment are dynamically adjusted, the development and the formulation of the rehabilitation of the children are evaluated by utilizing progress tracking real-time feedback, the rapid fluctuation and the trend change of the data can be captured by utilizing an exponential smoothing method, and the virtual reality system is used in an auxiliary mode by utilizing a professional doctor treatment scheme, so that the children can better understand and cope with various social, emotion and cognitive challenges, the adaptation and interaction of the children in the real world are promoted, the social interaction capability, the language expression capability and emotion cognition of the children are improved, the children are helped to gradually adapt to noise, light and touch sense and integration capability of the children is improved.
Drawings
FIG. 1 is a flow chart of the system of the present invention.
Fig. 2 is a block diagram of the system architecture of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Example 1
The embodiment provides a VR interactive technology-based system for assisting the rehabilitation of autism spectrum disorders in children as shown in fig. 1, which specifically comprises the following steps:
101. devices and facilities for creating and transmitting virtual reality experiences by using a head-mounted display, a sensing device, a controller and an input device, and a basic platform and a framework for providing the virtual reality experiences through a virtual reality platform;
102. analyzing the states and the characteristics of the children by utilizing sensor data and an image processing technology, correlating the related characteristics with the interests and the rehabilitation demands of the children, providing different types of virtual scenes and activities, and ensuring the individuation of the contents of the virtual reality;
103. collecting a data set of the actions of the children, detecting the actions of the children in real time through virtual reality hardware, classifying and identifying the characteristics by using a deep learning neural network model, and culturing interaction capability of children society;
104. according to the development and the capability of the children, the difficulty and the challenge of the environment are dynamically adjusted, and the situation that the children are unsuitable and dangerous to touch is limited by utilizing the characteristic that a virtual reality system has good controllability;
105. the progress tracking real-time feedback is utilized to evaluate the development of the rehabilitation of the child and make a target of the next step, based on the data analysis of the progress tracking, the system carries out self-adaptive adjustment according to the progress condition of the child;
106. collecting relevant data of children in the personalized setting module and the interaction module, and capturing rapid fluctuation and trend change of the data by an exponential smoothing method through calculating standard deviation of the children in different tasks and frequency distribution of specific skill behaviors;
107. the virtual reality system is used in an auxiliary mode by using the treatment scheme of the professional doctor through supervision and guidance of behaviors and reactions of the child when the virtual reality technology is used.
The embodiment provides a VR interactive technology-based system for assisting the rehabilitation of autism spectrum disorders in children as shown in fig. 2, which specifically comprises: the system comprises a virtual reality module, a personalized setting module, an interaction module, an environment control module, a real-time feedback module, a data collection and analysis module and an auxiliary matching module;
virtual reality module: the virtual reality system comprises a basic platform and a framework, wherein the basic platform and the framework are used for creating and providing virtual reality experience, and the virtual reality experience is provided through a virtual reality platform, and the basic platform and the framework comprise two subunits of hardware and software;
and the individuation setting module is used for: analyzing the state and the characteristics of the child through sensor data and an image processing technology, correlating the related characteristics with the interests and the rehabilitation demands of the child, and providing different types of virtual scenes and activities;
and an interaction module: detecting the actions of the children in real time through virtual reality hardware, classifying and identifying the characteristics by utilizing a deep learning neural network model, and culturing the interaction capability of children society;
an environment control module: according to the progress and the capability of the children, the difficulty and the challenge of the environment are dynamically adjusted, and the situations of inappropriateness and danger of the children are limited;
and the real-time feedback module is used for: the progress tracking real-time feedback is utilized to evaluate the development of the rehabilitation of the child and make a target of the next step, based on the data analysis of the progress tracking, the system carries out self-adaptive adjustment according to the progress condition of the child;
and the data collection and analysis module is used for: collecting relevant data of children in the personalized setting module and the interaction module, and capturing rapid fluctuation and trend change of the data by an exponential smoothing method through calculating standard deviation of the children in different tasks and frequency distribution of specific skill behaviors;
auxiliary matching module: the virtual reality system is used in an auxiliary mode by using the treatment scheme of the professional doctor through supervision and guidance of behaviors and reactions of the child when the virtual reality technology is used.
101. Devices and facilities for creating and transmitting virtual reality experiences by using a head-mounted display, sensing equipment, a controller and input equipment, and a basic platform and a framework for providing the virtual reality experiences through a virtual reality platform;
in this embodiment, a specific to be described is a virtual reality module, where the virtual reality module is configured to create and provide a virtual reality experience, and includes two subunits of hardware and software:
step 1, a hardware unit: the device and the facility for creating and transmitting virtual reality experience are characterized in that key devices for providing visual experience by utilizing a head-mounted display comprise a display screen, a sensor, an earphone and an interface connected with a computer and a console, a virtual scene is projected into eyes of a user, the motion and the position of the user are perceived through a perception device, the device comprises a tracker, a camera and a gyroscope, interaction of the virtual scene is realized, the controller and the input device are used for interaction and operation of the user and the virtual environment, the handle, the glove and the touch pen are used for tracking hand actions and gesture recognition.
Step 2, a software unit: the virtual reality system comprises a basic platform and a framework, wherein the basic platform and the framework are used for providing virtual reality experience through a virtual reality platform, the basic platform comprises an operating system, a development tool and an application program interface, the basic platform and the framework are used for constructing virtual reality scenes and functions, three-dimensional models, scenes and roles in a virtual environment are created and designed through 3D modeling and rendering software, developers are helped to establish realistic and high-interactivity virtual reality scenes, the interaction and game engine is utilized for providing core functions of the virtual reality application program, the core functions comprise physical simulation, collision detection and graphic rendering, the development process is simplified through the engine, and various interaction and game characteristics are provided.
102. Analyzing the states and the characteristics of the children by utilizing sensor data and an image processing technology, correlating the related characteristics with the interests and the rehabilitation demands of the children, providing different types of virtual scenes and activities, and ensuring the individuation of the contents of the virtual reality;
in this embodiment, a specific description is provided of a personalized setting module, where the personalized setting module uses sensor data and an image processing technology to analyze the state and characteristics of a child, monitors the brain electrical activity of the child through virtual reality hardware, estimates the concentration, relaxation and cognitive state of the child according to the electroencephalogram signal of the child, and uses a state estimation algorithm to perform spectrum analysis, wavelet change and time analysis on the electroencephalogram signal, where the state estimation algorithm is a gaussian kernel density estimation method, and the specific formula is as follows:
where f (x) represents the probability density function estimate at the location, x i The method comprises the steps of representing an ith sample point in a data set, wherein k (x) represents a Gaussian kernel function, h represents a bandwidth parameter, N represents the number of electroencephalogram data, wavelet transformation is continuous wavelet transformation, signals are continuously transformed by utilizing different scales and translation parameters to generate continuous scale images, transformation information of the electroencephalogram at different frequencies and times is provided, time domain analysis is used for analyzing the waveform, amplitude and frequency characteristics of the electroencephalogram, extracting the time domain parameters of the electroencephalogram, observing the periodicity and trend of the signals, performing time analysis and description on the electroencephalogram, extracting characteristics related to cognitive states, associating the related characteristics with interests and rehabilitation requirements of children, providing different types of virtual scenes and activities and guaranteeing content individuation of virtual reality.
103. Collecting a data set of the actions of the children, detecting the actions of the children in real time through virtual reality hardware, classifying and identifying the characteristics by using a deep learning neural network model, and culturing interaction capability of children society;
in this embodiment, what needs to be specifically described is an interaction module, where the interaction module is used for interaction between a child and virtual reality, culturing interaction capability of a child society, collecting a data set of actions performed by the child, including gesture data, expression data, language data and action data, detecting the actions performed by the child in real time through virtual reality hardware, performing graying and clipping processing on the data, extracting color, shape and motion characteristics, classifying and identifying the characteristics by using a deep learning neural network model, where the deep learning neural network model is a cyclic neural network, and the specific formula is as follows:
Y t ＝g(W h *y*h t +b h )
h t ＝f(W xh *x t +W hh *h t-1 +b h )
wherein W is xh Representing a weight matrix input to the hidden state, W hh The weight matrix representing hidden states to hidden states, f (x) representing an activation function, W h * y represents a weight matrix hiding state to output, b h And (3) representing the bias term, wherein g (x) represents an activation function, dividing the signal data set into a training set, a test set and a verification set, inputting batch data in the training set for iterative training, repeating the iterative training to reach a certain convergence condition, and carrying out parameter adjustment, scale adjustment and structural improvement according to the result of the verification set.
104. According to the development and the capability of the children, the difficulty and the challenge of the environment are dynamically adjusted, and the situation that the children are unsuitable and dangerous to touch is limited by utilizing the characteristic that a virtual reality system has good controllability;
in this embodiment, it is specifically to be described that an environmental control module dynamically adjusts the difficulty and challenges of the environment according to the progress and the capability of a child, provides social training suitable for their capability level, monitors the behavior and response of the child in a virtual reality environment in real time, uses virtual reality hardware to acquire performance data about the child, analyzes the acquired data, explores the association and trend thereof, discovers the characteristics and changes in the social skill level and development requirement of the child through statistical analysis and visualization technology, adjusts the roles, moods and tasks in the scene according to the performance thereof, provides a safe social exercise place without failure pressure through the virtual reality environment, shields and filters unsuitable speech behaviors through a neural network model of language data, protects the safety and psychological health of the child, limits the contact unsuitable and dangerous situations of the child by using the characteristic of good controllability of the virtual reality system, sets specific scenes and roles, and ensures the social training of the child in the safe environment.
105. The progress tracking real-time feedback is utilized to evaluate the development of the rehabilitation of the child and make a target of the next step, based on the data analysis of the progress tracking, the system carries out self-adaptive adjustment according to the progress condition of the child;
in this embodiment, a real-time feedback module is specifically needed to be described, the real-time feedback module uses progress tracking real-time feedback to evaluate the development of children rehabilitation and make a next target, the system records the behavior data of the children in a virtual reality scene, including their interaction mode, emotional response and accuracy of completing tasks, and is used for evaluating the performance and progress of the children, the system provides a virtual reality visual interface for displaying the progress and performance of the children, including charts, graphs and statistical information, clearly showing the development of the children in different aspects, making a personal archive storage cloud by using a database, recording the progress history and achievement of the children, checking the personal archive of the children at any time by a guardian, knowing the development track of the children, making the next target together with a rehabilitation doctor, providing feedback and advice related to the progress of the children for the guardian and the doctor, knowing the performance of the children through the visual interface of the system, performing intervention and guidance as required, performing self-adaptive adjustment according to the progress situation of the children based on the data analysis of the progress tracking.
106. Collecting relevant data of children in the personalized setting module and the interaction module, and capturing rapid fluctuation and trend change of the data by an exponential smoothing method through calculating standard deviation of the children in different tasks and frequency distribution of specific skill behaviors;
in this embodiment, a specific description is provided for a data collection and analysis module, where the data collection and analysis module collects relevant data of the child in the personalized setting module and the interaction module, and the structured data record performs statistical analysis, and uses descriptive statistical analysis to summarize and describe the collected data by calculating standard deviation of the child in different tasks and frequency distribution of specific skill behaviors, where the formula of the calculated standard deviation is:
wherein S represents the standard deviation of the reaction time, x i Representing the ith data in the sample data set, and n represents the number of sample data points, wherein the frequency distribution formula is as follows:
wherein V represents the frequency distribution, x represents the number of times a particular behavioral classification occurs in the sample, C represents the total number of samples, and for long-term tracked data, using time series analysis to help detect trends and periodic changes in rehabilitation progress, using exponential smoothing to capture rapid fluctuations and trend changes in the data, calculating a smoothed value by a weighted average based principle, the calculated smoothed value having the specific formula:
N＝α*M+(1-α)*m
wherein N represents a smooth value of a time point, alpha represents a smooth parameter, M represents a current observed value, M represents a last smooth value, repeatedly calculating the smooth values of all the time points by iteration, using the last smooth value as a reference, deducing the change trend of future rehabilitation data by weighted average, and knowing the long-term change and short-term fluctuation in the rehabilitation process of the child.
107. The method comprises the steps that a professional doctor monitors and guides the behaviors and reactions of children when using a virtual reality technology, and a virtual reality system is used in an auxiliary mode by using a treatment scheme of the professional doctor;
in this embodiment, it is specifically to be described that the auxiliary coordination module monitors and guides the behaviors and reactions of the child when using the virtual reality technology through the professional doctor, ensures that the child uses the equipment correctly, executes the rehabilitation actions, corrects the wrong postures and improper operations in time, provides real-time feedback and adjustment, ensures the best effect in the rehabilitation process, enables the professional personnel to provide necessary support and resources for the child and parents, solves the problems related to the virtual reality technology, provides the instructions and notes of use, assists in solving the technical or operational difficulties, provides psychological social support and education, helps the child and family adapt to the changes and challenges in the rehabilitation process, monitors and evaluates the rehabilitation progress of the child regularly by the professional doctor, tracks the functional improvement, rehabilitation effect and treatment effect of the child by using standardized evaluation tools and methods, optimizes the virtual reality treatment scheme through the evaluation results, adjusts the rehabilitation plan, and provides basis for further intervention.
According to the invention, a basic platform and a framework of virtual reality experience are provided through the virtual reality platform, the deep learning neural network model is utilized to classify and identify the characteristics for interaction, sufficient clinical data is satisfied to support the rehabilitation effect, progress tracking real-time feedback is utilized to evaluate the development and formulation of children rehabilitation, and the children are helped to better understand and cope with various social, emotional and cognitive challenges.
The formula in the invention is a formula which is obtained by removing dimension and taking the numerical calculation, and is closest to the actual situation by acquiring a large amount of data and performing software simulation, and the preset proportionality coefficient in the formula is set by a person skilled in the art according to the actual situation or is obtained by simulating the large amount of data.
Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made therein without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Finally: the foregoing description of the preferred embodiments of the invention is not intended to limit the invention to the precise form disclosed, and any such modifications, equivalents, and alternatives falling within the spirit and principles of the invention are intended to be included within the scope of the invention.

Claims (10)

1. Auxiliary children autism spectrum disorder rehabilitation system based on VR interactive technology, its characterized in that: comprising the following steps:
virtual reality module: the virtual reality system comprises a basic platform and a framework, wherein the basic platform and the framework are used for creating and providing virtual reality experience, and the virtual reality experience is provided through a virtual reality platform, and the basic platform and the framework comprise two subunits of hardware and software;
and the individuation setting module is used for: analyzing the state and the characteristics of the child through sensor data and an image processing technology, correlating the related characteristics with the interests and the rehabilitation demands of the child, and providing different types of virtual scenes and activities;
and an interaction module: detecting the actions of the children in real time through virtual reality hardware, classifying and identifying the characteristics by utilizing a deep learning neural network model, and culturing the interaction capability of children society;
an environment control module: according to the progress and the capability of the children, the difficulty and the challenge of the environment are dynamically adjusted, and the situations of inappropriateness and danger of the children are limited;
and the real-time feedback module is used for: the progress tracking real-time feedback is utilized to evaluate the development of the rehabilitation of the child and make a target of the next step, based on the data analysis of the progress tracking, the system carries out self-adaptive adjustment according to the progress condition of the child;
and the data collection and analysis module is used for: collecting relevant data of children in the personalized setting module and the interaction module, and capturing rapid fluctuation and trend change of the data by an exponential smoothing method through calculating standard deviation of the children in different tasks and frequency distribution of specific skill behaviors;
auxiliary matching module: the virtual reality system is used in an auxiliary mode by using the treatment scheme of the professional doctor through supervision and guidance of behaviors and reactions of the child when the virtual reality technology is used.
2. The VR interactive technology-based childhood autism spectrum disorder rehabilitation system of claim 1, wherein: the virtual reality module utilizes a head-mounted display, a sensing device, a controller and an input device to create and transfer virtual reality experience devices and facilities, and provides a virtual reality experience basic platform and framework through a virtual reality platform.
3. The VR interactive technology-based childhood autism spectrum disorder rehabilitation system of claim 1, wherein: the individuation setting module analyzes the states and the characteristics of the children by using sensor data and an image processing technology, associates the related characteristics with the interests and the rehabilitation demands of the children by using a state estimation algorithm, provides different types of virtual scenes and activities, and ensures the individuation of the contents of the virtual reality.
4. The VR interactive technology-based childhood autism spectrum disorder rehabilitation system of claim 3, wherein: the state estimation algorithm is a Gaussian kernel density estimation method, and the specific formula is as follows:
where f (x) represents the probability density function estimate at the location, x i Represents the ith sample point in the data set, k (x) represents a gaussian kernel function, h represents a bandwidth parameter, and N represents the number of electroencephalogram data.
5. The VR interactive technology-based childhood autism spectrum disorder rehabilitation system of claim 1, wherein: the interaction module collects data sets of actions of children, the actions of the children are detected in real time through virtual reality hardware, the characteristics are classified and identified by using the deep learning neural network model, and interaction capability of children society is cultivated.
6. The VR interactive technology-based childhood autism spectrum disorder rehabilitation system of claim 5, wherein: the deep learning neural network model is a cyclic neural network, and the specific formula is as follows:
Y t ＝g(W h *y*h t +b h )
h t ＝f(W xh *x t +W hh *h t-1 +b h )
wherein W is xh Representing a weight matrix input to the hidden state, W hh The weight matrix representing hidden states to hidden states, f (x) representing an activation function, W h * y represents a weight matrix hiding state to output, b h Representing the bias term, g (x) represents the activation function.
7. The VR interactive technology-based childhood autism spectrum disorder rehabilitation system of claim 1, wherein: the environment control module dynamically adjusts the difficulty and the challenge of the environment according to the progress and the capability of the child, and limits the situations of inappropriateness and danger of the child contact by utilizing the characteristic of good controllability of the virtual reality system.
8. The VR interactive technology-based childhood autism spectrum disorder rehabilitation system of claim 1, wherein: based on data analysis of progress tracking, the system carries out self-adaptive adjustment according to the progress situation of the child.
9. The VR interactive technology-based childhood autism spectrum disorder rehabilitation system of claim 1, wherein: the data collection and analysis module collects relevant data of the children in the personalized setting module and the interaction module, and the rapid fluctuation and trend change of the data are captured by an exponential smoothing method through calculating standard deviation of the children in different tasks and frequency distribution of specific skill behaviors.
10. The VR interactive technology-based childhood autism spectrum disorder rehabilitation system of claim 9, wherein: the specific calculation formula of the standard deviation is as follows:
wherein S represents the standard deviation of the reaction time, x i Representing the ith data in the sample data set, and n represents the number of sample data points, wherein the frequency distribution formula is as follows:
wherein V represents frequency distribution, x represents the number of times a specific behavior classification occurs in a sample, C represents the total number of samples, and the specific calculation formula of the exponential smoothing method is as follows:
N＝α*M+(1-α)*m
where N represents the smoothed value at the time point, α represents the smoothing parameter, M represents the current observed value, and M represents the last smoothed value.
CN202311008664.8A 2023-08-11 2023-08-11 Auxiliary child autism spectrum disorder rehabilitation system based on VR interaction technology Pending CN117133409A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311008664.8A CN117133409A (en) 2023-08-11 2023-08-11 Auxiliary child autism spectrum disorder rehabilitation system based on VR interaction technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311008664.8A CN117133409A (en) 2023-08-11 2023-08-11 Auxiliary child autism spectrum disorder rehabilitation system based on VR interaction technology

Publications (1)

Publication Number Publication Date
CN117133409A true CN117133409A (en) 2023-11-28

Family

ID=88857553

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311008664.8A Pending CN117133409A (en) 2023-08-11 2023-08-11 Auxiliary child autism spectrum disorder rehabilitation system based on VR interaction technology

Country Status (1)

Country Link
CN (1) CN117133409A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117438048A (en) * 2023-12-20 2024-01-23 深圳市龙岗区第三人民医院 Method and system for assessing psychological disorder of psychiatric patient

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117438048A (en) * 2023-12-20 2024-01-23 深圳市龙岗区第三人民医院 Method and system for assessing psychological disorder of psychiatric patient
CN117438048B (en) * 2023-12-20 2024-02-23 深圳市龙岗区第三人民医院 Method and system for assessing psychological disorder of psychiatric patient

Similar Documents

Publication Publication Date Title
KR102166010B1 (en) System and method for determining cognitive impairment using face recognization
CN112970056A (en) Human-computer interface using high speed and accurate user interaction tracking
US20070185697A1 (en) Using electroencephalograph signals for task classification and activity recognition
RU2708807C2 (en) Algorithm of integrated remote contactless multichannel analysis of psychoemotional and physiological state of object based on audio and video content
US20140003658A1 (en) Method and apparatus for coding of eye and eye movement data
Khan et al. Towards estimating computer users’ mood from interaction behaviour with keyboard and mouse
WO2021068781A1 (en) Fatigue state identification method, apparatus and device
Avola et al. Deep temporal analysis for non-acted body affect recognition
CN117133409A (en) Auxiliary child autism spectrum disorder rehabilitation system based on VR interaction technology
US20220351824A1 (en) Systems for dynamic assessment of upper extremity impairments in virtual/augmented reality
CN114998983A (en) Limb rehabilitation method based on augmented reality technology and posture recognition technology
Lunin et al. Systematic review of Kinect-based solutions for physical risk assessment in manual materials handling in industrial and laboratory environments
CN117438048B (en) Method and system for assessing psychological disorder of psychiatric patient
Zhou et al. H-GOMS: a model for evaluating a virtual-hand interaction system in virtual environments
Rumahorbo et al. Analyzing important statistical features from facial behavior in human depression using XGBoost
CN111768863A (en) Artificial intelligence-based infant development monitoring system and method
CN113974589B (en) Multi-modal behavior paradigm evaluation optimization system and cognitive ability evaluation method
Vijayvargiya et al. PC-GNN: Pearson Correlation-Based Graph Neural Network for Recognition of Human Lower Limb Activity Using sEMG Signal
Meneses et al. Methodology for automatic identification of emotions in learning environments
Butner et al. Ghost hunting in the nonlinear dynamic machine
Marco-Giménez et al. Affective and Behavioral Assessment for Adaptive Intelligent Tutoring Systems.
Wei et al. Exploration on Intelligent Virtual Reality Technology and Algorithms for VR Platforms under Intelligent Control and Computer Vision
Bakkialakshmi et al. Effective Prediction System for Affective Computing on Emotional Psychology with Artificial Neural Network
Festa Data Representation for Motor Imagery Classification
Argasinski et al. Enhancing VR Based Serious Games and Simulations Design: Bayesian Knowledge Tracing and Pattern-Based Approaches

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination