Multi-scene CPR nursing teaching experiment system based on AR technology
Technical Field
The invention belongs to the field of nursing teaching, and relates to a multi-scene CPR nursing teaching experiment system based on AR technology.
Background
The american heart association guidelines indicate that one of the most important determinants of the outcome of a cardiac arrest patient's life is to provide educational interventions to medical students, who should periodically perform CPR (cardio pulmonary resuscitation) teaching or activities, and to prevent forgetfulness of knowledge and skills related to cardio pulmonary resuscitation of medical personnel and medical students. Cardiopulmonary resuscitation is used as important content of nursing teaching in all nursing institutions in the world. In the past, the traditional teaching mode of multimedia theory teaching and high-simulation human simulator skill teaching is mostly adopted in cardiopulmonary resuscitation teaching, but the teaching effect on the aspects of thinking decision-making capability and self-confidence improvement, knowledge and skill acquisition and retention and the like of students is limited.
An AR technology-based cardio-pulmonary resuscitation autonomous training assessment system published by Beijing university has application number 202110539208.0 and application publication number CN113223389A, but the system has a single scene, does not contain teaching contents such as airway opening and artificial respiration required by professional rescue, and is not suitable for being used as a CPR teaching and assessment tool for nursing professional students. A3D virtual reality interaction-based emergency training and assessment system which is published by China people liberation military, third-good five hospital, has application number 202110955787.7 and application publication number CN113781857A collects actions of rescuers to generate virtual animations, and similarly, the rescue training and assessment system cannot train and assess the artificial respiration and pressing part operation of CPR in a virtual-real combined mode. The cardio-pulmonary resuscitation training and checking system based on the virtual reality technology, which is published by Nanchang Tongkun science and technology Limited under the application number of 201910884709.5 and the application publication number of CN1107518090A, enhances the operation immersion feeling by the virtual reality technology, but has the defects that an operator cannot see the actual operation action of the operator, and no actual operation video record can be traced in the later period. The invention overcomes the defects of the prior invention, and realizes the informatization and paperless CPR teaching according to the course characteristics of students in the nursing major. The virtual-real combination of nursing operation is realized through the AR technology, professional and standard operation procedures are implemented while multi-scene immersion is achieved, and the grasp of CPR skills by a caregiver is facilitated.
Disclosure of Invention
Aiming at the defects of the existing invention, the invention provides a CPR nursing teaching experiment system for realizing an information teaching mode, supports the situation that students experience CPR in different scenes and performs operation, study and examination, and a teacher calls the scores and operation data of all students by one key of archived information. The efficiency of CPR teaching of the nursing major of each college can be increased and the interest of student care learning can be improved.
A multi-scene CPR nursing teaching experiment system based on AR technology comprises a sensing human simulator, AR glasses, a wireless gateway and a data processing system. The sensing simulator is used for collecting the operation data of the life-care; the AR glasses are used for playing background sound of a first-aid scene, teaching images and recording sound and video of the life protector during operation. The data processing system is provided with a student port and a teacher port which are mutually independent; the nurse checks the score by logging in the student port; a teacher calls all the operation data of the students by logging in a teacher port; the wireless gateway is used for realizing data transmission between the AR glasses and the data processing system and between the sensing anthropomorphic dummy and the data processing system.
The sensing model person comprises a human-shaped main body, and a pressure sensor, an airflow sensor, an angle sensor and a displacement sensor which are arranged on the human-shaped main body and used for detecting operation data. The gas flow sensor records the number and duration of expiration, and calculates the gas quantity; the angle sensor records the opening angle of the air passage; the pressure sensor records the frequency of the pressing; the displacement sensor records the compression depth and rebound amplitude.
The data processing system is internally provided with an exercise mode, a learning mode and an assessment mode.
The working process of the multi-scene CPR nursing teaching experiment system based on the AR technology in the practice mode is as follows: logging in to the student port to select the exercise mode. A pressure sensor, an airflow sensor, an angle sensor and a displacement sensor in the sensing model person automatically acquire data in the process that a caregiver performs CPR operation on a human-shaped main body, and the acquired data are transmitted to a data processing system to be stored and fed back to AR glasses in real time. The AR glasses play background sound of the emergency scene and display holographic images for guiding operation and parameters collected by the sensing model person; after the operation is completed, the practice data and the operation video can be checked at the student port.
The working process of the multi-scene CPR nursing teaching experiment system based on the AR technology in the learning mode is as follows: logging on to the student port selects the learning mode. Displaying an operation demonstration video by the AR glasses; the operation demonstration video can be played repeatedly.
The working process of the multi-scene CPR nursing teaching experiment system based on the AR technology under the examination mode is as follows: log in to student port and select assessment mode. The pressure sensor, the airflow sensor, the angle sensor and the displacement sensor in the sensing model person automatically acquire data in the operation process, and the acquired data are transmitted to the data processing system for storage in a wireless transmission mode; and the data processing system scores according to the comparison condition of the received data and the data in the standard database. The AR glasses do not display the guide image, record the video and audio and upload to the data processing system.
Preferably, logging into the teacher port in the practice mode, the learning mode, and the assessment mode can query the student port for operational data, video, and audio obtained therefrom.
Preferably, in the practice mode, after each key step is completed by the student, the AR eyes display the image of the question corresponding to the key step to the student, and the student can perform the next operation after answering the question.
Preferably, the AR glasses include a microphone, a speaker, a camera, and a lens. The microphone is used for collecting sound in the life-care operation process; the loudspeaker is used for playing background sounds of different emergency scenes; the camera is used for recording operation videos in the life-preserving visual field; the lens is used for displaying the holographic image for guiding the operation and the title compiled by the teacher to the student.
Preferably, the wireless gateway communicates by adopting one or more of WIFI, 4G, 5G and Bluetooth technologies, and uploads detection operation parameters measured by the sensing model person and the life-care visual field operation video recorded by the AR glasses to the data processing system in real time.
Preferably, the emergency scenes comprise a fire scene, a drowning scene, a car accident scene and a myocardial infarction scene.
Preferably, the data processing system comprises an item bank module, a CPR learning module, a CPR exercise module, a CPR assessment module, a multi-scene module, a video and audio processing module, a data recording module and an identity authentication module. The question bank module contains theoretical knowledge of CPR teaching. The CPR learning module is used for realizing a learning mode and controlling AR eyes to play CPR standard operation videos. The CPR exercise module is used for realizing an exercise mode and assisting operation through a holographic image for guiding operation. The CPR examination module is used for realizing a CPR examination mode, recording operation data, videos and audios and scoring. The video and audio processing module is used for storing and reading operation videos and audios. The data recording module receives operation data from the sensing simulator and counts single or accumulated learning time length and assessment scores. The identity authentication module is used for realizing the identity authentication modes including account number password, certificate scanning, face recognition, iris recognition and fingerprint recognition to log in the student port and the teacher port.
Preferably, the database built in the data processing system stores standard operation data as follows: the expiration time is longer than 1 second and the air is not leaked; continuous expiration for 2 times; the pressing frequency is as follows: 100-120 times/min; pressing depth is 4-5 cm; the thorax fully rebounds after compression; pressing for 30 times continuously, and the frequency is equal; the ratio of the compression to the breathing rate is 30: 2; the air passage is open, and the head leans backwards by 90 degrees; chest compressions were performed 30 times and artificial breaths were performed 2 times for a complete cycle.
The invention has the beneficial effects that:
1. by introducing AR technology into CPR learning, practicing and checking, the invention enables a caregiver to learn details of CPR operation through holographic images, watch operation key points in real time during practicing, and answer questions after each key step of practicing; and the video, audio and specific operation data in the operation process of the convoy can be automatically acquired, so that the automatic scoring of CPR operation of the convoy is realized, the learning efficiency of the convoy is greatly improved, and the work of teachers is simplified.
2. According to the invention, by arranging the sensing model person with the pressure sensor, the airflow sensor, the angle sensor and the displacement sensor, the real-time acquisition of a plurality of operation data such as the number of times and duration of expiration, the opening angle of an airway, the frequency of pressing, the pressing depth, the rebound amplitude and the like is realized, and a basis is provided for improvement of life-support operation.
Drawings
FIG. 1 is a system block diagram of the present invention
FIG. 2 is a schematic diagram of a data processing system according to the present invention
FIG. 3 is a schematic view of the AR glasses of the present invention
FIG. 4 is a flow chart of the operation of the present invention in the exercise mode;
FIG. 5 is a flow chart of the operation of the present invention in a learning mode;
FIG. 6 is a flow chart of the present invention in the assessment mode.
Detailed Description
As shown in fig. 1, the multi-scene CPR nursing teaching experiment system based on the AR technology is used for realizing digitization and standardization of CPR teaching, has repeatability and interest, is beneficial for a caregiver to master CPR operation skills, and comprises a sensing simulator, AR glasses, a data processing system and a wireless gateway.
As shown in fig. 2, the data processing system includes a computer, a server, an operation and maintenance system, and a back-end support system. The data processing system is provided with two ports, namely a student end and a teacher end. The data processing system is provided with eight modules, namely an item bank module, a CPR learning module, a CPR exercise module, a CPR examination module, a multi-scene module, a video and audio processing module, a data recording module and an identity authentication module.
The question bank module comprises theoretical knowledge assessment of CPR teaching, and is compiled by teachers, so that the chief care students can master key difficulties of CPR operation.
The CPR learning module supports students to log in a CPR learning mode through student ports and learn a third person to call viewing angle CPR specification to operate video auxiliary understanding memory.
The CPR exercise module supports students to log in a CPR exercise mode through student ports and conducts one-step operation exercise according to the guidance holographic images. The training mode can be used for selecting four different scenes, including a fire scene, a drowning scene, a car accident scene and a myocardial infarction scene.
The CPR examination module supports students to log in a CPR examination mode through student ports, operation examination is carried out under the condition that a guide image is not provided, and the computer compares the scoring standard drawn by teachers with the database to evaluate the final score of the examinees.
The video and audio processing module supports storage and reading of images of the convalescent operation, and identification, storage and calling of language expression and conversation in the convalescent operation process, so that traceability of assessment scores is realized.
The data recording module receives the compression data, the expiration data and the airway opening data from the sensing simulator, wherein the data comprises the number of expiration times, duration, gas quantity, the airway opening angle, the compression frequency, depth and rebound amplitude, and statistics is carried out on single or accumulated learning duration and assessment scores.
The identity authentication module supports students or teachers to log in the system through identity authentication modes such as account passwords, certificate scanning, face recognition, iris recognition, fingerprint recognition and the like.
The AR glasses include an AR transparent lens, a microphone, a speaker, and a camera. The microphone is used for collecting voice of language expression and conversation in the process of life-care operation, and the loudspeaker can realize the broadcast of background sound in different situations; the high-definition camera is used for recording operation videos of the life-protecting vision and capturing motion information; the AR transparent lens is used for displaying the holographic images for guiding the life-care operation and the questions compiled by teachers. Under the control of the data processing system, the AR glasses provide three modes, namely an assessment mode, an exercise mode and a learning mode. Under the examination mode, the AR glasses can show different first-aid scenes to the caregiver, and the operator can experience more immersive first-aid scenes. The AR glasses can switch various scenes; the first-aid scenes comprise a fire scene, a drowning scene, a car accident scene and a myocardial infarction scene, and teachers participate in the compilation of sounds and pictures in different scenes in all the scenes to improve the immersion sense of operation and practice. In the practice mode, the AR glasses display the question bank compiled by the teacher to the student after each important operation so that the student can review the knowledge points firmly.
The sensing model person comprises a man-shaped main body, and a pressure sensor, an airflow sensor, an angle sensor and a displacement sensor which are arranged on the man-shaped main body. The gas flow sensor records the number and duration of expiration, and calculates the gas quantity; the angle sensor records the opening angle of the air passage; the pressure sensor records the frequency of the pressing; and the displacement sensor records the pressing depth and the rebound amplitude. In the process of the life-care operation, each sensor on the sensing model person automatically acquires data, the data are transmitted to the data processing system in real time through the wireless gateway and then fed back to the life-care by the AR glasses, and the data processing system judges the assessment score according to the database standard.
The wireless gateway comprises one or more of WIFI, 4G, 5G and Bluetooth technologies, data of pressing, breathing and airway opening and recorded life-support visual field operation videos are uploaded to the data processing system in real time, and the data processing system can be called and checked by a teacher end and can also feed back the data to the AR lens in an exercise mode in real time.
The standard operation data stored in the built-in database of the data processing system are as follows: (1) the expiration time is longer than 1 second and the air is not leaked; (2) continuous expiration for 2 times; (3) the pressing frequency is as follows: 100-120 times/min; (4) pressing depth is 4-5 cm; (5) the thorax fully rebounds after compression; (6) pressing for 30 times continuously, and the frequency is equal; (7) the ratio of the compression to the breathing rate is 30: 2; (8) the air passage is open, and the head leans backwards by 90 degrees; (9) chest compressions were performed 30 times and artificial breaths were performed 2 times for a complete cycle.
As shown in fig. 4, the working process of the multi-scenario CPR nursing teaching experiment system based on AR technology in the practice mode is as follows:
step one, a caregiver logs in the system by using an account password, and wears AR glasses to select an exercise mode to implement operation exercises.
And step two, automatically acquiring data by a pressure sensor, an airflow sensor, an angle sensor and a displacement sensor in the sensing model person in the operation process, transmitting the acquired data to a data processing system in a wireless transmission mode for storage and feeding back the data to the AR glasses in real time. The AR glasses broadcast the background sound of the first-aid scene of the exercise mode selected by the caregiver through the loudspeaker; the lenses of the AR glasses display holographic images for guiding operation and operation numerical values of the guardian, and voice prompt sounds appear when the correct standard threshold value is reached; after each key step, AR eyes display the images of the questions corresponding to the key step to the student, the student can perform the next operation after answering the questions, and the microphone and the camera record the operation video of the student in the whole process. The nodes of which the key steps are finished are determined by a preset sending mode.
And step three, logging in a student port of the data processing system through the account password after the child care operation is completed, and checking the exercise data and operating the video by oneself.
As shown in fig. 5, the working process of the multi-scenario CPR nursing teaching experiment system based on AR technology in the learning mode is as follows:
enabling the nurse to log in a student port of the data processing system by using the account password, wearing AR glasses to select a learning mode, and learning the operation demonstration video; the operation demonstration video can be played repeatedly; and the teacher logs in a student port of the data processing system and checks the learning video watching condition of each student.
As shown in fig. 6, the working process of the multi-scenario CPR nursing teaching experiment system based on the AR technology in the assessment mode is as follows:
the nurse logs in a student port of the data processing system by using the account password, and wears AR glasses to select an examination mode for examination. The pressure sensor, the airflow sensor, the angle sensor and the displacement sensor of the sensing model person automatically acquire data in the operation process, the obtained data are transmitted to the data processing system to be stored in a wireless transmission mode, and the system compares the data with the standard database and gives a score. The microphone and the camera embedded in the AR glasses record operation videos in the whole process, and guide images are not displayed any more. After the operation is finished, the student ports log in the data processing system through the account passwords to check the exercise data, operate the video and check the scores. And the teacher logs in a teacher port of the data processing system through the account password to call the data and videos of all students.