CN116312118A - Meta hospital system based on augmented reality digital twinning - Google Patents
Meta hospital system based on augmented reality digital twinning Download PDFInfo
- Publication number
- CN116312118A CN116312118A CN202310267559.XA CN202310267559A CN116312118A CN 116312118 A CN116312118 A CN 116312118A CN 202310267559 A CN202310267559 A CN 202310267559A CN 116312118 A CN116312118 A CN 116312118A
- Authority
- CN
- China
- Prior art keywords
- case
- space
- augmented reality
- simulation
- difficulty
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 58
- 238000004088 simulation Methods 0.000 claims abstract description 121
- 238000000034 method Methods 0.000 claims abstract description 67
- 230000008569 process Effects 0.000 claims abstract description 58
- 238000012545 processing Methods 0.000 claims abstract description 41
- 230000009471 action Effects 0.000 claims abstract description 16
- 230000004044 response Effects 0.000 claims description 13
- 238000013507 mapping Methods 0.000 claims description 5
- 230000036961 partial effect Effects 0.000 claims description 3
- 238000003860 storage Methods 0.000 abstract description 9
- 230000007423 decrease Effects 0.000 abstract description 3
- 238000012549 training Methods 0.000 description 65
- 201000010099 disease Diseases 0.000 description 14
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 14
- 238000005516 engineering process Methods 0.000 description 13
- 238000007726 management method Methods 0.000 description 12
- 230000008859 change Effects 0.000 description 11
- 230000000474 nursing effect Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 230000007547 defect Effects 0.000 description 5
- 238000011161 development Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000007654 immersion Methods 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 230000002829 reductive effect Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000013475 authorization Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000000747 cardiac effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000001502 supplementing effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 230000036772 blood pressure Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000035876 healing Effects 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 239000003607 modifier Substances 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000006722 reduction reaction Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 208000024891 symptom Diseases 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
Abstract
The invention relates to a meta-hospital system based on an augmented reality digital twin. The system at least comprises a processing unit and a storage unit. The processing unit is used for creating a case space and a plurality of simulation spaces and responding to the operation of a user to configure the case space and/or the simulation spaces; the case space provides editing and generating services for medical and care cases. Wherein the operation and/or configuration of the case space is based on visible operation actions of the staff. The invention is defined by multidimensional copying of the progress and the difficulty, plans different simulation spaces of the same case, increases the number of medical cases, enables students to carry out self-adaptive selection based on the progress and the difficulty of the required study, and gradually decreases the difficulty from the upper position to the lower position, so that the study process of the students is divided into steps, and the students feel own lifting process to increase the study interest.
Description
Technical Field
The invention relates to the technical field of medical treatment and nursing teaching training, in particular to a meta-hospital system based on an extended reality digital twin.
Background
The meta universe is a virtual world which is linked and created by utilizing a scientific and technological means and is mapped and interacted with the real world, and has a digital living space of a novel social system; the metauniverse is essentially a real-world virtualization, digitizing process that requires extensive modification of content production, economic systems, user experience, and physical world content, etc. But the development of the metauniverse is progressive, and is finally formed by continuous fusion and evolution of a plurality of tools and platforms under the support of shared infrastructure, standards and protocols; the method provides immersive experience based on an augmented reality technology, generates a mirror image of the real world based on a digital twin technology, builds an economic system based on a blockchain technology, integrates the virtual world with the real world closely on an economic system, a social system and an identity system, and allows each user to conduct content production and world editing.
At present, more cases exist for applying the augmented reality digital twin technology to staff teaching training, but no related study exists for medical teaching training cases. The prior art also stays with cumbersome parameter settings via the input device, resulting in slow case editing speed, small number of cases, and the need to constantly switch in the database to find the way of the required data. The existing case editing has the defect that since the editing is performed on computer equipment, teaching training is also performed on the computer equipment, so that the simulation of the case is in a two-dimensional form, and students often perform the teaching training by clicking on the image of a patient or according to the dialogue development and item selection modes for acquiring data in the two-dimensional simulation. That is, only the students need to select the correct option to represent the completion of the teaching training, as opposed to making a paper-faced choice question. In addition, the prior school and hospital teaching training technical field lacks a teaching mode through a meta-hospital, and students cannot conduct autonomous learning in a mode of participating in the case of the extended reality digital twin by themselves. Therefore, there is an urgent need for a meta-hospital system that facilitates case editing and is suitable for medical teaching training.
The Chinese patent CN 112991120A discloses a medical conjuncted pediatric nurse training system based on workshops in the technical field of training systems, which comprises an online training module, a practice training module, a training management module and an information management module, wherein the online training module is used for training courses of trainers, explaining, answering and simulating course contents in the training process, the practice training module is used for carrying out step demonstration and recording in practice and checking practice effects, and the training management module is used for checking and evaluating training results, distributing training contents and managing training files. Through setting up online training module, practice training module for the training person can initiatively train in real time, promotes training efficiency, distributes the training content according to the actual conditions of training person through training management module in addition, realizes carrying out the training with pertinence, improves the training effect. However, the training system is still limited to computer equipment, has no initiative in training, has low training efficiency for a trainer, and is difficult to directly carry out clinical operation after training.
Chinese patent CN 114765069a discloses a doctor training system, a doctor training method, and a readable storage medium, the doctor training system comprising: the surgical instrument comprises a first surgical robot and a processor, wherein the first surgical robot comprises an input device for a user to input a seeking assistance instruction, the processor is in communication connection with the first surgical robot and is used for receiving the seeking assistance instruction and sending the seeking assistance instruction to the outside, and the processor is further used for mapping at least one second surgical robot to the first surgical robot according to the received assistance instruction, so that the first surgical robot is controlled by the second surgical robot. By the configuration, the data can be mutually transferred between the surgical robots, so that mutual communication among doctors is achieved, high-level doctors can help the trained doctors to complete operation in a remote control mode, and the trained doctors can obtain intraoperative real-time training guidance of the high-level doctors. The training system is high in cost, and can only correspondingly train one trainer at the same time, so that high-efficiency training cannot be achieved. In the current social context of urgent medical personnel, particularly those having practical operation capabilities, it is difficult to train a batch of medical personnel with high efficiency and quality.
Furthermore, there are differences in one aspect due to understanding to those skilled in the art; on the other hand, since the applicant has studied a lot of documents and patents while making the present invention, the text is not limited to details and contents of all but it is by no means the present invention does not have these prior art features, but the present invention has all the prior art features, and the applicant remains in the background art to which the right of the related prior art is added.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides a meta-hospital system based on the digital twin of the augmented reality. The system comprises at least a processing unit and a storage unit. Wherein the processing unit is used for creating a case space and a plurality of simulation spaces, and responding to the operation of a user to configure the case space and/or the simulation spaces; the case space provides editing services for medical cases. Wherein the operation and/or configuration of the case space is based on visible operation actions of the staff. The meta-hospital system is established on the basis of a case database and a case editor, and virtualizes and digitizes a real clinical scene through case design. The immersion experience is provided by adopting the augmented reality technology and combining equipment such as helmets. Based on digital twin technology, a real world digitized image is generated. Based on the earlier stage, the virtual reality is mixed, the virtual reality is supplemented, students are brought into the immersive simulation clinical scene through the technical means, and the students interact with the scene, the characters and the things in an electronic game mode, so that the medical and nursing training has more realism and experience.
According to a preferred embodiment, the system further comprises an augmented reality device, the processing unit creating the simulated space from the case space in response to a request for creation of the simulated space issued by the augmented reality device. The data information for each case space is displayed in an operational language. The training person can create the corresponding simulation space through the augmented reality device, and even repeatedly create the same space for students to use, thereby reducing participation of case editors in the distribution of the simulation space, reducing workload of the case editors, and realizing creation and data transmission of the simulation space of students across cases, processes and/or difficulties.
According to a preferred embodiment, the processing unit creates the same simulation space with the specified simulation space as a template in response to a request for creating the specified simulation space of the augmented reality device, and the processing unit copies and divides the case space into a plurality of the simulation spaces based on a plurality of processes and difficulties of the same case that the case space has. The invention creates and copies different simulation spaces, so that students are not limited by the number of space users, and a plurality of students can be accommodated in the space to carry out unified teaching.
According to a preferred embodiment, several of the simulation spaces are distinguished in parallel and/or dependent relationship between progress and difficulty in the transverse and/or longitudinal direction. The invention is defined by multidimensional copying of the progress and the difficulty, plans different simulation spaces of the same case, increases the number of medical cases, enables students to carry out self-adaptive selection based on the progress and the difficulty of the required study, and gradually decreases the difficulty from the upper position to the lower position, so that the study process of the students is divided into steps, and the students feel own lifting process to increase the study interest.
According to a preferred embodiment, the case database is transmitted into the case space for the selection of filling by the staff. The case space is provided with at least a virtual scene and a virtual object, wherein the virtual object comprises a useful virtual object and a useless virtual object; the virtual object is excited to a multidimensional data image when an operator applies an operation action through the augmented reality device. According to the invention, by introducing the augmented reality equipment, the medical cases are edited on the three-dimensional level, and the upper and lower spaces are generated through the progress and the difficulty, so that a plurality of students can simultaneously carry out teaching training. The required processes in the teaching training are the same or different, so that the difficulty of teaching training management is reduced, standard customization, diversified teaching training management and efficiency management of the teaching training are realized, and the defect that layer-by-layer setting is required in the traditional teaching training is avoided. The multi-stage arrangement also reduces the transmission quantity of data, has a complete authority system, is easy to correct errors to find out the loopholes of case editing, and judges whether the medical cases are self-consistent.
According to a preferred embodiment, the simulation space replicates virtual scenes and useless virtual objects of the case space to build a preliminary framework; the simulation space is used for classifying the progress and the difficulty based on the multidimensional data image related to the useful virtual object. The training method is applied to the augmented reality technology, and the training mode of students is changed from the source, is not limited to two dimensions, and is trained from the three-dimensional perspective by establishing a case space and classifying the case space into a plurality of simulation spaces. The useful virtual object provided by the invention can also indirectly guide students to use equipment, train the students to know which equipment is needed to acquire medical data in actual operation, train the ability of the students to collect relevant information of diseases of patients, and the acquisition skills can be directly used in clinical operation, improve the practical ability of the students, establish clinical thinking and train clinical decision-making ability.
According to a preferred embodiment, a staff member associates the case database into the multi-dimensional data image via the augmented reality device to form the case space; each dimension in the multi-dimensional data image characterizes a different data type such that the simulation space is ranked in order of course and difficulty. The staff fills the data of the useful virtual object by filling the relevant data in the case database into the face. Since the case database is displayed in the form of data, tables, virtual images, etc. The case database and the multidimensional data image can be displayed simultaneously.
According to a preferred embodiment, the processing unit intercepts data of a partial time period in a multi-dimensional data image to form the simulation space of different courses. Students can practice in the partial time period, and can continuously complete all the stages of a disease case from the beginning stage to the end stage of the case, thereby experiencing complete disease care procedures. The above-mentioned course refers to the course of the disease, i.e. the stage of progression of the patient's condition.
According to a preferred embodiment, the processing unit adjusts parameters of the virtual object of interest based on the association when the association setting of the multidimensional data image and the case database is completed; the association is visually displayed in the case space; specified data in the case database is transferred to specified dimensions of the multi-dimensional data image and a visible identification is established. The association is represented by a virtual visible mark so as to be beneficial to a constructor to judge the association relation between the multidimensional data image and the case database.
According to a preferred embodiment, the visible identifier is also used to indicate the type of association after the association of the multidimensional data image and the case database has been established; wherein the association type at least comprises filling, correspondence and/or mapping; the association type means that the case database as the applying party maintains an association action on the multidimensional data image as the applied party. The invention establishes the change relation of the data in a visible mode, so that the case editing process is simplified, the subsequent optimizing process and the new case supplementing process are also simplified, the case editing efficiency is improved, and the labor cost is saved. The meta-hospital system based on the extended reality digital twinning also realizes high simulation and immersive exercise of clinical cases. By creating an immersive learning environment with high simulation degree and restoring real clinical scenes and scenes, students can experience and learn various clinical practices and patient cares in an immersive manner. Meanwhile, the medical safety ethics can be ensured, no real patient is injured in the student practice process, but students experience and practice clinical skills under the condition of unskilled technology and knowledge, the students have the right of autonomous decision making, and the self knowledge and experience are combined for comprehensive analysis. The meta-hospital system based on the extended reality digital twin aims at providing the environment for students so as to improve the clinical thinking ability and clinical decision ability of the students.
Drawings
Fig. 1 is a simplified diagram of a case space versus simulation space of a meta-hospital system based on augmented reality digital twinning in accordance with a preferred embodiment of the present invention;
fig. 2 is a simplified usage scenario diagram of a meta-hospital system based on augmented reality digital twinning according to a preferred embodiment of the present invention.
List of reference numerals
1: a processing unit; 2: an augmented reality device; 3: case space.
Detailed Description
In order to make the above objects, features and advantages of the present invention more comprehensible, the following description of the embodiments accompanied with the accompanying drawings will be given in detail. It will be apparent that the described embodiments are only some, but not all, embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The following detailed description refers to the accompanying drawings.
And a processing unit: any type of computer or processing system, including but not limited to a mobile terminal, personal Computer (PC), personal Digital Assistant (PDA), mainframe computer, network device, system or other device or combination of devices capable of storing and processing a database containing patient information. It is broadly defined to encompass any device or combination of devices having at least one processor that executes instructions from a storage medium.
Example 1
The invention relates to a meta-hospital system based on an augmented reality digital twin. The meta hospital system is established on the basis of a case database, a case editor and a case generator, generates different cases of the same disease based on the edited parent case, and virtualizes and digitizes a real clinical scene through case design. The immersion experience is provided by adopting the augmented reality technology and combining equipment such as helmets. Based on digital twin technology, a real world digitized image is generated. Based on the earlier stage, the students are brought into the immersive simulated clinical scene through the technical means, and interact with the scene, the characters and the things in the form of an electronic game, so that the students have more realism and experience for nursing patients.
According to a preferred embodiment, the system comprises at least a processing unit 1 and a storage unit. The processing unit 1 is used to create a case space 3 and several simulation spaces and to configure the case space 3 and/or the simulation spaces in response to a user operation. The processing unit 1 comprises at least a generation module and a configuration module. The generation module is used to create a case space 3 or simulation space in response to a request for space creation. The configuration module is used for carrying out self-defined configuration on the case space 3 and/or carrying out active configuration on parameters conforming to a preset scheme of the simulation space based on user operation. The generation module and the configuration module can be integrated on one processor or application specific integrated chip. The storage unit is used for storing at least zero-level data, general data of each level space and user space exclusive data. The processing unit 1 may execute related instructions or programs by means of a general purpose central processing unit CPU (Central Processing Unit), an application specific integrated circuit ASIC (Application Specific Integrated Circuit), a microprocessor, or one or more integrated circuits, etc. to implement the technical scheme of the present invention. The memory unit may be an integral part of the processing unit 1 or may be regarded as an element separate from the processing unit 1. For example, the memory unit may be implemented in the form of read only memory ROM (Read Only Memory), random access memory RAM (Random Access Memory), static storage device, dynamic storage device, or the like. The storage unit may store an input-output operating system, a data storage management system, a running operating system, and the like of the processing unit 1. When the technical solution according to the invention is implemented in software or hardware, the relevant program code may be kept in a memory unit and executed by the processing unit 1. Preferably, the system further comprises an identity unit for entering the digital world as a digital identity. Preferably, the augmented reality digital twin-based meta hospital system of the present invention. Can be divided into a student end and a teacher end. The teacher end generates complex cases by simplifying and improving editing efficiency. The student end is to create an immersive learning environment with high simulation degree and restoring real clinical scenes and situations, so that the student can experience and learn various clinical practices and patient cares in an immersive manner. Meanwhile, the medical safety ethics can be ensured, no real patient is injured in the student practice process, but students experience and practice clinical skills under the condition of unskilled technology and knowledge, the students have the right of autonomous decision making, and the self knowledge and experience are combined for comprehensive analysis. The meta-hospital system based on the extended reality digital twin aims at providing the environment for students and teachers so as to improve the clinical thinking and clinical decision making capability of the students and reduce the burden of case editing of the teachers.
According to a preferred embodiment, the processing unit 1 creates at least a case space 3. The case space 3 provides editing services for medical cases. The data of case space 3 is TO data. The TO data is mainly management class data and configuration class data, and at least comprises operation parameters, database states, authorization states and the like of a simulation space, and is not a space for a specific training person or case. Preferably, the system further comprises an augmented reality device 2. The augmented reality device 2 comprises an external feedback device. Such as a hand-worn augmented reality device 2 and a head-worn augmented reality device 2. Medical staff effects case editing in the case space 3 or training in the simulation space by hand or other limb movements. Preferably, the system can further comprise a camera unit. The photographing unit is disposed in the case space 3 and/or the analog space, and transmits corresponding display pictures of the case space 3 and/or the analog space to the outside through a camera view angle, a first person view angle or a third person view angle, so that the outside can view images through the display device. Preferably, the first view angle of medical staff in the case space 3 and/or the simulation space and the view angle of the camera module can be transmitted in a combined display mode, so that the system is provided for a learner who uses the system for the first time to learn related operations, and is used for multiplexing after finishing, and the teaching training effect is improved. Preferably, the augmented reality device 2 establishes a connection with the processing unit 1 in a wired or wireless manner for transmission of information.
According to a preferred embodiment, the processing unit 1 creates a first process first difficulty simulation space from the relevant case space 3 in response to a request for simulation space creation issued by the augmented reality device 2. The first process first difficulty simulation space is configured with relevant data of a medical case. In response to the data information selected by the augmented reality device 2, the first-process first-difficulty simulation space performs simulated personalized settings according to the data information. The first difficulty simulation space of the first process is set or input by a first trainer and forms a first simulation space. Preferably, the processing unit 1 creates a second process first difficulty simulation space from the relevant case space 3 in response to a request for simulation space creation issued by the augmented reality device 2. The second process first difficulty simulation space is configured with relevant data of a medical case. In response to the data information selected by the augmented reality device 2, the second process first difficulty simulation space performs a personalized setting of the simulation according to the data information. The second process the first difficulty simulation space is set or input by a second trainer and forms a second simulation space. The first simulation space and the second simulation space belong to the lower space of the case space 3. The first analog space and the second analog space are parallel analog spaces. Each of which exists a different data type. Preferably, the progress characterizes the progress of the medical cases in the case space 3 in which the simulation space is located. I.e. different stages of the disease condition of the same case, which belong to the lower expression of the same case space 3. Preferably, each first difficulty simulation space can be authorized to be set by the case space 3. Similarly, a simulation space with a certain difficulty can be authorized and set by a host space.
According to a preferred embodiment, the first process second difficulty simulation space is a lower space of the first process first difficulty simulation space. When the first process second difficulty simulation space is created, the difficulty authority of the first process first difficulty simulation space is partially weakened to provide the first process second difficulty. Namely, the first process second difficulty simulation space and the first process first difficulty simulation space are characterized in that: is a case simulation of the same case under the same disease process of the same case, and the second difficulty is less than the first difficulty. The first process second difficulty simulation space is a lower difficulty authorized by the first process first difficulty simulation space. Preferably, the second difficulty simulation space of the second process is a lower space of the first difficulty simulation space of the second process. When the second process second difficulty simulation space is created, the difficulty authorization of the second process first difficulty simulation space is partially weakened to provide the second process second difficulty simulation space. Namely, the second difficulty simulation space of the second process and the first difficulty simulation space of the second process are characterized in that: is a case simulation of the same case under the same disease process of the same case, and the second difficulty is less than the first difficulty. The second process second difficulty simulation space is a lower difficulty authorized by the second process first difficulty simulation space.
The data information of the respective case spaces 3 is displayed in an operational language. The trainer can create a corresponding simulation space through the augmented reality device 2, and even repeatedly create the same space for students to use, thereby reducing participation of case editors in simulation space allocation, reducing workload of case editors, and realizing creation and data transmission of the student simulation space crossing cases, processes and/or difficulties. It should be noted that, in the above-mentioned each simulation space, the relationship between the same case and different simulation spaces is not the relationship between the mother case depending on editing, and different cases of the same disease are generated within the range according to the parameter range when designing the mother case. When students practice, different fragments of the same case can be simulated.
Preferably, in response to a request for creation of a specified simulation space by the augmented reality device 2, the processing unit 1 creates the same simulation space with the specified simulation space as a template. Preferably, case space 3 has several processes and difficulties for the same case to be able to be replicated divided into several simulation spaces. Preferably, several students are able to complete case simulation individually or together in several simulation spaces. Preferably, several students can simulate under the same simulation space tree. That is, several students can perform a commonly assisted medical care work as an assisting individual in the same simulation space, or several students can perform a monotonous medical care work as an independent individual in different simulation spaces. The above-mentioned simulated space tree refers to a collection of all the simulated spaces of itself and the lower level generated by the parent case. The same simulation space and different simulation spaces can be simulation space trees generated by different female parent cases or simulation space trees generated by the same female parent cases, students can interact with each other when assisted simulation is performed, and when independent simulation is performed, the students can only perform independent simulation and cannot observe other students. The invention creates and replicates different simulation spaces, so that students are not limited by the number of space users, and a plurality of students can be trained uniformly in the space. The meta-hospital system of the present invention is based on the concept of meta-universe, i.e., in this meta-hospital system, students in different geographical locations can log in the same simulation space or different simulation spaces of the meta-hospital, such as the simulation space of a cardiac ward or the simulation space of a cardiac intensive care unit, each student has an avatar in the simulation space of the meta-hospital system, and each avatar has a different identity, such as a doctor or a nurse, by manipulating the avatar of the simulation space of the meta-hospital, a targeted medical care work is provided for the patient in the ward, and interactions can be performed between the respective avatars, rescuing critical patients by team cooperation or completing the whole medical care work of the ward. The invention is defined by multidimensional copying of the progress and the difficulty, plans different simulation spaces of the same case, increases the number of medical cases, enables students to carry out self-adaptive selection based on the progress and the difficulty of the required study, and gradually decreases the difficulty from the upper position to the lower position, so that the study process of the students is divided into steps, and the students feel own lifting process to increase the study interest.
The meta-hospital system based on the extended reality digital twinning is also focused on how to realize a clinical environment with high reduction, immersion and simulation degree, so that students can feel the feeling of real clinical practice in the virtual environment.
According to a preferred embodiment, the case space 3 can be configured at least by a staff member. Preferably, the case database is transferred into the case space 3 for selection filling by the staff. The case space 3 can be connected with at least a database and a three-dimensional object library. The database may retrieve medical-related data and the three-dimensional object library may retrieve a multi-dimensional data model. Since the case space 3 is used for nursing training for a certain case, the case space 3 has at least a virtual background and a virtual object. The virtual object at least comprises an avatar, a virtual object and the like. The virtual objects include useful virtual objects and useless virtual objects. The useless virtual objects are virtual objects such as seats, sickbeds on which the patient lies, and the like, and the interactive properties are not required to be added. Useful virtual objects are, for example, those that can interact with each other, such as electrocardiographs, paper files, patient avatars, and the like. Preferably, the simulation space replicates the virtual background and useless virtual objects of the case space 3 to build a preliminary framework. Preferably, the simulation space is rated for progress and difficulty based on multidimensional data images associated with the virtual object of interest. Preferably, the useful virtual object is motivated to a multidimensional data image in case the operator applies an operation action through the augmented reality device 2. Preferably, the case databases in the case space 3 are displayed in the form of data, tables, virtual images, etc. Preferably, the composer correlates the case database into the multidimensional data image via the augmented reality device 2 to form a complete case space 3. Preferably, the processing unit 1 associates the corresponding data elements into the corresponding multidimensional data images based on virtual object interaction properties recorded in the case database. The case database includes patient physiological data, characteristic data and past data of the case. Patient physiological data such as blood pressure, heart rate, and parameters such as patient's present symptoms, signs, discomfort, etc. The characteristic data is, for example, the name, age, etc. of the patient. Past data such as past medical history of the patient, medication history, and the like. The data in the case database is populated into the multi-dimensional data image. Preferably, the processing unit 1 synchronously updates the corresponding multidimensional data image in association based on the update of the case database. The above-described update is an update between data elements, not an update of an image change. The editing process of the case space 3 is based on the augmented reality, the complex process of computer editing is eliminated, and the editing process is directly carried out in the case space 3. This results in a large number of cases of different processes and different difficulties both laterally and longitudinally. Compared with the prior art that complicated parameter setting is carried out through input equipment, the method has the advantages that the case editing speed is low, the editing quantity is small, and the method needs to be continuously switched in a database to search for required data. The required processes in the training are the same or different, so that the difficulty of training management is reduced, standard customization, diversified training management and efficiency management of the training are realized, and the defect that layer-by-layer setting is required in the traditional training is avoided. The multi-stage arrangement also reduces the transmission quantity of data, has a complete authority system, is easy to correct errors to find out the loopholes of case editing, and judges whether the medical cases are self-consistent. Furthermore, the existing case editing has the defect that since the editing is performed on the computer equipment, training is also performed on the computer equipment, so that the simulation of the case is in a two-dimensional form, and for acquiring data in the two-dimensional simulation, students are often trained by clicking on the image of a patient or according to the dialogue development and item selection modes. That is, only the student is required to select the correct option to represent the training completion, as opposed to the choice questions on the paper. The training method is applied to the augmented reality technology, and the training mode of students is changed from the source, is not limited to two dimensions, and is trained from the three-dimensional perspective by establishing the case space 3 and grading the case space into a plurality of simulation spaces. According to the invention, based on the selection of a user for each medical disease type, a female parent case conforming to the selection is selected from a plurality of female parent cases, and different cases of the same medical disease type are generated based on the female parent cases to be supplied to students for carrying out three-dimensional simulation cases, so that the students experience three-dimensional operation learning experience which is not experienced by two-dimensional virtual interaction, and the students have higher reduction degree, immersion feeling and simulation degree, and feel real clinical practice. The useful virtual object provided by the invention can also indirectly guide students to use equipment, train the students to know which equipment is needed to acquire medical data in actual operation, and the acquisition skills can be directly used in clinical operation to provide practical capability for the students. The lateral direction characterizes at least the number of patients being cared for and the severity of the disease. The longitudinal direction at least characterizes whether other complications are combined or not.
According to a preferred embodiment, each dimension in the multi-dimensional data image characterizes a different data type such that the simulation space is ranked in order of course and difficulty. The multidimensional data image is for example a polyhedron. Each face of the polyhedron is of each dimension. The staff fills the data of the useful virtual object by filling the relevant data in the case database into the face. Since the case database is displayed in the form of data, tables, virtual images, etc. The case database and the multidimensional data image can be displayed simultaneously. For example, when the first dimension of the multi-dimensional data image is heart rate data, the programmer fills the heart rate data in the case database into the first dimension of the multi-dimensional data image as needed. The heart rate data is all or part of the heart rate data of the condition from the beginning to the end of the condition and to the healing. The processing unit 1 is able to intercept heart rate data over a part of the time period to form an analogue space of different courses. Preferably, the case database is displayed at any location in the case space 3. For example, suspended alongside the multi-dimensional data image. Preferably, the staff members relate the data in the case database to the multi-dimensional data image by means of the augmented reality device 2 in an operative action. The type of association is preferably dependent on the operator action of the staff. The presentation status and size of the multidimensional data image and/or the case database is adjusted by the staff member via the augmented reality device 2.
Preferably, the processing unit 1 determines the multidimensional data image and/or the visualization feature of the virtual object to be displayed based on at least the data type. The visual features mentioned above refer to the features of the relevant condition that can be displayed directly from the external appearance of the virtual object. Such as pale complexion of the patient, warning of related detection devices, etc. The data types refer to data which needs students to perform self-judgment, for example, the disease condition and the development condition of the patient are judged from various indexes of the patient, and the disease condition of the patient is not indicated through visual text display.
In the knowledge accumulation stage, students often focus on basic knowledge and learning of related nursing measures, the knowledge is related knowledge information which can be directly acquired, for the practical nursing process, students are difficult to touch practical information related to equipment using methods, principles, data acquisition sources and the like, and paper surface teaching is a process of directly giving related information results, and missing information observation, acquisition and processing. For example, in electrocardiograph use, students adopting paper surface teaching or two-dimensional display interface teaching have difficulty in actually performing electrocardiograph use and electrocardiograph image acquisition by hands, thereby causing the knowledge system of the students to miss important jigsaw of practical operation. The prior art lacks a training process for acquiring the information, and even in a virtual reality technology with high simulation, the information display aiming at displaying the real virtual object is also lacking. On the one hand, the display area is too small, the content cannot be displayed in an all-around way, namely, multiple window switching is needed to realize the check of numerous information, and the learning efficiency is low. On the other hand, too much complicated information can influence the final training efficiency, students are difficult to completely receive the learning of the information in a certain time period, and the learning efficiency is reduced. In this regard, the invention adopts the combination of the virtual object and the multidimensional data image to finely classify the complex data, and the students can observe various required information through the display surfaces with different dimensions by exciting the display information of the operation actions of the users, thus intuitively establishing the internal relation between the equipment and the information, grasping the practical knowledge and providing teaching efficiency.
Specifically, the composer views the virtual background and virtual object located in the case space 3 through the augmented reality device 2 into the case space 3. The staff selects useful virtual objects through operation actions to excite the multidimensional data image. Wherein the useful virtual object displays the relevant data in a simulation space at least in a clinically operated manner. For example, when the virtual object of interest is an electrocardiograph, it displays its two-dimensional screen in the simulation space, including displaying the electrocardiographic waveform, duration, direction, etc., for the student to make a true solid electrogram data acquisition. The operator selects one or several data in the case database through the augmented reality device 2 to be associated into a dimension of the multi-dimensional data image based on the operation action. The operation action is, for example, an interactive action such as clicking or dragging. The operation actions can be set by the personnel in a self-defining way. The multidimensional data image and/or the case database are visually displayed in the case space 3. When the association setting of the multidimensional data image and the case database is completed, the processing unit 1 adjusts the relevant parameters of the useful virtual object based on the association. Preferably, the association can be visually displayed in case space 3. The association is represented by a virtually visible identifier so as to be beneficial to the personnel to judge the association relationship between the multidimensional data image and the case database. The specified data in the case database is transmitted to a specified dimension of the multi-dimensional data image and a visible identification is established. If the data in the case database changes, the data in the multidimensional data image changes correspondingly. For example, the identification can be a visible pattern of lines, gamma values, colors, and a combination of sparkle rules.
According to a preferred embodiment, the visible identifier can also represent the type of association after the association is established. The association type includes at least padding, correspondence, and/or mapping. The above-mentioned association type can be preset by a staff. The association type in the invention refers to that a case database as an applying party keeps association actions on multidimensional data images as applied parties to realize data interaction. For example, in the case where the association between the case database of the application party and the multidimensional data image as the application party is determined, when the association between the case database of the application party and the multidimensional data image as the application party is filled, the data of the case database is copied and written into the multidimensional data image. When the link relation between the case database of the applying party and the multidimensional data image as the applied party is corresponding, the data change of the case database can lead the data in the multidimensional data image to carry out the same change, and the data correction of the multidimensional data image can lead the data of the case database to carry out the same change. When the association relationship between the case database of the application party and the multidimensional data image as the application party is a mapping, the data change of the case database can cause the data of the multidimensional data image to change identically, and the data change of the multidimensional data image can not cause the data change of the case database to change. Therefore, the invention establishes the change relation of the data in a visible mode, so that the case editing process is simplified, the subsequent optimizing process and the new case supplementing process are also simplified, the case editing efficiency is improved, and the labor cost is saved.
According to a preferred embodiment, the size, line of sight and/or resolution of the multidimensional data image and/or the case database can be selected in case the constructor has the operation of the augmented reality device 2. Preferably, the multidimensional data image and/or the case database can be displayed in the case space 3 in an omni-directional rotating manner in case of the operation of the augmented reality device 2 by the constructor. Preferably, the presentation surface of the multidimensional data image and/or the case database is displayed in the field of view of the staff. Preferably, the identification between the multidimensional data images and/or the case databases is displayed in the case space 3 in a manner that is virtual in the covered situation in response to dragging and/or rotating of the multidimensional data images and/or the case databases. Preferably, the logo can be moved to the desired display surface in case the operator has the operation of the augmented reality device 2. Preferably, in the case where the multidimensional data image and the case database are moved in synchronization, the identification can be adaptively changed based on the movement process in such a manner that the association relationship is maintained unchanged.
According to a preferred embodiment, the multidimensional data image and/or the case database is provided with model tags for characterizing basic properties of the multidimensional data image and/or the case database. The model tag at least comprises a model name, a right name and a time name, and can also comprise other attributes needing to be marked. Model names are, for example, the name of the multidimensional data image and/or case database, creator name, modifier name, and manager name. Rights names are for example by whom the multidimensional data image and/or case database can be modified. The case editor has a higher authority to fully edit the multidimensional data image and/or the case database. The time name is, for example, the creation time, modification time, etc. of the multidimensional data image and/or case database.
Throughout this document, the word "preferably" is used in a generic sense to mean only one alternative, and not to be construed as necessarily required, so that the applicant reserves the right to forego or delete the relevant preferred feature at any time.
It should be noted that the above-described embodiments are exemplary, and that a person skilled in the art, in light of the present disclosure, may devise various solutions that fall within the scope of the present disclosure and fall within the scope of the present disclosure. It should be understood by those skilled in the art that the present description and drawings are illustrative and not limiting to the claims. The scope of the invention is defined by the claims and their equivalents. The description of the invention encompasses multiple inventive concepts, such as "preferably," "according to a preferred embodiment," or "optionally," all means that the corresponding paragraph discloses a separate concept, and that the applicant reserves the right to filed a divisional application according to each inventive concept.
Claims (10)
1. A meta hospital system based on augmented reality digital twinning, characterized in that the system comprises at least a processing unit (1), wherein,
-the processing unit (1) is adapted to create a case space (3) and several simulation spaces, and to configure the case space (3) and/or simulation spaces in response to a user operation;
The case space (3) provides editing services for medical cases, wherein the operation and/or configuration of the case space (3) is performed based on visible operation actions of a staff.
2. The augmented reality digital twinning-based meta hospital system according to claim 1, characterized in that the system further comprises an augmented reality device (2), the processing unit (1) creating the simulated space from the case space (3) in response to a request for creation of the simulated space issued by the augmented reality device (2).
3. The augmented reality digital twinning-based meta hospital system according to claim 1 or 2, wherein the processing unit (1) creates the same simulation space with the specified simulation space as a template in response to a request for creation of the specified simulation space by the augmented reality device (2), the processing unit (1) copying-dividing the case space (3) into a number of the simulation spaces based on a number of processes and difficulties of the same case that the case space (3) has.
4. A meta hospital system based on augmented reality digital twinning according to any one of claims 1 to 3, wherein several of said simulated spaces are distinguished in parallel and/or subordinate relation by progress and difficulty in the lateral and/or longitudinal direction.
5. The augmented reality digital twinning-based meta hospital system according to any one of claims 1 to 4, wherein a case database is transmitted into the case space (3) for selection filling by staff members, wherein,
the case space (3) has at least a virtual background and a virtual object, the virtual object including a useful virtual object and a useless virtual object; the virtual object is excited to generate a multidimensional data image when a person to be programmed applies an operation action through the augmented reality device (2).
6. The metahospital system based on augmented reality digital twinning according to any one of claims 1 to 5, characterized in that the simulation space replicates the virtual scenes and useless virtual objects of the case space (3) to build a preliminary framework; the simulation space is used for classifying the progress and the difficulty based on the multidimensional data image related to the useful virtual object.
7. The augmented reality digital twinning-based meta hospital system according to any one of claims 1 to 6, characterized in that a staff member associates the case database into the multi-dimensional data image via the augmented reality device (2) to form the case space (3); each dimension in the multi-dimensional data image characterizes a different data type such that the simulation space is ranked in order of course and difficulty.
8. The metahospital system based on augmented reality digital twinning according to any one of claims 1 to 7, characterized in that the processing unit (1) intercepts data of partial time periods in a multi-dimensional data image to form the analog space of different courses.
9. The metahospital system based on augmented reality digital twinning according to any one of claims 1 to 8, characterized in that the processing unit (1) adjusts the parameters of the useful virtual object based on the association after the association setup of the multidimensional data image and the case database is completed; the association is visually displayed in the case space (3);
specified data in the case database is transferred to specified dimensions of the multi-dimensional data image and a visible identification is established.
10. The augmented reality digital twinning-based meta hospital system according to any one of claims 1 to 9, wherein the visible identifier is further used to indicate the type of association after the association of the multi-dimensional data image and the case database is established; wherein the association type at least comprises filling, correspondence and/or mapping; the association type means that the case database as the applying party maintains an association action on the multidimensional data image as the applied party.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310267559.XA CN116312118A (en) | 2023-03-15 | 2023-03-15 | Meta hospital system based on augmented reality digital twinning |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310267559.XA CN116312118A (en) | 2023-03-15 | 2023-03-15 | Meta hospital system based on augmented reality digital twinning |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116312118A true CN116312118A (en) | 2023-06-23 |
Family
ID=86781182
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310267559.XA Pending CN116312118A (en) | 2023-03-15 | 2023-03-15 | Meta hospital system based on augmented reality digital twinning |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116312118A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117352118A (en) * | 2023-12-06 | 2024-01-05 | 惠医(天津)健康科技有限公司 | Multi-terminal diagnosis and treatment interaction method and device based on mobile internet |
-
2023
- 2023-03-15 CN CN202310267559.XA patent/CN116312118A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117352118A (en) * | 2023-12-06 | 2024-01-05 | 惠医(天津)健康科技有限公司 | Multi-terminal diagnosis and treatment interaction method and device based on mobile internet |
| CN117352118B (en) * | 2023-12-06 | 2024-03-08 | 惠医(天津)健康科技有限公司 | Multi-terminal diagnosis and treatment interaction method and device based on mobile internet |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Jang et al. | Direct manipulation is better than passive viewing for learning anatomy in a three-dimensional virtual reality environment | |
| CN104271066B (en) | Mixed image with the control without hand/scene reproduction device | |
| US6739877B2 (en) | Distributive processing simulation method and system for training healthcare teams | |
| Halbig et al. | Opportunities and challenges of virtual reality in healthcare–a domain experts inquiry | |
| Fried et al. | The role of virtual reality in surgical training in otorhinolaryngology | |
| US20140287395A1 (en) | Method and system for medical skills training | |
| Ullah et al. | Exploring the potential of metaverse technology in healthcare: applications, challenges, and future directions | |
| US20090202972A1 (en) | Bi-Directional Communication of Simulation Information | |
| Zhou et al. | VR/AR technology in human anatomy teaching and operation training | |
| Sadeghi Milani et al. | A systematic review of human–computer interaction (HCI) research in medical and other engineering fields | |
| CN116312118A (en) | Meta hospital system based on augmented reality digital twinning | |
| Paiva et al. | Enhancing collaboration on a cloud-based cve for supporting surgical education | |
| McBain et al. | Scoping review: the use of augmented reality in clinical anatomical education and its assessment tools | |
| Forrest et al. | Healthcare simulation at a glance | |
| CN116229793A (en) | Training and checking system based on virtual reality technology | |
| Anderson et al. | A haptic-based virtual reality head and neck model for dental education | |
| Ng et al. | Using immersive reality in training nursing students | |
| Patra et al. | Visualization in anatomy education | |
| CN115188232A (en) | Medical teaching comprehensive training system and method based on MR-3D printing technology | |
| Chen et al. | Application of XR technology in stomatology education: Theoretical basis, application scenarios and future prospects | |
| Gupta | Investigation of a holistic human-computer interaction (HCI) framework to support the design of extended reality (XR) based training simulators | |
| Hand et al. | Virtual Reality for teaching clinical skills in medical education | |
| Dudina et al. | The role of information technology in the training of healthcare professionals | |
| US20230052960A1 (en) | Customizable Extended Reality Patient Simulator and Method Thereof for Healthcare Education | |
| Kale et al. | Medical Learning and Training using VR |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |