TWI671762B - Method, computer-readable recording medium, computer program product and system for medical care evaluation in virtual reality environment from randomthird-person or operator viewpoint - Google Patents

Abstract

A virtual reality medical treatment scoring method, a computer-readable recording medium, a computer program product, and a system from a third-person perspective or an operator's perspective, the system includes: a processing unit and a database connected to the processing unit , A virtual reality module, a perspective adjustment module, a recording module and a scoring module. The virtual reality module is used to display the virtual reality corresponding to the medical care scenario from an operator's perspective on an operator's display, and display the virtual reality from the operator's perspective or a third person's perspective on a monitor. monitor. The recording module is used to record medical treatment information of an interactive device interacting with the virtual reality. The scoring module is used to generate a scoring result according to the medical treatment information and a preset scoring rule.

Description

A virtual reality medical treatment scoring method based on on-demand third-person perspective or operator perspective , Computer-readable recording media, computer program products, systems

The invention relates to virtual reality technology, in particular to a virtual reality medical treatment scoring method, a computer-readable recording medium, a computer program product, and a system from the perspective of an on-demand third person or an operator.

Most of the traditional medical staff training and scoring methods use realistic patients with related auxiliary equipment. However, this training method requires expensive teaching equipment and maintenance costs, and requires the cooperation of many teaching personnel. Limited by resources such as funding, manpower, and space, it is difficult to provide effective training results, and the scoring results are difficult to be close to the actual situation.

In order to improve the effect of medical teaching, there are currently teaching units that develop "3D Nursing Situation Simulation Digital Learning System" such as the Republic of China New Patent Bulletin M472924, which mainly includes a virtual reality scene database, an object database, and a nursing event. A database, and an interactive interface platform that displays the background map and objects of the scene corresponding to the event task. This learning system can display events and tasks from hospitalization to discharge through an interactive interface platform, including consultation, physical evaluation, medical treatment and nursing care, vital signs measurement, blood oxygen concentration measurement, drip count control, etc. However, the previous case is only suitable for self-training of medical staff, and it is difficult to meet the needs for scoring.

Therefore, in order to better score the medical treatment, the present inventor proposed a virtual reality medical treatment scoring method based on a third-person or operator's perspective on-demand, including: an environment establishment step, a perspective adjustment step, A medical treatment record step and a scoring step. The environment building step: a virtual reality module is used to display an image corresponding to a virtual reality of a medical care scene, the virtual reality image is displayed on an operator terminal display from an operator's perspective, and the virtual reality is displayed. The images are displayed on a monitor display from the operator's perspective or a third-person perspective, where the operator display is a virtual reality display. The viewing angle adjustment step: The virtual reality module receives a viewing angle adjustment instruction of a viewing angle adjustment module, so that the aforementioned virtual reality displayed on the monitor display is switched between the operator's perspective and the third person's perspective. The medical treatment record step: records a medical treatment information of an interactive device interacting with the virtual reality with a recording module, the medical treatment information includes at least any of the following two messages: a medical action track, a medical action time, a medical care Sequence of actions, an inquiry message, an instruction message. The scoring step: using a scoring module to generate a scoring result according to the medical treatment information and a preset scoring rule, the scoring rule includes at least any of the following: the degree of correspondence between the medical trajectory and a preset trajectory, the The degree of correspondence between the medical action time and a preset time, the degree of correspondence between the medical action sequence and a preset order, the degree of correspondence between the consultation information and a preset questionnaire, and the degree of correspondence between the instruction message and a preset instruction message .

Further, in the medical treatment recording step, the medical treatment treatment information further includes a medical treatment interactive movie, and the recording module receives a time stamp instruction corresponding to any time point of the medical treatment interaction movie, so that a time stamp module interacts with the medical treatment The movie produces the aforementioned time stamp.

Further, it further includes a time stamp counting step: counting a time stamp of each medical interactive movie through a time stamp statistics module, so as to extract an image segment with the most time tags or relatively many time stamps in the medical interactive movie.

Further, the perspective adjustment instruction includes any one or combination of a free adjustment instruction and a preset position switching instruction.

The present invention is also a computer-readable recording medium or a computer program product. The computer-readable recording medium and the computer program product both store a program. After the computer loads the program and executes the program, the foregoing can be completed. A virtual reality medical treatment scoring method based on a third-person or operator perspective.

The invention is also a virtual reality medical treatment scoring system from a third-person or operator's perspective, which is used to connect a monitor display and an operator's display. The virtual reality medical treatment scoring system includes a processing unit, a database connected to the processing unit, a virtual reality module, a perspective adjustment module, a recording module, and a scoring module. The database stores data corresponding to a virtual reality of a medical care scene. The virtual reality module is configured to display an image of the virtual reality on the operator display from an operator's perspective, and display the image of the virtual reality on the monitor from the operator's perspective or a third person's perspective. The monitor display, wherein the operator display is a virtual reality display. The recording module is used to record medical treatment information of an interactive device interacting with the virtual reality. The medical treatment information includes at least any of the following two messages: a medical action track, a medical action time, a medical action sequence, and an inquiry. Information, an instruction message. The scoring module is used to generate a scoring result according to the medical treatment information and a preset scoring rule. The scoring rule includes at least any of the following: the degree of coincidence between the medical trajectory and a preset trajectory, and the medical operative time. A degree of correspondence with a preset time, a degree of correspondence between the sequence of medical care actions and a preset sequence, a degree of correspondence between the consultation information and a preset consultation information, and a degree of correspondence between the instruction message and a preset instruction message.

Further, the medical treatment information further includes a medical interactive movie, and the recording module receives a time stamp instruction corresponding to any time point of the medical interactive movie, so that a time stamp module generates the aforementioned time stamp on the medical interactive movie.

Further, it further includes a time stamp statistics module connected to the processing unit. The time stamp statistics module is used to count the aforementioned time stamps of each medical interactive movie, so as to extract the most time stamps or relatively compare them in the aforementioned medical interactive movie One more video clip.

Further, the viewing angle adjustment instruction includes any one or combination of a free adjustment instruction and a preset position switching instruction, wherein the monitor display is not a virtual reality display, and a monitor using the monitor display is located in the monitor. Out of virtual reality.

According to the above technical features, the following effects can be achieved:

1. The operator's display is a virtual reality display to create an immersive medical care scene, so that the scoring results can be closer to the actual situation.

2. The scoring module can automatically perform scoring based on the consistency of medical action trajectory, medical action time, medical action order, consultation information, and indication information to provide objective scoring results quickly.

3. The recording module can record the trajectory, medical action time, medical action sequence, consultation information, medical interactive video, and instruction message of the interaction between the interactive device and the virtual reality.

4. The recording module can also generate time markers at specific time points in the interactive medical care videos, making it easy to trace back specific segments of the interactive medical care videos.

5. The time stamp statistics module can be used to count the time stamps of all the interactive medical care videos, so as to count the particular sections that are particularly prone to errors.

6. The monitor can use the viewing angle adjustment module to switch the virtual reality displayed on the monitor's monitor between the operator's perspective and the third person's perspective, so that the monitor can objectively avoid the dead angle as much as possible. score.

7. The angle of view adjustment method can be free adjustment or preset position switching, so that it can be adjusted or switched quickly according to the actual needs of the monitor, which is convenient to use.

8. The monitor display is a non-virtual reality display, so that the monitor can more objectively watch the medical treatment process.

(100) ‧‧‧Virtual Reality Medical Care Scoring System

(1) ‧‧‧Processing unit

(2) ‧‧‧Database

(3) ‧‧‧Virtual Reality Module

(4) ‧‧‧Viewing angle adjustment module

(5) ‧‧‧Recording module

(51) ‧‧‧Interactive device

(511) ‧‧‧Sensory operation handle

(52) ‧‧‧Time Stamping Module

(53) ‧‧‧Time stamp statistics module

(6) ‧‧‧Scoring Module

(10) ‧‧‧Monitor Monitor

(11) ‧‧‧ Perspective area

(11A) (11B) (11C) (11D) ‧‧‧Mark

(20) ‧‧‧Operator display

(A) ‧‧‧Virtual Reality

(A1) ‧‧‧Operating Room

(A2) ‧‧‧ Surgical Equipment

(A3) ‧‧‧ physiological signal monitoring equipment

(A4) ‧‧‧patient

(A5) ‧‧‧Operating Table

(B) ‧‧‧ operator virtual image

(S1) ‧‧‧Environmental building steps

(S2) ‧‧‧ Perspective adjustment steps

(S3) ‧‧‧Medical treatment record steps

(S4) ‧‧‧Scoring steps

(S5) ‧‧‧Time stamp statistics steps

(P1) ‧‧‧Monitor

(P2) ‧‧‧Operator

[First diagram] is a schematic diagram of a system architecture according to an embodiment of the present invention.

[Second figure] A block diagram of a system according to an embodiment of the present invention.

[Third figure] It is the first schematic diagram of the use interface according to the embodiment of the present invention, which shows the virtual reality including the operator's virtual image.

[Fourth diagram] is the second schematic diagram of the use interface of the embodiment of the present invention, which shows the virtual reality of the operator's perspective and medical treatment.

[Fifth figure] is the third schematic diagram of the use interface of the embodiment of the present invention, which displays the operator's perspective and provides a virtual reality page of physiological information pages.

[Sixth figure] is the fourth schematic diagram of the use interface according to the embodiment of the present invention, which shows the virtual reality of the third person's perspective of the operator's virtual image for medical treatment.

[Seventh figure] is the fifth schematic diagram of the use interface according to the embodiment of the present invention, which displays the operator's perspective and provides a virtual reality page of a question page.

[Eighth Figure] It is a schematic flowchart of main steps in the embodiment of the present invention.

[The ninth figure] is the sixth schematic diagram of the use interface according to the embodiment of the present invention, which shows the perspective of a third person and provides a scoring result in a medical treatment step.

[Tenth figure] is the seventh schematic diagram of the use interface according to the embodiment of the present invention, which shows the third person's perspective and provides the scoring result in another medical treatment step.

Synthesizing the above technical features, the main effects of the virtual reality medical treatment scoring method, computer-readable recording medium, computer program product, and system of the third-person perspective or operator perspective of the present invention can be clearly presented in the following embodiments. .

Please refer to the first figure first, which is a virtual reality medical treatment scoring system (100) for revealing an on-demand third-person perspective or an operator perspective according to an embodiment of the present invention, which is used to connect a monitor display (10) and an operator. As the monitor (20), the monitor (10) and the monitor (20) are for viewing by a monitor (P1) and an operator (P2), respectively. The operator display (20) is a virtual reality display to create a virtual reality (A) of a medical care scene, and the monitoring display (10) can display the operating display (20) synchronously or asynchronously. Image content for manual scoring. The monitor display (10) in this embodiment is a general computer screen, rather than the aforementioned virtual reality display, so that the monitor (P1) can be independent of the medical care scene, and it is easier to objectively view the medical treatment. process. However, the implementation is not limited to this. Depending on the viewing needs of the monitor (P1), the monitor-side display (10) may also adopt the aforementioned virtual reality display.

Continue to see the second picture and the first picture. The virtual reality medical treatment scoring system (100) from the perspective of a third-person or operator's choice includes: a processing unit (1), and a connection to the processing unit (1) A database (2), a virtual reality module (3), a perspective adjustment module (4), a recording module (5), and a scoring module (6): The database (2) stores Data corresponding to one of the virtual reality (A) of a medical care scene. For example, the medical care scene may be an emergency surgery scene, so the virtual reality (A) may include an operating room (A1), surgical equipment (A2), physiological signal monitoring equipment (A3), patient (A4), surgery Images of related common environmental components such as the platform (A5). These environmental components can be stored in advance with 3D image files and position coordinate information in the database (2). However, the implementation of the medical care scene is not limited to this. For example, the medical care scene may also be a general outpatient scene, so the virtual reality (A) may include clinics, desks and chairs, patients, nurses, and other related common Image of environmental elements. The implementation is not limited to the inside of the hospital, and it can also be used outdoors. For example, when first-aid measures are needed outdoors (such as poisonous snake bites, fractures, cardiac arrest, and foreign body obstruction in the respiratory tract, etc.), as long as the scenes that require medical treatment can belong to the above medical scene .

Please refer to the second picture and the first picture again. The virtual reality module (3) is used to display the virtual reality (A) on the operator terminal display (20) from the operator's perspective (or may be called the first Human perspective), and the virtual reality (A) is displayed on the monitor display (10) from the operator's perspective or a third person perspective, where the operator display (20) is a virtual reality display, virtual Reality monitors are usually with eye masks or heads In the form of a helmet, the display screen is close to the user's eyes, and the focal length is adjusted through the light path to project a wide-angle picture on the eyes at a short distance.

Please refer to the second figure again. The perspective adjustment module (4) is used to generate a perspective adjustment instruction to the virtual reality module (3), so that the aforementioned virtual reality (A) displayed on the monitor display (10). ) Switch between the operator's perspective and the third-person perspective. As shown in the first figure, the monitor-side display (10) presents a third-person perspective, and a virtual reality (A) including an operator's virtual image (B) can be observed. In detail, the perspective adjustment instruction may include any one or combination of a free adjustment instruction and a preset position switching instruction. The free adjustment instruction allows, for example, the monitoring end to adjust the viewing direction at will by using an input device (such as a keyboard's arrow keys). Specifically, the preset position switching instruction specifically presets multiple position coordinates in addition to the position coordinates of the operator in the virtual reality (A), and the viewing directions of these position coordinates are all directed toward the operator. The image (B) may be located at various positions such as above, in front of, and on both sides of the position coordinates of the operator's virtual image (B). As shown in the third figure, the third person's perspective can be switched to different preset positions, and the virtual reality (A) including the operator's virtual image (B) can also be observed. Therefore, when the monitor inputs the preset position switching instruction by using an input device (such as a mouse, a keyboard, etc.), the position coordinates can be switched to reduce the viewing angle as much as possible. As shown in the first figure, a viewing angle prompting area (11) may be additionally provided on the display interface of the monitoring end display (10), and the viewing angle prompting area (11) may have a plurality of signs (11A) (11B) ( 11C) (11D) to indicate the current perspective. The aforementioned sign (11A) may be an image of a person to represent the perspective of the operator; the sign (11B) (11C) (11D) may be a number to represent each third person's perspective. When switching between different viewing angles, the aforementioned signs (11A) (11B) (11C) (11D) can produce corresponding changes (such as zoom in, bold, color change, etc.) to remind the current viewing angle.

Continue to refer to the second picture and the first picture. The recording module (5) is used to record medical treatment information of an interactive device (51) interacting with the virtual reality (A). The interactive device (51) includes, for example, various body-sensory operation devices such as a body-sensory operation handle (511), a radio unit, and the like. The medical treatment information contains at least the following The second message: a track of medical care movement, a time of medical movement, a sequence of medical movement, an inquiry information, an instruction message. Continue to refer to the fourth figure, for example: the medical action track, the medical action time, and the medical action sequence, for example, the operator can control the movement track of the cotton swab (T) to apply the medicine, the time of applying the medicine, the application The order of medicines; please refer to the fifth figure, continued. During the medical treatment, the patient's physiological information page (101) can also be displayed for the operator to consider as the basis for medical treatment. Continue to refer to the sixth figure, the medical action trajectory, the medical action time, and the medical action sequence, for example, the operator can also control the forceps (J) to clear the action track, time, and order of the wound. Please refer to FIG. 7 for the continuation. The instruction message is, for example, an option selected by the operator in response to a question page prompted by the system. For example, the question page (102) may ask the operator whether to insert a chest tube, and the operator may input options such as "need" and "not needed" to input the instruction message.

Please refer to the first graph and the second graph again. The acquisition of the medical action track, the time of the medical action, and the sequence of the medical action, for example, can be obtained from the gyroscope, accelerometer, and keys of the somatosensory operation handle (511). And other components such as motion trajectory, angle, moving speed, pressing signal and other detection information. Then, the recording module (5) stores information of a medical action track, the medical action time and the medical action sequence. The radio unit can receive the operator's audio during the consultation process, and the recording module (5) can then convert the audio into text information for recording by voice recognition software. In this embodiment, the medical treatment information may further include a medical interactive video, which is specifically an image data of an operator interacting in the virtual reality (A), and the recording module (5 ) May also receive a time stamp instruction corresponding to any time point of the medical interactive movie, so that a time stamp module (52) generates the aforementioned time stamp on the medical interactive movie, so as to facilitate the retrospection of the image data at a specific time point afterwards.

It should be added that the hardware part of this embodiment may use HTC Vive products, and the VIVE head-mounted display in the HTC Vive product may be used as the aforementioned operator terminal display. The sensor and HTC Vive mounted on the VIVE head-mounted display The VIVE controller and VIVE base station in the product can form the aforementioned interactive device, and can detect the operator's position change, gestures, hand movement trajectory, virtual Related information such as object picking and placing instructions. For detailed principles, please refer to "Virtual Reality System, Control Method and Non-transitory Computer-readable Media" in Taiwan Invention Patent Bulletin No. I602083. Technology is not the focus of this case, and for brevity, it will not be described in detail here.

Please refer to the second figure. The scoring module (6) is used to generate a scoring result (such as a score table, a rating table or a comment) according to the medical treatment information and a preset scoring rule. The scoring rule includes at least any of the following: the degree of correspondence between the medical action track and a preset trajectory, the degree of correspondence between the medical action time and a preset time, the degree of correspondence between the medical action sequence and a preset order, the The degree of correspondence between the consultation information and a preset consultation information, and the degree of correspondence between the instruction message and a preset instruction message. For example, for emergency rescue techniques for injured people who have fallen from a height, the items that can be scored are: protection of the cervical spine, protection of the shoulder and cervical spine, inspection awareness, preliminary assessment, inquiry of medical history, judgment of the severity of the disease, oxygen supply, and fractures Each of these items, such as fixing, upper neck circumference stage, upper long backboard stage, upper stretcher bed stage, and ambulance stage stage, has its own medical treatment.

Taking the aforementioned medical history and the aforementioned fracture fixation as representatives, detailed inspection items are listed in Tables 1 and 2.

Regarding the above-mentioned items for inquiring the medical history, the scoring rule may include whether the entire content is completely inquired, whether the inquiry order is correct, and the like. The comparison method can use speech recognition and semantic analysis technology for comparison.

Regarding the above items of fracture fixation, the scoring rule may include the correct type of fixation equipment, assessment of the distal pulse of the affected limb, timing and timing of feeling and movement, time limit for installing fixation equipment, whether to install pads, and whether the fixation range of the fixation equipment Exceed the proximal and distal joints of the fracture, whether to re-evaluate the distal pulse, sensory and motor functions of the affected limb.

The following further takes the emergency rescue technology of patients with hypoglycemia as an example. The items that can be scored by the emergency rescue technology of patients with hypoglycemia are in order: inspection awareness, preliminary assessment, auxiliary examination, medical history inquiry, re-assisted examination, intravenous injection. And drug administration, disease severity judgment, stretcher bed stage, medical care and so on.

The aforementioned intravenous injection and drug administration are representatively listed in Table III:

Regarding the above items of intravenous injection and drug administration, the scoring rule may include whether to follow the steps, whether to choose the correct intravenous infusion solution, the dropper and needle, whether to sterilize, whether the injection needle is in the correct angle, and whether the infusion flow rate is adjusted appropriately.

For use, please continue to refer to Figure 8 and Figure 1. The virtual reality medical treatment scoring method of the third-person view or operator's point of view in this embodiment matches the above-mentioned third-person point of view or operator's point of view. Virtual reality medical treatment scoring system. The on-demand third person perspective or action The virtual reality medical treatment scoring method from the perspective of the user is programmable as a program in practice and stored in a computer program product or a computer-readable recording medium. After the computer loads the program and executes it, the aforementioned virtual reality medical treatment scoring method from the perspective of an on-demand third person or operator can be completed. The method of scoring a virtual reality medical treatment according to an optional third-person perspective or an operator's perspective in this embodiment mainly includes the following steps: an environment establishing step (S1), a perspective adjusting step (S2), a medical treatment recording step (S3), and Scoring step (S4):

The environment building step (S1): first causing the aforementioned virtual reality module (3) to display the aforementioned virtual reality (A) on the aforementioned operator terminal display (20), and causing the virtual reality (A) to be displayed on the Monitoring terminal display (10). Then, the operator can perform the aforementioned medical treatment (such as a surgical process, an inquiry process, an examination process, etc.), and during the aforementioned medical treatment, the aforementioned recording module (5) will perform the aforementioned medical treatment recording step (S3), During the aforementioned medical treatment record step (S3), the aforementioned recording module (5) may also receive a time stamp instruction triggered by an operator or a monitor, so that the time stamp module (52) can be used in the medical interactive movie. The aforementioned time stamp is generated at a specific time point to facilitate backtracking of the clip at the specific time point. During or after the aforementioned recording module (5) executes the aforementioned medical treatment record recording step (S3), the monitor can trigger the perspective adjustment instruction according to his or her own needs to execute the perspective adjustment step (S2), so that by The aforementioned viewing angle adjustment module (4) adjusts the required viewing angle and position (as shown in Figures 9 and 10), and the monitor can switch the viewing angle displayed by the virtual reality (A) at any time according to requirements. Reduce observing blind spots). On the other hand, the aforementioned scoring module (6) can perform the aforementioned scoring step (S4), so that the aforementioned scoring module (6) generates the aforementioned scoring results according to the medical treatment information and preset scoring rules (such as the ninth figure and the first As shown in Figure 10, the scoring results can be presented in a score table (103)]. This scoring result can be used as a reference for manual scoring, or statistical methods such as averaging or weighting with the results of manual scoring can be used to obtain the final scoring result.

Continuing, please refer to the eighth figure and the second figure. It is preferable that the aforementioned environmental establishment step (S1), the aforementioned perspective adjustment step (S2), the aforementioned medical treatment record recording step (S3), and the aforementioned scoring step (S4) have been completed. After the two executions, a time stamp statistics module (53) can be used to perform a time stamp statistics step (S5) to count the aforementioned time stamps of each medical interactive movie, so as to extract the former in the aforementioned medical interactive movie. An image segment with the most time stamps or a relatively large number is described in order to count specific specific segments that are particularly prone to errors, such as the sequence of medical care actions that are often wrong, and the medical care actions that are often wrong.

Based on the description of the above embodiments, the operation, use and effects of the present invention can be fully understood, but the above-mentioned embodiments are only preferred embodiments of the present invention, and the implementation of the present invention cannot be limited in this way. The scope, that is, the simple equivalent changes and modifications made according to the scope of the patent application and the description of the invention, are all within the scope of the present invention.

Claims (8)

A virtual reality medical treatment scoring method from a third-person perspective or an operator's perspective on-demand includes: an environment building step: displaying a virtual reality image corresponding to one of a medical care scene with a virtual reality module, the virtual reality The real image is displayed on an operator display from an operator's perspective, and the virtual image is displayed on a monitor display from the operator's perspective or a third person perspective, where the operator display is virtual Reality display; a viewing angle adjustment step: The virtual reality module receives a viewing angle adjustment instruction of a viewing angle adjustment module, so that the aforementioned virtual reality displayed on the monitor display is at the operator's perspective and the third person's perspective Switching between; a medical treatment record step: recording a medical treatment information of an interactive device interacting with the virtual reality with a recording module, the medical treatment information includes at least any of the following two messages: a medical operation track, a medical operation Time, a medical action sequence, an inquiry information, an instruction message, in the medical treatment recording step, the medical treatment information further includes a medical treatment Moving the movie, the recording module receives a time stamp command corresponding to any time point of the medical interactive movie, so that a time stamp module generates the aforementioned time stamp on the medical interactive movie; a grading step: a grading module is based on the One of the medical treatment information and a preset scoring rule generates a scoring result, the scoring rule includes at least any of the following: the degree of correspondence between the medical action track and a preset trajectory, and the degree of coincidence of the medical action time with a preset time , The degree of correspondence between the sequence of medical care actions and a preset order, the degree of correspondence between the consultation information and a preset questionnaire, and the degree of correspondence between the instruction message and a preset instruction message. The virtual reality medical treatment scoring method according to the third-person perspective or operator's perspective described in item 1 of the scope of the patent application, further includes a time stamp statistics step: each medical care interaction is counted by a time stamp statistics module The time stamp of the movie is used to extract an image segment with the most time stamp or relatively many time stamps in the medical interactive movie. A virtual reality medical treatment scoring method from a third-person perspective or an operator's perspective on-demand includes: an environment building step: displaying a virtual reality image corresponding to one of a medical care scene with a virtual reality module, the virtual reality The real image is displayed on an operator display from an operator's perspective, and the virtual image is displayed on a monitor display from the operator's perspective or a third person perspective, where the operator display is virtual Reality display; a viewing angle adjustment step: The virtual reality module receives a viewing angle adjustment instruction of a viewing angle adjustment module, so that the aforementioned virtual reality displayed on the monitor display is at the operator's perspective and the third person's perspective Switching between, wherein the perspective adjustment instruction includes any one or combination of a free adjustment instruction and a preset position switching instruction; a medical treatment recording step: recording a recording module to record an interaction between an interactive device and the virtual reality A medical treatment information, the medical treatment information includes at least any of the following two messages: a medical action track, a medical action time, a medical action sequence, Consultation information, an instruction message; a scoring step: a scoring module generates a scoring result based on the medical treatment information and a preset scoring rule, the scoring rule includes at least any two of the following: the medical trajectory and a pre- Set the degree of coincidence of the trajectory, the degree of coincidence of the medical care action time with a preset time, the degree of coincidence of the medical care sequence with a preset order, the degree of correspondence between the consultation information and a preset questionnaire, the instruction message and a The preset indicates how well the message matches. A computer-readable recording medium, which stores a program, and when the computer loads the program and executes it, it can complete the on-demand third-person perspective or operation as described in any one of the claims 1 to 3 Scoring method of virtual reality medical treatment from the perspective of the user. A computer program product that stores a program. After the computer loads the program and executes it, it can complete the on-demand third-person perspective or operator perspective as described in any one of the request items 1 to 3. Scoring method for virtual reality medical treatment. A virtual reality medical treatment scoring system from a third-person or operator's point of view, for connecting a monitor display and an operator's display, the virtual reality medical treatment from a third-person or operator's point of view The treatment scoring system includes: a processing unit; a database connected to the processing unit to store data corresponding to a virtual reality of a medical care scene; a virtual reality module connected to the processing unit, the virtual reality module is used for Display the virtual reality on the operator display from an operator's perspective, and display the virtual reality on the monitor display from the operator's perspective or a third person perspective, where the operator display is virtual Reality display; a viewing angle adjustment module connected to the processing unit, the viewing angle adjustment module is used to generate a viewing angle adjustment instruction to the virtual reality module, so that the aforementioned virtual reality displayed on the monitoring end display is in the operation Switching between the perspective of the third person and the perspective of the third person; a recording module connected to the processing unit for recording a medical treatment resource of an interactive device interacting with the virtual reality , The medical treatment information includes at least any of the following two messages: a medical operation track, a medical operation time, a medical operation sequence, an inquiry information, an instruction message, the medical treatment information further includes a medical interactive video, the recording module Receiving a time stamp instruction corresponding to any time point of the medical interactive movie, so that a time stamp module generates the aforementioned time stamp on the medical interactive movie; and a scoring module connected to the processing unit, the scoring module is based on the medical care The treatment information and one of the preset scoring rules generate a scoring result, and the scoring rule includes at least any of the following: the degree of correspondence between the medical action track and a preset trajectory, the degree of coincidence of the medical action time with a preset time, The degree of correspondence between the sequence of medical care actions and a preset order, the degree of correspondence between the consultation information and a preset questionnaire information, and the degree of correspondence between the instruction message and a preset instruction message. The virtual reality medical treatment scoring system according to the third-person view or operator's view described in item 6 of the scope of the patent application, further includes a time stamp statistics module connected to the processing unit. The time stamp statistics module is used for The aforementioned time stamps of each medical interactive movie are counted to extract an image segment with the most or relatively many time stamps in the aforementioned medical interactive movie. A virtual reality medical treatment scoring system from a third-person or operator's point of view, for connecting a monitor display and an operator's display, the virtual reality medical treatment from a third-person or operator's point of view The treatment scoring system includes: a processing unit; a database connected to the processing unit to store data corresponding to a virtual reality of a medical care scene; a virtual reality module connected to the processing unit, the virtual reality module is used for Display the virtual reality on the operator display from an operator's perspective, and display the virtual reality on the monitor display from the operator's perspective or a third person perspective, where the operator display is virtual Reality display; a viewing angle adjustment module connected to the processing unit, the viewing angle adjustment module is used to generate a viewing angle adjustment instruction to the virtual reality module, so that the aforementioned virtual reality displayed on the monitoring end display is in the operation Switching between the perspective of the person and the perspective of the third person, the perspective adjustment instruction includes any one or combination of a free adjustment instruction and a preset position switching instruction, wherein the monitoring The display is not a virtual reality display, so that a monitor using one of the monitoring end monitors is located outside the virtual reality image; a recording module connected to the processing unit for recording an interactive device interacting with the virtual reality Medical treatment information, the medical treatment information includes at least any of the following two messages: a medical action track, a medical action time, a medical action sequence, an inquiry information, an instruction message; and a scoring module connected to the processing unit , The scoring module generates a scoring result according to the medical treatment information and a preset scoring rule, the scoring rule includes at least any of the following: the degree of coincidence between the medical trajectory and a preset trajectory, the medical trajectory time and A degree of correspondence between a preset time, a degree of correspondence between the sequence of medical care actions and a predetermined order, a degree of correspondence between the consultation information and a preset consultation information, and a degree of correspondence between the instruction message and a predetermined instruction message.