KR20240000112A - System for simulating radiation therapy and method thereof - Google Patents

Abstract

A radiation therapy simulation system and method are provided. A radiation therapy simulation system according to some embodiments of the present disclosure includes a Head Mounted Display (HMD) device mounted on the patient's head and displaying a simulation image embodying a virtual radiation treatment facility, and a virtual radiation therapy device according to an inputted control command. It may include a main controller that controls radiation therapy simulation to be performed in a radiation therapy facility.

Description

Radiation therapy simulation system and method {SYSTEM FOR SIMULATING RADIATION THERAPY AND METHOD THEREOF}

The present disclosure relates to a radiation therapy simulation system and method, and more specifically, to a system for performing radiation therapy simulation using VR (Virtual Reality) or AR (Augmented Reality) technology and a method performed in the system. will be.

Radiation therapy refers to a treatment that kills cancer cells by irradiating high-energy radiation. The most important thing in the radiation treatment process is to ensure that the radiation is irradiated accurately to the planned area (i.e., target tumor). This is because if the irradiated radiation does not accurately reach the cancer cells, the effectiveness of the radiation treatment is reduced, and normal cells adjacent to the target tumor are excessively exposed to the radiation, which may have a detrimental effect on the patient. Meanwhile, unlike general radiotherapy, stereotactic radiosurgery treats cancer by irradiating high doses of radiation over a short period of time, once or several times, and can obtain results comparable to surgery. Therefore, in order to irradiate an accurate high dose of radiation only to the patient's tumor area while the patient has learned the correct radiosurgery process, the patient's simulated treatment process is very important. Therefore, patients undergoing radiosurgery/treatment practice treatment postures in advance through a simulated treatment process and use body fixation devices (e.g. masks, auxiliary devices for posture fixation when performing radiosurgery/treatment of brain tumors, spinal tumors, etc.) I am receiving radiosurgery/treatment while wearing it.

However, most patients experiencing radiosurgery/treatment for the first time may move their bodies during the treatment process due to the discomfort and frustration caused by wearing body fixation devices and vague fears about radiation therapy. The effectiveness of radiation treatment may be reduced and normal tissues may be irradiated, resulting in radiation side effects.

Korean Patent Publication No. 10-2021-0128851 (published on October 27, 2021)

The technical problem to be solved through some embodiments of the present disclosure is to provide a system that can accurately simulate a radiation treatment process and a method performed in the system.

Another technical problem to be solved through some embodiments of the present disclosure is to provide a simulation system that can provide a realistic radiation treatment experience to patients and a method performed in the system.

Another technical problem to be solved through some embodiments of the present disclosure is to provide a simulation system that can provide a simulation training function for radiation therapy and a method performed in the system.

The technical problems of the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by those skilled in the art from the description below.

In order to solve the above-mentioned technical problems, the radiation treatment simulation system according to some embodiments of the present disclosure includes a Head Mounted Display (HMD) mounted on the patient's head and displaying a simulation image embodying a virtual radiation treatment facility. It may include a main controller that controls the radiation therapy simulation to be performed according to a control command input while the device and the simulation image are displayed.

In one embodiment, the main controller may receive the control command through a command input device equipped with a haptic interface.

In one embodiment, the control commands may include couch control commands, gantry control commands, and mask control commands.

In one embodiment, the method further includes another HMD device mounted on the head of a medical staff member, wherein the HMD device displays a first simulation image, and the other HMD device displays a second simulation image synchronized with the first simulation image. However, the first simulation image may be a first-person view image of the patient, and the second simulation image may be a first-person view image of the medical staff.

In one embodiment, the main controller may detect that the patient is lying on the couch through a pressure sensor or proximity sensor installed on the couch in an actual simulation facility, and may initiate the radiation treatment simulation in response to the detection.

In one embodiment, the main controller may control a vibrator installed on the patient's body so that vibration stimulation is applied to the patient's body in response to a control command regarding wearing a mask.

In one embodiment, the main controller may control a vibrator installed on the patient's body so that vibration stimulation is applied to the patient's body in response to a control command for moving or rotating the couch.

In one embodiment, the main controller may control gantry rotation sound to be output through a speaker installed in the HMD device or an actual simulation facility in response to a control command related to gantry rotation.

In order to solve the above-described technical problem, the radiation therapy simulation method according to some other embodiments of the present disclosure is a method performed on at least one computing device, and includes a Head Mounted Display (HMD) device mounted on the patient's head. It may include controlling a simulation image in which a virtual radiation treatment facility is implemented to be displayed, receiving a predetermined control command, and controlling a radiation treatment simulation to be performed according to the input control command.

A computer program according to some embodiments of the present disclosure for solving the above-mentioned technical problems is combined with a computing device to implement a virtual radiation treatment facility through a Head Mounted Display (HMD) device mounted on the patient's head. It may be stored in a computer-readable recording medium to execute the steps of controlling a simulation image to be displayed, receiving a predetermined control command, and controlling a radiation therapy simulation to be performed according to the input control command.

According to some embodiments of the present disclosure, a radiation treatment simulation may be performed according to an input control command while a simulation image (e.g. VR image, AR image) embodying a virtual radiation treatment facility is displayed. Accordingly, the realism and immersion of radiation therapy simulation can be improved, and a highly realistic radiation therapy experience can be provided to patients. In addition, by allowing patients to experience the radiation treatment process in advance through simulation, the patient's movement during actual radiation treatment can be minimized, the radiation treatment effect can be greatly improved, and an appropriate clinical prognosis can be expected.

In addition, by controlling the stimulator so that stimulation is applied to the patient in response to a control command related to wearing a mask, or by controlling a simulation image that reflects the reduced field of view due to wearing a mask to be displayed, the pressure or pressure felt by the patient when wearing an actual mask is reduced. The sense of confinement can be accurately replicated. Accordingly, the realism and immersion of radiation therapy simulation can be further improved.

Additionally, a stimulator (e.g. vibrator) may be controlled so that stimulation (e.g. vibration stimulation) is applied to the patient's body in response to a control command for moving or rotating the couch. Accordingly, the situation in which the couch moves or rotates during radiation therapy can be accurately simulated, and the realism and immersion of the radiation therapy simulation can be further improved.

In addition, by controlling the gantry to rotate in virtual space in response to a control command related to gantry rotation and outputting its sound, the situation in which the gantry rotates during actual radiation therapy can be accurately simulated in virtual reality space. Accordingly, the realism and immersion of radiation therapy simulation can be further improved.

Additionally, the patient's degree of movement can be monitored while the radiation therapy simulation is in progress. Additionally, information about a simulation situation in which movement exceeds a reference value may be provided to the patient, or a message regarding the occurrence of movement may be notified to the patient in real time. Accordingly, an effect of inducing the patient to suppress movement can be achieved, and as a result, the performance effect of the radiation therapy simulation can be greatly improved.

The effects according to the technical idea of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below.

1(a) to 1(c) are exemplary diagrams for explaining a digital twin environment provided by a radiation therapy simulation system according to some embodiments of the present disclosure (specifically, representing a rotating gantry) It is a drawing.)
2 is an exemplary configuration diagram showing a radiation therapy simulation system according to some embodiments of the present disclosure.
Figure 3 is an exemplary diagram for explaining a command input device according to an embodiment of the present disclosure.
Figure 4 is an exemplary diagram for explaining simulation equipment worn (equipped) by a patient according to an embodiment of the present disclosure.
Figure 5 is an exemplary diagram for explaining a couch installed in an actual simulation facility according to an embodiment of the present disclosure.
6 is an example flowchart schematically showing a radiation therapy simulation method according to some embodiments of the present disclosure.
Figure 7 is an exemplary diagram for explaining a method for recognizing a patient's lying posture according to an embodiment of the present disclosure.
FIGS. 8 and 9 are exemplary diagrams for explaining simulation images that may be referenced in some embodiments of the present disclosure.
10 is an exemplary detailed flowchart illustrating a radiation therapy simulation method according to some embodiments of the present disclosure.
11 and 12 are exemplary diagrams for explaining a mask wearing simulation method according to an embodiment of the present disclosure.
Figure 13 is an exemplary flowchart showing a method of utilizing the results of monitoring a patient's movement according to an embodiment of the present disclosure.
Figure 14 is an example flowchart showing a method of utilizing the patient's movement monitoring results according to another embodiment of the present disclosure.
Figure 15 is an exemplary flowchart showing a method of utilizing the patient's movement monitoring results according to another embodiment of the present disclosure.
16 illustrates an example computing device that can implement a radiation therapy simulation system according to some embodiments of the present disclosure.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the attached drawings. The advantages and features of the present disclosure and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the technical idea of the present disclosure is not limited to the following embodiments and may be implemented in various different forms. The following examples are merely intended to complete the technical idea of the present disclosure and to be used in the technical field to which the present disclosure belongs. It is provided to fully inform those skilled in the art of the scope of the present disclosure, and the technical idea of the present disclosure is only defined by the scope of the claims.

When adding reference numerals to components in each drawing, it should be noted that identical components are given the same reference numerals as much as possible even if they are shown in different drawings. Additionally, in describing the present disclosure, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the present disclosure, the detailed description will be omitted.

Unless otherwise defined, all terms (including technical and scientific terms) used in this disclosure may be used with meanings that can be commonly understood by those skilled in the art to which this disclosure pertains. Additionally, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless clearly specifically defined. The terminology used in this disclosure is for describing embodiments and is not intended to limit the disclosure. In this disclosure, the singular includes the plural, unless specifically stated otherwise in the context.

Additionally, in describing the components of the present disclosure, terms such as first, second, A, B, (a), and (b) may be used. These terms are only used to distinguish the component from other components, and the nature, order, or order of the component is not limited by the term. When a component is described as being “connected,” “coupled,” or “connected” to another component, that component may be directly connected or connected to that other component, but there is another component between each component. It will be understood that elements may be “connected,” “combined,” or “connected.”

As used in this disclosure, “comprises” and/or “comprising” refers to a referenced component, step, operation and/or element that includes one or more other components, steps, operations and/or elements. Does not exclude presence or addition.

Hereinafter, various embodiments of the present disclosure will be described in detail according to the attached drawings.

FIG. 1 is an exemplary diagram schematically illustrating a radiation therapy simulation system 10 according to some embodiments of the present disclosure. In particular, Figure 1 illustrates a digital twin environment provided by the radiation therapy simulation system 10.

Specifically, FIGS. 1(a) to 1(c) are exemplary diagrams for explaining a digital twin environment provided by a radiation therapy simulation system according to some embodiments of the present disclosure (specifically, a rotating gantry). This is a drawing expressing .)

As shown, the radiation treatment simulation system 10 according to embodiments is a system that can perform radiation therapy simulation within a virtual space (see right drawing) very similar to an actual radiation treatment facility (see left drawing). You can. For example, in an actual radiation therapy facility, there are radiation therapy machines (13, e.g. linear accelerators), gantries (12), couches (11), etc., but the virtual space (i.e., virtual space) provided by the radiation therapy simulation system is Radiation therapy devices (16), gantries (15), and couches (14) may also appear in radiation treatment facilities. This virtual space can be implemented through VR (Virtual Reality) or AR (Augmented Reality) technology, providing a high sense of immersion and realism to patients and medical staff participating in radiation treatment simulation.

Hereinafter, the configuration and operation of the radiation therapy simulation system 10 will be described in more detail. However, for convenience of explanation, the radiation therapy simulation system 10 will be abbreviated as 'simulation system 10'.

FIG. 2 is an exemplary configuration diagram showing a simulation system 10 according to some embodiments of the present disclosure. Figure 2 assumes that patients and medical staff participate together in a radiation therapy simulation.

As shown in Figure 2, the simulation system 10 includes a main controller 21, a command input device 22, a Head Mounted Display (HMD) device 23 for patients (hereinafter referred to as the 'first HMD device'), and a medical staff. It may include an HMD device 24 (hereinafter referred to as 'second HMD device'), a sensor 25, and a stimulator 26. However, only components related to the embodiment of the present disclosure are shown in FIG. 2 . Accordingly, a person skilled in the art to which this disclosure pertains will know that other general-purpose components (e.g. output devices such as speakers, etc.) may be further included in addition to the components shown in FIG. 2. Additionally, each component shown in FIG. 2 represents functionally distinct functional elements, and a plurality of components may be implemented in an integrated form in an actual physical environment. Hereinafter, each component of the simulation system 10 will be described.

The main controller 21 can control the overall operation of the simulation system 10. Specifically, the main controller 21 uses the command input device 22 while a simulation image (e.g. VR image, AR image) embodying a virtual radiation treatment facility is displayed through each HMD device 23, 24. Radiation treatment simulation can be controlled to be performed according to control commands input through the control system.

For example, the main controller 21 may analyze the sensing data collected from the sensor 25 to recognize and monitor the patient's position, posture, and movement. As a more specific example, the main controller 21 collects sensing data from a position (or motion) sensor (e.g. acceleration sensor, proximity sensor, etc., see 42 in FIG. 4) installed on the patient's body and analyzes the collected sensing data. Thus, the patient's position, posture (e.g. standing, sitting, lying down, etc.), and degree of movement can be recognized. As another example, the main controller 21 may detect (or recognize) the patient's posture using a pressure sensor (e.g. see 52 in FIG. 5) or a proximity sensor attached to a couch in the actual environment, which will be described later. Let's do it. As another example, the main controller 21 may recognize the patient's position, posture, and degree of movement by analyzing the patient's image captured through a camera (ie, camera sensor).

Additionally, for example, the main controller 21 may perform appropriate control in response to a control command received from the command input device 22. This will be described in detail with reference to FIGS. 6 to 12.

Additionally, for example, the main controller 21 may control simulation images displayed through the first HMD device 23 and the second HMD device 24 to be synchronized with the simulation progress state (situation). As a more specific example, the main controller 21 can control the patient's position, posture, movement, etc. recognized through the sensor 25 to be reflected in the simulation image in real time (e.g. the patient's position, posture, movement, etc. (so that it is reflected on the patient avatar in the simulation image), and the simulation progress according to the input control command can be controlled so that it is reflected in the simulation image in real time (e.g. when a command to wear a mask is input, the patient avatar in the simulation image wears a mask) to be worn). Any method may be used to synchronize the simulation progress state (situation) and the simulation video. For example, in the case where the main controller 21 streams simulation images to each HMD device 23 and 24, the main controller 21 can reflect the simulation progress status (situation) in the streaming image in real time. If a separate streaming server exists, the main controller 21 can control the streaming server so that the simulation progress state (situation) is reflected in the streaming video. As another example, if each HMD device 23, 24 displays a pre-stored simulation image, the main controller 21 can control each HMD device 23, 24 to reflect the simulation progress state (situation). there is.

Additionally, for example, the main controller 21 may store various data/information associated with the radiation therapy simulation in local or remote storage (e.g. cloud storage).

Additionally, for example, the main controller 21 can monitor the progress of the simulation (situation) through the sensor 25, etc., and provide the monitoring results in real time through a website. Monitoring results include, for example, images taken of patients in actual simulation facilities, simulation images, information recognized through sensing data (e.g. patient's position, posture, degree of movement), information about the current simulation situation (e.g. related control commands, etc.) ), etc., but the scope of the present disclosure is not limited thereto. For reference, an actual simulation facility is a facility (or space) where the simulation system 10 is built, and may refer to a facility prepared to allow patients and medical staff to perform radiation therapy simulation together. Regarding the actual simulation facility, it will be described later with reference to FIG. 5. In this example, the website may be provided by the main controller 21 or may be provided through a separate web server (not shown).

The detailed operation of the main controller 21 will be described in more detail later with reference to the drawings of FIG. 6 and below.

The main controller 21 may be implemented with at least one computing device. For example, main controller 21 may be implemented with one computing device, or a first function of main controller 21 may be implemented in a first computing device and a second function may be implemented in a second computing device. . Alternatively, specific functions of main controller 21 may be implemented in multiple computing devices.

A computing device may encompass any device equipped with a computing function, and for an example of such a device, refer to FIG. 16.

Next, the command input device 22 can receive various control commands related to radiation therapy simulation and transmit the input control commands to the main controller 21. The command input device 22 may be used by a radiation therapy simulation facilitator (e.g. medical staff, patient, third party, etc.). For example, medical staff can perform a radiation treatment simulation using the command input device 22.

Control commands may include, for example, couch control commands, gantry control commands, and mask control commands. However, the scope of the present disclosure is not limited thereto, and the control command may further include commands such as radiation irradiation, simulation scenario save/load/edit, etc. For reference, the couch control command may include instructions for moving and rotating the couch, the gantry control command may include instructions for rotating the gantry, and the mask control command may include instructions for putting on and taking off the mask. You can.

The command input device 22 may be implemented as hardware such as a terminal, or may be implemented as software such as an app.

For example, as shown in FIG. 3, the command input device 22 may be implemented as a terminal equipped with a haptic interface (i.e., a tactile interface). Figure 3 shows that the command input device 22 has a first interface 31 for receiving a couch control command, a second interface 32 for receiving a gantry control command, and a third interface 33 for receiving a mask control command. This is shown as an example, and each interface 31 to 33 is shown as an example implemented in the form of a button. And, the left side of FIG. 3 shows a front view of the command input device 22, and the right side shows a side view.

As another example, the command input device 22 may be implemented as an app and installed on the radiation therapy simulation host's terminal. For example, a command input app may be installed on the medical staff's terminal (e.g. smartphone). In this case, the medical staff may conduct a radiation treatment simulation using their own terminal. Alternatively, the command input device 22 may be installed in the main controller 21 or a separate computing device.

Description will be made again with reference to FIG. 2 .

The first HMD device 23 may refer to an HMD device mounted on the patient's head. That is, the patient can participate in the radiation treatment simulation while wearing the HMD device 23. The first HMD device 23 may display a simulation image (e.g. VR image, AR image) in which a virtual radiation treatment facility is implemented. As described above, the first HMD device 23 can display a simulation image synchronized with the patient's simulation progress state (situation).

Next, the second HMD device 24 may refer to an HMD device mounted on the head of a medical staff member. In other words, medical staff can also participate in the radiation treatment simulation while wearing the HMD device 24. The second HMD device 24 can also display a simulation image synchronized with the patient's simulation progress status (situation). For reference, if the medical staff does not participate in the radiation therapy simulation (e.g., only the patient participates), the second HMD device 24 may be omitted from the configuration of the simulation system 10.

Meanwhile, the simulation images displayed by the two HMD devices 23 and 24 may be images from different viewpoints. For example, the first HMD device 23 displays a first-person view image of the patient (e.g. an image in which only the avatars of the medical staff appear and the patient's avatar does not appear), and the second HMD device 24 displays a first-person perspective image of the patient, and the second HMD device 24 displays an image of the medical staff from a first-person perspective. A video from a first-person perspective (e.g. a video in which the relevant medical staff does not appear and only the avatars of the patient and other medical staff appear) can be displayed. In this case, the sense of immersion in the radiation therapy simulation can be further improved. However, in some cases, the first HMD device 23 and the second HMD device 24 may display images from a third-person perspective (e.g. images in which avatars of patients and medical staff appear together).

Each HMD device 23, 24 may display a pre-stored simulation image, or may receive and display the simulation image in real time from the main controller 21 or a separate streaming server (not shown). Each HMD device 23, 24 may use any method to display the simulation image.

Each HMD device 23, 24 may or may not be equipped with a module (e.g. headphones, speakers) that outputs sound. If a sound output module is not provided, a speaker (not shown) controlled by the main controller 21 may be installed in the actual simulation facility.

Next, the sensor 25 may be a general term for various sensors used to sense (monitor) the simulation progress state and the state of the patient and/or medical staff. For example, the sensor 25 may include a position (and motion) sensor installed on the patient's body, a pressure sensor or proximity sensor installed on a couch in an actual simulation facility, a camera sensor installed to photograph the patient, etc. . However, the scope of the present disclosure is not limited thereto. Data sensed by the sensor 25 may be transmitted to the main controller 21.

Next, the stimulator 26 may be a general term for various actuators for delivering (outputting) stimulation to the patient. For example, the stimulator 26 may include a vibrator (e.g. a vibration motor) that outputs (generates) a vibration stimulus, a pressurizer that outputs (generates) a pressure stimulus, etc. However, the scope of the present disclosure is not limited thereto. The stimulator 26 is installed on the patient's body and can output stimulation under the control of the main controller 21. By doing so, the realism and immersion of the radiation therapy simulation can be doubled, which will be described later.

Communication between the components 21 to 26 shown in FIG. 2 may be performed through various types of communication interfaces such as a USB interface, a serial communication interface such as RS-232, a wired or wireless Ethernet interface, and through any communication interface. It is okay even if it is carried out.

So far, the configuration and operation of the simulation system 10 according to some embodiments of the present disclosure have been described with reference to FIGS. 1 to 3. Below, in order to provide easier understanding, we will briefly describe the equipment worn by patients and medical staff participating in radiation therapy simulation and the actual simulation facility.

As shown in FIG. 4, in order to participate in the radiation therapy simulation, the patient may wear simulation equipment such as the first HMD device 23, the vibrator 41, the position sensor 42, etc. The first HMD device 23 is worn on the patient's head, and other simulation equipment (e.g. vibrator 41, position sensor 42, etc.) is installed (mounted) on appropriate body parts (e.g. shoulder, chest, neck, etc.) It can be. For example, a patient can easily install simulation equipment by wearing a belt or vest on which the corresponding simulation equipment (e.g. vibrator 41, position sensor 42, etc.) is installed, but the scope of the present disclosure is not limited thereto. In some cases, stimulators (e.g. pressurizers) other than the vibrator 41 and sensors other than the position sensor 42 may be installed on the patient's body. Additionally, in order to increase the accuracy of sensing, a plurality of position sensors 42 may be installed on the patient's body, and a plurality of vibrators 41 may be installed on the patient's body.

To participate in the radiation therapy simulation, the medical staff may wear the second HMD device 24. And, to proceed with the simulation, the medical staff may possess a command input device 22. In some cases, the sensor 25 may also be installed on the body of the medical staff.

Meanwhile, the radiation treatment simulation may be performed in an actual radiation treatment facility (e.g., when the simulation system 10 is built in the radiation treatment facility) or may be performed in a separately provided simulation facility. If a simulation facility is provided separately, the facility may also be equipped with a couch where the patient can lie down. For example, a couch 51 as shown in FIG. 5 may be installed in a simulation facility. However, the scope of the present disclosure is not limited thereto, and in some cases, a fixed couch may be installed to reduce costs, a motion couch identical to an actual radiation therapy room may be installed to maximize realism, or a motion couch equipped with a vibration function may be installed. A couch may be installed.

The illustrated couch 51 may be manufactured to allow angle adjustment at both ends, left and right movement (x-axis movement), forward and backward movement (y-axis movement), and up and down movement (z-axis movement). Such a couch 51 may be manufactured using, for example, a motion bed, but the scope of the present disclosure is not limited thereto. A pressure sensor 52 or a proximity sensor may be installed in the illustrated couch 51 to detect the patient's posture. The method of detecting the patient's posture using the pressure sensor 52 will be described later with reference to FIG. 7 . The illustrated couch 51 can be controlled by the main controller 21.

So far, with reference to FIGS. 4 and 5 , equipment worn by patients and medical staff participating in the radiation therapy simulation and the actual simulation facility have been briefly described. Hereinafter, various methods that can be performed in the simulation system 10 will be described in detail with reference to the drawings of FIG. 6 and below.

Hereinafter, for convenience of understanding, the first HMD device 23 is worn on the patient's head, and the sensor 25 and the stimulator 26 are worn on the patient's body (see FIG. 4). The explanation will be continued assuming that the methods to be described later are performed while the second HMD device 24 is worn on the second medical staff's head. Additionally, the description will be continued assuming that radiation therapy simulation is performed on the couch 51 as illustrated in FIG. 5 . In addition, the operation of the simulation system 10 will be explained focusing on the operation of the main controller 21. Therefore, when the subject of a specific operation is omitted, it can be understood as being performed by the main controller 21.

6 is an example flowchart schematically showing a radiation therapy simulation method according to some embodiments of the present disclosure. However, this is only a preferred embodiment for achieving the purpose of the present disclosure, and of course, some steps may be added or deleted as needed.

As shown in FIG. 6, the radiation therapy simulation method according to embodiments may begin in step S61 of recognizing the patient's posture. For example, the main controller 21 may recognize the patient's posture by analyzing sensing data collected through the sensor 25. However, the specific method may vary depending on the embodiment.

In one embodiment, the main controller 21 may collect sensing data from a position sensor installed on the patient's body and analyze the collected sensing data to recognize the patient's posture. For example, the main controller 21 can predict the patient's posture using a learned deep learning model. Alternatively, the main controller 21 may analyze the sensing data to extract a pattern and recognize the patient's posture by comparing the extracted pattern with previously stored patterns (e.g. patterns of sensing data for each posture).

In another embodiment, the main controller 21 may recognize the patient's posture through a pressure sensor or proximity sensor installed on a couch in an actual simulation facility. For example, as shown in FIG. 7, the main controller 21 can detect that the patient 71 is lying on the couch 51 through the pressure sensor 52 installed on the couch 51. In some cases, the main controller 21 may detect that the patient 71 is lying on the couch 51 based further on the angle state of the couch 51 . When the patient 71 first lies down on the couch 51, both ends of the couch 51 will be in a horizontal state (see FIG. 7), so the main controller 21 uses this point to allow the patient 71 to lie down on the couch ( 51) can be accurately detected when lying down.

In another embodiment, the main controller 21 may receive images of a patient from a camera installed in an actual simulation facility and analyze the received images to recognize the patient's posture.

In another embodiment, the patient's posture may be recognized based on various combinations of the above-described embodiments. For example, the main controller 21 predicts the patient's posture by analyzing sensing data collected through a position sensor, predicts the patient's posture by analyzing the patient's image, and recognizes the patient's posture by combining the predicted results. (e.g. if the prediction results are the same, the patient's posture is recognized as the predicted posture).

In step S62, it may be determined whether the recognized posture is a lying posture. In response to determining that the posture is lying down, step S63 may begin. That is, in response to the determination that the posture is lying down, the main controller 21 may start a radiation therapy simulation (e.g. activating the command input device 22).

In one embodiment, in response to determining that the recognized posture is a supine posture, main controller 21 may initiate or resume a radiation therapy simulation (e.g. activating command input 22). And, in response to determining that the recognized posture is not a lying posture, the main controller 21 may stop or terminate the ongoing radiation therapy simulation (e.g. deactivate the command input device 22). In this case, the problem of a decrease in the safety of the simulation due to incorrect operation of the command input device 22 can be prevented in advance. For example, if the medical staff accidentally presses the couch movement button on the command input device 22 while the patient is getting up from the couch (when the couch in the actual simulation facility is moved/rotated by the couch control command), the patient may fall from the couch and suffer injury. You can wear it, but these problems can be prevented in advance.

Meanwhile, although not shown in FIG. 6, in various embodiments of the present disclosure, the patient's posture recognition results may be reflected in the simulation image in real time. In other words, the simulation image displayed through the HMD device (e.g. 23) can be synchronized with the simulation progress status (situation) in real time. For example, let us assume that two medical staff and a patient participated in a radiation treatment simulation, and that the posture recognized by the main controller 21 was a lying posture. In this case, the first medical staff's HMD device 24 may display the simulation image 80 as illustrated in FIG. 8 . Figure 8 illustrates a first-person perspective image of a first medical staff member, in which a second medical staff member's avatar 81 and a patient's avatar 82 appear in a virtual radiation treatment facility, and the patient's posture information (i.e., lying posture) is displayed. This illustrates that is reflected in real time on the patient's avatar 82. Alternatively, the HMD devices 23 and 24 of patients or medical staff may display the simulation image 90 as illustrated in FIG. 9 . Figure 9 illustrates an image from a third-person perspective, in which medical staff and patient avatars 91 to 93 appear in a virtual radiation treatment facility, and the patient's posture information (i.e., lying posture) is displayed in the patient's avatar 91. ), which is reflected in real time.

This will be described again with reference to FIG. 6 .

In step S63, radiation therapy simulation may be controlled to be performed according to the input control command. For example, when a medical staff inputs a control command through the command input device 22, the main controller 21 can control the radiation therapy simulation to be performed (proceed) according to the input control command. This will be explained in more detail later.

Hereinafter, the radiation therapy simulation method according to some embodiments of the present disclosure will be described in more detail with reference to FIGS. 10 to 12. However, for clarity of the present disclosure, description of content that overlaps with the previous description will be omitted.

10 is an exemplary detailed flowchart illustrating a radiation therapy simulation method according to some embodiments of the present disclosure. However, this is only a preferred embodiment for achieving the purpose of the present disclosure, and of course, some steps may be added or deleted as needed. Hereinafter, it will be described with reference to FIG. 10.

As described above, the radiation therapy simulation method according to embodiments may begin at step S101 in which the main controller 21 recognizes the patient's lying posture. Regarding this step, please refer to the description of steps S61 and S62 described above.

In step S102-1, the command input device 22 may transmit a control command regarding wearing a mask to the main controller 21. For example, when a medical staff inputs a control command for wearing a mask through the command input device 22, the command input device 22 may transmit the input command to the main controller 21.

In step S102-2, in response to the input command, the main controller 21 may control the stimulator 26 (i.e., control the output) so that stimulation is applied to the patient. For example, the main controller 21 may control a vibrator to apply vibration stimulation to the patient's body, or control a pressurizer to apply pressure stimulation. By doing so, the pressure or restraint that the patient feels when wearing an actual mask can be simulated, and the realism and immersion of the radiation therapy simulation can be further improved.

In one embodiment, the reduction in field of view due to wearing a mask can be simulated through switching of the simulation image. For example, the main controller 21 may change the display image of the first HMD device 23 from the first simulation image (i.e., a simulation image in which field of view reduction is not reflected, and an image before a control command for wearing a mask is input) to the mask. It can be controlled to switch to a second simulation image that reflects the decrease in field of view due to wearing. For example, the main controller 21 may transmit an image switching request to the first HMD device 23 or transmit (or stream) a second simulation image to the first HMD device 23. In order to provide easier understanding, this embodiment will be further described with reference to FIGS. 11 and 12.

As shown in FIG. 11, assume that the mask 112 worn by the patient avatar 111 in the simulation image 110 is a grid-shaped mask. FIG. 11 illustrates a simulation image 110 (part of the image, to be precise) displayed on the second HMD device 24 as a control command related to wearing a mask is input. In this case, as shown in FIG. 12, the display image of the first HMD device 23 can be switched from the first simulation image 121 to the second simulation image 122 in which the view occlusion by the grid is reflected. there is. By doing so, even the reduction in field of view caused by wearing a mask can be accurately simulated, and the realism and immersion of the radiation treatment simulation can be maximized.

Description will be made again with reference to FIG. 10 .

In steps S103-1 and S103-2, the current simulation progress state (i.e., mask wearing state) may be reflected (i.e., synchronized) in the simulation image. For example, the main controller 21 transmits a synchronization request to each HMD device 23 and 24, and each HMD device 23 and 24 responds to the synchronization request and sends a simulation image reflecting the current simulation progress state (FIG. 11 and simulation images 110 and 122 of FIG. 12) can be displayed. At this time, the synchronization request may include information about the current simulation progress state. Alternatively, the main controller 21 may transmit (or stream) a simulation image reflecting the current simulation progress state to each HMD device 23 and 24. However, the scope of the present disclosure is not limited by these examples.

In step S104-1, the command input device 22 may transmit a control command regarding couch movement or rotation to the main controller 21. For example, when the medical staff inputs a control command for moving the couch through the command input device 22, the command input device 22 may transmit the input command to the main controller 21.

In step S104-2, in response to the input command, the main controller 21 may move or rotate the couch (see couch 51 in FIG. 7) of the actual simulation facility (e.g. movement, angle adjustment, rotation of couch 51). etc). Additionally, the main controller 21 can control the stimulator 26 so that stimulation is applied to the patient. For example, the main controller 21 may control the vibrator so that vibration stimulation is applied to the patient's body (that is, control the vibrator to simulate the vibration transmitted to the body when the couch is moved). By doing so, the situation in which the couch moves or rotates during radiation therapy can be accurately simulated, and the realism and immersion of the radiation therapy simulation can be further improved.

In one embodiment, in response to an input command, the main controller 21 may control the viewpoint of the simulation image of the first HMD device 23 to move or rotate (i.e., even though the patient does not turn his head) and the viewpoint of the simulation image is moved or rotated). For example, if the couch installed in the actual simulation facility is a fixed couch, the main controller 21 may simulate a situation in which the couch moves or rotates by moving or rotating the viewpoint of the simulation image.

In steps S105-1 and S105-2, the current simulation progress state (i.e., couch movement/rotation state) may be reflected (i.e., synchronized) in the simulation image. In other words, the couch can be moved or rotated even in the simulation video. For example, the couch on which the patient avatar is lying may be moved even in the simulation image of the second HMD device 24.

In step S106-1, the command input device 22 may transmit a control command regarding gantry rotation to the main controller 21. For example, when the medical staff inputs a control command for gantry rotation through the command input device 22, the command input device 22 may transmit the input command to the main controller 21.

In step S106-2, in response to the input command, the main controller 21 may control the gantry rotation sound to be output through each HMD device 23, 24 or a speaker installed in the actual simulation facility. By doing so, the situation in which the gantry rotates during radiation therapy can be simulated, and the realism and immersion of the radiation therapy simulation can be further improved.

In steps S107-1 and S107-2, the current simulation progress state (i.e., gantry rotation state) may be reflected (i.e., synchronized) in the simulation image. That is, the gantry can be rotated even in the simulation images of each HMD device 23 and 24.

Meanwhile, Figure 10 shows as an example that control commands are input in the order of wearing a mask, moving (or rotating) the couch, and rotating the gantry, but the order in which the control commands are input can be changed at any time. Additionally, in some cases, specific control commands may be input repeatedly in order to repeatedly experience (train) a specific situation (e.g. commands to put on and take off the mask are input repeatedly).

So far, the radiation therapy simulation method according to some embodiments of the present disclosure has been described with reference to FIGS. 10 to 12. According to the above, a radiation treatment simulation can be performed according to an input control command while a simulation image (e.g. VR image, AR image) embodying a virtual radiation treatment facility is displayed. Accordingly, the realism and immersion of radiation therapy simulation can be improved, and a highly realistic radiation therapy experience can be provided to patients. In addition, by allowing patients to experience the radiation treatment process in advance through simulation, patient movement during actual radiation treatment can be minimized and the radiation treatment effect can be greatly improved.

Hereinafter, embodiments of methods for utilizing the patient's movement monitoring results will be described with reference to FIGS. 13 to 15 .

Figure 13 is an example flowchart showing a method of utilizing a patient's movement monitoring results according to an embodiment of the present disclosure.

As shown in FIG. 13, this embodiment may begin at step S131, where a radiation therapy simulation is performed according to an input control command. For this step, please refer to the description in FIG. 10.

In step S132, the patient's degree of movement may be monitored while the radiation therapy simulation is in progress. For example, the main controller 21 may monitor the patient's degree of movement through a position sensor installed on the patient's body.

In step S133, information regarding a simulation situation in which the degree of movement exceeds the reference value may be extracted. For example, the main controller 21 can extract information about simulation situations in which the patient's degree of movement exceeds the standard value (e.g. when wearing a mask, moving a couch, assuming a specific posture, etc.) and provide the extracted information. there is. At this time, the extracted information may include, for example, the patient's posture, control commands related to the simulation situation, time elapsed from the start of the simulation, etc., but the scope of the present disclosure is not limited thereto.

So far, a method of utilizing the patient's movement monitoring results according to an embodiment of the present disclosure has been described with reference to FIG. 13 . According to the above, the performance effect of radiation therapy simulation can be further improved by providing information about simulation situations in which the patient moves violently. For example, if the patient's movement occurs excessively in a specific treatment position, the medical staff can devise a different treatment position to reduce the patient's movement during actual radiation treatment. Alternatively, by transmitting posture information that causes excessive movement to the patient, the effect of inducing the patient to suppress his or her own movement during actual radiation treatment may be achieved.

Hereinafter, a method of utilizing the patient's movement monitoring results according to another embodiment of the present disclosure will be described with reference to FIG. 14. However, for clarity of the present disclosure, description of content that overlaps with the previous embodiments will be omitted.

As shown in FIG. 14, this embodiment can also start at step S141, where radiation therapy simulation is performed according to the input control command.

In step S142, the patient's degree of movement may be monitored while the radiation therapy simulation is in progress.

In step S143, if the degree of movement exceeds the reference value, a predetermined message may be notified to the patient in real time. For example, the main controller 21 may notify the patient in a manner that the patient can perceive with a message indicating that excessive movement is currently occurring. As a more specific example, the main controller 21 may audibly notify the patient of a message regarding the occurrence of movement (or refraining from movement) through the first HMD device 23 or a speaker installed in an actual simulation facility. Alternatively, the main controller 21 may visually notify the patient of a message regarding the occurrence of movement (or refraining from movement) through the display image of the first HMD device 23.

So far, a method of utilizing the patient's movement monitoring results according to another embodiment of the present disclosure has been described with reference to FIG. 14 . According to the above, the effect of inducing the patient to suppress the movement can be achieved by notifying the patient of a predetermined message when the patient's movement is excessive, and thus the performance effect of the radiation therapy simulation can be further improved.

Hereinafter, a method of utilizing the patient's movement monitoring results according to another embodiment of the present disclosure will be described with reference to FIG. 15. However, for clarity of the present disclosure, description of content that overlaps with the previous embodiments will be omitted.

As shown in FIG. 15, this embodiment can also begin at step S151, where radiation therapy simulation is performed according to the input control command.

In step S152, the patient's degree of movement may be monitored while the radiation therapy simulation is in progress.

In step S153, at least one simulation situation in which the degree of movement exceeds the reference value (e.g. when wearing a mask, assuming a specific posture, etc.) may be detected.

In step S154, a simulation scenario may be created by combining the detected simulation situations. For example, the main controller 21 may create a simulation scenario in which detected simulation situations are repeatedly reproduced. At this time, the number of repetitions of the simulation situation may be determined based on the degree of movement (e.g., as the movement becomes more severe, the number of repetitions of the simulation situation increases). The simulation scenario may include, for example, information on control commands for reproducing the simulation situation, the number of repetitions, the reproduction order of the simulation situation, etc., but the scope of the present disclosure is not limited thereto.

Although not shown in FIG. 15, the main controller 21 can store the generated simulation scenario. Additionally, the main controller 21 may automatically proceed with radiation therapy simulation according to control commands defined in the simulation scenario by loading the simulation scenario.

So far, a method of utilizing the patient's movement monitoring results according to another embodiment of the present disclosure has been described with reference to FIG. 15 . According to the above, the performance effect of radiation therapy simulation can be further improved by automatically generating a simulation scenario for a situation in which movement is excessive and allowing the patient to repeatedly train using the generated simulation scenario.

Hereinafter, an exemplary computing device 160 capable of implementing the simulation system 10 according to some embodiments of the present disclosure will be described with reference to FIG. 16.

16 is an exemplary hardware configuration diagram showing the computing device 160.

As shown in FIG. 16, the computing device 160 includes one or more processors 161, a bus 163, a communication interface 164, and a memory (loading) a computer program executed by the processor 161. 162) and a storage 165 that stores a computer program 166. However, only components related to the embodiment of the present disclosure are shown in FIG. 16. Accordingly, a person skilled in the art to which this disclosure pertains can see that other general-purpose components may be included in addition to the components shown in FIG. 16 . That is, the computing device 160 may further include various components in addition to those shown in FIG. 16 . In some cases, the computing device 160 may be implemented with some of the components shown in FIG. 16 omitted.

The processor 161 may control the overall operation of each component of the computing device 160. The processor 161 is at least one of a Central Processing Unit (CPU), Micro Processor Unit (MPU), Micro Controller Unit (MCU), Graphic Processing Unit (GPU), or any type of processor well known in the art of the present disclosure. It can be configured to include. Additionally, the processor 161 may perform operations on at least one application or program to execute methods/operations according to various embodiments of the present disclosure. Computing device 160 may include one or more processors.

Next, memory 162 may store various data, commands and/or information. Memory 162 may load one or more programs 166 from storage 165 to execute methods/operations according to various embodiments of the present disclosure. The memory 162 may be implemented as a volatile memory such as RAM, but the technical scope of the present disclosure is not limited thereto.

Next, bus 163 may provide communication functionality between components of computing device 160. The bus 163 may be implemented as various types of buses, such as an address bus, a data bus, and a control bus.

Next, the communication interface 164 may support wired and wireless Internet communication of the computing device 160. Additionally, the communication interface 164 may support various communication methods other than Internet communication. To this end, the communication interface 164 may be configured to include a communication module well known in the technical field of the present disclosure.

Next, storage 165 may non-transitory store one or more computer programs 166. The storage 165 may be a non-volatile memory such as Read Only Memory (ROM), Erasable Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), flash memory, a hard disk, a removable disk, or a device well known in the art to which this disclosure pertains. It may be configured to include any known type of computer-readable recording medium.

The computer program 166, when loaded into the memory 162, may include one or more instructions that cause the processor 161 to perform methods/operations according to various embodiments of the present disclosure. That is, the processor 161 may perform methods/operations according to various embodiments of the present disclosure by executing one or more instructions.

For example, the computer program 166 controls the display of a simulation image of a virtual radiation treatment facility through the first HMD device 23 mounted on the patient's head, and receives a predetermined control command. and instructions for performing a control operation to perform a radiation therapy simulation according to an inputted control command. In this case, the main controller 21 according to some embodiments of the present disclosure may be implemented through the computing device 160.

So far, an exemplary computing device 160 capable of implementing the simulation system 10 according to some embodiments of the present disclosure has been described with reference to FIG. 16 .

So far, various embodiments of the present disclosure and effects according to the embodiments have been mentioned with reference to FIGS. 1 to 16 . The effects according to the technical idea of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below.

The technical ideas of the present disclosure described so far can be implemented as computer-readable code on a computer-readable medium. The computer-readable recording medium may be, for example, a removable recording medium (CD, DVD, Blu-ray disk, USB storage device, removable hard disk) or a fixed recording medium (ROM, RAM, computer-equipped hard disk). You can. The computer program recorded on the computer-readable recording medium can be transmitted to another computing device through a network such as the Internet, installed on the other computing device, and thus used on the other computing device.

In the above, even though all the components constituting the embodiments of the present disclosure have been described as being combined or operated in combination, the technical idea of the present disclosure is not necessarily limited to these embodiments. That is, within the scope of the purpose of the present disclosure, all of the components may be operated by selectively combining one or more of them.

Although operations are shown in the drawings in a specific order, it should not be understood that the operations must be performed in the specific order shown or sequential order or that all illustrated operations must be performed to obtain the desired results. In certain situations, multitasking and parallel processing may be advantageous. Moreover, the separation of the various components in the embodiments described above should not be construed as necessarily requiring such separation, and the program components and systems described may generally be integrated together into a single software product or packaged into multiple software products. You must understand that it exists.

Although embodiments of the present disclosure have been described above with reference to the attached drawings, those skilled in the art will understand that the present disclosure can be implemented in other specific forms without changing the technical idea or essential features. I can understand that there is. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive. The scope of protection of this disclosure should be interpreted in accordance with the claims below, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of rights of the technical ideas defined by this disclosure.

Claims (20)

A Head Mounted Display (HMD) device mounted on the patient's head and displaying a simulation image of a virtual radiation treatment facility; and
Comprising a main controller that controls radiation therapy simulation to be performed according to a control command input while the simulation image is displayed,
Radiation therapy simulation system. According to paragraph 1,
The main controller receives the control command through a command input device equipped with a haptic interface,
Radiation therapy simulation system. According to paragraph 1,
The control command includes a couch control command, a gantry control command, and a mask control command.
Radiation therapy simulation system. According to paragraph 1,
Further comprising another HMD device mounted on the head of the medical staff,
The HMD device displays a first simulation image,
The other HMD device displays a second simulation image synchronized with the first simulation image,
The first simulation image is a first-person perspective image of the patient,
The second simulation image is a first-person perspective image of the medical staff,
Radiation therapy simulation system. According to paragraph 1,
The main controller is,
Detecting that the patient is lying on the couch through a pressure sensor or proximity sensor installed on the couch in the actual simulation facility,
Initiating the radiation treatment simulation in response to the detection,
Radiation therapy simulation system. According to clause 5,
The couch has an angle adjustment function,
The main controller detects that the patient is lying on the couch based further on the angle state of the couch.
Radiation therapy simulation system. According to paragraph 1,
The main controller is,
Recognize the patient's posture by analyzing sensing data collected from a position sensor installed on the patient's body,
Initiating the radiation treatment simulation in response to determining that the recognized posture is a supine posture,
Radiation therapy simulation system. According to paragraph 1,
The main controller is,
Recognize the patient's posture,
Initiating or resuming the radiation therapy simulation in response to determining that the recognized posture is a supine posture,
stopping or terminating the radiation therapy simulation in response to determining that the recognized posture is not a supine posture,
Radiation therapy simulation system. According to paragraph 1,
The main controller controls a vibrator installed on the patient's body so that vibration stimulation is applied to the patient's body in response to a control command regarding wearing a mask,
Radiation therapy simulation system. According to paragraph 1,
The simulation image is a first simulation image in which reduction of visual field is not reflected,
The main controller controls the display image of the HMD device to be switched from the first simulation image to the second simulation image in response to a control command regarding wearing a mask,
The second simulation image is a simulation image that reflects the decrease in field of view due to wearing the mask,
Radiation therapy simulation system. According to clause 10,
Further comprising another HMD device mounted on the head of the medical staff,
The other HMD device displays a simulation image in which the patient's avatar wearing a grid-shaped mask appears in response to a control command regarding wearing the mask,
The second simulation image is an image reflecting the obstruction of the view by the grid,
Radiation therapy simulation system. According to paragraph 1,
The main controller controls a vibrator installed on the patient's body so that vibration stimulation is applied to the patient's body in response to a control command for moving or rotating the couch,
Radiation therapy simulation system. According to paragraph 1,
The main controller controls the couch installed in the actual simulation facility to move or rotate in response to a control command for moving or rotating the couch.
Radiation therapy simulation system. According to paragraph 1,
The main controller controls the viewpoint of the simulation image to move or rotate in response to a control command for moving or rotating the couch.
Radiation therapy simulation system. According to paragraph 1,
The main controller controls the gantry rotation sound to be output through a speaker installed in the HMD device or an actual simulation facility in response to a control command related to gantry rotation.
Radiation therapy simulation system. According to paragraph 1,
The main controller is,
The main controller is,
Monitoring the degree of movement of the patient while the radiation therapy simulation is in progress,
Extract information about a simulation situation in which the degree of movement exceeds the standard value,
The extracted information includes control commands associated with the simulation situation and the patient's posture,
Radiation therapy simulation system. According to paragraph 1,
The main controller is,
Monitoring the degree of movement of the patient while the radiation therapy simulation is in progress,
Notifying a predetermined message in a way that the patient can perceive in response to the determination that the degree of movement exceeds the standard value,
Radiation therapy simulation system. According to paragraph 1,
The main controller is,
Monitoring the degree of movement of the patient while the radiation therapy simulation is in progress,
Detect at least one simulation situation in which the degree of movement exceeds a reference value based on the monitoring results,
Generating a simulation scenario by combining the detected simulation situations,
Radiation therapy simulation system. 1. A method performed on at least one computing device, comprising:
Controlling a simulation image of a virtual radiation treatment facility to be displayed through a Head Mounted Display (HMD) device mounted on the patient's head;
Receiving a predetermined control command; and
Comprising the step of controlling radiation therapy simulation to be performed according to the input control command,
Radiation therapy simulation method. Combined with a computing device,
Controlling a simulation image of a virtual radiation treatment facility to be displayed through a Head Mounted Display (HMD) device mounted on the patient's head;
Receiving a predetermined control command; and
Stored in a computer-readable recording medium to execute the step of controlling the radiation therapy simulation to be performed according to the input control command,
computer program.