KR102443956B1 - eXtended reality-based acupuncture system and method thereof - Google Patents

Abstract

The present invention proposes an extended reality-based acupuncture system and method for performing blood collection and acupuncture while projecting and displaying bone and muscle information on a human body model capable of joint manipulation based on extended reality. The augmented reality-based acupuncture system of the present invention recognizes a human body model located in a predetermined practice space, acupuncture needles operated on the acupuncture points of the human body model, and the practitioner's gaze and hand motion, and recognizes the human body according to the practitioner's gaze. XR headset that displays a virtual model having bone or muscle information projected onto the model, motion capture that provides spatial coordinates of the surgical needle and the XR headset worn by the practitioner together with the human body model located in the practice space Based on the spatial coordinates provided by the unit and the motion capture unit, the virtual model to be projected onto the human body model is generated and provided to the XR headset, and information necessary for the acupuncture and acupuncture procedures is reconstructed to suit the practitioner's gaze. It is configured to include a central processing unit provided to the XR headset.

Description

Extended reality-based acupuncture system and method thereof

The present invention relates to an acupuncture and acupuncture system, and in particular, joint manipulation is possible, and in an extended reality environment that synthesizes a human body model with bones and muscles and a 3D virtual model of muscles and bones as a hologram, a practitioner can perform acupuncture and acupuncture on the human body model. A system and method for enabling acupuncture.

Acupuncture, practiced in oriental medicine, is a medical practice that can treat various diseases by applying acupuncture to various acupoints distributed in the human body. Acupuncture points where acupuncture is to be performed are distributed in countless numbers throughout the body, and the areas where acupuncture should be performed are different depending on the type of disease. In order to perform acupuncture, it is necessary to know the location of the acupuncture points correctly. If the needle is placed incorrectly, the surrounding nerves, blood vessels, muscles, fascia, ligaments, and periosteum may be stimulated, causing injury or discomfort to the patient.

In order to accurately find the location of the acupoint and apply acupuncture to the found acupoint, a lot of practice or training is required in advance. In the past, there was a case in which a trainee (trainee) who participated in the practice or training directly performed the procedure on the body of himself or a colleague. However, such an action could pose a significant risk because acupuncture is directly applied to the nervous tissue or muscle of the body, and there is no choice but to limit the number of acupuncture.

As another method, the prior literature of Korean Patent Application Laid-Open No. 10-2020-0073492 can be cited. The prior literature is a method that can be practiced repeatedly while directly basting a needle on a human body model (human dummy). However, the manikin used here is only made of silicone and does not provide any information for the location of acupuncture points or acupuncture, so the learning effect is low. In addition, in the prior literature, the position of the acupoint point is indicated on the human body model. Therefore, in the field of oriental medicine, where finding the location of acupoints is more important than anything else, as mentioned earlier, these prior literatures provide training or practice to find the location of acupoints effectively and effectively. It cannot be done, so it is not suitable as a practice method.

Recently, an acupuncture system using a VR (Virtual Reality) environment has been proposed as a better acupuncture practice method. It has the advantage of being easier to practice than a method using actual needles or a human body model.

However, since the VR environment is practiced in a virtual environment composed only of graphics, a visual difference from the real environment occurs, and the practical effect is reduced because the human body model in the virtual environment cannot be touched. To solve this problem, a VR practice system that interacts with a real human model has been proposed, but since a sensor must be attached in order to link the virtual human model and the real human model in VR, the human body model is deformed during this process. Due to this, there is a lot of difference from the actual acupuncture environment, and the practical effect is reduced.

Therefore, an object of the present invention is to solve the above problems, by synthesizing a 3D virtual model for bones and muscles in a hologram form with a human body model with bones and muscles embedded therein to give feedback on acupuncture and acupuncture in the same environment as in the real world. It is to provide an extended reality-based acupuncture system and method that can provide acupuncture in real time.

The present invention for achieving the above object, a human body model located in a predetermined practice space; a surgical needle to be operated on the acupoint of the human body model; an XR headset that recognizes the practitioner's gaze and hand motion and displays a projected virtual model having bone or muscle information on the human body model according to the practitioner's gaze; a motion capture unit for providing spatial coordinates of the surgical needle and the XR headset worn by the practitioner together with the human body model located in the practice space; and generating the virtual model to be projected onto the human body model based on the spatial coordinates provided by the motion capture unit and providing it to the XR headset, reconstructing the information required for acupuncture and acupuncture procedures according to the practitioner's gaze to fit the XR It provides an extended reality-based acupuncture system, characterized in that it includes a central processing unit provided to the headset.

The motion capture unit may include: a plurality of cameras for photographing the human body model, the surgical needle, and the XR headset located in the practice space; a distance measuring unit for measuring a distance between the human body model, the surgical needle, and the XR headset; a first calculation unit for calculating position coordinates of the human body model, the surgical needle, and the XR headset according to the measured distance; and a second calculation unit for calculating the position, direction, and angle of the surgical needle to be operated on the human body model.

The human body model is all or part of a body made of a silicone material, and is a model in which joint movement is possible.

The surgical needle, a marker pointing to three axes (x, y, z-axis) directions; and a needle marker attaching unit for attaching the marker to the surgical needle.

The XR headset may include a body having a shape that can be worn on the head; a camera installed in front of the main body and photographing an image for recognizing a practitioner's gaze and hand gestures; an image processing unit for processing hand gestures and gaze information of a practitioner based on the information captured by the camera; a transceiver for transmitting and receiving information with the central processing unit; And the central processing unit is configured to include a display unit of a transparent material that displays the information to be provided to the practitioner according to the practitioner's gaze.

The display unit is positioned in front of the main body and spaced apart from the front of the practitioner's eyes.

The virtual model includes bone and muscle information of the human body model, and when the virtual model is projected onto the human body model, information that cannot be obtained from the human body model is displayed through an XR headset.

According to the joint movement of the human body model, the virtual model also moves in the same way.

According to another feature of the present invention, there is provided an acupuncture method for practicing acupuncture using an extended reality-based acupuncture system, the acupuncture method comprising: a first step of generating a virtual model so as to be in the same position as a human body model located in a practice space; a second step in which the practitioner confirms the human body model synthesized with the virtual model through an XR headset; a third step of finding an acupoint in the human body model to place a surgical needle while checking information on the virtual model as well as the human body model through the XR headset; and a fourth step of applying surgical acupuncture to the acupoints.

In the first step, when the movement of the human body model occurs, the virtual model is synthesized with coordinates changed according to the movement.

In the third step, if the acupuncture point is not found, the augmented reality-based acupuncture system sequentially provides hand gesture location information for finding the acupuncture point to the practitioner.

In the fourth step, the augmented reality-based acupuncture system receives information about the position, direction, and angle of the surgical needle treated on the human body model, and determines whether the surgical needle is normally operated.

When the operation state of the operation needle is incorrect, the corrected position, direction, and angle information of the operation needle is guided.

According to the extended reality-based acupuncture system and method of the present invention as described above, it is possible to practice acupuncture in real-world conditions instead of the existing virtual reality, thereby increasing the practice effect.

According to the present invention, since acupuncture needles (procedure needles) used for actual acupuncture are used, more efficient practice can be expected than practice using model needles or needles equipped with various sensors.

According to the present invention, since the evaluation information on the practice process is provided in real time, the user can receive feedback on mistakes in the acupuncture and acupuncture processes immediately, so that the practice and learning are possible while correcting the acupuncture and acupuncture operations.

1 is a configuration diagram showing an extended reality-based acupuncture system according to a preferred embodiment of the present invention;
Figure 2 is a block diagram of a unit box provided in the motion capture unit of Figure 1;
3 is an exemplary view of a surgical needle with a marker attached according to the present invention
4 is a block diagram of an XR headset worn by a practitioner according to the present invention;
5 is an exemplary view in which a virtual model is applied to a human body model according to the present invention;
6 is a flowchart illustrating an extended reality-based acupuncture method according to a preferred embodiment of the present invention.
7 to 9 are exemplary views showing a part of acupuncture and acupuncture procedures according to the present invention;

Objects and effects of the present invention, and technical configurations for achieving them will become clear with reference to the embodiments described below in detail in conjunction with the accompanying drawings. In describing the present invention, if it is determined that a detailed description of a well-known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

And the terms to be described later are terms defined in consideration of functions in the present invention, which may vary according to intentions or customs of users and operators.

However, the present invention is not limited to the embodiments disclosed below and may be implemented in various different forms. Only the present embodiments are provided so that the disclosure of the present invention is complete, and to completely inform those of ordinary skill in the art to which the present invention belongs, the scope of the invention, the present invention is defined by the scope of the claims it will only be Therefore, the definition should be made based on the content throughout this specification.

Hereinafter, the present invention will be described in more detail based on the embodiments shown in the drawings.

1 is an overall configuration diagram showing an extended reality-based blood collection and acupuncture system according to an embodiment of the present invention. As shown in FIG. 1, according to the present invention, a series of practice spaces for acupuncture and acupuncture, a human body model 200 located in the practice space, an XR headset 300 worn by the practitioner, and surgical needles (400, see FIG. 3) A motion capture unit 100 for recognizing and calculating each position is provided.

The motion capture unit 100 includes a plurality of cameras 101 and a unit box 102 (refer to FIG. 2 ) connected to each camera 101 . The cameras 101 are installed in a form surrounding the human body model 200 in the practice space, and the unit box 102 may be integrally configured with the camera 101 or provided as a separate configuration.

The camera 101 serves to photograph the practice space and the components (human body model, XR headset, and surgical needle) located in the practice space. This is to calculate the position coordinates of each component.

2 is a configuration of the unit box 102. As shown, it includes a distance measurement unit 104 and a coordinate calculation unit (first calculation unit) 106 . The distance measuring unit 104 measures the distance to the above-described components, and the coordinate calculating unit 106 performs a function of calculating the position coordinates of each component according to the measured distance value. As such, recognizing the position of each component in the practice space A is to accurately match the virtual model 600 to the human body model 200 . That is, as will be described below, the human body model 200 is a structure that can move joints like a real body, and even if the practitioner moves the joints of the human body model 200 (that is, the position of the human model changes), the human body model 200 In order to accurately project the virtual model 600 to Here, the virtual model 600 includes information on bones or muscles to be projected on the human body model 200 . Therefore, when the virtual model 600 is projected on the human body model 200, the practitioner can see the same shape as the inside of the real body.

An example of the human body model 200 to which the virtual model 600 is applied is shown in FIG. 5 . FIG. 5A is a state in which bone and muscle information 602 is projected onto the human body model 200 , and FIG. 5B is a state in which bone information 604 is projected onto the human body model 200 . In this way, it provides the effect of seeing a real body.

Referring back to FIG. 2 , the motion capture unit 100 also includes a second calculator 108 for calculating the position, direction, and angle of the surgical needle 400 to be operated on the human body model 200 . This is to determine whether the operation needle 400 is being accurately operated on the acupoint point of the human body model 200 .

The human body model 200 refers to a human body model of a structure subject to acupuncture and acupuncture. The human body model 200 may be all or a part of the body, and is made of a model corresponding to all or part of the body. In this embodiment, the human body model 200 is formed in a three-dimensional shape, is made of a material similar to actual skin, and is manufactured so that joints such as knees and ankles can be moved by the operator's manipulation. In other words, not a simple human body model used in practice, but a human body model that can move with materials and joints similar to the actual body is used.

According to the present embodiment, as shown in FIG. 3 , the marker 412 on which three axes (x, y, z axes) are marked so that the motion capture unit 100 can recognize the movement of the surgical needle 400 . A needle marker attachment unit 410 capable of attaching 414 and 416 to the treatment needle 400 is provided. The needle marker attachment unit 410 has a structure that can be attached to one end of the surgical needle 400 in various ways. For example, there may be mentioned a method of being fixed to the end of the surgical needle 400 or attached to the outer diameter of the surgical needle 400 in a fitting and fixed manner. As such, the present invention can use the same surgical needle used for actual acupuncture as it is. That is, the present embodiment does not use a model needle conventionally used for practice or a surgical needle to which various sensors are attached. As such, it is possible to prevent problems such as changes in hand sensation due to changes in needles during practice and actual procedures.

The needle marker attachment unit 410 and the markers 412 , 414 , and 416 are designed in various sizes according to the length or diameter of the surgical needle 400 . This is because if the size of the treatment needle 400 is too small or too large, the movement of the treatment needle 400 may not be effectively tracked.

4 is a block diagram of the XR headset 300 worn by the practitioner according to the present invention. As shown, the XR headset 300 refers to a device that recognizes the practitioner's gaze and hand motion while the practitioner wears it on the head, and displays various information according to the gaze. The XR headset 300 includes a camera 310 installed in front of the main body formed to be worn on the head, an image processing unit 320 and a transceiver 330 provided at a predetermined position in the main body, and a position in front of the practitioner's eyes. and a display unit 340 to

The camera 310 is a device for photographing an image in order to recognize the practitioner's gaze and hand gestures. The camera 310 is configured to include a plurality of camera sensors and an IR camera so that the gaze and hand gestures can be recognized without error so as to correspond to the user's gaze.

The image processing unit 320 is a device for processing a practitioner's hand gestures and gaze information, ie, gaze direction, position, and angle, based on the information captured by the camera 310 .

The transmitting/receiving unit 330 is a device for transmitting/receiving various types of information with the central processing unit 500, and may use various communication media for transmission/reception. The transceiver 330 transmits the information processed by the image processing unit 320 to the central processing unit 500, and the central processing unit 500 serves to receive information to be displayed on the XR headset 300. do. The transceiver 330 preferably employs a wireless communication method for convenience instead of a wired communication method. An example of a wireless communication method. In this embodiment, various methods such as RF module, Bluetooth (BT) module, Wi-Fi module, Zigbee module, etc. can be applied, but it goes without saying that communication methods using other wireless modules may be applied. do.

The display unit 340 is a part that displays information to be provided to the practitioner by the central processing unit 500 according to the practitioner's gaze. The display unit 340 does not display information in virtual reality, but a shape in which the virtual model 600 is projected on the human body model 200 together with the human body model 200 located in front of the practitioner, and the practitioner's hand movement It is made of a transparent material because it is necessary to be able to see the actual field of view information, such as This can be said to be a completely different configuration from a headset made to display virtual reality information such as a conventional VR.

According to this embodiment, it includes the central processing unit 500 provided at a predetermined position in the practice space. The central processing unit 500 may be a series of computer devices. The central processing unit 500 serves to generate an image by reconstructing the coordinates of each component calculated by the motion capture unit 100 according to the gaze of the practitioner. That is, the virtual model 600 to be projected on the human body model 200 is generated.

The central processing unit 500 also provides a function of determining the correct blood collection operation and the position of the surgical needle 400 in the blood collection and acupuncture process, and transmitting the determination result to the XR headset 300 . In addition, the central processing unit 500 also transmits various menu information according to the blood collection and acupuncture procedures to the XR headset 300 . At this time, the menu information is transmitted to the XR headset 300 by calling the central processing unit 500 according to the hand gesture of the practitioner, and the practitioner executes a command by manipulating the displayed menu by hand. And the central processing unit 500 can display the entire process of blood collection and acupuncture practice so that users other than the practitioner can see the practice process, and display the information displayed on the screen on a monitor located in another place. can

Next, a blood collection and acupuncture process using the system configured as described above will be described with reference to FIG. 6 . The blood collection and acupuncture process of the present invention may largely include a preparation process and a practice process, and the practice process may include a process of performing evaluation and feedback on the practice results.

The preparation process can be said to be a preceding process for acupuncture and acupuncture.

A motion capture unit 100 including a camera 101 is installed in a practice space prepared for practice. A plurality of motion capture units 100 are radially installed around the central human body model 200 to increase recognition accuracy. In addition, in the practice space, the XR headset 300 worn by the practitioner for practice, acupuncture needles, etc. are located (s100).

In this environment, the motion capture unit 100 recognizes the overall spatial coordinates of the practice space by the camera 101 . In addition, the distance measuring unit 104 provided in the unit box 102 measures the distance to the human body model 200 located in the practice space based on the image information captured by the camera 101, and calculates the first The unit 106 calculates the position coordinates of the human body model 200 by using the measured distance information (s102). Accordingly, it is possible to know the exact position of the human body model 200 located in the practice space. Here, the distance measurement unit 104 and the first calculation unit 106 also calculate the distance measurement and location of the practitioner or the surgical needle 400, which will be performed when actual blood collection and acupuncture is performed. In this way, the process of recognizing the location of the practice space and the human body model 200 takes precedence.

The reason for recognizing the position of the human body model 200 as described above is to generate a virtual model 600 to be projected on the human body model 200 . This is because the position of the human body model 200 needs to be accurate because the present invention is to practice in a real environment, not a conventional VR (virtual reality).

The central processing unit 500 generates a virtual model 600 to be projected onto the human body model 200 based on the coordinate values of the human body model 200 calculated by the motion capture unit 100 (s104). . Since the position of the human body model 200 can be known, it is possible to generate a virtual model that can be projected on the human body model 200 as it is. The virtual model 600 has the same shape as the human body model 200 located in the practice space, and as described in FIG. 5 , refers to a model having information such as bones, muscles, and acupoint points of the human body model 200 .

The virtual model 600 is projected correspondingly according to the joint movement of the human body model 200 . That is, the position coordinates of the human body model 200 are calculated in real time and transmitted to the central processing unit 500, and the central processing unit 500 is a virtual model 600 to be projected in conformity with the human body model 200 in which motion occurs. because it can move Accordingly, when the practitioner sees the human body model 200, the practitioner can see the human body model in which the bones or muscles are synthesized.

As such, when the human body model 200 and the virtual model 600 to be projected on the human body model 200 are generated, a practice process can be performed thereafter. For reference, the virtual model 600 may be a model according to sex/gender, a model for all or part of the body, and these models may be generated in advance, in this case, the database (DB) in the central processing unit 500 ) and can be provided. Therefore, a model corresponding to the practiced human body model 200 may be directly called. In this way, the process of generating the virtual model 600 may be omitted.

The practice course is a process in which practitioners practice acupuncture and acupuncture. For the practice, the practitioner wears the XR headset 300 (s106). Even if the XR headset 300 is worn, unlike the VR headset, the practitioner can directly see the human body model 200 located in the center with the naked eye, so that the front view is secured as it is.

When the practitioner looks forward after wearing the XR headset 300 , the camera 310 mounted on the XR headset 300 captures the human body model 200 . Also, when the practitioner moves his/her hand, the hand motion is photographed (s108). At this time, the coordinates of the human body model 200 and hand movements are calculated in real time by the motion capture unit 100 and transmitted to the central processing unit 500 . In addition, the information captured by the camera 310 of the XR headset 300 is processed by the image processing unit 320 to process the practitioner's hand gestures or gaze information, and is transmitted to the central processing unit 500 . Therefore, the central processing unit 500 may set the coordinates so that the human body model 200 and the virtual model 600 are in the same position according to the gaze of the practitioner (s110).

As described above, when the coordinates of the human body model 200 and the virtual model 600 are set to be in the same position, the virtual model 600 can be projected on the human body model 200 according to a user command transmitted by the practitioner (s112). . These operations are possible through the user interface. That is, a user menu is displayed where the practitioner displays menu buttons for selecting predefined commands, for example, bone or muscle information, and when the practitioner operates the menu button with the other hand, bones or muscles are mapped to the human body model 200 and synthesized do. A synthesized example can be seen in FIG. 5 . That is, it can be said that the coordinates of the human body model 200 and the virtual model 600 are matched. Accordingly, the practitioner can view the human body model 200 in a state in which bones or muscles are projected through the XR headset 300 .

The practitioner performs the practice process while continuing to wear the XR headset 300 . The practice process may be performed with only the human body model 200 as an object or with bone or muscle information projected onto the human body model 200 according to the selection of the practitioner. During the exercise, a bone or muscle may be projected onto the human body model 200, or the projected bone or muscle may be removed.

The practice course is conducted in the order of blood collection and acupuncture. Acupuncture is the process of finding an acupuncture point for placing the surgical needle, and the acupuncture process is also complicated because the acupuncture point varies depending on the type of disease or symptoms. And most of the acupuncture processes do not find acupuncture points at once, but move locations to find acupuncture points.

As shown in FIG. 8, the blood collection process starts with the practitioner's hand gesture, that is, the hand gesture to find the acupoint while holding the human body model 200 (s114). In addition, the motion capture unit 100 and the XR headset 300 continuously recognize the movement of the hand to find the blood, and the recognized information is transmitted to the central processing unit 500 .

Then, the central processing unit 500 compares the spatial position of the hand with the position in the human body model 200 to determine the accuracy of the blood collection position (s116). The central processing unit 500 transmits the result to the XR headset 300 in real time, so that the practitioner can continue the blood collection operation while checking the result. The result information may not display separate information when the blood collection location is accurate. Conversely, only when the location of the blood collection is not accurate, it is displayed so that the practitioner can confirm that it is not the location of the blood collection (s117). According to this information display, the practitioner continues the process of finding the acupoint by moving his or her hand position, and this process is repeated until the correct acupuncture point is found. When the correct acupoint is found, the central processing unit 500 notifies that the currently pressed position is the correct acupoint, and may display the acupoint in a predetermined color if necessary.

After the blood collection process is finished, an acupuncture process of operating the surgical needle on the corresponding acupoint is performed (s118). The acupuncture process uses a surgical needle 400 equipped with a marker while referring to the guidance message for needle needle as shown in FIG. 9 .

In the acupuncture process, the practitioner places the surgical needle on the acupuncture point. During this acupuncture process, the second calculation unit 108 of the motion capture unit 100 calculates the position, direction, and angle of the surgical needle 400 ( s120). That is, if the markers 412 , 414 , 416 in the x, y, and z-axis directions attached to the surgical needle 400 are used, the second calculation unit 108 is the operation needle 400 placed on the human body model 200 . It can calculate position, direction, and angle. The calculated information is transmitted to the central processing unit 500 in real time.

Then, the central processing unit 500 determines whether the surgical needle 400 has been correctly operated on the acupoint of the human body model 200 (s122). That is, since the central processing unit 500 has information on the correct acupuncture of the surgical needle 400 to be operated for each acupoint, the needle is determined based on the position, direction, and angle of the surgical needle treated on the human body model 200 . You can see if it's done right. Information on the result of this determination is applied in the same manner as in the above-described blood collection process. That is, if the needle is correct, information may not be separately displayed. Conversely, if the position, direction, or angle of the viewing needle 400 is not accurate, the central processing unit 500 controls the display unit ( 340) is indicated.

The practitioner can immediately check if the operation needle 400 is incorrect through the information transmitted in this way, and continues the practice while checking the information and correcting the position, direction, angle, etc. of the operation needle (s123).

As such, the embodiment of the present invention enables the practitioner to immediately check and correct incorrect information when the acupuncture and acupuncture are wrong during the practice of acupuncture and acupuncture. Therefore, when practitioners practice alone, if they make a mistake or make a mistake step by step, they can easily recognize it so that correct practice is made.

In addition, it can be seen that the present invention can be practiced in the same environment as the actual acupuncture environment because actual acupuncture is used together with a human body model that is almost similar to the body. Furthermore, since bone or muscle information is added to the human body model and projected, the practitioner has the same advantage as if he or she is practicing using a real body.

Although described with reference to the illustrated embodiments of the present invention as described above, these are merely exemplary, and those of ordinary skill in the art to which the present invention pertains can use various methods without departing from the spirit and scope of the present invention. It will be apparent that modifications, variations, and other equivalent embodiments are possible. Therefore, the true technical protection scope of the present invention should be determined by the technical spirit of the appended claims.

100: motion capture unit 101: (for motion capture) camera
102: unit box 104: distance measuring unit
106: first calculation unit 108: second calculation unit
200: manikin 300: XR headset
310: (for headset) camera 320: image processing unit
330: transceiver 340: display unit
400: operation needle 412, 414, 416: marker
410: needle marker attachment unit 500: central processing unit
600: virtual model

Claims (13)

a human body model located in a predetermined practice space;
a surgical needle to be operated on the acupoint of the human body model;
an XR headset that recognizes the practitioner's gaze and hand motion and displays a projected virtual model having bone or muscle information on the human body model according to the practitioner's gaze;
a motion capture unit for providing spatial coordinates of the surgical needle and the XR headset worn by the practitioner together with the human body model located in the practice space; and
Based on the spatial coordinates provided by the motion capture unit, the virtual model to be projected onto the human body model is generated and provided to the XR headset, and information necessary for acupuncture and acupuncture procedures is reconstructed according to the eyes of the practitioner and the XR headset Extended reality-based acupuncture system, characterized in that it includes a central processing unit provided to. The method of claim 1,
The motion capture unit,
a plurality of cameras for photographing the human body model, the surgical needle, and the XR headset located in the practice space;
a distance measuring unit for measuring a distance between the human body model, the surgical needle, and the XR headset;
a first calculation unit for calculating position coordinates of the human body model, the surgical needle, and the XR headset according to the measured distance; and
An extended reality-based acupuncture system including a second calculation unit for calculating the position, direction, and angle of the surgical needle to be operated on the human body model. The method of claim 1,
The human body model is
An extended reality-based acupuncture system that is all or part of the body made of silicon and is a model that can move joints. The method of claim 1,
The treatment needle is
a marker pointing in the direction of three axes (x, y, z); and
An extended reality-based acupuncture system comprising an acupuncture marker attaching unit for attaching the marker to a surgical needle. The method of claim 1,
The XR headset,
a body shaped to be worn on the head; a camera installed in front of the main body and photographing an image for recognizing a practitioner's gaze and hand gestures;
an image processing unit for processing hand gestures and gaze information of a practitioner based on the information captured by the camera;
a transceiver for transmitting and receiving information with the central processing unit; and
An extended reality-based acupuncture system including a transparent material display for displaying information to be provided by the central processing unit to the practitioner according to the practitioner's gaze. 6. The method of claim 5,
The display unit,
An extended reality-based acupuncture system spaced apart from the front of the practitioner's eyes in front of the main body. The method of claim 1,
The virtual model is
Includes bone and muscle information of the human body model,
An extended reality-based acupuncture system that displays information that cannot be obtained from the human body model through an XR headset when the virtual model is projected onto the human body model. The method of claim 1,
An extended reality-based acupuncture system in which the virtual model also moves in the same manner according to the joint movement of the human body model. In an acupuncture method for acupuncture practice using an extended reality-based acupuncture system,
A first step of generating a virtual model so as to be in the same position as the human body model located in the practice space;
a second step in which the practitioner confirms the human body model synthesized with the virtual model through an XR headset;
a third step of finding an acupoint in the human body model to place a surgical needle while checking information on the virtual model as well as the human body model through the XR headset; and
An extended reality-based acupuncture method, characterized in that it is performed including a fourth step of operating acupuncture points on the acupoints. 10. The method of claim 9,
The first step is
When the movement of the human body model occurs, the augmented reality-based acupuncture method in which the virtual model is synthesized with coordinates changed according to the movement. 10. The method of claim 9,
The third step is
If the acupuncture points are not found, the augmented reality-based acupuncture system sequentially provides hand gesture location information for finding the acupuncture points to the practitioner. 10. The method of claim 9,
The fourth step is
An extended reality-based acupuncture method in which the augmented reality-based acupuncture system receives information about the position, direction, and angle of the surgical needle treated on the human body model, and determines whether the surgical needle is normally operated. 13. The method of claim 12,
An extended reality-based acupuncture method for guiding the corrected position, direction, and angle information of the surgical needle when the surgical state of the surgical needle is incorrect.

Images