CN110063886A - A kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment - Google Patents
A kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment Download PDFInfo
- Publication number
- CN110063886A CN110063886A CN201910412852.4A CN201910412852A CN110063886A CN 110063886 A CN110063886 A CN 110063886A CN 201910412852 A CN201910412852 A CN 201910412852A CN 110063886 A CN110063886 A CN 110063886A
- Authority
- CN
- China
- Prior art keywords
- acupuncture
- module
- acupuncture point
- point
- center processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001467 acupuncture Methods 0.000 title claims abstract description 173
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 20
- 239000011521 glass Substances 0.000 claims abstract description 28
- 230000007170 pathology Effects 0.000 claims abstract description 6
- 238000000034 method Methods 0.000 claims description 17
- 210000001747 pupil Anatomy 0.000 claims description 16
- 238000004458 analytical method Methods 0.000 claims description 7
- 230000000007 visual effect Effects 0.000 claims description 7
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 238000009826 distribution Methods 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 5
- 241001269238 Data Species 0.000 claims description 3
- 238000004891 communication Methods 0.000 claims description 3
- 238000013527 convolutional neural network Methods 0.000 claims description 3
- 238000001514 detection method Methods 0.000 claims description 3
- 238000003780 insertion Methods 0.000 claims description 3
- 230000037431 insertion Effects 0.000 claims description 3
- 230000008520 organization Effects 0.000 claims description 3
- 238000012805 post-processing Methods 0.000 claims description 3
- 210000004556 brain Anatomy 0.000 claims 1
- 239000003814 drug Substances 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 201000010099 disease Diseases 0.000 description 4
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 208000024891 symptom Diseases 0.000 description 2
- 238000002560 therapeutic procedure Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000000338 in vitro Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 230000001575 pathological effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000013334 tissue model Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H39/00—Devices for locating or stimulating specific reflex points of the body for physical therapy, e.g. acupuncture
- A61H39/02—Devices for locating such points
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5007—Control means thereof computer controlled
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5023—Interfaces to the user
- A61H2201/5043—Displays
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5058—Sensors or detectors
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2230/00—Measuring physical parameters of the user
- A61H2230/50—Temperature
- A61H2230/505—Temperature used as a control parameter for the apparatus
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Rehabilitation Therapy (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Physical Education & Sports Medicine (AREA)
- Epidemiology (AREA)
- Pain & Pain Management (AREA)
- Human Computer Interaction (AREA)
- Life Sciences & Earth Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Finger-Pressure Massage (AREA)
Abstract
The invention discloses a kind of AR augmented reality intelligent acupuncture and moxibustion headset equipments, more particularly to medical auxiliary equipment field, including AR glasses, AR glasses front end is equipped with acquisition camera, the connecting pin of the AR glasses is equipped with servomechanism, and the connecting pin of the servomechanism is equipped with working machine, is equipped with center processor inside the working machine, the working machine port is connected with data memory module, and the connecting pin of the center processor is additionally provided with acupuncture point automatic station-keeping system and acupoint is pierced into feedback system.The present invention carries out the acupoint position point location of three-dimensional space by scanning patient's human body, and behind the position for determining to estimate acupoint location point, acupoint location point will be estimated again carries out other determining acupuncture point points of algorithm prediction, realize AR real-time high-efficiency automatic Calibration acupuncture point, budget point is promoted to most accurately by the characteristics of combining in conjunction with AR actual situation in conjunction with actual body acupuncture point, provides most accurate acupuncture point position and treatment pathology gimmick for acupuncturist.
Description
Technical field
The present invention relates to medical auxiliary equipment fields, it is more particularly related to a kind of AR augmented reality intelligence needle
Moxibustion headset equipment.
Background technique
Chinese medicine acupuncture treatment is being collectively referred to as the skill of handling needles and moxibustion therapy, and the skill of handling needles is that acupuncture needle is pierced into a certain acupuncture point of patient body, is used
It is twisted with propose the manipulations of acupuncture such as slotting to treat disease;Moxibustion therapy is that the moxa being burning is utilized heat by the smoked bright skin in certain acupuncture point
Stimulation treat disease.Acupuncture is made of " needle " and " moxibustion ", is one of important component of traditional Chinese medicine, is had in distinctness
State's national culture and regional feature are the precious legacy generated based on Chinese national culture and scientific tradition.So succession Chinese medicine
Acupuncture develops right and wrong often with there is realistic meaning, however, present acupuncture Nurse Major for the culture of the Chinese nation
Raw and intern still has the accurate positioning acupuncture at acupuncture point very big difficulty via the professional training of a period of time,
In addition, the definite location point at acupoint also can be different according to the difference of a human body type and be changed.
100398083C Chinese patent discloses a kind of virtual reality acupuncture point location method, is combined with virtual
Traditional acupuncture positioning method is transformed in the high-tech means such as reality technology, automated control technology and Color Laser Projection Technology, realizes needle
Moxibustion acupoint selection positioning high-precision, automation.However, above-mentioned patent does not provide the acupoint how found out and can be relieved corresponding specific symptoms
Position, therefore, user oneself can not still find out acupoint position appropriate in the case where not knowing about acupoint and its curative effect
It sets a little, in addition to this, aforementioned patent must also employ two or more video camera shooting human body composition human body stereo images and can just search
Corresponding acupuncture point coordinate data is taken, and is searching access after, it is necessary to which corresponding acupuncture point is moved to by automatic control system control manipulator
Coordinate can just orient acupoint position, for common people, have can practicability it is not high and that equipment cost is huge is equal scarce
Point.
Chinese patent application CN102393880A discloses meridional point solid locating method under a kind of 3dmax environment,
Goal of the invention is how meridional point stereoscopic localized is carried out in 3D manikin, however, the invention is suitable only for Chinese medicine acupuncture
Practical teaching treated with clinic, it is for public for general general sieve and impracticable.In addition, how above-mentioned patent does not have offer yet
The acupuncture points on the human body position that can be relieved corresponding specific symptoms is found out, is only all meridional point positions for marking 3D manikin, therefore,
Real specific operation can not be carried out with patient.
Chinese patent application CN106780653A discloses the generation method of a kind of collaterals of human and acupuncture points on the human body Visual Graph, realizes
It is superimposed standardized human body's channels and collaterals and acupuncture points on the human body image on real-time body's image, uses to obtain collaterals of human and acupuncture points on the human body Visual Graph.But
Foregoing invention real-time is poor.
Chinese patent application CN101958079A discloses positioning of the meridian point in three-dimensional virtual human body anatomical tissue
Model and its application, disclosing has on computer video with the three-dimensional digital image of human visual's emulation and points acupuncture inquiry system
The form of system runs display.However, the invention is mainly to be applied to the scientific research and practical teaching of modern Chinese medicine medicine, lay particular stress on
In scholarly education, however applies acupuncture to operate for doctor and do not play direct effect still.
Chinese patent application CN109091380A discloses a kind of AR technology realization acupoint and visualizes, but is directed to user
My operation, i.e. patient oneself carry out point massage treatment, and the mode used is also that actual effect is too poor, and precision is also under meeting
Drop, is improved.
The above-mentioned patent of discovery is observed and studies, human acupoint distribution is easy to be influenced by human dimension and ratio, so
With following two characteristic: non-linear, fuzzy uncertainty.The solution of human acupoint distribution mainly has 3 kinds: vision skill
Art, optical alignment method and expert system approach.But there is some shortcomings for these methods: vision technique is using two-dimensional visual
Measurement combines image procossing to carry out the positioning of artificial target acupuncture point, and huge analysis system reduces the real-time of positioning, and answers
There is limitation with occasion, optical alignment method analog human eye show that the three-dimensional coordinate of object reaches positioning purpose, but positions target
It can all cause greatly to interfere to positioning with ambient background, reduce positioning accuracy.
Summary of the invention
In order to overcome the drawbacks described above of the prior art, the embodiment of the present invention provides a kind of AR augmented reality intelligent acupuncture and moxibustion head
Formula equipment is worn, the positioning of the acupoint location point of three-dimensional space is carried out by scanning patient's human body, and is determining to estimate acupoint
Behind the position of location point, then acupoint location point will be estimated and carry out other determining acupuncture point points of algorithm prediction, and realize AR real-time high-efficiency certainly
Budget point is promoted to most accurately in conjunction with actual body acupuncture point in conjunction with the characteristics of the combination of AR actual situation, is acupuncture by dynamic calibration acupuncture point
Doctor provides most accurate acupuncture point position and treatment pathology gimmick, to solve the problems mentioned in the above background technology.
To achieve the above object, the invention provides the following technical scheme: a kind of AR augmented reality intelligent acupuncture and moxibustion wear-type is set
It is standby, including AR glasses, equipped with acquisition camera, the connecting pin of the AR glasses is equipped with servomechanism, described for AR glasses front end
The connecting pin of servomechanism is equipped with working machine, is equipped with center processor inside the working machine, the working machine port is connected with number
According to memory module, the connecting pin of the center processor is additionally provided with acupuncture point automatic station-keeping system and acupoint is pierced into feedback system;
The acupuncture point automatic station-keeping system include input module, image identification demarcating module, pupil scaling identification module and
Display module is marked, the input module is used to input the physical characteristic information and acupoint coordinate of patient, acquisition camera
Patient's human body realtime graphic is acquired, realtime graphic is sent to center processor analysis processing, obtains the distributed intelligence of patient acupuncture point, shadow
As identifying that demarcating module is connect with center processor, the acupoint location point of estimating for pinpointing acupuncture point is tagged in 3-dimensional image, is passed through
An acupuncture point three-dimensional image output is formed after crossing analytical calculation, after acupuncture point 3-dimensional image is shown on label display module, pupil
Scaling identification module demarcates real-time virtual red dot at entire patient acupuncture point, and user is by pupil scaling identification module to virtual
Red dot zooms in and out a section, obtains acupuncture point position, and label display module makes to show acupoint information at red dot;
It includes being pierced into image gesture judgment module and depth feedback module, the image hand that the acupoint, which is pierced into feedback system,
Gesture judgment module is connect with center processor, and center processor receives the image information that gesture image input module receives, with number
Depth is pierced into according to each acupuncture point stored in memory module and bearing data is compared, and judges whether just acupuncture needle is pierced into gimmick
Really, it is pierced into feedback module to connect with center processor, center processor is according to the body of acupuncture needle length and external redundant length
Table image analysing computer obtains piercing depth, and the depth is shown in label display module, Real-time Feedback;
The input module includes pinpointing acupuncture point input unit, patient data input unit and body image input unit,
The fixed point acupuncture point input unit is used to input the acupuncture point coordinate for needing to apply acupuncture to patient and is pierced into depth, in patient data
Input unit inputs the human dimension of patient individual, which includes height, weight and figure percent information, body image input
Unit is for receiving realtime graphic and being sent to center processor analysis.
The data memory module also stores each acupuncture point letter for storing patient cases' information inside data memory module
Breath and each acupuncture point are pierced into depth and orientation requirement.
In a preferred embodiment, the depth feedback module includes low battery temperature-sensitive remote sensing needle, described
Low battery temperature-sensitive remote sensing needle is pierced into deep contact reaction for receiving, and the patient data input unit and body image are defeated
Enter unit matching and receive the practical height position ratio of patient, and utilize YOLO convolutional neural networks algorithm, carries out real-time object
Recognition detection and acupuncture point coordinate are demarcated.
In a preferred embodiment, the input module is set as portable electronic device, the portable electric
Sub-device includes laptop, tablet computer, desktop computer and smart phone, and the input module can also be built in cloud
On data memory module, and pass through network or other communication modes and portable electronic device line.
In a preferred embodiment, the label display module is arranged inside portable electronic device, or
LED display is connected on the outside of portable electronic device.
In a preferred embodiment, the image identification demarcating module is arranged inside portable electronic device,
Or it is provided by work generator terminal side.
In a preferred embodiment, AR glasses side is equipped with alarm, the alarm and center processing
Device is wirelessly connected, and amendment of the alarm for piercing system prompts.
In a preferred embodiment, the data memory module and center processor are electrically connected, the data
Memory module internal reservoir has illness to be pierced into depth data and all acupoint data, and center processor receives depth feedback module
Information, and prompt best piercing depth and be pierced into angle direction, the being associated property of piercing depth data of illness is matched, to take
The standard Value Data of the piercing depth must be corresponded to.
A kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment further includes that a kind of AR augmented reality intelligent acupuncture and moxibustion wear-type is set
Standby application method: specific step is as follows:
Step 1: being inserted into working machine port for data memory module, operation application program to AR glasses and servo driver end into
Row connection inputs acupoint information by fixed point acupuncture point input unit, and center processor obtains acupuncture point coordinate;
Step 2: the height position information of patient is inputted by patient data input unit, and sends information to center
Processor;
Step 3: doctor wears AR glasses, and acquisition camera acquires patient's human body realtime graphic, and is inputted by body image
Unit is sent to center processor after receiving;
Step 4: center processor analyzes organization of human body dimension scale according to the data in step 2 and step 3, as
Human body three-dimensional image shadow surface fixed point of the demarcating module under AR glasses sight is identified, by the acupuncture point coordinate in step 1 in patient
Body surface calibration, marks red dot region;
Step 5: above-mentioned label red dot region is exported, and calibrates human body by starting point application algorithm of budget acupuncture point point
Remaining acupuncture point point obtains acupoint distribution map;
Step 6: pupil scaling identification module reduces the acupuncture point that pupil is completed at red dot and shows, display mark module label
Human body red dot shows title, pathology treatment and the acupuncture skill at acupuncture point out, handles post-processing at visual three-dimensional empty by AR glasses
Quasi- mark;
Step 7: it applies acupuncture according to the acupuncture point mark point in step 6 to acupuncture point coordinate points, acupuncture angle and depth are abided by
According to the acupuncture skill of prompt, center processor receives the image information that gesture image input module receives, and cooperates low battery temperature-sensitive
Remote sensing needle, which receives, is pierced into deep contact reaction acquisition acupuncture needle insertion angle and depth, judges the accuracy of gimmick, works as gimmick
Mistake alarm device sounds an alarm, and doctor is prompted to adjust.
Technical effect and advantage of the invention:
1, the positioning of the acupoint location point of three-dimensional space is carried out by scanning patient's human body, and is determining to estimate acupoint
Behind the position of location point, then acupoint location point will be estimated and carry out other determining acupuncture point points of algorithm prediction, and realize AR real-time high-efficiency certainly
Budget point is promoted to most accurately in conjunction with actual body acupuncture point in conjunction with the characteristics of the combination of AR actual situation, is acupuncture by dynamic calibration acupuncture point
Doctor provides most accurate acupuncture point position and treatment pathology gimmick.
2, depth gimmick feedback system is pierced by the acupuncture point AR automatic positioning method and acupuncture, effectively promotes this Chinese medicine system
System and the wide usage of method, in conjunction with gesture identification, can after orienting acupoint location point, to the acupuncture of doctor be pierced into gesture into
Row identification judges whether correctly, to have also combined and be pierced into depth feedback system, can be pierced into the case where applying acupuncture and being pierced into
Depth feedback, improves the safety of acupuncture.
Detailed description of the invention
Fig. 1 is overall structure block diagram of the invention.
Fig. 2 is AR Glasses structure schematic diagram of the invention.
Fig. 3 is that gesture of the invention differentiates correct scene schematic diagram.
Fig. 4 is the scene schematic diagram that gesture of the invention differentiates mistake.
Fig. 5 is the practical figure at hand multiple spot of the present invention acupuncture point.
Fig. 6 is the image output figure at hand multiple spot of the present invention acupuncture point.
Fig. 7 is the output figure that hand multiple spot of the present invention acupuncture point is added after algorithm.
Fig. 8 is the practical acupuncture point coordinate in an embodiment of the present invention.
Fig. 9 is the image output acupuncture point coordinate in an embodiment of the present invention.
Figure 10 is that the acupuncture point coordinate after algorithm is added in an embodiment of the present invention.
Appended drawing reference are as follows: 1 AR glasses, 2 acquisition cameras, 3 servomechanisms, 4 working machines, 5 center processors, the storage of 6 data
Module, 7 acupuncture point automatic station-keeping systems, 71 input modules, 711 fixed point acupuncture point input units, 712 patient data input units, 713
Body image input unit, 72 images identification demarcating module, 73 pupil scaling identification modules, 74 label display modules, 8 acupoints thorn
Enter feedback system, 81 piercing image gesture judgment modules, 82 depth feedback modules, 9 alarms.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
A kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment according to shown in Fig. 1-10, including AR glasses 1, feature exists
In: 1 front end of AR glasses is equipped with acquisition camera 2, and the connecting pin of the AR glasses 1 is equipped with servomechanism 3, the servomechanism 3
Connecting pin be equipped with working machine 4, center processor 5 is equipped with inside the working machine 4,4 port of working machine is connected with data
Memory module 6, the connecting pin of the center processor 5 is additionally provided with acupuncture point automatic station-keeping system 7 and acupoint is pierced into feedback system 8;
The acupuncture point automatic station-keeping system 7 includes input module 71, image identification demarcating module 72, pupil scaling identification mould
Block 73 and label display module 74, the input module 71 are used to input the physical characteristic information and acupoint coordinate of patient,
Acquisition camera 2 acquires patient's human body realtime graphic, and realtime graphic is sent to 5 analysis of center processor processing, obtains patient cave
Bit distribution information, image identification demarcating module 72 are connect with center processor 5, and the acupoint location point of estimating for pinpointing acupuncture point is marked
Into 3-dimensional image, an acupuncture point three-dimensional image output is formed after being calculated analytically, acupuncture point 3-dimensional image shows mould in label
After showing on block 74, pupil scaling identification module 73 demarcates real-time virtual red dot at entire patient acupuncture point, and user passes through pupil
Hole scaling identification module 73 zooms in and out a section to virtual red dot, obtains acupuncture point position, and label display module 74 makes at red dot
Show acupoint information;
It includes being pierced into image gesture judgment module 81 and depth feedback module 82 that the acupoint, which is pierced into feedback system 8, described
Image gesture judgment module is connect with center processor 5, and center processor 5 receives the image that gesture image input module 71 receives
Information is pierced into depth with each acupuncture point stored in data memory module 6 and bearing data is compared, and judges that acupuncture needle is pierced into hand
Whether method correct, be pierced into feedback module connect with center processor 5, center processor 5 according to acupuncture needle length in vitro it is superfluous
The body surface image analysing computer of remaining length obtains piercing depth, and the depth is shown in label display module 74, Real-time Feedback;
The input module 71 includes that fixed point acupuncture point input unit 711, patient data input unit 712 and body image are defeated
Enter unit 713, the fixed point acupuncture point input unit 711 is used to input the acupuncture point coordinate for needing to apply acupuncture to patient and is pierced into deep
Degree inputs the human dimension of patient individual in patient data input unit 712, which includes height, weight and figure ratio
Information, body image input unit 713 is for receiving realtime graphic and being sent to the analysis of center processor 5.
The data memory module 6 also stores each acupuncture point inside data memory module 6 for storing patient cases' information
Information and each acupuncture point are pierced into depth and orientation requirement;
The depth feedback module 82 includes low battery temperature-sensitive remote sensing needle, and the low battery temperature-sensitive remote sensing needle is used
It is pierced into deep contact reaction in receiving, the patient data input unit 712 and the cooperation of body image input unit 713 receive disease
The practical height position ratio of person, and YOLO convolutional neural networks algorithm is utilized, it carries out real-time object identification detection and acupuncture point is sat
Mark calibration;
The input module 71 is set as portable electronic device, the portable electronic device include laptop,
Tablet computer, desktop computer and smart phone, the input module 71 can also be built on cloud data memory module 6, and
Pass through network or other communication modes and portable electronic device line;
The label display module setting connects inside portable electronic device, or on the outside of portable electronic device
LED display;
The image identification demarcating module is arranged inside portable electronic device, or is provided by 4 end side of working machine;
1 side of AR glasses is equipped with alarm 9, and the alarm 9 is wirelessly connected with center processor 5, the alarm
Amendment of the device 9 for piercing system prompts;
The data memory module 6 is electrically connected with center processor 5, and 6 internal reservoir of data memory module is ill
Disease is pierced into depth data and all acupuncture point datas, and center processor 5 receives 82 information of depth feedback module, and prompts best thorn
Enter depth and be pierced into angle direction, the being associated property of piercing depth data of illness is matched, to obtain the corresponding piercing depth
Standard Value Data;
Calculating in the system is based on particle swarm algorithm and optimization neural network (PSO-BP), turns three using three-dimensional
The output of dimension image reduces error there is no two dimension conversion is carried out, and further establishes and store in data memory module 6
Acupoint gimmick provides data as perfect as possible, is based on YOLO volumes in being pierced into the work of image gesture judgment module 81
Product neural network algorithm is pierced into depth feedback in setting and is carried out being pierced into depth feedback, and needle according to the regular length of acupuncture needle
To the different state of an illness, all pathological datas are stored into data and are deposited by the different length of different acupuncture needles, different piercing depth feedback
Module is stored up, the foundation that acupoint is pierced into 8 data memory module of feedback system is completed, prepares to carry out at the acupuncture point of human body palm part real
Test examination, collects the coordinate of human body palm part in advance, then carries out algorithm and obtains coordinate position and swept by structural light three-dimensional
It retouches human hands and carries out acupuncture point calibration, obtain and compared with the palm acupuncture point coordinate of standard after these calibration points, discovery is passed through
The palm acupuncture point grid deviation of coordinate position and actual standard that algorithm obtains meets positioning requirements within 10mm.
A kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment, it is characterised in that: further include a kind of AR augmented reality intelligence
The application method of acupuncture headset equipment: specific step is as follows:
Step 1: being inserted into 4 port of working machine for data memory module 6, runs application program to AR glasses 1 and servomechanism 3
End is attached, and inputs acupoint information by fixed point acupuncture point input unit 711, center processor 5 obtains acupuncture point coordinate;
Step 2: the height position information of patient is inputted by patient data input unit 712, and is sent information to
Heart processor 5;
Step 3: doctor wears AR glasses 1, and acquisition camera 2 acquires patient's human body realtime graphic, and defeated by body image
Enter after unit 713 receives and is sent to center processor 5;
Step 4: center processor 5 analyzes organization of human body dimension scale according to the data in step 2 and step 3, as
It identifies human body three-dimensional image shadow surface fixed point of the demarcating module under 1 sight of AR glasses, the acupuncture point coordinate in step 1 is being suffered from
The calibration of person's body surface, marks red dot region;
Step 5: above-mentioned label red dot region is exported, and calibrates human body by starting point application algorithm of budget acupuncture point point
Remaining acupuncture point point obtains acupoint distribution map;
Step 6: pupil scaling identification module 73 reduces the acupuncture point that pupil is completed at red dot and shows, shows mark module mark
Title, pathology treatment and the acupuncture skill for remembering human body red dot display acupuncture point out handle post-processing into visual three-dimensional by AR glasses 1
Virtual mark;
Step 7: it applies acupuncture according to the acupuncture point mark point in step 6 to acupuncture point coordinate points, acupuncture angle and depth are abided by
According to the acupuncture skill of prompt, center processor 5 receives the image information that gesture image input module 71 receives, cooperation low battery heat
Quick remote sensing needle, which receives, is pierced into deep contact reaction acquisition acupuncture needle insertion angle and depth, judges the accuracy of gimmick, works as hand
Method mistake alarm device 9 sounds an alarm, and doctor is prompted to adjust.
The several points that should finally illustrate are: firstly, in the description of the present application, it should be noted that unless otherwise prescribed and
It limits, term " installation ", " connected ", " connection " shall be understood in a broad sense, can be mechanical connection or electrical connection, be also possible to two
Connection inside element, can be directly connected, and "upper", "lower", "left", "right" etc. are only used for indicating relative positional relationship, when
The absolute position for being described object changes, then relative positional relationship may change;
Secondly: the present invention discloses in embodiment attached drawing, relates only to the structure being related to the embodiment of the present disclosure, other knots
Structure, which can refer to, to be commonly designed, and under not conflict situations, the same embodiment of the present invention and different embodiments be can be combined with each other;
Last: the foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, all in the present invention
Spirit and principle within, any modification, equivalent replacement, improvement and so on, should be included in protection scope of the present invention it
It is interior.
Claims (8)
1. a kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment according to claim 1, including AR glasses (1), special
Sign is: AR glasses (1) front end is equipped with acquisition camera (2), and the connecting pin of the AR glasses (1) is equipped with servomechanism (3),
The connecting pin of the servomechanism (3) is equipped with working machine (4), is equipped with center processor (5) inside the working machine (4), the work
Make machine (4) port to be connected with data memory module (6), the connecting pin of the center processor (5) is additionally provided with acupuncture point automatic positioning
System (7) and acupoint are pierced into feedback system (8);
The acupuncture point automatic station-keeping system (7) includes input module (71), image identification demarcating module (72), the identification of pupil scaling
Module (73) and label display module (74), the input module (71) are used to input physical characteristic information and the acupuncture cave of patient
Position coordinate, acquisition camera (2) acquire patient's human body realtime graphic, and realtime graphic is sent to center processor (5) analysis processing,
The distributed intelligence of patient acupuncture point is obtained, image identification demarcating module (72) is connect with center processor (5), will pinpoint estimating for acupuncture point
Acupoint location point is tagged in 3-dimensional image, and an acupuncture point three-dimensional image output, acupuncture point three-dimensional shadow are formed after being calculated analytically
After showing on label display module (74), pupil scaling identification module (73) demarcates real-time virtual at entire patient acupuncture point
Red dot, user zoom in and out a section to virtual red dot by pupil scaling identification module (73), obtain acupuncture point position, label
Display module (74) makes to show acupoint information at red dot;
It includes being pierced into image gesture judgment module (81) and depth feedback module (82), institute that the acupoint, which is pierced into feedback system (8),
It states image gesture judgment module to connect with center processor (5), center processor (5) receives the image that input module (71) receive
Information is pierced into depth with each acupuncture point stored in data memory module (6) and bearing data is compared, and judges that acupuncture needle is pierced into
Whether gimmick correct, be pierced into feedback module connect with center processor (5), center processor (5) according to acupuncture needle length with
The body surface image analysing computer of external redundant length obtains piercing depth, and by the depth in label display module (74) display, in real time
Feedback;
The input module (71) includes fixed point acupuncture point input unit (711), patient data input unit (712) and body image
Input unit (713), fixed point acupuncture point input unit (711) be used to input the acupuncture point coordinate that needs to apply acupuncture to patient with
Be pierced into depth, patient data input unit (712) input patient individual human dimension, the size include height, weight and
Figure percent information, body image input unit (713) is for receiving realtime graphic and being sent to center processor (5) analysis.
The data memory module (6) also stores each acupuncture point inside data memory module (6) for storing patient cases' information
Information and each acupuncture point are pierced into depth and orientation requirement.
2. a kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment according to claim 1, it is characterised in that: the depth
Feedback module (82) includes low battery temperature-sensitive remote sensing needle, and the low battery temperature-sensitive remote sensing needle is pierced into depth for receiving
Haptoreaction, the patient data input unit (712) and body image input unit (713) cooperation receive the practical height of patient
Position ratio, and YOLO convolutional neural networks algorithm is utilized, it carries out real-time object identification detection and acupuncture point coordinate is demarcated.
3. a kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment according to claim 1, it is characterised in that: the input
Module (71) is set as portable electronic device, and the portable electronic device includes laptop, tablet computer, desktop
Brain and smart phone, the input module (71) can also build on cloud data memory module (6), and by network or its
His communication modes and portable electronic device line.
4. a kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment according to claim 3, it is characterised in that: the label
Display module (74) is arranged inside portable electronic device, or LED display is connected on the outside of portable electronic device.
5. a kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment according to claim 3, it is characterised in that: the image
It identifies that demarcating module (72) are arranged inside portable electronic device, or is provided by working machine (4) end side.
6. a kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment according to claim 1, it is characterised in that: AR described
Mirror (1) side is equipped with alarm (9), and the alarm (9) and center processor (5) are wirelessly connected, and the alarm (9) is used for
The amendment of piercing system prompts.
7. a kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment according to claim 6, it is characterised in that: the data
Memory module (6) and center processor (5) are electrically connected, and data memory module (6) internal reservoir has illness to be pierced into depth
Data and all acupuncture point datas, center processor (5) receive depth feedback module (82) information, and prompt best piercing depth
And it is pierced into angle direction, the being associated property of piercing depth data of illness is matched, to obtain the standard of the corresponding piercing depth
Value Data.
8. a kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment described in -7 according to claim 1, it is characterised in that: further include
A kind of application method of AR augmented reality intelligent acupuncture and moxibustion headset equipment: specific step is as follows:
Step 1: being inserted into working machine (4) port for data memory module (6), runs application program to AR glasses (1) and servomechanism
(3) end is attached, and inputs acupoint information by fixed point acupuncture point input unit (711), center processor (5) obtains acupuncture point and sits
Mark;
Step 2: the height position information of patient is inputted by patient data input unit (712), and sends information to center
Processor (5);
Step 3: doctor wears AR glasses (1), and acquisition camera (2) acquires patient's human body realtime graphic, and defeated by body image
Enter after unit (713) receive and is sent to center processor (5);
Step 4: center processor (5) analyzes organization of human body dimension scale according to the data in step 2 and step 3, as knowing
Human body three-dimensional image shadow surface fixed point of the other demarcating module under AR glasses (1) sight, the acupuncture point coordinate in step 1 is being suffered from
The calibration of person's body surface, marks red dot region;
Step 5: exporting above-mentioned label red dot region, and using budget acupuncture point point as starting point application algorithm calibrate human body remaining
Acupuncture point point obtains acupoint distribution map;
Step 6: pupil scaling identification module (73) reduces the acupuncture point that pupil is completed at red dot and shows, display mark module label
Human body red dot shows title, pathology treatment and the acupuncture skill at acupuncture point out, by AR glasses (1) processing post-processing at visual three-dimensional
Virtual mark;
Step 7: applying acupuncture to acupuncture point coordinate points according to the acupuncture point mark point in step 6, and acupuncture angle and depth are in accordance with mentioning
The acupuncture skill shown, center processor (5) receive the image information that gesture image input module (71) receive, cooperation low battery heat
Quick remote sensing needle, which receives, is pierced into deep contact reaction acquisition acupuncture needle insertion angle and depth, judges the accuracy of gimmick, works as hand
Method mistake alarm device (9) sounds an alarm, and doctor is prompted to adjust.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910412852.4A CN110063886A (en) | 2019-05-17 | 2019-05-17 | A kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910412852.4A CN110063886A (en) | 2019-05-17 | 2019-05-17 | A kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110063886A true CN110063886A (en) | 2019-07-30 |
Family
ID=67370909
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910412852.4A Pending CN110063886A (en) | 2019-05-17 | 2019-05-17 | A kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110063886A (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111076776A (en) * | 2019-12-31 | 2020-04-28 | 北京航空航天大学 | Device for detecting acupuncture technique by using multi-sensing system and corresponding method |
CN111317665A (en) * | 2020-02-28 | 2020-06-23 | 广东工业大学 | Acupuncture guiding method and device |
CN112349382A (en) * | 2020-11-09 | 2021-02-09 | 中国人民解放军陆军军医大学第二附属医院 | Visual simplified acupuncture system and method |
CN112426356A (en) * | 2020-11-18 | 2021-03-02 | 成都艾养阳医学技术研究中心(有限合伙) | Traditional Chinese medicine moxibustion applying equipment and 3D scanning auxiliary acupoint positioning method and system thereof |
CN112991437A (en) * | 2021-04-08 | 2021-06-18 | 上海盛益精密机械有限公司 | Full-automatic acupuncture point positioning method based on image expansion and contraction technology |
CN113069082A (en) * | 2021-03-26 | 2021-07-06 | 海南可视化医疗科技有限公司 | Traditional Chinese medicine visceral manifestation visualization system |
CN115227569A (en) * | 2022-06-23 | 2022-10-25 | 齐齐哈尔市祥和中医器械有限责任公司 | Human body acupuncture point identification method and system based on reality and virtuality |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102698370A (en) * | 2012-07-03 | 2012-10-03 | 成都中医药大学 | Multifunctional intelligent acupuncture and moxibustion diagnosis and treatment instrument and application method thereof |
CN102698371A (en) * | 2012-07-03 | 2012-10-03 | 成都中医药大学 | Intelligent evidence-based acupuncture and moxibustion diagnosis and treatment system and method |
CN104207931A (en) * | 2013-06-05 | 2014-12-17 | 上海中医药大学 | Accurate human face acupuncture point locating and acupuncture and moxibustion prescription learning method |
CN105581904A (en) * | 2015-12-31 | 2016-05-18 | 司继红 | Intelligent acupuncture system |
CN106327983A (en) * | 2016-09-06 | 2017-01-11 | 成都华域天府数字科技有限公司 | Acupuncture acupoint determination auxiliary teaching system |
CN107845059A (en) * | 2017-10-12 | 2018-03-27 | 北京宇航时代科技发展有限公司 | Human meridian point's state dynamically normalized digital analysis system and method |
-
2019
- 2019-05-17 CN CN201910412852.4A patent/CN110063886A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102698370A (en) * | 2012-07-03 | 2012-10-03 | 成都中医药大学 | Multifunctional intelligent acupuncture and moxibustion diagnosis and treatment instrument and application method thereof |
CN102698371A (en) * | 2012-07-03 | 2012-10-03 | 成都中医药大学 | Intelligent evidence-based acupuncture and moxibustion diagnosis and treatment system and method |
CN104207931A (en) * | 2013-06-05 | 2014-12-17 | 上海中医药大学 | Accurate human face acupuncture point locating and acupuncture and moxibustion prescription learning method |
CN105581904A (en) * | 2015-12-31 | 2016-05-18 | 司继红 | Intelligent acupuncture system |
CN106327983A (en) * | 2016-09-06 | 2017-01-11 | 成都华域天府数字科技有限公司 | Acupuncture acupoint determination auxiliary teaching system |
CN107845059A (en) * | 2017-10-12 | 2018-03-27 | 北京宇航时代科技发展有限公司 | Human meridian point's state dynamically normalized digital analysis system and method |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111076776A (en) * | 2019-12-31 | 2020-04-28 | 北京航空航天大学 | Device for detecting acupuncture technique by using multi-sensing system and corresponding method |
CN111317665A (en) * | 2020-02-28 | 2020-06-23 | 广东工业大学 | Acupuncture guiding method and device |
CN112349382A (en) * | 2020-11-09 | 2021-02-09 | 中国人民解放军陆军军医大学第二附属医院 | Visual simplified acupuncture system and method |
CN112426356A (en) * | 2020-11-18 | 2021-03-02 | 成都艾养阳医学技术研究中心(有限合伙) | Traditional Chinese medicine moxibustion applying equipment and 3D scanning auxiliary acupoint positioning method and system thereof |
CN113069082A (en) * | 2021-03-26 | 2021-07-06 | 海南可视化医疗科技有限公司 | Traditional Chinese medicine visceral manifestation visualization system |
CN112991437A (en) * | 2021-04-08 | 2021-06-18 | 上海盛益精密机械有限公司 | Full-automatic acupuncture point positioning method based on image expansion and contraction technology |
CN115227569A (en) * | 2022-06-23 | 2022-10-25 | 齐齐哈尔市祥和中医器械有限责任公司 | Human body acupuncture point identification method and system based on reality and virtuality |
CN115227569B (en) * | 2022-06-23 | 2024-02-23 | 齐齐哈尔市祥和中医器械有限责任公司 | Human body acupoint recognition system based on reality and virtualization |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110063886A (en) | A kind of AR augmented reality intelligent acupuncture and moxibustion headset equipment | |
US20210174706A1 (en) | Injection site training system | |
CN105534694B (en) | A kind of characteristics of human body's visualization device and method | |
Mou et al. | Roles of egocentric and allocentric spatial representations in locomotion and reorientation. | |
CN109758230A (en) | A kind of neurosurgery air navigation aid and system based on augmented reality | |
CN110335516B (en) | Method for performing VR cardiac surgery simulation by adopting VR cardiac surgery simulation system | |
CN101904770B (en) | Operation guiding system and method based on optical enhancement reality technology | |
JP2017056212A (en) | Surgical operation support system, surgical operation support device, surgical operation support method, surgical operation support program and information processor | |
JP2022540898A (en) | Augmented Reality Systems and Methods for Remote Supervision of Surgical Procedures | |
CN109091380A (en) | Traditional Chinese medicine system and method for realizing acupoint visualization by AR technology | |
CN102622916A (en) | Human body acupuncture point projection demonstration method and device | |
CN104207931A (en) | Accurate human face acupuncture point locating and acupuncture and moxibustion prescription learning method | |
CN106780653A (en) | The generation method of collaterals of human and acupuncture points on the human body Visual Graph | |
CN109273079A (en) | AI cloud diagnosis and therapy system based on Chinese medicine | |
CN111729200B (en) | Transcranial magnetic stimulation automatic navigation system and method based on depth camera and magnetic resonance | |
CN109841272A (en) | Realtime graphic identification display equipment | |
CN114943802A (en) | Knowledge-guided surgical operation interaction method based on deep learning and augmented reality | |
CN110584780A (en) | Cerebral hemorrhage puncture operation navigation system | |
Ali et al. | 3-D telestration: a teaching tool for robotic surgery | |
CN112991437B (en) | Full-automatic acupuncture point positioning method based on image expansion and contraction technology | |
CN110349661A (en) | A kind of acupuncture remote diagnosis system | |
CN115576427A (en) | XR-based multi-user online live broadcast and system | |
Zhang et al. | From AR to AI: augmentation technology for intelligent surgery and medical treatments | |
TWI644285B (en) | Acupuncture visualization Chinese medicine system and method thereof by using AR technology | |
CN111544113A (en) | Target tracking and distance dynamic graphical display method and device in surgical navigation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190730 |