CN117058131B - Method for carrying out visual positioning on facial artery based on high-resolution thermal imaging - Google Patents
Method for carrying out visual positioning on facial artery based on high-resolution thermal imaging Download PDFInfo
- Publication number
- CN117058131B CN117058131B CN202311307742.4A CN202311307742A CN117058131B CN 117058131 B CN117058131 B CN 117058131B CN 202311307742 A CN202311307742 A CN 202311307742A CN 117058131 B CN117058131 B CN 117058131B
- Authority
- CN
- China
- Prior art keywords
- facial
- artery
- arteries
- preset
- blood flow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 210000001367 artery Anatomy 0.000 title claims abstract description 258
- 230000001815 facial effect Effects 0.000 title claims abstract description 190
- 230000000007 visual effect Effects 0.000 title claims abstract description 78
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000001931 thermography Methods 0.000 title claims abstract description 28
- 230000017531 blood circulation Effects 0.000 claims abstract description 59
- 238000007781 pre-processing Methods 0.000 claims abstract description 12
- 238000012800 visualization Methods 0.000 claims description 20
- 230000010412 perfusion Effects 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 6
- 239000003086 colorant Substances 0.000 claims description 4
- 230000004807 localization Effects 0.000 claims description 4
- 206010067484 Adverse reaction Diseases 0.000 abstract description 8
- 230000006838 adverse reaction Effects 0.000 abstract description 8
- 239000000945 filler Substances 0.000 abstract description 7
- 206010014513 Embolism arterial Diseases 0.000 abstract description 6
- 230000007547 defect Effects 0.000 abstract 1
- 238000002347 injection Methods 0.000 description 5
- 239000007924 injection Substances 0.000 description 5
- 238000010968 computed tomography angiography Methods 0.000 description 4
- 238000002604 ultrasonography Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 210000004204 blood vessel Anatomy 0.000 description 2
- 239000002872 contrast media Substances 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 201000004569 Blindness Diseases 0.000 description 1
- 208000005189 Embolism Diseases 0.000 description 1
- 206010020751 Hypersensitivity Diseases 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 230000007815 allergy Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000002591 computed tomography Methods 0.000 description 1
- 239000002537 cosmetic Substances 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000002427 irreversible effect Effects 0.000 description 1
- 238000002559 palpation Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 239000000243 solution Substances 0.000 description 1
- 230000037303 wrinkles Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10132—Ultrasound image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
- G06T2207/30104—Vascular flow; Blood flow; Perfusion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Data Mining & Analysis (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Life Sciences & Earth Sciences (AREA)
- Medical Informatics (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Evolutionary Computation (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The invention relates to the technical field of identification, in particular to a method for performing visual positioning on facial arteries based on high-resolution thermal imaging. Aiming at the defects of low reliability and large invasiveness of the existing method, the adopted method is as follows: acquiring a first thermal image; preprocessing the first thermal image to obtain a corresponding second thermal image; extracting form and position information of facial arteries in the second thermal image; performing visual processing on the form and position information of the facial artery to obtain a corresponding first visual view; acquiring a first video; inputting the first video into a preset blood flow state prediction model to obtain a blood flow state prediction result. By adopting the scheme, the morphology and the position of the superior trochlear artery, the superior orbital artery and the facial artery can be detected in a non-invasive, non-contact and clear way, so that a plastic cosmetologist can avoid the superior trochlear artery, the superior orbital artery and the facial artery more accurately when filling the filler, and adverse reactions of arterial embolism of eyes are avoided.
Description
Technical Field
The invention relates to the technical field of identification, in particular to a method for performing visual positioning on facial arteries based on high-resolution thermal imaging.
Background
Computed tomography angiography (Computed Tomography Angiography, CTA), by injecting contrast agent and performing CT scan, then image processing and reconstruction, a stereoscopic image of facial artery is obtained.
Color doppler ultrasound (Color Doppler Ultrasound, CDU) can detect indices such as diameter of facial artery, blood flow velocity, blood vessel wall thickness, etc. by doppler effect.
However, computed tomography angiography involves risks of radiation and contrast agent allergies, and is costly, and in addition, errors in reconstructed images are large and clinical practice cannot be widely developed.
Color Doppler ultrasound is a noninvasive detection technology, but has poor accuracy in positioning the superior trochlear artery, the superior orbital artery and the facial artery, requires an operator to palpation and position the artery before detection, requires abundant experience, and has a large technical error due to a high variation rate of the artery.
Therefore, there is a need to develop new facial artery identification methods to overcome the shortcomings of low reliability and high invasiveness of the existing methods.
Disclosure of Invention
The main object of the present invention is to provide a method, a device, a computer device and a computer readable storage medium for visual localization of facial arteries based on high resolution thermal imaging, so as to solve the shortcomings of low reliability and high invasiveness of the existing method.
In order to achieve the above-mentioned object,
the invention provides a method for performing visual positioning on facial arteries based on high-resolution thermal imaging, which comprises the following steps:
acquiring a first thermal image; wherein the first thermal image is an initial thermal image of a user's face;
preprocessing the first thermal image to obtain a corresponding second thermal image;
extracting form and position information of facial arteries in the second thermal image; wherein facial arteries include supratrochlear arteries, supraorbital arteries, and facial arteries;
performing visual processing on the form and position information of the facial artery to obtain a corresponding first visual view;
acquiring a first video; wherein the first video is a thermal imaging video of a user's face;
inputting the first video into a preset blood flow state prediction model to obtain a blood flow state prediction result; wherein, the blood flow state comprises blood flow direction, flow velocity and perfusion.
The invention also provides a visual positioning device, which comprises:
a first acquisition unit configured to acquire a first thermal image; wherein the first thermal image is an initial thermal image of a user's face;
the first processing unit is used for preprocessing the first thermal image to obtain a corresponding second thermal image;
an extracting unit, configured to extract morphology and position information of facial arteries in the second thermal image; wherein facial arteries include supratrochlear arteries, supraorbital arteries, and facial arteries;
the visualization unit is used for carrying out visualization processing on the form and position information of the facial artery to obtain a corresponding first visual view;
the second acquisition unit is used for acquiring the first video; wherein the first video is a thermal imaging video of a user's face;
the second processing unit is used for inputting the first video into a preset blood flow state prediction model to obtain a blood flow state prediction result; wherein, the blood flow state comprises blood flow direction, flow velocity and perfusion.
The invention also provides a computer device comprising a memory in which a computer program is stored and a processor which when executing the computer program implements the steps of the method as described above.
The present invention also provides a computer readable storage medium having stored thereon instructions which when executed by a processor implement the steps of the method as described above.
According to the method provided by the invention, the first thermal image is obtained, wherein the first thermal image is an initial thermal image of the face of the user; further, preprocessing the first thermal image to obtain a corresponding second thermal image; further, form and position information of facial arteries in the second thermal image are extracted, wherein the facial arteries comprise supratrochlear arteries, supraorbital arteries and facial arteries; furthermore, the form and position information of the facial artery are subjected to visualization processing to obtain a corresponding first visual view; further, a first video is obtained, wherein the first video is a thermal imaging video of the face of the user; and inputting the first video into a preset blood flow state prediction model to obtain a blood flow state prediction result, wherein the blood flow state comprises blood flow direction, flow speed and perfusion. By the method, the morphology and the position of the superior trochlear artery, the superior orbital artery and the facial artery can be detected in a non-invasive, non-contact and clear way, so that a plastic cosmetologist can avoid the superior trochlear artery, the superior orbital artery and the facial artery more accurately when filling the filler, and adverse reactions of arterial embolism of eyes are avoided; in addition, the facial information of the user in another dimension, namely the blood flow direction, the flow speed and the perfusion, can be provided for the plastic cosmetologist, and the information obtained by the plastic cosmetologist is more comprehensive.
Drawings
FIG. 1 is a flow chart of a method for visual localization of facial arteries based on high resolution thermal imaging according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a visual positioning device according to an embodiment of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Example 1
The embodiment of the invention provides a method for performing visual positioning on facial arteries based on high-resolution thermal imaging, which is shown in fig. 1 and comprises the following steps:
step S1: acquiring a first thermal image; wherein the first thermal image is an initial thermal image of the user's face.
Step S2: and preprocessing the first thermal image to obtain a corresponding second thermal image.
Step S3: extracting form and position information of facial arteries in the second thermal image; wherein facial arteries include supratrochlear arteries, supraorbital arteries, and facial arteries.
Step S4: and carrying out visualization processing on the form and position information of the facial artery to obtain a corresponding first visual view.
Step S5: acquiring a first video; wherein the first video is a thermal imaging video of the user's face.
Step S6: inputting the first video into a preset blood flow state prediction model to obtain a blood flow state prediction result; wherein, the blood flow state comprises blood flow direction, flow velocity and perfusion.
According to the method provided by the embodiment, the first thermal image is obtained, wherein the first thermal image is an initial thermal image of the face of the user; further, preprocessing the first thermal image to obtain a corresponding second thermal image; further, form and position information of facial arteries in the second thermal image are extracted, wherein the facial arteries comprise supratrochlear arteries, supraorbital arteries and facial arteries; furthermore, the form and position information of the facial artery are subjected to visualization processing to obtain a corresponding first visual view; further, a first video is obtained, wherein the first video is a thermal imaging video of the face of the user; and inputting the first video into a preset blood flow state prediction model to obtain a blood flow state prediction result, wherein the blood flow state comprises blood flow direction, flow speed and perfusion. By the method, the morphology and the position of the superior trochlear artery, the superior orbital artery and the facial artery can be detected in a non-invasive, non-contact and clear way, so that a plastic cosmetologist can avoid the superior trochlear artery, the superior orbital artery and the facial artery more accurately when filling the filler, and adverse reactions of arterial embolism of eyes are avoided; in addition, the facial information of the user in another dimension, namely the blood flow direction, the flow speed and the perfusion, can be provided for the plastic cosmetologist, and the information obtained by the plastic cosmetologist is more comprehensive.
By way of background, (1) facial injection filling is a cosmetic method of reshaping that improves facial contours, wrinkles, and skin quality by injecting a filling. In recent years, facial injection filling has been widely used worldwide, the market demand thereof continues to increase, and millions of people perform facial injection filling each year, however, the behavior has rare but serious adverse effects, namely, the effect of filling, the occurrence of embolism and blindness of the ocular artery, because the filling agent is erroneously injected into the blood vessel matching the ocular artery, and the arterial in the retina is subjected to countercurrent blockage under the action of injection pressure. Although this adverse reaction is rare, the consequences are catastrophic and irreversible. (2) Many arteries of the face are anastomosed with the ocular arteries, and the supratrochlear artery, the supraorbital artery and the facial artery are important branches, so that the above adverse reactions are avoided, and the supraorbital artery, the supraorbital artery and the facial artery need to be accurately avoided during injection.
Optionally, (1) the resolution ratio of the first thermal image is not lower than 640x480 pixels, so that more arterial features of the face of the user can be captured, and the accuracy of subsequent information extraction is ensured; (2) Preprocessing the first thermal image, wherein the preprocessing comprises, but is not limited to, image enhancement, denoising and segmentation, and at least one or any combination of the preprocessing and the denoising, the image quality and the interpretability of the first thermal image can be improved through the preprocessing; (3) Tools selected for the visualization process include, but are not limited to Matlab software; through the visualization processing, the running and distribution condition of the facial artery can be observed more intuitively.
Example two
The embodiment of the invention provides a method for performing visual positioning on facial arteries based on high-resolution thermal imaging, which is the same as the first embodiment and is not repeated, and is different in that: after step S4, the method further includes:
acquiring a pre-stored facial artery anatomic map; the facial artery anatomic map is used for comparing with the first visual view, and judging the accuracy of the form and position information of the facial artery on the first visual view.
By acquiring the pre-stored facial artery anatomic map, the facial artery anatomic map can be compared with the first visual view, the accuracy of the form and position information of the facial artery on the first visual view can be intuitively judged, and corresponding adjustment can be conveniently carried out according to the comparison result.
Alternatively, sources of facial arterial anatomic map include, but are not limited to, anatomic data, ultrasound databases.
Example III
The embodiment of the invention provides a method for performing visual positioning on facial arteries based on high-resolution thermal imaging, which is the same as the first embodiment and is not repeated, and is different in that: after step S6, the method further includes:
performing visualization processing on the blood flow state prediction result, and obtaining a corresponding second visual view;
overlapping the second visual view on the first video in real time to obtain a corresponding second video; wherein the second video is a thermal imaging flow field texture video.
In the method provided by the above, the blood flow state prediction result is subjected to visualization processing, and a corresponding second visualization view is obtained; and further, the second visual view is overlapped on the first video in real time to obtain a corresponding second video, wherein the second video is a thermal imaging flow field texture video. Through the scheme, richer and more informative videos are provided, and the facial conditions of the user can be analyzed by the plastic cosmetologist more conveniently.
Example IV
The embodiment of the invention provides a method for performing visual positioning on facial arteries based on high-resolution thermal imaging, which is the same as the first embodiment and is not repeated, and is different in that: before step S6, the method further includes:
acquiring a training video set and a corresponding blood flow state prediction label;
and training the CNN-LSTM model by taking the training video set as input and the blood flow state prediction label as output to obtain a corresponding blood flow state prediction model.
In the method provided by the above, the training video set and the corresponding blood flow state prediction label are obtained; further, the training video set is used as input, the blood flow state prediction label is used as output, and the CNN-LSTM model is trained to obtain a corresponding blood flow state prediction model. Through the scheme, the CNN-LSTM model can learn the mode and the relation of the training video set and the blood flow state prediction label, and the blood flow state in the unseen video can be predicted more accurately by the corresponding obtained blood flow state prediction model, so that the prediction performance is good.
Example five
The embodiment of the invention provides a method for performing visual positioning on facial arteries based on high-resolution thermal imaging, which is the same as the first embodiment and is not repeated, and is different in that: after step S4, the method further includes:
and establishing a face two-dimensional coordinate system on the first visual view, and displaying coordinate point information of the facial artery under the face two-dimensional coordinate system.
By establishing a face two-dimensional coordinate system on the first visual view and displaying coordinate point information of facial arteries under the face two-dimensional coordinate system, the shaping and beautifying doctor can conveniently and finely judge the distance relation among the arteries.
Example six
The embodiment of the invention provides a method for carrying out visual positioning on facial arteries based on high-resolution thermal imaging, which is the same as the second embodiment and is not repeated, and is different in that: after the step of obtaining the pre-stored facial arterial anatomic map, the method further comprises the steps of:
registering the first visual view and the facial arterial anatomic map, and obtaining a registered first visual view and facial arterial anatomic map;
displaying the registered first visual view and the facial artery anatomic map on the same screen;
generating a corresponding first facial artery contour according to the registered facial artery anatomic map;
displaying the first facial artery contour in a dotted line form, and obtaining a corresponding second facial artery contour;
the second facial artery contour is superimposed onto the registered first visual view.
In the method provided by the above, the first visual view and the facial arterial anatomic map are registered, and the registered first visual view and facial arterial anatomic map are obtained; further, the registered first visual view and the facial artery anatomic map are displayed on the same screen; further, generating a corresponding first facial arterial contour according to the registered facial arterial anatomic map; further, displaying the first facial artery contour in a dotted line form, and obtaining a corresponding second facial artery contour; further, the second facial artery contour is superimposed onto the registered first visual view. Wherein registration may ensure spatial consistency of the first visualization view and the facial arterial anatomic map; the same screen display enables the plastic cosmetologist to compare the relationship between the two on the same interface at a glance; the first facial artery contour is displayed in a dotted line form, so that a plastic cosmetologist can distinguish the first facial artery contour and know which part of the contour is used as a standard contour; the second facial artery contour is superimposed on the registered first visual view, and the shape and position difference of the second facial artery contour and the artery on the first visual view can be easily known, so that the artery condition can be analyzed more accurately.
Example seven
The embodiment of the invention provides a method for performing visual positioning on facial arteries based on high-resolution thermal imaging, which is the same as the sixth embodiment and is not repeated, and is different in that: after the step of overlaying the second facial artery contour on the registered first visual view, further comprising:
generating a corresponding third facial artery contour according to the registered first visual view;
comparing the first facial artery profile with the third facial artery profile; wherein the content of the facial arterial anatomic map includes all arteries; the content of the second facial artery contour includes only the supratrochlear artery, the supraorbital artery, and the facial artery;
if the third facial artery contour has preset points, displaying preset contents in the facial artery anatomical map in preset colors; the preset points are located outside the outline of the second facial artery, the first distance is the shortest distance between the preset points and the outline of the second facial artery, the second distance is the distance between the preset points and the preset artery, the preset artery is other arteries except the upper pulley artery, the upper orbit artery and the facial artery, and the preset content is the artery corresponding to the second distance.
In the method provided by the above, generating a corresponding third facial artery contour according to the registered first visual view; further, comparing the first facial artery contour with a third facial artery contour, wherein the content of the facial artery anatomic map includes all arteries, and the content of the second facial artery contour includes only supratrochlear arteries, supraorbital arteries, and facial arteries; and if the third facial artery contour has preset points, displaying preset contents in the facial artery anatomical map in preset colors, wherein the preset points correspond to first distances which are larger than a first preset value and correspond to second distances which are larger than a second preset value, the preset points are positioned outside the second facial artery contour, the first distances are the shortest distances between the preset points and the second facial artery contour, the second distances are the distances between the preset points and the preset arteries, the preset arteries are other arteries except for the supratrochlear artery, the supraorbital artery and the facial artery, and the preset contents are arteries corresponding to the second distances. The preset content in the facial artery anatomical map is displayed in a preset color, so that the plastic cosmetologist clearly confirms which arteries need to be focused, and as the content of the facial artery anatomical map comprises all arteries, the preset arteries are convenient to view, the focus range is enlarged, namely, the facial artery anatomical map is not limited to focused on the superior trochlear artery, the superior orbital artery and the facial artery.
Example eight
An embodiment of the present invention provides a visual positioning device, as shown in fig. 2, including:
a first acquisition unit 10 for acquiring a first thermal image; the first thermal image is an initial thermal image of the face of the user;
a first processing unit 11, configured to pre-process the first thermal image to obtain a corresponding second thermal image;
an extracting unit 12 for extracting morphology and position information of facial arteries in the second thermal image; wherein facial arteries include supratrochlear arteries, supraorbital arteries, and facial arteries;
the visualization unit 13 is used for performing visualization processing on the morphology and position information of the facial artery to obtain a corresponding first visual view;
a second acquisition unit 14 for acquiring a first video; the first video is a thermal imaging video of the face of the user;
the second processing unit 15 is configured to input the first video into a preset blood flow state prediction model to obtain a blood flow state prediction result; wherein, the blood flow state comprises blood flow direction, flow velocity and perfusion.
The device provided by the embodiment can be used for noninvasively, non-contact and clearly detecting the morphology and the position of the superior trochlear artery, the superior orbital artery and the facial artery, so that a plastic cosmetologist can more accurately avoid the superior trochlear artery, the superior orbital artery and the facial artery when injecting the filling agent, and adverse reactions of arterial embolism of eyes are avoided; in addition, the facial information of the user in another dimension, namely the blood flow direction, the flow speed and the perfusion, can be provided for the plastic cosmetologist, and the information obtained by the plastic cosmetologist is more comprehensive.
In this embodiment, the specific implementation of each unit in the embodiment of the visual positioning device may be described with reference to embodiments one to seven, and will not be described herein again.
Example nine
An embodiment of the present invention provides a computer device, including a memory and a processor, where the memory stores a computer program, and where the processor implements the steps of the method according to any of the embodiments one to seven when executing the computer program.
The device provided by the embodiment can noninvasively, non-contact and clearly detect the morphology and the position of the superior trochlear artery, the superior orbital artery and the facial artery, so that a plastic cosmetologist can more accurately avoid the superior trochlear artery, the superior orbital artery and the facial artery when injecting the filling agent, and adverse reactions of arterial embolism of eyes are avoided; in addition, the facial information of the user in another dimension, namely the blood flow direction, the flow speed and the perfusion, can be provided for the plastic cosmetologist, and the information obtained by the plastic cosmetologist is more comprehensive.
Examples ten
An embodiment of the present invention provides a computer-readable storage medium having instructions stored thereon, which when executed by a processor, implement the steps of the method according to any of embodiments one to seven.
The computer readable storage medium provided by the embodiment can noninvasively, non-contact and clearly detect the morphology and the position of the superior trochlear artery, the superior orbital artery and the facial artery, so that a plastic cosmetologist can more accurately avoid the superior trochlear artery, the superior orbital artery and the facial artery when injecting the filling agent, and adverse reactions of arterial embolism of eyes are avoided; in addition, the facial information of the user in another dimension, namely the blood flow direction, the flow speed and the perfusion, can be provided for the plastic cosmetologist, and the information obtained by the plastic cosmetologist is more comprehensive.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, apparatus, article, or method that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, apparatus, article, or method. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, apparatus, article or method that comprises the element.
The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the invention, and all equivalent structures or equivalent processes using the descriptions and drawings of the present invention or direct or indirect application in other related technical fields are included in the scope of the present invention.
Claims (6)
1. A method for visual positioning of facial arteries based on high-resolution thermal imaging, comprising the steps of:
acquiring a first thermal image; wherein the first thermal image is an initial thermal image of a user's face;
preprocessing the first thermal image to obtain a corresponding second thermal image;
extracting form and position information of facial arteries in the second thermal image; wherein facial arteries include supratrochlear arteries, supraorbital arteries, and facial arteries;
performing visual processing on the form and position information of the facial artery to obtain a corresponding first visual view;
acquiring a first video; wherein the first video is a thermal imaging video of a user's face;
inputting the first video into a preset blood flow state prediction model to obtain a blood flow state prediction result; wherein the blood flow state includes blood flow direction, flow velocity and perfusion;
after the step of performing visualization processing on the morphology and the position information of the facial artery to obtain the corresponding first visual view, the method further comprises the following steps:
acquiring a pre-stored facial artery anatomic map; the facial artery anatomic map is used for comparing with the first visual view, and judging the accuracy of the form and position information of the facial artery on the first visual view;
after the step of performing visualization processing on the morphology and the position information of the facial artery to obtain the corresponding first visual view, the method further comprises the following steps: establishing a face two-dimensional coordinate system on the first visual view, and displaying coordinate point information of a face artery under the face two-dimensional coordinate system;
after the step of obtaining the pre-stored facial arterial anatomic map, the method further comprises the following steps:
registering the first visual view and the facial arterial anatomic map, and obtaining the registered first visual view and the facial arterial anatomic map;
displaying the registered first visual view and the facial artery anatomic map on the same screen;
generating a corresponding first facial artery contour according to the registered facial artery anatomic map;
displaying the first facial artery contour in a dotted line form, and obtaining a corresponding second facial artery contour;
superimposing the second facial arterial contour onto the registered first visual view;
after the step of superimposing the second facial artery contour on the registered first visual view, further comprising:
generating a corresponding third facial artery contour according to the registered first visual view;
comparing the first facial artery profile with the third facial artery profile; wherein the content of the facial arterial anatomic map includes all arteries; the content of the second facial artery contour only comprises the supratrochlear artery, the supraorbital artery and the facial artery;
if the third facial artery contour has preset points, displaying preset contents in the facial artery anatomic map in preset colors; the preset points are located outside the outline of the second facial artery, the first distance is the shortest distance between the preset points and the outline of the second facial artery, the second distance is the distance between the preset points and the preset artery, the preset artery is other arteries except for the superior pulley artery, the superior orbit artery and the facial artery, and the preset content is the artery corresponding to the second distance.
2. The method for performing facial artery visualized localization based on high-resolution thermal imaging according to claim 1, wherein after the step of inputting the first video into a preset blood flow state prediction model to obtain a blood flow state prediction result, the method further comprises:
performing visualization processing on the blood flow state prediction result, and obtaining a corresponding second visual view;
the second visual view is overlapped on the first video in real time, and a corresponding second video is obtained; wherein the second video is a thermal imaging flow field texture video.
3. The method for performing facial artery visualized localization based on high-resolution thermal imaging according to claim 1, wherein before the step of inputting the first video into a preset blood flow state prediction model to obtain a blood flow state prediction result, further comprises:
acquiring a training video set and a corresponding blood flow state prediction label;
and training the CNN-LSTM model by taking the training video set as input and the blood flow state prediction label as output to obtain the corresponding blood flow state prediction model.
4. A visual positioning device, comprising:
a first acquisition unit configured to acquire a first thermal image; wherein the first thermal image is an initial thermal image of a user's face;
the first processing unit is used for preprocessing the first thermal image to obtain a corresponding second thermal image;
an extracting unit, configured to extract morphology and position information of facial arteries in the second thermal image; wherein facial arteries include supratrochlear arteries, supraorbital arteries, and facial arteries;
the visualization unit is used for carrying out visualization processing on the form and position information of the facial artery to obtain a corresponding first visual view;
the second acquisition unit is used for acquiring the first video; wherein the first video is a thermal imaging video of a user's face;
the second processing unit is used for inputting the first video into a preset blood flow state prediction model to obtain a blood flow state prediction result; wherein the blood flow state includes blood flow direction, flow velocity and perfusion;
after the step of performing visualization processing on the morphology and the position information of the facial artery to obtain the corresponding first visual view, the method further comprises the following steps:
acquiring a pre-stored facial artery anatomic map; the facial artery anatomic map is used for comparing with the first visual view, and judging the accuracy of the form and position information of the facial artery on the first visual view;
after the step of performing visualization processing on the morphology and the position information of the facial artery to obtain the corresponding first visual view, the method further comprises the following steps: establishing a face two-dimensional coordinate system on the first visual view, and displaying coordinate point information of a face artery under the face two-dimensional coordinate system;
after the step of obtaining the pre-stored facial arterial anatomic map, the method further comprises the following steps:
registering the first visual view and the facial arterial anatomic map, and obtaining the registered first visual view and the facial arterial anatomic map;
displaying the registered first visual view and the facial artery anatomic map on the same screen;
generating a corresponding first facial artery contour according to the registered facial artery anatomic map;
displaying the first facial artery contour in a dotted line form, and obtaining a corresponding second facial artery contour;
superimposing the second facial arterial contour onto the registered first visual view;
after the step of superimposing the second facial artery contour on the registered first visual view, further comprising:
generating a corresponding third facial artery contour according to the registered first visual view;
comparing the first facial artery profile with the third facial artery profile; wherein the content of the facial arterial anatomic map includes all arteries; the content of the second facial artery contour only comprises the supratrochlear artery, the supraorbital artery and the facial artery;
if the third facial artery contour has preset points, displaying preset contents in the facial artery anatomic map in preset colors; the preset points are located outside the outline of the second facial artery, the first distance is the shortest distance between the preset points and the outline of the second facial artery, the second distance is the distance between the preset points and the preset artery, the preset artery is other arteries except for the superior pulley artery, the superior orbit artery and the facial artery, and the preset content is the artery corresponding to the second distance.
5. A computer device comprising a memory and a processor, the memory having stored therein a computer program, characterized in that the processor, when executing the computer program, carries out the steps of the method according to any of claims 1-3.
6. A computer readable storage medium having instructions stored thereon, which when executed by a processor, implement the steps of the method of any of claims 1-3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311307742.4A CN117058131B (en) | 2023-10-11 | 2023-10-11 | Method for carrying out visual positioning on facial artery based on high-resolution thermal imaging |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311307742.4A CN117058131B (en) | 2023-10-11 | 2023-10-11 | Method for carrying out visual positioning on facial artery based on high-resolution thermal imaging |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117058131A CN117058131A (en) | 2023-11-14 |
| CN117058131B true CN117058131B (en) | 2024-03-19 |
Family
ID=88655690
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311307742.4A Active CN117058131B (en) | 2023-10-11 | 2023-10-11 | Method for carrying out visual positioning on facial artery based on high-resolution thermal imaging |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117058131B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111178271A (en) * | 2019-12-30 | 2020-05-19 | 南京华图信息技术有限公司 | Face image feature enhancement method, face recognition method and electronic equipment |
| CN112507916A (en) * | 2020-12-16 | 2021-03-16 | 苏州金瑞阳信息科技有限责任公司 | Face detection method and system based on facial expression |
| CN113288092A (en) * | 2021-05-06 | 2021-08-24 | 福建师范大学 | Blood pressure detection method and terminal for extracting pulse wave based on video |
| CN114613477A (en) * | 2022-04-28 | 2022-06-10 | 深圳市鹰瞳智能技术有限公司 | Psychological monitoring method, device, equipment and storage medium based on deep learning |
| CN115517707A (en) * | 2022-09-05 | 2022-12-27 | 广州华科盈医疗科技有限公司 | System and method for realizing non-invasive cerebral artery stiffness detection |
| CN116269247A (en) * | 2023-02-17 | 2023-06-23 | 合肥中聚源智能科技有限公司 | Method for detecting carotid artery occlusion by using facial thermal imaging data |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6496594B1 (en) * | 1998-10-22 | 2002-12-17 | Francine J. Prokoski | Method and apparatus for aligning and comparing images of the face and body from different imagers |
| US6996256B2 (en) * | 2000-06-08 | 2006-02-07 | Honeywell International Inc. | Detection system and method using thermal image analysis |
| EP2498672B1 (en) * | 2009-11-11 | 2017-12-13 | Koninklijke Philips N.V. | Mask comfort diagnostic method |
| WO2020146596A1 (en) * | 2019-01-10 | 2020-07-16 | The Regents Of The University Of Michigan | Detecting presence and estimating thermal comfort of one or more human occupants in a built space in real-time using one or more thermographic cameras and one or more rgb-d sensors |
| KR102408405B1 (en) * | 2020-03-19 | 2022-06-15 | 주식회사 아이도트 | System for diagnosing the carotid artery |
-
2023
- 2023-10-11 CN CN202311307742.4A patent/CN117058131B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111178271A (en) * | 2019-12-30 | 2020-05-19 | 南京华图信息技术有限公司 | Face image feature enhancement method, face recognition method and electronic equipment |
| CN112507916A (en) * | 2020-12-16 | 2021-03-16 | 苏州金瑞阳信息科技有限责任公司 | Face detection method and system based on facial expression |
| CN113288092A (en) * | 2021-05-06 | 2021-08-24 | 福建师范大学 | Blood pressure detection method and terminal for extracting pulse wave based on video |
| CN114613477A (en) * | 2022-04-28 | 2022-06-10 | 深圳市鹰瞳智能技术有限公司 | Psychological monitoring method, device, equipment and storage medium based on deep learning |
| CN115517707A (en) * | 2022-09-05 | 2022-12-27 | 广州华科盈医疗科技有限公司 | System and method for realizing non-invasive cerebral artery stiffness detection |
| CN116269247A (en) * | 2023-02-17 | 2023-06-23 | 合肥中聚源智能科技有限公司 | Method for detecting carotid artery occlusion by using facial thermal imaging data |
Non-Patent Citations (2)
| Title |
|---|
| 头颈部CT血管成像评估颈动脉几何形态对颈内动脉起始部粥样斑块的影响;黄治飞 等;《实用临床医药杂志》;第27卷(第13期);正文第65-70页 * |
| 解剖学观察血管灌注后头颅模型眉下区上睑支的来源及走行区域;李旭风;刘媛媛;任珊珊;王爱;卢小生;;中国组织工程研究;20180318(第08期);正文第99-104页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117058131A (en) | 2023-11-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105022719B (en) | Medicine angiography system and method | |
| EP2149121B1 (en) | Image registration method | |
| CN111227864B (en) | Device for detecting focus by using ultrasonic image and computer vision | |
| Grau et al. | Registration of multiview real-time 3-D echocardiographic sequences | |
| US8687863B2 (en) | Image processing apparatus, control method thereof and computer program | |
| JP5534607B2 (en) | Medical image processing apparatus and program thereof | |
| KR101625256B1 (en) | Automatic analysis of cardiac m-mode views | |
| EP2208182B1 (en) | System and method for quantitative 3d ceus analysis | |
| US9924927B2 (en) | Method and apparatus for video interpretation of carotid intima-media thickness | |
| US8218839B2 (en) | Automatic localization of the left ventricle in cardiac cine magnetic resonance imaging | |
| US20040143189A1 (en) | Method and apparatus for quantitative myocardial assessment | |
| EP2442276A1 (en) | Medical image processing apparatus and medical image processing method | |
| US10980502B2 (en) | Method, storage medium, and system for analyzing image sequences of periodic physiological activities | |
| US20150141818A1 (en) | Vascular imaging method and device | |
| JP5934071B2 (en) | Apparatus, method and program for searching for shortest path of tubular structure | |
| US11954860B2 (en) | Image matching method and device, and storage medium | |
| US20070160276A1 (en) | Cross-time inspection method for medical image diagnosis | |
| US7106892B2 (en) | Display of image data information | |
| US20180300890A1 (en) | Ultrasonic image processing system and method and device thereof, ultrasonic diagnostic device | |
| CN117058131B (en) | Method for carrying out visual positioning on facial artery based on high-resolution thermal imaging | |
| CN113516700A (en) | Image processing method, image processing device, related equipment and storage medium | |
| CN113516701A (en) | Image processing method, image processing device, related equipment and storage medium | |
| Kirişli et al. | Comprehensive visualization of multimodal cardiac imaging data for assessment of coronary artery disease: first clinical results of the SMARTVis tool | |
| US20080050003A1 (en) | Method for Detection and Visional Enhancement of Blood Vessels and Pulmonary Emboli | |
| JPWO2019044089A1 (en) | Medical information display device, method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |