CN118175278A - Tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry - Google Patents
Tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry Download PDFInfo
- Publication number
- CN118175278A CN118175278A CN202410283762.0A CN202410283762A CN118175278A CN 118175278 A CN118175278 A CN 118175278A CN 202410283762 A CN202410283762 A CN 202410283762A CN 118175278 A CN118175278 A CN 118175278A
- Authority
- CN
- China
- Prior art keywords
- projection
- tongue
- light
- intensity distribution
- dmd
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000005259 measurement Methods 0.000 title claims abstract description 39
- 238000001314 profilometry Methods 0.000 title claims abstract description 35
- 238000009826 distribution Methods 0.000 claims abstract description 121
- 238000012876 topography Methods 0.000 claims abstract description 18
- 238000003384 imaging method Methods 0.000 claims description 55
- 238000000034 method Methods 0.000 claims description 17
- 230000010363 phase shift Effects 0.000 claims description 17
- 230000003287 optical effect Effects 0.000 claims description 14
- 230000001360 synchronised effect Effects 0.000 claims description 13
- 238000004891 communication Methods 0.000 claims description 9
- 238000012538 light obscuration Methods 0.000 claims description 8
- 201000010099 disease Diseases 0.000 description 7
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 7
- 230000008569 process Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 239000003814 drug Substances 0.000 description 4
- 230000003068 static effect Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000008033 biological extinction Effects 0.000 description 2
- 239000011248 coating agent Substances 0.000 description 2
- 238000000576 coating method Methods 0.000 description 2
- 230000001276 controlling effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000011002 quantification Methods 0.000 description 2
- 208000024891 symptom Diseases 0.000 description 2
- 241001270131 Agaricus moelleri Species 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 210000003161 choroid Anatomy 0.000 description 1
- 230000003750 conditioning effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000003862 health status Effects 0.000 description 1
- 230000000877 morphologic effect Effects 0.000 description 1
- 210000000214 mouth Anatomy 0.000 description 1
- 230000003387 muscular Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 238000012634 optical imaging Methods 0.000 description 1
- 210000003254 palate Anatomy 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000003746 surface roughness Effects 0.000 description 1
- 210000001519 tissue Anatomy 0.000 description 1
- 238000009827 uniform distribution Methods 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4854—Diagnosis based on concepts of traditional oriental medicine
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
- G01B11/2518—Projection by scanning of the object
- G01B11/2527—Projection by scanning of the object with phase change by in-plane movement of the patern
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/254—Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
- H04N13/268—Image signal generators with monoscopic-to-stereoscopic image conversion based on depth image-based rendering [DIBR]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/296—Synchronisation thereof; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/315—Modulator illumination systems
- H04N9/3155—Modulator illumination systems for controlling the light source
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/41—Medical
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2213/00—Details of stereoscopic systems
- H04N2213/005—Aspects relating to the "3D+depth" image format
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Medical Informatics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Geometry (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Alternative & Traditional Medicine (AREA)
- Electromagnetism (AREA)
- Software Systems (AREA)
- Optics & Photonics (AREA)
- Pathology (AREA)
- Computer Graphics (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
The invention discloses a tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry, and belongs to the field of medical optics. The tongue three-dimensional shape reconstruction system comprises: a light source configured to provide incident light; the DMD regulation and control unit is configured to carry out multiple projections on the lingual surface of the same subject, wherein the multiple projections are formed by sequentially projecting different projection patterns onto the lingual surface of the same subject within a time range according to an interval time; a lingual light intensity distribution acquisition unit configured to acquire light intensity distribution data of lingual surfaces of the same subject in a plurality of projections; and a PMP reconstruction unit configured to provide different projection patterns in the plurality of projections, and to perform three-dimensional reconstruction on the lingual surface of the same subject by phase measurement profilometry based on the plurality of projection patterns and light intensity distribution data corresponding to the plurality of projection patterns, to obtain a lingual surface three-dimensional topography profile of the same subject.
Description
Technical Field
The invention relates to the field of medical optics, in particular to a tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry.
Background
In the dialectical of tongue manifestations of traditional Chinese medicine, the texture features of the tongue surface are often used by traditional Chinese medicine as a basis for assisting in judging the physical state (such as health state, disease degree, etc.) of a human body. However, in the prior art, only the color features of the tongue picture are quantized and dataized by the two-dimensional image technology, but the quantization of the tongue picture morphological features (such as the depth features of the tongue surface texture) still remains a difficulty in tongue picture analysis. Due to the fact that depth information of tongue images is lacking in two-dimensional visible light RGB image information, tongue image shape characteristics of diversity and complexity cannot be represented in multiple dimensions, so that reference data (or auxiliary data) for tongue image dialectical purposes lacks integrity, accuracy of auxiliary tongue image judgment is reduced, and practicality of data basis for auxiliary tongue image judgment is reduced.
Therefore, it is necessary to provide a three-dimensional tongue shape reconstruction system based on PMP phase measurement profilometry, which can reflect at least tongue depth information.
Disclosure of Invention
In order to solve at least one of the above problems and disadvantages of the prior art, the present invention provides a tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry, which can reflect tongue depth information at least partially. The technical scheme is as follows:
According to one aspect of the present invention, there is provided a tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry, the tongue three-dimensional shape reconstruction system comprising:
A light source configured to provide incident light;
The DMD regulation and control unit is configured to perform multiple projections on the lingual surface of the same subject, wherein the multiple projections are formed by sequentially projecting different projection patterns onto the lingual surface of the same subject in a time range according to an interval time;
A lingual light intensity distribution acquisition unit configured to acquire light intensity distribution data of a lingual surface of the same subject in the multiple projections;
A PMP reconstruction unit configured to provide the different projection patterns in a plurality of projections and to three-dimensionally reconstruct a lingual surface of the same subject by phase measurement profilometry based on a plurality of projection patterns and light intensity distribution data corresponding to the plurality of projection patterns to obtain a lingual three-dimensional topography profile of the same subject.
Specifically, the PMP reconstruction unit comprises a projection image generation module which generates a projection pattern of each projection in the plurality of projections based on a phase shift method and sequentially and synchronously transmits all projection patterns used in the plurality of projections to the DMD regulation and control unit,
In the same one of the plurality of projections, the DMD modulating unit projects a projection pattern of the one projection onto a lingual surface of the same subject, and the projection patterns of each projection are different from each other in the plurality of projections.
Specifically, the PMP reconstruction unit includes a tongue three-dimensional topography reconstruction module communicatively connected to at least the imaging unit, and the tongue three-dimensional topography reconstruction module performs three-dimensional reconstruction on the tongue of the same subject by phase measurement profilometry based on a plurality of projection patterns projected in a plurality of projections and light intensity distribution data of the tongue corresponding to the projection patterns, so as to obtain a tongue three-dimensional topography profile of the same subject.
Further, the tongue three-dimensional morphology signal reconstruction module performs tongue three-dimensional morphology signal reconstruction based on the plurality of projection patterns for a plurality of projections and the light intensity distribution data of the tongue corresponding to the projection patterns provided by the projection pattern generation module, so as to obtain the tongue three-dimensional morphology distribution map.
Further, the PMP reconstruction unit further includes a data packet storage module communicatively connected to the projection pattern generation module or the DMD regulation unit and the lingual light intensity distribution acquisition unit, respectively, and the data packet storage module stores different projection patterns used by the projection pattern generation module or the DMD regulation unit in multiple projections and light intensity distribution data provided by the lingual light intensity distribution acquisition unit corresponding to the projection patterns.
Further, the PMP reconstruction unit also comprises a synchronous control module which is respectively connected with the DMD regulation and control unit, the lingual light intensity distribution acquisition unit and the projection pattern generation module in a communication way,
In the same projection of the multiple projections, the synchronous control module synchronously controls the projection pattern generation module to transmit the projection pattern of the projection to the DMD regulation and control unit, the DMD regulation and control unit synchronously converts the projection pattern into a projection pattern expressed by light and projects the projection pattern to the lingual surface of the same subject, and the lingual surface light intensity distribution acquisition unit synchronously acquires light intensity distribution data corresponding to the projection pattern.
Specifically, the DMD regulation and control unit comprises a DMD digital micromirror modulator and a projection unit which are sequentially arranged between the light source and the same subject,
In the same projection, the DMD digital micromirror modulator converts the incident light received by the DMD digital micromirror modulator into a projection pattern expressed by light according to the projection pattern for the same projection provided by the PMP reconstruction unit, the projection unit vertically projects the projection pattern expressed by light to the tongue surface of a subject, and the projection pattern expressed by light projected by the projection unit and the projection pattern for the same projection provided by the PMP reconstruction unit coincide with each other,
In the multiple projections, the projection unit vertically projects different projection patterns expressed by light to the lingual surface of the same subject in sequence according to preset interval time.
Preferably, the projection pattern used each time at least partially covers the lingual surface, and a projection distance between a projection lens of the projection unit and the lingual surface is set to be 15cm to 20cm.
Further, the DMD modulating unit further comprises a collimator, a light collector and a light extinction device, wherein the collimator is arranged between the DMD digital micromirror modulator and the light source, the collimator converts incident light from the light source into parallel light and irradiates the parallel light onto an array reflector of the DMD digital micromirror modulator, the light collector is arranged between the light extinction device and the DMD digital micromirror modulator, and the light collector collects redundant light outside an effective area reflected by the DMD digital micromirror modulator and transmits the redundant light to the light extinction device, and the light extinction device eliminates the redundant light.
Specifically, the parallel light emitted by the collimator is incident into the DMD digital micromirror modulator at an included angle of 20-30 degrees,
The light collector and the collimator are symmetrically arranged on two sides of the DMD digital micromirror modulator respectively.
Specifically, the DMD digital micro-mirror modulator is provided with an array type reflector and a control chip for controlling the array type reflector,
When in use, the control chip adjusts the turning angle of each reflector in the array reflector according to the projection pattern provided by the PMP reconstruction unit so as to lead the projection pattern formed by reflecting the incident light by the array reflector to be consistent with the projection pattern provided by the PMP reconstruction unit,
The resolution of the projection pattern provided by the PMP reconstruction unit corresponds to the rows and columns of the array type reflectors of the DMD digital micromirror modulator one by one.
Specifically, the lingual light intensity distribution acquisition unit comprises an imaging module and an area array detector, wherein the imaging module is used for imaging three-dimensional pattern intensity distribution of the lingual surface of the same subject in each projection to the area array detector, and the area array detector is used for converting the pattern intensity distribution in each projection into light intensity distribution data of the lingual surface corresponding to the pattern intensity distribution.
Preferably, the imaging distance between the imaging module and the tongue surface is set to be 20 cm-30 cm,
The included angle formed between the main optical axis of the imaging module and the tongue surface is set to be 20-30 degrees,
The included angle range between the main optical axis of the imaging module and the main optical axis of the projection unit is set to be 20-30 degrees.
The tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry according to the embodiment of the present invention has at least one of the following advantages:
(1) The tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry provided by the invention can extract and reconstruct tongue three-dimensional features through the cooperation of the DMD digital micromirror modulator, the area array detector, the projection image generation module and the tongue three-dimensional shape reconstruction module, so that a tongue three-dimensional shape distribution map of a subject is obtained;
(2) According to the tongue three-dimensional shape reconstruction system based on the PMP phase measurement profilometry, provided by the invention, through projecting projection patterns (namely multi-frame projection patterns) modulated by different phases for a plurality of times, an area array detector can acquire light intensity distribution data of the tongue of the same subject in each projection, and a PMP reconstruction unit can calculate the height of the tongue of the same subject and reconstruct a tongue three-dimensional shape distribution map of the same subject through the phase measurement profilometry according to different light intensity distribution data and multi-frame projection patterns formed on the tongue of the same subject for a plurality of times;
(3) The tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry provided by the invention can realize automatic extraction of tongue shape features (such as texture depth features and the like);
(4) The tongue three-dimensional morphology distribution map provided by the tongue three-dimensional morphology reconstruction system based on PMP phase measurement profilometry provided by the invention keeps individual differences among subjects, so that the inherent fine differences of tongue pictographic characteristics of each subject can be reflected, and the classification judgment and quantification of clinical traditional Chinese medicine symptoms are facilitated;
(5) The DMD digital micromirror modulator in the tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry has the characteristics of high speed, the highest modulation speed can reach 20KHz, high-speed projection of stripes can be realized, and for tongue fur under non-ideal static conditions, the tongue fur can be considered to be in a relatively static state in the high-speed measurement process, so that the accuracy of a tongue three-dimensional shape distribution map obtained by reconstructing a PMP reconstruction unit is ensured;
(6) According to the tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry, provided by the invention, through synchronous control of the synchronous control module, the DMD digital micromirror modulator, the area array detector and the projection pattern generation module form synchronous operation, so that the projection pattern sending, the projection pattern conversion and the projection pattern acquisition can be synchronously carried out, the obtained tongue light intensity distribution of each projection of the tongue three-dimensional shape reconstruction module in the PMP reconstruction unit is approximately the same as the projection pattern of the time, and the accuracy of the tongue three-dimensional shape distribution map obtained by reconstruction of the PMP reconstruction unit is improved.
Drawings
These and/or other aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the preferred embodiments, taken in conjunction with the accompanying drawings, in which:
FIG. 1 is a schematic diagram of a PMP phase measurement profilometry-based tongue three-dimensional shape reconstruction system according to one embodiment of the present invention;
FIG. 2 is a schematic diagram of the tongue three-dimensional shape reconstruction system shown in FIG. 1;
FIG. 3 is a schematic diagram of a tongue three-dimensional topography profile reconstructed by the PMP reconstruction unit shown in FIG. 1;
FIG. 4 is a schematic diagram of a tongue three-dimensional topography profile reconstructed by the tongue three-dimensional topography reconstruction system shown in FIG. 1 according to experimental conditions of experiment one.
Detailed Description
The technical scheme of the invention is further specifically described below through examples and with reference to the accompanying drawings. In the specification, the same or similar reference numerals denote the same or similar components. The following description of embodiments of the present invention with reference to the accompanying drawings is intended to illustrate the general inventive concept and should not be taken as limiting the invention.
Referring to fig. 1, a PMP phase measurement profilometry-based tongue three-dimensional shape reconstruction system 100 is shown, according to one embodiment of the present invention. The lingual three-dimensional shape reconstruction system 100 comprises a light source 1, a DMD regulation unit 20, a lingual light intensity distribution acquisition unit 30 and a PMP reconstruction unit 40. The DMD modulating unit 20 is disposed between the light source 1 and the subject 7 to convert incident light emitted from the light source 1 into a projection pattern to be projected to the subject 7. The lingual light intensity distribution collection unit 30 is disposed on an optical path formed by the lingual light of the subject 7 reflecting the reflected light of the projection pattern, so as to collect the lingual light of the subject 7 reflecting the reflected light of the projection pattern, obtain a modulated projection pattern formed by depth modulation of the projection pattern at each position of the lingual surface, and obtain light intensity distribution data of the modulated projection pattern on the lingual surface.
In one example, the lingual surface should be understood broadly as the upper surface of the tongue, i.e. the side close to the palate. The tongue surface includes tongue coating. The tongue texture features may reflect the health status and/or the extent of the disease. For example, when a fissure texture feature occurs in the lingual surface, it is reflected that the human body is in an unhealthy state, such as a disease state. Meanwhile, the disease degree of the human body can be judged according to the depth of the crack, for example, the deeper the crack is, the more serious the disease degree is. For example, when the tongue edge has a saw tooth like texture feature or a tooth mark like texture feature, it can also be reflected that the human body is in an unhealthy state, such as a disease state. And judging the disease degree of the human body according to the depth and the density of the texture features. This example is merely an illustrative example and those skilled in the art should not be construed as limiting the invention.
In one example, the tongue appearance should be understood broadly to include both the tongue and tongue coating variations. The tongue body is the muscular choroid tissue of the tongue.
In one example, the light source 10 is configured as a light source of a lingual three-dimensional shape reconstruction system 100 for providing incident light. In one example, the incident light is visible light.
In one example, DMD conditioning unit 20 is configured to project multiple times to the lingual surface of the same subject 7. The multiple projections are to sequentially project different projection patterns onto the tongue surface of the same subject 7 within a time range at intervals.
In one example, during the same projection, a projection pattern is projected once onto the lingual surface of the same subject 7, and the projection pattern projected onto the subject 7 each time is different. In one example, a time range is 15s, 30s, 1min, 2min, etc., and those skilled in the art will understand that this example is only an illustrative example and should not be construed as limiting the invention, and those skilled in the art may choose according to actual needs.
In one example, the time interval may be set to be projected every 2s, or may be set to be projected every 5s, or may be set to be projected every 10s, and it should be understood by those skilled in the art that this example is only an illustrative example, and should not be construed as limiting the present invention, and those skilled in the art may choose according to actual needs.
In one example, the multiple projections may also be projection to the lingual surface of the same subject 7 within a time range according to a preset number of times, and different projection patterns are sequentially projected to the lingual surface of the same subject 7 in the multiple projections. For example, the preset number of times may be 3 times, 4 times, 5 times, etc. It should be understood by those skilled in the art that the present example is only an illustrative example, and should not be construed as limiting the present invention, and those skilled in the art may select according to actual needs.
In one example, the lingual light intensity distribution acquisition unit 30 is configured to acquire light intensity distribution data formed by a projection pattern projected by the same subject 7 after each of a plurality of projections, the projection pattern being remodulated by textures of different depths of the lingual surface.
In one example, the PMP reconstruction unit 40 is configured to provide different projection patterns in a plurality of projections, and to three-dimensionally reconstruct the lingual surface of the same subject 7 by Phase Measurement Profilometry (PMP) based on the plurality of projection patterns and light intensity distribution data corresponding to the plurality of projection patterns to obtain a lingual surface three-dimensional topography profile of the same subject 7.
In one example, the light transmission between the light source 1, the DMD modulating unit 20, the lingual surface of the subject 7 and the lingual surface light intensity distribution collecting unit 30 forms an optical path, thereby enabling the lingual surface light intensity distribution collecting unit 30 to obtain three-dimensional characteristics of the lingual surface expressed by light, and to output light intensity distribution data that can be recognized and calculated by the PMP reconstructing unit 40, thereby preserving subtle differences (e.g., differences in texture depth characteristics) that each subject 7 exhibits in the lingual surface due to individual differences. The PMP reconstruction unit 40 is in communication connection with the lingual light intensity distribution acquisition unit 30, so that the PMP reconstruction unit 40 can reconstruct the lingual surface of the subject 7 according to the received light intensity distribution data of the lingual surface of the same subject 7 after each projection and the projection pattern adopted by each projection in multiple projections to obtain a lingual three-dimensional morphology distribution map.
In one example, at the time of detection, in order to be able to sufficiently acquire the three-dimensional characteristics of the lingual surface of the subject 7, the lingual body of the subject 7 is made to protrude out of the oral cavity as sufficiently as possible until the lingual root can be seen with naked eyes.
In one example, the lingual features include texture features such as points, cracks, teeth marks, etc. on the lingual surface.
In one example, as shown in fig. 2, DMD steering unit 20 includes DMD digital micromirror modulator 3 and projection unit 6. The DMD digital micromirror modulator 3 and the projection unit 6 are sequentially disposed between the light source 1 and the subject 7.
In the same one of the plurality of projections, the DMD digital micromirror modulator 3 converts the incident light received by itself into a two-dimensional projection pattern expressed by light according to the two-dimensional projection pattern for the one projection provided by the PMP reconstruction unit 40. The projection unit 6 vertically projects the projection pattern expressed by light onto the lingual surface of the subject 7, and the two-dimensional projection pattern expressed by light projected by the projection unit 6 and the two-dimensional projection pattern for this projection provided by the PMP reconstruction unit 40 coincide with each other.
For example, the shape and size of the projection pattern projected onto the lingual surface by the projection unit 6 are substantially the same as the shape and size of the projection pattern for the projection provided by the PMP reconstruction unit 40, or the shape and size of the projection pattern formed by the incident light received from the lingual surface and transmitted by the projection unit 6 are substantially the same as the shape and size of the projection pattern for the projection provided by the PMP reconstruction unit 40.
In one example, in a plurality of projections, the projection unit 6 vertically projects different projection patterns expressed by light to the lingual surface of the same subject 7 sequentially at preset intervals.
In one example, the projection pattern may cover the lingual surface completely, i.e. the lingual surface can be covered entirely by the projection pattern, i.e. the size of the projection pattern matches the size (e.g. area and shape) of the lingual surface of each subject, e.g. the size of the projection pattern may be larger than the size of the lingual surface of the subject 7, or may be equal to the lingual surface size of the subject 7. In one example, the size of the projected pattern may be dynamically adjusted, such as by dynamically adjusting the focal length of the projection unit 6. It will of course be appreciated by those skilled in the art that when it is desired to capture the characteristics of the lingual portion of the subject 7, the projected pattern may be configured to be smaller than the lingual dimension, as long as the projected pattern is sized to capture the characteristics of the desired capture portion.
In one example, an array mirror (not shown) and a control chip (not shown) for controlling the array mirror are provided in the DMD digital micromirror modulator 3. The array type reflectors are arranged in an array type by a plurality of reflectors, the number of the reflectors in each row of the array type reflectors is equal to the number of the pixels in the transverse direction of the projection pattern, and the number of the reflectors in each column of the array type reflectors is equal to the number of the pixels in the longitudinal direction of the projection pattern, namely, the resolution of the projection pattern provided by the PMP reconstruction unit 40 corresponds to the rows and columns of the array type reflectors of the DMD digital micromirror modulator 3 one by one. In one example, the dimensions of each mirror in the array mirror may be selected to be 10 μm by 10 μm to 16 μm by 16 μm, which may be selected by one skilled in the art according to actual needs.
For example, when the resolution of the projection pattern is 1024×768, the number of mirrors per line of the array mirror is set to 1024, and each column is set to 768. When the resolution of the projection pattern is 2048×1152, the number of mirrors per line of the array mirror is set to 2048, and each column is set to 1152.
In use, the control chip adjusts the flip angle of each of the mirrors in the array mirror according to the projection pattern provided by the PMP reconstruction unit 40 so that the projection pattern formed by the reflection of the incident light by the array mirror coincides with the projection pattern provided by the PMP reconstruction unit 40.
That is, in a plurality of projections, each time the projection is performed, the PMP reconstruction unit 40 provides the projection pattern used for the projection to the control chip of the DMD digital micromirror modulator 3, and the control chip controls the flip angle of each mirror in the array mirror according to the received projection pattern, so that the projection pattern formed by the light output by the DMD digital micromirror modulator 3 substantially matches or even completely matches the projection pattern provided by the PMP reconstruction unit 40.
In one example, the array mirrors of the DMD digital micromirror modulator 3 include an array incident light mirror and an array reflective light mirror. That is, the mirror array of the DMD digital micromirror modulator 3 receiving the incident light and the mirror array outputting the reflected light are different arrays, and the array-type incident light mirror modulates the received incident light in accordance with the projection pattern and then reflects it to the array-type reflected light mirror, which reflects it to output.
In one example, the array mirror of the DMD digital micromirror modulator 3 may be a group, that is, the array that receives the incident light and outputs the reflected light is the same, and the array mirror thereof may switch between receiving and outputting (e.g., transmit the received incident light and output the reflected light modulated by the flip angle of the mirror in an alternating manner). In one example, the angular range of the flip angle of the array mirror is set to 10 ° to 14 °, and preferably the flip angle of the array mirror is 12 °.
For example, the control chip is used for switching on and off the light of each reflector respectively, and electronically addressing each reflector by binary signals to control two states of each lens: light reflected in a section with the mirror normal flipped 12 ° clockwise can be received, this state being 1 corresponding to "on"; light reflected by a section with the normal of the reflector turned 12 degrees anticlockwise cannot be received, and the state is 1 and 0, corresponding to off "
In one example, DMD steering unit 20 further includes collimator 2, light collector 4, and matting device 5. The collimator 2 is disposed between the DMD digital micromirror modulator 3 and the light source 1 and on the optical paths of the DMD digital micromirror modulator 3 and the light source 1, the collimator 2 converts the incident light from the light source 1 into parallel light and irradiates the parallel light onto the array mirror of the DMD digital micromirror modulator 3, and the light collector 4 is disposed between the extinction device 5 and the DMD digital micromirror modulator 3.
In one example, the parallel light emitted by the collimator 2 is incident into the DMD digital micromirror modulator 3 at an included angle of 20 ° to 30 °. Preferably, the parallel light emitted by the collimator 2 is incident into the DMD digital micromirror modulator 3 at an included angle of 24 °.
In one example, the light collectors 4 and the collimators 2 are symmetrically arranged on both sides of the DMD digital micromirror modulator 3, respectively. For example, the light collector 4 is at 24 ° to the DMD digital micromirror modulator 3, with a distance of 10cm between them; likewise, the collimator 2 is at 24 ° to the DMD digital micromirror modulator 3 and at a distance of 10cm. This example is merely an illustrative example and those skilled in the art should not be construed as limiting the invention.
In one example, when the DMD digital micromirror modulator 3 receives the projection pattern, the collimator 2 simultaneously irradiates parallel light to the array mirror, and then the array mirror modulates the incident parallel light according to the received projection pattern to form a projection pattern expressed by light. That is, the DMD digital micromirror modulator 3 modulates the incident parallel light to a projection pattern expressed by light in conformity with the projection pattern transmitted by the PMP reconstruction unit 40 through the communication signal.
In one example, the light collector 4 collects and transmits the redundant light outside the effective area reflected by the DMD digital micromirror modulator 3 to the matting device 5, and the matting device 5 eliminates the redundant light (e.g., the clutter light generated by the DMD digital micromirror modulator).
In one example, the DMD digital micromirror modulator 3 modulates the parallel light from the collimator 2, and forms a first reflected light that is output to the projection module in a direction perpendicular to the output surface of the DMD digital micromirror modulator 3, and a second reflected light that is output in a direction at an angle of, for example, 24 ° to the output surface of the DMD digital micromirror modulator 3, the direction being symmetrical to the direction of the parallel light incident to the DMD digital micromirror modulator 3. The light collector 4 collects and transmits the second reflected light to the extinction device 5, thereby avoiding the second reflected light being stray light within the system 100, which may interfere with the system.
In one example, the redundant light outside the effective area is the second reflected light, and outside the effective area is an area where the second reflected light is formed in the space between the DMD digital micromirror modulator 3 to the light collector 4.
In one example, the light collector 4 may be any one of a lens, a light collector, a light collection system. When the light collector 4 is a light collecting system or a light collecting system, the collecting area and the collecting area can be calibrated, and the calibrated collecting area and the collecting area are areas outside the effective area reflected by the DMD digital micromirror modulator 3. In one example, the matting device 5 may be a matting tube, or may be an optical attenuator.
In one example, the projection unit is a video camera, a projector, or a projection lens, and those skilled in the art can design the projection unit according to actual needs. The projection distance between the projection lens of the projection unit 6 and the lingual surface of the subject 7 is set to be 15cm to 20cm. . It is thereby ensured that the projection pattern of the projection unit 6 onto the lingual surface of the subject 7 is affected as little as possible by the various light in the environment (i.e. the redundant light), and further that the accuracy of the projection pattern of the lingual surface of the subject 7 is ensured, and further that the accuracy of the pattern intensity distribution of the lingual surface acquired by subsequent imaging is improved.
In one example, due to the tongue surface roughness of the subject 7, a two-dimensional projection pattern formed by light projected onto the tongue surface of the subject 7 is converted into a pattern intensity distribution with tongue surface three-dimensional feature information. Moreover, since the reflection, refraction, diffuse reflection, etc. of the light are different at each position of the tongue surface, the intensity of the light at the tongue surface will be changed to different extents, that is, the obtained pattern intensity distribution with the three-dimensional characteristic information of the tongue surface will not be uniform, but will be different at each position according to the condition of the tongue surface of the subject 7 (for example, the depth of the texture feature is different). Meanwhile, the difference of each subject due to individual difference is reserved, so that the accuracy of the reconstructed tongue three-dimensional morphology distribution map is improved, and the accuracy of tongue image judgment is improved when the tongue three-dimensional morphology distribution map is used as tongue image judgment auxiliary data.
In one example, subject 7 is head-mounted by a head-mounted module (not shown) to minimize movement, sloshing (including slight sloshing) of the head of subject 7 during the detection process, thereby ensuring that the subject is in a relatively stationary state, i.e., a non-ideal stationary state.
In one example, as shown in fig. 2, the lingual light intensity distribution acquisition unit 30 includes an imaging module 8 and an area array detector 9. The imaging module 8 is arranged between the area array detector 9 and the subject 7. The imaging module 8 is configured to image a pattern intensity distribution of a projection pattern of a lingual surface of the subject 7 onto the area detector 9, and the area detector 9 converts the pattern intensity distribution into a light intensity distribution of the lingual surface. That is, in the multiple projection process, the imaging module 8 acquires the pattern intensity distribution formed on the lingual surface of the same subject 7 each time, and then sequentially transmits to the area array detector 9, and the area array detector 9 sequentially converts the pattern intensity distribution into the light intensity distribution corresponding to the pattern intensity distribution.
In one example, the reflected light from the lingual surface collected by the imaging module 8 is light of different intensities formed by reflecting the projection pattern at different locations of the lingual surface at the same time. Different positions of the tongue face reflect light of different intensities of the projected pattern at the same time, forming the pattern intensity distribution.
In one example, the imaging module 8 transmits the collected reflected light of the lingual surface to the area array detector 9, after which the area array detector 9 converts the pattern intensity distribution expressed by the light into light intensity distribution data of the lingual surface that can be recognized and calculated by the PMP reconstruction unit 40.
In one example, the imaging module 8 may be a structured light camera, a light imager, etc., which is only an illustrative example, and those skilled in the art should not be construed as limiting the invention, and those skilled in the art may select any component, instrument, device, etc. that may perform the imaging function as actually needed to be substituted.
In one example, the imaging distance between the imaging lens of the imaging module 8 and the lingual surface of the subject 7 may be set in a range of 20cm to 30cm, preferably 25cm. Because the imaging lens of the imaging module 8 is closer to the lingual surface of the subject 7, light and natural light reflected by other objects in the environment collected by the imaging lens are reduced, the light transmitted to the area array detector 9 is ensured to be reflected by the lingual surface of the subject 7, and meanwhile, the imaging module 8 can be ensured to clearly image.
In one example, imaging module 8 may be an optical imaging system or may be a binocular structured light camera. The baseline distance may be set to 10cm. The angle formed between the main optical axis of the imaging module 8 and the lingual surface of the subject 7 may be set in the range of 20 deg. to 30 deg., preferably 24 deg.. The angle between the main optical axis of the imaging module 8 and the main optical axis of the projection unit 6 is set to be 20 deg. to 30 deg., preferably 24 deg..
It will be appreciated by those skilled in the art that the imaging distance between the imaging module 8 and the lingual surface, the baseline distance of the imaging module, and the angle of the included angle between the main optical axis and the lingual surface can all be adjusted according to actual needs. For example, at least one of the imaging distance, the baseline distance, and the included angle described above may be adjusted according to the selection of the type of imaging module, the product, etc. at the time. Of course, those skilled in the art can also adjust and adjust at least one of the imaging distance, the baseline distance and the included angle according to the real-time change of the light intensity of the ambient light or the intensity of the light of the environment. This example is merely an illustrative example and those skilled in the art should not be construed as limiting the invention.
In one example, to avoid receiving light projected from projection module 6, the effective area projected by projection module 6 will be calibrated before using lingual three-dimensional shape reconstruction system 100 so that imaging module 8 can extract only the effective area.
In one example, to reduce light (e.g., natural light, lights, etc.) reflected by imaging module 8 from the rest of subject 7 and other items within the environment, etc., the effective area captured by the imaging lens of imaging module 8 may be determined as the lingual surface of the exposed lingual body of subject 7.
In one example, due to the different size of the tongue exposed by each subject 7, parameters such as the focal length of the imaging module 8 may be dynamically adjusted to ensure that the effective area collected by the imaging lens is as much as possible only the lingual surface of each individual subject, and no light reflected by other areas is collected.
In one example, the area array detector 9 is used to record the pattern intensity distribution transmitted via the imaging module 8. In one example, after each output of the projection pattern by the DMD digital micromirror modulator 3, the area array detector 9 synchronously acquires an imaging image (i.e., three-dimensional pattern intensity distribution) from the imaging module 8, and then converts the three-dimensional pattern intensity distribution expressed by light into a light intensity distribution of the lingual surface, thereby converting light of different intensities reflected by the lingual surface into data (i.e., light intensity distribution data of the lingual surface) that can be recognized and calculated by the PMP reconstruction unit 40. In one example, the area array detector 9 is cleared after each output of the light intensity distribution data to avoid the data of the adjacent two times from being confused with each other or from being affected by the last data.
In one example, as shown in fig. 1-3, the PMP reconstruction unit 40 includes a projection image generation module 12. The projection pattern generation module 12 is respectively in communication connection with the DMD digital micromirror modulator 3 in the DMD regulation unit 20 and the area array detector 9 in the lingual light intensity distribution acquisition unit 30.
In one example, the projection image generation module 12 generates a projection pattern of each of the plurality of projections based on a phase shift method, and sequentially and synchronously transmits all the projection patterns used in the plurality of projections to the DMD regulation unit 20. In the same one of the plurality of projections, the DMD modulating unit 20 projects the projection pattern of the same projection onto the lingual surface of the same subject, and the projection patterns of each projection are different from each other in the plurality of projections.
In one example, the phase shift method is one of a three-step phase shift method, a four-step phase shift method, a double three-step phase shift method, and a five-step phase shift method. Preferably, the phase shift method is a four-step phase shift method, and the total phase shift amount is set to 2π. The projection image generation module 12 supplies four projection patterns (i.e., four frame projection patterns) to the DMD modulating unit 20, and the amount of phase shift between adjacent two projection patterns is 2 pi/4. That is, the phase shift amount between two adjacent projection patterns isWherein/>Represents the total phase shift amount, and n represents the total number of projection patterns.
In one example, the projection image generation module 12 also sequentially performs normalization and discretization processing on the projection pattern obtained according to the phase shift method, and the discrete intervals are prestored in the projection image generation module 12. The discrete interval is set to 1/255, so that the gradation value of the discretized projection pattern can be expressed to have 256 gradations, thereby obtaining the projection pattern transmitted to the digital micromirror array 3. For example, a sinusoidal fringe projection pattern. It will be appreciated by those skilled in the art that the projection pattern may also be a uniformly laid dot pattern, checkerboard pattern, etc., as long as 256 grayscales having a uniform distribution can be satisfied.
For example, the projection pattern generation module 12 adopts a four-step phase shift method, so that the total phase shift of four frames of projection patterns in one grating period is 2 pi, the projected projection patterns are shifted once every 1/4 of the grating period, the phases of the projection patterns are correspondingly shifted by 2 pi/4, and four frames of projection patterns with different phases are generated. Each time the projection pattern generation module 12 generates a frame of projection pattern, the frame of projection pattern is synchronously transmitted to the DMD digital micromirror modulator 3 of the DMD regulating unit 20, the DMD digital micromirror modulator 3 synchronously adjusts the array mirror according to the received frame of projection pattern, the collimator 2 synchronously converts the incident light emitted by the light source into parallel light to irradiate the array mirror, the array mirror synchronously modulates the incident parallel light according to the frame of projection pattern to form a projection pattern expressed by light consistent with the received projection pattern, and synchronously transmits the projection pattern to the projection unit 6, the projection unit 6 projects the frame of projection pattern onto the lingual surface of the subject 7, and the projection pattern expressed by light of the frame of the subject 7 is modulated again due to different textures (such as height, direction and/or density) of each position of the lingual surface of the subject 7, so that the projection pattern modulated by the lingual surface carries depth information of the lingual surface.
The imaging module 8 synchronously acquires the projection pattern (i.e. the pattern intensity distribution) of the frame modulated by the tongue surface on the tongue surface, and synchronously transmits the projection pattern to the area array detector 9, and the area array detector 9 synchronously converts the projection pattern expressed by light into first light intensity distribution data which can be read and identified by the PMP reconstruction module 40. Thus, a synchronous transmission light path of the frame projection pattern is formed by the light source 1, the DMD modulating unit 20, the lingual surface of the subject 7, and the lingual surface light intensity distribution collecting unit 30. And so on, the second light intensity distribution data of the second frame projection pattern on the lingual surface of the same subject 7, the third light intensity distribution data of the third frame projection pattern on the lingual surface of the same subject 7, and the fourth light intensity distribution data of the fourth frame projection pattern on the lingual surface of the same subject 7 are obtained. That is, in the four projection processes, corresponding light intensity distribution data in which four frames of projection patterns are modulated by the lingual surface of the same subject 7 are obtained in total.
In one example, the PMP reconstruction unit includes a lingual three-dimensional topography reconstruction module 13 communicatively coupled to at least the imaging unit 8. In one example, the lingual three-dimensional topography reconstruction module 13 is communicatively connected to the area array detector 9 in the lingual light intensity distribution acquisition unit 30 to receive the lingual light intensity distribution data corresponding to each frame of projection pattern.
The tongue three-dimensional topography reconstruction module 13 performs three-dimensional reconstruction on the tongue of the same subject using Phase Measurement Profilometry (PMP) based on a plurality of projection patterns projected in a plurality of projections (for example, four-frame projection patterns mentioned in the above description) and light intensity distribution data of the tongue corresponding to the projection patterns, to obtain a tongue three-dimensional topography profile of the same subject (as shown in fig. 3). The light intensity distribution data of the lingual surface corresponding to the projection pattern is the light intensity distribution data corresponding to each frame of the projection pattern and obtained by conversion of the area array detector. For example, the first light intensity distribution data, the second light intensity distribution data, the third light intensity distribution data, the fourth light intensity distribution data mentioned in the above description.
In one example, during three-dimensional reconstruction of the tongue surface of the same subject by Phase Measurement Profilometry (PMP), the relative heights of the individual points of the tongue surface in space with respect to a reference plane, i.e. tongue surface heights, can also be obtained. The tongue height is also understood as the average height of the point cloud of the tongue relative to the reference plane. The reference plane is obtained by system calibration during the construction of the tongue three-dimensional shape reconstruction system 100, and the height of the reference plane is set to 0.
In one example, the tongue three-dimensional shape reconstruction module 13 adopts phase measurement profilometry to the plurality of projection patterns and tongue light intensity distribution data corresponding to the projection patterns according to the plurality of projection patterns projected in the plurality of projections, and the tongue three-dimensional shape reconstruction module comprises the steps of sequentially carrying out phase wrapping, unwrapping the obtained phases to obtain the relative heights of all points of the tongue relative to a reference plane in a three-dimensional space and reconstructing a tongue three-dimensional shape distribution map according to the relative heights of all points on the tongue.
In one example, the tongue three-dimensional topography reconstruction module 13 may also be communicatively coupled to the projection pattern generation module 11. Upon reconstruction, the tongue three-dimensional topography reconstruction module 13 may obtain all projection patterns within one grating period (i.e. in multiple projections) from the projection pattern generation module 11. For example, the projection pattern generation module 11 generates the four-frame projection pattern mentioned in the above description.
In one example, the tongue three-dimensional topography reconstruction module 13 may also be communicatively connected to the DMD digital micromirror modulator 3 in the DMD regulation unit 20. During reconstruction, the tongue three-dimensional shape reconstruction module 13 can obtain all projection patterns in one grating period (i.e. in multiple projections) through the control chip of the DMD digital micromirror modulator 3. For example, the projection pattern generation module 11 generates the four-frame projection pattern mentioned in the above description.
In one example, the PMP reconstruction unit 40 further includes a data packet storage module 12 communicatively coupled to the projection pattern generation module 10 or the DMD regulation unit 20 and the lingual light intensity distribution acquisition unit 30, respectively. The data packet storage module 12 stores different projection patterns used in the multiple projections by the projection pattern generation module 10 or the DMD regulation unit 20 and light intensity distribution data provided by the lingual light intensity distribution acquisition unit corresponding to the projection patterns.
In one example, the PMP reconstruction unit 40 further includes a packet storage module 13. The data packet storage module 13 is respectively in communication connection with the DMD regulation unit 20 and the lingual light intensity distribution acquisition unit 30, so as to store the projection pattern of the DMD regulation unit and the light intensity distribution of the lingual light intensity distribution acquisition unit.
In one example, the data packet storage module 13 is communicatively connected to the DMD digital micromirror modulator 3 and the area array detector 9, respectively, in use, the DMD digital micromirror modulator 3 transmits each frame of projection pattern into the projection module 6 and the data packet storage module 13, respectively, and the area array detector 9 transmits the light intensity distribution data (e.g., the first light intensity distribution data to the fourth light intensity distribution data mentioned in the above description) of the tongue surface corresponding to each frame of projection pattern to the data packet storage module 13.
In one example, the area array detector 9 converts light intensity distribution data corresponding to each frame of projection pattern of the lingual surface of the same subject 7, for example, the first light intensity distribution data to the fourth light intensity distribution data mentioned in the above description) into an image to be output to the packet memory 13.
In one example, the PMP reconstruction unit 40 further includes a synchronization control module 11. The synchronous control module 11 is respectively in communication connection with the DMD regulation unit 20, the lingual light intensity distribution acquisition unit 30 and the projection pattern generation module 10, so that synchronous transmission light paths are formed at the lingual surface of the light source 1, the DMD regulation unit 20, the subject 7 and the lingual light intensity distribution acquisition unit 30 during each projection.
Experiment one:
The experimental conditions were set as: the light source 1 was an LED lamp with a peak value of 455nm, the imaging distance between the imaging module 8 and the lingual surface of the subject 7 was 20cm, the exposure time of the imaging module 7 was set to 700 μs, the array mirror scale of the DMD digital micromirror modulator 3 was 1280×720, and the size of each mirror was 5.4 μm.
The tongue three-dimensional shape reconstruction system 100 provided by the invention is used for respectively detecting two tool pieces (all parameters of the two tool pieces are identical) for simulating the tongue of a subject for 1 time under the same experimental condition, wherein the average height of the first tool piece relative to a reference plane is 1.01mm, the average height of the second tool piece relative to the reference plane is 1.04mm, and the height error is 0.03mm.
Then, the same tongue three-dimensional shape reconstruction system 100 was used to detect the tongue height of the same subject 10 times under the same experimental conditions, and the average height of each tongue (i.e. the tongue height in table one) with respect to the same reference plane was obtained, as shown in table one.
Meter for measuring tongue height of same subject
Measurement sequence number | Tongue height (mm) |
1 | 0.032745 |
2 | 0.03186 |
3 | 0.033386 |
4 | 0.030792 |
5 | 0.031586 |
6 | 0.031403 |
7 | 0.033325 |
8 | 0.031952 |
9 | 0.029877 |
10 | 0.032745 |
The data in the table are averaged to be 0.0319mm and the standard deviation is 0.0012mm. It can be seen that the tongue three-dimensional shape reconstruction system 100 provided by the present invention has a high resolution of 30 μm. As shown in fig. 4, a three-dimensional topography profile of the lingual surface of the subject reconstructed from the first measurement results is shown.
The tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry according to the embodiment of the present invention has at least one of the following advantages:
(1) The tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry provided by the invention can extract and reconstruct tongue three-dimensional features through the cooperation of the DMD digital micromirror modulator, the area array detector, the projection image generation module and the tongue three-dimensional shape reconstruction module, so that a tongue three-dimensional shape distribution map of a subject is obtained;
(2) According to the tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry, provided by the invention, through projecting projection patterns (namely multi-frame projection patterns) modulated by different phases for a plurality of times, an area array detector can acquire light intensity distribution data of the tongue of the same subject in each projection, and a PMP reconstruction unit can calculate the height (namely tongue height information) of the tongue of the same subject and reconstruct a tongue three-dimensional shape distribution map of the same subject through phase measurement profilometry according to different light intensity distribution data and multi-frame projection patterns formed on the tongue of the same subject for a plurality of times;
(3) The tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry can realize automatic extraction of tongue shape features;
(4) The tongue three-dimensional morphology distribution map provided by the tongue three-dimensional morphology reconstruction system based on PMP phase measurement profilometry provided by the invention keeps individual differences among subjects, so that the inherent fine differences of tongue pictographic characteristics of each subject can be reflected, and the classification and quantification judgment of clinical traditional Chinese medicine symptoms are facilitated;
(5) The DMD digital micromirror modulator in the tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry has the characteristics of high speed, the highest modulation speed can reach 20KHz, high-speed projection of stripes can be realized, and for tongue fur under non-ideal static conditions, the tongue fur can be considered to be in a relatively static state in the high-speed measurement process, so that the accuracy of a tongue three-dimensional shape distribution map obtained by reconstructing a PMP reconstruction unit is ensured;
(6) According to the tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry, provided by the invention, through synchronous control of the synchronous control module, the DMD digital micromirror modulator, the area array detector and the projection pattern generation module form synchronous operation, so that the projection pattern sending, the projection pattern conversion and the projection pattern acquisition can be synchronously carried out, the obtained tongue light intensity distribution of each projection of the tongue three-dimensional shape reconstruction module in the PMP reconstruction unit is approximately the same as the projection pattern of the time, and the accuracy of the tongue three-dimensional shape distribution map obtained by reconstruction of the PMP reconstruction unit is improved.
Although a few embodiments of the present general inventive concept have been shown and described, it would be appreciated by those skilled in the art that changes may be made in these embodiments without departing from the principles and spirit of the general inventive concept, the scope of which is defined in the claims and their equivalents.
Claims (13)
1. A tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry is characterized in that,
The tongue three-dimensional shape reconstruction system comprises:
A light source configured to provide incident light;
The DMD regulation and control unit is configured to perform multiple projections on the lingual surface of the same subject, wherein the multiple projections are formed by sequentially projecting different projection patterns onto the lingual surface of the same subject in a time range according to an interval time;
A lingual light intensity distribution acquisition unit configured to acquire light intensity distribution data of a lingual surface of the same subject in the multiple projections;
A PMP reconstruction unit configured to provide the different projection patterns in a plurality of projections and to three-dimensionally reconstruct a lingual surface of the same subject by phase measurement profilometry based on a plurality of projection patterns and light intensity distribution data corresponding to the plurality of projection patterns to obtain a lingual three-dimensional topography profile of the same subject.
2. The tongue three-dimensional shape reconstruction system according to claim 1, wherein,
The PMP reconstruction unit comprises a projection image generation module which generates a projection pattern of each projection in the plurality of projections based on a phase shift method and sequentially and synchronously transmits all projection patterns used in the plurality of projections to the DMD regulation and control unit,
In the same one of the plurality of projections, the DMD modulating unit projects a projection pattern of the one projection onto a lingual surface of the same subject, and the projection patterns of each projection are different from each other in the plurality of projections.
3. The tongue three-dimensional shape reconstruction system according to claim 2, wherein,
The PMP reconstruction unit comprises a tongue three-dimensional morphology reconstruction module which is at least in communication connection with the imaging unit, and the tongue three-dimensional morphology reconstruction module performs three-dimensional reconstruction on the tongue of the same subject through phase measurement profilometry based on a plurality of projection patterns projected in a plurality of projections and the light intensity distribution data of the tongue corresponding to the projection patterns so as to obtain a tongue three-dimensional morphology distribution map of the same subject.
4. The tongue three-dimensional shape reconstruction system according to claim 3, wherein,
The tongue three-dimensional morphology reconstruction module performs tongue three-dimensional morphology signal reconstruction based on the plurality of projection patterns for multiple projections and the tongue light intensity distribution data corresponding to the projection patterns provided by the projection pattern generation module so as to obtain the tongue three-dimensional morphology distribution map.
5. The tongue three-dimensional shape reconstruction system according to any one of claims 2-4, wherein,
The PMP reconstruction unit further comprises a data packet storage module which is respectively in communication connection with the projection pattern generation module or the DMD regulation and control unit and the lingual light intensity distribution acquisition unit, wherein the data packet storage module stores different projection patterns used by the projection pattern generation module or the DMD regulation and control unit in multiple projections and light intensity distribution data corresponding to the projection patterns and provided by the lingual light intensity distribution acquisition unit.
6. The tongue three-dimensional shape reconstruction system according to any one of claims 2-4, wherein,
The PMP reconstruction unit further comprises a synchronous control module which is respectively in communication connection with the DMD regulation and control unit, the lingual light intensity distribution acquisition unit and the projection pattern generation module,
In the same projection of the multiple projections, the synchronous control module synchronously controls the projection pattern generation module to transmit the projection pattern of the projection to the DMD regulation and control unit, the DMD regulation and control unit synchronously converts the projection pattern into a projection pattern expressed by light and projects the projection pattern to the lingual surface of the same subject, and the lingual surface light intensity distribution acquisition unit synchronously acquires light intensity distribution data corresponding to the projection pattern.
7. The tongue three-dimensional shape reconstruction system according to any one of claims 2-4, wherein,
The DMD regulation and control unit comprises a DMD digital micromirror modulator and a projection unit which are sequentially arranged between the light source and the same subject,
In the same projection, the DMD digital micromirror modulator converts the incident light received by the DMD digital micromirror modulator into a projection pattern expressed by light according to the projection pattern for the same projection provided by the PMP reconstruction unit, the projection unit vertically projects the projection pattern expressed by light to the tongue surface of a subject, and the projection pattern expressed by light projected by the projection unit and the projection pattern for the same projection provided by the PMP reconstruction unit coincide with each other,
In the multiple projections, the projection unit vertically projects different projection patterns expressed by light to the lingual surface of the same subject in sequence according to preset interval time.
8. The tongue three-dimensional shape reconstruction system according to claim 7, wherein,
The projection pattern used each time at least partially covers the lingual surface, and the projection distance between the projection lens of the projection unit and the lingual surface is set to be 15 cm-20 cm.
9. The tongue three-dimensional shape reconstruction system according to claim 7, wherein,
The DMD regulation and control unit further comprises a collimator, a light collector and a light extinction device, wherein the collimator is arranged between the DMD digital micro-mirror modulator and the light source, the collimator converts incident light from the light source into parallel light and irradiates the parallel light onto an array type reflector of the DMD digital micro-mirror modulator, the light collector is arranged between the light extinction device and the DMD digital micro-mirror modulator, and the light collector collects redundant light outside an effective area reflected by the DMD digital micro-mirror modulator and transmits the redundant light to the light extinction device, and the light extinction device eliminates the redundant light.
10. The tongue three-dimensional shape reconstruction system according to claim 7, wherein,
The parallel light emitted by the collimator is incident into the DMD digital micromirror modulator at an included angle of 20-30 degrees,
The light collector and the collimator are symmetrically arranged on two sides of the DMD digital micromirror modulator respectively.
11. The tongue three-dimensional shape reconstruction system according to claim 7, wherein,
An array type reflector and a control chip for controlling the array type reflector are arranged in the DMD digital micro-mirror modulator,
When in use, the control chip adjusts the turning angle of each reflector in the array reflector according to the projection pattern provided by the PMP reconstruction unit so as to lead the projection pattern formed by reflecting the incident light by the array reflector to be consistent with the projection pattern provided by the PMP reconstruction unit,
The resolution of the projection pattern provided by the PMP reconstruction unit corresponds to the rows and columns of the array type reflectors of the DMD digital micromirror modulator one by one.
12. The tongue three-dimensional shape reconstruction system according to claim 7, wherein,
The lingual light intensity distribution acquisition unit comprises an imaging module and an area array detector, wherein the imaging module is used for imaging three-dimensional pattern intensity distribution of the lingual surface of the same subject in each projection to the area array detector, and the area array detector is used for converting the pattern intensity distribution in each projection into light intensity distribution data of the lingual surface corresponding to the pattern intensity distribution.
13. The tongue three-dimensional shape reconstruction system according to claim 11, wherein,
The imaging distance between the imaging module and the tongue surface is set to be 20 cm-30 cm,
The included angle formed between the main optical axis of the imaging module and the tongue surface is set to be 20-30 degrees,
The included angle range between the main optical axis of the imaging module and the main optical axis of the projection unit is set to be 20-30 degrees.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410283762.0A CN118175278A (en) | 2024-03-13 | 2024-03-13 | Tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410283762.0A CN118175278A (en) | 2024-03-13 | 2024-03-13 | Tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry |
Publications (1)
Publication Number | Publication Date |
---|---|
CN118175278A true CN118175278A (en) | 2024-06-11 |
Family
ID=91348202
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410283762.0A Pending CN118175278A (en) | 2024-03-13 | 2024-03-13 | Tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN118175278A (en) |
-
2024
- 2024-03-13 CN CN202410283762.0A patent/CN118175278A/en active Pending
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20230285124A1 (en) | Intraoral scanner | |
US10716647B2 (en) | Methods and systems for generating color images | |
US20240156577A1 (en) | Dental scanning system with structured light projection | |
US4859181A (en) | Method and apparatus for measuring relative jaw movement | |
US9539070B2 (en) | Method and device for carrying out optical pickup | |
JPH06503723A (en) | Method for measuring intraoral space and device for carrying out this method | |
JP2599876B2 (en) | Device for determining the surface condition of a curved surface | |
US7259871B2 (en) | Apparatus and method for rapid and precise scanning of three-dimensional occlusal profile of dental cast | |
US5424836A (en) | Apparatus for contact-free optical measurement of a three-dimensional object | |
EP2654607B1 (en) | Optical system in 3d focus scanner | |
AU2004223469B2 (en) | Laser digitizer system for dental applications | |
US20130236850A1 (en) | Intra-oral scanner for digital impression and real-time reconstruction system for inner surface topographic image of oral cavity | |
CN103220964B (en) | Dental x-ray device with imaging unit for surface imaging, and method for generating an x-ay of a patient | |
KR101283635B1 (en) | Scanning system and method for oral cavity | |
CN118175278A (en) | Tongue three-dimensional shape reconstruction system based on PMP phase measurement profilometry | |
CN211485040U (en) | Intraoral three-dimensional scanner | |
CA2284299A1 (en) | Method and apparatus for a high resolution eye scanner | |
CN118097021A (en) | Tongue pictographic three-dimensional structure reconstruction method | |
Kagawa et al. | A compact shape-measurement module based on a thin compound-eye camera with multiwavelength diffractive pattern projection for intraoral diagnosis | |
JPH01218445A (en) | Method for three-dimensional determination of relative motion of upper and lower jaws and measuring apparatus for executing the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |