CN111553941A - Method and device for synthesizing panoramic view of oral cavity of user and electronic equipment - Google Patents
Method and device for synthesizing panoramic view of oral cavity of user and electronic equipment Download PDFInfo
- Publication number
- CN111553941A CN111553941A CN202010366223.5A CN202010366223A CN111553941A CN 111553941 A CN111553941 A CN 111553941A CN 202010366223 A CN202010366223 A CN 202010366223A CN 111553941 A CN111553941 A CN 111553941A
- Authority
- CN
- China
- Prior art keywords
- image
- virtual
- dental arch
- panoramic view
- arch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/08—Indexing scheme for image data processing or generation, in general involving all processing steps from image acquisition to 3D model generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10081—Computed x-ray tomography [CT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10088—Magnetic resonance imaging [MRI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30036—Dental; Teeth
Abstract
The invention discloses a method and a device for synthesizing a panoramic view of an oral cavity of a user and electronic equipment. Wherein, the method comprises the following steps: acquiring a target sequence image of the head of a target user, wherein the image type of the target sequence image is Magnetic Resonance Imaging (MRI); synthesizing a virtual CT image through the target sequence image; and synthesizing the oral cavity panoramic view of the target user based on the target sequence image and the virtual CT image. The invention solves the technical problem of high radiance when the oral panoramic view is obtained in the related technology.
Description
Technical Field
The invention relates to the technical field of head shadow analysis, in particular to a method and a device for synthesizing a panoramic view of an oral cavity of a user and electronic equipment.
Background
In the related art, in the aspect of clinical images, when the oral cavity tooth state of a user is detected, an oral cavity panoramic view is often required to be acquired, but in the prior art, the oral cavity panoramic view is acquired based on X-rays or CBCT (Cone beam computed tomography, abbreviated as virtual CT), and when the oral cavity panoramic view is acquired through X-rays, the problem of high radiance is caused; the CBCT is used for obtaining the panoramic view of the oral cavity, so that the radiation rate is high and the information of the soft tissues of the oral cavity cannot be obtained, and the panoramic view of the oral cavity state of the user has one-sidedness.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the invention provides a method and a device for synthesizing a panoramic view of an oral cavity of a user and electronic equipment, which are used for at least solving the technical problem of high radiance when the panoramic view of the oral cavity is obtained in the related technology.
According to an aspect of an embodiment of the present invention, there is provided a method for synthesizing a panoramic view of an oral cavity of a user, including: acquiring a target sequence image of the head of a target user, wherein the image type of the target sequence image is Magnetic Resonance Image (MRI); synthesizing a virtual CT image through the target sequence image; synthesizing an oral panoramic view of the target user based on the target sequence images and the virtual CT images.
Optionally, the step of obtaining a target sequence of images of the head of the target user comprises: outputting supine guidance information, wherein the supine guidance information is used for prompting a supine body posture of a target user during scanning; after detecting that the supine posture of the target user meets a preset supine condition, analyzing whether the mouth opening and closing state of the target user meets a preset opening and closing state or not; and under the condition that the oral cavity opening and closing state of the target user is determined to meet the preset opening and closing state, scanning the head of the target user by adopting a gradient echo sequence to obtain the target sequence image.
Optionally, the step of synthesizing the panoramic view of the oral cavity of the target user comprises: calculating a correction deviation angle based on the target sequence image and the virtual CT image, and performing rotation correction on virtual CT three-dimensional data based on the correction deviation angle; calculating maximum density projection of the corrected virtual CT three-dimensional data along a vertical axis, and segmenting a dental arch region in the virtual CT three-dimensional data; creating an arch wire based on the arch region and an arch image; discretizing the dental arch wire, and expanding the discretized dental arch wire along a vertical axis to synthesize the oral panoramic view.
Optionally, the step of calculating a correction deviation angle and performing rotation correction on the virtual CT three-dimensional data based on the correction deviation angle includes: calculating a maximum density projection of the virtual CT three-dimensional data along the coronal axis to determine a projected CT image; denoising the projection CT image, and increasing the gap at the occlusion part of the maxilla and the mandible in the projection CT image; performing bottom-hat transformation processing on the projection CT image with the increased gap, and performing binarization processing on the projection CT image after the transformation processing to obtain a binarization CT image; and determining a plurality of coordinate points in the binary CT image, and performing line fitting by using a least square method to determine a straight line inclination angle by using the fitted image straight line, wherein the inclination angle corresponding to the straight line inclination angle is the correction deviation angle.
Optionally, the step of segmenting the arch region in the virtual CT three-dimensional data comprises: removing other bone data of non-dental arch and non-alveolar bone from the virtual CT three-dimensional data; and calculating a maximum density projection along a vertical axis for the virtual CT three-dimensional data, and segmenting the dental arch region based on the maximum density projection.
Optionally, the step of creating an arch wire based on the arch region and the arch image comprises: carrying out binarization processing on the dental arch image to obtain a dental arch binary image; performing closed operation processing on the dental arch binary image, and filling a cavity area of the dental arch binary image; thinning the filled dental arch binary image; determining plane coordinates based on image lines in the thinned dental arch binary image, and fitting a quartic polynomial curve by using a least square method to obtain the dental arch line.
Optionally, the step of expanding the discretized dental arch line along a vertical axis to synthesize the panoramic view of the oral cavity comprises: dividing the dental arch line at equal intervals according to a preset arc length, and calculating the sampling position of each dental arch point in all dental arch point sets on the dental arch line along the normal direction; and carrying out preset transformation processing on the sampling position to synthesize the oral cavity panoramic view, wherein the CT value of each point in the oral cavity panoramic view is the average value of all the CT values of sampling points along the normal direction on a curved surface corresponding to an arch wire, the arch length of the oral cavity panoramic view is the total arc length of an arch curve, and the width of the oral cavity panoramic view is the vertical length of the virtual CT three-dimensional data arch.
According to another aspect of the embodiments of the present invention, there is also provided an apparatus for synthesizing a panoramic view of an oral cavity of a user, including: the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring a target sequence image of the head of a target user, and the image type of the target sequence image is Magnetic Resonance Image (MRI); a first synthesizing unit for synthesizing a virtual CT image from the target sequence image; a second synthesizing unit synthesizing the oral panoramic view of the target user based on the target sequence image and the virtual CT image.
Optionally, the obtaining unit includes: the device comprises a first output module, a second output module and a control module, wherein the first output module is used for outputting supine instruction information, and the supine instruction information is used for prompting the supine posture of the body of a target user during scanning; the first analysis module is used for analyzing whether the mouth opening and closing state of the target user meets a preset opening and closing state or not after detecting that the supine posture of the target user meets a preset supine condition; and the first scanning module is used for scanning the head of the target user by adopting a gradient echo sequence to obtain the target sequence image under the condition that the oral cavity opening and closing state of the target user is determined to meet the preset opening and closing state.
Optionally, the second synthesis unit comprises: the first calculation module is used for calculating a correction deviation angle based on the target sequence image and the virtual CT image and performing rotation correction on virtual CT three-dimensional data based on the correction deviation angle; the second calculation module is used for calculating the maximum density projection of the corrected virtual CT three-dimensional data along a vertical axis and segmenting a dental arch area in the virtual CT three-dimensional data; a first creation module to create an arch wire based on the arch region and an arch image; and the first synthesis module is used for discretizing the dental arch wire and expanding the discretized dental arch wire along a vertical axis so as to synthesize the oral panoramic view.
Optionally, the first computing module comprises: a first calculation submodule for calculating a maximum intensity projection of the virtual CT three-dimensional data along the coronal axis to determine a projected CT image; the de-noising submodule is used for de-noising the projection CT image and increasing the clearance of the occlusion part of the maxilla and the mandible in the projection CT image; the first transformation submodule is used for carrying out bottom-cap transformation processing on the projection CT image after the gap is increased and carrying out binarization processing on the projection CT image after the transformation processing to obtain a binarization CT image; and the first determining submodule is used for determining a plurality of coordinate points in the binary CT image, performing straight line fitting by using a least square method, and determining a straight line inclination angle by using a straight line of the fitted image, wherein the inclination angle corresponding to the straight line inclination angle is the corrected deviation angle.
Optionally, the second computing module comprises: the removing submodule is used for removing other skeleton data of the non-dental arch and the non-alveolar bone from the virtual CT three-dimensional data; and the second calculation submodule is used for calculating a maximum density projection of the virtual CT three-dimensional data along a vertical axis, and segmenting the dental arch region based on the maximum density projection.
Optionally, the first creating module includes: the binarization submodule is used for carrying out binarization processing on the dental arch image to obtain a dental arch binary image; the first operation submodule is used for carrying out closed operation processing on the dental arch binary image and filling a cavity area of the dental arch binary image; the thinning submodule is used for thinning the filled dental arch binary image; and the second determining submodule is used for determining plane coordinates based on the image lines in the thinned dental arch binary image and fitting a quartic polynomial curve by using a least square method to obtain the dental arch line.
Optionally, the first synthesis module comprises: the segmentation submodule is used for segmenting the dental arch line at equal intervals according to preset arc length and calculating the sampling position of each dental arch point in all dental arch point sets on the dental arch line along the normal direction; and the second transformation submodule is used for carrying out preset transformation processing on the sampling position so as to synthesize the oral panoramic view, wherein the CT value of each point in the oral panoramic view is the average value of all the CT values of sampling points on a curved surface corresponding to an arch wire along the normal direction, the arch length of the oral panoramic view is the total arc length of an arch curve, and the width is the vertical length of a virtual CT three-dimensional data arch.
According to another aspect of the embodiments of the present invention, there is also provided an electronic device, including: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the method of synthesizing a panoramic view of a user's oral cavity of any of the above via execution of the executable instructions.
According to another aspect of the embodiments of the present invention, there is also provided a computer storage medium including a stored program, wherein when the program runs, the apparatus on which the computer storage medium is located is controlled to execute any one of the above-mentioned methods for synthesizing a panoramic view of an oral cavity of a user.
In the embodiment of the invention, when the oral cavity panoramic view of the user is obtained, the target sequence image of the head of the target user is obtained firstly, wherein the image type of the target sequence image is magnetic resonance image MRI, then the virtual CT image is synthesized through the target sequence image, and finally the oral cavity panoramic view of the target user is synthesized based on the target sequence image and the virtual CT image. In the embodiment, the oral cavity panoramic views containing soft and hard tissues can be respectively formed through the non-radiative nuclear magnetic MRI data and the virtual CT data synthesized by the non-radiative nuclear magnetic MRI data, the oral cavity shape of a user can be more clearly presented, and therefore the technical problem that high radiance exists when the oral cavity panoramic views are obtained in the related technology is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a flow chart of an alternative method of synthesizing a panoramic view of a user's mouth in accordance with an embodiment of the present invention;
fig. 2 is a schematic diagram of an alternative synthesis apparatus for panoramic views of a user's mouth, in accordance with an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
To facilitate understanding of the invention by those skilled in the art, some terms or nouns referred to in the embodiments of the invention are explained below:
CT, Computed Tomography, and Computed Tomography utilize precisely collimated beams, rays, ultrasound, etc. to scan one section after another around a certain part of the body along with a highly sensitive detector.
CBCT, Cone beam computed tomography, also called oral CT for short, is a Cone beam projection computerized reconstruction tomographic imaging apparatus, which implements data tomographic reconstruction to obtain a three-dimensional oral image.
MRI, Magnetic Resonance Imaging, employs multi-sequence, direct multi-aspect display of images of the site under examination.
MRI-only, single nuclear magnetism, with MRI as the only original data source, without CT scanning, utilizes original MRI and its synthetic virtual CT image to analyze the user's panoramic view of the oral cavity. By utilizing the dual advantages of MRI-only display in soft and hard tissues, the invention can provide a panoramic view of the oral cavity of soft tissues based on original MRI data and also provide a panoramic view of the oral cavity of focusing on hard tissues based on CT synthesized by utilizing the original MRI data.
The synthesis method of the panoramic view of the oral cavity of the user provided by the embodiment of the invention can be applied to an oral cavity panoramic view measurement system based on conventional sequence nuclear magnetic data (single nuclear magnetic data or double nuclear magnetic data) to realize three-dimensional analysis of the oral cavity view.
Because the traditional oral panoramic film and the CBCT both utilize X-ray imaging, the CBCT with low radiation and high popularization rate is a main data source for the current three-dimensional cephalometric measurement research, but the CBCT has radiation and no soft tissue information. The method utilizes non-radiative nuclear magnetic resonance MRI, and forms the oral cavity panoramic views simultaneously containing soft and hard tissues through original MRI data and synthesized CT data. The following provides a detailed description of embodiments of the invention.
In accordance with an embodiment of the present invention, there is provided an embodiment of a method for synthesizing a panoramic view of a user's mouth, it being noted that the steps illustrated in the flowchart of the drawings may be performed in a computer system such as a set of computer-executable instructions and that while a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than that presented herein.
Fig. 1 is a flow chart of an alternative method for synthesizing a panoramic view of a user's mouth, according to an embodiment of the present invention, as shown in fig. 1, the method comprising the steps of:
step S102, acquiring a target sequence image of the head of a target user, wherein the image type of the target sequence image is a Magnetic Resonance Image (MRI);
step S104, synthesizing a virtual CT image through the target sequence image;
and step S106, synthesizing the oral cavity panoramic view of the target user based on the target sequence image and the virtual CT image.
Through the steps, when the oral cavity panoramic view of the user is obtained, the target sequence image of the head of the target user is obtained firstly, wherein the image type of the target sequence image is Magnetic Resonance Image (MRI), then the virtual CT image is synthesized through the target sequence image, and finally the oral cavity panoramic view of the target user is synthesized based on the target sequence image and the virtual CT image. In the embodiment, the oral cavity panoramic views containing soft and hard tissues can be respectively formed through the non-radiative nuclear magnetic MRI data and the virtual CT data synthesized by the non-radiative nuclear magnetic MRI data, the oral cavity shape of a user can be more clearly presented, and therefore the technical problem that high radiance exists when the oral cavity panoramic views are obtained in the related technology is solved.
The present invention will be described in detail below by integrating the above steps.
Step S102, a target sequence image of the head of a target user is obtained, wherein the image type of the target sequence image is Magnetic Resonance Imaging (MRI).
Optionally, the step of obtaining a target sequence image of the head of the target user includes: outputting supine guidance information, wherein the supine guidance information is used for prompting the supine posture of the body of the target user during scanning; after detecting that the supine posture of the target user meets a preset supine condition, analyzing whether the mouth opening and closing state of the target user meets a preset opening and closing state or not; and under the condition that the oral cavity opening and closing state of the target user meets the preset opening and closing state, scanning the head of the target user by adopting a gradient echo sequence to obtain a target sequence image.
The supine guidance information includes: the user lies flat on the scanning and detecting table and is in a supine position, and the direction and the position of the head are basically the same. The oral opening and closing state may include: the teeth are in the median occlusal position. A scan is performed with the MRI apparatus, the scan range including the entire head of the user, using a 3D gradient echo sequence.
The sequence image referred to in the present application is an MRI image obtained by nuclear magnetic scanning, and the obtained sequence image includes: soft tissue sequence images or black bone sequence images. Soft tissue may refer to the soft tissue series surrounding the oral cavity. For black bone sequence images, fat and water are suppressed by using a low flip angle to obtain a uniform soft tissue background (currently, signals from fat and water are effectively suppressed by the less sharp display of bone tissue by a nuclear magnetic scan sequence, cortical bone is rendered black and recognizable, soft tissue is rendered uniformly gray), and this MRI sequence renders bone tissue in a discernible black by improving image contrast between bone and other soft tissue, reducing contrast between different soft tissues, and is therefore referred to as a "black bone" sequence.
In the embodiment of the invention, single nuclear magnetic sequence scanning can be realized, namely, only soft tissue sequence images are scanned, and another black bone sequence image is synthesized through the soft tissue sequence images. Of course, the embodiment of the present invention may also scan the dual sequence images simultaneously, so as to synthesize the panoramic view of the oral cavity directly through the dual sequence images.
And step S104, synthesizing a virtual CT image through the target sequence images.
The invention adopts deep learning or a scheme for generating a antagonistic network (GaN) CNN when synthesizing a virtual CT image. Optionally, in the embodiment of the present invention, a deep learning unpaired data mode is adopted to synthesize a virtual CT image, and the deep learning unpaired data mode is more realistic than a CT image obtained by other paired data training methods, and contains fewer artifacts and fuzzy speckles, and the method based on the deep learning unpaired data includes three steps: in the first step, the MRI soft tissue sequence images are combined into CT images by learning. Second, learning converts the synthesized CT image back to an MRI image. And thirdly, finding out the difference between the synthesized CT and the actual CT through training.
Optionally, in the embodiment of the present invention, a reference coordinate system may be established in the target sequence image, the target sequence image and the virtual CT image are synchronized by the reference coordinate system, and a unified three-dimensional reference coordinate system is established, so that the method is more convenient and faster in synthesis.
And step S106, synthesizing the oral cavity panoramic view of the target user based on the target sequence image and the virtual CT image.
The oral cavity panoramic image provides the general conditions of the upper jaw bone, the lower jaw bone and the tooth area of the user, is a two-dimensional projection of a three-dimensional structure, and is reconstructed by computer image post-processing by utilizing the three-dimensional image data of the user.
Optionally, the step of synthesizing the panoramic view of the oral cavity of the target user includes: calculating a correction deviation angle based on the target sequence image and the virtual CT image, and performing rotation correction on the virtual CT three-dimensional data based on the correction deviation angle; calculating maximum density projection of the corrected virtual CT three-dimensional data along a vertical axis, and segmenting a dental arch region in the virtual CT three-dimensional data; creating an arch wire based on the arch region and the arch image; discretizing the dental arch wire, and expanding the discretized dental arch wire along a vertical axis to synthesize the oral panoramic view.
The embodiment of the invention provides a method for synthesizing CT based on MRI original data of a target sequence and automatically synthesizing an oral panoramic image based on the synthesized CT data, wherein the process of automatically synthesizing the panoramic image can be simply summarized as follows: (1) calculating a correction deviation angle, automatically calculating the angle between an occlusal plane (a plane inclined downwards after occlusion) of the tooth and a horizontal plane (a ground established vertically), and then rotating virtual CT three-dimensional data for correction; (2) segmenting dental arch areas, calculating maximum density projection of the corrected data along a vertical axis, and segmenting the dental arch areas; (3) fitting an arch wire, and creating an arch wire with a mathematical model by using an arch image; (4) and synthesizing a panoramic image, discretizing the dental arch line and expanding along a vertical axis to obtain discretization.
Details of the various implementations are described below.
First, calculate the correction deviation angle
Optionally, the step of calculating a correction deviation angle and performing rotation correction on the virtual CT three-dimensional data based on the correction deviation angle includes: calculating a maximum density projection of the virtual CT three-dimensional data along the coronal axis to determine a projected CT image; denoising the projection CT image, and increasing the gap at the occlusion part of the maxilla and the mandible in the projection CT image; performing bottom-hat transformation processing on the projection CT image with the increased gap, and performing binarization processing on the projection CT image after the transformation processing to obtain a binarization CT image; determining a plurality of coordinate points in the binary CT image, and performing straight line fitting by using a least square method to determine a straight line inclination angle by using the fitted image straight line, wherein the inclination angle corresponding to the straight line inclination angle is a correction deviation angle.
The virtual CT (cone beam computed tomography), namely CBCT, determines a projection CT image through the maximum density projection of the three-dimensional data of the virtual CT along the coronal axis. The maximum intensity projection means that in order to change a three-dimensional sequence image obtained by CBCT into a two-dimensional plane image, the three-dimensional sequence image is projected to a region with the maximum brightness (such as teeth and alveolar bones) and soft tissues are filtered, the projection of the occlusion plane in the direction is a straight line forming a certain angle with a horizontal line, and the angle is the correction deviation angle between the occlusion plane of the upper and lower jaws and the horizontal plane. Denoising (such as mean value denoising) is carried out on the projection CT image obtained after maximum density projection, morphological corrosion calculation is carried out, denoising pretreatment is carried out on the image, and the gap at the occlusion part of the upper jaw and the lower jaw in the image is corroded and increased.
After the gap at the occlusion part is enlarged, a horizontal structural element and a vertical structural element with one pixel width are respectively used for bottom cap transformation (for example, two times of different bottom cap transformations are adopted, the purpose is to eliminate unclosed hole areas in the image), summation and binarization processing are carried out, and a binarization image of the gap at the occlusion part of the upper jaw and the lower jaw is obtained.
After the binary image is obtained, the binary image is regarded as discrete coordinate points, straight line fitting is carried out by using a least square method, after a straight line is obtained, the inclination angle of the straight line is the correction deviation angle of the occlusion plane, the CBCT three-dimensional sequence image is rotated according to the correction deviation angle, the CBCT three-dimensional sequence image is projected along the direction of a coronal axis after the CBCT three-dimensional sequence image is rotated, the straight line becomes a horizontal straight line, and all points on the straight line have the same Y coordinate. Therefore, the position of the corrected occlusion plane can be determined by the coordinates of any point on the original straight line and the coordinates after rotation transformation.
Second, segmentation of arch area
Optionally, the step of segmenting the dental arch region in the virtual CT three-dimensional data includes: removing other bone data of non-dental arch and non-alveolar bone from the virtual CT three-dimensional data; and calculating the maximum density projection of the virtual CT three-dimensional data along a vertical axis, and segmenting the dental arch region based on the maximum density projection.
The maximum density projection of the rotated three-dimensional image is calculated along the vertical axis, the obtained image can truly reflect the arch shape of the patient, however, the arch areas are overlapped with other bones, the gray values of the arch areas are similar, no obvious boundary exists, and the arch areas are difficult to segment, so that other bones are necessary to be removed from the three-dimensional data. And obtaining the position of the occlusion plane after rotation, eliminating the influence of other skeleton data except for dental arches and alveolar bones in the three-dimensional data, calculating the maximum density projection of the data along a vertical axis, reflecting the projections of the upper alveolar bone and the lower alveolar bone and dentition on the horizontal plane by the obtained result, and finally segmenting the dental arch area through a preset threshold value.
Third, creation of arch wire
Optionally, the step of creating an arch wire based on the arch region and the arch image comprises: carrying out binarization processing on the dental arch image to obtain a dental arch binary image; performing closed operation processing on the dental arch binary image, and filling a cavity area of the dental arch binary image; thinning the filled dental arch binary image; determining plane coordinates based on image lines in the thinned dental arch binary image, and fitting a quartic polynomial curve by using a least square method to obtain the dental arch line.
According to the embodiment of the invention, morphological closed operation can be carried out on the obtained dental arch binary image, and the cavity is refilled; and performing morphological thinning operation on the filled image, then taking the binary image after the morphological thinning as coordinates in a plane, and fitting a quartic polynomial curve by using a least square method to obtain the dental arch line.
Fourth, synthesize an oral panoramic view
Optionally, the step of expanding the discretized dental arch line along a vertical axis to synthesize an oral panoramic view includes: dividing the dental arch line at equal intervals according to the preset arc length, and calculating the sampling position of each dental arch point in the set of all dental arch points on the dental arch line along the normal direction; and carrying out preset transformation processing on the sampling position to synthesize an oral panoramic view, wherein the CT value of each point in the oral panoramic view is the average value of all the CT values of sampling points along the normal direction on a curved surface corresponding to an arch wire, the arch length of the oral panoramic view is the total arc length of an arch curve, and the width is the vertical length of the virtual CT three-dimensional data arch.
Because the dental arch curved surface is the extension of the dental arch line along the vertical axis direction, the position of the sampling point can be calculated in a two-dimensional plane and then expanded to three-dimensional. Subdividing dental arch lines at equal intervals according to the arc length, calculating the sampling position of each point along the normal direction, and according to the X-ray imaging principle, the pixel value of each position of the panoramic image is the equivalent CT value of the tissue on the normal of the corresponding position on the dental arch curved surface. The synthesized panoramic image is preset transformation of the virtual CT three-dimensional data along the normal direction of the dental arch curved surface, the CT value of each point in the image is the average value of the CT values of the sampling points on the corresponding normal, the length of the synthesized panoramic image is the total arc length of the dental arch curve, and the width of the synthesized panoramic image is the vertical length of the dental arch of the CBCT three-dimensional data.
Through the embodiment, the oral cavity panoramic view focusing on soft tissue can be formed by utilizing original MRI data, the oral cavity panoramic view focusing on teeth and hard tissue is formed by utilizing synthesized CT data, the popularization rate of the oral cavity panoramic view of a user is improved, and the magnetic resonance MRI data is used, so that the radiation is avoided, and the safety injury to the user is reduced.
Fig. 2 is a schematic diagram of an alternative synthesis apparatus for panoramic views of a user's mouth according to an embodiment of the present invention, as shown in fig. 2, the synthesis apparatus may include: an acquisition unit 21, a first synthesis unit 23, a second synthesis unit 25, wherein,
an acquiring unit 21 configured to acquire a target sequence image of a head of a target user, wherein an image type of the target sequence image is a magnetic resonance image MRI;
a first synthesizing unit 23 for synthesizing a virtual CT image from the target sequence images;
and a second synthesizing unit 25 for synthesizing the panoramic view of the oral cavity of the target user based on the target sequence image and the virtual CT image.
When the panoramic view of the oral cavity of the user is obtained, the obtaining unit 21 may first obtain a target sequence image of the head of the target user, where the image type of the target sequence image is MRI, then the first synthesizing unit 23 synthesizes the target sequence image into a virtual CT image, and finally the second synthesizing unit 25 synthesizes the panoramic view of the oral cavity of the target user based on the target sequence image and the virtual CT image. In the embodiment, the oral cavity panoramic views containing soft and hard tissues can be respectively formed through the non-radiative nuclear magnetic MRI data and the virtual CT data synthesized by the non-radiative nuclear magnetic MRI data, the oral cavity shape of a user can be more clearly presented, and therefore the technical problem that high radiance exists when the oral cavity panoramic views are obtained in the related technology is solved.
Optionally, the obtaining unit includes: the first output module is used for outputting supine instruction information, wherein the supine instruction information is used for prompting the supine posture of the body of the target user during scanning; the first analysis module is used for analyzing whether the mouth opening and closing state of the target user meets a preset opening and closing state or not after the supine posture of the target user meets a preset supine condition is detected; the first scanning module is used for scanning the head of the target user by adopting a gradient echo sequence to obtain a target sequence image under the condition that the oral cavity opening and closing state of the target user is determined to meet the preset opening and closing state.
Optionally, the second synthesis unit comprises: the first calculation module is used for calculating a correction deviation angle based on the target sequence image and the virtual CT image and performing rotation correction on the virtual CT three-dimensional data based on the correction deviation angle; the second calculation module is used for calculating the maximum density projection of the corrected virtual CT three-dimensional data along a vertical axis and segmenting a dental arch area in the virtual CT three-dimensional data; a first creation module to create an arch wire based on an arch area and an arch image; the first synthesis module is used for discretizing the dental arch wire and expanding the discretized dental arch wire along a vertical axis to synthesize the oral panoramic view.
Optionally, the first calculation module comprises: a first calculation submodule for calculating a maximum intensity projection of the virtual CT three-dimensional data along the coronal axis to determine a projected CT image; the denoising submodule is used for denoising the projection CT image and increasing the gap at the occlusion part of the maxilla and the mandible in the projection CT image; the first transformation submodule is used for carrying out bottom-cap transformation processing on the projection CT image after the gap is increased and carrying out binarization processing on the projection CT image after the transformation processing to obtain a binarization CT image; the first determining submodule is used for determining a plurality of coordinate points in the binary CT image, performing straight line fitting by using a least square method, and determining a straight line inclination angle by using the fitted image straight line, wherein the inclination angle corresponding to the straight line inclination angle is a correction deviation angle.
Optionally, the second calculation module comprises: the removing submodule is used for removing other skeleton data of the non-dental arch and the non-alveolar bone from the virtual CT three-dimensional data; and the second calculation submodule is used for calculating the maximum density projection of the virtual CT three-dimensional data along a vertical axis and segmenting out the dental arch region based on the maximum density projection.
Optionally, the first creating module includes: the binarization submodule is used for carrying out binarization processing on the dental arch image to obtain a dental arch binary image; the first operation submodule is used for carrying out closed operation processing on the dental arch binary image and filling a cavity area of the dental arch binary image; the thinning submodule is used for thinning the filled dental arch binary image; and the second determining submodule is used for determining plane coordinates based on image lines in the thinned dental arch binary image and fitting a quartic polynomial curve by using a least square method to obtain the dental arch line.
Optionally, the first synthesis module comprises: the segmentation submodule is used for segmenting the dental arch line at equal intervals according to the preset arc length and calculating the sampling position of each dental arch point in all dental arch point sets on the dental arch line along the normal direction; and the second transformation submodule is used for carrying out preset transformation processing on the sampling position to synthesize an oral panoramic view, wherein the CT value of each point in the oral panoramic view is the average value of all the CT values of sampling points along the normal direction on a curved surface corresponding to the dental arch line, the dental arch length of the oral panoramic view is the total arc length of the dental arch curve, and the width is the vertical length of the virtual CT three-dimensional data dental arch.
According to another aspect of the embodiments of the present invention, there is also provided an electronic device, including: a processor; and a memory for storing executable instructions for the processor; wherein the processor is configured to perform the method of synthesizing a panoramic view of a user's oral cavity of any of the above via execution of executable instructions.
According to another aspect of the embodiments of the present invention, there is also provided a computer storage medium including a stored program, wherein the program when executed controls an apparatus on which the computer storage medium is located to perform any one of the above-mentioned methods for synthesizing a panoramic view of a user's oral cavity.
The above-mentioned synthesis device for panoramic views of the oral cavity of the user may further include a processor and a memory, the above-mentioned obtaining unit 21, the first synthesis unit 23, the second synthesis unit 25, and the like are all stored in the memory as program units, and the processor executes the above-mentioned program units stored in the memory to implement the corresponding functions.
The processor comprises a kernel, and the kernel calls a corresponding program unit from the memory. The kernel can be set to one or more, and the panoramic view of the oral cavity of the target user is synthesized based on the target sequence image and the virtual CT image by adjusting the kernel parameters.
The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
The present application further provides a computer program product adapted to perform a program for initializing the following method steps when executed on a data processing device: acquiring a target sequence image of the head of a target user, wherein the image type of the target sequence image is Magnetic Resonance Imaging (MRI); synthesizing a virtual CT image through the target sequence image; and synthesizing the oral cavity panoramic view of the target user based on the target sequence image and the virtual CT image.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (10)
1. A method for synthesizing a panoramic view of a user's mouth, comprising:
acquiring a target sequence image of the head of a target user, wherein the image type of the target sequence image is Magnetic Resonance Image (MRI);
synthesizing a virtual CT image through the target sequence image;
synthesizing an oral panoramic view of the target user based on the target sequence images and the virtual CT images.
2. The method of synthesis according to claim 1, wherein the step of obtaining a target sequence of images of the head of a target user comprises:
outputting supine guidance information, wherein the supine guidance information is used for prompting a supine body posture of a target user during scanning;
after detecting that the supine posture of the target user meets a preset supine condition, analyzing whether the mouth opening and closing state of the target user meets a preset opening and closing state or not;
and under the condition that the oral cavity opening and closing state of the target user is determined to meet the preset opening and closing state, scanning the head of the target user by adopting a gradient echo sequence to obtain the target sequence image.
3. A method of synthesis according to claim 1, wherein the step of synthesizing a panoramic view of the oral cavity of the target user comprises:
calculating a correction deviation angle based on the target sequence image and the virtual CT image, and performing rotation correction on virtual CT three-dimensional data based on the correction deviation angle;
calculating maximum density projection of the corrected virtual CT three-dimensional data along a vertical axis, and segmenting a dental arch region in the virtual CT three-dimensional data;
creating an arch wire based on the arch region and an arch image;
discretizing the dental arch wire, and expanding the discretized dental arch wire along a vertical axis to synthesize the oral panoramic view.
4. The synthesis method according to claim 3, wherein the step of calculating a correction deviation angle and performing rotation correction on the virtual CT three-dimensional data based on the correction deviation angle comprises:
calculating a maximum density projection of the virtual CT three-dimensional data along the coronal axis to determine a projected CT image;
denoising the projection CT image, and increasing the gap at the occlusion part of the maxilla and the mandible in the projection CT image;
performing bottom-hat transformation processing on the projection CT image with the increased gap, and performing binarization processing on the projection CT image after the transformation processing to obtain a binarization CT image;
and determining a plurality of coordinate points in the binary CT image, and performing line fitting by using a least square method to determine a straight line inclination angle by using the fitted image straight line, wherein the inclination angle corresponding to the straight line inclination angle is the correction deviation angle.
5. The method of claim 3, wherein the step of segmenting the arch region in the virtual CT three-dimensional data comprises:
removing other bone data of non-dental arch and non-alveolar bone from the virtual CT three-dimensional data;
and calculating a maximum density projection along a vertical axis for the virtual CT three-dimensional data, and segmenting the dental arch region based on the maximum density projection.
6. A synthesis method according to claim 3, wherein the step of creating an arch wire based on the arch area and the arch image comprises:
carrying out binarization processing on the dental arch image to obtain a dental arch binary image;
performing closed operation processing on the dental arch binary image, and filling a cavity area of the dental arch binary image;
thinning the filled dental arch binary image;
determining plane coordinates based on image lines in the thinned dental arch binary image, and fitting a quartic polynomial curve by using a least square method to obtain the dental arch line.
7. A synthesis method according to claim 3, wherein the step of expanding the discretized dental arch line along a vertical axis to synthesize the panoramic view of the oral cavity comprises:
dividing the dental arch line at equal intervals according to a preset arc length, and calculating the sampling position of each dental arch point in all dental arch point sets on the dental arch line along the normal direction;
and carrying out preset transformation processing on the sampling position to synthesize the oral cavity panoramic view, wherein the CT value of each point in the oral cavity panoramic view is the average value of all the CT values of sampling points along the normal direction on a curved surface corresponding to an arch wire, the arch length of the oral cavity panoramic view is the total arc length of an arch curve, and the width of the oral cavity panoramic view is the vertical length of the virtual CT three-dimensional data arch.
8. An apparatus for synthesizing a panoramic view of a user's mouth, comprising:
the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring a target sequence image of the head of a target user, and the image type of the target sequence image is Magnetic Resonance Image (MRI);
a first synthesizing unit for synthesizing a virtual CT image from the target sequence image;
a second synthesizing unit synthesizing the oral panoramic view of the target user based on the target sequence image and the virtual CT image.
9. An electronic device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the method of synthesizing the panoramic view of the user's oral cavity of any of claims 1 to 7 via execution of the executable instructions.
10. A computer storage medium comprising a stored program, wherein the program when executed controls an apparatus in which the computer storage medium is located to perform the method of synthesizing the panoramic view of the user's oral cavity according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010366223.5A CN111553941A (en) | 2020-04-30 | 2020-04-30 | Method and device for synthesizing panoramic view of oral cavity of user and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010366223.5A CN111553941A (en) | 2020-04-30 | 2020-04-30 | Method and device for synthesizing panoramic view of oral cavity of user and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111553941A true CN111553941A (en) | 2020-08-18 |
Family
ID=72004271
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010366223.5A Pending CN111553941A (en) | 2020-04-30 | 2020-04-30 | Method and device for synthesizing panoramic view of oral cavity of user and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111553941A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116563474A (en) * | 2023-07-05 | 2023-08-08 | 有方（合肥）医疗科技有限公司 | Oral cavity panorama generating method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102573644A (en) * | 2009-07-31 | 2012-07-11 | 牙科成像技术公司 | Panoramic dental imaging using segmentation and a master arch |
| KR20150065611A (en) * | 2013-12-05 | 2015-06-15 | (주)사이메딕스 | Cone-Beam CT / Magnetic Resonance hybrid simulation system and method for generating reference images for radiotherapy |
| CN107301622A (en) * | 2017-06-20 | 2017-10-27 | 广州华端科技有限公司 | The panoramic picture acquisition methods and system of oral cavity CBCT images |
| CN109961394A (en) * | 2017-12-23 | 2019-07-02 | 沈阳灵景智能科技有限公司 | A kind of MRI/PET/CT/PET-CT panoramic video auxiliary system |
| CN110464353A (en) * | 2019-08-21 | 2019-11-19 | 南方医科大学 | A kind of pseudo- CT synthetic method and application based on depth convolutional neural networks |
-
2020
- 2020-04-30 CN CN202010366223.5A patent/CN111553941A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102573644A (en) * | 2009-07-31 | 2012-07-11 | 牙科成像技术公司 | Panoramic dental imaging using segmentation and a master arch |
| KR20150065611A (en) * | 2013-12-05 | 2015-06-15 | (주)사이메딕스 | Cone-Beam CT / Magnetic Resonance hybrid simulation system and method for generating reference images for radiotherapy |
| CN107301622A (en) * | 2017-06-20 | 2017-10-27 | 广州华端科技有限公司 | The panoramic picture acquisition methods and system of oral cavity CBCT images |
| CN109961394A (en) * | 2017-12-23 | 2019-07-02 | 沈阳灵景智能科技有限公司 | A kind of MRI/PET/CT/PET-CT panoramic video auxiliary system |
| CN110464353A (en) * | 2019-08-21 | 2019-11-19 | 南方医科大学 | A kind of pseudo- CT synthetic method and application based on depth convolutional neural networks |
Non-Patent Citations (10)
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116563474A (en) * | 2023-07-05 | 2023-08-08 | 有方（合肥）医疗科技有限公司 | Oral cavity panorama generating method and device |
| CN116563474B (en) * | 2023-07-05 | 2023-09-19 | 有方（合肥）医疗科技有限公司 | Oral cavity panorama generating method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10204414B2 (en) | Integration of intra-oral imagery and volumetric imagery | |
| JP6483273B2 (en) | Automatic selection and locking of intraoral images | |
| US6405071B1 (en) | Three dimensional imaging and analysis of a root canal | |
| US11443423B2 (en) | System and method for constructing elements of interest (EoI)-focused panoramas of an oral complex | |
| Barone et al. | CT segmentation of dental shapes by anatomy‐driven reformation imaging and B‐spline modelling | |
| JP2014117611A5 (en) | ||
| EP3496654B1 (en) | Dynamic dental arch map | |
| US11900526B2 (en) | Volume rendering using surface guided cropping | |
| Kondo et al. | Computer-based extraction of the inferior alveolar nerve canal in 3-D space | |
| CA3136862A1 (en) | Method and apparatus for wireless portable ultrasound imaging | |
| JP7152738B2 (en) | Image processing device and image processing program | |
| JP2013236750A (en) | Image processing apparatus, imaging system and program | |
| CN111553941A (en) | Method and device for synthesizing panoramic view of oral cavity of user and electronic equipment | |
| Barone et al. | Geometrical modeling of complete dental shapes by using panoramic X-ray, digital mouth data and anatomical templates | |
| Zhu et al. | An algorithm for automatically extracting dental arch curve | |
| CN111583218A (en) | Analysis method and device for soft and hard tissues of temporomandibular joint of user and electronic equipment | |
| Cahyaningtyas et al. | Panoramic Projection of 3D CT Scan Teeth Images | |
| Barone et al. | Customised 3D Tooth Modeling by Minimally Invasive Imaging Modalities | |
| Barone et al. | 3D reconstruction of individual tooth shapes by integrating dental cad templates and patient-specific anatomy |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200818 |