TWI524873B - Intraocular photography display system - Google Patents

Description

Intraoral photography display system

The present invention relates to a system for photographing a panoramic view of the entire oral cavity.

Regarding the treatment of oral diseases such as cavities, most of the outpatient treatments are completed if the required treatment is over. The treatment of tooth decay is mostly started after the patient feels the symptoms such as toothache and discomfort. The mode is mostly the end of the treatment, and the outpatient treatment is also finished. Therefore, even if there is tooth decay but no symptoms, it will be placed regardless of the tooth decay. There are many examples of treatment.

In addition, in this kind of transient outpatient treatment, the entire oral cavity is not sought to be perfected, and in many cases, I do not know that dirt, swelling, defects, tartar, abrasion, meteorites, abnormalities, etc., although there are no symptoms, Symptoms that can be observed from the outside.

For the operation of the dental industry, sometimes the benefit of a single treatment is not necessarily good, but no better means of solving it.

A composition of an electronic medical record is shown in Japanese Laid-Open Patent Publication No. Hei 10-97404: by displaying the entire dentition on a computer screen, coloring is applied to each tooth so that the patient can easily observe it.

The easy-to-observe nature of the dentition is a necessary condition in the informed consent form. Even in the state where it is easy to observe a part of the entire dentition, in order to be used for the treatment, it is necessary to further enlarge to understand the constitution of the therapeutic purpose.

Japanese Laid-Open Patent Publication No. 2005-334426 discloses a configuration in which a plurality of pre-recorded intra-oral image data are displayed on a screen of a computer.

In Japanese Patent Laid-Open No. Hei 10-97405, a tool for informing informed consent is obtained by using an animation of a computer or an expression method of a still image display to improve understanding of professional terms.

Further, it is also described that the expression method can be used for education in elementary schools, junior high schools, companies, and elderly facilities.

Japanese Laid-Open Patent Publication No. Hei 10-201757 discloses a fluorescent film that visualizes an X-ray image and a configuration in which a visualized image is reflected by a cymbal and photographed by a camera.

[Previous Technical Literature]

[Patent Literature]

[Patent Document 1] Japanese Patent Laid-Open No. Hei 10-97404

[Patent Document 2] Japanese Patent Laid-Open Publication No. 2001-212161

[Patent Document 3] Japanese Patent Laid-Open Publication No. 2005-144171

[Patent Document 4] Japanese Laid-Open Patent Publication No. 62-246347

[Patent Document 5] Japanese Patent Laid-Open Publication No. 2001-29315

[Patent Document 6] Japanese Patent Laid-Open Publication No. 2002-355262

[Patent Document 7] Japanese Patent Laid-Open Publication No. 2005-304600

[Patent Document 8] Japanese Real Fair 5-30402

[Patent Document 9] Japanese Utility Model Registration No. 3131408

[Patent Document 10] USP5752827

[Patent Document 11] Japanese Patent Laid-Open Publication No. 2009-516555

[Patent Document 12] Japanese Patent Laid-Open No. Hei 10-201757

[Patent Document 13] Japanese Patent Laid-Open No. Hei 5-130991

[Patent Document 14] Japanese Patent Laid-Open No. Hei 10-97405

Observations in the oral cavity using image display have been proposed many times, but ultimately stop the information provided to the patient on the previous single and local treatment system, and have not reached the point of perfecting the system of seeking all the teeth in the oral cavity. .

Intra-oral or X-ray images of a patient obtained by a dental camera are sometimes used when the dentist treats the patient, but the image itself is difficult to understand.

The images and materials that are easily understood by the patient make it easy for the dentist to diagnose the patient, and the patient's awareness of the care and self-management in the oral cavity can be expected, but the expected response to the above-mentioned machine, image display, etc. has not been proposed.

With the increase in dental clinics, the dental industry has to operate consciously, and it is necessary to introduce new dental treatments, cost reduction, continuous patient visits, and rationalization of dental care in order to stabilize operations. A mobile terminal such as Japanese Utility Model Registration No. 3131408 is also proposed.

In view of the above, the present invention includes: a photographic image sequence forming means for forming a sequence of images by aligning the side faces of the photographic rows; and a side dentition image forming means for forming the image columns formed by the photographic image forming means As a part of the dentition image, a plurality of dentition images are formed by synthesizing the image which is the center of the overall compositing; and the side dentition image synthesizing means is based on the plural part formed by the side dentition image forming means The images of the center of the overall synthesis are connected and integrated to form a whole dentition; thereby, a hand-held intraoral camera can be used to form a clear panoramic dentition, and the X-ray panoramic dentition image can be displayed by collocation And the panoramic dentition with virtual correction or virtual aesthetic coloring, or overlapping display, can expand the scope of diagnosis and treatment in dentistry.

Further, the present invention is constituted by the following combination, which improves the patient's self-consciousness in treatment, seeks to improve the oral cavity, and continuously obtains a patient to achieve an improvement in the operational efficiency of the dental industry. The above-described combination is composed of the following means: The unit imaging means for visualizing the oral cavity for each medical treatment improvement unit; and setting means for setting the medical treatment improvement order information for the image obtained by unit imaging using the unit imaging means; and displaying means for improving according to the medical treatment The sequence information displays an image to which the above-mentioned medical treatment improvement order information is attached in a viewable manner; and the display medium displays and displays the display information obtained by the above display means.

The present invention is made of a small mobile terminal having a processor, a memory, a communication means, an input means, and a display means, and is used for a dental practitioner to use a computer or the like to describe the treatment content of the patient by the above method or the like, or to perform dental treatment. The use of computer processing data processing, such as attendance processing, medical treatment, and the like, to rationalize the dental industry.

The image shown in the present invention is a person who finally represents a digital image, and can use either an animation or a still image.

The "image which becomes the center of the overall composition" in the present invention refers to, for example, an image common to both of the two partial panoramic images. For the "whole", it does not mean only the final panoramic dentition image. For example, when three or more partial dentition images are formed, the panoramic dentition image obtained by synthesizing the two partial panoramic dentition images is also included. . "Synthesis from the image which is the center of the overall composition" refers to an image from the center of one of the teeth of the surface of the front teeth to the center, and a plurality of still images obtained by the dentition in the direction of the teeth are formed to form the left side. Partial dentition panoramic image and right side dentition panoramic image. "Link synthesis" refers to, for example, synthesis of a portion common to both the left partial dentition panoramic image and the right partial dentition panoramic image, or a connection based on the connectable portions.

The present invention has a case where a mark is set to include an image which is a part of the center of synthesis, and the mark means, for example, that it is not easily dissolved by saliva, water, or the like, and has an elongated rectangular shape or a short rectangular shape, for example, coated on the back surface. a seal of the agent, the adhesive, and a peelable attachment.

Further, the mark is not limited to the attached matter, and the mark may be drawn on the tooth by a pen which can be erased with a color and can be easily and clearly photographed with green or red.

Preferably, the portion where the mark is disposed is disposed to cover the upper and lower teeth, and for example, when only one of the upper and lower jaws is photographed, only one of the photographs may be disposed.

The predetermined position on the tooth row of the configuration mark refers to a position where the photographing is interrupted or the motion is stopped by changing, for example, the photographing direction or the photographing method of the camera, and the image is the center of the composition.

The color (green, blue, etc.) and shape can be easily formed on the photographic image, and the material and color can be appropriately selected. Moreover, in the case of obtaining a three-dimensional image, it is also possible to use a feature having three-dimensionality. It is only necessary to display the position on the surface of the tooth and clearly display the position on the image to be photographed. Therefore, for example, it is possible to provide an irradiation means for irradiating the laser with the known shape of the size projected on the surface of the tooth. Or, in a manner that can be irradiated from the intra-oral camera toward the teeth, an illumination means such as a spotlight is provided, and the illumination distance corresponds to the area of the irradiated light.

There are also marks that can be synthesized at least from the image where the mark is photographed at a predetermined position, and the photographing direction does not need to be from the caries. There are also cases in which the photographing direction and the synthesizing direction are not necessarily opposite. When synthesizing, the image displayed at a predetermined position from the mark is partially combined to the left and right, and finally the image is displayed based on the image displayed at the predetermined position. The predetermined position of the mark to start the synthesis is, for example, a case where the mark is located at the center of the photographic image, but the present invention is not limited thereto, and in the partial synthesis and the overall synthesis, the portion which is easy to synthesize may be used.

When the mark pair is partially combined with the right side, the center, and the left side of the tooth row, for example, the teeth on the right side and the center side are required, and the teeth on the center side and the right side are also required. In the case of two cases, there may be cases where a plural number may be attached. The side surface of the tooth row of the present invention refers not only to the front side but also to the back side and the occlusal side. Continuous shooting refers to automatic photography of 30 or less per second.

Synthetic system panoramic synthesis method, the method of synthesizing can selectively use the existing method, and can be automatically or manually by simple synthesis method, simple enumeration method, block matching method, and optical flow inference method such as Lucas-Kanade method. In the method of synthesizing, it is preferable to use an image adjustment means such as affine conversion in advance to adjust the inclination, the magnification, and the like according to the common portion between the images.

The feature portion in the present invention refers to a line shape, a dot shape, a figure shape or a three-dimensional shape indicating a joint position when a partial dentition panoramic image is combined, and for example, in the case of synthesizing two side panoramic images, the central front tooth and The boundary line of the front teeth is not limited thereto, and includes a front tooth, a characteristic tooth or a front end of the gum.

The intraoral system in the unit imaging means for visualizing the intraoral imaging for each treatment improvement unit indicates a region such as a tooth, a tooth row, a gum, a alveolar bone, a lip, a hard flap, a soft flap, and a uvula.

The diagnosis and treatment includes examination and treatment, and the dentist performs the examination, and the treatment is performed by all medical institutions.

The unit for improving the diagnosis and treatment is cavities, periodontal disease, tongue cancer, gum cancer, etc., and it is preferable to indicate the range of one examination and treatment, and it also indicates that the dirt, the correction, the like, the prevention treatment, and the quasi-diagnosis are also indicated.

The improvement refers to an action that can be overcome by brushing, fluorine, or a treatment of a bad breath preventive agent, or the application of a preventive agent such as a prophylactic treatment such as a prophylactic treatment, a cleansing, or a periodontal disease.

The imaged representation is converted into image data that can be displayed on a screen (display) device or a mobile phone display unit of a computer, and is displayed in a state in which two-dimensional or three-dimensional display is formed in a state of printing or printing on paper.

The medical treatment improvement order information indicating the setting means of the medical treatment improvement order information by the unit imaging method using the unit imaging means is a symbol, a symbol, a numerical value, etc. indicating the order of diagnosis, prevention, and improvement, and the like. The data indicating the date of diagnosis, the development of the disease, and the prediction of the development of the disease may be used to determine the order of diagnosis and improvement for at least a plurality of unit images. In addition to the contents that can be directly visually confirmed, the parameters for calculation may also be used. And can be confirmed by computer operation processing.

"Displaying in a manner that can be displayed in a list" is a list of at least the diagnosis and improvement procedures. If the overall status is easily identifiable, it is also possible to scroll and display the plurality of sheets and multiple images. The state of the state, etc.

The display medium on which the display information obtained by the above display means is recorded is displayed in a state in which one or more sheets of paper or booklet are printed or printed, or a display image based on JPEG, GIF, BMP or the like is portablely displayed. In the state of the data, the display medium refers to a paper-like, booklet-shaped paper medium, a USB memory, an SD (Secure Digital) card, or a display device having a recording element such as a memory, a mobile phone, and the like. At least the patient can carry it, and the printing, printing, electronic images, and the like in the oral cavity can be observed. In addition, it is also included in the home page display on the Internet to view the patient's oral data. Therefore, the display media also includes a desktop computer and a notebook computer.

According to the present invention, since the optical path of the illumination light is relatively long by using the mirror, an illumination source having an LED (Light Emitting Diode) according to the diffusion of the directivity angle is used, whereby the photographing position and the photographing range can be made clear.

The present invention is directed to an intraoral camera using a mirror, and a dentist or the like can clearly understand the photographing position even on an image photographed through the mirror.

Further, the present invention measures the angle information of the main body by the gyro sensor by the posture of the intra-oral camera that moves vertically and horizontally, and derives the angle of the mirror based on the angle of the main body to grasp the state. By adjusting the posture of the image in accordance with the photographing state, it is possible to always display an image in an easily viewable state regardless of the state of the camera moving in the vertical and horizontal directions.

In the present invention, a position sensor such as an angular velocity sensor (gyro sensor), an acceleration sensor, or the like is used. Specifically, a rate gyro output rate gyro, an output angle rate integrated gyro, a posture gyro, a MEMS (micro electro mechanical systems) type, and other mechanical, optical, etc. angular velocity sensors, pressure Acceleration sensors such as resistive, electrostatic, and thermal-sensing MEMS sensors.

The color of the illuminating light in the present invention may be a color that can be recognized by the color of the illumination light. If the illumination light is white, the illuminating light may be exemplified by red, green, or the like. Further, the irradiation timing of the collimated light is preferably a timing before the user starts photographing, and may also be irradiated for a short time at the time of photographing.

Further, the present invention is applicable to a mobile terminal of a body, and is internally provided with a storage means, a computer, an external modulation modulation demodulation means and a display means, and can perform input and output of the entire dental medical facility, thereby Dental practitioners can carry out electronic medical records, calculation of medical rewards, etc., and by synchronizing the sharing and display of such information, even if the number of people is limited, the dental affairs and medical treatments can be distributed to achieve dental treatment. Rationalization of the medical profession.

Preferably, the operation interface is disposed at an operable position during the treatment, and the operation method is different according to the operator, and the operation cannot be performed according to the physical requirement of the interface, or the patient is described. The status (for example, the verbal description and the time required for the screen display), and the means for adjusting the time delay of the operation of the operation interface and the actual execution operation by the operation method of the interface.

In this case, for example, when the operation interface is a switch, when the switch is pressed twice, the delay time may be adjusted according to the number of times of pressing after 2 seconds, or the display may be adjusted by the number of presses, the press time, or the like. The operation of the GUI (Graphical User Interface) of the display timing of the means.

Furthermore, the present invention has the following means: acquiring an X-ray image, overlapping the solid image, and joining, for example, an X-ray image of each tooth to form a panoramic image, overlapping with the solid image combined in the same manner, and performing the dentition A comparison of the sides of the side.

The overlapping and juxtaposition of the physical image and the X-ray image are performed on the display means, thereby achieving a further understanding of the patient's treatment.

Furthermore, the present invention forms a terminal device that is connected to a computer terminal device wirelessly or by wire, and includes a liquid crystal display portion, a numeric keypad, and the like as appropriate, and can be mounted on the arm, foot, and other parts of the user. The patient information and the input and output of the computer terminal, the dentist can process the past data necessary for the treatment or the pre-requisite knowledge for the treatment instructions for each patient in the state that the patient cannot observe, and can perform the exact diagnosis and treatment of the patient. Treatment instructions, etc.

That is, integrated with the dental treatment system, the dental treatment system is composed of an input unit for inputting dental related information, a mobile terminal having a display unit for displaying dental related information, and a record for temporarily or continuously recording dental related information. And a means for transmitting information by means of a host terminal having a processing means for processing the dental related information according to a predetermined algorithm, and transmitting information between the mobile terminal and the central terminal wirelessly or by wire, with respect to the mobile terminal The dental practitioners can carry them on the body parts such as the arms, the feet, the upper body and the lower body, and the dental practitioners or some of them can share the information displayed.

In addition to the portable type as described above, it can also be used as a tablet type or a desktop type computer. In the above case, it is also possible to perform one-piece management related to dentistry.

The mobile terminal is a terminal that can input and output and can perform information processing. Therefore, dental information such as oral information, dental information, dental affairs information, and dental information can be managed in one unit. Specifically, the example shows that the information from the peripheral device such as the corresponding software or the in-oral camera can be displayed, or the input processing such as adding, correcting, and deleting new data and the storage of the data can be performed, and other mobile terminals can be made. The information of the machine and the host terminal is shared and synchronized, and the status of the display and input processing is performed. However, the present invention is not limited thereto, and at least the display, recording, and input processing of the required dental information may be performed from the mobile terminal.

On the screen of the computer, for example, the menu item is displayed on the screen of the mobile terminal. In addition, when the user selects each information by using a mouse or the like, a screen switching display is formed or all the information of the patient is determined in one screen. Displayed as a window screen.

The user selects, creates, calibrates, deletes, etc. according to the display content of the screen, and the input can also be performed by using the set numeric keypad or the virtual numeric keypad, or by using the preset input text. The mouse or numeric keypad is selected for selection.

Moreover, the input of the attendance of the dental practitioner can also be performed by, for example, the use of the patient's mobile terminal or the host terminal by each practitioner, or the attendance operator can also perform the creation, correction, deletion, etc. input from the patient's mobile terminal or the host terminal. . When the dental practitioners each have a mobile terminal and only the person in charge can handle the situation, the password can be set for the person in charge.

The unitary management system indicates that, for example, a terminal device can be used for inputting and outputting information on dental medical information such as oral information, dental medical information, dental affairs information, and dental information, but the present invention is not limited thereto. For the above part of the information, it is also included if it corresponds to the management object of the purpose.

The present invention can further form a menu item for dental treatment by combining the subdivided image of the pre-subdivided portion, and can form an image for explanation such as a still image, a slide animation, or an animation corresponding to the treatment of each patient. .

The subdivided image is, for example, a tooth extraction image, a tooth extension image, a description image of the processed object, and the like, and is preferably prepared in advance using CG images and motion images. The dentist, the dental hygienist, and the like select, combine, or combine the treatment item list display such as the patient's self-implant treatment or the treatment of the make-up, or the patient selects and combines.

Simply select each subdivided image and execute it continuously on your computer. Further, it is also possible to prepare a plurality of pre-selected artificial animations, and the dental practitioner or the patient uses the combined animation as a treatment instruction to observe before, after, and sometimes during treatment.

The image of the link can form a combination of the patient's own treatment status, and thus can be expected to further understand and effect on the enlightenment activity such as tooth decay prevention. The following treatment system is proposed: the partial animation and the image obtained by photographing the patient's image by means of photography can be converted into the same image pattern, which is easy for the patient to understand and easy for the user such as a dentist.

According to the present invention, a part or all of the tooth rows can be displayed in a panoramic view using the physical image, and the X-ray images can be superimposed or recorded in a visible manner, and thus the patient can be easily explained by the display.

The present invention can accurately display the photographing position of the intraoral camera using the mirror, and can grasp the photographing posture of the photographing unit that moves vertically and horizontally in the oral cavity, and adjust to the state in which the photographed image is easily observed.

The patient often recognizes the condition in the oral cavity of the patient and the necessity of diagnosis and treatment on the paper or the display means of the recording medium, thereby continuously performing the diagnosis and improvement of the oral cavity. If you become higher, you can also improve your business in the dental industry.

The present invention processes the entire dental industry using a mobile terminal capable of digital data processing, thereby achieving rationalization and cost reduction.

The present invention relates to a continuous photographic tooth row, which is a method for synthesizing a partial panoramic image synthesized by a panoramic combination and a panoramic image of the portions to form an overall panoramic dentition, preferably configured by arranging a mark on the composite portion, thereby being easily configurable A dentition panoramic image is formed using a handheld camera.

According to the present invention, an oral image which is photographed in a home is taken from a dental treatment, or an oral image captured in a home, and an intra-oral camera or an X-ray imaging device is used to obtain a unit image corresponding to the diagnosis and treatment. The unit image is displayed on a screen (display) device for a computer that can be observed with the patient, for example, and the patient is recorded with the dentist in the order of the diagnosis, the beginning of the treatment, and the necessity of the diagnosis. The medical treatment improvement order information obtained by the degree or the like is printed on the unit image, printed on a piece of paper, or stored in a mobile phone having a storage medium and displayed on a mobile phone screen. Or, it is displayed on the screen for personal use on the front page of the dentist.

The invention can be installed in the mobile terminal of the body, and is internally arranged with storage means, computer, external communication modulation demodulation means and display means, and can perform input, output and data processing of the entire dental medical industry. Dental practitioners can perform dental attendance management, electronic medical record entry, medical treatment reward calculation, etc., and share such information. The mobile terminal is wirelessly connected to the host terminal via a medium such as infrared light or light, or is wired. Alternatively, the mobile terminal may have a computer specification that is connected to the cloud-based computer network via a wireless LAN (Local Area Network), a wired LAN, or the like.

[Example 1]

In turn, embodiments of the invention are described in detail with reference to the drawings.

Figure 1 (a) is a view showing an embodiment of the present invention.

The 11-system intra-oral imaging means is, for example, a device that uses a camera for photographing a full-toothed jaw or a lower jaw to perform photography and obtain digital image data.

The intra-oral imaging means 11 is, for example, a dental camera using a convex mirror as shown in FIG. 3(c), and a camera for intra-oral photography using a fisheye lens, and outputs a digital image of a full-tooth.

Alternatively, a method of photographing each tooth using a normal intraoral camera, extracting a contour from each photographic image, connecting the common portions of the contours, synthesizing, and obtaining a full-tooth image may be used.

The 12-series diagnosis site detection means is, for example, used to set a predetermined range of teeth for the diagnosis or improvement and the above-mentioned teeth, and a wide range of intraoral image cutting input by visually using the graphic software free intraoral imaging means 11 And extract.

Or, the step of extracting and obtaining the contour of the tooth by the processing of the software, taking the extracted contour as a circle and obtaining the center thereof, and extracting the image from the center having a radius longer than the radius of 10% to 20% of the contour. Wait.

The 13-series unit image forming means is formed by the image processing for the diagnosis and treatment obtained by the medical site detecting means 12, and is used to form an image in which an area to be recorded and annotated is added.

The unit image forming means 13 automatically creates a display model by the medical site detecting means 12 operating the designated medical site by the graphical operation of the software.

The image may also be used to display only a specified range of images input by the free intra-oral imaging means 11 or, in addition, the user's patient may also specify a model of the unit image display produced.

The image can also be displayed by using a camera using an appropriate mirror as shown in FIG. 3 at the time point when the unit image is displayed. The display is initially displayed in an animation in the unit image area, and then displayed as a still image by pressing the OK button.

The 14-series diagnosis order setting means can determine the order based on, for example, the development of the cavities or the degree of improvement of the diagnosis, or the dentist can negotiate with the patient or automatically determine the degree of development of the cavities or the degree of deformation of the shape. The automatic sequence can also be determined by digitizing the difference in the color of the teeth and comparing it with a fixed threshold, or from the basic shape of the tooth, the degree of deformation exceeding a certain fixed value, or the basis of the illumination source relative to the detection wavelength of the caries detection. The size of the spectral component of the wavelength is equal to or greater than a predetermined value, and the order of the images on the screen of the screen (display) device is changed in order.

This change is based on the order of treatment and examination after consultation with the patient. Therefore, after the decision is made, the order of the unit images placed on the screen is automatically changed and the patient's printing is performed by pressing the OK button, thereby enabling diagnosis and treatment. The rationality of time.

In the same manner as the medical treatment order setting means 14, the 15th-stage medical treatment instruction means is a means for the dentist to record the contents necessary for the patient's entry into the medical treatment start period, the urgency of the medical treatment, or the medical treatment method. The entry is an input from a keyboard of a computer (for example, FIG. 3 (315)), an operation of using a mouse (for example, FIG. 3 (316)), and an operation button of the intraoral camera shown in FIG. In the state of being connected to the input interface of the computer, it is also possible to use the input of the button attached to the camera body.

The medical treatment instruction forming means 15 is recorded in the 21st to 23b shown in Figs. 2(c) to (e), and the medical treatment start date or the medical treatment start scheduled date is also displayed, and the date can also automatically display the shortest day of the medical treatment.

The shortest day at which the medical treatment can be started may also have a function of setting the date of the medical treatment start date in the database of each patient recorded and stored by the recording means 17 and displaying the shortest day of the date on which the date is not entered.

The specific constitution is shown in Fig. 1(b). It is a part of the means for forming a medical treatment description, and the state in which other configurations are omitted is shown. 151 series patient database transfer means, which records the image data, sequence data, treatment start date (including time) data and description data shown in Figure 2, since the formation of general managers, the relevant information Recorded in the temporary recording area. It may also be used to transfer data from the database at the time of inspection when there is a large amount of stored information.

The shortest medical treatment date search means 152 is a date from which the medical treatment start date data is retrieved and the date from the search start date is not recorded in the medical treatment start date, and when there is an inconsistent data, it is output as the shortest medical treatment date.

The 153-series shortest medical treatment date display means is a means for displaying the date detected by the shortest medical treatment date search means 152 on the display unit of the unit image.

154 is an idle medical treatment date display means, which is displayed in such a manner that it is easy to know the date of diagnosis and treatment, and can also be displayed on a computer screen such as a one-month unit, a monthly unit, or the like, such as an analog clock and a calendar display. The display of the annual unit.

The 155 determines the input means, which begins the input to the database while the patient agrees.

156 is a means for recording to a database, and the recording means 156 is the same as the recording means 17, and a determination record can be formed in the recording means 17. As for the date of diagnosis, the other doctors and the patient have the same plan. The possibility of a table, therefore, requires a quick record of the database, so it is better to record to the database immediately after the decision.

16-series display output means for editing and displaying images consisting of unit images, medical treatment sequences, and medical instructions on the screen of a computer screen (display) device, or printing using a printer (for example, Fig. 3 (317)) Printed and edited on the paper.

The 17-series recording means is a means for recording the edited image data, recording it as part of the electronic medical record of the dentist, or recording it on the patient's mobile phone or computer via the storage medium. The recording means 17 includes a database obtained from the respective data of the patient and storing the data of the patient as a whole.

Next, an example of the intraoral camera shown in Fig. 3 will be described and explained.

The 301-series holding case is formed in a cylindrical shape to form a pencil-shaped intraoral camera, and has a circuit board and a USB connection circuit and a USB socket for external connection.

The camera unit 309 is integrally connected to the front end. For example, as shown in FIG. 3(e), the camera unit 309 has a configuration in which, for example, a CCD camera is disposed at the center, and white LEDs, LEDs of other colors, and other illumination elements 312 are disposed around the center. They are arranged at equal intervals in a concentric shape.

The 302-type mirror unit is connected to a flat mirror 303 which is disposed at an angle of, for example, 45 degrees at the front end, and has a cylindrical portion 305 formed in a state where the rear end is insertably connectable to the outer periphery of the camera unit 309 and can be exchanged. The outer shape of the outer surface of the camera unit 309 and the cylindrical portion 305 of the mirror unit 302 is preferably formed in an elliptical shape, and is set so as not to rotate when inserted.

The mirror unit 302 can be exchanged in a timely manner. Fig. 3(b) shows the mirror unit 310 having the mirror unit 303, and the mirror unit 310 and the camera unit 309 having the spherical mirror 308 set in Fig. 3(c). Insert the state of the union.

As described above, in the case of photographing full teeth, the mirror unit 310 to which the convex mirror 308 of Fig. 3(c) is attached is used, and the convex reflection map of the convex mirror 308 is photographed by the camera 313 of the camera unit 309, and the output of the illumination element 312 is output. The light is reflected by the convex mirror 308 to illuminate the observation site in the oral cavity. The camera 313 can be exemplified by a CCD pattern, a C-MOS pattern, etc., and the resolution is preferably higher image quality. However, when the motion picture is mainly used, the image quality can be lowered and used.

In the case of ordinary photography, the cylindrical portion 305 of the mirror unit with the mirror 303 shown in Fig. 3(b) is inserted into the outer periphery of the camera unit 309 to be used in combination.

304 is a wire, and a dedicated electric wire or a universal USB cable can be used.

306 and 307 are operation buttons, and are buttons of 1 to a plurality of push type, rotary type, and the like, and in the present embodiment, two are shown. In addition to the operation of the camera such as turning the power on and off, there is also a GUI (graphic user) that controls the selection of the screen 314A and the operation display window that is pressed by the operation button 307 and is displayed on the computer 314 connected via the wire 304. Interface) function situation.

For example, when the order of the unit images is automatically sorted in order, the operation buttons 306 and 307 can be operated and executed.

For example, 306 may be set as a button corresponding to the left click function of the mouse, and 307 may be set as a button corresponding to a right click.

314 is a computer, and the example is integrated with the screen (display) 314A. In addition to this, it can also be a combination of dedicated devices.

315 is the keyboard, 316 is the computer mouse. Either one is used for computer operation, and is also useful for operating a switch in an intraoral camera.

Further, 317 is a printer, and is formed by an ink jet method or a laser type color printer, and is used when printing a patient and providing an intra-oral image of a patient.

Fig. 3(d) shows the use of the mirror unit 318 of the concave mirror 311 as a mirror, which is used when, for example, an enlarged image is required. Further, in the case of the oral cavity, when the inner side of the dentition is only magnified, the curvature of the concave mirror 311 is adjusted in the direction close to the plane mirror, and the photograph is taken from a portion slightly away from the dentition. A wide range of images as shown in the present invention are obtained.

In the present invention, there are cases in which not only the dentition but also the tongue, the lip, the gums, and the like are handled as a wide range of images and unit images.

For example, the present invention, which is also a manifestation of tongue cancer, is displayed as a unit image, and the present invention is preferably used when the medical treatment is described.

Next, one of the images used to form the full-tooth image is illustrated in FIG.

The camera used is a mirror unit 302 using a mirror 303 as shown in Fig. 3(b).

Moreover, the image can be either a static digital image or a digital animation.

Furthermore, in the case where a plurality of still images are obtained by automatically drawing a digital image, since the number of pixels is relatively small for the purpose of animated photographing, it is preferable to photograph a still image while moving with an automatic shutter.

The plane mirror 303 of the mirror unit 302 is moved from the photographing surface 601 to the direction 612, and a full tooth of the lower surface 600 shown in Fig. 6(a) is photographed. The case of digital animation photography is the same as the case of inputting a still image at a rate of 30 frames per second. Therefore, if the mirror portion of the intraoral camera for digital animation photography is used, the photographic surface 601 of FIG. 6(a) is along 612. When the track moves, a large number of still images can be obtained. Furthermore, continuous image capture of still images is obtained by using still images of animated photographs, and the number of pixels is larger and the resolution is higher. Therefore, it is preferable to obtain an image of each tooth from the full-tooth image.

Fig. 6(b) shows a part of each image in the case where the photographing shown in Fig. 6(a) is performed. 613 is a common partial image of images 601 and 602, 614 is a common partial image of images 602 and 603, and 615 is a common partial image of images 603 and 604.

In addition, photographs are taken in such a manner that each of 604 and 605, 605 and 606, 606 and 607, 607 and 608, 608 and 609, 609 and 610, 610 and 611, 611 and 612 also obtain a common partial image.

For example, in a state in which the images are binarized to obtain a contour, the contour of the common portion is superimposed so that the images are uniform. Further, the images 605, 606, 607, 608, 609, 610, 611, and 612 are sequentially photographed and visualized, and the respective images are connected based on the common portions of each other to obtain a full-tooth image. The panoramic occlusal image can be formed by a well-known panoramic synthetic software. When the shaking caused by the hand is affected, it is preferable to perform affine conversion processing for correcting the image before synthesis.

Next, the operation of the embodiment will be described in detail with reference to FIG.

For example, the upper jaw of the oral cavity is photographed by the intraoral imaging means 11. The position of the image to be photographed is shown in Fig. 2(a).

The intra-oral imaging means 11 is a method in which at least the dentist knows which part of the oral cavity is included as the tooth to be diagnosed.

The image shown in Fig. 2(a) is obtained by photographing, for example, the intraoral imaging unit shown in Fig. 3(c), and may be further calibrated to correct the distortion. Further, the intraoral imaging means 11 is not necessarily a full tooth, but may be a partial tooth or a tooth. Fig. 2(a) shows the upper jaw 20, and the full-toothed and hard-mouthed parts are also photographed, and the diagnosis and treatment of the part is also performed.

Then, the part to be diagnosed and improved is automatically or manually extracted by the medical site detecting means 12. In the case of manual detection, similarly to the drawing software, the mouse is designated in a circle or a square shape, copied, cut, etc., and attached by a bonding operation.

20a, 20b, and 20c of Fig. 2(a) show a state in which a tooth that is a subject is manually or automatically indicated by a drawing software to display a circle of a remarkable color.

An internal transmissive processor that manually instructs a display system operation, such as a mouse attached to a keyboard of a computer to draw a circle, a quadrangle, other contour graphics, etc., automatically indicates that the display system has, for example, a mouse on the screen at a designated location. When the indicator is pressed and the button is pressed, an internal penetrating processor such as a circle of a predetermined radius or a square of a predetermined area is displayed.

Then, the specified tooth 20a shown in FIG. 2(c) is adjusted to the unit image 21 by the unit image forming means 13.

In this case, the additional setting is, for example, the order column 21a in which the order is determined after the order of the treatment is determined, for example, the medical treatment start date column 21b in which the medical treatment is started after the start of the treatment, and the description column 21c in which the medical treatment is formed.

The shortest medical treatment date is displayed, for example, in the medical treatment start date column 21b of the unit image in which the order of FIG. 2 is the earliest. When the patient agrees to the date, the decision input means 155 is moved, and the date is determined, and the recording means 156 is used to record the data to the patient's database.

When the patient does not agree, the idle medical treatment date display means 154 displays the date of the idle medical treatment in a two-dimensional form as in the form of a calendar.

The display is displayed by a schedule such as a list form or a hand-turned page, and is displayed at least for the patient to easily understand.

Furthermore, not only the date but also the time is required, so it is preferable to display the clock together. When the diagnosis start date is agreed based on the display, the date is input by the decision input means 155, and is recorded in the database by the recording means 156.

The unit image of the next order is moved and decided to be credited to the same medical start date.

The planning operation of the medical treatment date as described above is based on the present invention in setting a plurality of medical treatment scheduled dates, and in the transient medical treatment, it is necessary to avoid confusion with the schedules of other patients that are not generated, so that the schedule is clarified. effective.

Furthermore, the ID number can be entered in any column for each tooth. This column indicates the input box used in the database, etc. The date of diagnosis can be automatically determined according to the schedule of other patients' treatment plans. Therefore, it can also be based on the data of other patients when the unit image is displayed. Shows the time of idle.

Regarding the display contents in the frames, the image before the treatment may have at least a column showing the order of treatment, or may be displayed by adding an identification symbol to each of them.

Fig. 2(d) shows the unit image 22 of the tooth 20b for diagnosis and treatment of Fig. 2(a), and Fig. 2(e) shows the unit image 23 of the tooth 20c for diagnosis and treatment of Fig. 2(a), respectively.

In the unit video 22, the order column 22a, the medical treatment start date column 22b, and the explanation column 22c are integrally displayed, and similarly, in the unit video 23, the sequence column 23a is displayed integrally, and the medical treatment start date column 23b, Description column 23c.

Furthermore, when the determination is made, the OK button (including the virtual button displayed on the screen) is pressed. By pressing the OK button, the number of the column can be sequentially displayed in order, and by automating the job, the time for finalizing the paper delivered to the patient can be shortened.

The figure shown in Fig. 2 also shows a situation in which the entire screen is displayed on the screen of a computer. In this case, there is also a case where the operation range of the display output means 16 is combined.

Using the diagnosis order setting means 14, the dentist alone or the dentist consults with the patient side to determine and record the order of the sequence column 22a. Similarly, the medical treatment instruction forming means 15 is used to record the medical treatment start date column 22b and the explanation column 22c. This credit contains more special content, so there are cases where the dentist performs it separately.

The display output means 16 forms a unit image of the determined plural number on the computer screen and displays the state of the full-tooth image, and displays it.

The display output means 16 is preferably displayed on a screen when the dental treatment or the like is performed.

However, when there are many unit images, scrolling is performed, or it may be reduced as needed, or may be displayed as a thumb.

Further, the image in the determined display output means 16 can also be distributed to the patient by printing on the printer by means of a printer. The patient holds the patient's mouth in the image, and expects to perform outpatient treatment for the purpose of improving the oral cavity. Then, after the end of the medical treatment, the photography in the oral cavity is performed again as shown in FIG.

The tooth 20a of the same portion is displayed as a unit image 24 as shown in Fig. 2(b). 24d is a medical treatment site, and 24a searches for the same video data from the image data in which the medical treatment sequence is set in advance by, for example, the medical treatment order setting means 14. In this case, the displayed order is displayed.

For example, a record item at the time of medical treatment using the medical treatment instruction forming means 15 is described in advance.

Moreover, the unit image image after the diagnosis and treatment shown in Fig. 2(a) is displayed in a position adjacent to the same person, and the trust of the dentist or the outpatient treatment for the teeth after the treatment can be discerned. Timing. The 24c is, for example, a description column after the diagnosis, and is more preferably a description column for discussing the start of the next treatment with the patient.

Then, by using the display output means 16, the four images shown in, for example, 400 of FIG. 4 are printed on a sheet of paper and delivered to the patient by the printer, thereby providing the patient with the necessity of continuing the medical treatment.

Furthermore, the wide-range image of the oral cavity shown in FIG. 2(a) is not disclosed in 400, but it is preferable to disclose a wide-range image to make the diagnosis site clear, thereby obtaining further understanding of the patient.

For each of the display columns of FIG. 2 and FIG. 4, the number and display content of the display columns of each unit image are appropriately selected according to the purpose of treatment, the schedule, and the like.

[Embodiment 2]

Next, another embodiment will be described with reference to FIG. 5.

The 51-series wide-range image input means is a means for photographing the full teeth of the upper jaw and the lower jaw of the upper jaw of the oral cavity, and is obtained by photographing the full teeth of the convex mirror shown in (c) of FIG. 3 by using a camera. A wide-range image, or a continuous image of the continuous image and a static image constituting the digital animation as shown in FIG. 6, can be used to form a full-tooth image.

The 52-series tooth detecting means is a means for extracting image data of each tooth from the tooth row obtained by the wide-area image input means 51. In addition to the means for forming a tooth image by extracting a predetermined range from the periphery, for example, by means of a contour extraction program, a method of imaging each tooth using a plane mirror as shown in FIG. 3(b) may be employed. It is also possible to cut a unit image from a full-tooth image or a wide-range image in the oral cavity, and a means of forming a tooth image is more reasonable and better.

The 53-unit unit image forming means is a method for forming a video for display by adding a sequence entry column, a medical treatment explanation entry column, and the like to each of the images obtained by the tooth detecting means 52.

Furthermore, it is preferable to form a database for teeth, and to manage by adding a unique symbol.

The 54-series diagnosis and treatment image selection means is a means for selecting a tooth to be diagnosed from a video, such as a tooth decay or a defect, and the dentist can visually or read the previously registered data and compare it, and select according to the difference in color, shape, and the like. The teeth of the subject.

The 55 series of medical treatment order setting means, the dentist can determine the order of the teeth to be diagnosed separately, and the patient can also be printed with the dentist according to the screen displayed on the computer (for example, screen 314A of Fig. 3 (a)) or printed image. It is decided by consultation.

The 56 Department of Medical Treatment describes the means of formation. The dentist can record the period of diagnosis and treatment, the start date, the content of the treatment, the necessity of improvement, etc., either alone or according to the consultation with the patient, or may also show the difference between the use and the previous data. The size of the description is recorded in advance.

The 57-series display output means can also be used to display the display image to be the subject of the above-mentioned diagnosis on one sheet of paper or on a screen of a computer (for example, 314A in Fig. 3(a)), and obtain the consent and understanding of the patient. . In addition, the image printed on the paper is provided to the patient, and the dental treatment plan is continued as a future medical treatment plan.

The 58-series recording means records as a medical record or as a database, or may be uploaded to a patient-dedicated storage area of the server, or record the tooth image data in the recording unit of the patient's mobile phone.

Next, the operation of the embodiment shown in Fig. 5 will be described with reference to Fig. 7 .

The full-toothed image is taken from the patient's mouth using a wide range of image input means 51 to form one or a plurality of full-toothed image data 700 (Fig. 7(a)). The image data 700 indicating the full tooth can be formed by connecting the still image shown in FIG. 6 as an example.

From the wide range of image data 700 obtained, the tooth image is manually or automatically formed by the tooth detecting means 52.

As a method of automatically detecting the teeth, the image data in the oral cavity is extracted by the contour extraction program contour, and the contours of the teeth are respectively detected.

In this case, when the contour is incomplete, the number of points is detected and a virtual circle passing through the number is formed. Since the virtual circle can be regarded as the position of one tooth, the radius is only expanded from the center of the assumption, and the range is extracted as an image of the tooth in the form of a square face.

The extracted image is shown, for example, in Fig. 7(b). The tooth image 701 is a tooth image 701 with respect to the tooth 71, and is a tooth image 702 with respect to the tooth 72, and is a tooth image 703 with respect to the tooth 73.

Then, the unit image forming means 53 associates the information of the patient such as the identification code with the unit image of the images of the teeth (Fig. 7(c)). In the unit image 74, the tooth image 701 and the display field 704 for recording the medical procedure and the like are disclosed.

In the unit image 75, the tooth image 702 and the display field 705 are revealed, and in the unit image 76, the tooth image 703 and the display field 706 are revealed.

The unit images are recorded in a pre-set patient database to form a list of the upper and lower oral data of the patient.

The unit image 77 indicating the image of the tooth to be treated or improved is visually or automatically extracted from the medical image selection means 54 (Fig. 7(d)).

The medical treatment order setting means 55 and the medical treatment instruction forming means 56 having the same configuration as that of Fig. 1 and performing the same operation are used, and the dentist individually or preferably observes the unit tooth image photographed on the computer screen with the patient and records the medical treatment. Order and so on.

Further, in the stage in which the medical treatment order is determined and the medical treatment start date or the like is written, in the display output means 57, for example, a unit image in which the order shown in Fig. 7(e) is displayed can be displayed on the screen 78 of the computer. The arrangement or display is performed in a state in which a wide range of images are further edited as shown in FIG. 7(f), and the patient can obtain the diagnosis of the diagnosis and the consent of the continued diagnosis and treatment.

The unit images 707, 708, 709, and 710 are preferably arranged in the order in which the treatment is started. Fig. 7(f) is a screen display containing, for example, full-tooth image data 711 or printed materialized data 79 carried by the patient.

The recording means 58 records the unit images in a database and appropriately uses the adjustment of the schedule of other patients.

Moreover, in the present invention, when a wide range of images are obtained, a method of using the convex mirror shown in FIG. 3 or moving the mirror along the dentition and combining the still images to form a single image may be used.

That is, only the tooth row is regarded as a still image, and the portion of the tongue is photographed using a convex mirror, and image synthesis is performed, thereby obtaining a wide-range image of the oral cavity having the distortion-free dentition.

Further, FIG. 8 to FIG. 12 show an example of a method of forming a panoramic dentition image in which a tooth row of a panoramic shape is formed by combining the teeth in a state in which the teeth are meshed.

As shown in Fig. 8, in the case where the image obtained by photographing from the left inner side is photographed by the camera until the vicinity of the center, the direction of the camera in the oral cavity is changed, and the method of photographing is taken from the right inner side to the vicinity of the center, in this case, Since the direction of the camera is temporarily changed and the photographing state is interrupted, in many cases, the synthesis of the left and right dentition images cannot be accurately performed, and the shift occurs.

Moreover, when the mobile photography using a manual camera is used, for example, in the case of dental caries, the intraoral camera is moved in order to be placed between the buccal meat and the flank of the inner surface of the oral cavity, and the cheek-like state is pushed open. Or forming a state of contact with the side of the tooth, etc., the cheek meat, the side of the tooth becomes a state of supporting the mirror of the camera in the oral cavity or the photographing part of the camera, and if the camera in the oral cavity is moved in the direction of the front tooth, it is caused by the cheek meat. The liberation of oppression and the like, the position of the camera that is in the state of hand-held photography becomes unstable, and the image is easily confused. In particular, there is a case where the distance between the camera and the tooth side surface of the subject is changed or the photographing direction is shaken, and the size of the tooth as the subject is changed or the image is distorted.

The intraoral camera 901 using the mirror shown in FIG. 8 is a configuration shown in FIG. 3, and is configured by arranging a plurality of LEDs for a light source around a module-shaped CCD camera or a C-MOS camera. In the case where the light source LED is used for illumination in the oral cavity, and the image such as the dentition in the oral cavity is obtained in a continuous manner, the photographer can stably perform the self-clamping, but the present invention is not limited thereto, and may be unused. The case of a camera for direct photography of a mirror.

The intraoral camera 901 used here is exemplified by a mirror having a planar shape in which a front end of a main body 904 (301 of FIG. 3) including a photographing unit 905 (309 of FIG. 3) is exchangeably mounted. 902 (303 of FIG. 3) mirror unit 903 (302 of FIG. 3), the photographing unit 905 is a combination of a camera such as a CCD camera or a C-MOS camera, and four to eight light-emitting diodes are disposed around the camera. Obtained from the body of the illuminator.

The photographing unit 905 exemplifies a method of outputting a still image digital image by using a continuous shooting method of photographing a still image to obtain an image in a range of, for example, 10 to 30 frames per second.

Before the start of the continuous shooting, the mark ML is added in advance in the vicinity of the center of the tooth row 900a in the state in which the upper and lower teeth are engaged, and the mark ML is preferably such that the colored seal can be temporarily attached by the camera. It is displayed on the image by the record of the color pen that can remove the color. When the marker ML is attached to, for example, the vicinity of the center of the center of the dentition, it indicates the position of the dentition on the left and right of the photographic lens, and the reference is made at the time of the synthesis, and may be in the vicinity of the center of the image to be photographed. A part that is characteristic in image processing is detected, and the above-mentioned part is set on the mark image. The mark ML is preferably arranged to cover the upper and lower teeth.

The position of the molars, for example, the state of 906a, such as 906b, 906c, along the tooth surface, preferably at the same distance from the tooth surface, performs the continuous shooting operation, and the hand body 904 moves the mirror 902 to perform photography.

The IG-based correction display unit is configured to perform image correction for a patch member attached to the tooth surface in a peelable state, for example, a trapezoidal shape, a quadrangle, a triangle, a mesh, or other patterns, and according to image distortion, a camera and It is only necessary to correct the size of the image of the distance between the sides of the teeth, and the color of the correction display unit IG is also green, and if it is a color that can be recognized in the image processing, it is not limited. In green.

The attaching member may be attached to, for example, the surface of the tooth having the mark ML attached to the center of the tooth as shown in FIGS. 8 and 10, and also has the following condition: the attached tooth is not limited to one tooth. It is also possible to perform photography by attaching a member to a plurality of teeth, or to attach another tooth to the mouth without any other support, and manually photograph the part of the tooth.

The means for attaching the correction display unit IG to the surface of the tooth may be the same as the method of the mark ML. For example, if the display is not dissolved or exuded by saliva or the like, a part of the panoramic image and the right dentition of the left dentition are collectively photographed according to the two. It is preferable that the correction display portion IG obtained by a part of the panoramic image corrects the two image distortions or sizes and combines them.

Further, when the panoramic image is divided into three parts of the left dentition, the central dentition, and the right dentition, the auxiliary display portion IG may be provided for the common teeth of each of the partial panoramic image sequences.

The correction in each of the still images to be photographed is also detected in the image group to be photographed by, for example, a block matching method or a template matching method, based on, for example, the auxiliary display unit IG serving as a reference in the image obtained by continuous shooting. One of the correction display units IG is used as a reference, and the auxiliary display unit IG photographed in another image is detected, and compared with the reference image, the distortion, the inclination, the difference in size, and the like are detected and used. Correction of affine transformation for zooming in, zooming out, rotating, and moving adjustments. When the photographing by the manual shaking is unavoidable, the auxiliary display unit IG can be combined with the teeth to form a composite for the stable panoramic dentition image formation.

The correction of the image using the correction display unit IG as described above can also be performed using a calibration of a camera image such as the method of Zhang (IEEE. Transations on Pattern Analysis and Machine Intelligence, 22 (11); 1330-1334, 2000). The method used.

Further, there is a case where the correction display unit IG is not required depending on the imaging state, affine transformation, or the like.

Fig. 8(b) is a simplified representation of one imaging range when the actual caries are continuously connected.

On the other hand, the mirror portion of the intraoral camera is moved over time as 906a → 906b → 906c → 906d → 906e → 906f → 906g, and the continuous photographic image using the still image is obtained.

The intraoral camera 901 is configured by a configuration in which the distal end includes a mirror 902 having a predetermined angle. Therefore, if the left molar is photographed from the left side of the figure, the direction of the body 904 is changed in the vicinity of the center, and right from the figure. Since the molars are photographed in sequence, the 902e to 906g faces shown in Fig. 8 are photographed, and the intraoral camera 901 is reversed to start photographing from the right molar.

Since the speed of the continuous shooting is manually moved by the main body 904, it is preferable to consider the influence of shaking such as shaking, and it is set to be a large amount of photography from 20 to 30 sheets per second, and the margin of the image with the deletion jitter and the focus blur is connected. Photographing.

The continuous shooting is preferably performed until the mark ML reaches the center of the photographing screen or the mirror. However, there is a case where the photographing is performed until a certain portion is passed, and then the photographed image is selected and selected.

Since the camera operation is performed manually, it is preferable to adjust the state of the image by performing affine conversion based on the common portion of each image before synthesis.

For example, the comparison image is detected by the block matching method based on the image which is the center of the first synthesis, and the common plural is detected. The next image is affine transformed according to the point of the common plural. For example, the pixel coordinates (xb, yb) of a lower image corresponding to the pixel coordinates (xa, ya) of the reference image in the common portion are selected, and the values of the coefficient values a to f are obtained by substituting into the following equation.

It is also possible to perform the panoramic synthesis by performing affine transformation on the next image and sorting the image, or by adjusting the image while substituting the coefficient value into the following formula.

[Number 1]

One of the images obtained by continuous shooting from the left inner side to the front side of the figure of the tooth row 900a is shown in Fig. 9, and the photographing operation of the intraoral camera according to the embodiment will be described with reference to Fig. 8.

Figs. 9(a) to 9(e) are diagrams showing an example of a photographic image data line at the time of continuous shooting in the vicinity of the center 907c to 907e in the photographic image data of the dentition shown in Fig. 8(b).

Further, since the intra-oral camera obtains the dentition image by the mirror 902, the photographic image is reversed left and right, and is shown in FIGS. 9 and 11 in an unreversed state for easy understanding.

Fig. 9(a) is an image obtained in the vicinity of 906c in Fig. 8(b), Fig. 9(b) is an image obtained in the vicinity of photograph 906d, and Fig. 9(c) is an image obtained in the vicinity of photograph 906e, Fig. 9(d) The image obtained near the image 906f is photographed, and the image obtained in the vicinity of 906g is photographed in Fig. 9(e). Further, since the photographing is performed manually, in many cases, photographing cannot be performed in the same state in which the photographed images are always the same. Therefore, when the image is tilted, it is preferable to perform correction by affine transformation in a portion overlapping with the state of the other teeth, and FIG. 9 shows a corrected view.

At the time of correction, as a reference portion, in addition to the mark ML, a vertical center line CL and a horizontal center line HL which are set in advance on the mirror surface of the mirror 902 may be used.

The vertical center line CL and the horizontal center line HL are not necessarily displayed on the image, and may be provided with a mark such as a protrusion corresponding to a vertical center line and a start point and an end point of the horizontal center line in the edge portion of the mirror. The degree is also displayed in a virtual manner according to the mark.

Further, it is also possible to perform a process of correcting the distortion caused by the lens of the CCD camera for photography.

The outline of the RM system mirror, the image actually photographed is a circular image in the outline RM, and is displayed as a quadrangular image for easy description of the range.

Since the image to be photographed is hand-held, the distance between the tooth and the camera is different. In this case, the image of the ML and the vertical center line CL may be marked as a reference to correct the size of the other captured image.

Further, there is a case where the obtained image is stabilized by causing the front end of the mirror 902 to slightly contact the tooth surface while performing the continuous shooting.

As shown in Fig. 8, the mirror 902 of the main body 904 is disposed on the left side from the front side, and then moved in the front direction to perform continuous shooting, and images such as Figs. 9(a) to (e) are acquired.

In this case, the image obtained by photographing at the timing at which the mark ML coincides with the vertical center line (CL) of the mirror 902 is used in the form of a composite image until FIG. 9(c). If the pattern shown in Fig. 9(d) and the following figure is used, there is a case where the result of the shift occurs during the synthesis, and therefore it is preferably not used for the synthesis.

In order to use the image 10(c) as the reference image mark ML as a reference, it is also possible to correct the tilt of the image or the like as needed, that is, to correct the image based on the long side and the short side of the mark ML as a reference image.

A synthesis operation example will be described below.

The image used in the synthesis is shown in Fig. 9(f). Fig. 9(f) corresponds to the image shown in Fig. 9(c), Fig. 9(g) corresponds to Fig. 9(b), and Fig. 9(e) corresponds to Fig. 9(a). The image 906e shown in FIG. 9(f) and the image 906d shown in FIG. 9(g) are superimposed on the common portion of the image in which the image 906d is aligned or approximated based on the image 906e.

In the case of overlapping with reference to Fig. 9(f), the portion of Fig. 9(g) that protrudes to the left is indicated by 1001a. 1001a becomes an image of the direction of the caries.

Then, based on the synthesized image of FIG. 9(g), the composite image shown in FIG. 9(g) and the composite image shown in FIG. 9(a) are visually or by image processing methods in common portions such as shapes. The image 906c overlaps. The portion of the superimposed image that protrudes to the left from FIG. 9(g) is indicated by 1001b.

1001b becomes an image of the direction of the caries.

Then, the operation is performed between the adjacent images, and the next adjacent image is superimposed on the common portion, thereby synthesizing the image from the predetermined position to the panoramic image in the molar direction to form the left side tooth row.

In addition, a method of forming a panoramic image of the left half by projecting the portions 1001a, 1001b, and ‧ ‧ which are projected to the center image as shown in Fig. 9 (f) can be exemplified.

Further, the detection of the protruding portion may also extract a portion protruding between, for example, 900e of FIG. 9(c) and 900d of FIG. 9(b), and further, extracted from 900d of FIG. 9(b) and FIG. 9(a). The portion protruding between the 900c is further concentrated on the portion protruding between the next adjacent images, and finally the reference image is set to 10 (f), and the protruding portion is joined to form a panoramic image. The image which is also prominent is preferably a case where adjacent images are superimposed from the top based on the image near the center.

Furthermore, even in the case where they are not completely overlapped and coincident or approximate, when the mark portions are commonly present, the above portions may be overlapped and the same composition may be performed. Furthermore, since it is manual, there is a case where the distance or the inclination is different for the obtained still image. In this case, it is preferable to automatically correct the affine conversion or the like, or to perform the adjustment by arbitrarily zooming in and out.

The state after the synthesis is shown in Fig. 12 (a). As shown in Fig. 12(a), a panoramic dentition image of the left half can be formed.

Then, as shown in FIG. 10(a), in a state in which the mirror 104 of the main body 103d is disposed on the right inner side of the tooth row 900a in the state of being vertically meshed, the distance from the surface of the tooth row 900a is kept as constant as possible, and The sequence of 1101a→1101b→1101c is performed in the direction in which the center is approaching, and continuous shooting using still images is performed.

The positional relationship between the still image and the tooth row 900a photographed in Fig. 10(b) is schematically shown.

When the user holds the intra-oral camera 901, it moves in the direction of 1102a→1102b→1102c→1102d→1102e→1102f, and captures a still image. Since the present embodiment is a hand-held type, the photographic image is tilted or shifted in the left and right direction and the depth direction. However, it is also possible to use an affine transformation to rotate the common portion existing between the adjacent images obtained by performing the continuous shooting. The step of moving the image to adjust.

The intraoral camera 901 shown in Fig. 10(a) is directly used in Fig. 8, and therefore, the same reference numerals will be given and the description will be omitted.

Figures 11(a) to (e) show representative images within the range of 1102a to 1102f of Figure 10(b).

For the common configuration between FIG. 11 and FIG. 9, the same reference numerals as those shown in FIG. 9 are attached.

In Fig. 11, Fig. 11(a) shows the vicinity of the image of 1102d of Fig. 10(b), Fig. 11(b) shows the vicinity of the image of 1102e of Fig. 10(b), and Fig. 11(c) shows Fig. 10(b). Near the image of 1102f.

Fig. 11(d) shows the vicinity of the image of 1102g of Fig. 10(b), and Fig. 11(e) shows the vicinity of the image of 1102h of Fig. 10(b).

Further, in FIGS. 11(d) and 11(e), the vertical center line CL is aligned with the mark ML, and then the photographic image when the mirror 104 is moved to the left direction is photographed from the left and right directions. The overlap of the images is increased and the image is shifted. Therefore, the above images are not used, and Figs. 11(a) to (c) are used.

Here, the image (1102f of FIG. 11(c)) in which the mark ML coincides with the vertical center line CL is shown in FIG. 11(f). Then, the portion common to the images 1102e and 1102f shown in Fig. 11(b) is superimposed.

The portion that protrudes from the state in which the image 1102e is superimposed or approximated in the shape of the image 1102f is 1201a.

Then, the superimposed image is superimposed on the image 1201b shown in FIG. 11(b) from the upper portion of the image having the same or substantially the same shape by using the pattern matching method or the like as a reference.

The portion protruding in the overlapping state is 1201b. The images adjacent to each other in the above manner are superposed and opposed to each other to form a tooth row on the right side. As another synthesis method, there are cases where the reference image 906e and the images 1201a and 1201b can be synthesized as shown in Fig. 12(b).

Furthermore, when there is a slight offset in the image before and after the overlap, it is also possible to delete either of the overlapping portions.

According to the above sequence, the continuous image is synthesized, and the central image 906e when the image of the left dentition is superimposed and the central image 1101c when the image of the right dentition is synthesized is uniformly and substantially identical, thereby forming FIG. 12 ( c) The illustrated panoramic tooth row 303.

The overlap is preferably performed by, for example, combining the left and right panoramic tooth rows according to the boundary portion (KL) between the teeth and the teeth of the center. Furthermore, there are cases where the boundary between the tooth and the tooth corresponds to the case of the upper jaw or the lower jaw, and the boundary portion of the upper or lower jaw tooth can also be used as a boundary for synthesis, and the synthesis at this time is also The panoramic dentition of the top dentition and the lower jaw of the upper jaw can be separately synthesized, and finally the upper and lower jaws are combined.

At this time, any image in the overlapping range may be deleted when there is a slight offset between the center images.

Further, there is a case where the pre-center image 906e and the center image 1101c do not have to overlap, and any of the center images 1301 can be used.

In the case of the above, when the center image 906e is used, for example, the size of 1201a and 1201b may be slightly corrected. When the center image 1101c is used, the sizes of 1004a and 1004b may be corrected. In addition to the method of joining the protruding portions between the images as described above, there is also a case where the central image is superimposed while being overlapped while the overlapping portion is not extracted.

As described above, from the center image, the left and right dentitions are combined, and the left synthetic dentition and the right synthetic dentition are combined, and these are synthesized based on the respective central images, whereby a panoramic dentition that suppresses the offset can be formed.

Preferably, for example, the combination of the center image and the contact line (edge) of the tooth and the tooth is used as a feature portion to synthesize the left synthetic tooth row and the right synthetic tooth row. Further, the mark is not necessarily attached to the tooth of the center, and may be a position of the tooth photographed at the timing of changing the direction of the camera at the time of photographing, and the position of the mark may be appropriately selected for other purposes or the like.

The feature portion is also the same as the mark, and is a portion that can be aligned when the image is synthesized, and is not particularly limited.

Further, by adding a mark to the tooth row as the subject in advance or setting a portion corresponding to the mark from the image, more accurate synthesis can be performed.

Furthermore, the above description of the action is performed by using the drawing software, according to the visual display of the plurality of images displayed on the computer screen, and the copying, dragging and dropping, zooming and zooming, tilt correction, etc. of the mouse operation. In the case of the case, a known automatic panoramic photo composition software (Photoshop Elements 7 (trademark) (manufactured by Adobe), Photo Stitch (trademark) (manufactured by Canon), or the like may be used.

3D panoramic dentition image

The dentition is curved in an arc shape with respect to the occlusal plane. When the overall situation is grasped, in the two-dimensional panoramic display, the condition of each tooth is known, but the display is performed in a state in which the teeth are arranged in a plane. Therefore, the grasp of three-dimensional is not sufficient, so that the method of displaying in three dimensions is preferable.

A method of obtaining a panoramic image using a physical image in the oral cavity is described in, for example, Japanese Laid-Open Patent Publication No. 2007/063980, in which a frame having a shape similar to a virtual curve having a basic shape similar to a dentition is formed and disposed on the side thereof. In the case of an image pickup device, the entire dentition is formed in a three-dimensional form, thereby obtaining a stereoscopic three-dimensional panoramic image.

It is true that the image of the dentition can be photographed in a stereoscopic manner, but there is an aspect in which it is difficult to say that it is a simple measurement method in order to form a frame having a virtual curve having a substantially similar shape.

Next, an embodiment in which a three-dimensional panoramic image of a solid image is formed will be described with reference to FIG.

Figure 13 is a block diagram for explaining a three-dimensional panoramic dentition image forming means.

The 1401 series photographic data input means is a means for connecting a camera for stereoscopic image photography having a plurality of cameras as shown in FIG. 14 and simultaneously forming an image of the same number as the number of cameras.

The photographic data input means 1401 also has a configuration in which a shutter image is pressed for each one and a photographic shooting in which a plurality of photographs are taken by one shutter, and a plurality of pairs of still images are continuously output.

The 1402 type correction means is a means for performing correction such as distortion, jitter, and the like due to the shape of the lens, correction of the distance and the like, and is a method known as a so-called calibration means.

The correcting means 1402 corrects each of the simultaneously photographed images, and sometimes removes the peripheral portion having a large distortion.

The 1403 is a common point detecting means, which is a means for detecting, for example, a common point of a pair of images. The common point detecting means 1403 obtains, for example, the sum of the luminance differences by using the luminance value of one of the pixels of one image or the pixel of a harmonic color as the reference luminance value, and using the luminance value of one of the other pixels or a pixel of the harmonic color. (SAD), the sum of squares of luminance differences (SSD) values and outputs a portion that is identical according to its minimum or maximum value or a portion inferred by sub-pixel estimation as a common point.

More specifically, it is also possible to use, for example, a new well Yuanji and others to edit, the correlation function in the block matching of images and the sub-pixel designation method, the research report of the Society for Information Processing Society, 2004, P33-40 The composition shown or other known methods.

The 1404 is a world coordinate conversion means for converting the coordinates of the respective images of the obtained common points into a common three-dimensional coordinate.

The world coordinate conversion means 1404 performs computer processing by an arithmetic method such as a trigonometry method, an 8-point algorithm, or a triangulation method, and uses the coordinate value of each photo image of the common point obtained by the common point detecting means 1403 according to the parallax value. Or the characteristics of the camera (the focus distance of the lens as the internal parameter, the image center, the pixel size, and the position and posture of the two cameras as external parameters), and the output world coordinates (X, Y, Z) are formed.

For example, the local coordinates (u1, v1) and (u2, v2) of the common point M of the respective images obtained by the perspective projection matrices P1 and P2 composed of the internal parameters and the external parameters of the different cameras are generally used. Known formula (1), the world coordinates (X, Y, Z) are obtained.

[Number 2]

The perspective projection matrix is obtained by using the internal parameters of the camera and the external parameters, or the perspective projection matrices P ₁ , P ₂ and ω1, ω2 are obtained by using the local coordinates of the complex points obtained from the respective static images, and according to the formula ( 1) A method of obtaining a world coordinate or the like, and a known method such as the method described in Journal of Electronic Information and Communication Society, Vol. 92, No. 6, 2009, 463-468 is preferably used.

Other methods for obtaining three-dimensional coordinates are described in, for example, dental materials, instruments, Vol. 19 No. 3333-338 (2000), and the like, but are not limited thereto, and other general methods can be employed.

1405 is a three-dimensional image forming means, and the world coordinate data may be displayed on, for example, a three-dimensional coordinate space virtually formed on a computer, and a wireframe model in which the coordinate data is connected by a straight line or a curved line is formed, and further, by The surface information is attached to the part surrounded by the line to obtain more realistic panoramic 3D data.

It is also possible to display a curved dentition by stereoscopically arranging the three-dimensional panoramic dentition data on the three-dimensional coordinates.

The 1406 display means is formed by a screen for a computer, a printer, or the like, and can be displayed as a virtual three-dimensional image on a general computer screen, and can also project a curved panoramic dentition image or the like two-dimensionally. display.

Fig. 14 shows an example of a probe 1500 for three-dimensional measurement in which probes of two cameras are provided at the tip end.

The 1501 imaging unit A has a lens 1501a disposed at the center, and has a so-called camera module form.

The 1502 imaging unit B has a lens 1501b disposed at the center, and has a so-called camera module form.

The 1503 illumination light irradiation unit is preferably provided around the imaging unit A1501 and the imaging unit B1502, and irradiates the light emitted by the light-emitting means 1505 formed inside the support member 1506 through the light guide path 1504 to the teeth as the subject. Part of the surface. The illumination light irradiation unit 1503 is preferably in a shape that is more uniform in illumination, and is not necessarily in the shape shown in FIG.

The 1503a is a light source for indicating, and is a portion for indicating the image of the image, and for the portion where the output of the spotlight is used, an LED such as red, blue, or white that covers the periphery with a black cylinder is used. Since it is the light of the spotlight, the area of the irradiation surface differs depending on the distance, so that the probe 1500 can be moved while being fixed.

The 1504 light guide path is formed inside the support member 1506, and the surface is preferably covered with a light reflection member such as a film such as aluminum or silver.

The 1505-type light-emitting means is housed in the support member 1506, and exemplifies a white LED and another light source. In this embodiment, a flash-like intermittent flash drive or a continuous illumination drive or the like can be performed.

The 1506-type support member is formed by, for example, a lightweight and rigid plastic material, and is provided with an image pickup unit or the like at the distal end, and has a shape of a rod and is easily inserted into a deep portion of the oral cavity.

The 1507 series operation switch is used for shutter operation. Any number of components can be set according to the operation specifications or purposes.

In the case of using a shutter, it is also possible to adopt a specification in which the shutter drive is continuously performed at a predetermined interval during pressing.

The 1508-type grip portion is integrally formed with the support member 1506, and is preferably formed of a lightweight and strong plastic material or the like.

The 1509 is an electric wire that is connected to an external power source and is connected to an external data processing device or the like, and may be a cable that uses a USB connector.

Further, the light source is a light-emitting device, and may be used when the connected data is temporarily stored in the inside of the camera or when Zigbee (registered trademark) or the wireless communication communication terminal is used for wireless connection.

The operation of this embodiment shown in Figs. 13 and 14 will be described.

In the photographic data input means 1401 of FIG. 13, the user holds the grip portion 1508 shown in FIG. 14 and causes the imaging portion A1501 and the imaging portion B1502 at the front end of the support member 1506 in a state where the upper and lower teeth are engaged as shown in FIG. When the size and position of the spotlight indicated by the light source 1503a are observed close to the subject, the operation switch 1507 is pressed to start the continuous shooting operation.

There is also a case where the operation switch 1507 for pressing the shutter is pressed every time the continuous shooting operation is performed, but it is preferable to reduce the continuous shooting of the pressing operation in order to prevent the shaking.

In the pressed state, the image is taken to the same position as that of Fig. 8(a), and then, in the same state as in Fig. 10(a), the same position is captured.

A pair of images in a group of images obtained by one-shot photography is shown in FIG. Further, in the case where the surface shape of the tooth is measured with higher precision in the oral cavity, the photographing in the approaching state is preferable, and the focal length of the camera is preferably set in a state in which the close-up can be performed.

The images to be photographed are output to the common point detecting means 1403 by correcting (calibrating) the distortion or the inclination due to the curved surface of the lens by the correcting means 1402 of FIG.

When three-dimensional processing is performed, it is preferable to perform the synthesis from the vicinity of the center in the left-right direction as shown in FIGS. 9 and 11 from the center, but the method is not particularly limited.

Fig. 15 (a) shows the image of the front side of the tooth, which is obtained by photographing the photographic material input means 1401 which is the constituting element of the probe 1500 of Fig. 14 .

The 1701a is an image of the imaging unit B1502, and the 1701b is an image of the imaging unit A1501. Each of the images is given a coordinate having the center point as the same portion. For example, an arbitrary point A (x1, y1) of the image 1701a of FIG. 15(a) photographed by the imaging unit B1502 is set, and a point A' indicating the same position is found. (x2, y2). The point A is used as, for example, a block of one pixel, and an average luminance value is obtained. In the vicinity of the position of the point A' of the image data 1702a of FIG. 15(a), the pixel block of the same size as the point A is obtained, and the sum or square of the difference between the luminance values of the two is obtained, and the same is performed. The calculation gradually moves toward the point A'. A consistency evaluation curve is formed.

On the coincidence evaluation curve, the sub-pixel estimation method in which the sum of squares of the difference values or the square of the difference is minimized or the portion that becomes the largest is set to the point A' is preferable, but if the method of obtaining the common point is It is not specifically defined here.

Then, the same operation is performed on the adjacent pixel blocks of point A of 1701a, and the common point is detected from the image 1702a. Repeat this operation. The coordinates of the common point are obtained in the common range 1703a in which the range of the images 1701a and 1701b is removed.

In this case, the common point coordinates are formed centering on the position of the newly added mark ML, and a common point with higher precision can also be obtained.

Further, if the block is reduced, the common point can be detected in a state where the accuracy is higher, but the processing time becomes longer, and therefore the size of the block or the like can be appropriately selected.

Then, in the world coordinate conversion means 1404 of FIG. 13, the coordinate value obtained by taking the complex point from the common point, for example, is converted into a three-dimensional world coordinate system based on the parameters unique to the camera such as the parallax and the focal length. The specific method is preferably a conventional method represented by the above documents and the like.

After the common point is obtained for the image using one of FIG. 15(a), the common range 1703b for removing the occlusion range is converted into a three-dimensional world coordinate using the image pair 1701b, 1702b shown in FIG. 15(b). In the state of being a three-dimensional world coordinate, it is formed into, for example, a wire frame shape as shown in Fig. 15 (d).

Further, the three-dimensional world coordinates of the common points of the common range 1703c of the removal eigenranges of the image pairs 1701c and 1702c shown in FIG. 15(c) are obtained.

Then, in the three-dimensional image forming means 1405 shown in FIG. 13, the three-dimensional coordinates obtained according to FIG. 15(a) converted to the world coordinates are not overlapped with the plane in FIG. 15(b) but in the virtual three-dimensional coordinate space. overlapping.

Further, the three-dimensional world coordinates shown in FIG. 15(c) are superimposed on the superimposed images.

If the overlap is an overlap in the virtual three-dimensional space, the wire frame-shaped dentition shown in FIG. 15(d) can be virtually displayed on the computer screen according to the three-dimensional world-stabilized data. Performing a visual operation and operating a computer interface such as a mouse to overlap each other. When the accuracy of the overlap is improved, the difference is minimized by differential comparison or the like based on any of the compared three-dimensional values. The state of synthesis is better. A common point can also be obtained by using a block matching sub-pixel inference method.

15(a) to (c) form a tooth row based on the three-dimensional world-coordinated data of the right tooth row toward the front surface, and then the three-dimensional world coordinate of the left tooth row is performed.

The world coordinate system may be a method known as the above-described method, and may be a converter that converts the three-dimensional coordinates of the two images to the world coordinates that are common coordinates.

It is also possible to combine the three-dimensional world coordinates of the left and right dentitions by means of a three-dimensional virtual display of the computer or by using a uniform approximation of the values of the coordinate values.

In this case, it is preferable to overlap based on the three-dimensional coordinate data of the mark portion. According to the method, not only the two-dimensional even three-dimensional coordinates, but also the display means 1406 shown in FIG. 13 can be used to perform the offset-free panoramic tooth. The column is displayed.

The overlap is the overlap of the data values of the same shape portion. In the case of inconsistency, the method of using the method of overlapping the average values of the coordinates of the two and the manual method of dragging and dropping the image on the screen is performed, while operating the computer mouse A method of obtaining a coordinate value after overlapping one side.

Furthermore, there is also a case where, even in the case of an image having a mutual commonality, depending on the photographing condition and the image after the correction is in a poor relationship image, any one of the common images can be selected. In order to make a panoramic image, it is also possible to use an image of a portion of the side that does not overlap.

By utilizing the three-dimensional synthesis according to the world coordinates, the entire dentition can be displayed as a so-called denture.

The panoramic digital image display on the side of the two-dimensional tooth and the panoramic digital image display on the side of the three-dimensional tooth make it easy for the patient to understand the overall dentition state of the patient, and thus can also form the following aspects: for example, the second The panoramic dentition data and the three-dimensional panoramic dentition data are each subjected to a correction simulation process and a virtual whitening process to form an image of the state of the virtual dentition and placed on the computer screen so that the patient actually feels the effect of the treatment.

The correction simulation process refers to, for example, a two-dimensional panoramic dentition image, and a database of various shapes of one tooth is formed in advance according to the part, and the image of each tooth on the two-dimensional panoramic dentition image is formed on the drawing software by the corrective dentist. The computer mouse is used to copy and paste, and the virtual correction of the panoramic dentition is formed.

In the case of a panoramic three-dimensional dentition image, three-dimensional coordinates have been set, so that it is exemplified on the existing CAD software, and the corrective dentist performs the three-dimensional coordinate adjustment of the panoramic three-dimensional dentition image to form a virtual correction three-dimensional panoramic dentition. These corrective panoramic display methods are exemplified, and other methods may be employed.

The virtual display after the virtual whitening of the panoramic 2D and 3D dentition images of the patient may also be recorded by the dentist to adjust the color data of the images on the drawing software. As described above, the person who performs the virtual correction and the virtual coloring treatment on the panoramic dentition of the patient patient is provided on the screen, whereby the patient can deepen the understanding of the treatment.

Specimen light irradiation

Figure 16 is a diagram showing an embodiment of the present invention.

The A10-type mirror unit is formed of a hard plastic or the like, and is provided with a mirror A10K provided at a predetermined angle (for example, 45 degrees) at the front end, and a cylindrical mounting portion connectable to the outer periphery of the photographing unit A14 at the rear end. A10S, the middle of which becomes an open shape.

The connection between the mounting portion A10S and the photographing unit A14 is formed by being inserted, and the disengagement is also only possible to be separated. In order to prevent rotation, it is also possible to provide irregularities for both, or to form an asymmetrical shape such as an ellipse. .

The A11 series housing is made of plastic or resin. It has a cylindrical ball-like shape with a large diameter and is easy to hold. The camera unit A14 is arranged at the front end and connected to the external processing device at the rear end. Cable A15.

The A12 dentist, dental hygienist, and the like directly observe the observation direction when the mirror A10K at the front end of the reflection unit A10 is disposed at a predetermined angle.

A13 is an example of an irradiation surface of the collimated light when the collimated light output from the self-illuminating light source A142 is reflected by the mirror A10K and irradiated to the tooth surface.

The position of the sighting light source A142 is arbitrary, and if it is a position at which the range of the photographed image can be determined, it may be another position, for example, the front end portion of the mirror unit A10 or the portion of the illumination photographing range. In this case, since the optical path is shortened, there is a case where the range of the photographic image can be illuminated even if the pointing angle is slightly enlarged.

A state in which the photographing unit A14 is enlarged is shown in Fig. 16 (c).

The A141 is a light source for illumination with a wide range of pointing angles, exemplifying a combination of LEDs or lenses and LEDs. The illumination light source A141 is disposed in plural numbers around the imaging member A143.

The A142 is a light source for illumination, and is exemplified by an LED having a small pointing angle or a combination of a lens and an LED to perform an output that can have a predetermined range on the illuminated surface.

Further, in the case of a light source having a small angle of pointing, it is preferably arranged at intervals of a predetermined number.

The A143-type photographic member is formed by a CCD or CMOS camera, and the number of pixels is preferably more.

The A15 is a cable for connecting to an external image display device. In addition to a universal cable such as a USB cable, it can also be formed by a dedicated cable.

The A16a and A16b operation buttons A and B are composed of a push type, a pull type, or a rotary type. When the operation button AA16a is pressed for each button, the sight light source A142 emits light for a predetermined time and passes through the mirror. The main part of the A10H irradiation is only fixed for a fixed period of time.

The user can recognize at least the time of illuminating the main portion of the oral cavity at a fixed time, and it is preferable to press the operation button AA16a or the like until the timing of photographing.

In the case of photographing, since the illumination portion having a different color from the still image is formed, the observation is not preferable, and when the observation is not hindered, it is not necessary to particularly eliminate the collimated light, and the flicker may be caused to be flickered. User discriminator.

Next, the operation of the embodiment shown in Fig. 16 will be described.

The illumination output of the illumination light source A141 mounted around the photographing member A143 of the photographing unit A14 illuminates the teeth AH1 in the oral cavity via the mirror A10K. A14L is the standard light path.

In addition to this, the illumination light source is also irradiated via the mirror A10K, and one of the illumination light surfaces is in a state in which the illumination light irradiation surface A13 is formed.

The photographing member A143 is input to the portion of the irradiated oral cavity via the mirror A10K, and is displayed by the external screen device via the cable A15.

A user such as a dentist can use the image displayed on the external screen device to grasp the position of the photographing, shorten the time of the treatment or include the treatment, and the like, in many cases, the same use as the dental mirror is observed, and the observation direction is A12. The display is in a state different from the photographic image. At this time, for example, the operation button AA16a is pressed. When the operation button AA16a is pressed, the illumination light source A142 emits light, and the light emission is performed for a predetermined period of time, preferably before the start of shooting, and the viewer observes the observation position and the photographing position to emit light.

The observer performs the movement of the mirror A10K in order to match the photographing position with the observation position, and adjusts the photographing position and the observation position by pressing the operation button AA16a again.

When the positioning is completed, the still image or the animation is recorded by pressing the operation button AA16a or the operation button AB16b again. The operation contents of the operation button AA16a and the operation button AB16b are exemplified, and may be appropriately selected depending on the situation.

The above example is shown in Fig. 16(b).

An example of the A17 image is a tooth AH1 for photography purposes. The irradiation range of the illuminating light is a range of a circle indicated by the illuminating surface A13, and includes substantially all of the main parts for the purpose of photography.

The range of the light-irradiating surface A13 is a combination of the casing A11 and the mirror unit A10, and is changed by moving up and down with respect to the tooth H1, and the user can reverse the casing A11 and the mirror unit A10 upside down and adjust. The range of photography becomes larger or smaller, does not shift from the main part of the photographing range, and is more representative of the main part of the photographing range than the point source.

Through the above operations, the photographic and observation surfaces are adjusted to record accurate still images or animations.

By holding the casing A11 shown in Fig. 16(a), the observation portion in the oral cavity is vertically and horizontally moved by the mirror A10K so as to capture the target portion, and observation is performed.

The intraoral camera is inserted into a narrow and deep portion of the upper or lower jaw of the oral cavity, and the scope of the mirror is spread over a wide range and the oral cavity is photographed in a state where the mirror is inverted. Even if the image is tilted, facing one side, etc., the photographic image is also tilted or reversed.

Therefore, the present invention has a case where it is provided with an image refining means for detecting a photographing state by a position sensor and trimming it to a horizontal state in a state in which the image is upside down or tilted.

Photographic correction method

Fig. 17 is a cross-sectional view showing an example of an intra-oral camera used to explain an embodiment of the present invention.

The housing for gripping the A21 has a cylindrical shape having an internal space, and the elliptical cylindrical photographing unit A23 formed by the camera and the illumination light source formed around the camera is connected in a state of being protruded more than the housing A21. At the front end, a cable A26 for connecting to an external display device is connected to the rear end.

One of the illumination units is illustrated in Fig. 16(c).

The A22-type mirror unit is provided with a mirror A22H that is disposed at a predetermined angle at the front end, and a cylindrical mounting portion A22S that is attached to the periphery of the photographing unit A23 at the rear end, and is otherwise formed. Open state.

The A24-type circuit board is mounted inside the casing A21, and an image processing IC or the like is mounted. The A25a and A25b position sensors have an IC wafer shape mounted on a circuit board. The number of position sensors and the mounting location are examples. Depending on the type of sensor, there is also a case where it is not installed.

The position sensors A25a and A25b are acceleration sensors, angular velocity sensors, etc., and the intraoral camera can obtain a wide range of movement states. Therefore, sensor elements that do not become unmeasurable depending on the angle are used. The number of position sensors is expressed as two. For the sake of illustration, the number of wafers varies depending on the number of axes, and there is also a case where there are three axes.

The acceleration sensor and the angular velocity sensor exemplify a three-axis sensor, and the number of position sensors is also adjusted by the number of axes.

Examples of the x-axis, y-axis, and z-axis of the position sensors A25a and A25b‧ are shown as the axes shown in FIG.

In the case where the position sensors A25a, A25b are set as angular velocity sensors (gyro sensors), the angular velocity sensors respectively output, for example, the amount of change due to the movement around the x-axis, respectively, due to the surrounding y The amount of change in the angle caused by the movement of the axis, and the amount of change in the angle caused by the movement around the z-axis.

In the case of the angular velocity sensor, the amount of change of each axis is accumulated in a state where the initial state of the x-axis, the y-axis, and the z-axis is arbitrarily set, and the photographing state of the camera is detected.

On the other hand, the acceleration sensor outputs an acceleration component in the x-axis direction, an acceleration component in the y-axis direction, and an acceleration component in the z-axis direction. Further, the composite vector output posture vector of the acceleration components respectively represents the gravity acceleration vector when in a stationary state. According to the posture vector, the photographing state of the camera can be obtained.

For example, in order to stop the acceleration sensor, the state of the gravity acceleration vector is output as a posture vector, and the vector in the x-axis direction, the y-axis direction, and the z-axis direction in this state can be used as the reference posture, and then the angular velocity can be used. Since the sensor performs a method of calculating the amount of change in the rotation of each axis, etc., it is also possible to detect various states of the camera by combining both the acceleration sensor and the angular velocity sensor.

Fig. 18 is a block diagram showing an example of a means for trimming an image display state using a position sensor. The configuration shown in the block diagram may also be part of the execution of the program if it is computer processing.

The A31 system photographing means means for photographing an animation or a still image using a camera disposed at the center of the photographing unit A23 of Fig. 17.

The A32 image processing method consists of a video recording memory, a CPU (Central, etc., temporarily recording an image obtained by the photographing means A31, and rotating the image according to the camera angle information of the position detecting means A34 to form an image which is easy to observe. data.

For example, the photographing unit A23 performs photographing, defines a reference posture of the image projected on the screen, and moves the casing with respect to the reference posture. When the reference posture image is rotated, for example, an angular velocity sensor or the like according to an angular velocity in each axis. The amount of change in the rotation angle is detected, and the image is rotated and displayed only by subtracting the angle obtained by the portion of the rotation angle change, thereby forming an image that is easy to observe.

Furthermore, there is also a case where the image can be trimmed using only the rotation around the y-axis shown in Fig. 19.

In the case of photographing an image in the oral cavity reflected by the mirror, the camera of the photographing unit A23 always faces the mirror direction, and therefore the image is rotated because the shell mainly centered on the y-axis coordinate shown in Fig. 19 is mainly performed. The rotation of the body.

Therefore, there is also a case where it is preferable to correct the image projected on the xz plane to the image at least in a state in which the housing A11 and the mirror unit A10 are changed in the x-axis, the y-axis, and the z-axis direction. The state in which the display portion faces the fixed direction.

The 33-series image display means that the screen of the computer and other dedicated screens can be used to display the output image of the image correcting means A32.

The A34 system position detecting means is composed of position sensors A25a, A25b, etc. of Fig. 17, specifically, a rate gyro output angle, an output angle rate integrating gyro, a posture gyro, a MEMS type, and other machines. Acceleration sensors such as optical, isometric speed sensors, piezoresistive, electrostatic capacitance, and thermal detection type MEMS sensors.

Next, the operation of FIG. 18 will be described using FIG. 17 and FIG.

The coordinate axis shown in FIG. 19 indicates that one position sensor corresponds to the three-axis. When the position sensor corresponds to one axis, two axes, etc., the position corresponding to the position sensor is set. The coordinate axis.

The housing A21 shown in Fig. 17 is hand-held, and the mirror A22H is inserted into the oral cavity for the purpose of photography. At this time, the initial posture state is recorded by operating a switch or the like attached to the casing A21. An example of the coordinates in the expected posture state is shown by A410 of Fig. 19.

The coordinate axis is formed by the setting of the position sensor. In the present embodiment, A421 is set to the x-axis, A431 is set to the y-axis, and A441 is set to the z-axis.

Furthermore, the A451 gravitational acceleration vector is an example of a pose vector synthesized by the acceleration sensor at rest. Therefore, there is a case where the gravitational acceleration vector is not available when the acceleration sensor is not used.

The intra-oral camera is a coordinate that is close to an upright state, for example, in order to photograph the side of the molar.

A422 is the x-axis, A432 is the y-axis, and A442 is the z-axis. When the acceleration sensor is used, A452 can represent the gravitational acceleration vector.

The mirror 22H is moved to a target portion in the oral cavity. An example of the moving method is shown in FIG. The intra-oral camera constituted by the mirror 22H and the casing moves vertically and horizontally as shown by A411, A412, and A413, and the imaging means A31 is an intra-oral image in each state of still image or animation, and is output to the image trimming means. A32.

The position detecting means A34 outputs the initial posture information to the image trimming means A32, for example, with respect to each of the x, y, and z directions. Furthermore, as in the case of the present embodiment, when the image of the mirror is displayed, the camera is oriented in the direction of the mirror. Therefore, in many cases, the camera image is inverted and becomes invisible. The main reason is that the y-axis is around the y-axis. Since it is rotated, it is also possible to use only a 1-axis type position sensor. The image trimming means A32 associates the initial posture information with the image, and outputs it to the image display means A33 for display.

As shown in FIG. 19, when the intraoral camera is moved like A411, A412, and A413, and the inside of the oral cavity is photographed, the photographing means A31 outputs an image corresponding to each posture. If the camera rotates around the y-axis, the image is photographed upside down and an image corresponding to the photographing state is output.

The position detecting means A34 detects the angular velocities around the x-axis, the y-axis, and the z-axis using position sensors A25a, A25b (for example, the case of a gyro sensor), and detects the amount of change in the angle around the x-axis by using the angular velocity (? Θyz), the amount of change in the angle around the y-axis (Δθxz), and the amount of change in the angle around the z-axis (Δθxy).

These changes are output to the image trimming means A32. The image trimming means A32 returns the image to the original image based on the image data input from the photographing means A31 and the position information output from the position detecting means 34, for example, based on the amount of change in the angle.

Therefore, even if the image display means A33 rotates the camera to capture the same object in the mouth with the animation or the still image, the image can always be displayed in the first set state.

Furthermore, in the case of using a convex mirror to photograph the full teeth of the jaws and the jaws, a fisheye lens correction means using the method described in the document (Design Wave Magazine 2008 December P113-115) can also be applied.

Photographic motion timing adjustment

According to the present invention, the method of pressing the switch operated when the physical image is obtained is adjusted to the time until the actual photography is performed, for example, the number of times of pressing in a fixed time, such as a double-click method, during computer operation, so as to be inspected by the dentist during the treatment. At the time of the patient's explanation, the camera operation can be stabilized. Further, it is also possible to specify a display (for example, two times and two seconds, and then several consecutive shots) indicating that the switch of the camera is operated on the screen image to display the timing of the shooting operation timing, and the timing is determined.

Further, when a display function such as a coordinate is performed on the screen, the timing of the display is adjusted according to the number of times of pressing the operation button, the pressing method, or the like, and the image display can be adjusted when the camera is inserted into the oral cavity for explanation. Timing. The specific timing specifications can also be input and adjusted from the screen of the mobile terminal.

An example of the timing adjustment means will be described in detail with reference to Fig. 20 .

In Fig. 20, B7001 is an input means for indicating, for example, buttons 101d and 101e constituting the operation interface of Fig. 1.

The B7002 is a method for detecting the number of input times, and is composed of a counter, a flip-flop, and the like, and counts the number of times the button is pressed. Preferably, the count is counted over a predetermined time interval.

The B7003 is a delay means for setting the delay time by multiplying the number of presses by the delay time per press. After the delay time, a pulse is output.

The B7004 is a photographing output setting means that outputs a signal for starting photographing to the photographing means B7005 when the delay pulse of the delay means B7003 falls.

The photographing means B7005 performs continuous or animated photographing of several to several tens of still images based on the signal of the start of photographing.

The image obtained by the photographing is input to the image input means B7006, and the image having the focus is selected by the image selecting means B7007, and stored or displayed on the display 104 shown in FIG. 1 by the storage display means B7008.

The B7006 is an image input means for acquiring an image obtained by the photographing means B7005 as digital data and outputting it to the image selecting means B7007.

The B7007 is an image selection means for selecting only images having a focus, for example.

The B7009 is a display means for visually notifying the configuration of pressing the button of the input means B7001 until the execution is performed, by changing the blinking position.

The display means B7009 is placed in a conspicuous place during the treatment of the dentist, and after the operation button is pressed, the author is started a few seconds later, and the display is also displayed on the screen of the computer as one of the display means B7009.

Moreover, during the delay time, the color is red, and the user can recognize the indicator in the delay time by setting the LED that changes to white when the delay time ends or the light source that continuously emits light or blinks only in the delay time. There is ample button operation and the range of intraoral operations can be expanded.

X-ray photography

Figure 21 (a) is a block diagram showing an embodiment of the present invention.

The B8011 is an X-ray imaging means, exemplifying a combination of an X-ray output device and an X-ray CCD sensor or a combination of an X-ray output device and an X-ray fluorescent plate and a CMOS or CCD camera. Specifically, an example is shown in FIG.

In the X-ray imaging method, the existing panoramic X-ray imaging device, X-ray CT (Computed Tomography), dental X-ray device, etc. are also included, and at least the data can be displayed on the computer screen. When it is not possible to directly obtain the X-ray image data that is opened, it can also be used as a data copying of the X-ray image attached to the computer, a hard copy of the screen, a data in a common state of the screen image, and a photography screen using the intraoral camera. Obtained from the X-ray image data obtained from the X-ray image. Further, there is a case where the configuration of Fig. 21 (b) is included.

The B8012 is a solid image photographing means, and preferably, for example, a reflective intraoral camera.

The physical image capturing means B8012 further includes the configuration shown in Fig. 21 (c).

The B8013 is a comparison portion extracting means formed by a block matching method and a sub-pixel estimation method, and is a method for extracting a comparison portion for extracting a portion corresponding to the image photographed by the X-ray image capturing means B8011, and for performing, for example, The contour of the captured image is extracted, and the pixel values of the complex number are extracted, and the X-ray image is extracted.

The B8014 is a comparison portion extracting means formed by a block matching method, a sub-pixel estimation method, or the like, and is a method for extracting a comparison portion for extracting a portion corresponding to the image photographed by the solid image capturing means B8012, and performing For example, the contour of the captured image is extracted, and the pixel values of the complex number are extracted to output the physical image extraction data.

The B8015 is a comparison means that compares the extracted data outputted from each of the comparison site extraction means, and outputs a portion that is consistent, substantially identical, and inferred to be a uniform portion.

In the case of comparing and zooming in and out of the image, it is possible to convert the physical image and the X-ray image data into a general form such as BMP, JPEG, GIF, etc., and perform enlargement and reduction processing by a general drawing software.

The B8016 is a matching unit recording means, and records the matching portion, the substantially identical portion, or the estimated matching portion, and transmits it to the display means B8017.

The B8017 is a display means for exemplifying a screen (display) device of a computer, a mobile phone display unit, and the like, and is capable of clearly displaying an X-ray image at least in such a manner that at least the display of the X-ray image and the physical image is displayed in a superimposed manner and overlapped. The degree of resolution can be.

This embodiment is realized by a computer software, and can also be formed by a hardware.

The X-ray imaging method and the physical image capturing means may also be separate devices, but it is more preferably a state in which one of the devices is partially exchanged and shared.

The operation of this embodiment will be described.

The portion is measured by animated or still image photography by X-ray imaging means B8011. The portion to be measured by the X-ray imaging means B8011 is performed by selecting one tooth, a plurality of teeth, or a full tooth of the upper jaw, the lower jaw, or the like.

Then, using the physical image capturing means B8012, the portion photographed by the X-ray image capturing means B8011 is photographed by animation or still image.

It can also be accurately positioned and photographed in the same part, and can also be photographed according to the standard.

Correct the distortion of the image obtained from both. The correction method may be, for example, a calibration method in which a pre-shooting is used as a reference grid, and a distortion value due to the lens is calculated to correct the data.

Then, the feature portion is calculated by the comparison portion extracting means B8013 and B8014. The feature portion is, for example, a contour, which extracts part or all of the outline of the tooth in the case of X-ray and the contour of the tooth of the solid image.

Then, compare the outlines of the two. At this time, the X-ray image and the solid image are in a state in which one of the contours is identical or substantially coincident, and the overlapping portions of the two images are taken out.

The comparing means B8015 outputs the two duplicated images to the matching portion recording means B8016, and the matching portion recording means B8016 records the two images.

The display means B8017 displays two images according to the user's selection, and overlaps or juxtaposes in the penetrating state.

Fig. 23 shows an example of an image photographed by an X-ray image capturing means and a solid image capturing means. Fig. 23(a) is an X-ray image showing the tooth b101 obtained by X-ray imaging. (b) shows the tooth b102 of the solid image obtained by photographing at the same portion as (a).

(c) is a person who displays the repeated image b103 displayed by superimposing these. X-ray images can be easily understood by comparing X-ray images with solid images.

In particular, the physical image display can show the presence or absence of color, swelling, and inflammation of the gums. Therefore, by cooperating with the X-ray image, the patient can easily display the periodontal disease, the degree of development of the tooth decay, or the presence or absence of the tooth decay.

Next, a specific example of the X-ray imaging means will be described in detail with reference to FIG.

In Fig. 22, the B9101 is a holding case, and it is preferably formed of a lead-containing plastic material or the like for the purpose of preventing the X-ray from penetrating.

The B9102 is an X-ray output device, preferably a portable portable product for dental use, but is not particularly limited. If it is an X-ray output device used in dental treatment, it can be fully utilized functionally. The portable type is effective even at home, and is preferably used for X-ray images combined with physical images. Even if it is portable, it can be used in a stand.

The B9103 is an electric conductor, and a universal USB cable is used. In addition to this, a dedicated cable or the like can be used.

B9104 is a X-ray phosphor used on a glass substrate to grow phosphorescent materials CsI, CaWO, Gd ₂ O ₂ S: Tb ³⁺ , 549 nm (ff), (Zn, Cd) s:Ag crystals. Those who have been coated, etc.

The B9105 is a visible light penetrating member formed of a light-transmitting member containing lead and used to penetrate only visible light.

The B9106 is a photographing unit. In this case, it is also possible to use only a camera, and it is preferable to use a higher resolution.

The B9107 X-ray imaging support member is formed of a lead-free X-ray non-penetrating member, and has a mirror B9108, an X-ray phosphor B9104, and the like attached to the tip end, and the other end is inserted and fixed around the photographing unit B9106. And the formation of an open cylinder.

The B9108-based mirror is formed at a state of, for example, 45 degrees, and is formed by a planar mirror, and is a reflection image for reflecting the X-rays and transmitted to the photographing unit B9106.

(a) X-rays output from the X-ray output device are converted into visible light by the X-ray phosphor B9104, and then the X-ray component is removed, reflected by the mirror B9108, and then input to the imaging unit.

B9109 is the outline of the tooth in the oral cavity of the photographic part.

(b) An embodiment in which an X-ray image of an X-ray sensor and a solid image using a mirror are combined.

The B9110-based X-ray imaging support member is formed of an X-ray non-penetrating member similarly to the X-ray imaging support member B9107 shown in Fig. 2 .

The B9111 visible light penetrating member is formed of a light-transmitting member containing lead, and is a filter for removing X-rays and transmitting visible light to the imaging unit B9106.

The B9112 is a mirror, a flat mirror, and the B9113 X-ray sensor is formed by a built-in X-ray CMOS (CMOS) sensor and imaging plate.

B9114 is a wire that transmits the sensor signal of the X-ray sensor to the outside, preferably it is also covered with a lead-containing resin.

In addition to the X-ray sensor B9113, the present embodiment has a configuration for outputting X-ray visible light images and solid images at the same timing by the combination of the mirror unit and the photographing unit B9106.

The combination of the combined mirror B9112 and the X-ray sensor B9113 is preferably as follows: the solid image shows the back side of the tooth, which is easy to contrast with the image taken from the front of the tooth, and can simultaneously acquire the solid image in the same part. With X-ray images, it is not easy to obtain image processing that seeks a consistent range.

X-ray images in the oral cavity are difficult to understand for patients. It is easier to understand X-ray images by displaying the physical images of the same photographic part in parallel or penetratingly on the computer screen, paper surface, etc. The description of the patient becomes easy.

Regarding the X-ray image, in the case of dental X-ray, several teeth are photographed as one piece or one piece of information by one shot. In this case, while moving the X-ray sensor and the X-ray output device, for example, continuous shooting is performed, and a plurality of X-rays are imaged for the entire cymbal, and then contour extraction is performed as digital data. Moreover, it is also possible to detect a common portion of the image with less distortion in each adjacent X-ray image and to use a block matching method or to overlap them to detect a coincident and inferred point to form a panoramic image. Furthermore, the solid image also forms a panoramic image. By printing the images on a screen or on paper, it is possible to form a data that can be easily understood.

An example will be shown in Fig. 23 (d) (e). Fig. 23(d) shows the state in which the physical image data is digitally processed and joined, b104 is the upper data, and b105 is the lower data. For example, the intra-oral camera shown in Fig. 1 is used to gradually move the position, for example, to photograph the upper information (b104), and to overlap and join the common portions of the respective images. The squatting data (b105) is also made in the same manner, and means that the image is made into one image, and the squatting squat is simultaneously photographed, and the common portion is overlapped while being joined. The continuous camera system shows that the image is continuous in composition and continuous in size, so that it is easy to see the connected portion and the size adjustment is also small.

In the case of obtaining a panoramic solid image as described above, an intermediate luminance value method, a block matching method, an optical flow method, or the like can also be used.

Fig. 23(e) shows that the X-ray image b106 and the lower X-ray data b107 are joined in the same manner, and further, in the state where the data b105 is superimposed under the solid image, the patient can easily observe it.

In this embodiment, in order to compare the physical image of the oral cavity, the X-ray image Y, the virtual corrected panoramic dentition image, the panoramic dentition image using the virtual color matching, etc., the patient is made "on the computer screen, the printing of the paper, and the printing". Visualize the patient's mouth, thereby promoting continued treatment, effective prevention, and increased self-pay for active treatment.

In addition, X-rays and solid images are used to display the parts of the gums and the tibia that need to be replenished, and the state of the tibia as the condition for artificial root formation or the state of the virtual remedy in the physical image can be performed according to the X-ray image. A regeneration area utilizing bone regeneration means can be displayed.

The physical image, the X-ray image, and the microscope image are collected as a multi-faceted image, and can be easily observed. Therefore, by displaying the image and outputting the result of the editing, the patient can easily understand the treatment according to the condition of the oral cavity. The order of prevention.

The photographing of the solid image is performed by, for example, coloring tartar such as oleander red, and visually observing the tartar adhesion state, and then forming an image shown in FIG. 23(d) and recording it in a recording apparatus, and observing the adhesion state of the tartar and the condition of the gums. Further, tartar was taken according to the condition of the gums, and a periodontal disease image was formed using a microscope, and image editing was performed in a state related to the site to be taken.

Further, an intraoral map in which the condition of the periodontal disease is displayed in an easy-to-observe manner in a five-stage manner can be used as the image data and the printed material, and the periodontal disease prevention and the tooth decay prevention can be performed satisfactorily.

Image data showing tartar using a red coloring agent is obtained by obtaining a solid image forming means using the photographic image of the full or partial tooth of the above-mentioned panoramic specification.

The gradation value is detected by detecting a degree of fading of the redness of the image data by, for example, a luminance value detecting method using a software.

By setting a fixed value in the shading value, for example, a value in which the thickness of the thickness in the state in which the periodontal bacteria are easily propagated exceeds the value converted in the luminance value, the attention mark is attached to the above portion of the image data. The means for synthesizing the marks on the screen, etc., when the image printed in the oral cavity is output by a computer screen or a printer, the portion where the amount of tartar adhered is automatically displayed.

The output display and the condition of the gums can be observed from the image, so that the detection, prevention, and treatment of periodontal disease can be performed efficiently.

Virtual make-up treatment display in the mouth

The invention combines the X-ray image and the solid image to form an easy-to-understand image, and then superimposes the virtual shape or color information of the make-up on the image and synthesizes the image, and can display the virtual after treatment easily. status.

As an example, a configuration is shown in which a means for synthesizing the virtual shape shown in FIG. 21(b) is added to the rear end of the X-ray image capturing means B8011 shown in FIG. 21(a), and FIG. 21(a) is shown. The physical image capturing means B8012 shown is a means for synthesizing the virtual shape shown in Fig. 21(c) in the latter stage.

Further, it is preferable to include a storage means B8022 such as a virtual shape that is stored in advance and stored in a virtual shape for use in virtual composite display.

As a virtual shape or the like, the denture, the bridge, the snap ring, the implant, the inlay, the crown, the other make-up, the corrective device shape information, and the virtual shape also include color information, and may also include, for example, A colorimetric plate composed of a plurality of color samples having a tooth shape used for determining the color tone is used in advance or stored, and the obtained color information of all teeth or one tooth is obtained.

The storage of the data is stored in the X-ray image or the physical image of the oral cavity of the patient, and may be sequentially stored in the image by adding correction, sorting data, etc. as needed.

In Fig. 21(b), the B8018 is a virtual shape adjustment means for X-ray images. In the X-ray image capturing means B8011 to be photographed, the X-ray image to be captured can be X-ray image according to its size. It is easy to distinguish the virtual shape specified or automatically recalled by the user from the storage means B8022 such as the virtual shape, and is adjusted to a state in which the color can be adjusted to be uncomfortable and synthesized. B8019 is a means for synthesizing X-ray images, which is a means for synthesizing X-ray images and virtual shapes and displaying them on a screen.

In FIGS. 21(b) and 21(c), the virtual composite display means is added as a means of attaching to the photographing means, and is not limited to the accompanying person, and may be set as a main configuration depending on the purpose. Moreover, the configuration in which the physical image and the X-ray image are superimposed is not required in FIG. 21, and the physical image and the X-ray image may be separately combined for virtual display. The composition is a common form of BMP, JPEG, GIF, etc., and the overprint method can be used in the same manner as the grid display or the penetration method or the overlapping method used in the general drawing software.

In Fig. 21(c), the B8020 is a virtual shape adjustment means for solid image, and has the same configuration as the virtual shape adjustment means for X-ray images. The B8021 is a composite display means, and has the same function and configuration as the synthetic display means for X-ray images.

The composite configuration of the virtual display shown in Fig. 21 will be described in detail with reference to Fig. 28 .

In Fig. 21(a), the X-ray image capturing means B8011 is used to image and form the full-tooth X-ray image b201 shown in Fig. 28(a). The image is obtained from, for example, a panoramic image obtained by a conventional X-ray panoramic imaging device, or an X-ray image is acquired for each of the plurality of full teeth, and converted into a digital image, and then, for example, contour is extracted for each image. Detect the common department.

It is also possible to form a panoramic image of the full tooth by connecting each image to the common portion. Similarly, the entity image b202 of the full-teeth panorama shown in FIG. 28(b) is formed by the physical image capturing means B8012. Furthermore, the full-tooth image is not limited to this method, and a method of performing continuous shooting, selecting an appropriate image for bonding, or the like may be used.

Find the treatment site from the image. For example, in the image b201, the caries defect portions b219a and b219b, the front tooth defect portion b219c, and the front tooth gap b219d are also the same as the entity image b202.

It is necessary to separately study how the defect needs to be compensated. For example, if it is a front tooth compensation, the virtual shape adjustment means B8018 is used to search for a virtual shape or the like storage means B8022 to select a candidate for the shape before the tooth can be compensated. After the selection is made, the selected image is read, and the size and color are selected on the screen, and combined by the composite display means B8019 to be displayed on the display screen. Fig. 28(c) shows, for example, a video b203 obtained by synthesizing a virtual composition. In the synthetic image b203, when the artificial tooth root is appropriately confirmed for the dentition defect portions b219a and b219b of the lower jaw, when the plurality of individual tooth roots b213 and the upper structure b215 are spread from the storage means B8022 such as the virtual shape, the plant for the bridge is selected. The input b212 and the bridge upper structure b214 are adjusted in size and color by the virtual shape adjustment means B8018, and combined by the composite display means B8019, and displayed on the screen screen or the screen of the mobile terminal.

Similarly, the physical image data b202 obtained by the physical image capturing means is used to call up the complementary teeth, inlay data, and the like for the solid image from the storage means B8022 such as the virtual shape, and the size and color are adjusted by the virtual shape adjusting means B8020. Display is performed by the composite display means B8021.

B216 denotes the bridge upper structure b214 of Fig. 28(c), and b219 denotes the upper structure b215 of Fig. 28(c). B217 is a crown for the front teeth, which is equivalent to b210 of Figure 28(c). B218 denotes the gap compensation portion b211 of Fig. 28(c).

For example, if the teeth of the gap compensation portion b211 are crowns, the crowns can be formed in a contact state by increasing the size of the crown. In the case of natural teeth, it means that the teeth of both sides are slightly cut off, and the method of making up is made.

The complements are indicated by diagonal lines for each of the synthesized images b203 and b204. For example, in the case of the bridge implant b212 and the bridge upper structure b214 in the synthesized image b203, when the strength is not good, the same as the right side of the lower jaw is read from the storage means B8022 such as the virtual shape. The individual root and the upper structure are displayed alternately, and the condition of the bone of the defect portion and the implantable range are adjusted while observing the image.

Moreover, the tooth color data can be called up from a storage means such as a virtual shape, and the relationship between the screen and the color of the adjacent teeth can be adjusted and determined.

For example, the front tooth compensation b210 can also be determined by adjusting the shape and color and synthesizing the adjacent teeth with respect to the common model.

The treatment method of the gap b219d can also be used from the storage means B8022 such as the virtual shape, and the inlay, crown, and the like can be used to make up the pattern, embedded in the image, and adjusted by the virtual shape adjustment means B8018, and synthesized by the synthetic display means B8019. In the case, while studying other virtual shapes. When the virtual shape is formed into a three-dimensional shape, the virtual shape is rotated on the screen, and even if it is a flat intra-oral image, a more realistic synthetic image can be obtained.

Even before the state of the images of FIGS. 28(c) and (d) is obtained, sufficient information is available for the study, and further, the comparative portion detecting means B8013 of FIG. 21(a) is used, from FIG. 28(c). The synthetic image shown in the figure specifies the part which is the feature in the part before the synthesis, and the comparative part extracting means B8014 is used to specify the part which becomes the feature in the part before the synthesis from the image shown in Fig. 28 (d), and the comparison means is used. B8015, in contrast to the comparison of the two, temporarily record the same state, and then display.

An image showing the state of the display is shown in Fig. 28(e). The composite image b205 is obtained by superimposing a solid image and an X-ray image. The numbers are the compensated states shown by images b203 and b204. It is difficult to recognize an X-ray image, and it is particularly difficult to recognize the gum portion. The synthetic image of the above-described image can easily and clearly display the gum portion of the X-ray image, and the balance of the upper structure or the tooth and the root can be easily and clearly displayed.

By the virtual installation on the screen, it is possible to display the oral cavity in which the patient can imagine the actual treatment result, and to be more suitable for the patient by a virtual display suitable for the color of the person or the teeth such as silver teeth and ceramics. make up. For the treatment, the virtual attachment of the X-ray image is also a reference for the treatment of the dentist. The virtual data is directly enlarged, reduced and synthesized using the commercially available materials. In addition to the above, after the synthesis, the data can be converted into make-up data according to the actual distance, and color information and whitening and correction data are also obtained.

It is possible to obtain a part of the size of the actual make-up by synthesizing the virtual shape of the compensation portion. Therefore, there is also a case where the virtual shape or the like is directly used as the material for manufacturing the make-up.

There are also cases in which the method is carried out by a computer to quickly know a part of the size of the actual make-up, and it can also be used directly as a manufacturing material of the make-up.

Mobile terminal type information input and output means

Hereinafter, an embodiment of the present invention will be described in detail with reference to FIG.

1a01 is a small battery and is exemplified by a button type, a cylinder type, a sheet type, a needle type, and the like, and a primary battery or a secondary battery can be used.

The 1a02 boosting means is a DC-DC converter, a chopper type, and other switching regulators, and has a function of boosting, for example, 1.5 V to about 3 V.

1a03 is a control device, and is a control wafer such as a single-chip type computer or an ASIC (Application Specific Integrated Circuit).

1a04 is a display means, and is exemplified by a liquid crystal panel or the like which can perform two-dimensional display.

1a05 is a communication means, which is appropriately adjusted according to the type of the wireless medium 1a0C. If it is a radio wave, a carrier output means including up to several GHz, a modulation means such as FM, AM, and PCM, and a transmitting/receiving antenna are used. Further, a combination of a light-receiving element such as an LED, a laser, and a CDS is used. Among them, a Zigbee module (trade name) using a radio wave or the like can be preferably used. In addition, it is also possible to use a wired communication means such as a universal cable such as a USB connection or a dedicated cable.

1a06 is an input means, which exemplifies a keypad and a touch panel, and performs pressing, touching, and the like, and converts a part that is a user's purpose into an electric signal. There is also a case where the display means 1a04 such as a liquid crystal panel having a touch panel function and the input means 1a06 are used in the same manner.

1a07 is a storage means for recording a program in order to edit and display the patient data to the display unit. The patient data is mainly recorded on the main device side, so it can also be temporarily stored and stored according to the capacity. 1a08 is a direct connection between the input means 1a06 and the terminal side communication means 1a05, which means that if the key is pressed, the function is directly transmitted via the terminal side communication means 1a05, and the keyboard and the computer can also be represented. The circuit between the circuits is the same. There is also a case where it is not necessary when the control means 1a03 is substituted.

1a0B is a main device, which stores stored data such as patient data, patient oral data, patient health data, attendance related information such as dental attendance, dental medical information, electronic medical record data, patient reservation data, etc. The recording means 1a11, the main computer 1a10, and the communication means 1a09 of all the materials related to the industry are combined.

1a09 is a communication means on the host side, and is a combination of the terminal side communication means 1a05 on the mobile terminal side. Since a plurality of mobile terminals are not suitable for a plurality of patients, the mobile terminal or communication means 1a09 preferably sets a plurality of channels and accepts only input from a predetermined mobile terminal.

1a10 is a main computer and is combined with a peripheral device such as a display device, a keyboard, a mouse, and a printer.

The 1a11 recording means is a recording medium such as a hard disk, an SD (Secure Digital) card, a DVD (Digital Video Disc), a USB memory, or the like, and can be stored in the host computer 1a10.

The communication means 1a09 may be built in addition to the case of external connection.

1a12 is a communication network, which exemplifies the Internet, the company's internal LAN (Local Area Network), and the internal network.

1a13 is another main device having the same configuration as the main computer 1a10 of the main device 1a0B, and can store patient data not owned by the main device 1a0B.

Further, by transmitting the treatment data to the mobile terminal from, for example, remotely, it is also possible to support the examination and treatment of the dentist who performs the operation.

Next, the operation of FIG. 24 will be described.

The voltage of the battery 1a01 is raised by the boosting means 1a02 and supplied to each means. By the boosting means 1a02, for example, a battery voltage of 1.5 V is raised to a voltage of 3 V or more, whereby the C-MOS control element or the like can be driven.

The control means 1a03 can also display the inspection data processing program for the dental treatment from the storage means 1a07 and execute it on the display means 1a04.

Alternatively, the data transmitted by the home computer 1a10 may be displayed directly on the display means 1a04.

Since the wireless communication means is used, the communication status can be checked at the beginning or in the middle of the operation, and the communication status can be confirmed. In addition, it is also possible to temporarily change the configuration of the input/output during the cutting period by the control means 1a03 even if the wireless connection is cut off in the middle.

According to the display of the display means 1a04, the operator operates by pressing or touching the input button of the input means 1a06.

In this case, when the "1" key of the input means 1a06 is pressed, the "1" output is displayed on the display means 1a04 via the control means 1a03, and the terminal side communication means 1a05, the wireless medium 1a0C, and the communication means are transmitted. 1a09, transmitted to the host computer 1a10. When the execution button signal reaches the host computer 1a10, for example, when the patient name is transmitted from the input means 1a06 to the host computer 1a10, the database in the host computer 1a10 is retrieved and the data is transmitted to the mobile terminal 1a0A. . The transmitted data is adjusted to be displayed by the control means 1a03 via the terminal side communication means 1a05, and displayed on the display means 1a04.

Moreover, the data transmitted to the mobile terminal by the autonomous computer 1a10 can be directly displayed on the display means 1a04 of the mobile terminal 1a0A. Further, the control means 1a03 can also call up and execute the program from the storage means 1a07. The data transmitted by the computer 1a10 is processed by the program and displayed on the display means 1a04.

The data transmitted and received by wireless communication means transmitting symbol data, numerical data, symbol data, other text data, and video data.

When there is no required content in the host computer 1a10, the other host devices 1a13 may also obtain data via the communication network 1a12.

The input from the input means 1a06 is further recorded on the recording means 1a11 on the master side.

For example, when the periodontal pocket depth value is obtained and manually input from the input means 1a06, it is directly recorded in the recording means 1a11 via the host computer 1a10. In order to confirm the input value, it can also be set to be also performed by the display means 1a04. The circuit shown above.

Next, the operation of the embodiment of the present invention will be described in further detail with reference to Figs. 24 and 25 .

At the beginning of use, the automatic communication test is performed as shown in step 1b01 shown in FIG. 25. If the communication test fails (no) (step 1b02 shown in FIG. 25), an error message is displayed (step 1b03 shown in FIG. 25). ), the automatic communication test is performed again in step 1b01 shown in FIG.

If the automatic communication test is successful (yes), the host computer 1a10 shown in FIG. 24 outputs the patient ‧ selection item list display data to the control means 1a03 via the communication means 1a09, the wireless medium 1a0C, and the terminal side communication means 1a05, and inputs the data. The input control means 1a03 outputs it to the display means 1a04. In this case, the output of the host computer 1a10 is the display material, and when the display data is displayed by the display means 1a04, the control means 1a03 executes the display program read from the storage means 1a07. .

Furthermore, the patient ‧ selection item list can also be recorded as a program in the storage means 1a07 of the mobile terminal.

Further, there is a case where the data is directly displayed on the display means 1a04 without passing through the control means 1a03.

The display means 1a04 shown in Fig. 24 displays the patient ‧ user selection item list (step 1b04 shown in Fig. 25).

In the case of step 1b05 shown in FIG. 25, when the keypad is pressed to input the patient selection item number (yes), the other selection (no) is performed by moving to the terminal 1b05a, and is omitted because it is repeated for the same operation. Illustration and description.

If patient selection is made (for example, by pressing the keypad 1), the signal of 1 is directly transmitted to the host computer 1a10 via the wireless communication means, and the patient name input box is displayed on the display means 1a04. If the patient name or the patient code is input by pressing the keypad in step 1b06 shown in FIG. 25, the mark and text data corresponding to the pressed keypad are transmitted to the host computer 1a10 every time the press is performed, and if The lower input key searches for the stored data in the recording means 1a11 of the host computer 1a10.

In addition to the search for all the names, the search can be performed by using a partial search or the like that searches only by inputting the last name or the name, and displays the list of patients obtained when the partial search is performed.

Forming whether there is a selection display of the patient candidate, and in the case of the presence, pressing the button indicating the presence condition, directly transmitting the information pressed to the host computer 1a10, the host computer 1a10 recalls the patient data from the database, and The mobile terminal 1a0A transmits.

The patient data is displayed on the display means 1a04. In this case, the control means 1a03 can also directly display the display for each line feed code.

Further, in the case where the patient data is displayed, the control means 1a03 can also read out and execute the display program from the storage means 1a07, and display the display means 1a04 with the arrangement according to the program.

When the patient candidate is present in the step 1b07 shown in Fig. 25, the host computer 1a10 shown in Fig. 24 transmits the patient data to the mobile terminal 1a0A (step 1b08 shown in Fig. 25). In the case 1b07 shown in FIG. 25, when there is no patient candidate (no), a new patient registration may be performed or the search may be performed again, but the routine display of the re-search is omitted, and only the new patient is performed. The step of logging in (step 1b09 shown in Fig. 25).

When the new patient is logged in, when the keypad of the input means 1a06 is operated and the data is input, the keypad input is directly transmitted to the host computer 1a10 and registered in the database of the recording means 1a11. Furthermore, in the case of the registration of the new patient, in addition to the input from the input means 1a06, the input from the host computer 1a10 may be newly added to the input from the host computer 1a10. The patient information of the means 1a11 is recorded (step 1b09 shown in Fig. 25).

If the patient is predetermined and a record is displayed, then the item list for inspection by the display means 1a04 of the mobile terminal 1a0A is displayed in step 1b10 shown in FIG. The item list shows the information displayed by the main computer 1a10, or the control means 1a03 for executing the program for calling the data from the recording means 1a07, and the display means 1a04 is displayed.

It is also related to the inspection item list. When the text item is displayed, the autonomous device 1a0B is directly displayed via the wireless medium 1a0C and the control means 1a03, and when the display pattern of the arrangement pattern inherent to the database is displayed, it may be The storage means 1a07 reads out the application and executes it (step 1b10 shown in Fig. 25).

In Fig. 25, the case where the plaque inspection is designated is shown, and the other selection (1b11a) is omitted.

When the plaque inspection is specified in step 1b11 shown in Fig. 25, the input signal 1A06 is pressed and the input signal is directly transmitted to the host computer 1a10, and the host computer outputs the past plaque data.

The host computer 1a10 recalls the past plaque data coefficient values, symbols, characters, animations, still images, and the like from the recording means 1a11 and outputs them to the mobile terminal 1a0A.

The control means 1a03 executes the plaque display program called from the storage means 1a07, and displays it based on the data output from the host computer 1a10.

Which side of the tooth number is operated by the keypad on the mobile terminal side, and the data of which stage plaque is recorded is transferred to the host computer 1a10 shown in FIG.

The host computer 1a10 records the contents of the above contents in the recording means 1a11.

When the display of the patient's plaque is formed in the step 1b12 shown in FIG. 25, it is moved to the step 1b13 shown in FIG. 25 to be corrected or added, and when the correction is added, the correction as described above is performed. Add (step 1b14 shown in Fig. 25).

If the correction or the addition is completed, it is determined whether or not another inspection is performed in step 1b15 shown in FIG. 25, and when the other inspection is performed, the inspection item list shown in step 1b10 shown in FIG. 25 is displayed, and no other inspection is performed. In the case, whether or not to return to the display of the initial item list (step 1b16 shown in FIG. 25) is formed, and in the case of returning to the initial item list, the patient and the user selection item list display of step 1b04 shown in FIG. 25 are performed. Continue processing. For example, when it is not returned to the initial item list, for example, it may be ended.

In addition, the above configuration is exemplified as an example. For example, a smart phone or a mobile phone can be directly used as a mobile terminal for dental information management, and can be carried and input by at least a dental practitioner. Display, log in oral information, dental affairs information, dental practitioner information, other related information, etc., and read information from the host terminal as needed, log in, and the dental practitioners can display and input the required information in common. That is, a constituent corresponding to the above purpose can be obtained.

Through the above operations, the encoding of the wireless communication keypad and the numerical values, characters, symbols, symbols, text data, images, animations, etc., can be displayed immediately, so even if the terminal is used simultaneously with the diagnosis and treatment, Use without stress. Further, when the main device is attached to the waist or the back, or when the connection between the main device and the mobile terminal is unobstructed, the wired communication may be used without using wireless communication.

The present invention can also utilize the above mobile terminal device to seek one-party management of dental information.

As information to be managed, for example, a medical management fee schedule computer system for making a medical fee schedule, such as a dental management appointment management system, an electronic medical record system, and accounting information and medical information, may be input, and related to the patient. Dental affairs information, patient information, medical record information, accounting information, medical treatment remuneration information, etc. processed by the recovery management system, etc., indicating dental affairs information processed by, for example, a business management system having a function of displaying a charted bill. , X-ray information, dental microscope information, dental CT information, intraoral camera and other inspection information, therapeutic dental unit information, patient chair information, etc., periodontal bag inspection probe, from other machines Dental information such as oral information, dentists, dental hygienists, dental staff, reception staff, dental technicians, etc., other than dental information, such as brushing information, plaque-related information, periodontal Disease information, such as prevention information, lifestyle-related diseases, and Defining in the mouth, it may also comprise, for example blood pressure, blood indirect information associated with a disease of periodontal disease associated like.

In addition, if at least the hospital's useful information, patient information, medical information, business information, etc., it is the subject of one dollar management. The one dollar management is not only for the management of all relevant dental medical information, but also for the required Part of the information is the subject of unary management.

There are also cases where, for example, in the case of an analog X-ray device, only analog photos, images, or handwritten data can be used, it is preferably a hard copy via an image scanner, a digital camera, or a computer screen. The equal-digit conversion means converts to a digital signal for management.

One-dimensional management of the data can also be performed by the above-mentioned mobile terminal, or by one of the dental computers such as a tablet type, a notebook type, and a desktop type computer.

In particular, it is also possible to use an Internet-centric netbook-specific terminal or mobile terminal, or to use a mobile terminal that performs Internet connection in a wireless LAN.

Moreover, the present invention can also provide information providing information processing, information processing, and the like using a cloud computing method.

For example, the mobile terminal or the host terminal may also input and output data to and from the application software provided by one or more of the central means via the Internet using the dedicated or general browsing software on the terminal side. The application software for the unary management is not installed on the terminal side, and only the browsing software such as Internet Explorer (trademark) and Firefox (trademark) is installed, and the software for the management of the dental information in the center is executed through the browsing software, thereby enabling the data to be used. The input and output can be made compact and simple without worrying about the capacity of the recording device on the terminal side.

Furthermore, it is also possible to use a software for the dental information management software to start a dedicated software without using a general-purpose browser.

In addition, there are cases where the terminal side stores all of the information in the resources on the cloud side or personal information, and some information that requires security management is stored on the terminal side.

Regarding the state of the cloud, as a leak of information, for example, is only a private cloud within the company, central means or participating dental groups, the system constructed is better, and if it is safe, it can also be externally The public cloud is constructed by using the information provided by the computer, and it can be set as a private cloud or a public cloud depending on the situation.

Regarding the mobile terminal, in addition to the dentist, the dental hygienist, the dental reception staff, the dental technician, other related persons, and sometimes the patient may also carry it separately. It can also share information with other staff members. Further, by using an exchange function of a carrier that recognizes an individual such as an IC card, it is also possible to use one of them alternately.

Preferably, one of the data management is compatible between the data processed by each system, but is not necessarily compatible, for example, when using hard copy data of the screen, etc., at least on the mobile terminal. It can be operated.

In this embodiment, it is preferable to use the server in which the external database is set to communicate with the mobile terminal, but the present invention is not limited thereto, and the operation may be temporarily recorded in the mobile terminal. The time when the communication with the server becomes possible, the temporarily recorded data is automatically transferred to the batch method of the database.

For example, when the patient's reservation system is operated on the mobile terminal, when the outpatient treatment plan for the treatment and prevention of the patient is determined, if the appointment is made from the terminal, the reservation becomes an alternate candidate. The date is read from the database, and the reservation status data is read and compared, and the repeated scheduled date is displayed on the screen of the mobile terminal, and the change is promoted, and the schedule is recorded in the input display column of the mobile terminal screen. A plurality of treatment and prevention screens, and printing commands from the mobile terminal, can also be distributed to the patient by printing a treatment and prevention schedule with a related printer.

The mobile terminal system is connected to the main device wirelessly and by wire, and can be connected to the intraoral camera in a wired or wireless manner. In this case, the positioning of the teeth and the periodontal requiring treatment and prevention can be qualified.

In the case where a terminal device is used as a dental computer for each so-called dental clinic chair, the terminal device is used as a server for the dental device, and the host terminal is used as a server. One of the information management between the host terminal and the computer of each chair.

The input to the data of the mobile terminal is connected to the operation button and the rotary dial of the type in which the attached mold, the sliding mold, the finger, the pen, and the like are operated in contact with the screen as described above, and is also connected to the screen. In the case of a peripheral device such as a virtual button, a virtual keyboard, or an intraoral camera, the above-described buttons and dials on the peripheral device are exemplified, and the audio input recording using the integrally provided microphone is utilized, and the use is integrated or separated. The scan recording function of the camera set in the ground makes it easy to freely input. Furthermore, the scan recording function can also be set as a photo image recording by a dental camera.

Handwriting input data can also be obtained when a tablet computer, a mobile terminal, or the like is used to input an image of an electromagnetic induction pen, a resistive film pen, or a handwritten image when the screen is input.

For example, in the case of explaining the patient, when the dental hygienist explains the treatment method and other situations, when the gesture is displayed on the screen, when the screen is handwritten from the mobile terminal, it can also be directly Display or synchronously display on the screen of the host terminal, explain the patient, explain to other practitioners, or record directly, and use it later.

Especially when the image is input by hand in the mouth, it can be used directly as the patient's data.

Furthermore, in order to input audio data, it is also possible to accurately grasp the condition in the mouth.

The audio data may be, for example, when a conversation is made with other mobile terminal users on the mobile terminal screen, and the audio and video are simultaneously displayed by specifying a window.

Moreover, the audio data is directly converted into text data, and the handwritten text is also converted into text data, thereby reducing the recording capacity. In particular, when performing intraoral diagnosis, in the state of fangs, the professional term is registered as audio data in advance, and converted into text data by comparison with the audio input via the mobile terminal. This automatically makes the information written so far into electronic data.

Recording the audio sample and the text data of the pre-registered professional term on the recording device, comparing the input audio data and the audio sample data, and converting the text data corresponding to the audio sample data in the case of a consistent or substantially identical situation, This allows for accurate dental information recording.

In this embodiment, the input and output of information relating to dental affairs, such as the input of patient information such as an electronic medical record or the input of medical and medical remuneration information, can be performed under the one-man management. In this case, the host terminal and the mobile terminal can also be at least Synchronize in the input state. That is, when input from the host terminal, the input is displayed on the mobile terminal, and the output display is also synchronized in the same manner. In the case where the mobile terminal has a built-in general-purpose computer, the screen synchronization soft system can be performed using a commercially available software Sync+ (trade name) or the like. Further, the mobile terminal device indicates that a state in which a wireless LAN is available by connecting a USB terminal having a LAN function or a LAN function is provided. It not only seeks to share the host terminal and the mobile terminal, but also seeks to share it with other mobile terminals via the host terminal or directly with the host terminal. The direct sharing system may be a wireless communication medium such as electromagnetic waves or infrared rays, or may be a terminal that passes through the relay terminal.

In the case of dental conditions at home, when the storage capacity and processing capacity of the mobile terminal are low and the data cannot be stored, the unstorable parts can be sorted into materials by other storage devices or mails. The dedicated or public line is transmitted to the host terminal step by step or for each fixed amount of storage.

When the synchronization between the display of the terminals described above is performed in, for example, a common indoor dental treatment, it takes time to perform complicated input from the mobile terminal, so that an input interface equipped with a keyboard, a mouse, and the like can be enabled. The input of the host terminal can be quickly input.

Moreover, the automatic processing of the time series data can also be performed in one of the dental information management using the mobile terminal and other terminal devices. For example, the date when the treatment of the patient after the treatment is read out from the database is completed, and the date when the treatment is stopped is compared with the current date, and after the treatment, the content is displayed on the mobile terminal or the host after a predetermined period of time is set. Terminal. Alternatively, direct printing can be automatically made into a direct mail advertisement.

The host terminal can also automatically notify the mobile terminal when the period of the medical payment is made, and can also automatically adjust the date of the report without waiting for the attendance.

The mobile terminal system is connected to a peripheral device such as an X-ray imaging device, an intra-oral camera, or a microscope directly or via a host terminal device, thereby obtaining an instant display of the photographic output using the peripheral devices, for example, on the mobile terminal. And it is composed of a data holder recorded by a predetermined patient such as a patient name. The operation of these peripheral devices, dental chairs, lighting fixtures, and the like can also be controlled from the mobile terminal. At this time, the record of the control operation can also be recorded as a log on the patient's medical record.

The patient data folder is preferably centered on the host terminal, recorded in a state of non-repetition, and can be read by retrieval from each terminal. When the patient data folder is used for temporary use, there may be a plurality of files for each terminal, etc., and in the case of continuous login, it is preferably present in one storage area. There are also storage areas that are not only in the host terminal but also in the remote location via the network.

Furthermore, the mobile terminal can also exchange information using audio, video, and text with the patient, and particularly when the mobile terminal is used for generalization, the patient can carry the mobile terminal. In the case of a patient carrying, it is preferable to set only the information required for the patient to be viewed. There is also a case where, for example, in the case of performing the above-described dental management terminal for a smart phone or other mobile phone application software, it is possible to install a dedicated application only by the patient.

tooth Explanatory means

In the present embodiment, for the dental treatment, for example, all the dentition images and the treatment site images of the patient's panoramic view are displayed on the screen (monitor) screen of the computer, and the animation formed by subdividing according to the purpose is combined and reproduced as a combined animation. In this way, it is possible to make an easy-to-understand explanation when describing each patient. The dentist can also use an established animation line that is pre-combined with a subdivided animation, or can be edited and combined in advance.

The method of selecting and editing by the dentist in advance selects to use a semi-custom or existing combination of animation walkers, and then combines all the explanatory materials, and an embodiment for producing at least one animation line will be described in detail with reference to FIG.

Fig. 26 is a view for explaining the action of the dentist when it is set in advance as a combined animation.

1c01 is the display of the original project list. A list of established animation lines, a list of semi-customizable edits, and a list of each subdivided animation are displayed and selected according to the purpose.

1c02 is the step of selecting which one of the initial item list displays.

1c03 is a step in which a step is performed by selecting which one is selected, and in the case of NO, it is moved to another combined animation selection (not shown) via the terminal 1c03a. In the case of YES, it is judged whether or not the step of registering the combined animation (1c04) is moved to a method of searching by a combination of symbols unique to the animation name search or subdivided animation data, and it is assumed that the login is performed ( When yes), the transition is selected to other combined animation via terminal 1c03a.

When not logged in, a list of the subdivided data is displayed, and the editing area is displayed. The list of subdivided data can also be differentiated according to the purpose, and can also be serialized and formed.

In the selection of the segmentation animation data 1c05, from the list, use the copy paste, drag and drop to move to the editing area, edit the description of the time series.

In Fig. 26, at the end of the subdivided animation selection (1c06), the reproduction of the animation line combined with the selection is performed experimentally (1c07).

Fig. 27 is a view showing a combination of examples of combined animations.

1d01 is the recovery animation of the gums after tooth extraction, 1d02 is the tilting animation of the adjacent teeth, 1d03 is the extension animation of the teeth, the animation of the 1d04 bridge base, and the animation of the workpiece shown in Figure 25, 1d06 An animation showing the assembly of the workpiece.

There are also cases where the animations are not one and there are multiple animations.

The serial animation of 1d01 to 1d06 is used as the combined animation 1d00, and the name is recorded in the recording device, or the recording device records the symbol line pre-attached to each of the subdivided animation data, and the animation 1d00 can also be displayed on the computer screen. As an illustration.

The combined animation 1d00 is sequentially combined and continuously made into a reproducible one animator, and each animation is subdivided, and it is preferable to set a patient constant and a physician constant for each. The form of each animation is, for example, WMV, api, and MPEG format, and is selected by the existing animation editing software and combined in order.

Further, in step 1c08, the physician side data and the patient side data are displayed, and the time cost is displayed. Preferably, other methods are used, that is, the display of the description of the lower cost, the shorter time, and the high benefit can be performed according to the situation.

Step 1c09 is a step of selecting a transfer to the subdivided animation data even when the image is to be reselected in the state of being combined with the animation, and 1c10 is a step of selecting whether to save the list of the project list, in the case of saving ( When yes), enter the combined animation name in step 1c11 and log in to save.

In the unsaved situation, return to the original state in the end step, select to edit or directly end (1c12).

Fig. 26 is a diagram showing the actor who made the combined animation by the physician. Since there is a large number of actually subdivided data, it takes time to select the data according to the selected data, so the sample can be formed into an edit for each description type in advance. frame.

There are also cases in which the patient's own intra-oral image can be registered in a segmented animation, or can be utilized as part of a patient-specific treatment, prevention, and the like.

The present embodiment is mainly used in the informed consent form, and it is preferable to perform more efficient viewing and listening for the shortening of the treatment time of the patient or the efficiency of the explanation. In the above case, the segmentation is performed, and the physician In the face of the patient's description of the animation, which is a few seconds to a few minutes, the execution is performed, and the explanation of the use of the terms used by the physician is an auxiliary screen display, which is easy for the patient to understand.

For example, a list of the subdivided materials is displayed on a computer screen using icons, tables, and the like, and a concise title that is easy for the patient to understand is attached.

The edit of the list is displayed on the mobile terminal described above, and the dentist makes a selection. The selected state is displayed on the screen observed by the patient.

Further, it is also possible to form a combined animation line selected by the user for the animation on the mobile terminal while discussing the treatment with the patient, and to display it as a patient.

In other words, it is mainly composed of a mobile terminal including a display unit and an input interface carried by a dental practitioner, and a terminal for displaying a screen for viewing and displaying a patient, a preventive person (as a patient, etc.), and the dental practitioner is moving. On the terminal, an animation, a subdivided animation, or a combination thereof containing the content delivered to the patient or the like is retrieved and edited. At the end of the editing, the terminal is transmitted to the patient's audiovisual terminal.

Furthermore, in this case, the animation data may also be transmitted, or may be: transmitting the identification data attached to the animation data, and the terminal device for the patient's audio-visual receiving the identification data, and performing an animation according to the identification data. Instant processing displayed on the screen.

Further, in a state in which a mobile terminal is carried by a dentist or the like, a remote operation such as reproduction, stop, display of patient data, and non-display on an image display of a terminal for viewing by a patient or the like is performed. .

Moreover, the images and materials for viewing and viewing by the patient can be simultaneously displayed on the mobile terminal carried by the dental practitioner. In particular, when the intraoral camera shown in Fig. 1 is used to display the inside of the patient's mouth and the description is made, it is explained that it is consistent with the case, and it becomes easier to understand.

Furthermore, in the present embodiment, the mobile terminal device shown in FIG. 24 can also be used to edit the animation data, and output the image displayed on the computer screen that can be seen by the patient.

Moreover, the operation of displaying the animation of the screen connected to the dental computer visible to the patient can be performed by the mobile terminal.

Boundary and tooth boundary detection means

The present invention includes a configuration for clearly setting the boundary between the detecting tooth and the gum.

The image of the intraoral camera is often photographed while being illuminated in a dark and narrow space. Therefore, it may be detected as a means for forming a panoramic image processed by computer image as shown in FIG. 8 and FIG. 10, for example. When the common portion between the images is used or when the patient is subjected to dental treatment, the boundary between the gums and the teeth is difficult to recognize due to the influence of the approximate color tone or saliva.

Therefore, by the contour extraction means for extracting the contour of the tooth of the solid image, and the color component image conversion means for converting the solid image into the component color to form the shape of the tooth and the gum, the composite is converted by the color component image conversion means. The combination of the image and the synthetic image forming means of the contour extracted image can extract the contour of the tooth and the gum even in the place where the dirt or the illumination of the tooth is insufficient.

The contour extracting means is configured by, for example, means for performing two-dimensional Fourier transform on the image, and means for performing inverse Fourier transform by detecting only the phase signal in the frequency region indicating the change in the shading of the image after the Fourier transform. Sometimes, Z conversion system and Laplace conversion system can also be utilized.

The color component image conversion means is decomposed into, for example, an RGB color system, a La*b* color system, an HSV color system, an XYZ color system, an xyY color system, an L*u*v* color system, and a Mongolian color system. The image of the color of the color shown in the color system of the Xaar color system, Oswald color system, NCS (Natural Color System), DIN color system, etc., from which you can clearly see the color of the shape, Further, a means for forming an image based on the above-described component color or a component color of the color system is formed, thereby forming a component color which can more clearly see the shape and forming an image based on the component color. Preferably, the selection is a pre-measurement and determination of a component color suitable for intra-oral imaging, and indicates, for example, combining one of the L component image, the a* component image, or the b* component image of the La*b* color system with the HSV color. The system combines H (hue) component image, S (color saturation (Saturation ‧ Chroma)) component image, and V (brightness ‧ Lightness ‧ value component image) The case where the composition colors of different color systems are better combined with each other. The selection or combination of the component colors may be combined into a conversion to a component color in which the shape can be clearly seen or a combination of a plurality of component colors. In addition, the component image refers to a person who has obtained an image in which the image of the reinforcing component is adjusted to, for example, a value indicating a component value on a program.

Further, in addition to selecting a component image in which the shape can be clearly distinguished, the user can further distinguish the color of the boundary to perform coloring. This means, for example, that the R (red) component image is applied to the gums, and the G (green) component image is applied to the teeth.

Further, the component colors shown here are not only those obtained by detecting from the image, but also by re-coloring the color with a clear boundary.

Then, the synthetic image forming means sets the contour image obtained by the contour extracting means and the image obtained by the color component image converting means, for example, as the color key method, and sets the contour portion of the contour image to the same color system. The composition is synthesized by a translucent component image or the like. Further, after the synthesis, in order to further enhance the color component image, it is also possible to use a person to further visually or mechanically distinguish the boundary to make the gum portion red or thicker, and to strengthen the teeth to green or more densely. Means. Furthermore, if there is a color component that converts the gum color to red and the tooth color to green, it can also be converted into the above-described color component image. Preferably, the means are implemented by a computer software, or a custom or semi-custom IC such as a gate array or a PLD (Programmable Logic Device).

Next, an embodiment shown in Fig. 29 will be described.

The 2901 is an image input means for inputting a still image captured by, for example, an intraoral camera. The still video image input by the image input means is output to the filter means 2902. The 2902 filter means an edge enhancement filter such as an unblurred filter, and in addition, it is also possible to use a gradation filter for enhancing the image. Device.

The image subjected to the filtering process by the filter means 2902 is output to the contour extracting means 2903 and the component color image converting means 2903.

The 2903-based contour extracting means is composed of a two-dimensional Fourier transform means, a phase signal detecting means, and an inverse Fourier transform means, and these means exemplify a program model which is combined in a software library such as open-CV (manufactured by Intel Corporation). Group and perform the performers.

The 2904-based component color image conversion means, as described above, forms an image which is converted into a La*b* color system, an a* component color or a b* component color, and an H component color S component color V component color of the HSV color system. The means and the component color synthesis means for synthesizing the component colors, the color tone is changed, and the shape of the tooth and the gum is clearly defined. Further, depending on the change in the color tone, dirt and tooth decay of the teeth may be found.

The contour image obtained by the contour extracting means 2903 and the image converted by the component color image converting means 2904 into the component color image are output to the composite display means 2905.

The 2905 is a composite display means, and the contour image output by the synthetic contour extracting means 2903 and the output component color image of the component color image converting means are synthesized. For example, the composition is colored in the same color as the outline of the contour image, and the same color is made transparent, and is combined with the component color image that becomes the background image. The synthesized image is displayed on a computer screen.

Occasionally, a series of synthetic processes can be used to obtain a clear image of the boundary between the gums and the teeth. Further, when the left and right tooth rows shown in FIG. 12 are the reference when the composite mark ML reaches the center of the image (for example, the image 906e and the image 1101c), and the boundary KL of the center of the two teeth is detected, for example, the present embodiment Examples are preferably used. Moreover, the contour image and the solid image obtained by detecting the phase signal by Fourier transform can be directly synthesized. Further, even if only the component color image is used, an image having a clear shape can be obtained. Therefore, even if only the image obtained by the component color image detecting means is used, an image in which the boundary between the gum and the tooth becomes clear can be obtained. The image of the boundary between the tooth and the gum as described above can be used as a marker for various synthetic operations, or used to describe the patient for dental treatment.

[Industrial availability]

In order to improve the oral cavity in dental treatment, the present invention provides a dental system that can update the patient's oral information by providing oral information to the patient in an easily observable form, and effectively utilizes the dental system. In the medical field.

11. . . Oral imaging

12. . . Medical site detection means

13,53. . . Unit image forming means

14, 55. . . Medical treatment order setting means

15, 56. . . Medical treatment instructions

16,57. . . Display output means

17, 58, 156. . . Means of recording

20. . . Captain

21, 22, 23, 24, 74-77, 707-710. . . Unit image

21a, 22a, 23a. . . Sequence bar

21b, 22b, 23b. . . Medical treatment start date column

21c, 22c, 23c, 24c. . . Description bar

24d. . . Treatment site

31, B7005. . . Photography means

32. . . Image conditioning

33. . . Image display means

34. . . Position detection

51. . . Wide range of image input means

52. . . Tooth detection

54. . . Diagnosis and treatment image selection means

71～73, AH1, b101, b102. . . tooth

79. . . Tooth data

151. . . Patient database transfer means

152. . . Shortest diagnosis date retrieval method

153. . . Shortest treatment date display means

154. . . Idle medical treatment date display means

155. . . Decide on the means of input

301, A21, B9101. . . Grip housing

302, 310, 318, 903, A10, A22. . . Mirror unit

303. . . Plane mirror

304, B9114. . . wire

305. . . Cylinder

306, 307. . . Operation button

308. . . Convex mirror

309. . . Camera unit

311. . . concave mirror

312. . . Lighting component

313. . . camera

314. . . computer

78, 314A. . . Screen

315. . . keyboard

316. . . Computer mouse

317. . . Printer

600. . . Squat

601~612. . . Photographic surface

613-615. . . Common partial image

700, 711, 1702a. . . video material

701~703. . . Tooth image

704-706. . . Display bar

900a. . . Tooth column

901. . . Intraoral camera

A10K, A22H, 902, B9108, B9112. . . Reflector

904. . . Ontology

A14, A23, 905, B9106. . . Photography unit

1401. . . Photographic data input department

1402. . . Correction means

1403. . . Common point detection means

1404. . . World coordinate conversion means

1405. . . Three-dimensional image forming means

1406, B7009, B8017, 1a04. . . Display means

1500. . . Probe

1501. . . Camera A

1501a. . . lens

1502. . . Camera unit B

1503. . . Illumination light irradiation unit

1504. . . Light guide path

1505. . . Luminous means

1506. . . Support member

1507. . . Operation switch

1508. . . Grip

1509, B9103. . . Electric wire

1701a, 1701b, 1702b, 1701c, 1702c. . . image

1703b, 1703c. . . Common range

A16a, A16b. . . Operation button

A10S, A22S. . . Mounting department

A11. . . case

A12. . . Observation direction

A13. . . Illuminate the illuminated surface

A14L. . . Sighting

A15, A26. . . Cable

A24. . . Circuit substrate

A25a, A25b. . . Position sensor

A141, A142. . . Lighting source

A143. . . Photography component

A421, A422. . . X axis

A431, A432. . . Y-axis

A441, A442. . . Z axis

A451, A452. . . Gravity acceleration vector

B103. . . Repeated image

B104. . . Upload information

B105. . . Download information

B106. . . Shangyu X-ray data

B107. . . Lower X-ray data

B201. . . Full-tooth X-ray image

B202. . . Physical image

B203, b204, b205. . . Synthetic image

B210, b217. . . Crown for front teeth

B211, b218. . . Gap compensation

B212. . . Implant for dental bridge

B213. . . Artificial root

B214, b216. . . Upper bridge structure

B219, b215. . . Upper structure

B219a, b219b. . . Caries defect

B219c. . . Defect of the front teeth

B219d. . . Front tooth gap

1b05a, 1c03a. . . Terminal

B7001. . . Input means

B7002. . . Input number detection means

B7003. . . Delay means

B7004. . . Photography output setting means

B7006, 2901. . . Image input means

B7007. . . Image selection means

B7008. . . Save display means

B8011. . . X-ray imaging

B8012. . . Physical imaging

B8013. . . Comparison site extraction

B8014. . . Comparison site extraction

B8015. . . Comparison means

B8016. . . Consistent recording method

B8022. . . Virtual shape and other storage means

B8018, B8020. . . Virtual shape adjustment

B8019, B8021, 2905. . . Synthetic display means

B9102. . . X-ray output device

B9104. . . X-ray phosphor

B9105, B9111. . . Visible light penetrating member

B9107, B9110. . . Support member for X-ray photography

B9113. . . X-ray sensor

1a01. . . Small battery

1a02. . . Boosting means

1a03. . . Control means

1a05. . . Terminal side communication means

1a06. . . Input means

1a07, 1a11. . . Storage means

1a08. . . Electrical line

1a09. . . Communication means

1a10. . . Main computer

1a12. . . Communication network

1a13. . . Other main device

1a0A. . . Mobile terminal

1a0B. . . Main device

1a0C. . . Wireless media

1d00. . . Combine animation

1d01. . . Recovery animation of the gums after tooth extraction

1d02. . . Tilting animation of adjacent teeth

1d03. . . Extended animation of the teeth

1d04. . . Animation of bridge abutment

2902. . . Filter means

2903. . . Contour extraction

2904. . . Component color image conversion means

RM. . . profile

ML. . . mark

IG. . . Correction display unit

CL. . . Vertical center line

HL. . . Horizontal center line

KL. . . boundary

1b01~1b16. . . step

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a diagram showing an embodiment of the present invention.

Figure 2 is a diagram for explaining an embodiment.

Figure 3 is a diagram for explaining an embodiment.

Figure 4 is a diagram for explaining an embodiment.

Fig. 5 is a view showing another embodiment of the present invention.

Figure 6 is a diagram for explaining an embodiment.

Figure 7 is a diagram for explaining an embodiment.

Figure 8 is a diagram for explaining an embodiment.

Figure 9 is a diagram showing an embodiment of the present invention.

Figure 10 is a diagram for explaining an embodiment.

Figure 11 is a diagram for explaining an embodiment.

Figure 12 is a diagram for explaining an embodiment.

Figure 13 is a view showing another embodiment of the present invention.

Figure 14 is a diagram for explaining an embodiment.

Figure 15 is a diagram for explaining an embodiment.

Figure 16 is a diagram for explaining an embodiment.

Figure 17 is a diagram for explaining an embodiment.

Figure 18 is a diagram showing an embodiment of the present invention.

Figure 19 is a diagram for explaining an embodiment of the present invention.

Figure 20 is a diagram for explaining an embodiment of the present invention.

Figure 21 is a diagram for explaining an embodiment of the present invention.

Figure 22 is a diagram for explaining an embodiment of the present invention.

Figure 23 is a diagram for explaining an embodiment of the present invention.

Figure 24 is a diagram for explaining an embodiment of the present invention.

Figure 25 is a diagram for explaining an embodiment of the present invention.

Figure 26 is a diagram for explaining an embodiment of the present invention.

Figure 27 is a diagram for explaining an embodiment of the present invention.

Figure 28 is a diagram for explaining an embodiment of the present invention.

Figure 29 is a diagram for explaining an embodiment of the present invention.

11. . . Oral imaging

12. . . Medical site detection means

13. . . Unit image forming means

14. . . Medical treatment order setting means

15. . . Medical treatment instructions

16. . . Display output means

17. . . Means of recording

151. . . Patient database transfer means

152. . . Shortest diagnosis date retrieval method

153. . . Shortest treatment date display means

154. . . Idle medical treatment date display means

155. . . Decide on the means of input

156. . . Means of recording

Claims (7)

An intraoral photographic display system comprising: a photographic image forming means for performing continuous shooting on one side and the other side of a dentition to form a plurality of photographic image sequences; and a side dentition image forming means for using Combining the image of the one side of the dentition and the image of the other side of the photographic lens, the image of the side of the dentition of the photographic lens and the image of the other side are The photographic image forming means forms an image for common to the image of the side of the dentition of the photographic camera and the image of the other side to form the side and the other side of the dentition respectively And a side dentition image synthesizing means for combining the image common to the plurality of dentition images formed by the side dentition image forming means to synthesize the side of the dentition and the side A portion of the dentition image on the other side forms an overall dentition image. The intraoral photography display system according to claim 1, comprising: a marker setting means for setting a mark identifiable on the photographic image at a predetermined position on the tooth row; and a photographic image forming means for the dentition One side and the other side form a continuous image sequence; the side tooth row image forming means respectively synthesizes the image line of the one side and the connected image line of the other side from the mark to the image of the predetermined position Thereby forming a side dentition image and the other side And a side dentition image synthesizing means for combining the one side dentition image and the other side dentition image according to the characteristic part of the dentition in the static image of the mark at the predetermined position. The intraoral photography display system of claim 1, comprising: an X-ray image display means for displaying an X-ray image of the tooth corresponding to the side dentition image; and a virtual dentition display means for displaying The dentition of the virtual or virtual aesthetic coloration of the tooth corresponding to the side dentition image. The intraoral photography display system of claim 1, comprising: a dentition display means for displaying a dentition image obtained by the side dentition image synthesis means; and a unit imaging means for each diagnosis improvement The unit visualizes the oral cavity; the setting means sets the medical treatment improvement order information for the image obtained by unit imaging by the unit imaging means; and the display means displays the additional information in a manner that can be displayed in a list according to the medical treatment improvement order information There is an image of the medical treatment improvement order information; and a display medium whose display shows the display information obtained by using the display means. For example, the intraoral photography display system of claim 1 has a small and portable data processing terminal, and the data processing terminal tool There is an input unit, which can input and adjust information related to the dental medical industry; and a communication means, which can communicate with an external data processing terminal and a server for performing attendance management or dental treatment management; and display means, display thereof The dentition image synthesized by the side dentition image synthesizing means and the data related to the dental medical industry. The intraoral photography display system of claim 1, which has a dental treatment instruction data forming means for storing a subdivided animation of an animation obtained by pre-made subdivided dental treatment by means of data forming means. The data is stored in the storage means, and the subdivided animation data is selected from the storage means and connected, thereby forming a dental treatment instruction material and displaying the information by the display means. An intraoral imaging system according to the first aspect of the invention is characterized in that it comprises a hand-held imaging means for imaging the oral cavity, and means for irradiating the imaging means with illumination light indicating the imaging site.