JP2024079296A - Color acquisition support method - Google Patents

Abstract

[Problem] To realize efficient dental prosthesis production work for both the requester and the recipient of the request.
[Solution] The color acquisition support method of the present invention is a color acquisition support method that supports color acquisition when requesting the production of a dental prosthesis, characterized in that a party requesting the production of the dental prosthesis can use a first electronic device to input an image of the oral cavity of a patient who will use the dental prosthesis and a color sample of the teeth, as well as request information from the party requesting the production of the dental prosthesis, and a party to whom the dental prosthesis is requested can output the image and the request information using a second electronic device, the first and second electronic devices can use a social network service, and communication of the image and the request information between the first and second electronic devices is via the social network service.
[Selected Figure] Figure 1

Description

The present invention relates to a color acquisition support method that assists dentists in acquiring color when requesting the production of a dental prosthesis from a dental laboratory.

When a dentist requests a dental laboratory to manufacture a dental prosthesis such as a vestibular crown, the dentist communicates the numerous and varied colors of the patient's teeth to the dental laboratory by comparing the color of the patient's teeth with a tooth color sample called a shade guide (see, for example, Patent Document 1).

However, the information on the color sample alone is insufficient to convey the patient's color information, which varies from person to person, so in practice dentists communicate the color of the patient's teeth by sending a photograph of the shade guide and the patient's teeth (intraoral cavity) taken at the same time to the dental laboratory. This process of capturing information on the color of the teeth by photographing them is called "color acquisition," and is essential information for producing dental prostheses with accurate colors.

Generally, when a dentist (dental clinic) sends a photograph to a dental laboratory (dental laboratory), the procedure is complicated, such as: 1) taking a photograph with a digital camera and recording the image data on a portable recording medium such as an SD card or USB memory attached to the camera body, and then sending the recording medium; 2) temporarily importing the image data taken with the digital camera into a personal computer, transferring the image data to the recording medium, and then sending it; or 3) temporarily importing the image data taken with the digital camera into a personal computer, attaching the image data to an e-mail, and then sending it (see, for example, Patent Document 2).

JP 2002-90223 A JP 2020-25612 A

However, color acquisition involving the sending of photographs as described above requires at least the steps of taking a photograph inside the patient's mouth and sending the photograph as an email attachment, and each step is time-consuming due to the complexity of the procedure. In addition, the degree of freedom in the camera operation on the sending side means that the color of the photograph inside the patient's mouth and the resulting dental prosthesis are prone to variation due to lighting and the characteristics of the image sensor. Furthermore, even when a photograph is taken with a shade guide attached to the patient's mouth, deviations in color tone can occur depending on the position and angle of the teeth and shade guide in the photograph, which hinders the smooth production of dental prostheses.

In order to solve the above-mentioned technical problems, the present invention aims to provide a color acquisition support method that realizes the efficiency of dental prosthesis production work for both the client and the recipient of the request.

In order to solve the above-mentioned technical problems, the color tone acquisition support method of the present invention is a color tone acquisition support method that supports color tone acquisition when requesting the production of a dental prosthesis, and is characterized in that the requester of the dental prosthesis can use a first electronic device to input an image of the oral cavity of the patient who will use the dental prosthesis and a tooth color sample together with the request information from the requester, the recipient of the request for the dental prosthesis can output the image and the request information using a second electronic device, the first and second electronic devices can use a social network service, and the communication of the image and the request information between the first and second electronic devices is via the social network service.

The social network service used in the color acquisition support method of the present invention is a communication service that allows text and images to be sent to a specific communication partner, and is capable of sending and receiving information using a mobile phone such as a smartphone or a tablet terminal (hereinafter, these will be collectively referred to as "mobile terminals"), and is a service that allows sending and receiving text and images without using a mailer for email, which is common on personal computers. Known examples of such social network services include LINE (registered trademark) from LINE Corporation, Messenger (registered trademark) from Meta Platforms Inc., Kakao Talk (registered trademark) from Kakao Corporation, and WeChat (registered trademark) from Tencent Holdings Limited, and a good application can be selected in a short time after the application starts up (loading). Applications for using the social network services can be downloaded to these mobile terminals, and these services are still used by many people today.

In the color acquisition support method of the present invention, the requester is typically a dentist or dental clinic that provides dental prostheses to patients and performs dental treatment. On the other hand, the requestee is a dental laboratory or a person with similar processing technology. The requester uses a first electronic device and the requestee uses a second electronic device, both of which are mobile terminals. In a typical color acquisition support method of the present invention, a dedicated application can be downloaded to the first and second electronic devices, respectively, and the first and second electronic devices can open the downloaded application to communicate images and request information. In case the other party does not yet have the dedicated application installed, a download URL can be included in the communication information.

The request information in the color acquisition support method of the present invention includes information such as the imaging date, the patient's name, the shade guide color number, and information on the requester and the requestee, and can also include notes as necessary. The requester can select the requestee when using a social network service, and according to an embodiment of the present invention, the requester can select the requestee information from the history or from advertisements.

One feature of the color acquisition support method of the present invention is that it is premised on using a mobile terminal to capture images of both the patient's oral cavity and the tooth color sample, and the image capture can proceed while a guide contour line for this purpose is displayed on the camera monitor. In addition, the position of the tooth color sample's unique number can also be indicated by a second contour line in association with the guide contour line, and the contour line indicating the position of the tooth color sample relative to the patient's teeth can also be switched between the upper and lower jaws. Furthermore, when capturing an image of the patient's oral cavity and the tooth color sample together, while it is essential that the image be captured with a flash, it is also possible to add the option of capturing the image without a flash. In addition, when capturing an image of the patient's oral cavity and the tooth color sample together, a photo of the patient's facial features can also be added.

The color acquisition support method of the present invention can display a guide on how to take images of the patient's oral cavity and the patient's facial features. Specifically, by selecting the information button (tutorial button) on the monitor screen, a tutorial screen can be displayed that shows the ideal angle for taking images with a mobile device and the ideal position and orientation of the shade guide.

In the color acquisition support method of the present invention, the request information can be incorporated into the captured image of the patient's oral cavity so that it is clearly displayed. For example, the following characters can be displayed superimposed on the bottom left or right corner of the captured image: the date of capture, the patient's name, the shade guide number, and the name of the clinic (requester).

In the color tone acquisition support method of the present invention, the second electronic device of the requesting party can gray the transmitted image and can also overlay some of the pixels of the photograph of the tooth color sample on some of the pixels of the photograph of the patient's teeth, or overlay some of the pixels of the photograph of the patient's teeth on some of the pixels of the photograph of the tooth color sample, to compare differences in color tone.

1 is a diagram showing a schematic overall picture of a system for realizing a color tone acquisition support method according to an embodiment of the present invention; FIG. 13 is a schematic screenshot of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a dental clinic menu screen. FIG. 11 is a schematic screenshot of a mobile device for explaining the workflow in the color tone acquisition support method according to the embodiment, showing a registration screen of a dental laboratory. FIG. 11 is a schematic screenshot of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing an editing screen of a dental laboratory. FIG. 13 is a schematic screenshot of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a registration screen of a dental clinic. FIG. 13 is a schematic screenshot of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing an editing screen for a dental clinic. 13A and 13B are schematic screenshots of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a screen of a list of advertisement information. 13A and 13B are schematic screenshots of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a screen of a history of color tone acquisition support work. 13A to 13C are schematic screenshots of a tutorial screen of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment. 13A and 13B are schematic screenshots of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing another tutorial screen. 11A to 11C are schematic screenshots of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a photography screen. FIG. 11 is a schematic screenshot of a mobile device for explaining the workflow in the color tone acquisition support method according to the embodiment, showing an upper jaw photographing screen (part 1). FIG. 13 is a schematic screenshot of a mobile device for explaining the workflow in the color tone acquisition support method of the embodiment, showing an upper jaw photographing screen (part 2). 11A to 11C are schematic screenshots of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a screen at the time of shooting. FIG. 11 is a schematic screenshot of a mobile device for explaining the workflow in the color tone acquisition support method according to the embodiment, showing a lower jaw photographing screen (part 1). FIG. 11 is a schematic screenshot of a mobile device for explaining the workflow in the color tone acquisition support method according to the embodiment, showing a lower jaw photographing screen (part 2). FIG. 11 is a schematic screenshot of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a face photographing screen (part 1). FIG. 11 is a schematic screenshot of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a face photographing screen (part 2). 13A to 13C are schematic screenshots of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a tutorial screen (taken along with a guide). FIG. 13 is a schematic screenshot of a mobile device for explaining the workflow in the color tone acquisition support method according to the embodiment, showing a tutorial screen (upper jaw photography part 1). FIG. 13 is a schematic screenshot of a mobile device for explaining the workflow in the color tone acquisition support method according to the embodiment, showing a tutorial screen (upper jaw photography part 2). FIG. 13 is a schematic screenshot of a mobile device for explaining the workflow in the color tone acquisition support method according to the embodiment, showing a tutorial screen (mandibular photographing part 1). FIG. 11 is a schematic screenshot of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a tutorial screen (facial image capture). 13A to 13C are schematic screenshots of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing an additional shooting screen (part 1). 13A to 13C are schematic screenshots of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing an additional shooting screen (part 2). 13A to 13C are schematic screenshots of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing an additional shooting screen (part 3). 11A to 11C are schematic screenshots of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing an information input screen. 13 is a schematic screenshot of a mobile device for explaining the workflow in the color tone acquisition support method according to the embodiment, showing a clinic side result confirmation screen. FIG. FIG. 13 is a schematic screenshot of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing an SNS usage screen (preparing to send). FIG. 11 is a schematic screenshot of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing an SNS usage screen (talk screen). 13A to 13C are schematic screenshots of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing an email sending prompt screen. 13A to 13C are schematic screenshots of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing an email sending screen. 13A to 13C are schematic screenshots of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a photo storage screen. FIG. 11 is a schematic screenshot of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a menu screen on the dental laboratory side. FIG. 13 is a schematic screenshot of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a color tone confirmation screen on the dental laboratory side. FIG. 11 is a schematic screenshot of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a gray conversion screen on the dental laboratory side. FIG. 13 is a schematic screenshot of a mobile device for explaining a workflow in the color tone acquisition support method according to the embodiment, showing a color tone determination screen on the dental laboratory side. FIG. 13 is a schematic screenshot of a mobile device for explaining the workflow in the color tone acquisition support method according to the embodiment, showing a facial photo editing tutorial screen on the dental laboratory side. FIG. 13 is a schematic screenshot of a mobile device for explaining the workflow in the color tone acquisition support method according to the embodiment, showing a photo loading screen on the dental laboratory side. FIG. 13 is a schematic screenshot of a mobile device for explaining the workflow in the color tone acquisition support method according to the embodiment, showing an editing screen for a facial photo on the dental laboratory side.

An embodiment of the color tone acquisition support method of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a schematic overall view of a system for realizing the color tone acquisition support method of one embodiment of the present invention, and shows a state where a dentist D at a dental clinic requests a dental technician T at a dental laboratory to make a dental prosthesis for a patient P. The dentist D, who is the requester, uses a mobile device M1, which is a first electronic device, to take a picture of the oral cavity of the patient P, and is configured to send the picture of the oral cavity of the patient P and the request information to a mobile device M2, which is a second electronic device of the dental technician T who is the requester. The mobile devices M1 and M2, which are the first and second electronic devices, are mobile terminals such as so-called smartphones or electronic terminals of a type called a tablet that are usually available on the market. The color tone acquisition support method of this embodiment is a method that is realized through the execution of a program that can be installed in the form of an app on these mobile devices M1 and M2. A program for executing the color tone acquisition support method is also installed on these mobile devices M1 and M2, but it is assumed that social network services such as LINE and Messenger are also available at the same time.

A system that realizes the color tone acquisition support method of this embodiment requires at least a pair of electronic devices that can communicate, and can also support a system that interconnects multiple clinics and multiple dental laboratories. As for social network services, the embodiment uses LINE as a typical example, but it is also possible to use other social network services that allow request information such as photos and text to be sent to specific recipients. It is assumed that mobile devices M1 and M2 also have cameras, but instead of mobile devices M1 and M2, devices with separate cameras connected as accessories or devices that can transmit captured data can also be used.

To realize the color tone acquisition support method of this embodiment, a color tone acquisition support app is downloaded from a download center corresponding to each carrier for mobile devices M1 and M2, and made available for use on the mobile devices M1 and M2. Even if the app has not yet been installed at first, the dental laboratory can send a URL for downloading the app when contacted by mobile device M2, and the app can be downloaded by accessing the URL.

When ordering the manufacture of dental prostheses, it is important for the technician to understand the patient's tooth color with minimal error. Since lighting is not generally standardized in dental clinics, it is important to take a picture of both the patient's teeth and the tooth color sample (shade guide). A tooth color sample (shade guide) is a tooth color sample used when whitening or filling or capping, and lists the color and brightness of the teeth. A number is given to each sample tooth with a different color tone. For example, according to one example of a shade guide, in the case of Japanese people, most Japanese people are type A in terms of skin color, and A3 to 3.5 is the standard, with A being characterized by 3.5 being between 3 and 4. In the tooth color sample (shade guide), a number is provided on the surface of the retaining part made of a metal piece protruding from each tooth of the sample, and when taking a picture of the patient's mouth and the tooth color sample together, it is important to take a picture of the color sample number at the same time. In particular, the color tone acquisition support method of this embodiment displays effective tutorials for this purpose and displays contour lines when shooting, as described below.

The color tone acquisition support method of this embodiment will be described below with reference to Figs. 2 to 40 along its flow. The flow of the color tone acquisition support method to be implemented includes, as the first step, the registration of the requesting dental clinic and the requested dental laboratory. Then, there is the step of taking a photograph and inputting the requested information at the requesting dental clinic, which can be a subsequent step to the input of the requesting dental clinic and the requesting dental laboratory, or can be a separate step, followed by a step of transmitting the information data, and a step of receiving and using the data information at the requested dental laboratory.

To explain the registration process of the requesting dental clinic and the requested dental laboratory, FIG. 2 shows a dental clinic menu screen 10 on the mobile device M1 at the requesting dental clinic. On the dental clinic menu screen 10, the name of the application "Color Tone Acquisition Assist" is displayed at the top of the screen, and in the upper right corner is a question button 11 linked to the tutorial. From the top to the middle of the screen is a display section 12 for the dental clinic menu, which includes a color tone acquisition button 13 with a camera icon and "Acquire color tone" displayed, and a history display button 14 with a clock icon and "View history". Further below that is a link 15 with "Switch to dental laboratory menu" displayed for switching from the dental clinic menu to the dental laboratory menu. At the bottom of the dental clinic menu are a registration button 16 for the requesting dental clinic and the requested dental laboratory, a button 17 with "About this app" displayed that links to an explanation page about this app, and at the bottom is an advertisement section 18 for displaying advertisements for dental laboratories and dental clinics.

When the registration button 16 shown in FIG. 2 is clicked or touched, the dental clinic/dental laboratory registration screen shown in FIG. 3 is displayed. The dental clinic/dental laboratory registration screen has a dental clinic tab 20 and a dental laboratory tab 21 that can be switched using the tabs at the top of the screen. In FIG. 3, a list 22 of dental laboratories that are already registered is displayed. To further add and register a new dental laboratory, the dental laboratory add button 23 labeled "Add new dental laboratory" at the bottom of the dental clinic menu screen 10 is clicked or touched.

Clicking or touching the Add Dental Laboratory button 23 displays a dental laboratory editing (registration) screen as shown in FIG. 4. From the top of the dental clinic menu screen 10, an input box 30 for the dental laboratory name, an input box 31 for an email address, and an input box 32 for the dental technician name are displayed, and inputting information into these boxes allows the dental laboratory to be registered and edited. Entering the dental laboratory name is required, but entering an email address is not necessary if using a social networking service such as LINE. Clicking or touching the Register button 33 at the bottom allows the dental laboratory information to be saved.

Next, when the tab is switched to the dental clinic tab 20 on the dental clinic/dental laboratory registration screen shown in FIG. 3, a list 24 of dental clinics that have already been registered is displayed, as shown in FIG. 5. To further add and register a new dental clinic, click or touch the dental clinic addition button 24 labeled "Add new dental clinic" at the bottom of the dental clinic menu screen 10.

Clicking or touching the Add Dental Clinic button 24 displays a dental clinic editing (registration) screen as shown in FIG. 6. From the top of the dental clinic menu screen 10, an input box 34 for the dental clinic name, an input box 35 for an email address, and an input box 36 for the dentist name are displayed, and inputting information into these boxes allows the dental clinic to be registered and edited. Entering the dental clinic name is required, but entering an email address is not necessary if using a social networking service such as LINE. Clicking or touching the Register button 37 at the bottom allows the dental clinic information to be saved.

The above registration process for dental clinics and dental laboratories is assumed to be completed before actually starting transmission, but it can also be set up just before sending image information or request information. Dental clinics can also register multiple dental laboratories to send to, and dental laboratories can also register multiple dental clinics with which they do business.

Furthermore, below the advertisement column 18 at the bottom of the dental clinic menu screen 10 shown in Figure 2, there is a button 19 labeled "See more." Clicking or touching this button 19 displays advertisement cards 38, 39, and 40 as shown in Figure 7, and businesses that have paid an advertising fee to the operator of the app can place advertisements that are based on the assumption that dental clinics and other similar establishments are frequently used.

When viewing the history section in the middle of the dental clinic menu screen shown in FIG. 2, clicking or touching the displayed button 14 displays history data 42 of past color tone acquisitions in list format as shown in FIG. 8, allowing the user to easily view the history data 42 when it is necessary to look back on past color tone acquisitions. Although not shown in FIG. 8, a history search window can be provided so that searches can be performed when there is a large amount of history data 42. As shown in FIG. 8, the history data 42 can be a combination of the date and time of transmission, a thumbnail of the patient's intraoral photograph, and a string of request information, but it is also possible to extract and display part of the memo.

In addition, in the app that executes the color tone acquisition assistance method of this embodiment, when the button 17 for this app on the dental clinic menu screen shown in FIG. 2 is clicked or touched, a screen explaining the app such as that shown in FIG. 9 and FIG. 10 appears. FIG. 9 is a screen 43 that uses illustrations to explain the overall function of this app called color tone acquisition assist, and shows that color tone acquisition information can be sent via LINE or email. FIG. 10 is a screen 44 that explains that, regarding medical treatment fees, the storage of photos within the app is calculated into medical treatment fees, and has a sufficient message function for the dental clinic.

Next, as an example of the color tone acquisition support method of this embodiment, the flow from shooting to sending will be described with reference to Figs. 11 to 33. Fig. 11 shows a photo shooting screen for color tone acquisition, and three shooting methods can be performed from the mobile device M1, which is a mobile terminal displaying this screen. The first shooting method is the required shade taking, which is a method of shooting with a flash, and can be performed by clicking or touching the large button 51 located in the upper left corner and displaying "Shoot with flash ON". The second shooting method is optional shade taking, which is a method of shooting without a flash, and can be performed by clicking or touching the large button 52 located in the upper right corner and displaying "Shoot with flash OFF". The third shooting method is facial photography, which can be performed by clicking or touching the large button 53 located in the lower left corner and displaying "Shoot" below the characters for facial photography. Radio buttons are arranged in area 54, and as a sending setting, you can select either to send only the photo displayed here (this screen) or to send all the photos you have taken. Note that the ? button on the top right corner indicates the sending method. If you select the (Question) button 49, a tutorial screen like the one described below will be displayed.

Next, the user can enter the photography mode by clicking or touching button 51 or button 52. In photography, in one example of the color tone acquisition support method of this embodiment, when an image of the patient's oral cavity and a tooth color sample is photographed, the position of the tooth color sample relative to the patient's teeth can be indicated by a contour line. Figures 12 and 13 show an example of such a contour line shown on a black background when photographing the upper jaw. There are three types of contour lines shown in Figures 12 and 13: contour line 55, which serves as a guide for the position of the tooth to be manufactured as a dental prosthesis, contour line 56, which guides the tooth color sample, i.e., the tooth mold part of the shade guide, and contour line 57, which guides the number part of the shade guide. Contour line 56 is the contour line of the shade guide corresponding to three teeth lined up horizontally, and contour line 57 is also the number of these three, so it is a contour line of three circles lined up. The contour line 55, which guides the position of the patient's teeth, and the contour line 56, which guides the tooth mold part of the shade guide, are drawn in white, but the contour line 57, which guides the number part of the shade guide, is particularly important and is easily forgotten, so it is drawn in a conspicuous color, such as red. At the bottom of the screen, there are buttons 58 and 59 for switching between the upper and lower jaws, and the image from the camera attached to the mobile device M1 can be overlaid by, for example, hovering the mouse over the shutter button 60 or by one-clicking it. At the top of the screen that displays these contour lines 55, 56, and 57, short sentences and illustrations about tips for taking pictures are also displayed, and a design is made to prevent mistakes when taking pictures as much as possible. The difference between Figures 12 and 13 is whether or not explanations (gray semi-transparent background color) are added to each position of the contour lines 55, 56, and 57, and the dentist can select whether or not to include the explanations, and the explanations can also be made to fade out after a specified time. In principle, the photos sent are still images, but it is also possible to configure the system to send and receive video of the patient's oral cavity and tooth color samples instead of photos.

Figure 14 shows the screen when photographing the inside of a patient's mouth (upper jaw) with a shade guide, and the photographer photographs while adjusting the position and direction of the mobile device M1 and the intensity of the lighting so that the guided object is captured in the position guided by the three contour lines 55, 56, and 57. Since the photograph is taken using the mobile device M1, it is possible to take several pictures and send the best one, or it is also possible to send multiple pictures.

15 and 16 show an example of such contour lines shown on a black background when photographing the lower jaw. There are three kinds of contour lines shown in Figs. 15 and 16, as in the case of photographing the upper jaw shown above. These are contour line 61, which guides the position of the teeth to be produced for the dental prosthesis, contour line 62, which guides the tooth mold part of the tooth color sample, i.e., the shade guide, and contour line 63, which guides the number part of the shade guide. Contour line 62 is the contour line of the shade guide corresponding to three teeth lined up horizontally, and contour line 63 is also the number for these three, so it is a contour of three circles lined up. Contour line 61, which guides the position of the patient's teeth, and contour line 62, which guides the tooth mold part of the shade guide, are drawn in white, but contour line 63, which guides the number part of the shade guide, is particularly important and is easily forgotten, so a conspicuous color such as red is used. At the bottom of the screen are buttons 58, 59 for switching between the upper and lower jaws, and by, for example, hovering the mouse over or clicking the shutter button 60, an image from the camera attached to the mobile device M1 can be superimposed. At the top of the screen that displays these contours 61, 62, 63, short sentences and illustrations on tips for taking pictures are also displayed, in an effort to prevent mistakes when taking pictures as much as possible. The difference between Figures 15 and 16 is whether or not an explanation (gray semi-transparent background color) for each of the contours 61, 62, 63 is added at each position, and the dentist can choose whether or not to include the explanation, and the explanation can also be made to fade out after a specified period of time.

Next, the facial photographing method will be described. Figure 17 shows the contours 65, 66 when photographing the face, which consist of the face contour 65 and the mouth contour 66. It is desirable to photograph the patient with their mouth open so that the state of the oral cavity of the patient's face can be grasped, and the mouth contour 66 representing the state of the patient's mouth being open is also provided for facial photographing. Figure 18 shows the screen when switching from a black background to the camera, and the face of patient P can be adjusted while looking at the face contour 65 and the mouth contour 66, and the photograph can be taken at a well-adjusted angle and distance by clicking or touching the button 60.

In the color tone acquisition support method of this embodiment, as shown in FIG. 11, three types of photography can be carried out, the first photography method being mandatory shade taking with flash, the second photography method being optional shade taking without flash, and the third photography method being facial photography. For each of these three photography methods, a tutorial screen with illustrations as shown in FIG. 19 to FIG. 23 can be displayed.

Figure 19 is a tutorial screen for shade taking and facial photography. If you select the ? (question) button 49 on the top right of the color tone acquisition photography screen in Figure 11, for example, an illustration or a photo of the oral cavity will be displayed, and a screen for teaching the photography method will be displayed, for example, in the form of a pop-up or modal window. Figures 20 and 21 are tutorial screens for photographing the upper jaw. The screen 72 shown in Figure 20 shows the correct position of the shade guide with an illustration, which also shows the correct position of the shade guide number. The screen 73 shown in Figure 21 shows that the correct photography is to align the direction of the mobile device M1 at the time of photography and the end of the shade guide with the end of the upper teeth. Figure 22 is a tutorial screen for photographing the lower jaw. The screen 74 shown in Figure 22 shows that the correct photography is to align the direction of the mobile device M1 at the time of photography and the end of the shade guide with the end of the lower teeth. It is possible to provide a screen showing the correct position of the shade guide with an illustration as in Figure 20 for the lower teeth, but in this embodiment, the upper and lower jaws are similar, so this is omitted. These tutorial screens for the upper and lower jaws can be displayed in pop-up or modal window format by touching the thumbnail (left side) and excerpt (right side) areas 50 of the illustrations at the top of the screen in the shooting mode of the screens of Figures 12 to 16, or by selecting the ? (question) button 49 at the top right. Figure 23 shows a tutorial screen 75 for photographing the face, and if the ? (question) button 49 at the top right is selected when photographing the face, a screen 75 that teaches the shooting method is displayed.

In the color tone acquisition support method of this embodiment, when the required shade taking photography is completed, the screen returns to the color tone acquisition photography screen as shown in FIG. 24. Then, the area where the flash ON button was displayed is replaced with the captured photo 81 and displayed. Also, if facial image photography is also completed, when the screen returns to the color tone acquisition photography screen as shown in FIG. 25, the area where the flash ON button was displayed is replaced with the captured photo 81 and the facial image photography area is replaced with the captured facial image 82.

When the required shade taking has been completed, if there are multiple photos of the patient's oral cavity, it is possible to narrow down the number of photos to be sent to one, or select some of the multiple photos to send. Figure 26 shows multiple shade takings of the patient's oral cavity and color samples stored in the mobile device M1, and multiple shade taking photos can be handled within one session. The selected photo 83 is displayed at the top of the screen, and thumbnail photos 84 and 85 are displayed below it. The photo to be sent can be selected by generally selecting a thumbnail photo and touching or clicking the decision button 86 at the bottom of the screen to decide which photo to send.

The request information is added to the photo data to be sent. Figure 27 shows the input screen for the added request information. The top of the input box is a patient name input box 91, which can be input by operating a software keyboard 96 displayed at the bottom of the screen. Below that is a shade number input section 92, where guide numbers such as A1, A2, A3, A3.5, A4, B1, B2, B3, B4, C1, C2, C3, C4, D2, D3, and D4 can be displayed and selected using a pull-down or other simple input. Below that are a dental clinic name box 93, a dentist name box 94, and a dental technician name box 95, and request information can be added by inputting information in these boxes. The dental clinic name box 93, dentist name box 94, and dental technician name box 95 can be used to call up and input pre-registered data, and previous history, etc. can also be reflected.

Figure 28 shows the color tone acquisition result confirmation screen. The top of the screen displays a shade taking photo 96 and a facial photo 97 to be sent, and below that is a confirmation screen 98 that displays the request information, including the date of shooting, patient name, shade number, dental clinic, dental laboratory, and transmission settings. The requesting dentist checks the information on this screen and operates the four buttons at the bottom of the color tone acquisition result confirmation screen to perform the next task. The four buttons are a line send button 99, an email send button 100, a print button 101, and an end button 102. To send quickly, touch the line send button 99, or if there is a reason that line cannot be used, email or other methods can be used instead.

When the LINE Send button 99 is touched and selected, a modal window 103 for setting the destination for LINE sending is displayed as shown in FIG. 29. If the requested dental laboratory is already displayed, the destination can be easily set by selecting it. Even if the dental laboratory to which the data is to be sent has not yet been set at this point, it is possible to set the destination again here. It is also possible to send the data by e-mail instead of using a social networking service, as described below. It is also possible to put the work on hold here and send the results of the color tone acquisition after a certain amount of time has passed.

Figure 30 shows the LINE screen 110 of the requesting dentist's mobile device M1 after sending a LINE message. The request information is displayed as text in a message 111 on the LINE chat screen, and a photo is also sent according to the LINE service, allowing the recipient to automatically save the photo. In addition, according to the LINE chat function, when the recipient receives and opens the message, the word "read" is displayed on the sender along with the time. In addition to the request information, the message 111 can contain a URL 113 for downloading the app, and advertisements can also be added. When sending, part of the request information (date, patient name, shade guide number, clinic name) can be superimposed on the shade taking photo, for example in the lower right corner, and a barcode linked to part of the request information can also be added.

Figure 31 shows the prompt window 114 when the destination is a carrier email address (e.g., a mobile phone company's email address). In this case, a prompt is displayed encouraging the user to send or receive via LINE or PC email. Figure 32 shows an email editing screen 115 when email is used as an alternative. It contains a message similar to that of LINE, and can be sent even if the recipient does not support mobile devices.

Next, the work at the dental laboratory, which is the receiving party, will be described. Figures 33 to 40 are diagrams showing the screen of mobile device M2 at the dental laboratory, which is the request destination. Figure 33 is the LINE chat screen 120, and is also the screen on which the results of the color tone acquisition are received. The received message includes the request information, and shows that the photograph sent from the dentist has also been received.

After receiving the line, the dental laboratory mobile device M2 opens the color tone acquisition support app and displays the dental laboratory menu screen 121 shown in FIG. 34. This dental laboratory menu screen 121 is also the screen displayed as a result of selecting the link 15 labeled "Switch to dental laboratory menu" for switching from the dental clinic menu shown in FIG. 2 to the dental laboratory menu. There is a color tone confirmation button 122 labeled "Check the color tone of the photo" on the upper side, and a facial photo editing button 123 labeled "Edit facial photo" on the lower side, which allow the user to proceed to the color tone confirmation work and the facial photo editing work, respectively. The button 127 labeled "About this app" links to an explanation page about the app, and the user can read the explanation page about the color tone acquisition support app, such as disclaimers and copyrights, as necessary. An advertisement column 128 is arranged at the bottom, and a company that has paid an advertising fee to the operator of the app can insert advertisements on the assumption that the app is frequently used by dental laboratories and the like. It is also possible to move to the dental clinic menu by following link 129, which is labeled "Switch to dental clinic menu."

Figure 35 shows the dental laboratory tutorial screen 124. When the ? (question) button 124 in the upper right corner of the dental laboratory menu screen 121 is touched or clicked, the dental laboratory tutorial screen 125 is displayed. This tutorial screen 125 may be displayed as a modal window when the color tone confirmation button 122 is selected.

The dental laboratory's work on intraoral photographs includes an arbitrary gray conversion as shown in FIG. 36, and a comparison between the shade guide and the actual photograph of the patient's teeth as shown in FIG. 37. The gray conversion is a work to prevent optical illusions, and aims to change the area around the teeth and shade guide in the shade-taking image 131 to gray so that the color of the teeth and shade guide is not confused by the surrounding color. In general, optical illusions are psychological phenomena in which something looks different from the actual color depending on the environment, and the color tone of teeth also looks different from the actual color due to the influence of the surrounding gums, etc. For this reason, it is important to prevent optical illusions by gray conversion around the teeth and shade guide. The other color comparison work involves extracting the target tooth photograph 133 and shade guide photograph 134 from the shade-taking image 132, cutting out and transplanting certain pixels, and comparing the color differences. In this case, in the color acquisition support app, some of the pixels of the tooth color sample photo can be overlaid on some of the pixels of the patient's tooth photo, or some of the pixels of the patient's tooth photo can be overlaid on some of the pixels of the tooth color sample photo, and the differences in color can be compared. If there is a difference in color, it is possible to grasp the characteristics of the natural tooth and achieve color harmony in the prosthesis.

When the facial photo editing button 123 is selected from the dental laboratory menu in FIG. 34, a tutorial screen 141 for editing facial photos as shown in FIG. 38 is first displayed, and by selecting the "Load Photo" button 142 at the bottom, the facial photo loading screen 140 shown in FIG. 39 appears. A specific patient's face is selected from the facial photo loading screen 140, and then the facial photo editing mode as shown in FIG. 40 is entered. When prosthetically restoring anterior teeth, it is difficult to determine the inclination of the dentition from a working model, and a photo showing the facial features is a useful countermeasure. By placing guidelines on the facial photo, the inclination can be intuitively detected. This type of facial photo editing work makes it possible to provide a beautiful dental prosthesis that is balanced with the entire face.

As described above, the color acquisition support method of the present invention makes it possible for both the requester and the recipient of the dental prosthesis to use social network services to improve the efficiency of the dental prosthesis production process.

M1, M2 Mobile device P Patient D Dentist T Dental technician 10 Dental clinic menu screen 55-57 Contour line 121 Dental laboratory menu screen

Claims (12)

A color tone acquisition support method for supporting color tone acquisition when ordering the manufacture of a dental prosthesis, comprising:
A requester of the dental prosthesis can input, using a first electronic device, an image of the oral cavity of a patient who will use the dental prosthesis and a tooth color sample, and request information from the requester;
The person who has requested the production of the dental prosthesis can output the image and the request information using a second electronic device;
A color acquisition support method, characterized in that the first and second electronic devices are enabled to use a social network service, and communication of the image and the request information between the first and second electronic devices is via the social network service. A color tone acquisition support method according to claim 1, characterized in that part of the request information is information selected when using the social network service. A color tone acquisition support method according to claim 1, characterized in that the first and second electronic devices can open a downloaded application and communicate the image and the request information. A color tone acquisition support method according to claim 1, characterized in that when an image of the patient's oral cavity and a tooth color sample are captured, the position of the tooth color sample relative to the patient's teeth is indicated by a contour line. A color tone acquisition support method according to claim 4, characterized in that the position of the tooth color sample's unique number is also indicated by a second contour line in association with the contour line. A color tone acquisition support method according to claim 4, characterized in that the contour line indicating the position of the tooth color sample relative to the patient's teeth can be switched between the upper and lower jaws. A color tone acquisition support method according to claim 1, characterized in that when capturing an image of the patient's oral cavity and a tooth color sample, the image must be captured with a flash, but it is also possible to capture the image without a flash. A color tone acquisition support method according to claim 1, characterized in that when an image of the patient's oral cavity and a tooth color sample is taken, a photograph of the patient's facial features can also be added. A color tone acquisition support method according to claim 1, characterized in that a tutorial on the imaging method can be displayed when imaging the patient's face and when imaging the patient's face. A color acquisition support method according to claim 1, characterized in that the image of the patient's oral cavity taken is captured so that the request information is clearly indicated. A color tone acquisition support method according to claim 1, characterized in that the second electronic device of the request destination can perform gray conversion processing on a part of the transmitted image. A color tone acquisition support method according to claim 1, characterized in that the second electronic device of the requesting party can compare differences in color tone by superimposing some of the pixels of the photograph of the tooth color sample on some of the pixels of the photograph of the patient's teeth, or by superimposing some of the pixels of the photograph of the tooth color sample on some of the pixels of the photograph of the tooth color sample.