WO2025182844A1 - 画像処理方法、画像処理装置、及び、プログラム - Google Patents

画像処理方法、画像処理装置、及び、プログラム

Info

Publication number
WO2025182844A1
WO2025182844A1 PCT/JP2025/006176 JP2025006176W WO2025182844A1 WO 2025182844 A1 WO2025182844 A1 WO 2025182844A1 JP 2025006176 W JP2025006176 W JP 2025006176W WO 2025182844 A1 WO2025182844 A1 WO 2025182844A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
pixels
image processing
region
tooth
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/JP2025/006176
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
泰雄 大塚
岳史 浜崎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Management Co Ltd
Original Assignee
Panasonic Intellectual Property Management Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Intellectual Property Management Co Ltd filed Critical Panasonic Intellectual Property Management Co Ltd
Priority to JP2026504261A priority Critical patent/JPWO2025182844A1/ja
Publication of WO2025182844A1 publication Critical patent/WO2025182844A1/ja
Anticipated expiration legal-status Critical
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/045—Control thereof
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/24—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for the mouth, i.e. stomatoscopes, e.g. with tongue depressors; Instruments for opening or keeping open the mouth
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61C—DENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE
    • A61C19/00—Dental auxiliary appliances
    • A61C19/04—Measuring instruments specially adapted for dentistry
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration

Definitions

  • This disclosure relates to an image processing method, an image processing device, and a program.
  • Patent Document 1 discloses an intraoral camera system that captures images of teeth inside the oral cavity.
  • the present disclosure therefore provides an image processing method that can accurately identify plaque areas in dental images.
  • An image processing method includes: irradiating the teeth with light including a wavelength range of blue light to photograph the teeth and dental plaque that are undergoing a fluorescent reaction, thereby obtaining a first RGB image; obtaining color data indicating the color of the tooth region being photographed; and performing image processing including a first image processing on the first RGB image to generate a second RGB image; the first image processing is a process of adjusting the gain of at least two of the red, green, and blue color components so that the difference between the acquired color data and color data based on a first red pixel average value of multiple red pixel values of multiple first pixels in a specific region of the tooth region in the RGB image being processed that is a region of the tooth that is not covered with plaque, a first green pixel average value of multiple green pixel values of the multiple first pixels, and a first blue pixel average value of multiple blue pixel values of the multiple first pixels, falls within a predetermined range.
  • the recording medium may be a non-transitory recording medium.
  • the image processing method and the like disclosed herein can accurately identify plaque areas in dental images.
  • FIG. 1A is a perspective view of an intraoral camera in an intraoral camera system according to an embodiment.
  • FIG. 1B is a cross-sectional view schematically illustrating a photographing optical system incorporated in the intraoral camera in the intraoral camera system according to the embodiment.
  • FIG. 2 is a schematic configuration diagram of an intraoral camera system according to an embodiment.
  • FIG. 3 is a diagram showing the flow of an intraoral photographing operation in the intraoral camera system according to the embodiment.
  • FIG. 4 is a functional block diagram of the mobile terminal according to the embodiment.
  • FIG. 5 is a diagram showing a state in which the front teeth of the upper jaw are photographed from the buccal side.
  • FIG. 6A is a diagram showing an example of a first RGB image of the front teeth captured in the state shown in FIG. 5 .
  • FIG. 6B is a diagram showing an example of color difference data between a plaque region and a tooth region when light including a blue light wavelength range is irradiated onto the tooth without a blue light cut filter.
  • FIG. 6C is a diagram showing an example of color difference data between a plaque region and a tooth region when light including a wavelength range of blue light is irradiated onto the tooth using a blue light cut filter.
  • FIG. 6D is a diagram showing an example of color difference data between the plaque region and the tooth region when light including the wavelength range of blue light and white light are irradiated onto the tooth without a blue light cut filter.
  • FIG. 7A is a diagram showing an example of a second RGB image of the front teeth captured in the state shown in FIG. 5 .
  • FIG. 7A is a diagram showing an example of a second RGB image of the front teeth captured in the state shown in FIG. 5 .
  • FIG. 7B shows an example of color difference data between the plaque region and the tooth region after exposure control processing and white balance adjustment processing are performed when light including the blue light wavelength range is irradiated onto the tooth without a blue light cut filter.
  • FIG. 7C shows an example of color difference data between the plaque region and the tooth region after exposure control processing and white balance adjustment processing are performed when light including the wavelength range of blue light is irradiated onto the tooth using a blue light cut filter.
  • FIG. 7D shows an example of color difference data of the plaque region and the tooth region after exposure control processing and white balance adjustment processing are performed when light including the blue light wavelength range and white light are irradiated onto the tooth without a blue light cut filter.
  • FIG. 8 is a diagram showing an example of a fourth RGB image of the front teeth captured in the state shown in FIG.
  • FIG. 9 is a diagram showing another example of the fourth RGB image of the front teeth captured in the state shown in FIG.
  • FIG. 10 is a flowchart of image processing in the mobile terminal.
  • FIG. 11 is a flowchart showing the details of the process for detecting the natural tooth region.
  • FIG. 12 is a diagram showing an example of an RGB image (first RGB image).
  • FIG. 13 is a diagram showing an example of the detected first natural tooth region.
  • FIG. 14 is a diagram showing an example of a detected gingival region.
  • FIG. 15 is a diagram showing an example of the second natural tooth region.
  • the inventors therefore discovered an image processing method that can accurately identify plaque areas in a tooth image by performing image processing that takes into account the color of the tooth area of the person being identified.
  • the image processing method acquires a first RGB image obtained by photographing the teeth and dental plaque that are undergoing a fluorescent reaction by irradiating the teeth with light including a wavelength range of blue light, acquires color data indicating the color of the tooth region of the imaged subject, and generates a second RGB image by performing image processing including a first image processing on the first RGB image, wherein the first image processing is a process of adjusting the gain of at least two of the red, green, and blue color components so that the difference between the acquired color data and color data based on a first red pixel average value of multiple red pixel values of multiple first pixels within a specific region that is the tooth region of the RGB image to be processed, a first green pixel average value of multiple green pixel values of the multiple first pixels, and a first blue pixel average value of multiple blue pixel values of the multiple first pixels falls within a predetermined range.
  • the image processing method according to the second aspect is the image processing method according to the first aspect, wherein in the first image processing, an area surrounded by an outline that is the boundary where the brightness of the RGB image to be processed changes from pixels darker than a predetermined brightness to pixels brighter than the predetermined brightness is detected as the specific area.
  • the image processing method is the image processing method according to the first aspect, and in the first image processing, of the multiple RGB pixels constituting the specific area, a first area that is (i) an area where the luminance value is equal to or greater than a predetermined first threshold, or (ii) an area where the green pixel value is equal to or greater than a predetermined second threshold, is detected as a natural tooth area, and multiple second pixels included in the first area are set as the multiple first pixels.
  • the image processing method according to the fourth aspect is the image processing method according to the third aspect, in which, in the first image processing, an area obtained by excluding areas of plaque and tartar from the first area is detected as the natural tooth area.
  • the image processing method according to the fifth aspect is the image processing method according to the first aspect, wherein the specific region has, as the plurality of first pixels, a plurality of pixels among the plurality of second pixels constituting the tooth region, whose red, green, and blue pixel values are the largest and whose green pixel value is equal to or greater than a predetermined value.
  • areas of the teeth that are likely to be free of plaque can be identified as specific areas.
  • the image processing method is the image processing method according to any one of the first to fifth aspects, and further comprises converting the color space of the second RGB image into an HSV space to generate an HSV image, identifying a specific pixel region in which one or more fourth pixels of the HSV image that satisfy at least one of a first predetermined range for saturation, a second predetermined range for hue, and a third predetermined range for brightness are located, and performing an enhancement process on the specific pixel region in the second RGB image to generate a third RGB image.
  • the image processing method is the image processing method according to the fifth or sixth aspect, further comprising: generating an HSL image by converting the color space of the second RGB image into an HSL space; identifying a specific pixel region in which one or more fourth pixels of the plurality of fourth pixels in the HSL image are located, the fourth pixels having at least one of a saturation within a first predetermined range, a hue within a second predetermined range, and a luminance within a third predetermined range; and performing an enhancement process on the specific pixel region in the second RGB image to generate a third RGB image.
  • the image processing method according to the eighth aspect is the image processing method according to any one of the first to seventh aspects, in which the color data is acquired based on a photographed image obtained by photographing the tooth.
  • tooth color data can be easily obtained by taking an image of the tooth.
  • the image processing method according to the ninth aspect is the image processing method according to the eighth aspect, in which the captured image is an image obtained by capturing an image with a camera provided in a mobile terminal.
  • tooth color data can be easily obtained by taking an image of the tooth with the camera built into the mobile device.
  • the image processing method according to the tenth aspect is the image processing method according to the eighth aspect, wherein the captured image is an image obtained by capturing an image of the inside of the oral cavity with an intraoral camera.
  • tooth color data can be easily obtained by taking images of the teeth with an intraoral camera.
  • the image processing method according to the eleventh aspect is the image processing method according to any one of the first to seventh aspects, wherein the color data indicates the tooth color corresponding to an identifier designated by the user in a shade guide indicating tooth colors.
  • tooth color data can be obtained without taking images based on a shade guide.
  • the image processing device comprises an acquisition unit that acquires a first RGB image obtained by photographing the tooth and dental plaque that are undergoing a fluorescent reaction by irradiating the tooth with light including a wavelength range of blue light; a storage unit that stores color data indicating the color of the tooth region; and a generation unit that generates a second RGB image by performing image processing including first image processing on the first RGB image, wherein the first image processing is a process that adjusts the gain of at least two of the red, green, and blue color components so that the difference between the acquired color data and color data based on a first red pixel average value of multiple red pixel values of multiple first pixels in a specific region that is the tooth region of the RGB image to be processed, a first green pixel average value of multiple green pixel values of the multiple first pixels, and a first blue pixel average value of multiple blue pixel values of the multiple first pixels falls within a predetermined range.
  • the photographic optical system 12 is incorporated into the head portion 10a and neck portion 10c.
  • the photographic optical system 12 includes an image sensor 14 and a lens arranged on its optical axis LA.
  • the imaging optical system 12 of the intraoral camera 10 is incorporated into the head portion 10a and neck portion 10c.
  • the imaging optical system 12 includes an image sensor 14 and a lens 16 arranged on its optical axis LA.
  • the imaging element 14 is a photographing device such as a C-MOS sensor or CCD element, and an image of the tooth D is formed by the lens 16.
  • the imaging element 14 outputs a signal (image data) corresponding to the formed image to the outside.
  • Lens 16 is, for example, a condenser lens that forms an image of the tooth D that is incident on the imaging element 14. Note that lens 16 may be a single lens or a lens group consisting of multiple lenses.
  • the imaging optical system 12 further includes a mirror 18 that reflects the image of the tooth D toward the lens 16, a blue light cut filter (blue blocking element) 20 arranged between the mirror 18 and the lens 16, and an aperture 24 arranged between the lens 16 and the image sensor 14.
  • a mirror 18 that reflects the image of the tooth D toward the lens 16
  • a blue light cut filter (blue blocking element) 20 arranged between the mirror 18 and the lens 16
  • an aperture 24 arranged between the lens 16 and the image sensor 14.
  • the mirror 18 is positioned on the optical axis LA of the imaging optical system 12 so as to reflect the image of the tooth D that passes through the entrance 12a of the imaging optical system 12 toward the lens 16.
  • the blue light cut filter 20 is a filter that cuts out blue wavelength light components contained in the light that enters the image sensor 14.
  • the blue light cut filter 20 cuts out light including the blue wavelength range from the light before it enters the image sensor 14.
  • the intraoral camera 10 is also equipped with multiple first to fourth LEDs 26A-26D as lighting devices that illuminate the tooth D to be photographed during photography.
  • the first to fourth LEDs 26A-26D are, for example, blue LEDs.
  • the first to fourth LEDs 26A-26D are arranged to surround the entrance 12a.
  • a translucent cover 28 is provided on the head unit 10a to cover the first to fourth LEDs 26A-26D and the entrance 12a.
  • Some of the first to fourth LEDs 26A-26D may be white LEDs. Using white LEDs for some of the first to fourth LEDs 26A-26D can brighten the first RGB image and improve the balance of blue pixel values relative to red and green pixel values.
  • the intraoral camera 10 has a composition adjustment mechanism 30 and a focus adjustment mechanism 32, as shown in Figure 1B.
  • the composition adjustment mechanism 30 is composed of a housing 34 that holds the image sensor 14 and lens 16, and an actuator 36 that moves the housing 34 in the direction of extension of the optical axis LA.
  • the actuator 36 adjusts the position of the housing 34, thereby adjusting the angle of view, i.e., the size of the row of teeth imaged on the image sensor 14.
  • the composition adjustment mechanism 30 automatically adjusts the position of the housing 34 so that, for example, the entirety of one tooth is captured in the captured image.
  • the composition adjustment mechanism 30 also adjusts the position of the housing 34 based on user operation so that the angle of view desired by the user is achieved.
  • the focus adjustment mechanism 32 is held within the housing 34 of the composition adjustment mechanism 30 and is composed of a lens holder 38 that holds the lens 16, and an actuator 40 that moves the lens holder 38 in the direction of extension of the optical axis LA.
  • the actuator 40 adjusts the relative position of the lens holder 38 with respect to the image sensor 14, thereby adjusting the focus, i.e., the focal point.
  • the focus adjustment mechanism 32 automatically adjusts the position of the lens holder 38 so that, for example, a tooth located in the center of the captured image is in focus.
  • the focus adjustment mechanism 32 also adjusts the position of the lens holder 38 based on user operation.
  • the components of the imaging optical system 12, excluding the mirror 18, may be provided on the handle portion 10b of the intraoral camera 10.
  • the image sensor 14 is a photographing device such as a C-MOS sensor or CCD element, and an image of the teeth is formed by a lens.
  • the image sensor 14 outputs a signal (image data) corresponding to the formed image to the outside.
  • the image output by the image sensor 14 is an RGB image in which each of the multiple pixels that make up the image has RGB sub-pixels.
  • FIG. 2 is a schematic diagram of the intraoral camera system according to this embodiment.
  • the intraoral camera system according to this embodiment is generally configured to capture an image of the dentition using an intraoral camera 10 and perform image processing on the captured image.
  • the intraoral camera system includes an intraoral camera 10, a mobile terminal 70, and a cloud server 80.
  • the mobile terminal 70 is, for example, a smartphone or tablet terminal capable of wireless communication.
  • the mobile terminal 70 is equipped with an input device and an output device, such as a touch screen 72 capable of displaying an image of the dentition.
  • the mobile terminal 70 functions as a user interface for the intraoral camera system.
  • the intraoral camera system includes a central control unit 50 as the main part that controls the system, an LED control unit 54 that controls multiple LEDs 26A-26D, a lens driver 56 that controls the actuator 36 of the composition adjustment mechanism and the actuator 40 of the focus adjustment mechanism, and a position sensor 90.
  • the intraoral camera system also includes a wireless communication module 58 that communicates wirelessly with the mobile terminal 70, and a power supply control unit 60 that supplies power to the central control unit 50 and other components.
  • the central control unit 50 of the intraoral camera system is mounted, for example, on the handle portion 10b of the intraoral camera 10.
  • the central control unit 50 also includes a controller 62 such as a CPU or MPU that executes various processes described below, and a memory 64 such as RAM or ROM that stores programs for causing the controller 62 to execute various processes.
  • the memory 64 also stores images of the row of teeth (image data) captured by the image sensor 14, various setting data, and the like.
  • the row of teeth image captured by the image sensor 14 is an example of a first RGB image.
  • the controller 62 transmits the dentition image output from the imaging element 14 to the mobile terminal 70 via the wireless communication module 58.
  • the mobile terminal 70 displays the transmitted dentition image on the touch screen 72, thereby presenting the dentition image to the user.
  • the LED control unit 54 is mounted, for example, on the handle portion 10b of the intraoral camera 10, and turns on and off the first to fourth LEDs 26A to 26D based on control signals from the controller 62.
  • the LED control unit 54 is composed of, for example, a circuit. For example, when a user operates the touch screen 72 of the mobile terminal 70 to activate the intraoral camera 10, a corresponding signal is sent from the mobile terminal 70 to the controller 62 via the wireless communication module 58. Based on the received signal, the controller 62 sends a control signal to the LED control unit 54 to turn on the first to fourth LEDs 26A to 26D.
  • the lens driver 56 is mounted, for example, on the handle portion 10b of the intraoral camera 10, and controls the actuator 36 of the composition adjustment mechanism and the actuator 40 of the focus adjustment mechanism based on control signals from the controller 62 of the central control unit 50.
  • the lens driver 56 is composed of, for example, a circuit.
  • a corresponding signal is sent from the mobile terminal 70 to the central control unit 50 via the wireless communication module 58.
  • the controller 62 of the central control unit 50 sends a control signal to the lens driver 56 to adjust the composition or focus.
  • the controller 62 calculates the control amounts of the actuators 36, 40 required for composition adjustment and focus adjustment based on the dentition image from the image sensor 14, and sends a control signal corresponding to the calculated control amount to the lens driver 56.
  • the wireless communication module 58 is mounted, for example, on the handle portion 10b of the intraoral camera 10, and communicates wirelessly with the mobile terminal 70 based on control signals from the controller 62.
  • the wireless communication module 58 performs wireless communication with the mobile terminal 70 in accordance with existing communication standards such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).
  • Wi-Fi registered trademark
  • Bluetooth registered trademark
  • the power supply control unit 60 is mounted on the handle portion 10b of the intraoral camera 10 and distributes power from the battery 66 to the central control unit 50, LED control unit 54, lens driver 56, and wireless communication module 58.
  • the power supply control unit 60 is composed of, for example, a circuit.
  • the battery 66 is a rechargeable secondary battery, and is wirelessly charged by an external charger 69 connected to a commercial power source via a coil 68 mounted on the intraoral camera 10.
  • the position sensor 90 is a sensor for detecting the posture and position of the intraoral camera 10, and is, for example, a multi-axis (here, three axes: x, y, and z) acceleration sensor.
  • the position sensor 90 may be a six-axis sensor having a three-axis acceleration sensor and a three-axis gyro sensor.
  • the z-axis coincides with the optical axis LA.
  • the y-axis is parallel to the imaging surface and extends in the longitudinal direction of the intraoral camera 10.
  • the x-axis is parallel to the imaging surface and perpendicular to the y-axis.
  • the output of each axis of the position sensor 90 may be transmitted to the mobile terminal 70 via the central control unit 50 and wireless communication module 58.
  • the position sensor 90 may be a piezo-resistive, capacitance, or thermal detection MEMS sensor. Although not specifically shown, it is advisable to provide a correction circuit to correct the balance of sensor sensitivity for each axis, the temperature characteristics of sensitivity, temperature drift, etc.
  • a band-pass filter (low-pass filter) may also be provided to remove dynamic acceleration components and noise. Noise may also be reduced by smoothing the output waveform of the acceleration sensor.
  • Figure 3 is a diagram showing the flow of the intraoral photography operation in the intraoral camera system. Note that the processing shown in Figure 3 is, for example, processing performed in real time, and is performed each time one frame or multiple frames of image data are obtained.
  • the user uses the intraoral camera 10 to capture images of the teeth and gums in their oral cavity, generating image data (S101).
  • the intraoral camera 10 transmits the captured image data to the mobile terminal 70 (S102).
  • the image data may be a video or one or more still images.
  • sensor data may be transmitted for each frame of the video or for each still image.
  • sensor data may be transmitted for each multiple frame.
  • image data may be transmitted in real time, or may be transmitted all at once after a series of photographs (for example, photographs of all teeth in the oral cavity) have been taken.
  • the mobile terminal 70 performs image processing on the received image data (first RGB image) (S103) and displays the image data after image processing (S104).
  • a user can take images of the inside of their own oral cavity with the intraoral camera 10 and check the condition of their oral cavity displayed on the mobile device 70. This allows the user to easily check the health of their own teeth, etc.
  • the mobile terminal 70 may generate a three-dimensional model of multiple teeth in the oral cavity from multiple captured image data. Furthermore, the mobile terminal 70 may display an image based on the generated three-dimensional model.
  • the mobile terminal 70 processes the tooth images, some or all of this processing may be performed by the intraoral camera 10.
  • the mobile terminal 70 is an example of an image processing device.
  • FIG. 4 is a functional block diagram of the mobile terminal 70.
  • the mobile terminal 70 includes an acquisition unit 101, a generation unit 102, a display unit 103, and a storage unit 104.
  • the acquisition unit 101 acquires image data (first RGB image) transmitted from the intraoral camera 10.
  • the acquisition unit 101 may acquire sensor data in addition to image data from the intraoral camera 10.
  • the first RGB image is an image obtained by the intraoral camera 10 photographing the teeth that are undergoing a fluorescent reaction by irradiating the teeth with light including the wavelength range of blue light.
  • the generation unit 102 may generate a third RGB image by performing exposure control processing (second image processing) on the first RGB image, and may generate a second RGB image by performing white balance adjustment processing (first image processing) on the third RGB image.
  • the memory unit 104 stores color data indicating the color of the tooth area being photographed.
  • the color data may be acquired based on a captured image obtained by photographing the tooth. Specifically, the color data may be generated based on a tooth area specified by the user in the captured image.
  • the captured image may be an image obtained by photographing with a camera provided in the mobile terminal 70.
  • the captured image may be an image obtained by photographing with a camera provided in the mobile terminal 70 under natural light or white light, for example.
  • the captured image may be an image obtained by photographing with an intraoral camera 10 that photographs the inside of the oral cavity.
  • the captured image may be an image obtained by photographing with the intraoral camera 10 while irradiating white light from a white LED, for example.
  • the color data may be data indicating the colors of multiple types of teeth included in a shade guide that indicates tooth colors.
  • the acquisition unit 101 may acquire, for example, color data indicating the color of a tooth corresponding to an identifier specified by user input from among multiple types of teeth as the color data of the subject to be photographed. Multiple types of teeth are teeth with mutually different colors.
  • the shade guide is, for example, a color chart that indicates the colors, tones, or hues that a person's teeth can have.
  • the generation unit 102 first extracts, from among the plurality of first RGB pixels (third pixels) that make up the first RGB image, a plurality of pixels whose RGB values satisfy the following equations 1 and 2.
  • min(R,G,B) indicates the minimum pixel value of the three RGB sub-pixels (i.e., the red pixel value, green pixel value, and blue pixel value) of the first RGB pixel.
  • max(R, G, B) indicates the maximum value of the pixel values of the three RGB sub-pixels (i.e., the red pixel value, green pixel value, and blue pixel value) of the first RGB pixel.
  • Thmax indicates the maximum value that a pixel value can take.
  • Thmax is expressed as 1023 in 10-bit notation.
  • Thmax is an example of a first threshold value.
  • Gmax is the maximum value of the multiple green pixel values in the first RGB image. In other words, it is the pixel value of the green pixel with the maximum pixel value among the multiple green pixels of the first RGB pixels that make up the first RGB image.
  • Thb is a threshold value used to extract the second green pixel from the first RGB pixels. If the Thb value is set too high, the image will become too bright, so it is set to a value of 10 or less in 10-bit representation, for example.
  • Equation 1 excludes glossy regions, and equation 2 extracts the tooth region from the first RGB image.
  • the multiple pixels extracted using equations 1 and 2 are the multiple second pixels that make up the tooth region.
  • the multiple second pixels are those of the multiple first RGB pixels (third pixels) that make up the first RGB image, where the pixel value max (R, G, B) of the maximum color component is smaller than the first threshold value (Thmax) and the pixel value min (R, G, B) of the minimum color component is equal to or smaller than the second threshold value (Ths).
  • the generation unit 102 calculates the average value of the green pixels of the multiple second pixels and determines the gain by which to multiply the pixel values of the three RGB sub-pixels based on the calculated average value of the green pixels.
  • the generation unit 102 determines the gain by which to multiply the pixel values of the three RGB sub-pixels, for example, using the following equation 3.
  • the gain is obtained by dividing the target pixel value by the average value of the green pixels.
  • the generation unit 102 generates the third RGB image by multiplying each of the multiple first RGB pixels that make up the first RGB image by the determined gain. More specifically, the generation unit 102 generates the third RGB image by multiplying the pixel values of the three sub-pixels of each of the multiple first RGB pixels by the determined gain.
  • the pixel values of the multiple third RGB pixels that make up the third RGB image are pixel values calculated by multiplying the pixel values of the multiple first RGB pixels that make up the first RGB image by the determined gain. Note that if multiplying the gain causes the pixel value to exceed the maximum value (1023 in the case of 10-bit representation), the generation unit 102 replaces the pixel value with 1023.
  • the average value of the green pixels of the multiple second pixels extracted from the first RGB pixels is calculated using Equation 2, and the gain to be multiplied by the pixel values of the three RGB sub-pixels is determined according to the calculated average value of the green pixels, but this is not limited to this.
  • the average value of the red pixels of the multiple second pixels extracted from the first RGB pixels may be calculated, and the gain to be multiplied by the pixel values of the three RGB sub-pixels may be determined according to the calculated average value of the red pixels.
  • the average value of the blue pixels of the multiple second pixels extracted from the first RGB pixels may be calculated, and the gain to be multiplied by the pixel values of the three RGB sub-pixels may be determined according to the calculated average value of the blue pixels.
  • the exposure control process is a process that generates a third RGB image by determining a gain for multiple second pixel values so that the average value of multiple index values calculated from multiple second pixel values of multiple second pixels (pixels corresponding to the tooth area) included in the RGB image to be processed (here, the first RGB image) becomes a predetermined value, and applying the determined gain to multiple first RGB pixel values of multiple first RGB pixels included in the first RGB image.
  • the index value may be a value calculated from the pixel values of the three RGB sub-pixels that make up one pixel, or it may be the pixel value of any one of the three sub-pixels.
  • the average value of the multiple index values is the average value of the color component having the maximum pixel value among the red, green, and blue components of the first RGB image.
  • the color component having the maximum average value is the color component having the maximum average value among three average values: a first red pixel average value of the multiple red pixel values of the multiple first pixels constituting the first RGB image; a first green pixel average value of the multiple green pixel values of the multiple first pixels; and a first blue pixel average value of the multiple blue pixel values of the multiple first pixels. Note that the color component having the maximum average value does not need to be determined by calculating and comparing the first red pixel average value, the first green pixel average value, and the first blue pixel average value, and may be fixed to the green component.
  • the generation unit 102 calculates the average value of the green pixels of the multiple second pixels when determining the gain, and determines the gain based on the calculated average value of the green pixels.
  • the generation unit 102 may calculate the average value of the luminance values of the multiple second pixels as the average value of the multiple index values, and determine the gain based on the calculated average value of the luminance values.
  • the index value may be the pixel value of any one of the three RGB sub-pixels that make up one pixel, or may be a value calculated from the pixel values of the three sub-pixels.
  • the generation unit 102 calculates the luminance value of the second pixel using the sub-pixel values of the three sub-pixels that the second pixel has. For example, the generation unit 102 calculates the luminance value using the following equation 3.
  • Equation 3 Y is the brightness value, R is the red pixel value, G is the green pixel value, and B is the blue pixel value.
  • multiple luminance values may be obtained by calculating, for each of multiple pixel values, based on the red pixel value, green pixel value, and blue pixel value contained in that pixel value.
  • the generation unit 102 extracts, from among the third RGB pixels that constitute the third RGB image to be processed, a plurality of pixels whose RGB values satisfy Equation 1 and Equation 4 below.
  • Thl is a threshold indicating the lower limit of the tooth area
  • Thu is a threshold indicating the upper limit of the tooth area
  • the tooth region in the third RGB image is extracted using Equation 4.
  • the multiple pixels extracted using Equations 1 and 4 are the multiple second pixels that make up the tooth region.
  • the specific area may also be an area surrounded by a contour that is a boundary where the brightness of the RGB image to be processed changes from pixels darker than a predetermined brightness to pixels brighter than a predetermined brightness.
  • the generation unit 102 then calculates a first red pixel average value Rave, which is the average value of multiple red pixel values in the specific region, a first green pixel average value Gave, which is the average value of multiple green pixel values in the tooth region, and a first blue pixel average value Bave, which is the average value of multiple blue pixel values in the tooth region.
  • the generation unit 102 then adjusts the gain of at least two color components, the red component, the green component, and the blue component, of the RGB image to be processed so that the difference between the acquired color data and the color data based on the first red pixel average value Rave, the first green pixel average value Gave, and the first blue pixel average value Bave falls within a predetermined range.
  • the gains of at least two color components are adjusted so that the ratio between the first red pixel average value Rave, the first green pixel average value Gave, and the first blue pixel average value Bave is approximately the same as the ratio between the red pixels, green pixels, and blue pixels obtained from the color data.
  • Approximately the same as the ratio between the red pixels, green pixels, and blue pixels obtained from the color data means that the value is within a specified range based on that ratio.
  • the specified range may be, for example, a range of ⁇ 5%.
  • the generation unit 102 may emphasize the plaque region within the tooth region in the second RGB image by performing the following third image processing on the second RGB image. Specifically, the generation unit 102 generates the HSV image by converting the color space of the second RGB image into HSV space.
  • the generation unit 102 identifies, as the plaque region, a specific pixel region in which one or more fourth pixels of the multiple fourth pixels in the HSV image are located, the fourth pixels having at least one of a saturation within a first predetermined range (e.g., 30 to 80 in 8-bit representation), a hue within a second predetermined range (e.g., 140 to 170 in 8-bit representation), and a lightness within a third predetermined range (e.g., 100 to 180 in 8-bit representation).
  • the first, second, and third predetermined ranges are not limited to the above numerical ranges, and may be determined by comparing the actual plaque and tooth regions with the HSV image.
  • the generation unit may generate an HSL image by converting the color space of the second RGB image into an HSL space.
  • luminance is used instead of lightness, and the luminance condition falls within a third predetermined range.
  • the display unit 103 is a display device included in the mobile terminal 70, and displays the image after image processing by the generation unit 102.
  • the display unit 103 may display the second RGB image or the fourth RGB image.
  • FIG. 5 is a diagram showing a state in which a user is vertically holding the intraoral camera 10 and photographing the upper front teeth from the cheek side (lip side).
  • Fig. 6A is a diagram showing an example of a first RGB image of the front teeth photographed in the state shown in Fig. 5 by illuminating the intraoral cavity with blue light (peak wavelength: 405 nm).
  • FIG. 6B shows an example of color difference data for the plaque region 201 and tooth region detected in FIG. 6A.
  • FIG. 6B shows color difference data for the plaque region 201 and tooth region detected from a first RGB image captured without the blue light cut filter 20 shown in FIG. 1B.
  • the average color difference coordinates for the hue of the plaque region were (0.16, 0.06), and the average color difference coordinates for the hue of the tooth region were (0.25, -0.02). Note that these average color difference coordinates for these hues are for reference only and may vary depending on the intensity of blue light and the sensitivity of the camera.
  • Figure 6C shows an example of color difference data for the plaque region 201 and tooth region detected from a first RGB image of a front tooth captured with light including the blue light wavelength range cut out using the blue light cut filter 20.
  • the average color difference coordinates of the hue of the plaque region are (0.058, 0.068), and the average color difference coordinates of the hue of the tooth region are (0.050, -0.004). Note that these average color difference coordinates of the hues are for reference only and may vary depending on the intensity of blue light and the sensitivity of the camera.
  • cutting light that includes the blue wavelength range using a blue light cut filter reduces the saturation of the blue color (makes the color lighter). Because the plaque area fluoresces a reddish pink color, it is possible to reduce the brightness of the tooth area while maintaining the brightness of the plaque area. This reduces the blue pixel value and narrows the difference between the red and green pixel values, thereby reducing the white balance gain multiplied by the red and green pixel values and achieving the effect of suppressing noise.
  • some of the first to fourth LEDs 26A to 26D in Figure 1 can be white LEDs.
  • Figure 6D shows an example of color difference data for the plaque region 201 and tooth region detected from a first RGB image of a front tooth captured by illuminating the oral cavity with blue light (peak wavelength 405 nm) and white light.
  • Figure 6D shows color difference data for the plaque region 201 and tooth region detected from a first RGB image captured without the blue light cut filter 20 shown in Figure 1B.
  • the average color difference coordinates for the hue of the plaque region were (0.089, 0.041), and the average color difference coordinates for the hue of the tooth region were (0.15, -0.013). Note that these average color difference coordinates for these hues are for reference only and may vary depending on the intensity of the blue light and white light and the sensitivity of the camera.
  • the mobile terminal 70 performs image processing (exposure control processing and white balance adjustment processing) to generate a second RGB image 210 in which the plaque region 211 is easily distinguishable, as shown in Fig. 7A.
  • the image processing essentially decolorizes the tooth region, making the plaque region 211 easier to distinguish.
  • Figure 7B shows an example of color difference data for the plaque region and tooth region after exposure control processing and white balance adjustment processing when light including the blue light wavelength range is irradiated onto the tooth without a blue light cut filter.
  • the tooth region is considered to be substantially white.
  • the color difference average coordinates of the hue of the plaque region in Figure 7B were (0.033, 0.071). Note that these color difference average coordinates of the hue are for reference only and may change depending on the intensity of the blue light and the sensitivity of the camera.
  • Figure 7C shows an example of color difference data for the plaque region and tooth region after exposure control processing and white balance adjustment processing when a tooth is irradiated with light including the wavelength range of blue light using a blue light cut filter.
  • the tooth region is considered to be substantially white.
  • the average color difference coordinates of the hue of the plaque region in Figure 7C were (0.033, 0.071). Note that these average color difference coordinates of the hue are for reference only and may change depending on the intensity of blue light and the sensitivity of the camera.
  • Figure 7D shows an example of color difference data for the plaque region and tooth region after exposure control processing and white balance adjustment processing when light including the blue light wavelength range and white light are irradiated onto the tooth without a blue light cut filter.
  • the tooth region is considered to be substantially white.
  • the color difference average coordinates of the hue of the plaque region in Figure 7D were (0.014, 0.048). Note that these color difference average coordinates of the hues are for reference only and may change depending on the intensity of the blue light and white light and the sensitivity of the camera.
  • the hue of the plaque area can be displayed in roughly the same reddish pink color regardless of the type of light source used to illuminate the oral cavity.
  • FIG. 8 is a diagram showing an example of a fourth RGB image of the front teeth captured in the state shown in Fig. 5.
  • Fig. 9 is a diagram showing another example of the fourth RGB image of the front teeth captured in the state shown in Fig. 5.
  • the mobile terminal 70 acquires a first RGB image 200 from the intraoral camera 10, as shown in Figure 6A.
  • the mobile terminal 70 can generate a fourth RGB image 220 in which the plaque region 221 is easily distinguishable, as shown in FIG. 8, by performing saturation enhancement processing on the plaque region 211 of the second RGB image 210.
  • the mobile terminal 70 can further replace the plaque region 211 of the second RGB image 210 with a predetermined pattern, thereby generating a fourth RGB image 230 in which the plaque region 231 has been replaced with a predetermined pattern, as shown in FIG. 9.
  • FIG. 10 is a flowchart of image processing in the mobile terminal 70.
  • the mobile terminal 70 acquires a first RGB image from the intraoral camera 10 (S111).
  • the mobile terminal 70 acquires color data indicating the color of the tooth area being photographed (S112).
  • the acquired color data indicates the color of the tooth area being photographed when no plaque is present.
  • the color data is data based on the color previously acquired for the tooth being photographed.
  • the mobile terminal 70 generates a third RGB image by performing exposure control processing on the first RGB image (S113).
  • the mobile terminal 70 generates a second RGB image by performing white balance adjustment processing on the third RGB image (S114).
  • the mobile terminal 70 identifies the plaque area in the second RGB image (S115).
  • the mobile terminal 70 generates a fourth RGB image by performing saturation enhancement processing on the plaque region of the second RGB image or by replacing the plaque region with a predetermined pattern (S116).
  • the image processing device (e.g., mobile terminal 70) according to this embodiment includes acquisition unit 101, generation unit 102, and storage unit 104.
  • Acquisition unit 101 acquires a first RGB image obtained by photographing teeth and dental plaque that are undergoing a fluorescent reaction by irradiating the teeth with light including a wavelength range of blue light.
  • Storage unit 104 stores color data indicating the color of the tooth region being photographed.
  • Generation unit 102 generates a second RGB image by performing image processing, including first image processing, on the first RGB image.
  • the first image processing is a process of adjusting the gain of at least two of the red, green, and blue color components so that the difference between the acquired color data and color data based on a first red pixel average value of multiple red pixel values held by multiple first pixels in a specific region, which is a tooth region within the RGB image to be processed that is a tooth region free of plaque, a first green pixel average value of multiple green pixel values held by multiple first pixels, and a first blue pixel average value of multiple blue pixel values held by multiple first pixels, falls within a predetermined range.
  • areas of the teeth that are likely to be free of plaque can be identified as specific areas.
  • the generation unit 102 further generates an HSV image by converting the color space of the second RGB image into HSV space, identifies specific pixel regions in which one or more fourth pixels of the multiple fourth pixels in the HSV image are located, the fourth pixels having at least one of a first predetermined range for saturation, a second predetermined range for hue, and a third predetermined range for brightness, and generates a third RGB image by performing enhancement processing on the specific pixel regions in the second RGB image.
  • color data is acquired based on captured images obtained by photographing teeth. Therefore, tooth color data can be easily acquired by photographing an image of the teeth.
  • the captured image is an image obtained by capturing an image with a camera provided in the mobile terminal 70. Therefore, tooth color data can be easily obtained by capturing an image of the teeth with the camera provided in the mobile terminal 70.
  • the captured image is an image obtained by capturing an image using an intraoral camera 10 that captures images of the oral cavity. Therefore, tooth color data can be easily obtained by capturing an image of the teeth using the intraoral camera 10.
  • the color data indicates the tooth color corresponding to an identifier specified by the user from a shade guide that indicates tooth color. Therefore, tooth color data can be obtained without capturing an image based on the shade guide.
  • an HSV image is generated by converting the color space of the second RGB image into an HSV space, a specific pixel area is identified in which one or more fourth pixels of the multiple fourth pixels in the HSV image are located, the fourth pixels having at least one of a first predetermined range for saturation, a second predetermined range for hue, and a third predetermined range for brightness, and a fourth RGB image is generated by replacing the specific pixel area in the second RGB image with a predetermined pattern.
  • the image processing further includes second image processing.
  • the second image processing is processing that determines a gain so that the average value of multiple luminance values calculated from multiple second pixel values possessed by multiple second pixels included in the RGB image to be processed becomes a predetermined value, and generates a third RGB image by applying the determined gain to the RGB image to be processed.
  • the first image processing is processing of the third RGB image.
  • exposure control processing is performed by adjusting the gain of the luminance values of multiple second pixels, so the conditions for multiple luminance values can be kept constant even if the shooting conditions vary.
  • the conditions for the luminance distribution of the third RGB image to be processed in the first image processing can be kept constant regardless of the shooting conditions, allowing the first image processing to be performed more effectively.
  • the average value of multiple brightness values is the average value of the color component having the maximum average value among the red, green, and blue components of the first RGB image.
  • multiple luminance values are obtained by calculating, for each of multiple pixel values, based on the red pixel value, green pixel value, and blue pixel value contained in that pixel value.
  • the multiple second pixels are pixels among the multiple third pixels constituting the first RGB image, where the pixel value of the maximum color component is smaller than the first threshold value and the pixel value of the minimum color component is equal to or smaller than the second threshold value.
  • the second image processing can be performed by excluding areas in the first RGB image that are strongly affected by reflection from the irradiated light.
  • the intraoral position may be displayed on the display unit 103 of the mobile terminal 70.
  • the guidance may be output as audio from a speaker (not shown) of the mobile terminal 70. This allows the user to move the intraoral camera 10 to the specified intraoral position in accordance with the guidance so that photographing is performed at the specified intraoral position.
  • the intraoral position may be the position of a front tooth, a back tooth, or the like.
  • the mobile terminal 70 may then store, in association with the intraoral position indicated by the guidance, a second RGB image or a fourth RGB image generated by image processing performed on the first RGB image acquired while the intraoral position was being indicated.
  • the intraoral camera 10 transmits the first RGB image to the mobile terminal 70, and image processing is performed on the first RGB image in the mobile terminal 70.
  • the first RGB image may be transmitted to the cloud server 80, the cloud server 80 may perform the image processing, and the second RGB image or the fourth RGB image resulting from the image processing may be transmitted to the mobile terminal 70.
  • the first RGB image may be transmitted from the intraoral camera 10 to the cloud server 80 without passing through the mobile terminal 70, or may be transmitted from the intraoral camera 10 to the cloud server 80 via the mobile terminal 70.
  • the white balance adjustment process extracts a tooth region from the RGB image to be processed, and adjusts the gains of at least two color components among the red, green, and blue components of the RGB image to be processed so that the first average red pixel value, the first average green pixel value, and the first average blue pixel value in the tooth region are equal.
  • the pixel average values of each color targeted for gain adjustment are not limited to the average values in the tooth region, and may be the average values in the natural tooth region.
  • Figure 11 is a flowchart showing the details of the process for detecting natural tooth regions.
  • FIG. 12 is a diagram showing an example of an RGB image (first RGB image).
  • the RGB image shown in FIG. 12 is an image of a natural tooth 241, an artificial tooth 242, and gums 243 (gums).
  • the artificial tooth 242 is, for example, a prosthesis made of a metal such as gold or silver.
  • the natural tooth 241 is a natural tooth, and is the part of the tooth excluding the artificial tooth 242.
  • the generation unit 102 detects a first natural tooth region using the RGB image (first RGB image) (S201). Specifically, the generation unit 102 detects, as the first natural tooth region, a region in the RGB image that satisfies both a first condition that the green pixel value (G) is equal to or greater than a predetermined first threshold, and a second condition that the differences between the green pixel value (G), red pixel value (R), and blue pixel value (B) are less than a predetermined third threshold.
  • excitation light blue light
  • excitation fluorescence is emitted from the dentin. This excitation fluorescence passes through the enamel, causing the natural tooth to fluoresce green.
  • fillings from caries treatments appear dark (low brightness) in images captured by a camera, unlike when white light is irradiated.
  • natural teeth covered with enamel appear bright (high brightness) in images. Therefore, by extracting this green fluorescence according to the first condition, it is possible to identify areas of natural teeth and exclude areas of artificial teeth.
  • the second condition is that (1) the absolute value (abs(R-G)) of the difference between the red pixel value (R) and the green pixel value (G) is less than the threshold value rg_th, (2) the absolute value (abs(G-B)) of the difference between the green pixel value (G) and the blue pixel value (B) is less than the threshold value gb_th, and (3) the absolute value (abs(B-R)) of the difference between the blue pixel value (B) and the red pixel value (R) is less than the threshold value gb_th.
  • the threshold values rg_th, gb_th, and br_th may be the same or different values.
  • a luminance value (Y) may be used instead of the green pixel value (G).
  • the luminance value (Y) is calculated using the above-mentioned formula 3. For example, an area where the luminance value is equal to or greater than a predetermined first threshold value may be detected as an area of a natural tooth.
  • the ratio of green pixel values to luminance values is high, so detection can be performed using luminance values in the same way as when green pixel values are used.
  • first and second conditions are used has been shown here, only one of the first and second conditions may be used.
  • first condition may be used.
  • FIG. 13 is a diagram showing an example of a detected first natural tooth region 251. Note that for the sake of explanation, FIG. 13 illustrates the shape of the teeth, etc. in addition to the first natural tooth region 251, but the detected information does not necessarily include the shape of the teeth, etc. This also applies to FIGS. 14 and 15.
  • the area including the area of the natural tooth 241 and the area of the gums 243 is detected as the first natural tooth area 251.
  • the first natural tooth area 251 does not include the area of the artificial tooth 242.
  • the first natural tooth region 251 includes the entire area of the gums 243, depending on the imaging conditions, there may be cases in which only a portion of the area of the gums 243 is included in the first natural tooth region 251, or in which the area of the gums 243 is not included in the first natural tooth region 251.
  • FIG. 14 is a diagram showing an example of a detected gum region 252. As shown in FIG. 14, the gum region 243 is detected as the gum region 252. Note that while an example of detecting the gum region is shown here, in addition to the gums, lips, etc. may also be detected as the gum region 252.
  • the generation unit 102 determines the area obtained by excluding the gum area 252 from the first natural tooth area 251 as the second natural tooth area 253 (S204).
  • Figure 15 is a diagram showing an example of the second natural tooth area 253. As shown in Figure 15, the second natural tooth area 253 includes the area of the natural tooth 241, but does not include the areas of the artificial tooth 242 and gum 243.
  • the generation unit 102 determines the third natural tooth region by excluding small regions from the second natural tooth region 253 (S205).
  • a small region is, for example, a region whose area is smaller than a predetermined value. This prevents high-brightness regions caused by reflected light, etc., outside the natural tooth region (for example, the gum region) from being mistakenly determined to be a natural tooth region.
  • the generating unit 102 determines the fourth natural tooth region by expanding the third natural tooth region (S206). Specifically, the generating unit 102 determines the fourth natural tooth region as an area obtained by expanding the boundary of the third natural tooth region outward by a predetermined amount. This makes it possible to add the boundary between the teeth and gums, etc. to the natural tooth region, and prevents the plaque region from being displayed excessively.
  • the generation unit 102 ultimately detects the fourth natural tooth area as the natural tooth area to be used in the white balance adjustment process.
  • multiple second pixels that make up the natural tooth region may be set as multiple first pixels within the specific region.
  • the image data obtained by the intraoral camera 10 is an RGB image, but it may be a CMYG image obtained using a CMYG complementary color filter of four colors: cyan, magenta, yellow, and green.
  • the CMYG image may be converted into an RGB image by calculation using an approximation formula, and the mobile terminal 70 may perform image processing on the converted RGB image.
  • the conversion from the CMYG image to the RGB image may be performed by the intraoral camera 10, the mobile terminal 70, or another information processing device.
  • Mg represents magenta
  • Ye represents yellow
  • Cy represents cyan.
  • the intraoral camera 10 may also be an oral care device equipped with a camera.
  • the intraoral camera 10 may also be an oral irrigator equipped with a camera.
  • each processing unit included in the intraoral camera system according to the above embodiment is typically realized as an LSI, which is an integrated circuit. These may be individually implemented as single chips, or some or all of them may be integrated into a single chip.
  • integrated circuits are not limited to LSIs, but may be realized using dedicated circuits or general-purpose processors.
  • FPGAs Field Programmable Gate Arrays
  • reconfigurable processors which allow the connections and settings of circuit cells within the LSI to be reconfigured, may also be used.
  • each component may be configured with dedicated hardware, or may be realized by executing a software program appropriate for that component.
  • Each component may also be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.
  • the present disclosure may also be realized as an image display method executed by an intraoral camera system.
  • the present disclosure may also be realized as an intraoral camera, a mobile terminal, or a cloud server included in an intraoral camera system.
  • the division of functional blocks in the block diagram is one example; multiple functional blocks may be realized as a single functional block, one functional block may be divided into multiple blocks, or some functions may be moved to other functional blocks. Furthermore, the functions of multiple functional blocks with similar functions may be processed in parallel or time-shared by a single piece of hardware or software.
  • This disclosure can be applied to intraoral camera systems.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Biophysics (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biomedical Technology (AREA)
  • Medical Informatics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Pathology (AREA)
  • Optics & Photonics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Epidemiology (AREA)
  • Dental Tools And Instruments Or Auxiliary Dental Instruments (AREA)
  • Endoscopes (AREA)
PCT/JP2025/006176 2024-02-26 2025-02-21 画像処理方法、画像処理装置、及び、プログラム Pending WO2025182844A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2026504261A JPWO2025182844A1 (cg-RX-API-DMAC7.html) 2024-02-26 2025-02-21

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2024026277 2024-02-26
JP2024-026277 2024-02-26

Publications (1)

Publication Number Publication Date
WO2025182844A1 true WO2025182844A1 (ja) 2025-09-04

Family

ID=96920618

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2025/006176 Pending WO2025182844A1 (ja) 2024-02-26 2025-02-21 画像処理方法、画像処理装置、及び、プログラム

Country Status (2)

Country Link
JP (1) JPWO2025182844A1 (cg-RX-API-DMAC7.html)
WO (1) WO2025182844A1 (cg-RX-API-DMAC7.html)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005341175A (ja) * 2004-05-26 2005-12-08 Olympus Corp 撮影システム
WO2007010749A1 (ja) * 2005-07-19 2007-01-25 Konica Minolta Holdings, Inc. 画像処理装置、画像処理システム及び画像処理プログラム
JP2008244794A (ja) * 2007-03-27 2008-10-09 Olympus Corp 画像処理装置、及び、画像処理方法
JP2010005327A (ja) * 2008-06-30 2010-01-14 Olympus Corp 歯科用画像処理装置、システム、方法、及びプログラム
JP2014239277A (ja) * 2013-06-06 2014-12-18 株式会社リコー プロファイル検索システム、画像処理システム、検索方法およびプログラム
JP2017018152A (ja) * 2015-07-07 2017-01-26 Juki株式会社 測色装置、測色方法及びプログラム
JP2019141582A (ja) 2018-02-16 2019-08-29 スカラ株式会社 口腔カメラシステム、口腔カメラ
WO2023163051A1 (ja) * 2022-02-22 2023-08-31 パナソニックIpマネジメント株式会社 口腔洗浄装置、制御装置、口腔洗浄方法、及び、プログラム
WO2024106391A1 (ja) * 2022-11-17 2024-05-23 パナソニックIpマネジメント株式会社 画像処理方法、画像処理装置、及び、プログラム

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005341175A (ja) * 2004-05-26 2005-12-08 Olympus Corp 撮影システム
WO2007010749A1 (ja) * 2005-07-19 2007-01-25 Konica Minolta Holdings, Inc. 画像処理装置、画像処理システム及び画像処理プログラム
JP2008244794A (ja) * 2007-03-27 2008-10-09 Olympus Corp 画像処理装置、及び、画像処理方法
JP2010005327A (ja) * 2008-06-30 2010-01-14 Olympus Corp 歯科用画像処理装置、システム、方法、及びプログラム
JP2014239277A (ja) * 2013-06-06 2014-12-18 株式会社リコー プロファイル検索システム、画像処理システム、検索方法およびプログラム
JP2017018152A (ja) * 2015-07-07 2017-01-26 Juki株式会社 測色装置、測色方法及びプログラム
JP2019141582A (ja) 2018-02-16 2019-08-29 スカラ株式会社 口腔カメラシステム、口腔カメラ
WO2023163051A1 (ja) * 2022-02-22 2023-08-31 パナソニックIpマネジメント株式会社 口腔洗浄装置、制御装置、口腔洗浄方法、及び、プログラム
WO2024106391A1 (ja) * 2022-11-17 2024-05-23 パナソニックIpマネジメント株式会社 画像処理方法、画像処理装置、及び、プログラム

Also Published As

Publication number Publication date
JPWO2025182844A1 (cg-RX-API-DMAC7.html) 2025-09-04

Similar Documents

Publication Publication Date Title
EP4620433A1 (en) Image processing method, image processing device, and program
EP2992805B1 (en) Electronic endoscope system
JP5968944B2 (ja) 内視鏡システム、プロセッサ装置、光源装置、内視鏡システムの作動方法、プロセッサ装置の作動方法、光源装置の作動方法
CN101331519B (zh) 图像组合装置
JP6817154B2 (ja) プロセッサ装置及びその作動方法
CN112584747B (zh) 内窥镜系统
JP7015382B2 (ja) 内視鏡システム
JP7784630B2 (ja) 歯垢検出装置、歯垢検出方法及びプログラム
WO2021065939A1 (ja) 内視鏡システム及びその作動方法
US20070140553A1 (en) Dental colorimetry apparatus
JP2007047045A (ja) 画像処理装置及び方法並びにプログラム
JP6319980B2 (ja) 歯牙測色方法、歯牙測色装置、及び歯牙測色プログラム
CN106687023A (zh) 评价值计算装置以及电子内窥镜系统
WO2023163051A1 (ja) 口腔洗浄装置、制御装置、口腔洗浄方法、及び、プログラム
JP3989521B2 (ja) 画像合成装置およびその方法並びにプログラム
WO2022113995A1 (ja) 歯列画像撮影システムおよび歯列画像撮影方法
JP2009195495A (ja) 歯科用測色装置
JP3989522B2 (ja) 歯科用測色装置、システム、方法、およびプログラム
WO2025079525A1 (ja) 画像処理方法、画像処理装置及びプログラム
JP7675374B2 (ja) 口腔内カメラ、照明制御装置及び照明制御方法
JP4831962B2 (ja) 撮影装置
WO2025173550A1 (ja) 情報処理装置、情報処理方法及びプログラム
WO2025173551A1 (ja) 情報処理装置、情報処理方法及びプログラム
JP2009053160A (ja) 歯科用測色装置
WO2025115505A1 (ja) 歯列画像生成装置、歯列画像生成方法及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 25761191

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2026504261

Country of ref document: JP

Kind code of ref document: A