WO2021256134A1 - 画像処理装置と画像処理方法とプログラムおよび画像投写方法 - Google Patents

画像処理装置と画像処理方法とプログラムおよび画像投写方法 Download PDF

Info

Publication number
WO2021256134A1
WO2021256134A1 PCT/JP2021/018201 JP2021018201W WO2021256134A1 WO 2021256134 A1 WO2021256134 A1 WO 2021256134A1 JP 2021018201 W JP2021018201 W JP 2021018201W WO 2021256134 A1 WO2021256134 A1 WO 2021256134A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
color
projected
color information
projection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/018201
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
隆太郎 峯
都夢 田原
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Group Corp
Original Assignee
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Group Corp filed Critical Sony Group Corp
Priority to US18/000,573 priority Critical patent/US20230215130A1/en
Priority to JP2022532391A priority patent/JP7616219B2/ja
Publication of WO2021256134A1 publication Critical patent/WO2021256134A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G03B21/14—Details
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/56—Extraction of image or video features relating to colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/761—Proximity, similarity or dissimilarity measures
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/02—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H04N1/56—Processing of colour picture signals
    • H04N1/60—Colour correction or control
    • H04N1/603—Colour correction or control controlled by characteristics of the picture signal generator or the picture reproducer
    • H04N1/6052—Matching two or more picture signal generators or two or more picture reproducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/74—Projection arrangements for image reproduction, e.g. using eidophor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141—Constructional details thereof
    • H04N9/3147—Multi-projection systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3182—Colour adjustment, e.g. white balance, shading or gamut
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3185—Geometric adjustment, e.g. keystone or convergence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3191—Testing thereof
    • H04N9/3194—Testing thereof including sensor feedback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/64—Circuits for processing colour signals
    • H04N9/68—Circuits for processing colour signals for controlling the amplitude of colour signals, e.g. automatic chroma control circuits
    • H04N9/69—Circuits for processing colour signals for controlling the amplitude of colour signals, e.g. automatic chroma control circuits for modifying the colour signals by gamma correction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H04N1/56—Processing of colour picture signals
    • H04N1/60—Colour correction or control
    • H04N1/603—Colour correction or control controlled by characteristics of the picture signal generator or the picture reproducer
    • H04N1/6052—Matching two or more picture signal generators or two or more picture reproducers
    • H04N1/6055—Matching two or more picture signal generators or two or more picture reproducers using test pattern analysis

Definitions

  • This technology makes it possible to separate a projected image from an image of a mixed image composed of a plurality of projected images with respect to an image processing device, an image processing method, a program, and an image projection method.
  • one mixed image is displayed by combining the projection images of a plurality of projection devices.
  • the projection image is imaged by using an image pickup device to acquire the positional relationship of each projection image, and the inconsistency of the images in the superimposed region of the projection images is solved.
  • Patent Document 1 when structured light is simultaneously projected, the structured light is mixed with each other, and it is not possible to distinguish which projection device the pixel information of the captured projected image corresponds to, so that different color information is given. By doing so, it is possible to distinguish between a plurality of projected images. Further, in Patent Document 2, a plurality of projected images are distinguished by using a region that does not overlap spatially.
  • the color to be projected is taken due to the color of the screen or ambient light, the spectral characteristics peculiar to the device of the projection device and the image pickup device, and the like. If the colors do not match, a projection image different from the desired projection image may appear in the separation result, which may cause a decrease in sensing accuracy or a failure in sensing.
  • an object of this technique to provide an image processing device, an image processing method, a program, and an image projection method capable of separating a projected image from an image of a mixed image composed of a plurality of projected images.
  • the first aspect of this technology is The relationship between the color information of the captured image obtained by capturing the mixed image of the projected images projected by giving different color information from a plurality of projection devices, the color information of the captured image, and the color information of the projected image and the background is shown. It is in an image processing apparatus including a color separation processing unit that generates a separation image for each color information based on a color model.
  • the color separation processing unit uses the color information of an image captured by capturing, for example, a mixed image of structured light projected by applying different color information from a plurality of projection devices, and the color information of the image. Based on the color model showing the relationship between the projected image and the color information of the background, a separated image is generated for each color information.
  • the color information of the projected image that changes according to the spectral characteristics of the projection device and the image pickup device that acquires the image image, and the attenuation coefficient that indicates the attenuation that occurs in the mixed image captured by the image pickup device are used as parameters.
  • the color separation processing unit generates a separated image for each color information based on the color model by using a parameter that minimizes the difference between the color information of the captured image and the color information estimated by the color model.
  • the image pickup device that captures the mixed image is a non-fixed viewpoint, and the color separation processing unit generates a separated image using the image pickup image after the degamma processing when the gamma correction is performed by the image pickup device. Further, the color information different from each other is set so that the inner product of the color vectors corresponding to the color information is minimized. Further, the projected image and the captured image are images that are not saturated.
  • an image correction unit for correcting the projected image projected from the projection device is provided, and the color of the projected image is calibrated using the color information given to the separated image.
  • the image correction unit includes a corresponding point detection unit that detects the corresponding points between the separated images for each color information generated by the color separation processing unit, and the image correction unit has a corresponding point for each separated image detected by the corresponding point detection unit. The projected image is corrected using the geometric correction information.
  • a predetermined number of projection devices are grouped, and at least one projection device in the group is included in another group, and different color information is given to the projection images in the group.
  • the color separation processing unit generates a separated image for each group, the corresponding point detection unit detects the corresponding point for each group, and the image correction unit detects the corresponding point for each group.
  • the projected image is corrected using the geometric correction information that matches the corresponding points of each detected separated image.
  • the second aspect of this technology is Based on a color model composed of the color information of the projected image and the color information of the background color from the captured image obtained by capturing the mixed image of the projected images projected by giving different color information from a plurality of projection devices. It is an image processing method including generating a separated image for each color information by a color separation processing unit.
  • the third aspect of this technology is It is a program that allows a computer to execute the process of separating each projected image from the captured image of the mixed image of the projected image.
  • a procedure for acquiring an image obtained by capturing a mixed image of the projected images projected by giving different color information from a plurality of projection devices and
  • the computer executes a procedure for generating a separated image for each color information from the captured image based on a color model composed of the color information of the projected image and the color information of the background color.
  • the program of the present technology is, for example, a storage medium, a communication medium, for example, a storage medium such as an optical disk, a magnetic disk, a semiconductor memory, etc., which is provided in a computer-readable format to a general-purpose computer capable of executing various program codes. It is a program that can be provided by a medium or a communication medium such as a network. By providing such a program in a computer-readable format, processing according to the program can be realized on the computer.
  • the fourth aspect of this technology is Based on a color model composed of the color information of the projected image and the color information of the background color from the captured image obtained by capturing the mixed image of the projected images projected by giving different color information from a plurality of projection devices.
  • Generating a separated image for each color information in the color separation processing unit The corresponding point detection unit detects the corresponding points between the separated images for each of the color information generated by the color separation processing unit.
  • An image projection method including correcting a projected image image projected from the plurality of projection devices by the image correction unit using geometric correction information for matching the corresponding points for each of the separated images detected by the corresponding point detection unit. be.
  • FIG. 1 illustrates the configuration of an image projection system using the image processing device of the present technology. Note that FIG. 1 illustrates a case where two projection devices are used.
  • the image projection system 10 is acquired by the projection devices 20-1 and 20-2 that project an image on the screen Sc, the image pickup device 30 that captures the screen Sc from a non-fixed viewpoint (non-fixed viewpoint), and the image pickup device 30. It has an image processing device 40 that separates a projected image from the captured image, and an image generation device 50 that outputs an image signal indicating an image projected on the screen Sc to the projection devices 20-1 and 20-2.
  • the image pickup device 30, the image processing device 40, and the image generation device 50 may be provided independently, or each device may be integrated or only a part of the devices (for example, the image processing device 40 and the image generation device 50) may be provided. It may be provided integrally. Further, the image generation device 50 or the image processing device 40 and the image generation device 50 may be provided integrally with any of 20-1 and 20-2 in the projection device.
  • FIG. 2 illustrates the configuration of the embodiment, and the image processing apparatus 40 includes a color separation processing unit 41, a corresponding point detection unit 42, and a position calculation unit 43.
  • a projection image for example, a sensing pattern (structured light) is projected on the screen Sc by projection devices 20-1 and 20-2, and the sensing pattern has a different color in each projection device.
  • Information is given.
  • the image pickup apparatus 30 captures the screen Sc on which the sensing pattern is projected from a non-fixed viewpoint, and the first sensing pattern projected by the projection apparatus 20-1 and the second sensing pattern projected by the projection apparatus 20-2. An image showing a mixed image of the above is acquired.
  • the color separation processing unit 41 adds colors to the sensing pattern based on a color model showing the relationship between the color information of the image captured image acquired by the image pickup device 30, the color information of the image image, and the color information of the projected image and the background. Generate a separated image for each information. The details of the generation of the separated image for each color information will be described later.
  • the color separation processing unit 41 outputs the generated separated image to the corresponding point detection unit 42.
  • the corresponding point detection unit 42 detects the corresponding points between the separated images for each color information, and outputs the corresponding point information indicating the detection result to the position calculation unit 43.
  • the position calculation unit 43 calculates a position correction amount for matching the display positions of the corresponding points detected by the corresponding point detection unit 42. For example, the position calculation unit 43 uses the separated image of the color information given to the first sensing pattern as a reference, and separates the color information given to the second sensing pattern with respect to the corresponding point of the separated image as the reference. Calculate the position correction amount to match the display positions of the corresponding points in the image. The position calculation unit 43 outputs the calculated position correction amount to the image generation device 50.
  • the image generation device 50 has an image generation unit 51 and an image correction unit 52.
  • the image generation unit 51 generates an image signal of the projected image. For example, when the image projection system is calibrated, the image generation unit 51 generates a first sensing pattern as a projection image projected from the projection device 20-1 and a second sensing pattern as a projection image projected from the projection device 20-2. Further, the image generation unit 51 imparts color information to the first sensing pattern, and imparts color information different from the first sensing pattern to the second sensing pattern. After calibrating the image projection system, the image generation unit 51 receives an image according to the user's request as a projection image projected from the projection device 20-1 and a projection image projected from the projection device 20-2 from the user or the like. Generate an image on demand. The image generation unit 51 outputs an image signal indicating the generated image to the image correction unit 52.
  • the image correction unit 52 outputs the image signal of the first sensing pattern projected from the projection device 20-1 to the projection device 20-1 and projects the image signal from the projection device 20-2. 2
  • the image signal of the sensing pattern is output to the projection device 20-2.
  • the image correction unit 52 uses the position correction amount calculated by the position calculation unit 43 of the image processing device 40 as the geometric correction information, and uses the geometric correction information during and after the calibration process of the image projection system to display the projected image. Geometric correction is performed to match the projected image projected from the projection device 20-1 with the projected image projected from the projection device 20-2.
  • the image correction unit 52 for example, when the position correction amount calculated by the position calculation unit 43 of the image processing device 40 is based on the first sensing pattern, the geometric correction information for the projected image projected from the projection device 20-2. Perform geometric correction based on.
  • the image correction unit 52 projects a first sensing pattern projected from the projection device 20-1 during the calibration process, and an image signal of an image projected from the projection device 20-1 after calibration according to a request from a user or the like. Output to -1.
  • the image correction unit 52 corrects the geometry of the first sensing pattern projected from the projection device 20-2 during the calibration process, and the geometry of the image projected from the projection device 20-2 after the calibration in response to a request from the user or the like. The correction is performed, and the image signal after the geometric correction is output to the projection device 20-2.
  • the image correction unit 52 may be provided in the projection device instead of the image generation device 50.
  • the image correction unit 52 may be provided in the projection device 20-2.
  • FIG. 3 is a flowchart illustrating the operation of the embodiment.
  • the image projection system projects the sensing pattern.
  • the projection devices 20-1 and 20-2 of the image projection system 10 project the first sensing pattern and the second sensing pattern to which different color information is given on the screen Sc, and step ST2. Proceed to.
  • step ST2 the image projection system acquires an image.
  • the image pickup device 30 of the image projection system 10 does not capture a mixed image of the first sensing pattern projected from the projection device 20-1 and the second sensing pattern projected from the projection device 20-2 on the screen Sc. This is performed from a fixed viewpoint, an image showing a mixed image is acquired, and the process proceeds to step ST3.
  • step ST3 the image projection system performs color separation processing.
  • the color separation processing unit 41 in the image processing device 40 of the image projection system 10 has a relationship between the color information given to the first and second sensing patterns, the color information of the captured image, and the color information of the projected image and the background. Based on the color model showing the above, a first separated image of the color information given to the first sensing pattern and a first separated image of the color information given to the second sensing pattern are generated, and the process proceeds to step ST4.
  • step ST4 the image projection system performs the corresponding point detection process.
  • the corresponding point detection unit 42 in the image processing apparatus 40 detects corresponding points corresponding to each other in the first separated image and the second separated image generated by performing the color separation processing in step ST3.
  • known techniques described in JP-A-2000-348175, JP-A-2018-011302, and the like may be used.
  • the corresponding point detection unit 42 detects the corresponding point and proceeds to step ST5.
  • step ST5 the image projection system performs the position calculation process of the corresponding point.
  • the position calculation unit 43 in the image processing device 40 calculates the display position of the corresponding point detected in step ST4, and proceeds to step ST6.
  • step ST6 the image projection system generates geometric correction information.
  • the image correction unit 52 in the image generation device 50 calculates the geometric correction information for each corresponding point by calculating the position correction amount that makes the display position of the corresponding point the same position based on the display position of the corresponding point calculated in step ST5. Generate and finish the calibration of the image projection system. After that, when projecting a projected image such as video content in response to a request from a user or the like, the process proceeds to step ST7.
  • the image projection system performs projection processing of the projected image.
  • the image generation device 50 of the image projection system 10 generates an image signal of a projected image in response to a request from a user or the like in the image generation unit 51.
  • the image correction unit 52 performs geometric correction on the projected image generated by the image generation unit 51 based on the geometric correction information, and outputs the image signal of the projected image after the geometric correction to the projection devices 20-1 and 20-2. By outputting to, the projected image from each of the projection devices 20-1 and 20-2 is projected on the screen Sc without causing inconsistency.
  • Separation image generation operation the operation of generating the separated image will be described.
  • the separation image generation operation the color information of the captured image obtained by capturing the mixed image of the projected images projected by giving different color information from a plurality of projection devices, the color information of the captured image, the projected image, and the background color.
  • a separated image for each color information is generated based on a color model showing the relationship with the information.
  • the color model includes color information of a projected image that changes according to the spectral characteristics of the projection device and the image pickup device that acquires the image, a attenuation coefficient that indicates the attenuation that occurs in the mixed image captured by the image pickup device, and a background color.
  • Information is used as a parameter, and the color separation processing unit uses a parameter that minimizes the difference between the color information of the captured image and the color information estimated by the color model, and creates a separated image for each color information based on the color model. Generate.
  • FIG. 4 illustrates the spectral sensitivity of the image pickup apparatus.
  • the image pickup apparatus 30 has sensitivity in the wavelength range of the three primary colors (red R, green G, blue B), and the sensitivities of the respective colors partially overlap, for example, for a red wavelength (610 nm to 750). Has green and blue sensitivity. Therefore, the color of the projected image may change in the captured image.
  • FIG. 5 exemplifies the color change of the captured image with respect to the projected image.
  • FIG. 6 illustrates an image taken by changing depending on the environment.
  • the projected image is the color Cpro
  • the ambient light from the illumination light source is the color Cenv
  • the projection surface of the screen Sc is the color Cback
  • the color Ccam of the projected image observed by the image pickup apparatus 30 is shown by the function of the equation (1). Will be the value.
  • Ccam f (Cpro, Cenv, Cback) ... (1)
  • the projected image in the image captured by the image pickup device 30 may have a different color from the projected image input to the projection device 20 due to the spectral characteristics of the projection device 20 and the image pickup device 30. Further, the projected image observed by the image pickup apparatus 30 is affected not only by the color Cpro of the projected projected image, but also by the color Cenv of the ambient light and the color Cback of the projection surface of the screen Sc. Therefore, the color separation processing unit 41 of the image processing device 40 assigns different color information to the projection devices 20-1 and 20-2 in order to separate the mixed images with high accuracy, and mixes the projected images projected.
  • Color separation processing is performed using a color model showing the relationship between the color information of the captured image obtained by capturing the image, the color information of the captured image, and the color information of the projected image and the background.
  • the color model does not consider the influence of gamma characteristics in projection and imaging. Further, it is assumed that the projection devices 20-1 and 20-2 have the additivity of the projected light.
  • the color separation processing unit 41 separates the mixed image using the color model and generates a separated image.
  • the image showing the sensing pattern is separated from the image taken by capturing the mixed image of the sensing pattern projected by giving different color information from the projection devices 20-1 and 20-2. A case where an image is generated with high accuracy for each sensing pattern will be described.
  • the input color of the projection device 20-1 is the pixel value P1'
  • the attenuation coefficient of the projected image projected by the projection device 20-1 is " ⁇ 1”
  • the input color of the projection device 20-2 is the pixel value P2'.
  • the color model is the color model shown in the equation (4).
  • the pixel value P1'and the pixel value P2' are additive to the projected light, and are related to the equation (5).
  • the formula (4) is a color model for one pixel corresponding to the projected image and the captured image, and the color separation processing unit 41 applies the color model to the entire captured image.
  • the captured image has a horizontal pixel number QH and a vertical pixel number QV.
  • the color information of the pixel position (x, y) in the image is set to the pixel value CPx, y, and the attenuation coefficient of the pixel position (x, y) is set to " ⁇ 1x, y" and " ⁇ 2x, y".
  • the attenuation coefficient vectors indicating the attenuation coefficients of each position on the screen are ⁇ v1 and ⁇ v2.
  • the color separation processing unit 41 uses the pixel values CPx and y to have the minimum evaluation value EV shown in the equation (6) and the parameters (pixel values) "P1', P2', BC that satisfy the condition of the equation (7). '” And the parameter (reduction coefficient)“ ⁇ 1, ⁇ 2 ”are estimated.
  • FIG. 7 shows the sensing pattern and the projection state on the screen.
  • FIG. 7 (a) illustrates the first sensing pattern SP1 projected from the projection device 20-1
  • FIG. 7 (b) shows the second sensing pattern SP2 projected from the projection device 20-2. Is illustrated.
  • the first sensing pattern is, for example, a pattern in which black dots are provided in a red rectangular region
  • the second sensing pattern is, for example, a pattern in which black dots are provided in a blue rectangular region.
  • FIG. 7 (c) illustrates a state in which the first sensing pattern SP1 and the second sensing pattern SP2 are projected on the screen Sc, and corresponds to both the first sensing pattern SP1 and the second sensing pattern SP2.
  • the area that is not used is the background area SB.
  • the pixel positions (x, y) are detected in advance as to which of the background region, the region to which the color of the sensing pattern is given, and the region of the black dots of the sensing pattern. For example, if the first sensing pattern and the second sensing pattern are individually projected, it is clear that the pixel positions (x, y) correspond to any region.
  • the color separation processing unit 41 uses the color information of the corresponding region in the sensing pattern for the pixel values P1'and P2'. Further, when the pixel positions (x, y) are the pixel positions in the background region, the pixel values P1'and P2' are set to "0".
  • the color separation processing unit 41 performs the calculation shown in the equation (8), and generates the pixel value CP1 of the separated image showing the first sensing pattern projected by the projection device 20-1 based on the color model. Further, the color separation processing unit 41 performs the calculation shown in the equation (9) to generate the pixel value CP2 of the separated image showing the second sensing pattern projected by the projection device 20-2 based on the color model.
  • the color separation processing unit 41 divides the estimation of the parameters so that the parameters can be easily estimated, and repeats the process of estimating other parameters using the estimation results, so that the color information and the color of the captured image can be easily estimated. Estimate the optimum value of the parameter that minimizes the difference from the color information estimated by the model. For example, the color separation processing unit 41 divides the process of estimating the parameter indicating the color information and the process of estimating the parameter indicating the attenuation coefficient, and converges by repeating the process using one estimation result as the other. The estimation result is used as the optimum value of the parameter.
  • FIG. 8 is a flowchart illustrating the parameter estimation operation.
  • the color separation processing unit sets the parameters P1', P2', and BC'to the initial values.
  • the color separation processing unit 41 sets the parameters P1', P2', and BC'as initial values when estimating the attenuation coefficient.
  • the color information between the input and output does not change significantly in the spectral characteristics of a general projection device or image pickup device. Therefore, by setting the initial values of the parameters P1'and P2'to the pixel values reflecting the spectral characteristics, it is possible to accelerate the convergence.
  • the parameter P2'detected by projecting and imaging the sensing pattern is used.
  • the initial value of the parameter BC' is set to black, it is possible to accelerate the convergence.
  • the pixel value detected by imaging the screen on which the sensing pattern is not projected from the projection devices 20-1 and 20-2 can be used as the initial value of the parameter BC'. It is possible to accelerate the convergence.
  • the color separation processing unit 41 sets the parameters P1', P2', and BC'to the initial values, and proceeds to step ST12.
  • Step ST12 is the x-direction loop processing start end.
  • the color separation processing unit 41 starts processing for sequentially moving the pixel position for calculating the attenuation coefficient in the x direction of the captured image in pixel units, and proceeds to step ST13.
  • Step ST13 is the y-direction loop processing start end.
  • the color separation processing unit 41 starts processing for sequentially moving the pixel position for calculating the attenuation coefficient in the y direction of the image in pixel units, and proceeds to step ST14.
  • step ST14 the color separation processing unit calculates the attenuation coefficient.
  • the color separation processing unit 41 uses the set parameters P1', P2', BC'and the pixel value CP of the captured image, and based on the equation (3), the attenuation coefficient ⁇ 1x at the pixel position (x, y), Calculate y, ⁇ 2x, y and proceed to step ST15.
  • Step ST15 is the end of the y-direction loop processing.
  • the color separation processing unit 41 proceeds to step ST16 when the attenuation coefficient is calculated for each pixel position in the y direction, and repeats the processes of steps ST13 to ST15 when the calculation of the attenuation coefficient is not completed.
  • the attenuation coefficient is calculated by sequentially moving the pixel positions in the direction.
  • Step ST16 is the end of the x-direction loop processing.
  • the color separation processing unit 41 proceeds to step ST17 when the attenuation coefficient is calculated for each pixel position in the x direction as well as the y direction, and processes from step ST12 to step ST16 when the calculation of the attenuation coefficient is not completed.
  • the pixel positions are sequentially moved not only in the y direction but also in the x direction, and the attenuation coefficient of each pixel position in the image is calculated.
  • step ST17 the color separation processing unit generates a separated image.
  • the color separation processing unit 41 calculates the equations (8) and (9) using the set parameters P1', P2', BC'and the attenuation coefficient vectors ⁇ v1 and ⁇ v2 calculated in the processing of steps ST12 to ST16. Is performed, a separated image showing the first sensing pattern projected from the projection device 20-1 and a separated image showing the second sensing pattern projected from the projection device 20-2 are generated, and the process proceeds to step ST18.
  • step ST18 the color separation processing unit discriminates between the projection area and the background area.
  • the color separation processing unit 41 discriminates between a projection area and a background area for each of the separated images generated in step ST17 based on the pixel values of the separated images and the like. For example, the color separation processing unit 41 uses the color information given to the sensing pattern to determine a region of similar color information as a projection region, and determines a region excluding the projection region as a background region. The color separation processing unit 41 discriminates between the projection area and the background area, and proceeds to step ST19.
  • step ST19 the color separation processing unit extracts the pixel values of the projection area and the background area.
  • the color separation processing unit 41 extracts pixel values from the projection area and the background area determined in step ST18.
  • the color separation processing unit 41 has a statistical value calculated by statistical processing of the pixel value, for example, an average value, a median value, or a mode. You may use the value or the like as the extracted pixel value.
  • the color separation processing unit 41 extracts the pixel values PE1'and PE2'in the projection area and the pixel values BCE'in the background area, and proceeds to step ST20.
  • step ST20 the color separation processing unit determines whether it is necessary to update the parameters.
  • the color separation processing unit 41 calculates the difference between the parameters P1', P2', BC'used for calculating the attenuation coefficients ⁇ 1 and ⁇ 2 and the pixel values PE1', PE2', BEC' calculated in step ST19, respectively. If any of the calculated differences is larger than the preset threshold value, it is determined that the update is necessary, and the process proceeds to step ST21. Further, the color separation processing unit 41 determines that the update is unnecessary when the calculated difference is equal to or less than the preset threshold value, that is, the parameter has converged to the optimum value, and proceeds to step ST22.
  • step ST21 the color separation processing unit updates the parameters.
  • the color separation processing unit 41 updates the parameters whose calculated difference is larger than the preset threshold value, and returns to step ST12 using the pixel values extracted in step ST19 as parameters used for calculating the attenuation coefficients ⁇ 1 and ⁇ 2.
  • the color separation processing unit When proceeding from step ST20 to step ST22, the color separation processing unit outputs a separated image. Since the estimation result has converged, the color separation processing unit 41 outputs the separated image generated in step ST17 to the corresponding point detection unit 42.
  • the first sensing image obtained by imaging a mixed image of the first sensing pattern and the second sensing pattern with the parameter as the optimum value in the color model is the first. Since the separated image showing the sensing pattern and the separated image showing the second sensing pattern are generated, the sensing pattern can be separated more accurately than in the conventional case.
  • FIG. 9 illustrates a separated image.
  • FIG. 9A exemplifies a state in which the first sensing pattern SP1 and the second sensing pattern SP2 are projected on the screen Sc, and corresponds to both the first sensing pattern SP1 and the second sensing pattern SP2.
  • the area that is not used is the background area SB.
  • the color separation processing unit 41 captures the first sensing pattern SP1 and the second sensing pattern SP2 projected on the screen Sc as shown in FIG. 9A from the captured image.
  • FIG. 9B a separated image showing the first sensing pattern SP1 and a separated image showing the second sensing pattern SP2 can be generated as shown in FIG. 9C.
  • FIG. 10 is a diagram showing an example of parameter estimation operation.
  • the first sensing pattern SP1 shown in FIG. 10A and the second sensing pattern SP2 shown in FIG. 10B are projected onto the screen Sc and are projected by the image pickup apparatus 30. It is assumed that the image captured in FIG. 10 (c) is acquired.
  • the color separation processing unit 41 binarizes the image to determine the projection area in order to obtain the color information in the background area and the projection area for each projection device, and determines the projection area based on the difference from the projection area other than itself for each projection device. Find the projection area.
  • the background area is an area that does not belong to any projection area.
  • FIG. 10 shows the separated image generated in step ST17, the region of the first sensing pattern is the pixel value "P1' ⁇ 1", and the region of the second sensing pattern is the pixel value "P2". It is " ⁇ 2".
  • (f) of FIG. 10 is a mask which shows the area of a pixel value "P1' ⁇ 1" in a separated image
  • (g) of FIG. 10 is a mask which shows the area of a pixel value "P2' ⁇ 2" in a separated image. Is shown.
  • the color separation processing unit 41 determines the projection area in order to obtain the color information in the projection area of the first sensing pattern. Specifically, the image extracted by applying the mask shown in FIG. 10 (f) to the image taken in FIG. 10 (c) is obtained by using the color information given to the first sensing pattern. By digitizing, the projection area of the first sensing pattern shown in FIG. 10 (h) is determined.
  • the color separation processing unit 41 determines the projection area in order to obtain the color information in the projection area of the second sensing pattern. Specifically, the image extracted by applying the mask shown in FIG. 10 (g) to the image taken in FIG. 10 (c) is obtained by using the color information given to the second sensing pattern. By digitizing, the projection area of the second sensing pattern shown in FIG. 10 (i) is determined.
  • the color separation processing unit 41 determines the background area in order to obtain the color information in the background area. Specifically, the region masked in both (f) of FIG. 10 and (g) of FIG. 10 (the region shown in black) is used as the background region as shown in (j) of FIG.
  • FIG. 10 (k) illustrates an image of the projection region of the first sensing pattern determined by applying the mask shown in FIG. 10 (h) to the image captured image shown in FIG. 10 (c).
  • the image of the projection area of the first sensing pattern includes not only the first sensing pattern SP1 but also a part of the second sensing pattern SP2.
  • FIG. 10 (l) illustrates an image of the projection area of the second sensing pattern determined by applying the mask shown in FIG. 10 (i) to the image captured image shown in FIG. 10 (c).
  • the image of the projection area of the second sensing pattern includes not only the second sensing pattern SP2 but also a part of the first sensing pattern SP1.
  • FIG. 10 (m) exemplifies an image of the background region determined by applying the mask shown in FIG. 10 (j) to the image captured image shown in FIG. 10 (c), and is an image of the background region. Includes a part of the first sensing pattern SP1 and a part of the second sensing pattern SP2.
  • step ST20 when the region to be discriminated includes another region, it is determined in step ST20 that the parameters need to be updated, and the parameters used for calculating the attenuation coefficients ⁇ 1 and ⁇ 2 are updated as shown in step ST21. .. Further, when the processing of step ST12 to step ST21 is repeated, the other regions included in the region to be discriminated gradually decrease, and when the region to be discriminated does not include other regions, the parameters converge and the second It becomes possible to obtain a separated image in which the first sensing pattern SP1 and the second sensing pattern SP2 are accurately separated.
  • the color separation processing unit 41 in the three-dimensional color space when estimating the parameters P1', P2', BC'from the color information of the projected light and the background color from each projection device.
  • the parameters P1'and P2' are estimated for the color distribution of the projected light by regression line or principal component analysis.
  • the parameter BC' uses a statistical value of pixel values in the background region, for example, an average value, a median value, a mode value, or the like. Further, when the captured image of the background can be acquired, the color information may be used.
  • the present technology it is possible to accurately separate each projected image from the captured image acquired by capturing a mixed image of the projected images simultaneously projected on the screen from a plurality of projection devices by the image pickup device. It will be like.
  • the spatial position of the projected images is obtained from the detected corresponding points information so that the inconsistency in the area where the projected images are superimposed can be accurately eliminated. The image can be corrected.
  • the image pickup device is placed at a predetermined position as in the conventional case. It is not necessary to fix it to the image projection system, and the image projection system can be easily calibrated.
  • sensing pattern is not limited to the image including dots as shown in FIG. 7, and may be used by adding different color information to each projection device for a gray code pattern or a checker pattern having no color information.
  • FIG. 11 illustrates a sensing pattern (structured light) projected from the projection device, and the sensing pattern may be a checker pattern to which different color information is added as shown in FIGS. 11A and 11B. .. Further, color information may be added to the pattern of FIGS. 11C and 11 shown in "Image processing apparatus and method, data, and recording medium" of International Publication 2017/104447.
  • the color information to be added is generated using the pixel values of the pattern that does not have color information.
  • the color information P (Pr, Pg, Pb) of the three primary colors
  • Pr (Y) the red component is the pixel value Y
  • Pg (Y) the green component is the pixel value Y
  • Pb (Y) the blue component is the pixel value Y.
  • the process of generating color information using the pixel values of the pixels to be given is performed by individually treating the pixels of the pattern having no color information as the pixels to be given, and the color information generated in the pattern having no color information is generated. By adding it, a sensing pattern having color information can be created.
  • gamma characteristics The above ⁇ 3-1.
  • the color separation processing unit 41 performs degamma processing on the color information C (x, y) of the image image used in the equation (6) and is linear. Convert to color space information and use the color information after degamma processing. As described above, if the color information subjected to the degamma processing is used, the projected image can be separated accurately as in the above-described embodiment.
  • a predetermined number for example, two or three
  • groups are set for a plurality of projection devices so that at least one projection device in the group is included in the other groups. do.
  • different color information is given within the group.
  • groups are formed and each group is described in ⁇ 3-1. If the operation of the embodiment> is performed, the positional relationship of the projected images from a plurality of projection devices becomes clear based on the corresponding points of the separated images detected for each group, and the separation detected for each group becomes clear. Geometric correction information that matches the corresponding points for each image can be generated. Therefore, even when a large number of projection devices are used, by using the geometric correction information, it is possible to correct the image so that the inconsistency in the region where the projected images are superimposed can be accurately eliminated.
  • the projected image projected by each projection device can be separated from the mixed image.
  • a technique such as color proofing may be used to project an image with correct color expression.
  • an image is projected from a projection device in various different colors, and the input signal value is determined so that the color when the projected image is captured is the correct color in the real space. Therefore, in this technology, if color calibration is performed using the color information given to the projected sensing pattern, the geometric correction of the image is performed so that the inconsistency in the area where the projected image is superimposed can be accurately eliminated. Not only can you do this, but you can also project the projected image in the correct color.
  • color calibration can be performed with high accuracy.
  • the color calibration can be performed by using the color information given to the projected sensing pattern, it is not necessary to perform the color calibration in advance, and the image projection system can be efficiently calibrated.
  • the projection condition and the imaging condition are set so that the pixel values of the projected image and the captured image have a wide range of values without causing saturation. For example, it is effective to adjust the projected image so that the range of the input image is as wide as possible but not saturated by referring to the histogram of the pixel values for each color in the captured image.
  • the series of processes described in the specification can be executed by hardware, software, or a composite configuration of both.
  • the program that records the processing sequence is installed in the memory in the computer built in the dedicated hardware and executed.
  • the program can be recorded in advance on a hard disk as a recording medium, SSD (Solid State Drive), or ROM (Read Only Memory).
  • a hard disk as a recording medium
  • SSD Solid State Drive
  • ROM Read Only Memory
  • the program is a flexible disc, CD-ROM (Compact Disc Read Only Memory), MO (Magneto optical) disc, DVD (Digital Versatile Disc), BD (Blu-Ray Disc (registered trademark)), magnetic disc, semiconductor memory card. It can be temporarily or permanently stored (recorded) on a removable recording medium such as an optical disc.
  • a removable recording medium such as an optical disc.
  • Such removable recording media can be provided as so-called package software.
  • the program may be transferred from the download site to the computer wirelessly or by wire via a network such as LAN (Local Area Network) or the Internet.
  • the computer can receive the program transferred in this way and install it on a recording medium such as a built-in hard disk.
  • the image processing device of the present technology can have the following configurations.
  • (1) The color information of an image captured by capturing a mixed image of projected images projected by giving different color information from a plurality of projection devices, the color information of the captured image, and the color information of the projected image and the background.
  • An image processing device including a color separation processing unit that generates a separated image for each color information based on a color model showing a relationship.
  • (2) The color model determines the color information of the projected image changed according to the spectral characteristics of the projection device and the image pickup device that acquires the image pickup device, and the attenuation that occurs in the mixed image captured by the image pickup device.
  • the image processing apparatus according to (1) which uses the indicated attenuation coefficient as a parameter.
  • the color separation processing unit uses the parameter that minimizes the difference between the color information of the captured image and the color information estimated by the color model, and the separated image for each color information based on the color model.
  • the image processing apparatus according to any one of (1) to (6), wherein the projected image and the captured image are images that are not saturated.
  • the image processing device according to any one of (1) to (7), wherein the image is an image acquired by a non-fixed viewpoint image pickup device.
  • the image processing device according to any one of (1) to (8), further comprising an image correction unit that corrects a projected image projected from the projection device.
  • the image processing apparatus according to (9), wherein the image correction unit performs color calibration of the projected image using the color information given to the separated image.
  • a corresponding point detecting unit for detecting a corresponding point between the separated images for each color information generated by the color separation processing unit is provided.
  • the image processing device wherein the image correction unit corrects the projected image by using geometric correction information for matching the corresponding points for each separated image detected by the corresponding point detecting unit.
  • a predetermined number of projection devices are grouped to the plurality of projection devices, and at least one projection device in the group is included in another group, and different color information is given to each other in the group.
  • the projected image is projected,
  • the color separation processing unit generates a separation image for each group, and the color separation processing unit generates a separation image.
  • the corresponding point detection unit detects the corresponding point for each group, and the corresponding point detection unit detects the corresponding point.
  • the image processing apparatus according to (11), wherein the image correction unit corrects the projected image by using geometric correction information for matching the corresponding points for each separated image detected by the corresponding point detection unit for each group. ..

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Databases & Information Systems (AREA)
  • Computing Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • Geometry (AREA)
  • Projection Apparatus (AREA)
  • Controls And Circuits For Display Device (AREA)
PCT/JP2021/018201 2020-06-15 2021-05-13 画像処理装置と画像処理方法とプログラムおよび画像投写方法 Ceased WO2021256134A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US18/000,573 US20230215130A1 (en) 2020-06-15 2021-05-13 Image processing apparatus, image processing method, program, and image projection method
JP2022532391A JP7616219B2 (ja) 2020-06-15 2021-05-13 画像処理装置と画像処理方法とプログラムおよび画像投写方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-102784 2020-06-15
JP2020102784 2020-06-15

Publications (1)

Publication Number Publication Date
WO2021256134A1 true WO2021256134A1 (ja) 2021-12-23

Family

ID=79267805

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/018201 Ceased WO2021256134A1 (ja) 2020-06-15 2021-05-13 画像処理装置と画像処理方法とプログラムおよび画像投写方法

Country Status (3)

Country Link
US (1) US20230215130A1 (https=)
JP (1) JP7616219B2 (https=)
WO (1) WO2021256134A1 (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7593382B2 (ja) * 2022-09-20 2024-12-03 セイコーエプソン株式会社 表示方法、表示システム、及びプログラム

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001054131A (ja) * 1999-05-31 2001-02-23 Olympus Optical Co Ltd カラー画像表示システム
JP2003348501A (ja) * 2002-05-23 2003-12-05 Olympus Optical Co Ltd 画像表示装置
WO2010055625A1 (ja) * 2008-11-17 2010-05-20 日本電気株式会社 画素位置対応関係特定システム、画素位置対応関係特定方法および画素位置対応関係特定プログラム
JP2011164246A (ja) * 2010-02-08 2011-08-25 Seiko Epson Corp 投写位置ずれ量検出装置、投写位置ずれ量検出方法及びプロジェクションシステム
JP2012029269A (ja) * 2010-06-21 2012-02-09 Sanyo Electric Co Ltd 撮像装置および投写型映像表示装置
US20120194562A1 (en) * 2011-02-02 2012-08-02 Victor Ivashin Method For Spatial Smoothing In A Shader Pipeline For A Multi-Projector Display
US20130314550A1 (en) * 2010-11-24 2013-11-28 Echostar Ukraine L.L.C. Television receiver - projector compensating optical properties of projection surface
JP2014006357A (ja) * 2012-06-22 2014-01-16 Seiko Epson Corp プロジェクター、画像表示システム、プロジェクターの制御方法
CN105072427A (zh) * 2015-07-29 2015-11-18 深圳华侨城文化旅游科技股份有限公司 一种多投影仪之间的自动色彩平衡方法
JP2016519330A (ja) * 2013-03-15 2016-06-30 スケーラブル ディスプレイ テクノロジーズ インコーポレイテッド 短焦点カメラを用いてディスプレイシステムを校正するためのシステム及び方法
WO2018225531A1 (ja) * 2017-06-09 2018-12-13 ソニー株式会社 画像処理装置および方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5641820B2 (ja) * 2010-08-25 2014-12-17 キヤノン株式会社 投射型表示システム及び投射型表示装置

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001054131A (ja) * 1999-05-31 2001-02-23 Olympus Optical Co Ltd カラー画像表示システム
JP2003348501A (ja) * 2002-05-23 2003-12-05 Olympus Optical Co Ltd 画像表示装置
WO2010055625A1 (ja) * 2008-11-17 2010-05-20 日本電気株式会社 画素位置対応関係特定システム、画素位置対応関係特定方法および画素位置対応関係特定プログラム
JP2011164246A (ja) * 2010-02-08 2011-08-25 Seiko Epson Corp 投写位置ずれ量検出装置、投写位置ずれ量検出方法及びプロジェクションシステム
JP2012029269A (ja) * 2010-06-21 2012-02-09 Sanyo Electric Co Ltd 撮像装置および投写型映像表示装置
US20130314550A1 (en) * 2010-11-24 2013-11-28 Echostar Ukraine L.L.C. Television receiver - projector compensating optical properties of projection surface
US20120194562A1 (en) * 2011-02-02 2012-08-02 Victor Ivashin Method For Spatial Smoothing In A Shader Pipeline For A Multi-Projector Display
JP2014006357A (ja) * 2012-06-22 2014-01-16 Seiko Epson Corp プロジェクター、画像表示システム、プロジェクターの制御方法
JP2016519330A (ja) * 2013-03-15 2016-06-30 スケーラブル ディスプレイ テクノロジーズ インコーポレイテッド 短焦点カメラを用いてディスプレイシステムを校正するためのシステム及び方法
CN105072427A (zh) * 2015-07-29 2015-11-18 深圳华侨城文化旅游科技股份有限公司 一种多投影仪之间的自动色彩平衡方法
WO2018225531A1 (ja) * 2017-06-09 2018-12-13 ソニー株式会社 画像処理装置および方法

Also Published As

Publication number Publication date
US20230215130A1 (en) 2023-07-06
JPWO2021256134A1 (https=) 2021-12-23
JP7616219B2 (ja) 2025-01-17

Similar Documents

Publication Publication Date Title
US10378877B2 (en) Image processing device, image processing method, and program
JP4378168B2 (ja) 光学系を使用して出力されたカラーイメージの色収差を補正する方法およびシステム
JP5997645B2 (ja) 画像処理装置及び方法、及び撮像装置
JP4741483B2 (ja) 映像品質評価方法及びシステム
US7986352B2 (en) Image generation system including a plurality of light receiving elements and for correcting image data using a spatial high frequency component, image generation method for correcting image data using a spatial high frequency component, and computer-readable recording medium having a program for performing the same
JP5338718B2 (ja) 補正情報算出装置、画像処理装置、画像表示システム、および画像補正方法
WO2005002240A1 (ja) 表示特性補正データの算出方法、表示特性補正データの算出プログラム、表示特性補正データの算出装置
WO2006025191A1 (ja) マルチプロジェクションシステムにおける幾何補正方法
KR20160030224A (ko) 화상 처리 장치, 화상 처리 시스템, 화상 처리 방법, 및 컴퓨터 프로그램
JP2010041417A (ja) 画像処理装置、画像処理方法、画像処理プログラム、及び、撮像装置
WO2007026899A1 (ja) 画像処理装置および画像処理プログラム
CN114651439A (zh) 信息处理系统、内窥镜系统、已学习模型、信息存储介质及信息处理方法
JP3530652B2 (ja) 画像合成方法及び画像合成装置
JP2019220887A (ja) 画像処理装置、画像処理方法およびプログラム
JP2010187348A (ja) 画像処理装置、画像処理方法、画像処理プログラム
JP2004228824A (ja) スタックプロジェクション装置及びその調整方法
JP2005189542A (ja) 表示システム、表示プログラム、表示方法
WO2021256134A1 (ja) 画像処理装置と画像処理方法とプログラムおよび画像投写方法
WO2014069248A1 (ja) 画像処理装置および画像処理方法、並びにプログラム
JP3721281B2 (ja) 画像欠陥補正方法およびこの方法を記録した記録媒体
US11715218B2 (en) Information processing apparatus and information processing method
JP5634744B2 (ja) Ｘ線診断装置、画像処理装置及びプログラム
JP4114107B2 (ja) 画像処理装置および方法、並びに記録媒体
TWI899860B (zh) 沉浸式投影系統及其校正方法
JP2012070168A (ja) 画像処理装置、画像処理方法、および、画像処理プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21826398

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022532391

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21826398

Country of ref document: EP

Kind code of ref document: A1