JP2016139974A - Projection device, image projection system, image projection method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To represent an image from which the color difference of a projection object itself cannot be felt, even if the color projected from a projection display unit to a projection object composed of a plurality of colors deviates from the color reproducible range of the projection object.SOLUTION: A projection device has a measuring camera 1 for acquiring the color information of a projection object, a color conversion unit 255 for changing the color value of projection image data, on the basis of the color information of the projection object acquired by the measuring camera 1, and an approximate color detector 256 for detecting the approximate color of a color value close to an out-of-gamut color value in a projectable gamut, when the color value of the projection image data is an out-of-gamut color value projectable in the region of the projection object. When an out-of-gamut color value is included in the projection image data, the color conversion unit 255 performs color conversion by substituting the approximate color value for the out-of-gamut color value of the projection image data.SELECTED DRAWING: Figure 11

Description

  The present invention relates to a projection apparatus, an image projection system, an image projection method, and a program.

2. Description of the Related Art There is known an illumination system that performs an effect by using a projector, which is a projection device, instead of a lighting fixture. The luminaire used in this illumination system emits image light as projection light, and changes the light and color of the projection light to change as a moving image.
In this illumination system, when the color of the projection object is composed of, for example, a plurality of colors, the same color is applied even in a portion where the color of the projection object itself is different in consideration of the color of the projection object itself or the influence of the projection light. Projection is performed after color conversion so that it can be expressed.
However, when the projected color is out of the reproducible color range of the projection object, there is a problem that the same color cannot be expressed in a portion where the color of the projection object itself is different.

As an example of a conventional illumination system, the portable imaging display device described in Patent Document 1 compares an initial image with a captured image obtained by imaging the initial image projected by the projection display unit with the imaging unit. Then, the state of the ground surface on which the display image is projected is detected by the imaging function of the device itself, a correction signal using a complementary color of the color difference is generated, and the correction signal is superimposed on the display image and displayed. In other words, the situation of the ground surface on which the display image is projected is detected by the imaging function of the device itself, and the display image is corrected according to this situation to display an image with good reproducibility. When there are different parts, color conversion is performed on the projected image so that it can be viewed with the same color as that projected onto the white screen.
However, in this portable imaging display device, when the color of light projected by the projection display unit is outside the reproducible color range of the projection target with respect to the projection target composed of a plurality of colors, the projection target The problem of being unable to express the same color in different parts of the color cannot be solved.

  The present invention has been made in view of the above-described conventional problems, and an object of the present invention is to reproduce a color projected by a projection display unit with respect to a projection target composed of a plurality of colors. Even when out of the range, it is possible to express an image that does not feel the color difference of the projection object itself.

  The present invention is based on color information acquisition means for acquiring color information of the projection object from a captured image of the projection object on which the projection image is projected, and color information of the projection object acquired by the color information acquisition means. A color conversion unit that changes a color value of the projection image data; and a color that can be projected when the color value of the projection image data is an out-of-gamut color value that can be projected in the area of the projection target object. An approximate color detection unit that detects an approximate color value of a color value close to the out-of-gamut color value in the gamut, and the color conversion unit includes the projection when the out-of-gamut color value is included in the projection image data. A projection apparatus that performs color conversion by replacing an out-of-gamut color value of image data with the approximate color value.

  According to the present invention, even when the color projected by the projection display unit is outside the color reproducible range of the projection target with respect to the projection target composed of a plurality of colors, the color difference of the projection target itself is not felt. An image can be expressed.

It is a block diagram which shows the projection system which consists of the projection apparatus which concerns on embodiment of this invention, and its peripheral device. It is a figure which shows roughly the process sequence between the measurement camera, illumination system, and projector at the time of producing | generating a color gamut for every part of a projection target object. It is a figure shown about the functional structure of the illumination system at the time of producing | generating the color gamut for every part, and its peripheral device. It is a figure which shows the specific example of the coordinate data of the parts which a coordinate detection part detects. It is a figure which shows the specific example of the table which preserve | saves the coordinate data of parts. It is a color gamut diagram showing the color gamut of parts in the chromaticity diagram. It is a flow which shows the process sequence which produces | generates the color gamut for every part in an illumination system. It is a figure which shows the specific color gamut generation method of parts. It is a figure which shows the specific example of determination of the presence or absence of the parts of the same hue. It is a figure which shows the process sequence of an illumination system roughly. It is a figure which shows the illumination design creation part which produces an illumination design. It is a figure which shows the specific approximate color detection process in the case of detecting the nearest color within the color gamut which an approximate color detection part performs. It is a figure which shows the influence with respect to another part regarding the color determined to be out of a color gamut. It is a figure which shows the division | segmentation management table which manages the data regarding the output image which a division | segmentation image management part preserve | saves to a storage medium. It is a flowchart which shows the procedure which produces the design image of the illumination in an illumination system. It is a figure explaining the specific example of the color conversion process of step S306-S308 in FIG.

  In the present invention, when a projection target color of projection light is composed of a plurality of colors, a moving image or a still image to be projected (in the present invention, a moving image, a still image, and projection light are collectively referred to as an image), etc. When determining the color of the projection object, the color reproducible range of the projection object is acquired in units of parts described later of the projection object, and even if the color to be projected is outside the color reproducible range of the projection object The feature is that the color information of the projected image is changed so that the projected image can be expressed without making the object itself feel a color difference.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing a projection system including a projection apparatus and peripheral devices according to an embodiment of the present invention.
That is, the image projection system according to the present embodiment includes a measurement camera 1, an illumination system 2, and a projector 3 that is an image projection apparatus.
The measurement camera 1 stores an image of the projection target when the light projected from the projector 3 is irradiated onto the projection target, and acquires the spectral reflectance of the projection target, thereby obtaining the color information of the projection target, That is, luminance and color difference (color difference between the image projected on the projection object and the projected image) are measured. In addition, the measurement camera 1 outputs the measurement result and the stored image, and transmits them to the illumination system 2.

The illumination system 2 creates coordinate detection for each color part and a color expression table to be described later for each color part based on the image of the projection object received from the measurement camera 1 and the values of luminance and color difference. In addition, the illumination system 2 performs a process of correcting the image output from the projector 3 based on the created color expression table.
The projector 3 projects the image received from the illumination system 2 onto the projection target.
In this embodiment, when the projection object itself is composed of a plurality of colors, the projection object itself is classified into a plurality of parts based on the colors and coordinate shapes (here, the classified parts are referred to as parts).

First, the overall operation of the image projection system will be schematically described.
FIG. 2 is a diagram schematically showing a processing procedure between the measurement camera 1, the illumination system 2, and the projector 3 when generating a color gamut for each part of the projection target.
In FIG. 2, requests for processing and data acquisition are indicated by solid lines, and information notifications and returns (responses) to requests are indicated by broken lines.

  The illumination system 2 requests the projector 3 to perform irradiation for grasping the position of the part (S101), and notifies the optical signal (image) for recognizing the shape, size, and coordinates of the part. In response to this request, the projector 3 irradiates the projection target with an image. The projector 3 replies to the illumination system 2 that an image has been projected as necessary (S102).

(Saving the positioning image)
The illumination system 2 notifies the measurement camera 1 to save the projected object image (S103). The measurement camera 1 stores the image of the projection object and transmits the stored image to the illumination system 2 (S104).

(Parts division / coordinate recognition)
The illumination system 2 analyzes the image received from the measurement camera 1 and recognizes the shape, size, and coordinates for each part (S105). The analysis method will be described later.
The recognition of the shape, size, and coordinates for each part in step S105 is repeated for the number of parts of the projection target. The illumination system 2 requests the projector 3 to irradiate the color gamut generation light (S106).

  In this case, in order to generate a color gamut for each part, color data of a plurality of colors (color values, hereinafter the same) is required. Therefore, the illumination system 2 notifies the projector 3 of an image (light signal) for acquiring necessary color data. The projector 3 returns to the illumination system 2 that the notified optical signal is projected as necessary (S107).

  The illumination system 2 requests the measurement camera 1 to measure the luminance and color difference (color value difference) of the projection object (part) being projected. That is, the illumination system 2 notifies the measurement camera 1 of the color of the image being irradiated and the coordinates to be measured in order to measure the brightness and color difference of the parts (S108).

  Here, the coordinates are coordinates based on the data acquired in the position grasp image saving process in step S103. The measurement camera 1 returns the illumination system 2 with the coordinate, luminance, and color difference associated with each other (S109). By repeating the processing of (color gamut generation light irradiation) in step S106 and the luminance acquisition (luminance, color difference, coordinates) in step S108 by the number of irradiation lights, a color gamut is generated for each part group from the acquired data ( S110).

FIG. 3 is a diagram illustrating the functional configuration of the illumination system 2 and its peripheral devices when generating a color gamut for each part.
In FIG. 3, data transmission / reception is indicated by a solid line, and an interface between hardware is indicated by a broken line.
The functional configuration unit of the measurement camera 1 includes an image acquisition unit 101 and a luminance measurement unit 102. The image acquisition unit 101 acquires an image of a projection target as RGB bitmap data using an image acquisition device such as a digital camera. The timing at which the image acquisition unit 101 acquires an image is when a request from the illumination system 2 is received.

The luminance measurement unit 102 is a part that acquires lightness and color difference signals, like a spectral radiance meter, and measures the Lab value of the coordinates specified for the object (projection object). The timing at which the luminance measurement unit 102 measures the luminance and color difference for each part is when a request is received from the illumination system 2. The luminance measuring unit 102 also receives the coordinates of an object for measuring luminance and color difference from the illumination system 2 together with the measurement timing.
The luminance measurement unit 102 determines the coordinates of the measurement target from the image held by the image acquisition unit 101 and measures the luminance and the color difference. Both the image acquisition unit 101 and the luminance measurement unit 102 transmit the acquired information to the illumination system 2. The measurement camera 1 corresponds to the color information acquisition means of the present invention that images a projection object and acquires color information of the projection object.

The illumination system 2 includes an image analysis unit 201, a luminance analysis unit 202, a projection management unit 203, a color gamut acquisition projection management unit 204, a coordinate detection unit 205, a coordinate registration unit 206, a part color gamut management unit 207, a storage medium 208, and parts. A color gamut generation unit 209 and an illumination design creation unit 25 are included.
The image analysis unit 201 is an interface between the image acquisition unit 101 of the measurement camera 1 and the illumination system 2. The image analysis unit 201 instructs the measurement camera 1 to acquire an image and receives the image data acquired by the image acquisition unit 101 when grasping an object (part) obtained by classifying the projection target for each color.

The luminance analysis unit 202 is an interface between the luminance measurement unit 102 of the measurement camera 1 and the illumination system 2. When generating the color gamut for each part, the measurement camera 1 is instructed to measure the brightness and the color difference, and the coordinates of the measurement target are passed, and the brightness and color difference values for each part acquired by the brightness measuring unit 102 are received. .
The projection management unit 203 is an interface between the projector 3 and the illumination system 2. An image decided to be projected by the illumination system 2 is converted into an RGB signal to be output by the projector 3 and transmitted.

The color gamut acquisition projection management unit 204 is a window that receives instructions from a user interface or the like when generating the color gamut of each part of the projection target. When detecting the coordinates of the parts, adjust the projection timing and the image acquisition timing to match, and when generating the color gamut for each part, the timing to project the image and the timing to measure the luminance color difference are Adjust to fit.
The coordinate detection unit 205 divides the parts for each hue from the image data of the projection target, and grasps the shape of the part and acquires the coordinates.

The coordinate registration unit 206 confirms that the part information (part shape and coordinates) detected by the coordinate detection unit 205 is registered and that the registration to the storage medium 208 is completed, and instructs the next processing.
The part color gamut management unit 207 registers and manages the shape, coordinates, and color gamut of parts in the storage medium 208. The part color gamut management unit 207 provides an interface for storing and acquiring part information to modules in the lighting system 2 in response to a request.
The storage medium 208 is, for example, a non-volatile memory, and is means for holding generated information. Information to be registered and managed is retained in the same form as the database.
The part color gamut generation unit 209 generates a color gamut based on the luminance and color difference acquired by the luminance analysis unit 202 and requests registration to the storage medium 208.

Next, a process for generating and saving a color gamut for each part will be described in the order of processing.
In response to an instruction to generate a color gamut of a part from the user interface or the like, the color gamut acquisition projection management unit 204 requests the projection management unit 203 to perform part recognition irradiation, and the image analysis unit 201 stores the part recognition image. Request. Here, the irradiation for parts recognition is the same as the projection for grasping the shape of the projection target.
When the image analysis unit 201 receives the image data from the image acquisition unit 101, the image analysis unit 201 transmits the image data to the coordinate detection unit 205. The coordinate detection unit 205 grasps the shape of each part and acquires coordinates. The coordinate detection unit 205 transmits part coordinate data (including shape and coordinates) to the coordinate registration unit 206.

FIG. 4 is a diagram illustrating a specific example of part coordinate data detected by the coordinate detection unit 205.
The coordinate data includes a process ID 311, a part ID 312, an X coordinate 313, a Y coordinate 314, a part shape 315, and a check bit 316.
The process ID 311 is a unique ID of a process type indicating that the data is based on part coordinate detection.
The part ID 312 is a unique ID of the detected part, and is, for example, a serial number in the detected order.

The X coordinate 313 and the Y coordinate 314 are detected coordinate values. In the part shape 315, raw data (raw data) or a file name obtained by extracting only a part portion from the part recognition image acquired by the image analysis unit 201 is entered. The check bit 316 is a value for detecting an abnormal transmission in the transmission packet, and specifically includes a sum check.
The coordinate registration unit 206 requests the part color gamut management unit 207 to save the coordinate data in the storage medium 208. The part color gamut management unit 207 stores the coordinate data acquired by the coordinate detection unit 205 in the storage medium 208.

FIG. 5 is a diagram showing a specific example of a table (storage table) for storing the coordinate data of parts.
The coordinate data area includes parts ID 321, X coordinate 322, Y coordinate 323, part shape file 324, and color gamut ID 325. The part ID 312, the X coordinate 313, the Y coordinate 314, and the part shape 315 acquired by the coordinate detection unit 205 are inserted into each area of the part ID 312, the X coordinate 322, the Y coordinate 323, and the part shape file 324. The color gamut ID area 325 is an area in which a value indicating a specific color gamut such as a file name of the color gamut is entered.

When the coordinates of the parts are stored, the coordinate registration unit 206 notifies the color gamut acquisition projection management unit 204 of the coordinates for measuring the luminance and the color difference. The color gamut acquisition projection management unit 204 requests the projection management unit 203 to perform projection for color gamut generation, and requests the luminance analysis unit 202 to measure luminance and color difference. Here, the projection for generating the color gamut is performed by outputting all combinations of R, G, B, RG, GB, RB, and RGB with the maximum light quantity that the projector 3 can output.
The luminance analysis unit 202 receives the value measured by the luminance measurement unit 102 and notifies the part color gamut generation unit 209 of the value. The part color gamut generation unit 209 generates a color gamut for each part. When parts having the same color gamut occur due to the same hue or the like of the parts of the projection target, one color gamut is referred to for a plurality of parts.
The part color gamut management unit 207 stores the part ID 312 detected and stored by the coordinate detection unit 205 in the storage medium 208 so as to associate the color gamut generated by the part color gamut generation unit 209 with each other. Here, a value is entered in the color gamut ID 325 of the coordinate data table.

FIG. 6 is a color gamut diagram showing the color gamut of parts in the chromaticity diagram.
That is, in the figure, the horseshoe 540 portion is the entire range of chromaticity that can be recognized by humans. In the drawing, a portion surrounded by a hexagon 542 indicates a color gamut that can be expressed by the part. The color gamut changes the shape and range of the hexagon according to the color of the ground (base surface) of the part.
Note that the value to be entered in the color gamut ID area 325 in FIG. 5 is a unique ID that identifies the color gamut or the name of a file that describes the color gamut.

Next, a process for generating a color gamut for each part will be described.
FIG. 7 is a flow showing a processing procedure for generating a color gamut for each part in the illumination system 2.
First, when the color gamut acquisition projection management unit 204 receives a color gamut generation request for each part from the user interface or the like (S201), the projection management unit 203 requests the projector 3 to perform irradiation for part recognition (S202). Here, the irradiation for part recognition is to detect the ground color of the projection object, and the parts for each color of the projection object (here, R, G, B, RG, GB, RB, RGB (colorless)). Is used to separate from the coordinates and shape. Specifically, this is a technique equivalent to that described in Patent Document 1 (Japanese Patent Laid-Open No. 2008-67080), and irradiation for detecting the state of the ground surface including the influence of the shadow of natural light is assumed.

The image analysis unit 201 acquires a part recognition image from the image acquisition unit 101 of the measurement camera 1 at the timing when the projector 3 projects onto the projection target (S203). The coordinate detection unit 205 acquires the coordinates and shape of each part based on the image acquired by the image analysis unit 201 (S204). The part color gamut management unit 207 stores the coordinates and shape of each part in the storage medium 208 via the coordinate registration unit 206 (S205).
When the storage in step S205 is completed, the color gamut acquisition projection management unit 204 requests the projection management unit 203 to perform irradiation for color gamut generation (S206). When the projector 3 performs irradiation for color gamut generation according to an instruction from the projection management unit 203, the color gamut acquisition projection management unit 204 requests the luminance analysis unit 202 to acquire luminance and color difference (S207). The luminance analysis unit 202 acquires the luminance and color difference of the designated coordinates from the luminance measurement unit 102 of the measurement camera 1. The part color gamut generation unit 209 generates a color gamut for each part based on the luminance and color difference acquired by the luminance analysis unit 202 (S208).

FIG. 8 is a diagram for explaining a specific part color gamut generation method.
Based on the coordinates of the irradiation target held by the luminance analysis unit 202, the luminance and color difference of each color of the color gamut generation irradiation are acquired.
In the above specific example, the table 429 converted from the luminance and color difference to the two-dimensional coordinate XY is assumed. The X and Y values of R, G, B, RG, GB, and RB in the table 429 are set as two-dimensional coordinate points (X, Y), and the vertices are connected to form a hexagon (see FIG. 6). The interior is the color gamut.
The part color gamut generation unit 209 searches the registered parts for parts having the same hue (S209).

FIG. 9 is a diagram illustrating a specific example of the determination of the presence / absence of parts having the same hue.
In order to determine whether the registered color gamut has the same hue as the color gamut of the generated part, the registered color gamut is compared with the color gamut generated in the order of ID.
As a comparison method, a case where the generated color gamut is the XY table 441 with the color gamut ID0000 and the registered color gamut is the XY table 442 with the color gamut ID0001 is shown.
First, R, G, B, RG, GB, RB, and RGB color differences, which are hexagonal corners indicating the color gamut, are obtained from the XY tables 441 and 442.
That is, a threshold value table 443 for determining the same hue in each color is stored in the system in advance, and it is determined whether or not the hue is the same by comparing the color difference with the threshold value. Specifically, according to the equation (Equation 1), it is checked whether or not the color difference is smaller than the threshold value. If all colors are smaller than the threshold value, the same hue is determined.

If there is a part with the same hue (S209, YES), the part is stored in association with the already generated color gamut (S210). As described above, when the same color gamut is already saved in the storage medium 208, the color gamut data is not saved and the data is not duplicated. Therefore, the capacity required for the color gamut can be reduced.
When there is no part with the same hue (S209, NO), the part color gamut generation unit 209 saves the part via the part color gamut management unit 207 in step S205 and the storage table (also referred to as the color gamut table). (S211).
As described above, when the ground color of the projection object is a plurality of colors, the illumination system 2 holds the color gamut corresponding to the ground color.
In the present embodiment, the color gamut is linked according to the ground color of the projection object. This makes it possible to grasp the shape and color of the portion with the ground color.

FIG. 10 is a diagram schematically showing the processing procedure of the illumination system 2 described above.
Here, as an example, the projection object has two ground colors. The image 411 of the projection target is divided into parts 412 (413, 414) according to the difference in hue, and color gamuts for the parts 413, 414 are generated. For parts 413 and 414 having the same ground color of the projection object, color gamut 415 (color gamut ID: 0001) and 416 (color gamut ID: 0002) are associated with each part color.

FIG. 11 is a diagram illustrating an illumination design creation unit 25 that creates an illumination design.
As shown in FIG. 11, the illumination design creation unit 25 of the present embodiment includes a design creation unit 251, a design image division unit 252, a divided image management unit 253, a design image color gamut determination unit 254, a color conversion unit 255, an approximate color. A detection unit 256, a related part search unit 257, and a part combination unit 258 are included.

Here, the design creation unit 251 receives a design image at a window from a user interface or the like when the user creates a lighting design.
The design image dividing unit 252 divides one surface (one screen) of the design image into the number of parts from information such as the coordinates and color gamut of the parts registered in the storage medium 208.
The divided image management unit 253 manages not only the divided images of the divided design images, but also the state of whether or not the color gamut determination and color conversion processing has been completed for all the parts. Note that the storage medium 208 is used to manage the divided design images. When it is confirmed that the processing has been completed for all the parts, a request for the next processing is made to the parts combining unit 258.

The design image color gamut determination unit 254 determines whether the divided design image is a color that can be expressed in the color gamut of the part. When the design image can be expressed within the color gamut, a request for the next process (color conversion process) is made to the color conversion unit 255, and when it is out of the color gamut, a request for the next process (approximate color detection) is made to the approximate color detection unit 256.
The color conversion unit 255 performs color processing (color conversion processing) for projecting the color of the design image onto the projection target based on the color gamut.
The approximate color detection unit 256 detects the closest color within the color gamut with respect to the color of the design image indicating the out of the color gamut.
Based on the data acquired from the divided image management unit 253, the related parts search unit 257 relates to the color (color value) of another part with respect to the color (color value) determined to be out of the color gamut by the design image color gamut determination unit 254. The influence is examined, and for the affected part, the color conversion unit 255 is requested to perform color conversion by replacing it with an approximate color.
Note that when the related parts search unit 257 searches for related parts, a means for determining a color change (replacement) range from image information before division may be provided. By doing so, it is possible to reduce the time for searching the influence range in the related parts search when the out-of-gamut determination is made.
Similarly, parts that have no influence may be replaced with similar colors for conversion.

The part combining unit 258 combines the color converted parts and outputs the combined image. The output method is registered in the storage medium 208 or displayed on a user interface (I / F) UI.
Note that each of the functional components 201 to 207 and 251 to 258 constituting the illumination system 2 shown in FIG. 11 is realized by causing a computer to read a computer-readable program.

FIG. 12 is a diagram illustrating a specific approximate color detection process performed when the approximate color detection unit 256 detects the closest color in the color gamut.
That is, 522 is an enlarged view of the color portion where the out-of-gamut has occurred in the color-gamut diagram 521 of the part where out-of-gamut has occurred. When the color outside the color gamut is a color having a coordinate of 523, the approximate color detection unit 256 detects the color 524 having a short distance from the color 523 inside the hexagon inside the color gamut as the closest color in the color gamut. .
The detected color is replaced with the color of the design image so that the color conversion unit 255 can perform color conversion.

FIG. 13 is a diagram illustrating the influence on other parts regarding the color determined to be out of the color gamut.
That is, here, when projecting the projection image 532 of the same color onto the projection object 531, the lower color 534 of the projection object 531 is within the color gamut of the part, and color reproduction is possible. However, since the upper color 533 of the projection target 531 has the background color of the part, it is out of the color gamut and cannot be reproduced, that is, the color 533 cannot be reproduced. Therefore, the projection image 532 originally of a single color design is used. Cannot be expressed.
In this case, the color of the projection image 532 is changed to the closest color 536 in the color gamut so that the color 533 projected by the part determined to be out of the color gamut matches the color projected to the lower part of the projection target 531. Replace and convert color.
Note that when the related parts search unit 257 searches for related parts, a means for determining a color change (replacement) range from image information before division may be provided. By doing so, it is possible to reduce the time for searching the influence range in the related parts search when the out-of-gamut determination is made.
Similarly, parts that have no influence may be replaced with similar colors for conversion.
Next, an example of a method for saving the divided image management unit 253 to the storage medium 208 will be described.

FIG. 14 is a diagram showing a division management table for managing data related to output images stored in the storage medium 208 by the divided image management unit 253.
The divided images to be stored are managed by this divided image management table. The divided image management table includes a design image ID 511, a part ID 512, a conversion state flag 513, a file name before conversion 514, and a file name 515 after conversion.
Here, the design image ID 511 is a unique ID of the design image received from the user interface or the like by the design creation unit 251.
The part ID 512 is a part ID acquired from the part color gamut management unit 207 by the design image dividing unit 252 and is associated with the part ID 312 of the coordinate data.

The conversion state flag 513 is a flag for managing the progress of the processing content, and assumes three types of states: already converted (completed), before conversion (not yet), and during feedback (correction) due to the influence of out-of-gamut determination. . At this point, enter the default (not yet).
The pre-conversion file name 514 is the name of the file divided and stored by the design image dividing unit 252.
The post-conversion file name 515 is a file name in which image data after the color conversion unit 255 performs color conversion on the data of the pre-conversion file name 514 is stored.

FIG. 15 is a flowchart showing a procedure for creating an illumination design image in the illumination system 2.
That is, the design creation unit 251 receives a design image to be projected from a user interface or the like (S301). However, it is assumed that the shape of the projection object is already included in the design image, and the design that matches the shape is an existing technology, and thus the description thereof is omitted.
The design image dividing unit 252 acquires the coordinates of the parts of the projection object and the shape of each part via the part color gamut management unit 207, and receives them from the design creation unit 251 based on the acquired coordinates and shapes. The design image to be projected is divided into parts (S302). Next, the divided image management unit 253 stores the design image divided into parts in the storage medium 208.

  The design image color gamut determination unit 254 checks whether or not the color (color value) of the design image divided for each part is within the color gamut of the part from the color gamut data of the storage medium 208 (S303). If the design image color gamut determination unit 254 determines that the color is within the part color gamut (S303, YES), the color conversion unit 255 performs color conversion on the part of the design image (S304). The converted image is stored in the storage medium 208 via the divided image management unit 253 (S305).

In step S303, when the design image color gamut determining unit 254 determines that it is out of the part color gamut (S303, NO), the approximate color detecting unit 256 detects a close color within the color gamut (S306). Next, the close color detected by the approximate color detection unit 256 is used as the color of the design image (S307), and the color conversion unit 255 performs color conversion using the close color as the color of the design image (S308).
The color conversion here is image correction of a display image in accordance with the ground color detected at the time of part recognition irradiation in step S101 in FIG. 2, and is described in Patent Document 1 (Japanese Patent Laid-Open No. 2008-066700). The explanation is omitted because it is the same as the above.

When the color conversion is completed, the part image after color conversion is stored in the storage medium 208 via the divided image management unit 253 (S309).
The related parts search unit 257 searches for related parts other than the parts processed in steps S306 to S309, and converts the color of the design image of the parts related by the color conversion unit 255 to the color determined in step S306 (S310). ). The converted image is stored in the storage medium 208 via the divided image management unit 253 (S311).
The processes in steps S303 to S311 are processes for each part. For the method of discriminating related parts, refer to the description related to FIG.

FIG. 16 shows a specific example of color conversion processing in steps S306 to S308 in FIG. 15, that is, color conversion performed by replacing the color 534 projected onto the lower portion of the projection target 531 in FIG. 13 with the closest color 536 in the color gamut. It is a figure explaining about.
Approximate color is detected by an approximate color detection method (a method of detecting a color 524 having a short distance from the color 523 inside the hexagon 542 within the color gamut from the color gamut diagram 521 of the part where the color gamut has occurred and related. Part Color Gamut In FIG. 625, the same color 628 as the detected color 524 is detected from the part color gamut 632 of the color 534 projected onto the lower part of the projection object 531 (626 is a conversion unit of the part color gamut 632. The surrounding area is an enlarged view.) All the pixels of the color 627 before conversion in the part are replaced with the same color 628 as the detected color 524, and the closest color 536 in the color gamut is obtained (FIG. 13).
The divided image management unit 253 confirms that the storage of the images after color conversion has been completed for all the parts, and the part combining unit 258 combines the parts (S312) and stores them as one image (S313).

  By performing such processing, color conversion for the color gamut of each part is performed, and even when the ground color of the projection target is composed of multiple colors, the difference in ground color is automatically detected and color conversion is performed. Therefore, in the present embodiment, the same color can be expressed when a single color image is projected to a place where a plurality of ground colors of the projection target are configured.

In the embodiment described above, in the case of acquiring an image of a photographing target, a means for acquiring partial image information may be provided.
Thereby, color conversion can be performed while creating a design image.
In addition, when the out-of-gamut determination (S303, NO) is issued in step S303 in FIG. 15, a means for leaving the reason for the out-of-gamut determination and the processing result as a history may be provided. Thereby, it is possible to eliminate duplicate processing such as time for color conversion processing occurring in related parts as well as parts determined to be out of the color gamut, and to shorten processing time.
Furthermore, the projection object used in the present embodiment may have a three-dimensional shape, or may have a two-dimensional shape such as a wall surface.

  DESCRIPTION OF SYMBOLS 1 ... Measurement camera, 101 ... Image acquisition part, 102 ... Luminance measurement part, 2 ... Illumination system, 201 ... Image analysis part, 202 ... Luminance analysis part, 203 ... Projection management unit, 204 ... color gamut acquisition projection management unit, 205 ... coordinate detection unit, 206 ... coordinate registration unit, 207 ... parts color gamut management unit, 208 ... storage medium, 209 ..Part color gamut generation unit, 251... Design creation unit, 252... Design image division unit, 253... Divided image management unit, 254. Conversion unit, 256... Approximate color detection unit, 257... Related part search unit, 258.

JP 2008-67080 A

Claims (9)

Color information acquisition means for acquiring color information of the projection object from a captured image of the projection object obtained by projecting the projection image;
Color conversion means for changing the color value of the projection image data based on the color information of the projection object acquired by the color information acquisition means;
When the color value of the projection image data is an out-of-gamut color value that is outside the color gamut that can be projected in the area of the projection object, an approximate color value that is close to the out-of-gamut color value within the color gamut that can be projected. An approximate color detection means for detecting,
When the projection image data includes an out-of-gamut color value, the color conversion unit performs color conversion by replacing the out-of-gamut color value of the projection image data with the approximate color value. The projection device according to claim 1,
Based on the color information of the projection object acquired by the color information acquisition means, having a color gamut generation means for generating a color gamut for each part according to the ground color of the projection object;
The projection apparatus according to claim 1, wherein the approximate color detection unit determines whether or not the color gamut can be projected based on each color gamut. The projection apparatus according to claim 2, wherein
Regarding a color value determined to be out of the color gamut by the approximate color detection unit, only a part whose color value is affected by the color value is replaced with the approximate color value. The projection apparatus according to claim 2 or 3,
The projection apparatus characterized in that the color conversion means performs color conversion on a color value of the projection image data based on a color gamut for each part. The projection apparatus according to any one of claims 2 to 4,
The color gamut generation means generates the color gamut based on the luminance of the image projected onto the projection object and the color difference between the image projected onto the projection object and the projection image. apparatus. The projection apparatus according to claim 5, wherein
Storage means for storing color gamut data generated by the color gamut generation means is provided, and when the color difference is smaller than a predetermined threshold, it is determined that the hue is the same, and the same color gamut is stored in the storage means. If so, the projection apparatus is characterized in that the color gamut data is not stored. A projection device for projecting an image;
A color information acquisition device that acquires color information of the projection object from a captured image of the projection object obtained by projecting the projection image;
Based on the color information of the projection object acquired by the color information acquisition device, color conversion means for changing the color value of the projection image data, and the color value of the projection image data is in the region of the projection object In the case of an out-of-gamut color value that is out of the projectable color gamut, an illumination system having approximate color detection means that detects an approximate color value of a color value close to the out-of-gamut color value in the projectable color gamut, The color conversion means, when the projection image data includes an out-of-gamut color value, replaces the out-of-gamut color value of the projection image data with the approximate color value, and performs the color conversion, and
An image projection system comprising: An image projection method in a projection device, comprising:
A color information acquisition step of acquiring color information of the projection object from a captured image of the projection object obtained by projecting the projection image;
A color conversion step of changing the color value of the projection image data based on the color information of the projection object acquired in the color information acquisition step;
When the color value of the projection image data is an out-of-gamut color value that is outside the color gamut that can be projected in the area of the projection object, an approximate color value that is close to the out-of-gamut color value within the color gamut that can be projected. An approximate color detection step to detect;
In the color conversion step, when the projection image data includes an out-of-gamut color value, the color conversion is performed by replacing the out-of-gamut color value of the projection image data with the approximate color value. Image projection method. The computer of the projection device,
Color information acquisition means for acquiring color information of the projection object from a captured image of the projection object obtained by projecting the projection image;
Color conversion means for changing the color value of the projection image data based on the color information of the projection object acquired by the color information acquisition means;
When the color value of the projection image data is an out-of-gamut color value that is outside the color gamut that can be projected in the area of the projection object, an approximate color value that is close to the out-of-gamut color value within the color gamut that can be projected. Function as an approximate color detection means to detect,
When the projection image data includes an out-of-gamut color value, the color conversion unit performs color conversion by replacing the out-of-gamut color value of the projection image data with the approximate color value.

Images