JP7228112B2 - PROJECTION CONTROL DEVICE, PROJECTION DEVICE, PROJECTION METHOD AND PROGRAM - Google Patents

Description

The present invention relates to a projection control device, a projection device, a projection method and a program.

In a projection device that projects a color image, there have been proposed techniques for displaying the image projected by the projection device in the correct color and shape when the projection surface such as a wall has color, pattern, distortion, etc. (for example, Patent document 1).

JP 2007-259472 A

In order to accurately grasp the color reproduction state in the projection range of the projection device and correct the projected image, including the technology described in the above patent document, the color information of the image projected on the projection surface by the projection device is obtained. It is necessary to provide a means for acquiring (a color sensor in the case of Patent Document 1). In this case, if the position of the projection device and the position of the viewer of the projection image are different, it may be difficult to correct the image by reflecting the position of the viewer even if the projection device captures the projection image.

Therefore, as a means for accurately acquiring color information of an image, a separate photographing device such as a digital camera used by the user of the projection device can be considered. If the color correction of the projection device can be executed by photographing the projected image with a general digital camera, the initial setting of the projection device can be easily and accurately achieved.

However, in order to correct an image more accurately, a plurality of image patterns for correction including shape correction of a projected image in addition to color correction are continuously projected by a projection device, and the plurality of image patterns are projected in succession. An image pattern must be captured by a digital camera. If these projected images are shot with a handheld digital camera, the shooting position of the digital camera itself is not stable, and camera shake may occur.

Therefore, it becomes difficult to accurately detect the range projected by the projection device in the captured images that are continuously obtained. Although there is a method of fixing the digital camera on a tripod or the like in order to accurately photograph the projected image, the time and effort required for the initial setting become complicated.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a projection control apparatus, a projection apparatus, a projection method, and a program with improved robustness capable of projecting a clear projection image without discomfort regardless of the projection target.

The projection control apparatus of the present invention comprises a first correcting image comprising a measurement image used for correcting a projected image and a plurality of marker images for image position identification that differ in at least one of color, size, shape, and orientation. storage means for storing an image; projection control means for causing projection means to project the first correction image stored in the storage means onto a projection target; and the first correction image projected onto the projection target a marker determining means for determining a marker image to be used for correcting the projected image from the plurality of marker images by receiving the photographed image and analyzing the marker image; and the measuring image and the marker determining means are different from each other pattern generation means for generating a plurality of second correction images based on the marker image determined by the above ; The positions of the marker images determined by the marker determining means in the photographed image of are matched, and the correction information of the projection image is obtained using each measurement image included in the photographed images of the plurality of second correction images. and generating means for generating.

A projection apparatus of the present invention is characterized by comprising the above-described projection control apparatus and projection means.

The projection method of the present invention comprises a measurement image used for correcting the projection image, and a plurality of marker images for image position identification that differ in at least one of color, size, shape, and orientation, and are stored in a storage means. a projection step of projecting a first correction image onto a projection target by a projection means; a marker determination step of determining a marker image to be used for correcting the projected image from the marker images of the marker images; receiving a plurality of photographed images of the second correction image projected onto the projection target, and markers used for the correction in the plurality of photographed images; a generation step of matching the positions of the images and generating correction information of the projection image using each of the measurement images included in the captured images of the plurality of second correction images;
characterized by comprising

The program of the present invention is a program executed by a computer, wherein at least one of color, size, shape, and orientation is different from the measurement image used for correcting the projection image stored in the storage means. a plurality of marker images for image position identification, projection control means for projecting a first correction image stored in a storage means onto a projection target by a projection means, and the first correction projected onto the projection target. marker determination means for determining a marker image to be used for correcting the projection image from the plurality of marker images by receiving a photographed image of the measurement image and analyzing the marker image; and the measurement image and the marker determination are different from each other pattern generating means for generating a plurality of second correction images based on the marker image used for the correction determined by the means; and generating a plurality of captured images of the second correction images projected onto the projection target. In addition to receiving, matching the positions of the marker images used for the correction in the plurality of captured images, and using each measurement image included in the captured images of the plurality of second correction images to obtain correction information of the projected image. It is characterized by functioning as generating means for generating

According to the present invention, it is possible to provide a projection control apparatus, a projection apparatus, a projection method, and a program with improved robustness capable of projecting a clear projection image without discomfort regardless of the projection target.

1 is a schematic diagram of a projection system according to an embodiment of the invention; FIG. 1 is a diagram showing the configuration of a projection system according to an embodiment of the present invention; FIG. FIG. 4 is a diagram showing measurement images according to an embodiment of the present invention, where (a) to (c) are measurement images for color correction of the projected image, and (d) to (f) are for shape correction of the projected image. This is a measurement image for It is a figure which shows the structure of the marker which concerns on embodiment of this invention. It is a flowchart figure of the marker determination program which concerns on embodiment of this invention. 4 is a flowchart of marker analysis in the marker determination program according to the embodiment of the present invention; FIG. FIG. 4 is a diagram showing an example of a correction image according to the embodiment of the present invention; FIG. FIG. 4 is a diagram showing an example of a correction image according to the embodiment of the present invention; FIG.

A mode for carrying out the present invention will be described below. FIG. 1 is a diagram showing an outline of a projection system 1. As shown in FIG. The projection system 1 includes a projection device 10 (projection control device) that projects an image onto a projection plane 26 of a projection target 25 such as a curtain or a wall, and a digital camera or camera-equipped mobile phone that captures the image projected onto the projection plane 26 . and a photographing device 20 such as a telephone. Note that the photographing device 20 may be a portable digital device with an image input function, such as a video camera, a smart phone (high-performance mobile phone), a tablet terminal, or the like. In this embodiment, the projection object 25 is a curtain. The projection target 25 is suspended from a rail (not shown) or the like, and has a wave-like undulation mainly on the surface along the lateral direction. Colors and patterns are formed on the projection plane 26 .

The projection device 10 is arranged at a position different from that of the imaging device 20 . The projection device 10 in FIG. 1 is arranged on the left side of the projection plane 26 and projects an image from an oblique direction. The photographing device 20 is arranged at a position where the user views the image projected on the projection plane 26 , such as substantially in front of the projection plane 26 . Therefore, the image captured by the image capturing device 20 and the image visually recognized by the user can be configured so that the angle of view is approximately the same. The imaging device 20 may be held by a user.

An overview of the operation of the projection system 1 will be described. The projection image projected by the projection device 10 is affected by the shape, pattern, etc. of the projection surface 26 and the difference between the projection direction of the projection device 10 and the line-of-sight direction of the user. From this point of view, it is observed in a different color and shape from the original image data. Therefore, in the present embodiment, the projection control unit 100 corrects the image data so that the user can preferably visually recognize the projected image from the user's viewpoint. The image data is corrected by projecting a later-described correction image 70 onto the projection surface 26 by the projection device 10 and photographing the projected correction image 70 by the photographing device 20 . The imaging device 20 transmits the captured image including the correction image 70 to the projection device 10 via the wired or wireless communication unit 400 . The projection device 10 corrects the image data based on the received correction image 70 of the captured image. In this manner, the projection device 10 can project an image such that the image data is viewed in an intended manner by the user, who is an observer.

FIG. 2 is a diagram showing the configuration of the projection system 1. As shown in FIG. The projection apparatus 10 includes a projection control section 100 as projection control means, a projection section 200 as projection means, and a storage section 300 as storage means. The projection control unit 100 includes an image processing unit 110 and an image correction unit 120 that receive image data 50 of a projected image, and detection means that receives a captured image from the imaging device 20 via a wired or wireless communication unit 400 and performs marker detection. a measuring unit 130 as marker determining means for determining a marker image to be used for correcting a projected image; A pattern generator 140 is provided as projection condition determining means. The projection unit 200 also includes a light source 210 , a projection element 220 and a projection lens 230 .

The projection control unit 100 can be configured as a program stored in the storage unit 300 and executed by a computer (not shown) included in the projection apparatus 10 . The video processing unit 110 of the projection control unit 100 processes the viewing image data 50 sent from a personal computer (not shown) or a USB memory connected to the projection device 10 at a frame rate according to a predetermined format. Generate image data for projection. The image correction unit 120 receives the image correction information from the measurement unit 130, corrects the image data for projection from the image processing unit 110, and drives the projection element 220 of the projection unit 200 for display.

The measurement unit 130 of the projection control unit 100 analyzes the captured image including the correction image 70 captured by the imaging device 20, and generates image correction information and the like. The pattern generation unit 140 generates a correction image 70 including a measurement image 30 to be used for correcting the projected image and a plurality of marker images 40 for image position identification, which are stored in the storage unit 300 . The projection element 220 of the projection unit 200 is driven to display.

The light source 210 of the projection unit 200 has an LED or LD (laser diode), which is a semiconductor light emitting element, and irradiates the projection element 220 with light from the red, green, and blue wavelength bands. A DMD (digital micromirror device) is used for the projection element 220, and by time-divisionally displaying red, green, and blue wavelength band light according to the image data to be projected, the projection target is projected through the projection lens 230. 25 can project a color image. Note that the projection device 220 may be of another type such as a liquid crystal projector.

The storage unit 300 is configured by, for example, an SSD (Solid State Drive) or SRAM (Static Random Access Memory). The storage unit 300 stores the correction image 70 and control programs for the projection control unit 100 and the like.

Next, the measurement image 30 stored in the storage unit 300 of the projection device 10 will be described with reference to FIG. The image for measurement 30 can be a rectangular image having an aspect ratio according to the projection mode, and in this figure, the entire image has a horizontally long rectangular shape.

3A to 3C are measurement images 31, 32, and 33 for color correction of projected images. The measurement images 31, 32, and 33 are a black measurement image 31, a gray measurement image 32, and a white measurement image 33 in which the substantially entire measurement region 30a is black, gray, and white, respectively. The projection device 10 projects the measurement images 31, 32, and 33 together with a plurality of marker images 40, which will be described later, onto the projection plane 26, causes the imaging device 20 to shoot the images, and causes the projection control unit 100 (measurement unit 130) to project the measurement images 31, 32, and 33 onto the projection plane 26. A pattern formed on 26 and a change in color caused by distortion of the projection plane 26 are detected.

3D to 3F are measurement images 34, 35, and 36 for distortion correction (shape correction) of the projection image projected onto the projection object 25. FIG. Each of the measurement images 34, 35, and 36 has a checkered pattern in which substantially square white rectangles and black rectangles are alternately arranged in the vertical and horizontal directions on the substantially entire measurement area 30a. An image 34 for measurement, an image 35 for measurement with a medium-sized checkered pattern, and an image 36 for measurement with a small-sized checkered pattern were used. The projection control unit 100 (measuring unit 130) can detect the distortion of the projection plane 26 with different resolutions depending on the sizes of the checkered patterns in the measurement images 34, 35, and 36. FIG. The projection device 10 projects the measurement images 34, 35, and 36 together with a plurality of marker images 40, which will be described later, onto the projection surface 26, causes the imaging device 20 to photograph them, and causes the projection control unit 100 (measurement unit 130) to project the measurement images 34, 35, and 36 onto the projection surface. 26 to detect the distortion of the whole. At this time, the square corners of the checkered measurement images 34, 35, and 36 of different sizes are positioned so as not to overlap each other during projection.

Next, a plurality of marker images 40 for image position identification, which are stored in the storage unit 300, will be described with reference to FIG. The plurality of marker images 40 are projected onto the projection surface 26 as the correction image 70 together with the measurement image 30 described above, and captured by the imaging device 20 . A plurality of photographed images including the correction image 70 of the photographing device 20 are analyzed by the measurement unit 130 . At this time, the measurement unit 130 analyzes the measurement image 30 by aligning the positions of the marker images 40 detected in the plurality of captured images. Such a plurality of marker images 40 for image position identification are formed to differ in at least one of color, size, shape, and orientation.

Specifically, the marker images 41-1, 41-2, 41-3 and 41-4 are formed in a rectangular shape, and the marker images 42-1, 42-2, 42-3 and 42-4 are formed in a rectangular shape. , and round shapes are superimposed at the center, respectively, and the marker images 43-1, 43-2, and 43-3 are shapes in which a square shape and a triangular shape are respectively superimposed at the center. The marker images 41-3, 42-2 and 43-1 have a white background, the marker images 41-1, 41-2 and 43-3 have a green background, and the marker images 43-2 and 41- 4 and 42-4 have a red background, and the marker images 42-1 and 42-3 have a blue background. Also, all the marker images 40 have different sizes. Further, the plurality of marker images 40 are arranged in different directions and positions in the measurement area 30a of the measurement image 30. As shown in FIG.
Of course, the shape of the marker image 40 is not limited to the above example, and various shapes may be used.

Next, the correction of the projected image by the projection device 10 will be described. In this embodiment, the projection image is corrected by first performing shape correction and then performing color correction. Alternatively, color correction may be performed first. As shown in FIG. 5, first, in step S101, the pattern generation unit 140 generates and projects the first correction image 71 according to the instruction from the measurement unit 130 . The correction image 71 is stored in the storage section 300 . In step S101, as shown in FIG. 7, a large checkered measurement image 34 (see FIG. 3D) is superimposed on all the marker images 40 in FIG. 4 as the first correction image 71. An image is projected. Next, in step S<b>105 , the correction image 71 projected onto the projection surface 26 is captured by the imaging device 20 and this captured image is transmitted to the measurement unit 130 via the communication unit 400 . In the next step S110, the photographed image transmitted in step S105 is analyzed, and the marker image 40 to be used for image position identification is determined from among the plurality of marker images 40. FIG.

Determination of the marker image 40 is performed according to the flowchart of FIG. First, in step S201, the captured image is grayscaled. Then, in step S205, the grayscaled photographed image is binarized. In step S201 or step S205, each process can be performed with priority given to a predetermined parameter. The predetermined parameter can be arbitrarily selected from the color, size, shape, orientation, and position of the marker image 40 in this embodiment. For example, when priority is given to red for "color" as a predetermined parameter, only the red marker images 43-2, 41-4, and 42-4 are extracted from the captured image, and the process of step S201 or step S205 is performed. be able to. Note that processing using a predetermined parameter may be performed in either step S201 or step S205.

In the next step S210, contour extraction is performed on the binarized photographed image. In the contour extraction process, for example, a boundary between a black image and a white image in a binarized image, which is a closed region, is detected as a contour. Then, in step S215, the marker image 40 in the image is identified from the detected contour, and candidates for the marker image 40 used for image position identification are listed. Then, in step S220, the enumerated candidate marker images 40 are analyzed, and marker images 40 that are regarded as error values and are difficult to use for image position identification are removed. The error value can set the accuracy of the shape of the marker image 40 with a predetermined threshold.

Thus, for example, if one or more marker images 40 remain, the process of determining the marker images 40 ends (step S225). If the marker image 40 that can be used for image position identification cannot be obtained, the process returns to step S201, and grayscale processing (step S201) or binarization (step S205) is performed by changing the predetermined priority parameter. conduct. For example, if the marker image 40 that can be used for image position identification cannot be determined even if the color is prioritized as a predetermined parameter and the processing is performed, then the shape is prioritized and grayscaled (step S201). Alternatively, binarization (step S205) can be performed.

In addition, even if contour extraction (step S210) is performed on the marker images 43-2, 41-4, and 42-4 with priority given to red as a predetermined parameter, an error occurs (step S220) and the image position is identified. If the marker image 40 that can be used for the purpose cannot be determined, the contour extraction is performed on the marker images 41-1, 41-2, 41-3, and 41-4 with priority given to the rectangular shape as the predetermined parameter. can be processed. In this way, the color, size, shape, orientation, and position are sequentially determined with the given priority parameters, so that the marker image 40 that can be used for identifying the image position can be determined. As for the marker image 40, if at least one marker image 40 can be detected, the image position can be identified. is improved, the correction accuracy of the projected image is improved.

Here, it is assumed that the red marker images 43-2, 41-4, and 42-4 are determined as the marker images 40 for image position identification in step S225 of FIG. Returning to FIG. 5, when the marker images 40 (marker images 43-2, 41-4, 42-4) that can be used for image position identification are determined by analyzing the first correction image 71 in step S110, , in step S115, the projection device 10 projects the second and subsequent correction images 72 . As shown in FIG. 8, the second correction image 72 generated by the pattern generation unit 140 includes marker images 43-2, 41-4, and 42-4 for image position identification determined by the measurement unit 130. , and a medium-sized checkered measurement image 35 (see FIG. 3(e)) is superimposed and formed. This correction image 72 is stored in the storage unit 300 . Then, in step S<b>120 , the projected correction image 72 is photographed by the photographing device 20 . In this manner, the third and subsequent correction images 70 are formed by the determined marker images 43-2, 41-4, and 42-4 for image position identification and the measurement images 36, 31, 32, and 42-4. 33 are overlapped and stored in the storage unit 300 . That is, the pattern generator 140 determines projection conditions for the image projected by the projector 200 based on the marker image 40 determined by the measurement unit 130 . Accordingly, the correction images 70 formed by determining the projection conditions are sequentially projected and photographed by the photographing device 20 in sequence. In this embodiment, the image captured by the image capturing device 20 is a correction image 70 formed from the measurement images 31, 32, 33, 34, 35, and 36 and the marker images 43-2, 41-4, and 42-4. , resulting in a total of six images.

In addition to the above, the generation of the second and subsequent correction images 70 can be performed as follows. That is, the storage unit 300 stores in advance six correction images 70 formed by superimposing each of the measurement images 31 to 36 and the plurality of marker images 40 in FIG. After the processing of steps S201 to S225 in FIG. 6 is performed and the marker image 40 to be used for correcting the projection image is determined by the correction image 70 projected on the first sheet, the correction image 70 projected on the second and subsequent sheets is determined. , the area where the marker image 40 that could not be detected (the marker image 40 other than the marker images 43-2, 41-4, and 42-4 in the example of FIG. 4) is arranged by the image processing means provided in the measurement unit 130. It is also possible to generate the second and subsequent correction images 70 (for example, the correction image 72 in FIG. 8) by changing the area of the measurement image 30 (35).

In step S125, image correction information for correcting the shape and color of the projected image is generated by the measurement unit 130 based on each measurement image 30 of each correction image 70 in the six captured images. Image correction information is obtained by matching the marker images 40 of a plurality of correction images 70 captured by the imaging device 20 and analyzing each measurement image 30 . Therefore, even a photographed image in which camera shake occurs can be used for correcting a projected image. That is, in the shape correction of the projected image, the positions of the marker images 40 in each of the captured images obtained by capturing the three correction images 70 including the measurement images 34, 35, and 36 for shape correction are matched, The degree of distortion of each measurement image 34, 35, 36 can be obtained by detecting the coordinates of the intersection of the checkered pattern of each measurement image 34, 35, 36 of each captured image. In addition, in the color correction of the projected image, the position of the marker image 40 in each photographed image is similarly matched, and the black, gray, and white colors at the coordinates of the projection element 220 specified by the checkered measurement images 34, 35, and 36 are displayed. By measuring the light intensities of the measurement images 31, 32, and 33, the light intensities of red, green, and blue, which are the target values for the coordinate positions, are obtained. In this way, image correction information for the projected image regarding shape and color is generated. Then, in step S130, the generated image correction information is transmitted to the video correction unit 120. FIG. Then, the video correction unit 120 corrects the projection image based on the image data, and projects the corrected projection image by the projection unit 200 .

Although the embodiments of the present invention have been described above, the present invention is not limited to the embodiments and can be implemented in various forms. For example, the arrangement of the plurality of marker images 40 shown in FIG. 4 is performed by arranging the marker images 40 having a high detection rate from the accumulated plurality of past detection results at the four corners of the measurement area 30a of the measurement image 30, and performing detection. Other marker images 40 with lesser percentages can be placed on the sides or in the center of the measurement area 30a. As a result, the marker images 40, which are unnecessary for the analysis of the measurement image 30, are placed at the four corners as much as possible to improve the accuracy of image correction near the center of the projection plane 26 for the projection object 25, which does not have a complicated pattern or shape. On the other hand, it is possible to perform image correction using various marker images 40 for the projection object 25 that has many patterns that may be confused with the marker image 40 or has a complicated shape.

Further, only the marker images 40 determined for image position identification in step S225 of FIG. 6 are used for the second and subsequent correction images 70. However, as in this embodiment, the unused marker image 40 is removed from the second and subsequent correction images 70 to reduce noise and correct color and shape. The effect of expanding the display range of the image can be expected. Also, when there are many marker images 40 determined for image position identification in step S225 of FIG. For example, it is possible to leave only the marker images 40 close to the four corners of the measurement area 30a, or leave only the small marker images 40.

Further, in the present embodiment, the projection device 10, which is the device itself, is exemplified to have the measurement unit 130, but the present invention is not limited to this. The projection control unit 100 communicates with an external device (e.g., the imaging device 20) having the measuring unit 130 via the communication unit 400, thereby detecting the marker image detected by the external device having detection means for detecting the marker image 40. may be configured to acquire information on the detection result of
By configuring in this way, the load of control processing performed by the projection control unit 100 of the projection apparatus 10 can be reduced.

As described above, the projection device 10 as the projection control device according to the embodiment of the present invention provides an image position that differs from the measurement image 30 used for correcting the projected image by at least one of color, size, shape, and orientation. A storage unit (storage unit 300) for storing a correction image 70 including a plurality of identification marker images 40, and a projection unit (projection unit 200) for projecting the correction image 70 stored in the storage unit (projection unit 200). A projection control means (projection control unit 100) for projecting onto an object 25) and a marker image 40 to be used for correcting the projection image are determined from a plurality of marker images 40 of the correction image 70 projected onto the projection object 25. Marker determining means (measuring part 130) and projection condition determining means (pattern generating part 140) for determining projection conditions of an image projected by the projecting means based on the marker image 40 determined by the marker determining means . Accordingly, it is possible to provide the projection apparatus 10 with improved robustness capable of projecting a beautiful projection image without a sense of discomfort regardless of the pattern or color applied to the projection object 25 .

Further, the marker determining means determines the marker image 40 of the second or subsequent correction image 72 to be projected next using the marker image 40 detected from the previously projected correction image 71 which is the first sheet. . As a result, the processing time for the second and subsequent correction images 70 can be shortened.

Further, the marker determining means determines a marker image to be used for correcting the projected image from the marker image detected by the detecting means provided in the own device (projecting device 10) or an external device (imaging device 20). Accordingly, if one of the self-device and the external device is provided with this detection means, the other device can be a general-purpose device.

Further, the marker determination means includes image processing means for changing the area where the marker image 40 that could not be detected from the projected correction image 70 is arranged to the area of the measurement image 30 . As a result, the marker image 40 that cannot be detected can be eliminated, and the area of the measurement image 30 that contributes to the correction of the projection image can be expanded.

Also, the marker determining means detects the marker image 40 with priority given to a predetermined parameter. This predetermined parameter can be the color, size, or other shape, orientation, and position of the marker image 40 . As a result, the detection processing time of the marker image 40 by the marker determining means can be shortened. If the predetermined parameter with priority is color, when the pattern of the projection object 25 is close to the marker image 40 and it is difficult to detect the marker image 40 (outline extraction), the projection object 25 pattern can be reduced. For example, in the case of a red and white screen, the red component is reflected both in the white part and the red part, so by projecting red and looking at the red plane, the influence of the pattern on the screen can be reduced. Also, by giving priority to the size, for example, if the marker image 40 is large, folds or patterns of the screen may enter the inside of the marker image 40, and extra lines may be detected. It is preferable to give priority to the marker image 40 of . Conversely, if the marker image 40 is small, the straight line of the marker image 40 is too short to be detected, or the marker image 40 itself may be crushed. preferred.

Further, the projection device 10 can also be configured to include a projection unit 200 as projection means and a projection control device. This allows the projection system 1 to be configured in various ways.

Moreover, the projection method by the projection device 10 includes a measurement image 30 used for correcting the projected image, and a plurality of marker images 40 for image position identification that differ in at least one of color, size, shape, and orientation. A projection step of projecting a correction image 70 stored in a storage unit onto a projection target (projection target 25) by a projection unit (projection unit 200), and a plurality of marker images 40 of the correction image 70 projected onto the projection target. a marker determination step of detecting the marker image 40 used for correcting the projected image from the marker determination step; and a projection condition determination step of determining the projection condition of the image projected by the projection means based on the marker image 40 determined in the marker determination step. , provided. As a result, it is possible to provide a robust projection method capable of projecting a clear and beautiful projection image regardless of the pattern or color applied to the projection target 25 .

Further, the computer-executed program causes the projection device 10 (computer) to generate a plurality of image position identification images different from the measurement image 30 used for correcting the projected image, at least one of color, size, shape, and orientation. a marker image 40, and a projection control means for projecting a correction image 70 stored in a storage means (storage unit 300) onto a projection target (projection target 25) by a projection means; marker determination means for determining a marker image to be used for correction of the projected image from a plurality of marker images 40 of the projected correction image 70; It functions as projection condition determination means (image correction unit 120) that determines projection conditions. Accordingly, it is possible to provide a computer program with improved robustness capable of projecting a beautiful projection image without a sense of discomfort regardless of the pattern or color applied to the projection object 25 .

It should be noted that the embodiments described above are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the scope of the invention described in the claims and its equivalents.

Below, the invention described in the first claim of the present application is added.
[1] storage means for storing a correction image composed of a measurement image used for correcting a projected image and a plurality of marker images for image position identification that differ in at least one of color, size, shape, and orientation;
projection control means for projecting the correction image stored in the storage means onto a projection target;
marker determination means for determining a marker image to be used for correcting the projection image from the plurality of marker images of the correction image projected onto the projection target;
projection condition determination means for determining projection conditions for the image projected by the projection means based on the marker image determined by the marker determination means;
A projection control apparatus comprising:
[2] The above-described [1], wherein the marker determination means determines the marker image of the correction image to be projected next by using the marker image detected from the correction image projected last time. projection control device.
[3] The marker determining means determines a marker image to be used for correcting the projected image from marker images detected by a detecting means provided in the device itself or an external device.
The projection control apparatus according to [1] or [2], characterized by:
[4] The above [ The projection control apparatus according to any one of 1] to [3].
[5] The projection control apparatus according to any one of [1] to [4], wherein the marker detection means detects the marker image with priority given to a predetermined criterion.
[6] The projection control apparatus according to [5], wherein the predetermined reference is the color of the marker image.
[7] The projection device according to [5], wherein the predetermined criterion is the size of the marker image.
[8] the projection control apparatus according to any one of [1] to [7];
projection means;
A projection device comprising:
[9] A correction image stored in a storage means, comprising a measurement image used for correcting a projected image and a plurality of marker images for image position identification that differ in at least one of color, size, shape, and orientation. a projection step of projecting onto a projection target by a projection means;
a marker determination step of determining a marker image to be used for correcting the projection image from the plurality of marker images of the correction image projected onto the projection target;
a projection condition determination step of determining projection conditions for an image projected by the projection means based on the marker image determined in the marker determination step;
A projection method comprising:
[10] A program executed by a computer, comprising:
A measurement image used for correcting the projection image stored in the storage means, and a plurality of marker images for image position identification that differ in at least one of color, size, shape, and orientation, and are stored in the storage means. projection control means for projecting the correction image onto the projection target by the projection means;
marker determination means for determining a marker image to be used for correcting the projection image from the plurality of marker images of the correction image projected onto the projection target;
projection condition determination means for determining projection conditions for the image projected by the projection means based on the marker image determined by the marker determination means;
A program characterized by functioning as

1 projection system 10 projection device 20 imaging device 25 projection object 26 projection planes 30 to 36 measurement image 30a measurement regions 40, 41-1 to 4, 42-1 to 4, 43-1 to 3 marker image 50 image data 70 , 71, 72 correction image 100 projection control unit 110 image processing unit 120 image correction unit 130 measurement unit 140 pattern generation unit 200 projection unit 210 light source 220 projection element 230 projection lens 300 storage unit 400 communication unit

Claims (10)

storage means for storing a first correction image comprising a measurement image used for correcting the projected image and a plurality of marker images for image position identification that differ in at least one of color, size, shape, and orientation;
projection control means for causing projection means to project the first correction image stored in the storage means onto a projection target;
marker determination means for determining a marker image to be used for correcting the projection image from the plurality of marker images by receiving the photographed image of the first correction image projected onto the projection target and analyzing the marker image; and,
pattern generation means for generating a plurality of second correction images based on the different measurement images and the marker images determined by the marker determination means;
receiving a plurality of photographed images of the second correction image projected onto the projection target , matching the positions of the marker images determined by the marker determining means in the plurality of photographed images, and obtaining a plurality of the second correction images; generating means for generating correction information for the projection image using each measurement image included in the photographed image of the correction image;
A projection control apparatus comprising: 2. The apparatus according to claim 1, wherein the marker determination means determines the marker image detected from the first correction image projected last time as the marker image to be used in the second correction image projected next. A projection control device as described. The marker determination means determines a marker image to be used for correcting the projection image from the marker image detected by the detection means provided in the device itself or an external device.
3. The projection control apparatus according to claim 1, wherein: 4. The marker determining means comprises image processing means for changing an area in which the marker image, which could not be detected from the projected correction image, is arranged to an area of the measurement image. A projection control apparatus according to any one of . 5. The projection control apparatus according to any one of claims 1 to 4, wherein said marker determination means determines said marker image with priority given to a predetermined criterion. 6. A projection control apparatus according to claim 5, wherein said predetermined reference is the color of said marker image. 6. The projection control apparatus according to claim 5, wherein said predetermined criterion is the size of said marker image. a projection control apparatus according to any one of claims 1 to 7;
projection means;
A projection device comprising: A first correction image stored in a storage means, comprising a measurement image used for correcting the projected image and a plurality of marker images for image position identification that differ in at least one of color, size, shape, and orientation. a projection step of projecting onto a projection target by a projection means;
a marker determination step of determining a marker image to be used for correcting the projection image from the plurality of marker images by receiving a photographed image of the first correction image projected onto the projection target and analyzing the marker image; and,
a pattern generation step of generating a plurality of second correction images each based on the different measurement images and the marker images used for the correction determined in the marker determination step;
receiving a plurality of captured images of the second correction image projected onto the projection target, matching positions of the marker images used for the correction in the plurality of captured images, and obtaining a plurality of the second correction images; a generation step of generating correction information for the projection image using each measurement image included in the captured image of the image;
A projection method comprising: A program executed by a computer, the computer comprising:
A measurement image used for correcting the projection image stored in the storage means, and a plurality of marker images for image position identification that differ in at least one of color, size, shape, and orientation, and are stored in the storage means. projection control means for projecting a first correction image onto a projection target by projection means; marker determination means for determining a marker image to be used for correcting the projected image from the marker image;
pattern generation means for generating a plurality of second correction images based on the different measurement images and the marker images used for the correction determined by the marker determination means;
receiving a plurality of captured images of the second correction image projected onto the projection target, matching positions of the marker images used for the correction in the plurality of captured images, and obtaining a plurality of the second correction images; generation means for generating correction information for the projection image using each measurement image included in the captured image of the image;
A program characterized by functioning as

Images