JP2021141347A - Information processing device, information processing method, and program - Google Patents

Abstract

To make it easy to obtain an appropriate amount of correction based on how a user sees.SOLUTION: An information processing device is used to project a test image in which a pattern for detection composed of a plurality of pattern elements that has previously undergone correction processing of varying degrees is arranged. By allowing a user to select a pattern element that appears to cause no degradation in image quality, it is possible to easily set an appropriate amount of correction based on how the user sees the image. The present technology can be applied to information processing devices that control the projection of projectors.SELECTED DRAWING: Figure 8

Description

The present technology relates to information processing devices, information processing methods, and programs, and in particular, information processing devices, information processing methods, and programs that enable the user to easily obtain an appropriate correction amount based on the appearance of the user. Regarding.

Due to the influence of ambient light and the color of the projection surface, the color reproducibility of the projected image of the projector may deteriorate. Various adjustments are required to obtain the intended color.

There is a technology that automatically adjusts the projector without human intervention. For example, in Patent Document 1, a white or gray test pattern is projected, and the RGB ratio of the image obtained by taking a picture with a camera is used as an evaluation value, and adjustment is repeated so that the evaluation value falls within the target range. The technology to be performed is disclosed.

Japanese Unexamined Patent Publication No. 2006-109380

In the above technique, a camera for capturing a test pattern is required.

Further, due to the influence of the characteristics of the optical system such as a lens and the characteristics of the imaging system such as the sensitivity of the sensor, the color of the captured image and the color of the image actually viewed by the user may be different. In this case, an inappropriate adjustment value is required based on the user's appearance.

Furthermore, since the procedure of changing the RGB value and shooting the projected image is repeated, it takes time to complete the adjustment.

The present technology has been made in view of such a situation, and makes it possible to easily obtain an appropriate correction amount based on the appearance by the user.

The information processing device on one aspect of the present technology includes a projection control unit that projects a test image in which a detection pattern composed of a plurality of pattern elements that have been subjected to correction processing of different degrees in advance is arranged.

In one aspect of the present technology, a test image is projected in which a detection pattern composed of a plurality of pattern elements that have been subjected to correction processing of different degrees in advance is arranged.

According to the present technology, it is possible to easily obtain an appropriate correction amount based on the appearance by the user.

The effects described here are not necessarily limited, and may be any of the effects described in the present disclosure.

It is a figure which shows the structural example of the projection system which concerns on one Embodiment of this technique. It is a flowchart explaining the correction process. It is a flowchart explaining other correction processing. It is a figure which shows the example of the test image for color shift detection. It is a figure which shows the detection pattern of FIG. 4 in an enlarged manner. It is a figure which shows the example of the correction block which constitutes the detection pattern. It is a figure which shows an example of the change of appearance by an environment. It is a figure which shows the example of the actual appearance of a correction block. It is a figure which shows the example of the test image for spatial resolution deterioration detection. FIG. 9 is an enlarged view showing the detection pattern of FIG. 9. It is a figure which shows the example of the test image for color shift detection. It is a figure which shows the detection pattern of FIG. 11 in an enlarged manner. It is a block diagram which shows the hardware configuration example of an information processing apparatus. It is a block diagram which shows the functional structure example of an information processing apparatus. It is a figure which shows the configuration example of a projector.

Hereinafter, modes for implementing the present technology will be described. The explanation will be given in the following order.
1. 1. About the projection system 2. About the test image 3. Configuration of each device 4. Modification example

<< About the projection system >>
<Detection of correction amount in projection system>
FIG. 1 is a diagram showing a configuration example of a projection system according to an embodiment of the present technology.

The projection system of FIG. 1 is configured by connecting an information processing device 1 such as a PC and a projector 2. A screen 11 serving as a projection surface is provided in front of the projector 2.

An image of content such as a movie reproduced in the information processing device 1 is output to the projector 2 as a projected image and projected on the screen 11. Instead of the image of the content reproduced in the information processing device 1, the image of the content output from another device such as a mobile terminal or a reproduction device may be projected from the projector 2.

In the projection system of FIG. 1, a test image T, which is an image for detecting a correction amount, is projected before the projection of such a projected image. Although the details will be described later, a detection pattern used for detecting the correction amount is arranged at a predetermined position of the test image T. In the example of FIG. 1, nine detection patterns of 3 × 3 (vertical × horizontal) are arranged.

One detection pattern is composed of a plurality of correction blocks that have been subjected to correction processing of different degrees in advance. Hereinafter, the pre-correction process for generating the correction block constituting the detection pattern is referred to as a pre-correction process.

Each correction block, which is an element constituting the detection pattern, is a block-shaped image having distortion generated by performing pre-correction processing having different variations. The plurality of correction blocks are arranged side by side in an area where it can be assumed that the degree of image quality deterioration is almost the same.

Here, the test image T projected on the screen 11 is affected by the environment such as ambient light and the color of the screen 11 which is the projection surface, so that the original appearance (the appearance of the image in the internal processing) Will be different from.

The correction block constituting the detection pattern includes an image whose image quality deterioration has been canceled due to the influence of such an environment. Further, the correction block constituting the detection pattern includes an image in which the image quality is not canceled and the image quality is deteriorated, and an image in which the image is overcorrected and the appearance is different from the original appearance.

The user selects a correction block that does not appear to have image quality deterioration from the correction blocks constituting the detection pattern arranged on the test image T projected on the screen 11. The information processing device 1 accepts the user's selection of the correction block, and sets the correction amount according to the correction block selected by the user as the correction amount used for the correction of the projected image.

Each correction block is associated with a correction amount used for correction of the projected image. For example, the same correction amount as the correction amount used in the pre-correction process is associated with each correction block.

On the test image T projected on the screen 11, it seems that there is no deterioration in the image quality of a certain correction block, which means that the deterioration in image quality to the extent of canceling the pre-correction processing given to the correction block is shown in FIG. It will occur naturally in the environment of the projection system.

By projecting a test image T containing a plurality of correction blocks that have undergone pre-correction processing of different degrees, and letting the user select a correction block that does not appear to have image quality deterioration, the user's appearance is used as a reference. Therefore, it is possible to easily set an appropriate correction amount.

By such adjustment using the test image T, for example, a correction amount for correcting color shift, spatial resolution deterioration (blurring), and color shift of the projected image is set. The information processing apparatus 1 is prepared with a test image for detecting color shift, a test image for detecting spatial resolution deterioration, and a test image for detecting color shift.

<Correction processing>
Here, a series of correction processes including the detection of the correction amount as described above will be described with reference to the flowchart of FIG.

In step S1, the information processing device 1 projects the test image T from the projector 2.

In step S2, the information processing device 1 accepts the user's selection of the correction amount. The selection of the correction amount by the user is performed so as to select a correction block that does not appear to have deterioration in image quality.

For example, a test image for color shift detection, a test image for spatial resolution deterioration detection, and a test image for color shift detection are projected in order, and a correction amount for color shift correction, a correction amount for spatial resolution deterioration correction, and a color are projected. A correction amount for taste shift correction is selected.

In step S3, the information processing apparatus 1 performs correction processing for each of color shift, spatial resolution deterioration, and color shift on the projected image obtained by reproducing the content. Further, the information processing device 1 projects the corrected projected image from the projector 2.

For example, the information processing apparatus 1 performs correction processing for color shift of a projected image based on the same correction amount as the color shift correction amount given to the correction block selected by using the test image for color shift detection. Correct the color shift.

Further, the information processing apparatus 1 uses the same correction amount as the correction amount of the spatial resolution given to the correction block selected by using the test image for detecting the deterioration of the spatial resolution as the correction processing regarding the deterioration of the spatial resolution. Corrects the spatial resolution deterioration of the projected image.

The corrected image looks like an enhanced image, but by projecting this, the correction and deterioration due to projection and environmental influences are canceled, and an image with less deterioration in spatial resolution is projected. Become.

The information processing apparatus 1 performs a projection image based on the same correction amount as the color shift correction amount given to the correction block selected by using the test image for color shift detection as the correction process related to the color shift. Correct the color shift of.

Other correction processes will be described with reference to the flowchart of FIG.

The processing of steps S11 to S13 of FIG. 3 is the same as the processing of steps S1 to S3 of FIG. That is, the projected image after the correction process based on the correction amount selected using the test image T is projected in step S13.

In step S14, the information processing device 1 determines whether the determination of the correction result by the user is OK or NG. In this example, the user evaluates whether the image quality of the corrected projected image is as intended or not.

If it is determined in step S14 that the image quality of the corrected projected image is not as intended, the information processing apparatus 1 selects the test image T in which the detection pattern is changed in step S15. The test image T in which the detection pattern is changed is projected in step S11, and the subsequent processing is performed.

As described above, the plurality of correction blocks constituting one detection pattern need to be arranged in a region where it can be assumed that the degree of image quality deterioration is substantially the same. That is, there is a limit to the number of correction blocks constituting the detection pattern.

The test image T selected in step S15 is an image in which a detection pattern composed of correction blocks having different variations in the pre-correction processing is arranged as compared with the previously projected test image T. By using a plurality of types of test images T, it is possible to detect the correction amount using many variations of detection patterns.

When an image is projected from the projector 2, the image is blurred, color shift occurs and color edges that are not included in the original image occur, and the color of the original image differs depending on the ambient light and the color of the projection surface. It may look like.

By displaying the correction blocks to which all variations of the pre-correction processing have been performed side by side, the information processing device 1 can make the user compare each correction block, and set a more optimum correction amount with less effort. Is possible.

That is, the information processing device 1 can easily obtain an appropriate correction amount based on the final appearance by the user.

Since the camera is not used to detect the correction amount, the user does not need to consider the camera settings and installation position. The user does not need to consider the erroneous calculation of the correction amount due to the deterioration of the imaging system, which needs to be considered when the camera is used.

<< About the test image >>
<Pattern for detecting color shift detection test image>
FIG. 4 is a diagram showing an example of a test image for detecting color shift.

As shown in FIG. 4, the entire color shift detection test image _{is divided into 3 × 3 regions A 11 to} A ₃₃ , and a detection pattern is arranged at a predetermined position in each region. The dashed line representing each area is not the line displayed on the image. The subscript numbers in each area represent the rows and columns at the location of each area.

In the example of FIG. 4, the detection pattern P ₁₁ , the detection pattern P ₁₂ , and the detection pattern P ₁₃ are located at the upper left end of the _{area A 11 , the upper center of the area A 12} , and the upper _{right end of the area A 13, respectively.} Be placed.

Further, the left end of the region A _21, the central region A _22, the right end of the region A _23, respectively, for detection pattern P _21, detection pattern P _22, and the detection pattern P ₂₃ is disposed.

The detection pattern P ₃₁ , the detection pattern P ₃₂ , and the detection pattern P ₃₃ are arranged at the lower left of the area A _{31, the lower center of the area A 32, and} the lower right of the area A _{33, respectively.}

The number of divisions of the area, the position of the area, and the position of the detection pattern in the area can be arbitrarily changed.

The correction amount selected using each detection pattern is used to correct the region on the projected image corresponding to the region in which the detection pattern is arranged during the correction processing of the projected image.

For example, the correction amount selected by using the detection pattern P ₁₁ is used for the correction processing of the upper left region corresponding to the _{region A 11 in the entire projected image.} Further, the correction amount selected by using the detection pattern P ₂₂ is used for the correction processing of the central region corresponding to the _{region A 22 in the entire projected image.}

A correction amount used for correction processing in a predetermined area may be calculated based on a plurality of correction amounts selected by using a plurality of detection patterns, such as weighting a plurality of correction amounts. ..

FIG. 5 is an enlarged view showing the detection pattern of FIG.

_{In the example of FIG. 5, the detection pattern P 11} arranged at the upper left corner of the color shift detection test image is shown. The detection pattern P ₁₁ is configured by arranging 20 correction blocks side by side in 4 × 5.

The correction blocks b _{11 to} b ₁₅ are arranged in order from the left in the first line, and the correction blocks b _{21 to} b ₂₅ are arranged in order from the left in the second line. The correction blocks b _{31 to} b ₃₅ are arranged in order from the left on the third line, and the correction blocks b _{41 to} b ₄₅ are arranged in order from the left on the fourth line.

The numbers shown inside each correction block are numbers representing the amount of correction. The number representing the correction amount may be actually superimposed on the correction block or may not be displayed.

Here, the color shift is a phenomenon in which a color edge that is not included in the original projected image is generated at the edge portion of the pattern due to the shift between the R channel and the B channel with respect to the G channel. The larger the amount of color shift, the wider the color edge looks.

The R channel color shift detection pattern is composed of a correction block in which the phase of the R channel is shifted with respect to the G channel. The color shift detection pattern of the B channel is composed of a correction block in which the phase of the B channel is shifted with respect to the G channel.

The test image for color shift detection includes a test image in which a detection pattern for detecting color shift in the R channel is arranged and a test image in which a detection pattern for detecting color shift in the B channel is arranged. There are two types of test images. When the color shift is detected, the color shift of the R channel and the color shift of the B channel are detected using each test image.

FIG. 6 is a diagram showing an example of a correction block constituting a detection pattern.

The square image shown on the left side of FIG. 6 is an image without color shift. In the detection pattern for detecting the color shift of the R channel, the region where the R channel and the G channel overlap is a yellow region in the entire correction block. The entire square image shown on the left side of FIG. 6 is a yellow region. In FIG. 6, the rectangular white region (non-colored region) represents the yellow region.

As shown at the tip of the arrows # 1 and # 2, the correction block is generated by fixing the phase of the G channel and shifting the phase of the R channel by a predetermined amount in each of the x-axis direction and the y-axis direction. Will be done.

The correction block shown at the tip of the arrow # 2 is an image in which the phase shift amount of the R channel is larger than that of the correction block shown at the tip of the arrow # 1. In the example of FIG. 6, the correction block is generated by shifting the phase in the left direction and the upward direction.

In the two correction blocks, the dark-colored region is the phase-shifted R-channel region and is the red region. The light-colored area is the reference G-channel area and becomes the green area. In one correction block, a rectangular yellow area is formed in the center, an upside-down L-shaped red part of a predetermined width can be seen in the upper left, and a left-right inverted L-shaped part of a predetermined width can be seen in the lower right. The image shows the green part of.

In this way, each correction block is generated by fixing the phase of the G channel and performing a pre-correction process for shifting the phase of the R channel in the x-axis direction and the y-axis direction by various amounts.

In the correction block of the detection pattern for detecting the color shift of the B channel, the region where the B channel and the G channel overlap is a light blue region. In one correction block, a rectangular light blue area is formed in the center, an upside-down L-shaped blue part of a predetermined width can be seen in the upper left, and a left-right inverted L-shaped part of a predetermined width can be seen in the lower right. The image shows the green part of.

For example, the image on the left side of FIG. 6 is a correction block in which the phase shift amount of the R channel is 0.0 pixel. The correction block shown at the tip of the arrow # 1 is a correction block having a phase shift amount of 1.0 pixel. The correction block shown at the tip of the arrow # 2 is a correction block having a phase shift amount of 1.9 pixels.

For example, 20 correction blocks in which the phases of the R channels are shifted by 0.1 pixel are arranged to form a detection pattern as shown in FIG.

The correction blocks b _{11 to} b _{15 in the} first row are images having phase shift amounts of 0.0, 0.1, 0.2, 0.3, and 0.4 pixels, respectively. The correction blocks b _{21 to} b _{25 in the} second row are images having phase shift amounts of 0.5, 0.6, 0.7, 0.8, and 0.9 pixels, respectively. The correction blocks b _{31 to} b _{35 on the} third row are images having phase shift amounts of 1.0, 1.1, 1.2, 1.3, and 1.4 pixels, respectively. The correction blocks b _{41 to} b _{45 on the} fourth row are images having phase shifts of 1.5, 1.6, 1.7, 1.8, and 1.9 pixels, respectively.

In this example, a correction block having a phase shift amount different by 0.1 pixel is used, but the change in the phase shift amount is not limited to the change by 0.1 pixel. A correction block having a larger range of phase shift may be presented at once, or a correction block having a phase shift changed with finer accuracy may be presented.

Further, with reference to the upper left of the detection pattern, correction blocks having a larger correction amount are arranged toward the right and downward, but the order of the correction blocks is also arbitrary.

Further, although it is assumed that a correction block whose phase is shifted in the positive direction (left direction) of the x-axis and the positive direction (upward direction) of the y-axis is used, the correction block is generated by shifting the phase in the negative direction. You may. The correction block may be generated by shifting in either direction instead of shifting in both the x-axis direction and the y-axis direction.

A test image for color shift detection in which a plurality of such detection patterns are arranged is projected. The user actually sees each detection pattern placed on the projected color shift detection test image, and selects a correction block that does not appear to have color shift from the correction blocks of each detection pattern. do.

FIG. 7 is a diagram showing an example of a change in appearance depending on the environment.

Although the detection pattern placed on the projected color shift detection test image has a predetermined color shift as the original appearance (internal processing), the actual appearance is the environment. There is a correction block in which the color shift is corrected as shown at the tip of the arrow # 11 due to the influence of.

FIG. 8 is a diagram showing an example of the actual appearance of the correction block.

Detection pattern P ₁₁ of FIG. 8 represents the actual projection state of the detection pattern P ₁₁ of FIG. The degree of color shift of each correction block on the projected test image for color shift detection is different from the original degree of color shift in the internal processing described with reference to FIG. 5 due to the influence of the environment. Become.

For example, in the example of FIG. 8, the correction block b ₁₁ is projected in a form having more color shift than the original degree of color shift (0.0 pixels). Further, the correction block b ₄₅ is projected in a form having a color shift less than the original degree of color shift (1.9 pixels).

The user selects a correction block that does not appear to have color shift from the correction blocks of _{the detection pattern P 11} actually projected in this way. _{In the example of FIG. 8, the correction block b 32} is selected as a correction block that does not appear to have color shift, as shown by enclosing it in the frame of the alternate long and short dash line.

In this case, 1.1 pixels, which is the amount of color shift given to the _{correction block b 32} , is set as the correction amount when the correction process is applied to the area of the projected image corresponding to the _{area A 11} in which the _{detection pattern P 11 is arranged.} Will be done. For the R channel of each pixel in the area of the projected image corresponding to the area A ₁₁ , the correction for shifting the phase by 1.1 pixels is performed in each of the x-axis direction and the y-axis direction.

As described above, the color shift detection using the color shift detection test image is performed based on the user's appearance. Such color shift detection and correction amount setting are performed using another detection pattern.

A correction block may be selected for each of the color shift in the x-axis direction and the color shift in the y-axis direction.

_{For example, when the correction block b 31} is selected as the correction block having a small color shift in the x-axis direction and the _{correction block b 32} is selected as the correction block having a small color shift in the y-axis direction, the correction amount in the x-axis direction is set as the correction amount. 1.0 pixel, which is the amount of color shift of the correction block b ₃₁ , is set, and 1.1 pixel, which is the amount of color shift _{of the correction block b 32} , is set as the correction amount in the y-axis direction.

The detection of the amount of color shift using the test image for color shift detection is performed, for example, when the projector 2 is a so-called three-panel projector having display devices for R channel, G channel, and B channel. It is said.

<Pattern for detecting test image for detecting spatial resolution deterioration>
FIG. 9 is a diagram showing an example of a test image for detecting spatial resolution deterioration.

As shown in FIG. 9, configured by the spatial resolution degradation detection test image, in place of the detection pattern P ₁₁ to P ₃₃ in a color shift detecting the test image, the detection pattern P _R11 or P _R33 is arranged Will be done. Duplicate explanations will be omitted as appropriate.

FIG. 10 is an enlarged view showing the detection pattern of FIG. 9.

_{In the example of FIG. 10, the detection pattern PR11} arranged at the upper left corner of the spatial resolution deterioration detection test image is shown. The detection pattern _PR11 is configured by arranging 49 correction blocks side by side in 7 × 7.

Here, the spatial resolution deterioration is a phenomenon in which the edges included in the projected image appear vaguely blurred. The larger the amount of deterioration, the wider the pixels appear and the thicker the edges such as lines appear.

The spatial resolution deterioration detection pattern is composed of correction blocks obtained by performing pre-correction processing for correcting blur (improving spatial resolution) to different degrees.

Instead of a quadrangular image like a correction block, an image obtained by performing pre-correction processing for improving resolution on an image of other shapes such as dots and straight lines is used as an element constituting the detection pattern. It may be.

In addition, the amount of deterioration of spatial resolution may differ for each RGB. A test image for detecting spatial resolution deterioration for each of the RGB channels may be created so that the amount of deterioration for each can be obtained.

In the example of FIG. 10, each correction block is a square image composed of edges on four sides. The correction block shown in FIG. 10 is, for example, a G channel correction block.

Further, in the example of FIG. 10, with reference to the correction block b11 on the upper left, a correction block having a larger horizontal blur correction amount toward the right and a larger vertical blur correction amount toward the lower side is arranged. Each correction block is an image generated by combining seven types of horizontal blur correction amounts and vertical blur correction amounts.

For example, the correction block b ₁₁ at the upper left end is an image in which both the horizontal blur correction amount and the vertical blur correction amount are 0, and there is no deterioration in spatial resolution. The correction block b _{17 at the} upper right end is an image in which the maximum spatial resolution is corrected for the horizontal blur correction amount and the spatial resolution is not corrected for the vertical blur correction amount.

_{The correction block b 71} at the lower left end is an image in which the maximum spatial resolution is corrected for the vertical blur correction amount and the spatial resolution is not corrected for the horizontal blur correction amount. The correction block b _{77 at the} lower right end is an image in which the maximum spatial resolution is corrected for both the horizontal blur correction amount and the vertical blur correction amount.

In this example, a correction block that combines seven types of horizontal blur correction amount and vertical blur correction amount is used, but a correction block that combines more types of horizontal blur correction amount and vertical blur correction amount is used. It may be used.

A test image for detecting spatial resolution deterioration in which a plurality of such detection patterns are arranged is projected. The user actually sees each detection pattern placed on the projected spatial resolution deterioration detection test image, and selects a correction block that does not appear to be blurred from the correction blocks of each detection pattern. do.

For example, when the correction block b ₇₇ in FIG. 10 is selected as an image that does not appear to be out of focus, correction processing is performed on the area of the projected image corresponding to the _{area A 11} in which the _{detection pattern PR 11 is arranged.} As the correction amount at the time, the correction amount of the correction block b ₇₇ is set. Regarding the resolution of each pixel in the area of the projected image corresponding to the area A ₁₁ , the process of correcting the blur according to the maximum correction amount of the seven types is performed for each of the horizontal blur and the vertical blur. ..

As described above, the detection of spatial resolution deterioration using the test image for detecting spatial resolution deterioration is performed based on the user's appearance. Such detection of spatial resolution deterioration and setting of the correction amount are performed using another detection pattern.

A correction block may be selected for each of the horizontal blur correction amount and the vertical blur correction amount.

In general, the correction of spatial resolution deterioration is performed by a filter process. In this case, in a place where the difference in pixel value from the adjacent pixel is large (such as a steep binary edge part), a large value pixel or a small value pixel may occur around the corresponding part of the correction result. be.

On the other hand, since there is a limit to the value (expression range) that the image projected by the projector can have, it is not possible to accurately express the corrected value for such a part, and the image quality of the projected image. May get worse.

When a quadrangular correction block as shown in FIG. 10 is used in consideration of deterioration of image quality due to such limitation of the expression range, the difference between the pixel values of the four sides of the correction block and the adjacent pixels becomes small. , May be designed to have a gentle edge.

In the example of FIG. 10, a quadrangular correction block is used to make it easier to understand the difference in the amount of blur, but the amount of blur is detected using an arbitrary natural image that shows the difference in the amount of blur. You may do so.

<Pattern for detecting test image for color shift detection>
FIG. 11 is a diagram showing an example of a test image for detecting color shift.

As shown in FIG. 11, color shift detection test image is constituted by instead of detection patterns P ₁₁ to P ₃₃ in a color shift detecting the test image, the detection pattern P _C11 to P _C33 is located Will be done. Duplicate explanations will be omitted as appropriate.

FIG. 12 is an enlarged view showing the detection pattern of FIG. 11.

_{In the example of FIG. 12, the detection pattern PC11} arranged at the upper left corner of the color shift detection test image is shown. The detection pattern _PC11 is configured by arranging 81 correction blocks side by side in 9 × 9.

Here, the color shift is a phenomenon that occurs due to ambient light or the color of the projection surface, and even if white is projected, it does not appear white on the projection surface. The larger the amount of color shift, the more the color of the projected image looks different from the color of the original image.

The pattern for detecting color shift is configured by using an image of a predetermined color in which the RGB ratio is changed as a correction block.

In the example of FIG. 12, each correction block is a square image having different RGB ratios. For example, when the correction block at the upper left end is used as a reference, a correction block having a large amount of color shift correction toward the right and a large amount of color shift correction toward the bottom is arranged.

In this example, a pattern consisting of 81 kinds of color correction blocks is used as a pattern for detecting color shift, but a pattern consisting of correction blocks of different numbers or colors having significantly different RGB ratios is used. It may be. A plurality of variations of test images for color shift detection having different detection patterns may be prepared according to the environment of the projection system.

A test image for color shift detection in which a plurality of such detection patterns are arranged is projected. The user actually sees each detection pattern arranged on the projected color shift detection test image, and selects, for example, a correction block that looks white from the correction blocks of each detection pattern.

For example, when the correction block at the lower right end of FIG. 12 is selected as an image that looks white, correction is performed when the correction process is applied to the area of the projected image corresponding to the _{area A 11} in which the _{detection pattern PC 11 is arranged.} As the amount, a correction amount is set so that the correction block at the lower right end is white. The color tone of each pixel in the area of the projected image corresponding to the area A _{11 is corrected to change the color tone according to the set correction amount.}

As described above, the detection of the color shift using the test image for the color shift detection is performed based on the appearance of the user. Such color shift detection and correction amount setting are performed using another detection pattern.

<< Configuration of each device >>
FIG. 13 is a block diagram showing a configuration example of the hardware of the information processing device 1.

The CPU (Central Processing Unit) 101, ROM (Read Only Memory) 102, and RAM (Random Access Memory) 103 are connected to each other by a bus 104.

An input / output expansion bus 105 is further connected to the bus 104. A GPU (Graphics Processing Unit) 106, a UI (User Interface) I / F 109, a communication I / F 112, and a recording I / F 113 are connected to the input / output expansion bus 105.

The GPU 106 uses the VRAM 107 to render the projected image projected from the projector 2. For example, the GPU 106 generates a projected image to be projected from the projector 2 and outputs it to the display I / F 108.

The display I / F 108 is an interface for outputting a projected image or the like. The display I / F 108 is configured as an interface of a predetermined standard such as HDMI (registered trademark) (High-Definition Multimedia Interface). The display I / F 108 outputs the projected image supplied from the GPU 106 to the projector 2 and projects it.

The UI I / F 109 is an interface for detecting an operation. The UI I / F 109 detects an operation performed by using the keyboard 110 or the mouse 111, and outputs information indicating the content of the operation to the CPU 101. For example, the operation of the user who selects the correction block is detected by the UI I / F 109.

The communication I / F 112 is an interface for communication with an external device. The communication I / F 112 is composed of a network interface such as a wireless LAN or a wired LAN. The communication I / F 112 communicates with an external device via a network such as the Internet, and transmits / receives various data. The content reproduced in the projection system of FIG. 1 may be provided from the server via the network.

The recording I / F 113 is an interface for a recording medium. Recording media such as HDD 114 and removable media 115 are mounted on the recording I / F 113. The recording I / F 113 reads the data recorded on the mounted recording medium and writes the data to the recording medium. In addition to the contents, various data such as programs executed by the CPU 101 are recorded in the HDD 114.

FIG. 14 is a block diagram showing a functional configuration example of the information processing device 1.

As shown in FIG. 14, the control unit 151 is realized in the information processing device 1. The control unit 151 includes a test image generation unit 161, a projection control unit 162, a projection image acquisition unit 163, and a correction unit 164. At least a part of the functional units shown in FIG. 14 is realized by executing a predetermined program by the CPU 101 of FIG.

The test image generation unit 161 generates a test image for detecting various image quality deteriorations. The test image generated by the test image generation unit 161 is supplied to the projection control unit 162.

For example, the test image generation unit 161 generates a test image for detecting color shift when detecting color shift, and generates a test image for detecting deterioration of spatial resolution when detecting deterioration of spatial resolution. Further, when the test image generation unit 161 detects the color shift, the test image generation unit 161 generates a test image for detecting the color shift.

By controlling the display I / F 108, the projection control unit 162 outputs the test image generated by the test image generation unit 161 to the projector 2 and projects it. The projection of the test image is projected in the same size as the image of the content to be projected later. The size of the test image will be the same as the size of the content image.

Further, when the corrected projection image in which the color shift, the deterioration of the spatial resolution, and the deterioration of the image quality of the color shift are corrected is supplied from the correction unit 164, the projection control unit 162 projects the corrected projection image. Output to 2 and project. The processing of steps S1 and S3 of FIG. 2 is a processing performed by the projection control unit 162.

The projected image acquisition unit 163 reproduces the content such as a movie after detecting the deterioration of the image quality using the test image, and outputs the image of the content as the projected image to the correction unit 164.

When the image quality deterioration is detected using the test image, the correction unit 164 detects the correction block selected by the user and accepts the selection of the correction amount. The process of step S2 in FIG. 2 is a process performed by the correction unit 164.

For example, the correction unit 164 sets a correction amount according to a correction block selected by the user as a correction amount related to color shift when detecting color shift using a test image for color shift detection.

Further, the correction unit 164 sets a correction amount according to the correction block selected by the user as a correction amount related to the spatial resolution deterioration at the time of detecting the spatial resolution deterioration using the test image for detecting the spatial resolution deterioration.

When detecting the color shift using the test image for detecting the color shift, the correction unit 164 sets the correction amount according to the correction block selected by the user as the correction amount related to the color shift.

The correction unit 164 performs correction processing for correcting color shift, spatial resolution deterioration, and color shift with respect to the projected image supplied from the projected image acquisition unit 163 when the content is reproduced, based on the respective correction amounts. To apply. A part of the processing in step S3 of FIG. 2 is a processing performed by the correction unit 164. The correction unit 164 outputs the corrected projected image in which the color shift, the spatial resolution deterioration, and the color shift are corrected to the projection control unit 162.

<< Modification example >>
Although it is assumed that three types of image quality deterioration amounts of color shift, spatial resolution deterioration, and color shift are detected, at least two types of image quality deterioration amounts may be detected and corrected. Further, the amount of color shift, spatial resolution deterioration, and other types of image quality deterioration other than color shift, such as brightness, may be detected and corrected.

Although the information processing device 1 is provided with the function of adjusting using the test image, it may be mounted on the projector 2. In this case, each functional unit shown in FIG. 14 is realized in the projector 2.

FIG. 15 is a diagram showing a configuration example of the projector 2.

As shown in FIG. 15, the projector 2 is composed of a control unit 151 and a projection unit 201. The control unit 151 of FIG. 15 has the same function as the control unit 151 of FIG.

When the test image is generated by the control unit 151, the projection unit 201 projects the test image supplied from the control unit 151. Further, when the projected image after correction of various image quality deterioration is supplied from the control unit 151, the projection unit 201 projects the corrected projected image.

As described above, the adjustment function using the test image and the correction function of the projected image may be provided in the projector 2 or may be provided in a device external to the projector 2. ..

The series of processes described above can be executed by hardware or software. When a series of processes are executed by software, the programs constituting the software are installed from the program recording medium on the computer or the like shown in FIG. 13 constituting the information processing apparatus 1.

The program executed by the CPU 101 is recorded on the removable media 115, or provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting, and installed on the HDD 114.

The program executed by the computer may be a program in which processing is performed in chronological order in the order described in this specification, or processing is performed in parallel or at a necessary timing such as when a call is made. It may be a program to be performed.

In the present specification, the system means a set of a plurality of components (devices, modules (parts), etc.), and it does not matter whether or not all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a device in which a plurality of modules are housed in one housing are both systems. ..

The effects described herein are merely exemplary and not limited, and may have other effects.

The embodiment of the present technology is not limited to the above-described embodiment, and various changes can be made without departing from the gist of the present technology.

For example, the present technology can have a cloud computing configuration in which one function is shared by a plurality of devices via a network and jointly processed.

Further, each step described in the above-mentioned flowchart can be executed by one device or can be shared and executed by a plurality of devices.

Further, when a plurality of processes are included in one step, the plurality of processes included in the one step can be executed by one device or shared by a plurality of devices.

The present technology can also have the following configurations.
(1)
An information processing device including a projection control unit that projects a test image in which a detection pattern composed of a plurality of pattern elements that have been subjected to correction processing of different degrees in advance is arranged.
(2)
The information processing apparatus according to (1), further comprising a correction unit that corrects a projected image based on a correction amount corresponding to the pattern element selected from the pattern elements included in the projected test image. ..
(3)
The information processing device according to (2) above, wherein the projection control unit projects the corrected projected image.
(4)
The information processing apparatus according to (3), wherein a plurality of detection patterns are arranged on the test image.
(5)
The correction unit corrects each region of the projected image based on the correction amount corresponding to the pattern element selected by using the detection pattern arranged at the corresponding position of the test image. The information processing apparatus according to (4).
(6)
The detection pattern is composed of a plurality of the pattern elements that have been subjected to color shift correction processing of different degrees.
The information processing apparatus according to any one of (2) to (5), wherein the correction unit corrects color shift of the projected image based on the correction amount corresponding to the selected pattern element.
(7)
The detection pattern is composed of a plurality of the pattern elements that have been subjected to correction processing for improving the resolution to different degrees.
The information processing device according to any one of (2) to (5) above, wherein the correction unit corrects the resolution deterioration of the projected image based on the correction amount corresponding to the selected pattern element.
(8)
The detection pattern is composed of a plurality of the pattern elements that have been subjected to color shift correction processing of different degrees.
The information processing apparatus according to any one of (2) to (5), wherein the correction unit corrects the tint of the projected image based on the correction amount corresponding to the selected pattern element.
(9)
The information processing apparatus according to any one of (2) to (8), further comprising a projection unit for projecting the test image and the corrected projected image.
(10)
Information processing device
An information processing method that projects a test image in which a detection pattern composed of a plurality of pattern elements that have been subjected to correction processing of different degrees in advance is arranged.
(11)
On the computer
A program for projecting a test image in which a detection pattern composed of multiple pattern elements that have been subjected to correction processing of different degrees in advance is projected.

1 Information processing device, 2 Projector, 11 screen, 151 control unit, 161 test image generation unit, 162 projection control unit, 163 projection image acquisition unit, 164 correction unit, 201 projection unit

Claims (11)

An information processing device including a projection control unit that projects a test image in which a detection pattern composed of a plurality of pattern elements that have been subjected to correction processing of different degrees in advance is arranged. The information processing apparatus according to claim 1, further comprising a correction unit that corrects a projected image based on a correction amount corresponding to the pattern element selected from the pattern elements included in the projected test image. The information processing device according to claim 2, wherein the projection control unit projects the corrected projected image. The information processing apparatus according to claim 2, wherein a plurality of detection patterns are arranged in the test image. A claim that the correction unit corrects each region of the projected image based on the correction amount corresponding to the pattern element selected by using the detection pattern arranged at the corresponding position of the test image. Item 4. The information processing apparatus according to item 4. The detection pattern is composed of a plurality of the pattern elements that have been subjected to color shift correction processing of different degrees.
The information processing device according to claim 2, wherein the correction unit corrects the color shift of the projected image based on the correction amount corresponding to the selected pattern element. The detection pattern is composed of a plurality of the pattern elements that have been subjected to correction processing for improving the resolution to different degrees.
The information processing device according to claim 2, wherein the correction unit corrects the resolution deterioration of the projected image based on the correction amount corresponding to the selected pattern element. The detection pattern is composed of a plurality of the pattern elements that have been subjected to color shift correction processing of different degrees.
The information processing device according to claim 2, wherein the correction unit corrects the tint of the projected image based on the correction amount corresponding to the selected pattern element. The information processing apparatus according to claim 2, further comprising a projection unit that projects the test image and the corrected projected image. Information processing device
An information processing method that projects a test image on which a detection pattern consisting of multiple pattern elements that have been subjected to correction processing of different degrees in advance is arranged. On the computer
A program for projecting a test image in which a detection pattern composed of multiple pattern elements that have been subjected to correction processing of different degrees in advance is projected.

Images