JP2010136105A - Projector, method and program for adjusting display, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a projector, a method and program for adjusting display, and a recording medium that adjust the display state of a desired image, while displaying the image. <P>SOLUTION: The projector 1A for projecting an input image corresponding to input image information includes: a display means 5 for projecting the input image and displaying it within a prescribed area; a pattern image generation means (pattern image generating part) 66A for generating a pattern image for adjusting the display state of the input image and displaying the pattern image between frames configuring the input image by the display means 5; an imaging means 21 for picking up the image displayed by the display means 5; and an adjusting means (display adjusting part) 67A for adjusting the display state of the input image, on the basis of the pattern image picked up by the imaging means 21. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a projector that projects an image on a projection surface, a display adjustment method, a display adjustment program, and a recording medium.

  Conventionally, a light source device, a light modulation device that modulates a light beam emitted from the light source device to form image light according to image information, and a projection optical device that enlarges and projects the formed image light on a projection surface A projector equipped with is known. When such a projector is arranged to be inclined with respect to the projection surface, the projection range of the image light from the projector is distorted into a trapezoid. Such distortion is generally called trapezoidal distortion. As a configuration for correcting such trapezoidal distortion, a projector that adjusts the shape of image light to be formed (the shape of a transmission region in a plane orthogonal to the optical axis of the image light) is known (for example, Patent Documents). 1).

  In the projector described in Patent Document 1, a pattern image (checker pattern image) is displayed, and the pattern image is sensed by an image distortion sensing unit. Then, the image distortion correction unit corrects the shape of the formed image based on the sensing result. As a result, an image from which distortion has been eliminated is displayed on the projection surface.

JP 2006-222858 A

  However, the projector described in Patent Document 1 has a problem that a user's desired image cannot be displayed while a pattern image for correcting trapezoidal distortion is displayed. That is, even if the user tries to display a desired image, there is a problem that the desired image cannot be displayed unless sensing and correction of the pattern image is completed.

  An object of the present invention is to provide a projector, a display adjustment method, a display adjustment program, and a recording medium that can adjust the display state of a desired image during display of the desired image.

  In order to achieve the above-described object, the projector according to the present invention is a projector that projects an input image according to input image information, and projects the input image to display it in a predetermined area. Generating a pattern image for adjusting the display state of the input image, and causing the display means to display the pattern image between frames constituting the input image; and the display means An image pickup means for picking up a displayed image, and an adjustment means for adjusting the display state of the input image based on the pattern image picked up by the image pickup means.

  According to the present invention, the pattern image displayed by the display unit is captured by the imaging unit, and the display state of the input image is adjusted by the adjustment unit based on the captured pattern image. According to this, since the pattern image for adjusting the display state of the input image is displayed between frames constituting the input image, it is necessary to interrupt the display of the input image in order to display the pattern image. Absent. Further, since the pattern image is displayed between frames in this way, the pattern image can be made inconspicuous. Therefore, the display state of the input image can be adjusted while the input image is displayed.

In the present invention, it is preferable that the pattern image generation unit generates the pattern image based on an original image which is a frame displayed at least one of the frames immediately before and immediately after the pattern image.
According to the present invention, a pattern image displayed between frames of an input image is generated based on an original image that is a frame displayed at least immediately before and immediately after the pattern image. According to this, when each frame and pattern image are continuously displayed, the display of the pattern image can be made less noticeable. Therefore, the displayed pattern image can be made more difficult to recognize.

In the present invention, it is preferable that the pattern image generation unit generates the pattern image by changing a gradation value of a pixel constituting the original image.
According to the present invention, since the pattern image is formed by changing the gradation value of the pixel of the original image, the pattern image has a predetermined color (for example, black displayed when the gradation value of the pixel is the lowest). Compared to the case where a pattern image including a pattern having a lattice, a figure, and a plurality of points (feature points) is displayed, the display of the pattern image can be made more inconspicuous. Therefore, it is possible to make it difficult to recognize the displayed pattern image.

  In the present invention, the adjustment unit is based on a difference acquisition unit that acquires a difference between gradation values of pixels corresponding to the original image and the pattern image captured by the imaging unit, and the acquired difference. Based on the acquired distance, a feature point extraction unit that extracts a feature point included in the pattern image, a distance acquisition unit that acquires a distance from the projector to the extracted feature point, and It is preferable to include an adjustment unit that adjusts at least one of the focus position of the input image and the shape of the input image.

  According to the present invention, a feature point included in the pattern image is extracted based on a difference between gradation values of the original image and the pattern image, and a distance from the projector to the feature point is acquired. Then, based on the acquired distance, at least one of the focal position and the shape of the input image is adjusted. According to this, since the display state of the input image can be adjusted by picking up the original image and the pattern image by the image pickup means, the display state adjustment process can be performed quickly. In addition, when the adjustment unit adjusts the focal position of the input image, it is possible to save the user from adjusting the focal position and display the input image appropriately. On the other hand, when the adjustment unit adjusts the shape of the input image, the input displayed when the predetermined area in which the input image is displayed is inclined with respect to the projection direction of the image by the display unit. The input image can be appropriately displayed by adjusting the shape of the image according to the inclination. Therefore, the input image can be displayed quickly and appropriately.

Alternatively, in the present invention, the pattern image generation means uses, as the pattern image, the first pattern in which a plurality of transmissive regions through which the original image is transmitted and non-transparent regions through which the original image does not transmit are formed as the original pattern. It is preferable to generate the first pattern image superimposed on the image.
According to the present invention, the first pattern image as the pattern image is generated by superimposing the first pattern including the transmissive area through which the original image is transmitted and the non-transmissive area through which the original image is not transmitted on the original image. . According to this, the difference between the first pattern image and the original image displayed immediately before or after the first pattern image can be reduced. Therefore, it is possible to make it difficult to recognize the displayed pattern image.

  In the present invention, the pattern image generation means includes a second pattern in which the first pattern image and the second pattern in which the transmissive area and the non-transmissive area are replaced with the first pattern are superimposed on the original image. And the adjustment unit is configured to extract an edge component from each of the first pattern image and the second pattern image captured by the imaging unit, and each of the extracted edge components. A pattern acquisition unit that acquires a pattern common to the first pattern and the second pattern, a feature point extraction unit that extracts a feature point from the acquired pattern, and from the projector to the extracted feature point A distance acquisition unit that acquires a distance, a focal position of the input image to be projected based on the acquired distance, and a shape of the input image Among them, it is preferably provided with an adjustment unit for adjusting at least any.

  According to the present invention, a pattern included in each pattern image is acquired based on the edge components of the first pattern image and the second pattern image, and feature points are extracted from the pattern. Then, the distance from the projector to the feature point is acquired, and at least one of the focal position and the shape of the input image is adjusted based on the distance. According to this, since the display state of the input image can be adjusted by capturing the first pattern image and the second pattern image by the imaging unit, the display state adjustment processing is performed as in the case described above. Can be done quickly. In addition, since the adjustment unit automatically adjusts the focal position of the input image, it is possible to save the user and to display the input image appropriately. On the other hand, the adjustment unit adjusts the shape of the input image, so that the input image can be appropriately displayed according to a predetermined area where the input image is displayed. Therefore, the input image can be displayed quickly and appropriately.

The display adjustment method of the present invention is a display adjustment method that is performed using a projector that projects and displays an input image corresponding to input image information and adjusts the display state of the projected input image. A pattern image generation procedure for generating a pattern image for adjusting the display state of the input image, a pattern image display procedure for displaying the pattern image between frames constituting the input image, and display by the display means And an adjustment procedure for adjusting a display state of the input image based on the captured pattern image.
According to the present invention, the same effects as those of the projector described above can be obtained. That is, since the pattern image is displayed between frames of the input image, the display state of the input image can be adjusted while the input image is displayed.

The display adjustment program of the present invention is a display adjustment program that is executed by a projector that projects and displays an input image corresponding to input image information, and that adjusts the display state of the projected input image, A pattern image generation step for generating a pattern image for adjusting the display state of the input image, a pattern image display step for displaying the pattern image between frames constituting the input image, and the display means An imaging step of capturing the pattern image and an adjustment step of adjusting the display state of the input image based on the captured pattern image are executed.
According to the present invention, the same effects as those of the projector and the display adjustment method described above can be obtained.

The recording medium of the present invention is characterized in that the above-described display adjustment program is recorded so as to be readable by a computer.
According to the present invention, it is possible for the projector to read and execute a display adjustment program recorded on a recording medium so as to be readable by a computer, thereby achieving the same effect as the projector described above. As recording media, magnetic tapes such as DAT (Digital Audio Tape), magnetic disks such as FD (Flexible Disc), optical disks such as CD (Compact Disc) and DVD (Digital Versatile Disc), magneto-optical disks, hard disk devices, In addition, a semiconductor memory or the like can be used, and by using these, the display adjustment program can be installed and executed by the projector, and the display adjustment program can be easily distributed.

[1. First Embodiment]
The projector 1A according to the first embodiment of the present invention will be described below.
FIG. 1 is a schematic perspective view showing a projector 1A according to the present embodiment.
The projector 1A is connected to an image output device such as a PC (Personal Computer), for example, and projects an image input from the image output device (hereinafter, may be abbreviated as “input image”) to project on the screen SC. It is displayed on the screen. As shown in FIG. 1, the projector 1 </ b> A includes a housing 2 having a substantially rectangular parallelepiped shape as a whole, and an apparatus main body 3 (see FIG. 2) housed in the housing 2.

  The housing 2 is made of synthetic resin, and an opening for exposing a projection optical device 53 (see FIG. 2) of the display means 5 described later is formed on the front surface of the housing 2 although not shown. . The casing 2 is provided with an imaging unit 21 so as to face the projection direction of the image light corresponding to the input image by the projection optical device 53. The imaging unit 21 sets the projection range of the image light as the imaging range by the projection optical device 53, captures an image projected in the imaging range, and stores the storage unit 65 (see FIG. 2) of the control unit 6A described later. Memorize). In the present embodiment, the imaging unit 21 is configured by a color CCD (Charge Coupled Device), but may be a CCD that acquires a captured image in gray scale. In addition to these CCDs, other configurations such as a CMOS (Complementary Metal Oxide Semiconductor) device may be used.

[Configuration of the device body]
FIG. 2 is a block diagram showing the configuration of the projector 1A.
The apparatus body 3 displays an input image from the above-described image output apparatus. As shown in FIG. 2, the apparatus body 3 includes a receiving unit 4, a display unit 5, a control unit 6 </ b> A, and a focus adjusting unit 7.
The receiving unit 4 receives a packet including an image (image data) transmitted from the image output apparatus, and outputs the packet to the control unit 6A. The receiving unit 4 is connected to another image output device and outputs an image signal input from the image output device to the control unit 6A.

[Configuration of display means]
The display unit 5 forms and projects image light corresponding to a drive signal input from the control unit 6A described later, and displays an input image on the projection surface of the screen SC. The display unit 5 includes a light source device 51, a light modulation device 52, and a projection optical device 53.
The light source device 51 includes a light source lamp such as a high-pressure mercury lamp and a reflector that is a reflecting mirror, or a solid light source such as an LED, and irradiates the light modulation device 52 with a light beam.

Although not shown, the light modulation device 52 includes a liquid crystal panel that modulates a light beam emitted from the light source device 51 to form image light, and a driver that drives the liquid crystal panel according to an input drive signal. Configured. Note that the light modulation device 52 is not limited to a configuration including a liquid crystal panel, and may employ a configuration other than liquid crystal, such as a device using a micromirror.
The projection optical device 53 enlarges and projects the image light formed by the light modulation device 52 onto the projection surface, and is a combined lens including a lens barrel and a plurality of lenses housed in the lens barrel. It is configured. The plurality of lenses include a focus lens 531, a zoom lens 532, and the like. The focus lens 531 is advanced and retracted along the optical axis of the projection optical device 53 by the focus adjustment unit 7, and is thereby projected. The focus position of the image to be adjusted is adjusted.

[Configuration of focus adjustment means]
The focus adjustment unit 7 adjusts the position of the focus lens 531 based on a control signal input from the control unit 6 </ b> A (particularly, a focus control unit 674 described later), and a focus position of an image projected by the projection optical device 53. Adjust. Such a focus adjustment unit 7 can be exemplified by a stepping motor or the like that is driven in accordance with a drive signal as the control signal.

[Configuration of control means]
The control means 6A is configured as a circuit board on which a CPU (Central Processing Unit) and the like are mounted, and controls the entire projector 1A. Therefore, the control unit 6A includes a main control unit 61, an image processing unit 62, a frame memory 63, a drive control unit 64, a storage unit 65, a pattern image generation unit 66A, and a display adjustment unit 67A.
The main control unit 61 controls the entire control means 6A and thus the entire projector 1A. The main control unit 61 outputs a control signal to each of the functional units 62 to 65, 66A, and 67A that constitute the control unit 6A, and performs control so that they perform an appropriate operation at an appropriate time. For example, the main control unit 61 designates the address of the frame memory 63 when writing image data to the image processing unit 62 and the display adjustment unit 67A, and also reads the image data into the drive control unit 64. Specify an address.

The image processing unit 62 processes the packet and the image signal received by the receiving unit 4 and generates an input image corresponding to the packet and the image signal on the frame memory 63. For example, when a packet is input, the image processing unit 62 reconstructs the image data included in the data portion of the packet based on the header information included in the header portion of the packet, and the image data An input image corresponding to the above is developed on the frame memory 63. Further, when an image signal is input, the image processing unit 62 demodulates the image signal and develops an input image corresponding to the image signal on the frame memory 63.
The frame memory 63 is configured to be able to store a plurality of frames. An image is written into the frame memory 63 by the image processing unit 62, the pattern image generating unit 66A, and the display adjusting unit 67A, and an image is read by the drive control unit 64.

  The drive control unit 64 outputs a drive signal corresponding to the image developed on the frame memory 63 to the display unit 5. In addition, the drive control unit 64 outputs a control signal for controlling turning on / off of the light source device 51 and the amount of emitted light to the display unit 5.

  The storage unit 65 stores various programs and data necessary for processing by the control unit 6 </ b> A, and stores a captured image captured by the imaging unit 21. For example, the storage unit 65 stores a display adjustment program for executing a display adjustment process described later as the program. The storage unit 65 stores data necessary for calculating the distance from the projector 1A to the projection surface. As such data, a LUT (Look) in which the coordinates of a feature point C included in a pattern image PP, which will be described later, and the distance (projection distance) from the projector 1A to the projection surface measured in advance according to the coordinates are associated. Up Table).

[Configuration of pattern image generator]
FIG. 3 is a diagram illustrating an example of the input image BP for one frame displayed immediately before the pattern image, and FIG. 4 is a diagram illustrating an example of the pattern image PP generated based on the input image. It is.
The pattern image generation unit 66A corresponds to the pattern image generation means of the present invention, and generates the pattern image PP on the frame memory 63 by display adjustment processing described later. At this time, the pattern image generation unit 66A obtains one frame (hereinafter sometimes abbreviated as “original image”) BP1 of the input image displayed immediately before the pattern image PP, and based on the original image BP1, A pattern image PP is generated.

  For example, when the pattern image generation unit 66A acquires the original image BP1 shown in FIG. 3, the pattern image generation unit 66A generates the pattern image PP by superimposing the grid-like grid pattern G1 shown in FIG. 4 on the original image BP1. . The grid pattern G1 is generated by increasing / decreasing the gradation value (luminance) of the original image BP1 where the pixels constituting the grid pattern G1 are located. That is, the pattern image generation unit 66A increases the gradation value of the pixels constituting the grid pattern G1 by a predetermined value (for example, 10) to the gradation value of the pixel of the original image BP1 at the position corresponding to the pixel. The gradation value. When the gradation value increased by the predetermined value exceeds the limit (highlight) of the gradation value, the gradation value obtained by subtracting the predetermined value from the gradation value of the pixel of the original image BP1 is It is assumed that the gradation value of the pixels constituting the grid pattern G1. Thereby, the pattern image PP shown in FIG. 4 is generated.

  Here, in the present embodiment, as shown in FIG. 4, the pattern image PP has a grid pattern G1 formed in a lattice pattern by three straight lines S arranged at equal intervals in the vertical and horizontal directions. Of the feature points C that are the intersections of these straight lines, the feature point C1 that is the intersection of the vertical and horizontal straight lines located in the center and the four feature points C2 that are the intersections of the vertical and horizontal straight lines located outside are A gradation value obtained by further increasing (or subtracting) a predetermined value from the gradation value of the original image at the corresponding position is set. For this reason, in the differential image DP (see FIG. 6), which will be described later, the positions of the feature points C1 and C2 become clearer with respect to the other feature points C3.

  Note that a gradation value obtained by subtracting a predetermined value from the gradation value of each pixel of the original image BP1 may be used as the gradation value of each pixel constituting the grid pattern G1. In this case, if the gradation value limit (shadow) is exceeded by subtracting the predetermined value, the gradation value obtained by increasing the gradation value of the pixel of the original image BP1 by a predetermined value constitutes the grid pattern G1. The gradation value of the pixel to be used may be used. Further, such a predetermined value may be set as appropriate, but it is preferable to set the gradation value to such a degree that the difference between the original image BP1 and the pattern image PP is difficult for the user to recognize.

FIG. 5 is a diagram showing a transition when displaying the pattern image PP. Of these, FIGS. 5A to 5C show the original image BP1, the pattern image PP, and the image BP2, respectively. The images are shown in FIGS. 5A, 5B, and 5 (FIG. 5). It shall be displayed in the order of C).
The pattern image PP generated as described above is read by the drive control unit 64 under the control of the main control unit 61, and after the output of the drive signal corresponding to the original image BP1, as shown in FIG. A drive signal corresponding to the pattern image PP is output to the display means 5 before outputting a drive signal corresponding to the image BP2 which is the next frame of the original image BP1. Thereby, the pattern image PP is displayed between frames from when the original image BP1 is displayed until the image BP2 is displayed. As described above, the imaging unit 21 captures the original image BP1 and the pattern image PP, and stores these captured images in the storage unit 65.

[Configuration of display adjustment unit]
The display adjustment unit 67A corresponds to the adjustment unit of the present invention, and adjusts the input image stored in the frame memory 63 based on the captured image stored in the storage unit 65. Specifically, the display adjustment unit 67A adjusts the focal position of the projection image based on the pattern image PP captured by the imaging unit 21 using the focus adjustment unit 7, and also trapezoidal distortion of the image projected on the screen SC. Correct. The display adjustment unit 67A includes a difference acquisition unit 671, a feature point acquisition unit 672, a distance acquisition unit 673, a focus control unit 674, a relative angle calculation unit 675, and a trapezoidal distortion correction unit 676.

FIG. 6 is a diagram illustrating the difference image DP acquired by the difference acquisition unit 671. FIG. 6 shows a difference image DP that is a difference between the original image BP1 shown in FIG. 3 and the pattern image PP shown in FIG. 4, but in FIG. The low gradation area (area where the gradation value is 0) is replaced with white.
The difference acquisition unit 671 acquires the original image BP1 and the pattern image PP captured by the imaging unit 21 from the storage unit 65, and acquires the difference between these images BP1 and PP. Specifically, the difference acquisition unit 671 acquires a difference between gradation values of each corresponding pixel, and converts the difference into an absolute value. Then, the difference acquisition unit 671 generates a difference image DP (for example, the difference image DP shown in FIG. 6) in which the gradation value that is the absolute value difference is set in the corresponding pixel.

  Returning to FIG. 2, the feature point extraction unit 672 performs filter processing such as Laplacian filter processing or differential filter processing on the differential image DP, and extracts edge components from the differential image DP. This extracted edge component corresponds to the grid pattern G1 on the projection surface. Then, the feature point extraction unit 672 extracts each of the above-described feature points C (C1 to C3) (see FIGS. 4 and 6) constituting the grid pattern G1 based on the edge component. Thereafter, the feature point extraction unit 672 acquires the coordinates (coordinates in the captured image) of the extracted feature points C (particularly, the feature points C1 and C2). As the coordinates of the feature point C, the coordinates of the center at the intersection of the straight lines S are set.

  The distance acquisition unit 673 refers to the above-described LUT stored in advance in the storage unit 65, and acquires the projection distance corresponding to the coordinates of the feature point C (particularly the feature points C1, C2). That is, the distance acquisition unit 673 acquires the distance from the projector 1A to each feature point C (particularly, feature points C1 and C2) based on the coordinates of each feature point C extracted on the projection surface.

  The focus control unit 674 corresponds to the adjustment unit of the present invention, and calculates an average value of each distance to the feature point C. Then, the focus control unit 674 outputs a control signal to the focus adjustment unit 7 so as to adjust the position of the focus lens 531 so that the focus position of the projected image becomes a position corresponding to the average value. In the present embodiment, the focus control unit 674 adjusts the focal position of the projection image to the average value, but the focus control unit 674 is not limited to this, and the focal point is the shortest distance or the longest distance among the distances to the feature point C. You may make it match a position.

The relative angle calculation unit 675 calculates an approximate plane corresponding to the projection plane based on the acquired coordinates of each feature point C and each distance to each feature point C. Then, the relative angle calculation unit 675 calculates a relative angle (relative angle) with the projection direction of the projection optical device 53 with respect to the generated approximate plane. At this time, the relative angle calculation unit 675 calculates the relative angles in the vertical direction and the horizontal direction.
The trapezoidal distortion correction unit 676 corresponds to the adjustment unit of the present invention. Based on the relative angle calculated by the relative angle calculation unit 675, the shape of the input image on the projection surface is the same as the shape of the input image before correction. The input image stored in the frame memory 63 is corrected so as to have a substantially similar shape (same aspect ratio).

[Display adjustment processing]
FIG. 7 is a flowchart showing display adjustment processing by the projector 1A.
The projector 1A performs the following display adjustment processing including steps SA01 to SA09 as shown in FIG. 7 in accordance with the display adjustment program stored in the storage unit 65 when the power is turned on or when an image is displayed.
Specifically, in step SA01 in the display adjustment process, the pattern image generation unit 66A acquires the original image BP1 that is an image for one frame from the input image from the frame memory 63, and based on the original image BP1, the above-described image is generated. A pattern image PP is generated.
In step SA02, the drive control unit 64 outputs a drive signal corresponding to the original image BP1 in the process of outputting a drive signal corresponding to the input image developed on the frame memory 63 to the display means 5, thereby The display unit 5 displays the original image BP1 on the projection surface. Then, the imaging unit 21 captures the original image BP1 displayed on the projection surface, and stores the captured image of the original image BP1 in the storage unit 65.

  In step SA03, the drive control unit 64 responds to the pattern image PP generated in step SA01 after outputting the drive signal corresponding to the original image BP1 and before outputting the drive signal corresponding to the image BP2. A drive signal is output. Thereby, the pattern image PP is displayed between the original image BP1 and the image BP2. That is, the pattern image PP is inserted and displayed between the frames of the input image. And the imaging means 21 images the pattern image PP displayed on the projection surface, and memorize | stores the captured image of the said pattern image PP in the memory | storage part 65. FIG.

In step SA04, the difference acquisition unit 671 acquires the captured images of the original image BP1 and the pattern image PP stored in the storage unit 65, and acquires the above-described difference image DP that is the difference between these images BP1 and PP.
In step SA05, the feature point extraction unit 672 performs the above-described filtering process on the difference image DP to extract the grid pattern G1 that is an edge component, and acquires the coordinates of the feature point C based on the grid pattern G1. To do.
In step SA06, the distance acquisition unit 673 refers to the LUT stored in advance in the storage unit 65 and acquires the distance from the projector 1A to each feature point C.

  In Step SA07, the focus control unit 674 outputs a control signal to the focus adjustment unit 7 based on the acquired average value of the distances to the feature points C, and the focus adjustment unit 7 responds to the average value. The position of the focus lens 531 is adjusted so that the position of the projection optical device 53 matches the focal position of the projection optical device 53, that is, the focal position of the projection image. Thereby, a projection image will be in an in-focus state.

In step SA08, the relative angle calculation unit 675 generates an approximate plane of the projection surface based on the acquired coordinates of each feature point C and the distance to the feature point C, and the approximate plane and the projection optical device. The relative angle with the image projection direction 53 (the optical axis of the projection optical device 53) is calculated.
In step SA09, the trapezoidal distortion correction unit 676 corrects the input image stored in the frame memory 63 as described above based on the calculated relative angle. The correction of the input image in step SA09 is repeatedly executed.

  In this manner, when the drive control unit 64 outputs a drive signal corresponding to the corrected input image to the display unit 5, the input image in which the keystone distortion is corrected by the display unit 5 is displayed on the projection surface. Is displayed. Note that, in such display adjustment processing, steps SA01 to SA05 are repeatedly executed after a predetermined time has passed, and it is determined whether or not there is a change in the position of each feature point C. In addition, steps SA06 to SA09 are further executed.

The projector 1A according to the present embodiment described above has the following effects.
(1) Since the pattern image PP forms an input image and is displayed between the original image BP1 and the image BP2 that are continuous frames, the display of the input image is interrupted for the display of the pattern image PP. The display state of the input image can be adjusted. Moreover, since the pattern image PP is displayed between frames, the display of the pattern image PP can be made inconspicuous. Therefore, the display state of the input image can be adjusted while the input image is displayed.

  (2) The pattern image PP displayed between frames of the input image is generated based on the original image BP1 displayed immediately before the pattern image PP. According to this, when the original image BP1, the pattern image PP, and the image BP2 are continuously displayed, the display of the pattern image PP can be made less noticeable. Accordingly, the displayed pattern image PP can be made more difficult to recognize.

  (3) Since the pattern image PP is formed by changing the gradation value of the pixel of the original image BP1, the pattern image PP can be displayed more than when the grid pattern G1 is displayed in a predetermined color. It can be made less noticeable. Therefore, it is possible to make it difficult to recognize the displayed pattern image PP.

(4) In the display adjustment process, a difference image DP is generated based on the difference between the gradation values of the original image BP1 and the pattern image PP, and the feature point C is extracted from the difference image DP. Then, the distance from the projector 1A to the feature point C is acquired, and the focal position of the input image is adjusted based on the distance (more specifically, the average value of each distance). According to this, it is possible to save time and effort for the user to adjust the focal position, and it is possible to display the input image quickly and appropriately.
Further, a relative angle between the projection surface and the projection direction of the input image is calculated based on the distance, and the shape of the input image is adjusted based on the relative angle. According to this, even when the projection surface is inclined with respect to the projection direction, the input image can be appropriately displayed by adjusting according to the inclination (correcting the trapezoidal distortion). . Accordingly, similarly, the input image can be displayed quickly and appropriately.

[2. Second Embodiment]
Next, a projector 1B according to a second embodiment of the invention will be described.
The projector 1B of the present embodiment has the same configuration as the projector 1A described above, but the projector 1A generates a difference image DP that is a difference between the captured original image BP1 and the pattern image PP, and the difference image DP. Based on the edge component, the coordinates of the feature point C in the captured image were acquired. On the other hand, the projector 1B generates different pattern images in which the transmissive region and the non-transmissive region are inverted, generates a difference image that is a difference between the captured pattern images, and based on the difference image Get the coordinates of point C. In this respect, the projector 1B is different from the projector 1A. In the following description, parts that are the same as or substantially the same as those already described are assigned the same reference numerals and description thereof is omitted.

[Configuration of projector]
FIG. 8 is a block diagram showing the configuration of the projector 1B.
The projector 1B is connected to the image output device similarly to the projector 1A described above, and projects and displays the input image from the image output device on the projection surface of the screen SC. As shown in FIG. 8, the projector 1B has the same configuration as the projector 1A described above except that it includes a control unit 6B instead of the control unit 6A.
The control means 6B has the same configuration as the control means 6A except that it includes a pattern image generation unit 66B and a display adjustment unit 67B instead of the pattern image generation unit 66A and the display adjustment unit 67A.

[Configuration of pattern image generator]
The pattern image generation unit 66B corresponds to the pattern image generation unit of the present invention, acquires an image (original image) for one frame constituting the input image from the frame memory 63, and superimposes a predetermined pattern on the original image. Generated pattern images PPA and PPB are generated on the frame memory 63.

FIGS. 9A and 9B are diagrams illustrating examples of patterns CPA and CPB that are superimposed on the original image when generating different pattern images PPA and PPB, respectively.
Specifically, in the present embodiment, the pattern image generation unit 66B superimposes either the checkered first pattern CPA or the second pattern CPB as shown in FIGS. 9A and 9B on the original image. The first pattern image PPA and the second pattern image PPB, which are the pattern images, are generated. Among these, the pattern CPA is, for example, a rectangular non-transparent area SA (hatched area in FIG. 9) in which a gradation value of 50% is set uniformly and the pattern CPA are superimposed on the original image. The transmission area TA (the area that is not the shaded area in FIG. 9) through which the original image is transmitted is a pattern in which the matrix is alternately arranged vertically and horizontally. The pattern CPB is a pattern in which the non-transmissive area SA and the transmissive area TA in the pattern CPA are replaced with each other. Then, the pattern image generation unit 66B generates a pattern image PPA by superimposing the pattern CPA on the original image, and generates a pattern image PPB by superimposing the pattern CPB on the original image.

  10 and 11 are diagrams illustrating examples of images processed by the control unit 6B. Specifically, FIGS. 10A and 11A are diagrams showing original images BPA and BPB, respectively. FIGS. 10B and 11B show pattern images PPA and PPB, respectively. FIG. FIGS. 10C and 11C are diagrams showing binarized images DPA and DPB obtained by binarizing captured pattern images PPA and PPB, respectively. (D) is a diagram showing edge images EPA and EPB obtained by extracting edge components of the binarized images DPA and DPB.

  For example, when the image shown in FIGS. 10A and 11A is acquired as the original images BPA and BPB, the pattern image generation unit 66B superimposes the patterns CPA and CPB on the original images BPA and BPB, respectively. The pattern images PPA and PPB shown in FIGS. 10B and 11B are generated. The drive signals corresponding to the pattern images PPA and PPB are output by the drive control unit 64 under the control of the main control unit 61 after the drive signals corresponding to the original images BPA and BPB are output. Each of the pattern images PPA and PPB is displayed immediately before the original images BPA and BPB before the drive signal corresponding to the next frame of BPA and BPB is output.

[Configuration of display adjustment unit]
The display adjustment unit 67B corresponds to the adjustment unit of the present invention. The display adjustment unit 67B corrects the input image stored in the frame memory 63 based on the pattern images PPA and PPB captured by the imaging unit 21, and the focus adjustment unit 7 The position of the focus lens 531 is adjusted to adjust the focal position of the projected input image. The display adjustment unit 67B includes a binarization unit 677, an edge extraction unit 678, a pattern acquisition unit 679, a feature point extraction unit 672, a distance acquisition unit 673, a focus control unit 674, a relative angle calculation unit 675, and a trapezoidal distortion correction unit 676. It has.

The binarization unit 677 displays the pattern images PPA and PPB, acquires the pattern images PPA and PPB captured by the imaging unit 21 from the storage unit 65, and binarizes the pattern images PPA and PPB. Turn into. Specifically, the binarization unit 677, when the gradation values of the pixels constituting the pattern images PPA and PPB are equal to or less than the gradation values of the non-transparent areas SA of the patterns CPA and CPB, When the gradation value is the lowest value (shadow) and the gradation value of the pixel exceeds the gradation value of the non-transparent area SA, the image is captured with the gradation value of the pixel being the highest value (highlight). Each pattern image PPA, PPB is binarized.
For example, when the captured images of the pattern images PPA and PPB shown in FIGS. 10B and 11B are acquired, the binarization unit 677 is based on the gradation value of each pixel of the captured image. The binarized images DPA and DPB shown in FIGS. 10C and 11C are generated.

  Returning to FIG. 8, the edge extraction unit 678 extracts the edge component of the binarized image generated by the binarization unit 677. When the binarized images DPA and DPB are generated, the edge extracting unit 678 performs the above-described filtering process on the binarized images DPA and DPB, similarly to the feature point extracting unit 672. Then, the edge extraction unit 678 generates edge images EPA and EPB shown in FIGS. 10D and 11D in which edge components are extracted based on the binarized images DPA and DPB, respectively.

FIG. 12 is a diagram illustrating an example of the grid pattern G2 acquired from the edge image.
The pattern acquisition unit 679 generates a grid pattern G2 based on the generated edge image. For example, when the edge images EPA and EPB are generated, the pattern acquisition unit 679 extracts edge components common to both of the edge images EPA and EPB and complements the missing straight line. 12 is acquired.

Returning to FIG. 8, as described above, the feature point extraction unit 672 extracts the feature points C that are intersections of the straight lines constituting the grid pattern G2 based on the acquired grid pattern G2, and each of the feature points. Get the coordinates of C.
Then, the distance acquisition unit 673 acquires the distance to each feature point C from the coordinates of each feature point C, and the focus control unit 674 calculates the average value of the distance to each feature point C, and the focus The position of the focus lens 531 of the display unit 5 is adjusted by the adjusting unit 7 so as to be in focus.
Further, the relative angle calculation unit 675 calculates a relative angle between the screen SC and the projection direction by the projection optical device 53 of the display unit 5 based on the coordinates of each feature point C and each distance to each feature point C. Based on the calculated relative angle, the trapezoidal distortion correction unit 676 corrects the input image.

[Display adjustment processing]
FIG. 13 is a flowchart showing display adjustment processing by the projector 1B.
As in the projector 1A described above, the projector 1B performs steps SB01 to SB06, SA05 to SA09 as shown in FIG. The following display adjustment processing is performed.
In step SB01 of the display adjustment process, the pattern image generation unit 66B acquires an original image BPA that is an image for one frame from the input image from the frame memory 63, and generates a pattern image PPA based on the original image BPA. To do.

  In step SB02, the pattern image PPA is displayed by the drive control unit 64 and the display unit 5 after the display of the original image BPA and before the display of the next frame of the original image BPA. Then, the imaging unit 21 captures the displayed pattern image PPA and causes the storage unit 65 to store the captured image of the pattern image PPA.

In step SB03, the main control unit 61 determines whether or not a captured image corresponding to the pattern image has been acquired a plurality of times.
If it is determined that it has not been acquired, the main control unit 61 repeats step SB01 and causes the pattern image generation unit 66B to generate the pattern image PPB. In step SB02, the pattern image PPB is displayed, and the captured image of the pattern image PPB is acquired by the imaging unit 21.
On the other hand, if it determines with having acquired, the main control part 61 will transfer to step SB04.

In step SB04, the binarization unit 677 binarizes the captured images of the pattern images PPA and PPB stored in the storage unit 65, and generates binarized images DPA and DPB.
In step SB05, the edge extraction unit 678 extracts the edge components of the binarized images DPA and DPB, and generates the above-described edge images EPA and EPB.
In step SB06, the pattern acquisition unit 679 acquires the grid pattern G2 based on the edge images EPA and EPB.

As described above, the function units 672 to 676 calculate the coordinates of the feature points C constituting the grid pattern G2 (step SA05), obtain the distances to the feature points C (step SA06), and average the distances. Focus adjustment based on the value (step SA07), relative angle calculation (step SA08), and image correction (step SA09) are performed.
Thus, the display adjustment process ends. By such display adjustment processing, the focal position of the projection image is adjusted, and the trapezoidal distortion of the projection image is corrected.

According to the projector 1B of the present embodiment described above, in addition to the same effects as the effects (1) and (2) that can be achieved by the projector 1A, there are the following effects.
(5) The first pattern image PPA and the second pattern image PPB are generated by superimposing the first pattern CPA and the second pattern CPB including the transmissive area TA and the non-transmissive area SA on the original images BPA and BPB, respectively. According to this, the difference between the pattern images PPA and PPB and the original images BPA and BPB displayed immediately before the pattern images PPA and PPB can be reduced. Accordingly, the displayed pattern images PPA and PPB can be made more difficult to recognize.

(6) Binarized images DPA and DPB are generated based on the pattern images PPA and PPB, and edge images EPA and EPB are generated based on the binarized images DPA and DPB. Then, a grid pattern G2 is acquired based on the edge images EPA and EPB, and feature points C are extracted from the grid pattern G2. Then, the distance from the projector 1B to the feature point C is acquired, and the focus position of the input image is automatically adjusted based on the distance. According to this, it is possible to save time and effort for the user to adjust the focal position, and to appropriately display the input image.
Further, a relative angle between the projection surface and the projection direction of the input image is calculated based on the distance, and the input image is adjusted based on the relative angle. According to this, even when the projection surface is inclined with respect to the projection direction, it is possible to quickly adjust the shape of the displayed input image according to the inclination (to correct the trapezoidal distortion). it can.
Therefore, it is possible to save the user's trouble and display the input image quickly and appropriately.

[3. Modification of Embodiment]
The present invention is not limited to the above-described embodiment, and modifications, improvements, and the like within the scope that can achieve the object of the present invention are included in the present invention.
In each of the above embodiments, the pattern images PP, PPA, and PPB are generated based on the original images BP1, BPA, and BPB displayed immediately before each pattern image. However, the present invention is not limited to this. That is, the pattern image may be generated based on an input image for one frame displayed immediately after the pattern image, or a pattern image unrelated to the input image may be generated. . When the image BP2 displayed immediately after the pattern image is used as the original image and the pattern image PP is generated based on the original image BP2, the difference acquisition unit 671 described above includes the pattern image PP, the original image BP2, What is necessary is just to acquire the difference image DP used as the difference.

  In the first embodiment, it is assumed that the pattern image PP on which the grid pattern G1 is formed is generated. In the second embodiment, the transmissive areas TA and the non-transmissive areas SA are alternately arranged vertically and horizontally. Although the pattern images PPA and PPB are generated, the present invention is not limited to this. That is, the patterns included in these pattern images PP, PPA, and PPB do not have to be in a lattice pattern. For example, the pattern may be a polygonal pattern, or may be a pattern composed of a plurality of points that are not on the same straight line.

  In the above embodiments, the distances from the projectors 1A and 1B to the feature points C are acquired with reference to the LUT stored in the storage unit 65, but the present invention is not limited to this. For example, the position of the feature point in the displayed pattern image may be detected, and the distance from the projector to the feature point may be measured by distance measuring means such as a sensor.

  In each of the above embodiments, the display adjustment program for executing the display adjustment process is stored in the storage unit 65, but the present invention is not limited to this. For example, the program may be stored in a disk-type recording medium such as a CD and a DVD and a magnetic disk device such as an HDD (Hard Disk Drive), and read and executed as appropriate.

  In each of the embodiments, the front type projectors 1A and 1B in which the projection direction of the image light with respect to the screen SC and the observation direction of the image related to the image light are substantially the same are illustrated, but the present invention is not limited to this. . For example, the present invention can be applied to a rear type projector in which the projection direction and the observation direction are opposite directions.

  The present invention can be suitably used for a projector.

1 is a schematic perspective view showing a projector according to a first embodiment of the invention. The block diagram which shows the structure of the projector in the said embodiment. The figure which shows an example of the input image for 1 frame in the said embodiment. The figure which shows an example of the pattern image in the said embodiment. The figure which shows the transition at the time of displaying the pattern image in the said embodiment. The figure which shows the difference image in the said embodiment. The flowchart which shows the display adjustment process in the said embodiment. The block diagram which shows the structure of the projector which concerns on 2nd Embodiment of this invention. The figure which shows an example of the pattern in the said embodiment. The figure which shows an example of the image processed by the display adjustment part in the said embodiment. The figure which shows an example of the image processed by the display adjustment part in the said embodiment. The figure which shows an example of the grid pattern in the said embodiment. The flowchart which shows the display adjustment process in the said embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1A, 1B ... Projector, 5 ... Display means, 21 ... Imaging means, 66A, 66B ... Pattern image generation part (pattern image generation means), 67A, 67B ... Display adjustment part (adjustment means), 671 ... Difference acquisition part, 672 ... feature point extraction unit, 673 ... distance acquisition unit, 674 ... focus control unit (adjustment unit), 676 ... trapezoidal distortion correction unit (adjustment unit), 678 ... edge extraction unit, 679 ... pattern acquisition unit, PP ... pattern image, CPA: first pattern, CPB: second pattern, PPA: first pattern image (pattern image), PPB: second pattern image (pattern image).

Claims (9)

A projector that projects an input image according to input image information,
Display means for projecting the input image and displaying it within a predetermined area;
Pattern image generation means for generating a pattern image for adjusting the display state of the input image and displaying the pattern image between frames constituting the input image by the display means;
Imaging means for capturing an image displayed by the display means;
Adjusting means for adjusting the display state of the input image based on the pattern image imaged by the imaging means;
A projector comprising: The projector according to claim 1, wherein
The said pattern image generation means produces | generates the said pattern image based on the original image which is a flame | frame displayed at least any one of the said frame immediately before and after the said pattern image. The projector according to claim 2,
The projector according to claim 1, wherein the pattern image generation means generates the pattern image by changing a gradation value of a pixel constituting the original image. The projector according to claim 3, wherein
The adjusting means includes
A difference acquisition unit that acquires a difference between gradation values of pixels corresponding to each of the original image and the pattern image captured by the imaging unit;
A feature point extraction unit that extracts feature points included in the pattern image based on the acquired difference;
A distance acquisition unit that acquires a distance from the projector to the extracted feature point;
An adjustment unit that adjusts at least one of the focal position of the projected input image and the shape of the input image based on the acquired distance;
A projector comprising: The projector according to claim 2,
The pattern image generation means superimposes, as the pattern image, a first pattern in which a plurality of transparent regions through which the original image is transmitted and non-transparent regions through which the original image is not transmitted are superimposed on the original image. A projector that generates one pattern image. The projector according to claim 5, wherein
The pattern image generation unit generates the first pattern image and a second pattern image obtained by superimposing the second pattern in which the transmissive area and the non-transmissive area are replaced on the original image. And
The adjusting means includes
An edge extraction unit that extracts edge components from the first pattern image and the second pattern image captured by the imaging unit;
A pattern acquisition unit that acquires a pattern common to the first pattern and the second pattern from each of the extracted edge components;
A feature point extraction unit for extracting feature points from the acquired pattern;
A distance acquisition unit that acquires a distance from the projector to the extracted feature point;
An adjustment unit that adjusts at least one of the focal position of the projected input image and the shape of the input image based on the acquired distance;
A projector comprising: A display adjustment method for adjusting a display state of the projected input image, which is performed using a projector that projects and displays an input image corresponding to input image information,
A pattern image generation procedure for generating a pattern image for adjusting the display state of the input image;
A pattern image display procedure for displaying the pattern image between frames constituting the input image;
An imaging procedure for imaging the pattern image displayed by the display means;
An adjustment procedure for adjusting the display state of the input image based on the captured pattern image;
A display adjustment method characterized by comprising: A display adjustment program that is executed by a projector that projects and displays an input image corresponding to input image information and adjusts the display state of the projected input image,
A pattern image generation step of generating a pattern image for adjusting the display state of the input image;
A pattern image display step for displaying the pattern image between frames constituting the input image;
An imaging step of imaging the pattern image displayed by the display means;
An adjustment step of adjusting a display state of the input image based on the captured pattern image;
A display adjustment program characterized in that   9. A recording medium in which the display adjustment program according to claim 8 is recorded so as to be readable by a computer.

Images