JP2008294961A - Video display apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video display apparatus capable of projecting a video image on a video projection surface in any arbitrary shape to display such a video image as to cover a field of view of an observer. <P>SOLUTION: The present invention relates to a video display apparatus 1 in which a video image is projected on a video projection surface in any arbitrary shape by a video image projection unit, including: an observer field-of-view display unit 2 for displaying thereon a field of view of an observer; an observer field-of-view detection unit 13 for detecting the field of view of the observer displayed by the observer field-of-view display unit 2; a display video image detection unit 12 for detecting a video image projection range of the video image being projected on the video projection surface by the video image projection unit 11; a control arithmetic unit 14 and a video image projecting position moving unit 15 for moving the video image projection unit 11 in such a way as to reduce a difference between the field of view of the observer detected by the observer field-of-view detection unit 13 and the video image projection range detected by the display video image detection unit 12. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a video display device that displays an image that covers an observer's field of view by projecting an image on a video projection surface such as a wall or an arbitrary shape screen by a projector or the like.

  Conventionally, as a technique for projecting image light onto a screen by a projector and automatically positioning a projected image within a projection surface of the screen, there is a technique described in Patent Document 1 below.

  In general, an image display apparatus that projects image light emitted from a projector onto a screen generally performs projection by arranging a screen as a projection destination in front of the projector. In such a video display format, since projection can be performed only at a place depending on the installation position of the screen, there are many usage restrictions such as having to carry the projector to the installation position of the screen.

With respect to such restrictions, in the technique described in Patent Document 1, each luminance value is calculated at a plurality of predetermined positions in the screen on which the image light is projected, the outer edge of the screen is detected, and the projection of the projector By adjusting the position, the projection range of the image light is positioned within the screen.
JP 2006-313979 A

  However, in the technique described in Patent Document 1 described above, the projector is installed in a range where the image light reaches the screen, and the projection range is accommodated in the screen. The video projected from the projector cannot be displayed. Furthermore, the above-described Patent Document 1 describes only trapezoidal correction, gamma correction, and the like as image correction processing, and there are many restrictions such as that the shape of the screen needs to be a flat surface. Therefore, with the technique described in Patent Document 1 described above, it is difficult to display an image on an image projection surface having an arbitrary shape only by a projector.

  Therefore, the present invention has been proposed in view of the above-described circumstances, and an image display device capable of projecting an image on an image projection surface having an arbitrary shape and displaying an image that covers an observer's visual field. The purpose is to provide.

  The present invention is an image display device that projects an image on an image projection surface of an arbitrary shape by an image projection unit, and in order to solve the above-described problem, an observer field display means for displaying an observer's field of view An observer visual field detection means for detecting the visual field of the observer displayed by the observer visual field display means; a video projection range detection means for detecting the video projection range of the video projected on the video projection plane by the video projection unit; Video projection position moving means for moving the video projection unit so as to reduce the difference between the visual field of the observer detected by the observer visual field detection means and the video projection range detected by the video projection range detection means;

  According to the present invention, the image projection unit is moved so that the difference between the observer's field of view and the image projection range is small. Therefore, even if an image is projected on an arbitrarily shaped image projection surface, the observer's field of view is covered. Such an image can be displayed.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  For example, as shown in FIG. 1, the present invention is applied to a video display system in which an observer field-of-view display unit 2 is connected to a video display device 1 and a video is displayed on a wall or the like that is not a screen by the video display device 1. 1 does not show a video projection surface onto which the video light emitted from the video display device 1 is projected. However, this video projection surface is not a screen for a video display system, but a video display system. It is an arbitrarily shaped surface such as a wall of an installed room. In other words, the video display system covers the range with the video by detecting the range designated by the observer without requiring a screen. The detection of the range designated by the observer means, for example, that the observer's visual field is detected by the observer visual field display unit 2.

  In this video display system, the video display device 1 includes a video projection unit 11 including a projector that projects video light, a display video detection unit 12, and an observer visual field detection unit 13 connected to the observer visual field display unit 2. A control calculation unit 14 and a video projection position moving unit 15.

  The video projection unit 11 includes a projector that emits video light when video data is supplied. The function unit of the projector in the image projection unit 11 is mounted on a moving mechanism that rotates the emission position of the image light vertically and horizontally. This moving mechanism is the image projection position moving unit 15 shown in FIG. The image projection position moving unit 15 physically moves the image projection unit 11 such as a wheel type or a wave type that moves the image projection range by moving the emission position of the image light.

  Further, the image projection position moving unit 15 includes an extendable linear motion actuator that moves the image light emission position up and down, an extendable linear motion actuator that translates the image light emission position left and right, and an image light emission position. It is desirable to have means for moving the optical axis of the image light, such as a rotary actuator that rotates. This mechanism generates a driving force for moving the emission position of the image light in accordance with a control signal (difference data) from a control calculation unit 14 described later.

  Furthermore, the image projection position moving unit 15 can change the image projection range projected by the image projection unit 11 by controlling the focus function and zoom function of the image projection unit 11.

  The observer visual field display unit 2 emits visible light such as laser light or infrared light. The observer visual field display unit 2 is, for example, a pen-type pointer operated by the observer, which can display and specify the visual field center position in the video projection plane, and is a partial function of the projector. There are those that can display and specify the center position of the visual field in the projection plane. An image showing the observer field designated by the observer field display unit 2 is displayed by being superimposed on the video displayed on the video projection plane by the video projection unit 11. The observer can adjust the position of the image indicating the observer's field of view displayed on the video projection plane by the observer field of view display unit 2. Note that the image showing the observer's field of view may be an image showing the center position of the observer's field of view as a point, or may show the range of the observer's field of view as a circular image.

  The observer visual field detection unit 13 detects the position of an image showing the observer visual field displayed on the video by the observer visual field display unit 2. This observer visual field detection unit 13 has a camera and an image extraction function as a configuration for detecting an image showing the observer visual field superimposed on the video displayed in the video projection plane. The observer visual field detector 13 supplies the position of the image showing the observer visual field to the control calculator 14 as coordinate data.

  The display video detection unit 12 detects the projection range of the video displayed by the video projection unit 11. The display image detection unit 12 detects an image indicating the image center position that is displayed at the same time when an image is displayed by the image projection unit 11. The display video detection unit 12 has a camera and an image extraction function as a configuration for detecting the video projection range displayed in the video projection plane. The display video detection unit 12 supplies the video projection range to the control calculation unit 14 as coordinate data.

  The control calculation unit 14 detects a difference between the visual field of the observer detected by the observer visual field detection unit 13 and the video projection range detected by the display video detection unit 12. When the coordinate data indicating the center position of the observer visual field is supplied from the observer visual field detector 13, the control calculation unit 14 sets a predetermined range centered on the central position of the observer visual field as the range of the observer visual field. . Then, the control calculation unit 14 supplies the difference direction data indicating the difference between the image projection range and the range of the observer's field of view and the difference data indicating the difference amount to the image projection position moving unit 15.

  When the difference data is supplied from the control calculation unit 14, the image projection position moving unit 15, according to the difference data, the optical axis of the image light, the image projection radius from the image center, and the position of the image projection unit 11 itself. Move. Thereby, the video display system brings the video projection range by the video projection unit 11 closer to the range of the observer's visual field.

  In the video display system configured as described above, when video is displayed on a video projection surface having an arbitrary shape, the center of the observer's field of view is obtained by performing the processing in steps S1 to S3 as shown in FIG. In addition to the detection, the center position of the video projection range is detected by performing the processing of step S4 to step S6.

  In other words, when the observer visual field display unit 2 displays the center position of the observer visual field in step S1, the video display system searches for the central position of the observer visual field by the observer visual field detector 13 in step S2, and step S3 The observer visual field detector 13 determines whether or not the center position of the observer visual field has been detected. On the other hand, when the image projection unit 11 displays the image center position in step S4, the image display system searches for the image center position by the display image detection unit 12 in step S5, and in step S6, the image display unit 12 displays the image center position. It is determined whether or not the center position has been detected.

  When the observer visual field detection unit 13 can detect the center position of the observer visual field in step S3 and the display video detection unit 12 can detect the video central position in step S6, the video display system displays the video in step S7. The optical axis direction of the image light emitted from the image projection unit 11 is changed so that the center position matches the center position of the observer's visual field. The image projection position moving unit 15 drives the focus function, the zoom function, the rotation actuator, the linear motion actuator, and the like of the image projection unit 11, and thereby the optical axis of the image light emitted from the image projection unit 11 based on the difference data. And the image projection range is adjusted so that the difference from the range of the observer's field of view becomes small.

  Next, in step S8, the control calculation unit 14 determines the difference between the observer visual field range based on the central position of the observer visual field detected in step S3 and the video projection range based on the video central position changed in step S7. Thus, difference data is supplied to the image projection position moving unit 15 so that the image projection range approaches the range of the observer's visual field. Thereby, the image projection position moving unit 15 is driven so that the entire image projection range matches the range of the observer's visual field. Note that the video projection position moving unit 15 may use the zoom function and the focus function of the video projection unit 11 together so that the entire video projection range becomes the range of the observer's field of view.

  In the next step S9, the control calculation unit 14 of the video display system determines that the difference between the video projection range and the viewer field of view is within a predetermined range as a result of the video projection position moving unit 15 changing the video projection range in step S8. It is determined whether or not there is. Here, the control calculation unit 14 needs to set in advance a difference that allows the difference in the video projection range to be regarded as substantially 0 with respect to the range of the observer's visual field. At this time, the control calculation unit 14 determines whether the image projection range and the range of the observer field of view are based on the image center position detected by the display image detector 12 and the observer field detector 13 and the center position of the observer field of view. Find the difference. If the difference between the image projection range and the observer field of view becomes a small value within the predetermined range, the process ends. If the difference between the image projection range and the observer field of view is still large, the process proceeds to step S10. Proceed with the process.

  In step S10, the control calculation unit 14 determines the optical axis of the video light that needs to be further moved by the video projection position moving unit 15 based on the difference between the video projection range determined in step S9 and the range of the observer's visual field. The movement amount is calculated, and in step S11, the image projection position moving unit 15 is further driven. Then, the video display system performs the process of step S9 again. When it is determined that the difference between the video projection range and the observer field of view is within the predetermined range, the processing is terminated. Repeats step S10 and step S11 again.

  As described above, according to the video display system to which the present invention is applied, even when a video is presented in a space without a screen, the video projection unit 11 is set so that the video projection range matches the range of the observer's visual field. Therefore, it is possible to project an image on an image projection surface having an arbitrary shape and display an image that covers the visual field of the observer.

  In the description of the video display system described above, the video projection range may be adjusted a plurality of times, or the number of trials may be limited. That is, in step S9 in FIG. 2, after determining that the difference between the video projection range and the observer field of view is not within the predetermined range, the number of times to adjust the video projection range is determined to be the predetermined number of trials. If so, the process is terminated.

  In addition, a threshold value may be set in advance for the movement amount of the video projection unit 11 by a user setting operation, and the range of the observer's field of view may be notified when the movement amount of the video projection unit 11 exceeds the threshold value. Alternatively, it may be notified that the installation position of the video projection unit 11 is changed. Thereby, when the image projection range and the range of the observer's visual field are significantly separated, the image projection unit 11 can be moved by the observer.

  Further, regarding the adjustment of the video projection range and the observer visual field range, even if the video projection range and the observer visual field range are not substantially within the predetermined range in step S9, the observer performs an operation to complete the adjustment. If it is detected, it may be canceled.

  Next, in the video display system to which the present invention is applied, an example in which distortion correction processing is performed on the video data supplied to the video projection unit 11 will be described with reference to FIGS. The same parts as those in the video display system described above are denoted by the same reference numerals, and detailed description thereof is omitted.

  As shown in FIG. 3, the video display system includes a video projection plane on which a video projected by the video projection unit 11 is displayed after the video projection unit 11 is moved by the video projection position moving unit 15. A projection surface shape acquisition unit 21 that acquires a shape, and a distortion correction that performs distortion correction so that the image is not distorted when the image is projected toward the shape of the image projection surface acquired by the projection surface shape acquisition unit 21. And a unit 22.

  The distortion correction unit 22 generates video data obtained by distorting the planar image so that the planar image is visually recognized as an undistorted image from the observer when the planar image is projected on the video projection surface having an arbitrary shape. . For this purpose, the distortion correction unit 22 generates a distortion correction parameter as a parameter for distorting the planar video by the video projection unit 11. The distortion correction parameter based on the projection surface shape is a parameter for distorting the planar image so that the image can be seen without distortion when the planar image is projected onto the projection surface shape. Specifically, the distortion correction parameter is a coordinate conversion table for converting pixel coordinates of a plane image into pixel coordinates of a display image in order to display a prepared plane image without distortion.

  Further, this video display system may include a viewpoint position detection unit 23 that measures the viewpoint position of the observer as means for acquiring parameters for performing distortion correction by the distortion correction unit 22. In this case, the distortion correction unit 22 performs distortion correction so that the image displayed on the image projection plane can be seen without distortion from the viewpoint position of the observer measured by the viewpoint position detection unit 23.

  Such a video display system is changed when the video projection position moving unit 15 changes the optical axis of the video light based on the difference data, the video projection range, or the video projection unit 11 itself is moved. Information is supplied to the distortion correction unit 22. On the other hand, the distortion correction unit 22 performs distortion correction processing for generating a distortion correction parameter based on the input change information. This distortion correction parameter is supplied from the distortion correction unit 22 to the video projection unit 11. When the distortion correction parameter is supplied, the video projection unit 11 performs distortion correction using the distortion correction parameter on the video data, and projects video light with the corrected video data.

  The projection surface shape acquisition unit 21 emits visible light, infrared light, ultrasonic waves, and the like of the video projection unit 11 to the video projection surface, and the distance between the video projection unit 11 and the video projection surface based on the reflected light and the reflected wave. Ask for. The projection plane shape acquisition unit 21 obtains the distance from the video projection unit 11 for a plurality of points on the video projection plane and acquires the shape of the video projection plane. The distance data indicating the shape of the image projection plane is supplied to the distortion correction unit 22. The distortion correction unit 22 updates the distortion correction parameter based on the distance data. Thus, in the video display system, the video projection unit 11 performs distortion correction so that the viewer can see no distortion when viewing the video on the video projection surface. Note that the projection plane shape acquisition unit 21 may obtain the shape of the video projection plane by directly inputting the three-dimensional shape of the plane to be the video projection plane, for example, by reading CAD data.

  The viewpoint position detection unit 23 detects the viewpoint position of the observer when an image is displayed on the image projection plane. The viewpoint position detection unit 23 recognizes, for example, a marker such as infrared light displayed by the observer visual field display unit 2, a shape displayed by the observer visual field display unit 2, and the like, and determines the viewpoint position of the observer. To detect. The observer's viewpoint position is supplied to the distortion correction unit 22, for example, every predetermined period. The distortion correction unit 22 configures distortion correction parameters based on the viewpoint position of the observer. For example, if the observer's viewpoint position deviates from a predetermined recommended position, distortion that applies distortion correction to the image data so that the image can be observed without distortion even if the image on the image projection plane is observed from the deviated viewpoint position. Update to correction parameters.

  In such a video display system, the distortion correction unit 22 integrates both the projection surface shape acquired by the projection surface shape acquisition unit 21 and the observer's viewpoint position acquired by the viewpoint position detection unit 23. The distortion correction parameters are updated, and distortion correction is performed according to changes in the projection plane shape and the viewpoint position of the observer.

  As shown in FIG. 4, such a video display system first performs the processes of steps S <b> 1 to S <b> 11 described above, and sets the difference between the video projection range and the range of the observer's field of view to be substantially zero. Then, the processing after step S21 is performed.

  In step S21, the projection plane shape acquisition unit 21 acquires distances from the video projection unit 11 to the video projection plane for points on the plurality of video projection planes, and in step S22, calculates the projection plane shape. This projection plane shape is supplied from the projection plane shape acquisition unit 21 to the distortion correction unit 22.

  In the next step S23, the distortion correction unit 22 creates a distortion correction parameter based on the projection plane shape calculated in step S22, the distance between the video projection unit 11 and the projection plane shape, and the recommended viewpoint position. Note that this distortion correction parameter creation processing is another process that affects the distortion when an observer observes the video on the video projection plane, such as the angle of view of the video projection unit 11. A distortion correction parameter may be created by adding a value so that the image can be observed without distortion.

  As a result, even if the video projection surface onto which the video light is projected has an arbitrary shape, the video display system makes it possible to observe a video with suppressed distortion by creating a distortion correction parameter in accordance with the shape of the projection surface. Can do.

  In addition, when the video display system displays the video with the video data that has been subjected to distortion correction using the distortion correction parameter created in step S23 after the processing in step S23, in step S24, the viewpoint of the observer is displayed. It is determined whether or not the position has changed from the recommended viewpoint position. This determination is performed when the distortion correction unit 22 inputs the viewpoint position from the viewpoint position detection unit 23 every predetermined period.

  When it is determined that the viewpoint position of the observer has not been changed from the recommended viewpoint position or the previously acquired viewpoint position, the distortion correction unit 22 does not perform the process of changing the distortion correction parameter. On the other hand, when it is determined that the viewpoint position has been changed, in step S25, the distortion correction unit 22 updates the distortion correction parameter based on the changed viewpoint position, and in step S26, the distortion correction parameter is projected as a video. It outputs to the part 11 and performs distortion correction by the updated distortion correction parameter.

  As described above, according to the video display system to which the present invention is applied, an image subjected to distortion correction based on the projection plane shape can be displayed on the video projection plane, so that the range of the observer's field of view is covered. After the video projection range is changed, distortion correction can be performed according to the projection plane shape in the changed video projection range. Moreover, according to this video display system, even when the viewpoint position of the observer is deviated, it is possible to suppress distortion of the video viewed from the observer due to the deviation of the viewpoint position.

  Note that the method for inputting the viewpoint position may be changed according to the preference of the observer by the observer viewpoint position input mechanism, or may be a function for detecting a human face. In this case, the viewpoint position detection unit 23 considers that the observer's visual field is directly facing the video projection range, and searches for the observer's viewpoint. Furthermore, the viewpoint position detection unit 23 may detect the viewpoint position of the observer by communicating with the observer visual field display unit 2 using infrared rays or the like. Furthermore, the viewpoint position detection unit 23 may detect a specific object as the viewpoint position when detecting the viewpoint position of the observer.

  In addition, when there are a plurality of observers, it is possible to register an observer who is the optimum viewpoint position where the image distortion can be most suppressed and to observe the image with the least distortion from the registered observer. Alternatively, the distortion correction parameter may be set by optimizing the viewpoint position so that a plurality of observers have a uniform degree of distortion. In addition, when there are three or more observers, distortion correction parameters are set so that distortion is reduced for two or more of them, so that a specific person (s) can observe an image with the same distortion. Distortion correction can be performed.

  Next, in the video display system to which the present invention is applied, an example in which luminance correction is performed on the video displayed by the video projection unit 11 will be described with reference to FIGS. 5 and 6. The same parts as those in the video display system described above are denoted by the same reference numerals, and detailed description thereof is omitted.

  As shown in FIG. 5, the video display system includes a luminance distribution storage unit 31 that stores a luminance distribution of a video that is projected by the video projection unit 11 and displayed on the video projection plane, and a video that is displayed by the video projection unit 11. A luminance distribution measuring unit 32 that detects the luminance distribution of the video when projected onto the video projection plane, and the luminance distribution of the video detected by the luminance distribution measuring unit 32 is stored in the luminance distribution storage unit 31. And a brightness correction processing unit 33 that performs brightness correction so that

  The luminance distribution storage unit 31 holds the luminance information of the image to be projected in advance. This luminance distribution is set based on video data supplied to the video projection unit 11 and user settings. The luminance distribution stored in the luminance distribution storage unit 31 records basic luminance images (test patterns) in several steps, and data for correcting the luminance by projecting the video onto an arbitrary curved surface. It may be.

  The luminance distribution measurement unit 32 is, for example, a camera, images a video displayed on the video projection plane, calculates the luminance distribution of the video, and passes it to the luminance correction processing unit 33.

  The luminance correction processing unit 33 compares the luminance distribution stored in the luminance distribution storage unit 31 with the measured value of the luminance distribution by the luminance distribution measuring unit 32, and supplies correction data for correcting the luminance to the video projection unit 11. To supply. Here, the luminance distribution of the video stored in the luminance distribution storage unit 31 is a luminance distribution displayed when a plane image is projected onto a plane, and the luminance distribution measured by the luminance distribution measuring unit 32 is an arbitrary shape. It is a luminance distribution of the image | video displayed on the image | video projection surface. Therefore, the luminance correction processing unit 33 creates correction data that approximates the luminance distribution of the video displayed on the video projection surface having an arbitrary shape to the luminance distribution when the video is projected onto a plane as much as possible. This correction data indicates, for example, how much the luminance of each pixel data of the video is increased or decreased.

  When the correction data is generated by the luminance correction processing unit 33, it is desirable to generate the correction data so that the predetermined luminance distribution stored in the luminance distribution storage unit 31 is similar to the luminance distribution. That is, for example, if the predetermined luminance distribution is such that the luminance at the center of the video is the highest and the luminance at the end of the video is the lowest, if correction data can be created so as to be similar to the shape of the luminance distribution It is not necessary for the video portion with the highest luminance to have the same luminance as the predetermined luminance distribution.

  When the luminance distribution correction data is supplied from the luminance correction processing unit 33, the video projection unit 11 corrects the luminance of the video based on the correction data. As a result, an image having a luminance distribution close to a planar image can be displayed on the image projection surface.

  As shown in FIG. 6, such a video display system first performs the processes of steps S <b> 1 to S <b> 11 described above, and sets the difference between the video projection range and the range of the observer's field of view to be substantially zero. The processes after step S31 are performed.

  In step S31, the video projection unit 11 performs video projection for luminance correction. At this time, the video projection unit 11 may project a test pattern stored in advance in the luminance distribution storage unit 31.

  In the next step S32, the luminance distribution measuring unit 32 measures the luminance distribution of the image projected in step S31 for luminance correction.

  In the next step S33, the luminance correction processing unit 33 acquires a predetermined luminance distribution of the image projected in step S31 from the luminance distribution storage unit 31, and the predetermined luminance distribution and the measured luminance distribution are measured in step S32. Compare the brightness distribution. Then, correction data for making the luminance distribution of the video currently displayed on the video projection plane close to a predetermined luminance distribution is generated, and the video projection unit 11 performs luminance correction. Here, when the video display system includes the above-described distortion correction unit 22, correction data for the video after distortion correction is generated by the luminance correction processing unit 33 using the distortion correction parameter, and the video projection unit 11. To supply.

  In the next step S34, the luminance correction processing unit 33 compares the luminance distribution of the image displayed on the current image projection plane measured by the luminance distribution measuring unit 32 again with a predetermined luminance distribution, and corrects the corrected luminance. It is determined whether the luminance distribution is a difference within a threshold with respect to a predetermined luminance distribution. This threshold is determined by the user or the like when the video display system is introduced. For example, when a uniform luminance test pattern is displayed in step S31, it is determined whether or not the luminance unevenness is within a predetermined threshold value.

  If the corrected luminance distribution is within the threshold value with respect to the predetermined luminance distribution, the luminance correction is terminated. If not, the process returns to step S31 and the luminance correction is started again. To do.

  As described above, according to the video display system to which the present invention is applied, the luminance distribution is predetermined when the video is projected onto the video projection surface having an arbitrary shape and the video projection range is set to the range of the observer's field of view. Even when the brightness distribution is different from the brightness distribution, the brightness distribution can be corrected so that the image can be observed with the same brightness distribution as that of the planar image. As a result, the video display system can reproduce the luminance distribution close to the case where the video is projected on the flat screen even when the video is displayed on the video projection surface having an arbitrary shape.

  In addition, according to this video display system, by correcting the video brightness as well as correcting the video distortion, the video image with no distortion or brightness on the video projection surface of any shape is covered with the visual field specified by the observer. Such a display can be realized.

  Note that the luminance distribution correction data calculated by the luminance correction processing unit 33 can be corrected more accurately by repeatedly correcting the luminance distribution. Further, the luminance correction performed by the luminance correction processing unit 33 can adjust the correction accuracy by providing a threshold value for the average value of the number of repetitions of luminance correction or the difference in luminance distribution.

  If the luminance distribution of the video does not become the predetermined luminance distribution even after performing the luminance correction a predetermined number of times, a response such as changing the range of the observer's visual field may be notified. Furthermore, when it is difficult to reproduce a faithful luminance distribution, the luminance distribution may be corrected as a whole to increase or decrease the luminance of the original video while maintaining the luminance difference between adjacent pixels. Furthermore, it is possible to perform brightness correction according to the viewer's preference by allowing an observer to determine an operation mode in which no brightness correction is performed and an operation mode in which brightness correction is automatically performed.

  Next, an example in which color correction is performed on an image displayed by the image projection unit 11 in the image display system to which the present invention is applied will be described with reference to FIGS. The same parts as those in the video display system described above are denoted by the same reference numerals, and detailed description thereof is omitted.

  As shown in FIG. 7, this video display system includes a color distribution storage unit 41 that stores a color distribution of a video that is projected on a video projection plane by projecting a predetermined image pattern by the video projection unit 11, and a video projection unit. 11, the color distribution measuring unit 42 that detects the color distribution of the image when a predetermined image pattern is projected onto the image projection plane, and the color distribution of the image detected by the color distribution measuring unit 42 are stored in the color distribution storage unit 41. A color correction processing unit 43 that performs color correction so as to be close to the color distribution of the stored video. In this video display system, the color correction processing unit 43 performs color correction of the video based on the color distribution data (RGB, etc.) of the video to be projected onto the video projection plane and the color distribution of the video actually projected. The video projected on the video projection plane is projected with the original color distribution. In addition, although the function which corrects distortion and the function which correct | amends luminance distribution are not illustrated in FIG. 7, of course, you may provide.

  The color distribution storage unit 41 stores, for example, color information of 16 colors serving as basic colors as RGB values.

  The color distribution measurement unit 42 is, for example, a camera, captures an image displayed on the image projection plane, calculates an RGB color distribution of the image, and passes the image to the color correction processing unit 43.

  The color correction processing unit 43 compares the color distribution stored in the color distribution storage unit 41 with the measurement value of the color distribution measured by the color distribution measurement unit 42 and supplies correction data for color correction to the video projection unit 11. To supply. Here, the color distribution of the video stored in the color distribution storage unit 41 is, for example, a uniform color distribution displayed when the video is projected onto a white monochrome screen, and the color measured by the color distribution measurement unit 42. The distribution is a color distribution of an image displayed on a video projection surface having an arbitrary shape. Therefore, the color correction processing unit 43 creates correction data that approximates the color distribution of the video displayed on the video projection plane having an arbitrary shape as close as possible to the color distribution when the video is projected onto the monochromatic video projection plane. This correction data indicates, for example, how much the color of each pixel data of the video is increased or decreased.

  When the color distribution correction data is supplied from the color correction processing unit 43, the video projection unit 11 corrects the color of the video based on the correction data.

  As shown in FIG. 8, such a video display system first performs the processes of steps S <b> 1 to S <b> 11 described above to set the difference between the video projection range and the range of the observer's field of view to substantially zero. The process after step S41 is performed.

  In step S41, the video projection unit 11 performs video projection for color correction. At this time, the video projection unit 11 may project a monochromatic single-color video stored in advance in the color distribution storage unit 41.

  In the next step S42, the color distribution measuring unit 42 measures the color distribution of the image projected in step S41 for color correction.

  In the next step S43, the color correction processing unit 43 acquires a predetermined color distribution of the image projected in step S41 from the color distribution storage unit 41, and the predetermined color distribution and the measurement are measured in step S42. Compare the color distribution. Then, correction data for making the color distribution of the image currently displayed on the image projection plane close to a predetermined color distribution is generated, and the image projection unit 11 performs color correction. Here, when the video display system includes the distortion correction unit 22 described above, the color correction processing unit 43 generates correction data for the video after distortion correction using the distortion correction parameters, and the video projection unit 11. To supply.

  When a monochrome image is displayed in step S41, the color distribution storage unit 41 acquires information of each monochrome data as an RGB distribution in step S43. If the image projection surface, which is a wall, is not of a uniform color or material, even if a single color image is projected, an image with a uniform color will not be projected on the image projection surface, so correction to make the color distribution uniform Create data. The color correction processing unit 43 calculates how to correct each color and creates correction data.

  In the next step S44, the color correction processing unit 43 compares the color distribution of the image displayed on the current image projection plane again measured by the color distribution measuring unit 42 with a predetermined color distribution, and corrects the corrected color. It is determined whether the color distribution is a difference within a threshold with respect to a predetermined color distribution. This threshold is determined by the user or the like when the video display system is introduced. For example, when a uniform color test pattern is displayed in step S31, it is determined whether or not the color unevenness is within a predetermined threshold value.

  If the corrected color distribution is a difference within the threshold with respect to the predetermined color distribution, the process proceeds to step S45. If not, the process returns to step S31 to perform color correction again. Start. In step S45, it is determined whether or not the processing in steps S41 to S44 has been performed for all the preset colors. If it is determined that the correction has been completed for all the colors, the processing ends.

  Accordingly, the video display system displays, for example, a red single color video, measures the RGB distribution, creates correction data for each of RGB, displays a green single color video, measures the RGB distribution, and measures the RGB distribution. It is possible to create correction data for each of them, display a blue monochromatic image, measure the RGB distribution, and create correction data for each of RGB.

  As described above, according to the video display system to which the present invention is applied, the color distribution is predetermined when the video is projected onto the video projection surface having an arbitrary shape and the video projection range is set to the range of the observer's field of view. Even if the color distribution is different from the color distribution, the color distribution can be corrected and the video can be observed with the same color distribution as when the video is projected onto a white monochrome screen. As a result, the video display system can reproduce a color distribution close to that when an image is projected onto a flat screen even when a wall surface made of an arbitrary shape and a plurality of colors or different materials is used as a video projection surface.

  In addition, the video display system further includes the distortion correction unit 22 as described above, so that the color corrected by the distortion correction based on the positional relationship between the video projection unit 11 and the video projection surface or the shape of the video projection surface Distribution correction can be performed.

  The color distribution correction data calculated by the color correction processing unit 43 can be corrected more accurately by repeatedly correcting the color distribution. Further, the color correction performed by the color correction processing unit 43 can adjust the correction accuracy by providing a threshold value for the average number of color correction repetitions or color distribution differences. Furthermore, if the color distribution of the video does not become the predetermined color distribution even after the color correction is performed a predetermined number of times, a response such as changing the range of the observer's visual field may be notified. Further, when it is difficult to reproduce the faithful color distribution, correction may be performed so that the color is changed as a whole from the original video while maintaining the relative difference between the colors of adjacent pixels. Furthermore, it is possible to perform color correction according to the observer's preference by allowing the observer to determine an operation mode in which color correction is not performed and an operation mode in which color correction is automatically performed.

  Next, in the video display system to which the present invention is applied, an example in which the pixel size in the video displayed by the video projection unit 11 is corrected will be described with reference to FIG. 9, FIG. 10, and FIG. The same parts as those in the video display system described above are denoted by the same reference numerals, and detailed description thereof is omitted.

  As shown in FIG. 9, the video display system includes a projection plane distance acquisition unit 51 (distance detection unit) that detects a distance between the video projection unit 11 moved by the video projection position moving unit 15 and the video projection plane, Based on the distance detected by the projection plane distance acquisition unit 51, a pixel size calculation unit 52 that calculates the pixel size of the image on the entire surface of the image projection surface, and an image so that the pixel size is uniform on the entire surface of the image projection surface And a video correction processing unit 53 for correcting the above. This video display system obtains the shape of the video projection surface by calculating the distance from the video projection unit 11 to the video projection surface, and performs correction processing so that the pixels displayed on the video projection surface have a uniform size. Do. Note that FIG. 9 does not show a function for correcting distortion, or a function for correcting luminance distribution and color distribution, but of course may be provided.

  As the projection plane distance acquisition unit 51, for example, the visible light, infrared rays, and ultrasonic waves of the video projection unit 11 are emitted to the video projection surface, and the video projection unit 11 and the video projection surface are based on the reflected light and the reflected wave. For calculating the distance of the camera, or for calculating the distance by analyzing the video taken by the camera. The projection plane distance acquisition unit 51 obtains the distance from the video projection unit 11 for a plurality of points on the video projection plane, and acquires the shape of the video projection plane. The distance data indicating the shape of the image projection plane is supplied to the pixel size calculation unit 52.

  The pixel size calculation unit 52 calculates the distortion of the video caused by the distance from the distance data obtained from the projection plane distance acquisition unit 51. For example, when an image is projected on a plane facing the image projection unit 11, all the pixels (A1, A2, A3,..., B1, B2, B3, etc.) are displayed as shown in FIG. .., C1, C2, C3,... Are projected with the same size, but there are irregularities in the image projection plane and the distance from the image projection unit 11 is different, the result is as shown in FIG. As shown, there is a problem that only some pixels (A3, B3, C3,...) Become large. The pixel size calculator 52 detects the largest pixel in such a video projection plane, and sets all the pixels to the same size as shown in FIG. For example, when the number of pixels enlarged by the projections and depressions on the image projection surface is twice that of a normal size pixel, correction data is created with the pixels A1 and A2 as one pixel. This correction corresponds to a process of reducing the resolution of the video for the entire video displayed on the video projection plane. The pixel size correction data may be data indicating resolution, data indicating the maximum pixel size, or data indicating the aspect ratio of the maximum size.

  The video correction processing unit 53 performs correction processing on the video data based on the correction data supplied from the pixel size calculation unit 52 and supplies the video data to the video projection unit 11. At this time, the video correction processing unit 53 unifies the pixels on the video projection surface with the maximum pixel size according to the correction data, and mixes the color information of the pixels that constitute the corrected maximum size pixel to correct the image. The color information of the subsequent pixel is used. For example, as shown in FIG. 11C, when the pixel A1 and the pixel A2 are one pixel, the color information of the one pixel is an intermediate color between the pixel A1 and the pixel A2.

  As shown in FIG. 10, such an image display system first performs the above-described steps S1 to S11 and sets the difference between the image projection range and the range of the observer's field of view to be substantially zero. Then, the processing after step S51 is performed.

  In step S51, the projection plane distance acquisition unit 51 acquires the distances from the video projection unit 11 to the video projection plane for points on the plurality of video projection planes, and the pixel size calculation unit 52 determines the maximum pixel in step S52. Calculate the size. The pixel size calculation unit 52 uses the resolution when the video is composed with the maximum size as the correction data.

  In the next step S53, the video correction processing unit 53 corrects the resolution of the video data based on the correction data calculated in step S52.

  In the next step S54, the video correction processing unit 53 assigns color information to each actual pixel. At this time, it is determined which pixel color information of the video data after correction is included in the color information of the video data after correction, and the corrected video data is created.

  As described above, according to the video display system to which the present invention is applied, when the video is projected onto the video projection surface having an arbitrary shape and the video projection range is set to the range of the observer's field of view, Even when the pixel size does not become uniform over the entire image due to the shape, the size of all the pixels can be corrected to the maximum pixel size. Therefore, according to this video display system, even if a video is displayed on the unevenness of the wall surface, a video with uniform image quality can be displayed over the entire image.

  In addition, instead of the correction data calculated by the pixel size calculation unit 52, the aspect ratio of the pixels may be directly input to the video correction processing unit 53 by the observer. In addition, the process of determining the maximum pixel size may be manually input by the observer while viewing the image, and further, in the observer's field of view (within the image projection range), where the pixel size is not desired to be as large as possible. If an important range is present, an important range may be specified by a touch panel (not shown), and the pixel size of the important range may be uniform. Further, the pixel size outside the important range and the pixel size outside the important range may be separated. It may be set to.

  Next, in the video display system to which the present invention is applied, an example in which an important part in the video displayed by the video projection unit 11 is displayed will be described with reference to FIGS. The same parts as those in the video display system described above are denoted by the same reference numerals, and detailed description thereof is omitted.

  As shown in FIGS. 12 and 13, this video display system includes an important visual field display unit 61, which is within the range of the viewer's visual field and within the video projection range, in the video displayed on the video projection plane. A highlighted image that emphasizes a part (important part) is displayed.

  The important visual field display unit 61 is used to designate an important region in the video that the observer wants to pay attention to by visible light or infrared light. The important visual field display unit 61 is operated by, for example, an observer, and displays an area designated by the observer as important in the video projection range, like the observer visual field display unit 2. The important part designated by the important visual field display unit 61 is detected by the observer visual field detection unit 13.

  Coordinate data indicating an important part designated by the important visual field display unit 61 is supplied from the observer visual field detection unit 13 to the control calculation unit 14. The control calculation unit 14 gives the video projection unit 11 a control signal that makes the resolution of the important part higher than the resolution of the other important parts. As a result, the important part is highlighted and the line of sight is guided to the important part.

  For example, when the video projection unit 11 is composed of a single projector, the control calculation unit 14 displays a video with a difference in resolution between the important video range shown in FIG. 12 and other ranges. The video projection unit 11 is controlled. When the video display device 1 is a projector including a plurality of video projection units 11, the entire video projection range is displayed by the single video projection unit 11, and the important video range shown in FIG. Displayed by the unit 11. At this time, the video projection unit 11 that displays the important video range outputs a video having a higher resolution than the video projection unit 11 that displays other portions.

  Such a video display system performs the processing of steps S61 to S63 in parallel with the above-described steps S1 to S6, as shown in FIG.

  In this video display system, the above-described steps S1 to S6 are processes for recognizing the observer's visual field and video projection range, and perform preparations for bringing the video projection range closer to the observer's visual field (step S70). ). In parallel with step S70, the video display system performs steps S1 to S3 and steps S61 to S63 as processing for determining whether or not the important video range exists in the observer's field of view (step S63). S71). In addition, after the processing of Step S70 and Step S71, the processing of Step S7 to Step S11 is performed to bring the video projection range closer to the observer's field of view.

  In step S61, the video display system displays, for example, the visual field center in the important part in the video projection range by the important visual field display unit 61 by the operation of the observer, and in step S62, the visual field center of the important part is displayed by the observer visual field detection unit 13. Explore. When the observer visual field detection unit 13 detects the visual field center of the important part, the process proceeds to step S7.

  Next, the video display system controls the video projection unit 11 to perform the processes in steps S7 to S11 to display in the visual field range other than the important part, and to display the important part in the video projection range as the important visual field display unit. 61 is displayed (step S72).

  When there is one video projection unit 11, in step S <b> 72, the video projection unit 11 displays a video with a high resolution of the video projection range. In this state, the video projection position moving unit 15 displays the video. The projection range is moved. After the video projection range matches the observer's field of view in step S72, in step S80, the resolution of only the video in the important video range is maintained, and the resolution of the other video is reduced.

  When the video projection unit 11 is composed of a plurality of units, in step S72, a control signal for projecting a video in the important video range is supplied to the video projection unit 11 for displaying the video in the important video range. The video projection unit 11 that displays the entire video projection range is controlled to bring the video projection range detected in step S70 closer to the observer's field of view, similarly to the control described above. On the other hand, the video projection unit 11 that displays the important video range, in step S80, separately from the video projection range being moved by the video projection position moving unit 15, the important video indicated by the important visual field display unit 61. The video in the important video range is displayed by following only the range.

  As described above, according to the video display system to which the present invention is applied, when a video is projected onto a video projection surface of an arbitrary shape and the video projection range is set to the range of the observer's field of view, the video projection range You can highlight and display important parts of. For example, the video display device 1 emphasizes and displays the important part by increasing the resolution of the video in the important part as compared with the resolution of the video displayed by the video projection unit 11, and the viewer's line of sight is displayed. Can invite.

  Also, according to the video display system, the important part is always smaller than the observer's field of view, and by raising the resolution of the video compared to the surroundings, the video that can effectively draw attention or concentrate on the important part is displayed can do.

  In addition, as a case where the important visual field display part 61 and the control calculating part 14 are connected, any of wireless communications, such as infrared rays, and wired communications, such as serial communications and LAN, may be sufficient. Further, the number of important visual field ranges in the video projection range may be increased by increasing the important visual field display unit 61. Further, when the viewpoint positions of a plurality of observers are measured, the distortion may be minimized from the designated observer. In addition, when video is presented to multiple observers and multiple important parts are displayed, the important parts are allocated to each observer, and the distortion of each important part is minimized by each observer. Distortion correction may be performed so as to be limited.

  The above-described embodiment is an example of the present invention. For this reason, the present invention is not limited to the above-described embodiment, and various modifications can be made depending on the design and the like as long as the technical idea according to the present invention is not deviated from this embodiment. Of course, it is possible to change.

It is a block diagram which shows the structure of the video display system to which this invention is applied. It is a flowchart which shows the process sequence in the video display system to which this invention is applied. It is a block diagram which shows the structure which performs distortion correction when the viewpoint changes in the video display system to which this invention is applied. It is a flowchart which shows the process sequence which performs distortion correction, when the viewpoint changes in the video display system to which this invention is applied. It is a block diagram which shows the structure which performs the brightness | luminance correction | amendment of video data in the video display system to which this invention is applied. It is a flowchart which shows the process sequence which performs the brightness | luminance correction | amendment of video data in the video display system to which this invention is applied. It is a block diagram which shows the structure which performs the color correction of video data in the video display system to which this invention is applied. It is a flowchart which shows the process sequence which performs the color correction of video data in the video display system to which this invention is applied. It is a flowchart which shows the process sequence which adjusts a pixel size to the largest pixel size in the video display system to which this invention is applied. In the video display system to which the present invention is applied, since the pixel size changes depending on the shape of the projection surface, it is an explanatory diagram of processing for changing the pixel size to the maximum size in the entire video. It is a figure which shows a mode that pixel size changes in the video display system to which this invention is applied. It is a figure which shows a mode that the important video range of a video projection range is designated by the observer in the video display system to which this invention is applied. It is a block diagram which shows the structure which displays an important part in the image | video projection range in the image | video display system to which this invention is applied. It is a flowchart which shows the process sequence which displays an important part in the image | video projection range in the image | video display system to which this invention is applied.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Video display apparatus 2 Observer visual field display part 11 Video projection part 12 Display video detection part 13 Observer visual field detection part 14 Control calculating part 15 Video projection position moving part 21 Projection surface shape acquisition part 22 Distortion correction part 23 Viewpoint position detection part DESCRIPTION OF SYMBOLS 31 Luminance distribution memory | storage part 32 Luminance distribution measurement part 33 Luminance correction process part 41 Color distribution memory | storage part 42 Color distribution measurement part 43 Color correction process part 51 Projection plane distance acquisition part 52 Pixel size calculation part 53 Image correction process part 61 Important field display Part

Claims (7)

An image display device that projects an image by an image projection unit on an image projection surface of an arbitrary shape
An observer visual field display means for displaying an observer's visual field;
An observer visual field detection means for detecting the visual field of the observer displayed by the observer visual field display means;
Video projection range detection means for detecting a video projection range of the video projected by the video projection unit onto the video projection plane;
Video projection position moving means for moving the video projection unit so that a difference between the visual field of the observer detected by the observer visual field detection means and the video projection range detected by the video projection range detection means becomes small. An image display device comprising: A projection surface shape obtaining unit for obtaining a shape of a video projection surface on which an image projected by the video projection unit is displayed after the video projection unit is moved by the video projection position moving unit;
And further comprising distortion correction means for correcting distortion so that the image is not distorted when the image is projected toward the shape of the image projection plane acquired by the projection plane shape acquisition means. Item 2. The video display device according to Item 1. Viewpoint position measuring means for measuring the viewpoint position of the observer;
2. The apparatus according to claim 1, further comprising distortion correction means for performing distortion correction so that an image displayed on the image projection plane can be seen without distortion from an observer's viewpoint position measured by the viewpoint position measurement means. The video display device described in 1. A luminance distribution storage means for storing a luminance distribution of an image projected by the image projection unit and displayed on the image projection plane;
A luminance distribution detecting means for detecting a luminance distribution of an image when the image is projected onto the image projection plane by the image projection unit;
And a brightness correction unit configured to perform brightness correction so that the luminance distribution of the video detected by the luminance distribution detection unit approaches the luminance distribution of the video stored in the luminance distribution storage unit. The video display device according to any one of claims 1 to 3. Color distribution storage means for storing a color distribution of a video displayed on the video projection plane when a predetermined image pattern is projected by the video projection unit;
Color distribution detection means for detecting a color distribution of a video when a predetermined image pattern is projected onto the video projection plane by the video projection unit;
And a color correction unit configured to perform color correction so that the color distribution of the video detected by the color distribution detection unit approaches the color distribution of the video stored in the color distribution storage unit. The video display device according to any one of claims 1 to 4. Distance detecting means for detecting a distance between the image projection unit and the image projection plane;
Pixel size calculation means for calculating the pixel size of the image on the entire surface of the image projection surface based on the distance detected by the distance detection means;
6. The video display device according to claim 1, further comprising: a video correction unit that corrects a video so that a pixel size is uniform over the entire surface of the video projection surface. .   7. The highlighting for emphasizing a part of the image displayed on the image projection plane is displayed within the range of the visual field of the observer and within the image projection range. The video display device according to any one of the above.

Images