JP6091133B2 - Projection type display device, control method used therefor, and program - Google Patents

Description

  The present invention relates to a projection display device such as a liquid crystal projector, and more particularly to display of a menu image.

  2. Description of the Related Art Conventionally, there is a projection display device that can move the display position of a menu image. Patent Document 1 discloses a method of displaying an operation key at an easy-to-use position according to the situation around the display screen.

JP 2009-221460 A

  However, when an image is projected using a blackboard, whiteboard, or the like as a screen, the text written on the screen and the menu image are superimposed, and the visibility of the menu image is reduced.

  Further, when using the edge blend function of the projection display device, there is another problem that the visibility of the menu image is lowered.

In order to solve the above problems, a projection display device of the present invention is
A projection display device that projects light modulated by a light modulation element onto a projection surface,
Imaging means for capturing a projected image;
Search means for searching for an area having the lowest spatial frequency among a plurality of areas included in the captured image captured by the imaging means;
It has a display means for displaying a menu image in a region which is searched by the search means, wherein are set the priority for a plurality of regions, the plurality of regions, the lowest region spatial frequency more If present, a menu image is displayed in a region having the highest priority among the plurality of regions .

A program as another aspect of the present invention is:
In a projection type display device having an imaging means capable of capturing a projection image,
An imaging step of capturing a projected image;
When a menu image is displayed in the area searched in the search step, when priority is set for the plurality of areas and there are a plurality of areas having the lowest spatial frequency, the plurality of areas exist. Among them, a display step of displaying a menu image in a region having the highest priority is executed.

A program as another aspect of the present invention is:
In a projection display device that projects light modulated by a light modulation element onto a projection surface,
Executing the step of moving the menu image to a position where the area where the image projected by the projection display apparatus and the image projected by another projection display apparatus overlap and the display area of the menu image do not overlap. A program characterized by

  According to the present invention, even when an image is projected on a screen on which characters or the like are written, a projection display device that can display a menu at a position where the visibility of the menu image is not deteriorated is provided. Can do.

  As another effect of the present invention, when the edge blend function of the projection display device is used, the menu can be displayed at a position where the visibility of the menu image is not lowered.

1 is a schematic configuration diagram of a projection display device according to a first embodiment of the present invention. The flowchart regarding determination of the display position of the menu image of Embodiment 1 of this invention. The figure which shows the captured image of Embodiment 1 of this invention. The figure which shows the projection image of Embodiment 1 of this invention. The figure which shows the character directly described on the screen of Embodiment 1 of this invention The figure which shows the differential amount map of Embodiment 1 and Embodiment 3 of this invention. Schematic configuration diagram of a projection display device according to a second embodiment of the present invention. The figure which shows the display position of the menu image at the time of the edge blend setting of Embodiment 2 of this invention The figure which shows the display position of a menu image when the edge blend width of Embodiment 2 of this invention is changed. The flowchart regarding determination of the display position of the menu image of Embodiment 5 of this invention

Embodiment 1
FIG. 1 is a schematic configuration diagram of a projection display apparatus 100 according to the first embodiment of the present invention. In the projection display apparatus 100, light from the light source 101 is guided to a light modulation element such as a liquid crystal panel via the illumination optical system 102 and the color separation / synthesis system 103. The light modulation element modulates incident light according to the input image signal. The modulated light is projected onto a projection surface such as a screen via the projection lens 104. The storage unit 107 stores the menu image itself (corresponding to a reference menu image to be described later) superimposed on the projection image, the display position of the menu image, information on divided areas to be described later, and the like. The control unit 105 is, for example, a microcomputer, and controls each unit of the projection display device 100. The imaging unit 106 is provided in the projection display device 100 so that a projected image can be captured.

  FIG. 2 is a flowchart regarding determination of the display position of the menu image according to the first embodiment. This flowchart is started when an instruction to display a menu image is received from a user via an operation unit such as a remote controller.

  First, in step S101, when the control unit 105 receives an instruction to display a menu image, the control unit 105 displays the menu image at the display position of the menu image stored in the storage unit 107, and proceeds to step S102.

  In step S102, the control unit 105 instructs the imaging unit 106 to perform imaging in a state where a pattern image for detecting the projection area is displayed in the next step. When imaging by the imaging unit 106 is completed, the process proceeds to step S103. Here, FIG. 3 shows an image captured by the image capturing unit 106, that is, an image on the screen that the user sees. The portion shown in black is an image (character) projected on the screen by the projection display device 100, and the portion shown in gray is a character written on the screen by the user. FIG. 4 and FIG. 5 show the images of FIG. 3 divided into images (characters) projected on the screen by the projection display apparatus 100 and characters directly written on the screen.

  When the imaging in step S102 is completed, in step S103, the control unit 105 detects an area where the projection display apparatus 100 projects an image from the captured image (captured image).

  In step S104, the control unit 105 performs projective transformation on the area detected in step S103, and converts the distorted image into an image (rectangular image) viewed from the front.

  Next, in step S <b> 105, the control unit 105 performs differentiation processing on the projectively transformed image. The differential process is a process for obtaining a differential value (inclination amount) between pixels from, for example, a difference between pixel values of adjacent pixels.

  In step S106, the control unit 105 creates a differential amount map as shown in FIG. 6A using the result of the differential processing. Each divided area shown in FIG. 6A is an area occupied by a menu image at a specific menu display position in a projective transformed image, and the value shown in each divided area is a differential value of a pixel in the divided area. Is the total differential amount (total differential value). In the present embodiment, it is assumed that the display position of the menu image displayed in step S101 is a position corresponding to the divided area M1.

  Next, in step S <b> 107, the control unit 105 searches for the divided area (the display position of the menu image) with the smallest total differential amount from the created differential amount map.

  In step S108, the control unit 105 displays a menu image at a position having the smallest total differential amount based on the search result. In the present embodiment, since the total differential amount of the divided area M2 in FIG. 6A is the smallest 0 (zero), the position corresponding to the divided area M2 is determined as the optimum position for displaying the menu image. A menu image is displayed there.

  According to the present embodiment, the menu can be displayed at a position where the visibility of the menu image is not deteriorated even when the image is projected while being superimposed on the projection surface on which characters or the like are written.

  FIG. 6A shown in step S106 of the present embodiment is simplified for explanation, and the number of matrices when creating the differential quantity map is not limited to 5 × 5, and the size of the menu image is shown. It can be changed to suit. Further, the plurality of divided regions may overlap each other depending on the required high visibility. Further, it is not necessary for the divided areas to occupy all the areas of the projective transformed image, and the divided areas may be set to be only the peripheral portion of the image. In the present embodiment, each divided area is set in advance, but may be set by the user.

  In the present embodiment, the sum of the differential values is used as a parameter when determining the display position of the menu image. However, the method using the differential values is limited as long as the method can identify a region having a low spatial frequency. I can't. In addition, the total sum of the differential values was used when creating the differential amount map, but the present invention is not limited to this. A straight line representing the differential value (inclination amount) between each pixel obtained by the differential processing or an approximation thereof. You may search the display position of a menu image using the parameter showing the smoothness of a curve.

  In the present embodiment, the form of searching for the display position of the menu image with respect to the image subjected to the projective transformation has been described. You may search.

<< Embodiment 2 >>
FIG. 7 is a schematic configuration diagram of a projection display apparatus 700 according to the second embodiment of the present invention. The difference from the first embodiment is that the projection display device 700 does not have the imaging unit 106, and the display position of the menu image is set so that the edge blend area and the menu image do not overlap when displaying the menu image. It is a point to control.

  In the projection display device 700, light from the light source 701 is guided to a light modulation element such as a liquid crystal panel via an illumination optical system 702 and a color separation / synthesis system 703. The light modulation element modulates incident light according to the input image signal. The modulated light is projected onto a projection surface such as a screen via a projection lens 704. The storage unit 707 stores the menu image itself (corresponding to a reference menu image to be described later) superimposed on the projection image, the display position of the menu image, information on divided areas to be described later, and the like. The control unit 705 is, for example, a microcomputer, and controls each unit of the projection display device 700.

  Here, the edge blend region (superimposition region) is an image projected by the projection display device 700 and another projection type when the projection display device 700 and another projection display device are arranged side by side to project one image. It is an area where the image projected by the display device overlaps. In recent years, in order to project a large image, two or more projection display devices are often arranged to project one image. Therefore, there is a function to display the edge blend area so that the user can understand each projection type display device appropriately and to change the width of the edge blend area according to the installation situation. Some are provided in a projection display device. In addition, if the image projected by the projection display device 700 and the image projected by another projection display device are superimposed as they are, the edge blend region becomes brighter, so the gradation value of the edge blend region is automatically adjusted. There is a function to do.

  In many cases, the user can select whether these functions are enabled or disabled. The edge blend in this embodiment is a function of automatically adjusting the gradation value of an area (edge blend area) where an image projected by the projection display apparatus 700 and an image projected by another projection display apparatus overlap. That is.

  FIG. 8A shows a state in which the menu image 202 is displayed at the end of the display area 201 when the edge blend is invalid. In this state, if the edge blend is enabled and the position of the menu image 202 is not changed, the menu image 202 and the edge blend area 203 overlap as shown in FIG. 8B, and the visibility of the menu image 202 is lowered. Resulting in.

  Therefore, in the present embodiment, as shown in FIG. 8C, when the edge blending is enabled, the position of the menu image is moved to the inside of the display region by an amount that the menu image 202 and the edge blend region 203 overlap. Let

  FIG. 9A shows a state in which edge blending is effective and a menu is displayed along the edge blend area 203. If the width of the edge blend area is changed from this state, the menu image 202 and the edge blend area 203 overlap as shown in FIG. 9B, and the visibility of the menu image 202 is lowered.

  Therefore, as shown in FIG. 9C, the menu image 202 is moved inside the display area in accordance with the amount of change in the width of the edge blend area.

  According to the present embodiment, the menu image can be displayed at a position where the visibility of the menu image is not deteriorated even when the edge blending is enabled or the width of the edge blend region is changed.

<< Embodiment 3 >>
The projection type display apparatus of Embodiment 3 of this invention has the structure similar to FIG. The difference from the first embodiment is that the display position of the menu image is determined according to the priority of the display position of the menu image in addition to searching the display position of the menu image having the smallest total differential amount from the differential amount map. It is a point to do. An example of the differential amount map in the present embodiment is shown in FIG.

  First, in the search step in step S107 of FIG. 2, the search is started from the display position of the menu image stored in the storage unit 107. Here, assuming that the display position of the menu image stored in the storage unit 107 is a position corresponding to the divided area A in FIG. 6B, the control unit 105 first starts searching from the divided area A. . Next, the right divided area B, the lower divided area C, and the left divided area D are searched in order in the clockwise direction. Of these, the optimum menu display position is a divided area having the lowest spatial frequency and a position in the early search order. That is, in this embodiment, the priority is the search order, and the priority is higher in the divided region with the earlier search order. In the present embodiment, there are a plurality of regions having the lowest spatial frequency, but the control unit 105 displays a menu image at a position corresponding to the divided region A having the highest priority.

  According to this embodiment, even when an image is projected on a projection surface on which characters or the like are written, the menu can be displayed at a position where the visibility of the menu image is not lowered.

  In the present embodiment, the search order is given as an example of priority as an example of priority, but the present invention is not limited to this. The priority is set for each divided region, the divided region having the lowest spatial frequency, and the priority. May be set as the position where the menu image is finally displayed.

  As in the present embodiment, setting the priority of the divided area A including the display position of the menu image stored in the storage unit 107 to the highest priority greatly changes the display position of the menu image. Since it is suppressed, it is more preferable.

<< Embodiment 4 >>
The projection type display apparatus of Embodiment 4 has the same configuration as FIG. The fourth embodiment further includes selection means for selecting whether to perform (valid) or not (invalid) the menu image display position search process described in the first embodiment.

  A control flowchart according to the fourth embodiment will be described. As in the first embodiment, the process is started when the user instructs display of the menu image.

  First, upon receiving a menu image display instruction from the user, the control unit 105 confirms whether the setting for searching for the display position of the menu image is valid or invalid. When the setting is invalid, the control unit 105 reads the display position of the menu image from the storage unit 107 and displays the menu image at the position. On the other hand, when the setting is valid, the control unit 105 performs control based on the flowchart of the first embodiment, and displays a menu image at a position corresponding to the region having the lowest spatial frequency.

  The validity or invalidity of the search processing for the display position of the menu image is selected by the user operating the operation unit.

<< Embodiment 5 >>
The projection display apparatus of Embodiment 5 has the same configuration as that in FIG. The difference from the first embodiment is that after the menu image is displayed according to the first embodiment, a re-search is performed according to the visibility of the displayed menu.

  FIG. 10 is a flowchart for performing re-search. This flowchart is a flowchart that can be executed after the flow of the first embodiment.

  First, step S301 is a state in which the menu image is displayed at the position determined by the method of the first embodiment. Here, it is assumed that the display position of the menu image at the position determined by the method of the first embodiment is a position corresponding to a divided area X (not shown).

  In step S302, the control unit 105 captures a projected image again, detects a projection area, and performs projective conversion of the captured image.

  In step S303, the control unit 105 detects a menu image from the image subjected to the projective transformation, and detects the detected menu image (hereinafter referred to as a captured menu image) and the menu image held by the storage unit 107 (hereinafter referred to as a reference). Comparison with menu image). Specifically, the difference between the captured menu image and the reference menu image is calculated. The difference in the present embodiment is a value obtained by summing up the absolute values of the difference between the corresponding pixel values of the captured menu image and the reference menu image.

  In step S304, if the difference between the captured menu image and the reference menu image exceeds a preset threshold value (YES in the figure), the control unit 105 proceeds to step S305. In step S305, the total differential amount of the divided area X corresponding to the position where the menu image is displayed in step S301 is set to the maximum value, and an area other than the divided area X (an area other than the area where the menu image is displayed). Then, the region having the smallest total differential amount is searched again. After the search, the process returns to step S301.

  On the other hand, when the difference between the captured menu image and the reference menu image does not exceed the threshold value (in the case of NO in the figure), the process proceeds to step S306, and the position where the menu image was displayed in step S301 is stored in the storage unit 107. This flow is finished.

  In the present embodiment, a menu image with better visibility can be displayed.

  In the fifth embodiment, whether or not to perform a re-search is determined based on whether or not the difference between the captured menu image and the reference menu image exceeds a threshold value, but is not limited thereto. For example, the similarity may be calculated by taking a correlation between the captured menu image and the reference menu image, and it may be determined whether to perform a re-search based on whether the similarity is high or low.

<< Other embodiments >>
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

DESCRIPTION OF SYMBOLS 100 Projection type display apparatus 105 Control part 106 Imaging part

Claims (9)

A projection display device that projects light modulated by a light modulation element onto a projection surface,
Imaging means for capturing a projected image;
Search means for searching for an area having the lowest spatial frequency among a plurality of areas included in the captured image captured by the imaging means;
Have a display means for displaying a menu image in a region which is searched by the searching means,
If priority is set for the plurality of regions, and there are a plurality of regions having the lowest spatial frequency among the plurality of regions, the region having the highest priority among the plurality of regions present A projection-type display device that displays a menu image on the screen . Having a projective transformation means for projective transformation of the projected image taken by the imaging means;
The projection display device according to claim 1, wherein the search unit searches for a region having the lowest spatial frequency in the projective transformed image.   The projection display device according to claim 1, wherein the search unit searches for a region having the lowest spatial frequency using a differential value between pixels. A storage unit for storing the display position of the menu image;
Projection display device according to claim 1 to 3, characterized in that the priority of a region including the display position of the menu image which the storage unit stores, set the highest priority. Projection display device according to any one of claims 1 to 4, characterized in that it has a setting means for enabling or disabling the search for a display position of the menu image by the search means. The imaging unit captures again the menu image displayed by the display unit,
When the difference between the captured menu image and the reference menu image stored in the storage unit exceeds the threshold, the search means selects the region having the lowest spatial frequency among the regions other than the region where the menu image is displayed. Explore again,
The display means, the projection type display device according to any one of claims 1 to 5, characterized in that displaying a menu image is searched by the search again region. A projection display device that projects light modulated by a light modulation element onto a projection surface,
Control means for moving the menu image to a position where the area where the image projected by the projection display apparatus and the image projected by another projection display apparatus overlap and the display area of the menu image do not overlap. Projection type display device characterized by the above. In a projection type display device having an imaging means capable of capturing a projection image,
An imaging step of capturing a projected image;
A search step for searching for a region having the lowest spatial frequency among a plurality of regions included in the captured image captured in the imaging step;
When a menu image is displayed in the area searched in the search step, when priority is set for the plurality of areas and there are a plurality of areas having the lowest spatial frequency, the plurality of areas exist. A program for executing a display step of displaying a menu image in an area having the highest priority . In a projection display device that projects light modulated by a light modulation element onto a projection surface,
Executing the step of moving the menu image to a position where the area where the image projected by the projection display apparatus and the image projected by another projection display apparatus overlap and the display area of the menu image do not overlap. A program characterized by

Images