JP2024070341A - Projection display device, projection display system, control method for projection display device, and program - Google Patents

Abstract

[Problem] To provide a projection display device that is capable of performing highly accurate position adjustment while improving user convenience. [Solution] A projection display device (102) capable of projecting a first image and simultaneously projecting the first image and a second image by at least one other projection display device (101, 103), has an acquisition unit (206) that acquires an image captured by an imaging unit (105) that includes adjustment points used to adjust the second image, and a control unit (208) that performs control to project the captured image as the first image. [Selected Figure] Figure 1

Description

The present invention relates to a projection display device, a projection display system, a control method for a projection display device, and a program.

Conventionally, a projection display system is known that can project multiple images simultaneously using multiple projection display devices to project one overall image. Patent Document 1 discloses a method for adjusting the position of a projected image by performing keystone correction based on an image captured by a camera.

JP 2019-149633 A

The method disclosed in Patent Document 1 requires position adjustment using an external device such as a personal computer, which reduces user convenience. On the other hand, if position adjustment is attempted without using an external device, when the entire image covers a wide area, the distance from the user's position to the position of the adjustment point on the entire image becomes long, making it difficult to perform highly accurate position adjustment.

The present invention aims to provide a projection display device that is capable of performing highly accurate position adjustments while improving user convenience.

A projection display device according to one aspect of the present invention is a projection display device capable of projecting a first image and simultaneously projecting the first image and a second image by at least one other projection display device, and has an acquisition unit that acquires an image captured by an imaging unit, the image including adjustment points used to adjust the second image, and a control unit that controls the projection of the captured image as the first image.

Other objects and features of the present invention are described in the following embodiments.

The present invention provides a projection display device that is convenient for users and allows for highly accurate position adjustment.

1 is a configuration diagram of a projection display system according to a first embodiment. 4 shows examples of the arrangement of projected images in each embodiment. FIG. 4 is a configuration diagram of a projection unit in each embodiment. 6 is a flowchart showing an operation for adjusting the position of an image display area in the first embodiment. 11A and 11B are display examples of projected images during position adjustment in each embodiment. FIG. 11 is a configuration diagram of a projection display system according to a second embodiment. 10 is a flowchart showing an operation for adjusting the position of an image display area in the second embodiment.

The following describes in detail an embodiment of the present invention with reference to the drawings.

First Embodiment
First, a projection display system 100 according to a first embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is a configuration diagram of the projection display system 100. The projection display system 100 has projection units (projection display devices) 101, 102, and 103, a communication line 104 that communicably connects the projection units 101, 102, and 103, and an imaging unit 105. In this configuration, the projection display system 100 can simultaneously project an image (first image) from a first projection display device (e.g., the projection unit 102) and an image (second image) from a second projection display device (e.g., at least one of the projection units 101 and 103).

Projection units 101, 102, and 103 are, for example, projectors that project a projection image onto a projection surface such as a screen. In this embodiment, a case will be described in which three projection images projected by projection units 101, 102, and 103 are arranged on a screen to form one screen. Note that the arrangement of the projection images is not limited to this, and one screen may be formed by overlapping parts of at least two projection images.

Next, referring to FIG. 2, an example of the arrangement of the image display areas (projected images) of the projection units 101, 102, and 103 on the screen will be described. FIG. 2 shows an example of the arrangement of the projected images. In FIG. 2, rectangle 11 is the image display area of the projection unit 101. Rectangle 12 is the image display area of the projection unit 102, and is disposed adjacent to the right side of the image display area 11 of the projection unit 101. Rectangle 13 is the image display area of the projection unit 103, and is disposed adjacent to the right side of the image display area 12 of the projection unit 102. The image display area formed by the image display areas (rectangles 11, 12, and 13) of the projection units 101, 102, and 103 is called the entire image display area.

In FIG. 1, communication line 104 is a communication line such as a network. Projection units 101, 102, and 103 are connected to communication line 104 and can communicate with each other. Imaging unit 105 is a camera that captures the projected image displayed on the screen. Imaging unit 105 may be either a moving image or a still image camera. Imaging unit 105 may be connected to projection unit 102 via communication line 104, or may be built into projection unit 102. Imaging unit 105 outputs the captured image to projection unit 102. Note that imaging unit 105 may be provided in projection unit 101 or projection unit 103, rather than projection unit 102.

Next, an example of the internal configuration of the projection unit 101 will be described with reference to FIG. 3. FIG. 3 is a configuration diagram of the projection unit 101. The projection unit 101 has an image signal input unit 201, an image transformation unit 202, an image synthesis unit 203, a display device unit 204, a projection optical unit 205, a captured image input unit (acquisition unit) 206, an operation unit 207, and a control unit 208. The internal configurations of the projection units 102 and 103 are similar to that of the projection unit 101.

The image signal input unit 201 is an input terminal for image signals, such as HDMI (registered trademark) (High-Definition Multimedia Interface) and DisplayPort. The image signal input unit 201 is connected to an image signal output device, such as a personal computer or a video player. The image signal input unit 201 receives an image signal output by the image signal output device, and outputs the received image signal to the image transformation unit 202. The image transformation unit 202 transforms the image by performing distortion correction and keystone correction on the image signal. The image transformation unit 202 transforms the image signal input to the image signal input unit 201, and outputs the transformed image signal to the image synthesis unit 203.

The image synthesis unit 203 synthesizes images by superimposing and laying out multiple image signals. The image synthesis unit 203 synthesizes the image signal output from the image transformation unit 202, the captured image input to the captured image input unit 206, and OSD (on-screen display) such as markers drawn by the control unit 208, and outputs the synthesized image signal to the display device 204.

The display device unit 204 includes a light modulation device having a large number of pixels, such as a liquid crystal panel or a DMD (digital mirror device). For example, when the display device unit 204 is a three-panel type, the light output from the light source is separated into three colors (RGB), and each of the separated lights is modulated by a light modulation device according to an image signal for each color. On the other hand, when the display device unit 204 is a single-panel type, the color-sequential light output from the light source is modulated by a light modulation device according to an image signal for each color. The display device unit 204 also combines the modulated light and outputs the combined light to the projection optical unit 205. The projection optical unit 205 is configured with a projection lens and the like, and projects the light modulated by the display device unit 204 onto a screen via the projection lens, while also performing focus control, zoom control, and the like.

The captured image input unit 206 is an input terminal that inputs the captured image acquired by the imaging unit 105. The captured image input unit 206 outputs the input captured image to the image synthesis unit 203. The operation unit 207 is a user interface such as an operation button or a remote control. The operation unit 207 outputs operation information to the control unit 208 in accordance with the user's operation. The control unit 208 controls the image deformation unit 202 and the image synthesis unit 203 based on the operation information. The control unit 208 is also connected to the communication line 104 and communicates with other projection units (projection units 101, 102).

Next, referring to FIG. 4, the operation of adjusting the position of the entire image display area formed by the projection images (image display areas) of the projection units 101, 102, and 103 by operating the projection unit 102 via a remote control (remote control device) by the user will be described. FIG. 4 is a flowchart showing the operation of adjusting the position of the entire image display area. Note that in FIG. 4, the adjustment points used to adjust the position of the entire image display area are described as the four vertices of the upper left, upper right, lower left, and lower right of the entire image display area. However, this embodiment is not limited to this, and any point of the entire image display area can be used as the adjustment point. Also, in FIG. 4, the projection unit 102 is described as the master projection unit, and the projection units 101 and 103 are described as slave projection units, but this is not limited to this, and either of the projection units 101 and 103 may be the master projection unit.

First, in step S11, the user operates the operation unit 207, such as a remote control or an operation button, to instruct the start of position adjustment of the entire image display area. Then, in step S12, the control unit 208 of the projection unit 102, which is the master projection unit, receives information (operation information) indicating the start of position adjustment of the entire image display area.

Next, in step S13, the control unit 208 instructs the projection unit 101, which is the slave projection unit, to display a marker (index) indicating the adjustment point at the position of the upper left vertex of the current projection image (second projection image) in order to adjust the position of the upper left vertex, which is the first adjustment point, of the entire image display area. Then, in step S14, the projection unit 101 displays a marker indicating the position of the upper left vertex of the projection image.

Next, in step S15, the imaging unit 105 captures an image of an area (image area) including the marker. Then, the captured image input unit 206 of the projection unit 102 acquires the captured image captured by the imaging unit 105.

Next, in step S16, the control unit 208 of the projection unit 102 displays an area of the captured image that includes the markers that are adjustment points in the image display area of the projection unit 102 (projects it as the image (first image) displayed by the projection unit 102).

Now, referring to FIG. 5, the projection image of the projection type display system 100 during position adjustment will be described. FIG. 5 is an example of the display of the projection image during position adjustment. In FIG. 5, rectangle 11 is the image display area (second image) of the projection unit 101, rectangle 12 is the image display area (first image) of the projection unit 102, and rectangle 13 is the image display area of the projection unit 102. A marker (adjustment point, index) 14 is displayed at the top left vertex of the entire image display area. The image display area of the projection unit 102 displays an image captured by the imaging unit 105, i.e., an image 15 acquired by capturing an image of an area (adjustment area) including the marker 14.

Next, in step S17, the user operates the operation unit 207 of the projection unit 102 to move the marker 14 to the position to which it is to be adjusted. This allows the upper left position of the entire image display area to be adjusted. At this time, the image deformation unit 202 of the projection unit 101 may perform image deformation in conjunction with the position of the marker 14. The captured image 15 of the area including the marker 14 captured by the imaging unit 105 is enlarged and displayed in the image display area of the projection unit 102. That is, the captured image 15 of the marker 14, which is the adjustment point of the image display area (second image) of the other projection unit (for example, the projection unit 101), is displayed in the image display area (first image) of the projection unit 102 that receives the user's operation for position adjustment.

Next, in step S18, the control unit 208 of the projection unit 102 determines whether or not adjustment of the position of the upper left vertex has been completed. If it is determined that the position adjustment has been completed, the process proceeds to step S19. On the other hand, if it is determined that the position adjustment has not been completed, the process returns to step S15, and the control unit 208 continues adjusting the position.

In step S19, the other adjustment points (the positions of the upper right, lower left, and lower right vertices) are adjusted in the same manner as in steps S13 to S18 for adjusting the position of the upper left vertex. The control unit 208 of the projection unit 102 calculates the trapezoid correction parameters of the image transformation units 202 of the projection units 101, 102, and 103 so that the entire image display area matches the positions of the upper left, upper right, lower left, and lower right vertices adjusted by the user. The control unit 208 then sets the calculated parameters to each of the projection units 101, 102, and 103. The projection units 101, 102, and 103 transform the input image according to the set trapezoid correction parameters, thereby displaying the entire image display area with the adjusted position.

According to this embodiment, when adjusting the position of the image display area, a captured image of the adjustment point (marker) displayed in the image display area of another projection unit is displayed in the image display area of the projection unit 102 that receives the user's position adjustment operation. This allows the user to adjust the position with high precision without having to approach the location where the position adjustment marker is displayed. As a result, the convenience of position adjustment can be improved when there are a large number of projection units or when the adjustment point in the entire image display area is far away due to wide-area projection.

In this embodiment, the position of the entire image display area of the projection units 101, 102, and 103 is adjusted via the operation unit 207 of the projection unit 102, but the present invention is not limited to this. This embodiment can also be applied when adjusting the position of the image display area of other projection units (for example, the image display area of only the projection unit 101) via the operation unit 207 of the projection unit 102. For example, an image obtained by capturing an image of an area including the adjustment point markers at the upper left, upper right, lower left, and lower right of the image display area of the projection unit 101 other than the projection unit 02 via the operation unit 207 of the projection unit 102 may be displayed in the image display area of the projection unit 102. Even in this case, the position can be adjusted with high accuracy even if the user does not approach the location where the position adjustment markers displayed on the projection unit 101 are displayed. In this embodiment, the imaging unit 105 is connected to the projection unit 102 that receives the user's operation, but the present invention is not limited to this. For example, the imaging unit 105 may be connected to the projection unit 101 or the projection unit 103.

Second Embodiment
Next, a projection type display system 100a according to a second embodiment of the present invention will be described with reference to Fig. 6. Fig. 6 is a configuration diagram of the projection type display system 100a. In the projection type display system 100 according to the first embodiment, an image capturing unit 105 is connected to one of the three projection units 101, 102, and 103 (projection unit 102 in Fig. 1). On the other hand, the projection type display system 100a according to this embodiment differs from the first embodiment in that an image capturing unit is connected to each of the three projection units 101, 102, and 103. The following mainly describes the differences from the first embodiment.

Projection display system 100a has projection units (projection display devices) 101, 102, 103, communication line 104 that communicatively connects projection units 101, 102, 103, and image capture units 301, 302, 303. Note that projection units 101, 102, 103 and communication line 104 are the same as in the first embodiment, and therefore their description is omitted. An example of the arrangement of the projection images of projection units 101, 102, 103 on the screen is as shown in FIG. 2.

The imaging units 301, 302, and 303 are cameras that capture the projection image displayed on the screen. The imaging unit 301 is connected to the projection unit 101 and captures the image display area of the projection unit 101. The imaging unit 302 is connected to the projection unit 102 and captures the image display area of the projection unit 102. The imaging unit 303 is connected to the projection unit 103 and captures the image display area of the projection unit 103. The imaging units 301, 302, and 303 may be built into the projection units 101, 102, and 103, respectively.

Next, referring to FIG. 7, the operation of adjusting the position of the whole image display area formed by the projection images (image display areas) of the projection units 101, 102, and 103 by operating the projection unit 102 via a remote control (remote control device) by the user will be described. FIG. 7 is a flowchart showing the operation of adjusting the position of the whole image display area. Note that in FIG. 7, as in FIG. 4, the adjustment points used to adjust the position of the whole image display area will be described as the four vertices at the top left, top right, bottom left, and bottom right of the whole image display area. Also, in FIG. 7, as in FIG. 4, the projection unit 102 will be described as the master projection unit, and the projection units 101 and 103 as the slave projection units. Note that in FIG. 7, steps S21 to S24 and S27 to S29 are the same as steps S11 to S14 and S17 to S19 in FIG. 4, respectively, and therefore their description will be omitted.

In step S25, the imaging unit 301 connected to the projection unit 101 captures an image of an area (image area) including the marker. The captured image input unit 206 of the projection unit 101 acquires the captured image captured by the imaging unit 301. The projection unit 101 then transmits the acquired captured image via the communication line 14 to the projection unit 102, which is the master projection unit. The captured image input unit 206 of the projection unit 102 acquires the captured image of the imaging unit 301 via the communication line 14.

Next, in step S26, the control unit 208 of the projection unit 102 displays an area of the captured image that includes the marker, which is the adjustment point, in the image display area of the projection unit 102 (projects it as the image (first image) displayed by the projection unit 102). In FIG. 5, the captured image captured by the imaging unit 301, i.e., captured image 15 obtained by capturing an image of the area (adjustment area) that includes marker 14, is displayed in the image display area of the projection unit 102.

According to this embodiment, when adjusting the position of the entire image, an image of the marker displayed in the image display area of another projection unit is displayed in the image display area of the projection unit 102 that receives the user's operation for position adjustment. In this embodiment, this displayed image is an image captured by an imaging unit connected to a projection unit other than the projection unit 102 that receives the user's operation. Therefore, the position can be adjusted with high accuracy without approaching the location where the position adjustment marker is displayed. This improves the convenience of position adjustment when there are many projection units or when projecting over a wide area and the entire image display area is far away.

Other Embodiments
The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

According to each embodiment, it is possible to provide a projection display device, a projection display system, a control method for a projection display device, and a program that are capable of performing highly accurate position adjustment while improving user convenience.

The disclosure of each embodiment includes the following configurations and methods:

(Configuration 1)
A projection display device capable of projecting a first image and simultaneously projecting the first image and a second image by at least one other projection display device,
an acquisition unit that acquires a captured image including an adjustment point used to adjust the second image, the image being captured by an imaging unit;
a control unit that performs control so as to project the captured image as the first image.
(Configuration 2)
Further comprising an operation unit operable by a user,
2. The projection display device according to configuration 1, wherein the control unit performs the control based on a signal from the operation unit.
(Configuration 3)
3. The projection display device according to configuration 1 or 2, wherein the imaging section is connected to the projection display device or the at least one other projection display device.
(Configuration 4)
3. The projection type display device according to configuration 1 or 2, wherein the imaging section is built in the projection type display device or the at least one other projection type display device.
(Configuration 5)
5. The projection display device according to any one of configurations 1 to 4, wherein the adjustment point is used to adjust an image display area including the first image and the second image projected simultaneously.
(Configuration 6)
6. The projection display device according to configuration 5, wherein the adjustment point is at least one of the four vertices of the image display area.
(Configuration 7)
A projection type display device described in any one of configurations 1 to 4, characterized in that the adjustment point is used to adjust the image display area of the second image of the first image and the second image that are simultaneously projected.
(Configuration 8)
8. The projection display device according to any one of configurations 1 to 7, wherein the control unit performs the control so as to enlarge and display an area including the adjustment point.
(Configuration 9)
A projection display system having a first projection display device, a second projection display device, and an imaging unit, capable of simultaneously projecting a first image from the first projection display device and a second image from the second projection display device,
The first projection type display device includes:
an acquisition unit that acquires a captured image including an adjustment point in the second image captured by the imaging unit;
a control unit that performs control so as to project the captured image as the first image.
(Method 1)
1. A method for controlling a projection display device capable of projecting a first image and simultaneously projecting the first image and a second image by at least one other projection display device, comprising:
acquiring a captured image including adjustment points used to adjust the second image, the image being captured by an imaging unit;
and performing control so as to project the captured image as the first image.
(Configuration 10)
A program for causing a computer to execute the control method according to method 1.

The above describes preferred embodiments of the present invention, but the present invention is not limited to these embodiments, and various modifications and variations are possible within the scope of the gist of the invention.

101, 102, 103 Projection unit (projection type display device)
105, 301, 302, 303 Imaging unit 206 Captured image input unit (acquisition unit)
208 Control unit

Claims (11)

A projection display device capable of projecting a first image and simultaneously projecting the first image and a second image by at least one other projection display device,
an acquisition unit that acquires a captured image including an adjustment point used to adjust the second image, the image being captured by an imaging unit;
a control unit that performs control so as to project the captured image as the first image. Further comprising an operation unit operable by a user,
2. The projection display device according to claim 1, wherein the control unit performs the control based on a signal from the operation unit. The projection display device according to claim 1, characterized in that the imaging unit is connected to the projection display device or to at least one of the other projection display devices. The projection display device according to claim 1, characterized in that the imaging unit is built into the projection display device or the at least one other projection display device. The projection display device according to claim 1, characterized in that the adjustment points are used to adjust an image display area including the first image and the second image that are simultaneously projected. The projection display device according to claim 5, characterized in that the adjustment point is at least one of the four vertices of the image display area. The projection display device according to claim 1, characterized in that the adjustment points are used to adjust the image display area of the second image of the first image and the second image that are simultaneously projected. The projection display device according to any one of claims 1 to 7, characterized in that the control unit performs the control so as to enlarge and display the area including the adjustment point. A projection display system having a first projection display device, a second projection display device, and an imaging unit, capable of simultaneously projecting a first image from the first projection display device and a second image from the second projection display device,
The first projection type display device includes:
an acquisition unit that acquires a captured image including an adjustment point in the second image captured by the imaging unit;
a control unit that performs control so as to project the captured image as the first image. 1. A method for controlling a projection display device capable of projecting a first image and simultaneously projecting the first image and a second image by at least one other projection display device, comprising:
acquiring a captured image including adjustment points used to adjust the second image, the image being captured by an imaging unit;
and performing control so as to project the captured image as the first image. A program for causing a computer to execute the control method described in claim 10.