JP2019047355A - projector - Google Patents

Abstract

To solve such a problem in the conventional alignment where four corners of superposition region are adjustable, that although it is adjustable finally, undeformable state may be brought about by the adjustment order of four corners, and it is difficult for the user to understand.SOLUTION: A projector includes control means for controlling to fix the vertex of a projection image, if it is impossible to project, when a user moves on each vertex of a superposition region, to make the vertex of the projection image movable when adjustable by moving other vertex of the superposition region, and to fix the vertex if the vertex of the projection image is impossible to project, when the user moves on each vertex of the superposition region, and making the vertex of the superposition region unmovable when not adjustable even if other vertex of the superposition region is moved.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image projection apparatus that projects an image.

  Conventionally, as a projector (projector), there is known a projector which projects and displays an image generated by a light valve such as a liquid crystal panel on a screen. In recent years, the resolution of images has been increased, and for example, it is desired to display an image with a large number of pixels such as 4K2K and 8K4K on a large screen. Generally, in order to increase the number of pixels of a projector and increase the screen size, it is necessary to miniaturize a light valve such as a liquid crystal panel or to employ a high-intensity light source, resulting in an increase in cost. Therefore, multi-projection using a plurality of inexpensive projectors having ordinary light valves and light sources often performs multi-pixel, large-screen projection display.

  Multi-projection is a projection method in which projection images of a plurality of projection devices are connected together on a projection surface (screen) so that one image is displayed as a whole. When joining a plurality of projected images, if the positions are not precisely aligned, a seam is visually recognized, which leads to a reduction in the image quality of the projected images. For this purpose, a process called edge blending is used to make seams inconspicuous. In the edge blending process, a plurality of projected images are partially overlapped and connected. Then, by performing the light reduction processing on the superimposed region, the level difference of the illuminance of the superimposed region and the non-superposed region is made inconspicuous.

  On the other hand, there are cases where the projector can not be installed in front of the screen due to restrictions of the installation location. In this case, due to the relative tilt of the projector body with respect to the screen, geometric distortion called trapezoidal distortion may occur in the projected image on the screen. There is a projector having a keystone correction function of correcting this keystone distortion by image processing. Patent Document 1 describes in detail a calculation method of keystone correction (keystone correction) based on the relative inclination angle between one projector body and the screen.

  When multi-projection is performed, it is necessary to make both trapezoidal correction and accurate alignment of the overlapping region compatible with each other, and the work of main body installation and correction setting becomes complicated. In a projector that does not have a lens shift function, it is necessary to move the projector body to align the overlapping area, but this changes the relative position between the projector and the screen, so that it is necessary to reset the keystone correction. . Therefore, it is necessary to repeat the alignment of the main body and the keystone correction.

  According to Patent Document 2, trapezoidal correction is performed by aligning the four corners of the projection image of each projector with the edge of the screen at the time of multi-projection, and guides displayed in the superposition region of each projector are superimposed. A method of aligning has been proposed.

  Here, since the projection area is usually much larger than the overlap area, even if the positions of the four corners of the projection area are adjusted, the overlap areas rarely match exactly. In that case, it is necessary to finely adjust the four corners of each projector so as to make them fit exactly, and there is a problem that the procedure becomes complicated.

  According to Patent Document 3, when performing multi-projection using a plurality of projection devices, it is possible to easily perform positioning of the superposition area and setting of keystone correction by making the four corners of the superposition area adjustable. It will be possible.

JP, 2005-123669, A JP, 2009-200613, A JP, 2014-078872, A

  However, in the conventional alignment in which the four corners of the overlapping area are adjustable, although projection is finally adjustable, depending on the adjustment order of the four corners, projection of the projection area is continued because it becomes impossible to deform. There were times when it became difficult or impossible to make adjustments.

  According to the present invention, there is provided a projector which constitutes an image projection system for projecting one image by superimposing a part of a plurality of projection images projected by a plurality of projectors and connecting them on a screen. The deformation means for geometrically deforming the image, the setting means for setting the parameters of the deformation process by the deformation means, and the setting means are for the overlapping region in the projected image before the deformation by the deformation means. The parameters of the deformation process are set based on the relationship between the position and the position of the superimposed area in the projected image after deformation, and when the user moves each vertex of the superimposed area, the vertex of the projected image is projected If possible, make it possible to move the vertices of the overlap area, and if the user can move each vertex of the overlap area, the vertices of the projection image can not be projected, Fix the top of the superimposed area and move the other top of the superimposed area to make adjustments, if possible, move the top of the superimposed area, and when the user moves each vertex of the superimposed area, the top of the projected image If it is impossible to project, the vertex is fixed, and if it is impossible to adjust even if moving the other vertex of the overlap region, control is performed so that the vertex of the overlap region can not move. Characterized in that it comprises means.

  According to the present invention, in the multi-projection installation work with overlapping areas, the adjustment of the overlapping areas of the overlapping areas of the second and subsequent projectors enables adjustment from any of the apexes, but once adjusted the apexes again Since there is no need to make adjustments, it is possible to easily perform alignment of the overlapping area and setting of keystone correction.

A diagram showing the overall configuration of a liquid crystal projector Flow chart of control of basic operation of liquid crystal projector of this embodiment FIG. 2 is a diagram showing an internal configuration of an image processing unit according to the first embodiment A perspective view of the multi-projection system of the first embodiment The figure for demonstrating the process of the light-reduction processing part of Example 1. Flowchart for explaining the multi-projection installation process of the first embodiment Example of Menu Display of Embodiment 1 Flow chart of reference projector installation process of the first embodiment The figure which shows the change of the projection image by the setting process for reference | standard projectors of Example 1 Flow chart of installation process for second and subsequent projectors of the first embodiment Change of the projection image by the installation processing for the second and subsequent projectors of the embodiment 1 (part 1) Same as above (Part 2) Same as above (No. 3) Same as above (4) Same as above (No. 5) Same as above (Part 6) Same as above figure (7) Same as above (No. 8) Same as above (No. 9) Flowchart of Superimposed Region Modification Process of Embodiment 1 The perspective view of the multi-projection system of Example 2 Flowchart for explaining the installation process of the third embodiment Diagram explaining projective transformation

  A projector which is an image projection apparatus according to the present invention will be described by way of an embodiment.

Example 1
FIG. 1 is a block diagram showing the configuration of a projector according to the present invention. In this embodiment, a projector using a transmissive liquid crystal panel will be described as an example of a projection type display device. The liquid crystal projector of the present embodiment controls the light transmittance of the liquid crystal panel according to the image to be displayed, and projects the light from the light source transmitted through the liquid crystal panel onto the screen to project the image.

  Hereinafter, an embodiment in which the present invention is applied to such a liquid crystal projector will be described. First, the overall configuration of the liquid crystal projector of this embodiment will be described with reference to FIG. FIG. 1 is a view showing the overall configuration of a liquid crystal projector 100 according to this embodiment. 11, a RAM 112, an operation unit 113, an image input unit 130, and an image processing unit 140.

  The liquid crystal projector 100 further includes a liquid crystal control unit 150, liquid crystal panels 151R, 151G, and 151B, a light source control unit 160, a light source 161, a color separation unit 162, a color synthesis unit 163, an optical system control unit 170, and a projection optical system 171. Have. The liquid crystal projector 100 may further include a recording / reproducing unit 191, a recording medium 192, a communication unit 193, an imaging unit 194, a display control unit 195, and a display unit 196.

  The CPU 110 controls each operation block of the liquid crystal projector 100, and the ROM 111 is for storing a control program in which the processing procedure of the CPU 110 is described. Further, the RAM 112 temporarily stores a control program and data as a work memory. Further, the CPU 110 temporarily stores still image data and moving image data reproduced from the recording medium 192 by the recording and reproducing unit 191 in the RAM 112 temporarily, and reproduces respective images and videos using a program stored in the ROM 111 You can also

The CPU 110 can also temporarily store still image data and moving image data received from the communication unit 193 in the RAM 112, and reproduce the respective images and videos using the program stored in the ROM 111. . Alternatively, the image or video obtained by the imaging unit 194 may be temporarily stored in the RAM 112 and converted to still image data or moving image data using the program stored in the ROM 111 and recorded in the recording medium 192. it can.
The operation unit 113 receives a user's instruction and transmits a control signal to the CPU 110. The operation unit 113 includes, for example, a switch, a dial, and a touch panel provided on the display unit 196. In addition, the operation unit 113 may be, for example, a signal receiving unit (such as an infrared receiving unit) that receives a signal from a remote control, and may transmit a predetermined control signal to the CPU 110 based on the received signal.

  The CPU 110 also receives control signals input from the operation unit 113 and the communication unit 193 to control each operation block of the liquid crystal projector 100.

  The image input unit 130 receives an image signal from an external device. For example, a composite terminal, an S video terminal, a D terminal, a component terminal, an analog RGB terminal, a DVI-I terminal, a DVI-D terminal, an HDMI (registered trademark) terminal, and the like are included. When the image input unit 130 receives an analog image signal, the image input unit 130 converts the received analog image signal into a digital image signal. Then, the image input unit 130 transmits the received image signal to the image processing unit 140.

  Here, the external device may be any device such as a personal computer, a camera, a mobile phone, a smartphone, a hard disk recorder, a game machine, etc. as long as it can output an image signal.

  The image processing unit 140 performs processing for changing the number of frames, the number of pixels, the image shape, etc. on the image signal received from the image input unit 130, and transmits the image signal to the liquid crystal control unit 150. It consists of Further, the image processing unit 140 does not have to be a dedicated microprocessor, and for example, the CPU 110 may execute the same processing as the image processing unit 140 by a program stored in the ROM 111.

  The image processing unit 140 can execute functions such as frame thinning processing, frame interpolation processing, resolution conversion processing, and distortion correction processing (keystone correction processing). In addition to the image signal received from the image input unit 130, the image processing unit 140 can also perform the above-described change process on the image or video reproduced by the CPU 110.

  The liquid crystal control unit 150 controls voltages applied to the liquid crystals of the pixels of the liquid crystal panels 151R, 151G, and 151B based on the image signals processed by the image processing unit 140, and thereby controls the liquid crystal panels 151R, 151G, and 151B. Adjust the transmittance. The liquid crystal control unit 150 is composed of a control microprocessor. The liquid crystal control unit 150 does not have to be a dedicated microprocessor, and the CPU 110 may execute the same processing as the liquid crystal control unit 150 according to a program stored in the ROM 111, for example.

  For example, when an image signal is input to the image processing unit 140, the liquid crystal control unit 150 causes the liquid crystal panel to have a transmittance corresponding to the image every time an image of one frame is received from the image processing unit 140. It controls 151R, 151G, 151B.

  The liquid crystal panel 151R is a liquid crystal panel corresponding to red, and among the light output from the light source 161, of the light separated into red (R), green (G) and blue (B) by the color separation unit 162 Among them, it is for adjusting the transmittance of red light.

  The liquid crystal panel 151G is a liquid crystal panel corresponding to green, and among the light output from the light source 161, the light separated into red (R), green (G) and blue (B) by the color separation unit 162 Among them, it is for adjusting the transmittance of green light.

  The liquid crystal panel 151 B is a liquid crystal panel corresponding to blue, and among the light output from the light source 161, of the light separated into red (R), green (G) and blue (B) by the color separation unit 162 Among them, it is for adjusting the transmittance of blue light.

  The specific control operation of the liquid crystal panels 151R, 151G, 151B by the liquid crystal control unit 150 and the configuration of the liquid crystal panels 151R, 151G, 151B will be described later.

  The light source control unit 160 controls on / off of the light source 161 and controls the light amount, and includes a control microprocessor. The light source control unit 160 does not have to be a dedicated microprocessor. For example, the CPU 110 may execute the same processing as the light source control unit 160 according to a program stored in the ROM 111.

  The light source 161 outputs light for projecting an image on a screen (not shown), and is, for example, a halogen lamp, a xenon lamp, a high pressure mercury lamp or the like. The color separation unit 162 separates the light output from the light source 161 into red (R), green (G), and blue (B), and is made of, for example, a dichroic mirror or a prism. In addition, when using LED (light emitting diode) corresponding to each color, a semiconductor laser, etc. as the light source 161, the color separation part 162 is unnecessary.

  The color combining unit 163 combines red (R), green (G), and blue (B) light transmitted through the liquid crystal panels 151R, 151G, and 151B, and includes, for example, a dichroic mirror or a prism. . Then, light obtained by combining the components of red (R), green (G), and blue (B) by the color combining unit 163 is sent to the projection optical system 171. At this time, the liquid crystal panels 151 R, 151 G, and 151 B are controlled by the liquid crystal control unit 150 so as to have the light transmittance corresponding to the image input from the image processing unit 140. Therefore, when the light combined by the color combining unit 163 is projected on the screen by the projection optical system 171, an image corresponding to the image input by the image processing unit 140 is displayed on the screen.

  The optical system control unit 170 controls the projection optical system 171, and includes a control microprocessor. The optical system control unit 170 does not have to be a dedicated microprocessor, and the CPU 110 may execute the same process as the optical system control unit 170 according to a program stored in the ROM 111, for example.

  Also, the projection optical system 171 is for projecting the combined light output from the color combining unit 163 on a screen. The projection optical system 171 is composed of a plurality of lenses and an actuator for driving the lens, and the lens can be driven by the actuator to perform enlargement, reduction, focus adjustment and the like of the projection image.

  The recording / reproducing unit 191 reproduces still image data and moving image data from the recording medium 192, receives still image data and moving image data of an image and video obtained by the imaging unit 194 from the CPU 110, and records It is recorded in 192. In addition, the recording and reproducing unit 191 may record still image data and moving image data received from the communication unit 193 in the recording medium 192.

  The recording / reproducing unit 191 includes, for example, an interface electrically connected to the recording medium 192 and a microprocessor for communicating with the recording medium 192. Further, the recording and reproducing unit 191 does not have to include a dedicated microprocessor, and for example, the CPU 110 may execute the same processing as the recording and reproducing unit 191 by a program stored in the ROM 111.

  In addition, the recording medium 192 can record still image data, moving image data, control data necessary for the liquid crystal projector of this embodiment, and the like. The recording medium 192 may be any recording medium such as a magnetic disk, an optical disk, or a semiconductor memory, and may be a removable recording medium or a built-in recording medium.

  The communication unit 193 is for receiving control signals from external devices, still image data, moving image data and the like, and may be, for example, a wireless LAN, a wired LAN, USB, Bluetooth (registered trademark), etc. The communication method is not particularly limited. For example, if the terminal of the image input unit 130 is an HDMI (registered trademark) terminal, communication for controlling the liquid crystal projector 100 may be performed via the terminal.

  Here, the external device may be any device such as a personal computer, a camera, a mobile phone, a smartphone, a hard disk recorder, a game machine, a remote control, etc. as long as it can communicate with the liquid crystal projector 100. .

  The imaging unit 194 captures an image signal by capturing the periphery of the liquid crystal projector 100 of the present embodiment, and can capture an image projected through the projection optical system 171 (capture the screen direction). . The imaging unit 194 transmits the obtained image or video to the CPU 110, and the CPU 110 temporarily stores the image or video in the RAM 112, and based on the program stored in the ROM 111, still image data or moving image data Convert to

  The imaging unit 194 includes a lens for acquiring an optical image of a subject, an actuator for driving the lens, a microprocessor for controlling the actuator, an imaging element for converting the optical image into an image signal, an AD conversion unit for converting the image signal into a digital signal, etc. It consists of Furthermore, the imaging unit 194 is not limited to one that captures the screen direction, and may capture, for example, the viewer in the direction opposite to the screen.

  A display control unit 195 controls the display unit 196 provided in the liquid crystal projector 100 to display an operation screen for operating the liquid crystal projector 100 and an image such as a switch icon. It consists of a processor etc. The microprocessor does not need to be a dedicated display control unit 195. For example, the CPU 110 may execute the same processing as the display control unit 195 by a program stored in the ROM 111. The display unit 196 also displays an operation screen for operating the liquid crystal projector 100 and a switch icon.

  The display unit 196 may be anything as long as it can display an image. For example, it may be a liquid crystal display, a CRT display, an organic EL display, or an LED display. In addition, in order to display a specific button in a recognizable manner for the user, an LED or the like corresponding to each button may be made to emit light.

  The image processing unit 140, the liquid crystal control unit 150, the light source control unit 160, the optical system control unit 170, the recording and reproducing unit 191, and the display control unit 195 of this embodiment perform the same processing as those of these blocks. There may be one or more microprocessors capable. Alternatively, for example, the CPU 110 may execute the same processing as each block by a program stored in the ROM 111.

  Next, the basic operation of the liquid crystal projector 100 of the present embodiment will be described using FIGS. 1 and 2. FIG. 2 is a flowchart for explaining control of the basic operation of the liquid crystal projector 100 according to this embodiment. The operation of FIG. 2 is basically performed by the CPU 110 controlling each functional block based on a program stored in the ROM 111. The flow chart of FIG. 2 starts at a point of time when the user instructs the liquid crystal projector 100 to turn on the power by the operation unit 113 or a remote controller (not shown). When the user instructs the liquid crystal projector 100 to turn on the power via the operation unit 113 or a remote control (not shown), the CPU 110 supplies power from the power supply circuit (not shown) to each part of the projector 100 from the power supply unit (not shown).

  Next, the CPU 110 determines the display mode selected by the operation of the operation unit 113 or the remote controller by the user (step S210). One of the display modes of the projector 100 of the present embodiment is the “input image display mode” in which an image input from the image input unit 130 is displayed. In addition, one of the display modes of the projector 100 according to the present embodiment is the “file reproduction display mode” in which the still image data or moving image data read from the recording medium 192 by the recording / reproducing unit 191 is displayed. is there. Further, one of the display modes of the projector 100 according to the present embodiment is a “file reception display mode” for displaying an image or a video of still image data or moving image data received from the communication unit 193.

  In this embodiment, the case where the display mode is selected by the user will be described. However, the display mode at the time of turning on the power may be the display mode at the end of the previous time, and any of the above-mentioned The display mode of some may be the default display mode. In that case, the process of step S210 can be omitted.

  Here, it is assumed that the “input image display mode” is selected in step S210. When the “input image display mode” is selected, the CPU 110 determines whether an image is input from the image input unit 130 (step S220). When an image is not input (step S220: No), the CPU 110 stands by until an input image signal is detected, and when an image is input (step S220: Yes), the CPU 110 performs a projection process. (Step S230) is performed.

  The CPU 110 transmits the image input from the image input unit 130 to the image processing unit 140 as projection processing, and causes the image processing unit 140 to execute the transformation of the number of pixels, the frame rate, and the shape of the image. The image for one screen is transmitted to the liquid crystal control unit 150. Then, the CPU 110 causes the liquid crystal control unit 150 to obtain the transmittance according to the gradation level of each color component of red (R), green (G) and blue (B) of the received image of one screen. The transmittance of the liquid crystal panels 151R, 151G, and 151B is controlled. Then, the CPU 110 causes the light source control unit 160 to control the output of the light from the light source 161. The color separation unit 162 separates the light output from the light source 161 into red (R), green (G), and blue (B), and supplies the light to the liquid crystal panels 151R, 151G, and 151B.

  The light of each color supplied to the liquid crystal panels 151R, 151G, and 151B has a limited amount of light transmitted through each pixel of each liquid crystal panel. The light of red (R), green (G) and blue (B) transmitted through the liquid crystal panels 151R, 151G and 151B is supplied to the color synthesis unit 163 and synthesized again. Then, the light combined by the color combining unit 163 is projected on a screen (not shown) via the projection optical system 171.

  This projection process is sequentially performed for each image of one frame while projecting an image. When the user inputs an instruction to operate the projection optical system 171 from the operation unit 113, the CPU 110 causes the optical system control unit 170 to change the focus of the projected image or the enlargement ratio of the optical system according to the instruction content. The actuator of the projection optical system 171 is controlled to make a change. While this projection process is being performed, the CPU 110 determines whether or not the user has input an instruction to switch the display mode from the operation unit 113 (step S240).

  Here, when an instruction to switch the display mode is input by the user from the operation unit 113 (step S240: Yes), the CPU 110 returns to step S210 again to determine the display mode. At this time, the CPU 110 transmits a menu screen for selecting a display mode to the image processing unit 140 as an OSD (on-screen display) image, and the image is superimposed on the image being projected. The processing unit 140 is controlled. The user can select the display mode while viewing the projected OSD screen.

  On the other hand, when an instruction to switch the display mode is not input from the operation unit 113 by the user while the display processing is being performed (step S240: No), the CPU 110 determines whether the instruction to end projection is input from the operation unit 113 by the user. Is determined (step S250). Here, when the user inputs a projection end instruction from the operation unit 113 (step S250: Yes), the CPU 110 stops the power supply to each block of the projector 100, and ends the image projection.

  On the other hand, when the user does not input a projection end instruction from operation unit 113 (step S250: No), CPU 110 returns to step S220, and thereafter, until the user inputs a projection end instruction from operation unit 113. The processing from step S220 to step S250 is repeated during this period.

  As described above, the liquid crystal projector 100 of this embodiment projects an image on the screen.

  In the “file reproduction display mode”, the CPU 110 causes the recording and reproduction unit 191 to read the file list of still image data and moving image data and the thumbnail data of each file from the recording medium 192 and temporarily store the file in the RAM 112 Do.

  Then, the CPU 110 generates a character image based on the file list temporarily stored in the RAM 112 and an image based on thumbnail data of each file based on the program stored in the ROM 111, and transmits the image to the image processing unit 140. Then, the CPU 110 controls the image processing unit 140, the liquid crystal control unit 150, and the light source control unit 160 as in the normal projection process (step S230).

  The user wants to play back a still image that he / she wants to play by operating the operation unit 113 while looking at a GUI composed of characters or images corresponding to still image data or moving image data recorded on the recording medium 192 displayed on the projected image Select data or moving picture data. Then, the CPU 110 controls the recording and reproducing unit 191 to read out the selected still image data and moving image data from the recording medium 192.

  Then, the CPU 110 temporarily stores the read still image data and moving image data in the RAM 112, and reproduces an image and an image of the still image data and the moving image data based on the program stored in the ROM 111. Then, the CPU 110 sequentially transmits, for example, the image of each frame of the reproduced moving image data to the image processing unit 140, and the image processing unit 140, the liquid crystal control unit 150, the light source as in the normal projection processing (step S230). The controller 160 is controlled.

  When the still image data is reproduced, the reproduced image is transmitted to the image processing unit 140, and the image processing unit 140, the liquid crystal control unit 150, and the light source control unit 160 are transmitted as in the normal projection process (step S230). Control. In the “file reception display mode”, the CPU 110 temporarily stores still image data and moving image data received from the communication unit 193 in the RAM 112, and based on a program stored in the ROM 111, still image data and moving image Play data images and videos. Then, the CPU 110 sequentially transmits, for example, the image of each frame of the reproduced moving image data to the image processing unit 140, and the image processing unit 140, the liquid crystal control unit 150, the light source as in the normal projection processing (step S230). The controller 160 is controlled.

  When the still image data is reproduced, the reproduced image is transmitted to the image processing unit 140, and the image processing unit 140, the liquid crystal control unit 150, and the light source control unit 160 are transmitted as in the normal projection process (step S230). Control.

  FIG. 3 is a block diagram for explaining an internal configuration of the image processing unit 140 of FIG. The image processing unit 140 includes various image processing units 310, an OSD superimposing unit 320, a light reduction processing unit 330, a deformation processing unit 340, and a black floating processing unit 350. As described above, the original image signal s301 is input from the image input unit 130, the recording and reproducing unit 191, the communication unit 193, and the like according to the display mode. The timing signal s302 is a timing signal such as a vertical synchronization signal, a horizontal synchronization signal, or a clock synchronized with the original image signal s301, and is supplied from a supply source of the original image signal s301.

  Although each block in the image processing unit 140 operates based on the timing signal s 302, the timing signal may be regenerated in the image processing unit 140 and may be used. The various image processing unit 310 inputs the original image signal s301 in cooperation with the CPU 110, and outputs an image processing signal s303 generated by performing various image processing to the OSD superimposing unit 320.

  Various image processing is processing such as acquisition processing of statistical information such as histogram and average pixel value of image signal, IP conversion, frame rate conversion, resolution conversion, γ conversion, color gamut conversion, color correction, edge emphasis, etc. . The details of these image processings are known and will not be described.

  The OSD superimposing unit 320 superimposes, on the image processing signal s303, an OSD image representing a menu constituting a GUI for user operation and information for operation support according to an instruction of the CPU 110, and reduces the generated OSD superimposed signal s304. Output to the section 330. The light reduction processing unit 330 performs light reduction processing of the superimposed region on the OSD superimposed signal s304 received from the OSD superimposing unit 320 according to an instruction of the CPU 110, and generates the superimposed portion light reduction signal s305 to the transformation processing unit 340. Output.

  As the light reduction processing, the light reduction processing unit 330 applies a gain such that light is gradually reduced from the boundary with the non-overlapping region toward the end in the multi-projection overlapping region. The processing details of the light reduction processing unit 330 will be described using FIGS. 4 and 5. In order to simplify the description, the projector and the screen will be described in a state of being facing each other.

  FIG. 4 shows a perspective view of the multi-projection system (image projection system) of this embodiment. The image signal source 400 is connected to the projectors 420a and 420b by image cables 410a and 410b, respectively, and supplies image signals. The projectors 420a and 420b perform projection on a screen 430 which is a projection plane.

  The projectors 420a and 420b receive the image signal transmitted from the image signal source 400 via the image cables 410a and 410b. The projectors 420a and 420b project one integrated large image by projecting the images based on the received image signals so as to partially overlap. Such projection method is called multi-projection. FIG. 5A shows a projected image of the projector 420a. The projected image 500a includes a non-overlapping area 510a and an overlapping area 520a. FIG. 5B shows a projected image 500b of the projector 420b. The projected image 500 b includes a non-overlapping area 510 b and an overlapping area 520 b. Graphs 530a and 530b illustrated in FIG. 5C indicate gains that the light reduction processing unit 330 of the projectors 420a and 420b applies to the OSD superimposed signal s304.

  In this embodiment, the non-overlapping regions 510a and 510b are 1.0, and the overlapping regions 520a and 520b are 1.0 at the boundary with the non-overlapping region, 0 at the end of the projected image, and in the lateral position between them. The gain is determined so as to be determined accordingly.

  Although FIG. 5C shows an example in which the gain linearly changes from the boundary with the non-overlapping area to the end of the projected image, if the sum of the luminance in the overlapping area is equal to the luminance in the non-overlapping area, the gain The change of is not limited to the linear change, but may be an S-curve or the like.

  FIG. 5D shows a projection image after integration by multi-projection. The overlap area 540 is an overlap of the overlap areas 520a and 520b of the projectors 420a and 420b, and the luminance is equal to that of the non-overlap areas 510a and 510b, so the boundary is not noticeable.

  The deformation processing unit 340 performs geometric deformation processing on the superimposed portion light reduction signal s305 based on the equation of deformation, and outputs a post-deformation image signal s306. Since keystone correction can be realized by projective transformation, the transformation processing unit 340 inputs parameters for projective transformation from the CPU 110. Assuming that the coordinates of the original image are (xs, ys), the coordinates (xd, yd) of the image after deformation are represented by Expression 1.

  Here, M is a 3 × 3 matrix, and is a projection transformation matrix from the original image input from the CPU 110 to the image after deformation.

xso and yso are the coordinates of one vertex of the original image shown by a solid line in FIG. 15, and xdo and ydo correspond to the vertex (xso, yso) of the original image of the image after deformation shown by a dashed dotted line in FIG. Coordinate value of the vertex to be The inverse matrix M ^-1 of the matrix M of Equation 1 and the offsets (xso, yso) and (xdo, ydo) are input from the CPU 110, and the original image corresponding to the transformed coordinate values (xd, yd) according to Equation 2. Find the coordinates (xs, ys).

  If the coordinates of the original image obtained based on Expression 2 become integers, the pixel value of the original image coordinates (xs, ys) may be used as it is as the pixel value of the converted coordinates (xd, yd). However, since the coordinates of the original image obtained based on Equation 2 are not necessarily integers, the values of the peripheral pixels are used to interpolate to obtain the pixel value of the post-deformation coordinates (xd, yd).

  The interpolation method may be bilinear, bicubic, or any other interpolation method. If the coordinates of the original image obtained based on Equation 2 are out of the range of the original image area, the pixel value thereof is black or the background color set by the user. The transformation processing unit 340 thus obtains pixel values for all of the coordinates after conversion, and creates an image after conversion.

In the above description, it is assumed that the matrix M and its inverse matrix M ⁻¹ are input from the CPU 110 to the image processing unit 140. However, only the inverse matrix M ⁻¹ may be input and the matrix M may be determined inside the image processing unit 140, or only the matrix M may be input and the inverse matrix M ⁻¹ within the image processing unit 140. It is also good.

  The post-deformation image signal s306 output from the transformation processing unit 340 is supplied to the black floating processing unit 350. In a projector, even if a black image is displayed, black light is generated due to leaked light, so the black light amount of the overlapping area corresponds to the number of projected images (number of projectors) superimposed in the area. The sum of Therefore, black in the superimposed area is displayed brighter than black in the non-overlapped area. The black floating processing unit 350 applies signal processing to the non-overlapping area to increase the luminance so as to become black equivalent to the overlapping area with respect to the post-deformation image signal s306, and outputs the black floating corrected image signal s307. As described above, the black floating corrected image signal s307 is supplied to the liquid crystal control unit 150 and displayed on the liquid crystal panels 151R, 151G, and 151B.

  Next, the operation of the superimposed area keystone adjustment of the projector according to the present embodiment will be described according to the installation operation of multi-projection with reference to FIGS. FIG. 6 is a flowchart executed by the CPU 110 of the projectors 420a and 420b. The operation in FIG. 6 is activated when the user inputs an instruction to start setting for multi-projection using the operation unit 113 or a remote controller (not shown). First, the CPU 110 instructs the OSD superimposing unit 320 to display a multi-projection setting menu as shown in FIG. 7A.

  Then, the user is made to select whether the first projector serving as a reference for multi-projection or the second and subsequent projectors (dependent projectors) set according to the reference projector (step S601). When the projector to be the reference is selected (step S601: Yes), the CPU 110 performs the setting for the first installation (the setting for the reference projector) (step S602). If not (step S601: No), the CPU 110 performs installation setting for the second and subsequent ones (installation setting for the dependent projector) (step S603). Regardless of which process is performed, the process of this flowchart ends upon completion of each setting.

  FIG. 8 is a flowchart of the process of setting the installation of the first projector (reference projector) (step S602). First, the CPU 110 instructs the OSD superimposing unit 320 to display the zoom adjustment menu shown in FIG. 7B and causes the user to adjust the zoom (step S801).

  FIG. 9 is a diagram showing a projection area by the first projector on the screen. In FIG. 9A, reference numeral 910 denotes a projection image before correction, and reference numeral 920 indicated by a broken line is a desired projection area to be a target. The user adjusts the zoom amount with the operation unit 113 or a remote controller (not shown), so that the projection image 930 after zoom adjustment includes the desired projection area 920 as shown in FIG. Zoom adjustment is performed so that two vertices (the lower left vertex in the example of FIG. 9B) coincide with each other. Also, the projector body may be moved as needed.

  Next, the CPU 110 instructs the OSD superimposing unit 320 to display the vertical / horizontal keystone correction menu shown in FIG. 7C, and allows the user to perform keystone adjustment (step S802). In the vertical and horizontal keystone correction, the conventional keystone correction in which the user gives relative tilt angles of the screen and the projector as setting values in the GUI, and based on that, the CPU 110 calculates coordinates after correction and sets them in the transformation processing unit 340 It is.

  In the vertical and horizontal keystone correction, parameters of deformation processing are set based on the relative inclination angle between the projector body and the screen. The setting of deformation processing by vertical and horizontal keystone correction is referred to as a first setting mode. This keystone correction is performed so that one vertex of the projection image area (the vertex 940 at the lower left shown in FIG. 9B in the case of this embodiment) does not move.

  Therefore, in the present embodiment, in a state in which the projected image is adjusted to be rectangular on the projection surface by vertical and horizontal keystone correction, as shown in FIG. 9C, the desired projected area 920 and the projected image after keystone correction It matches with 950. An area outside the projected image 950 after keystone correction is displayed in black. In the case of a projector equipped with a different keystone correction algorithm, this can be coped with by changing the adjustment method of the zoom adjustment in step S801.

  Next, the CPU 110 instructs the OSD superimposing unit 320 to display an edge blend setting menu shown in FIG. 7D, and allows the user to perform edge blend setting (step S803). When the projector 420 a in FIG. 4 is used as a reference projector, here, the edge blend on the right side is enabled, and the width of the overlapping area is set. The width of the overlapping area is the width of the overlapping area set in the image signal supplied from the image signal source 400 to the projectors 420a and 420b, and is a known amount. Then, the CPU 110 displays an edge blend marker as a guide for aligning the second projector. The projected image after the edge blend setting is as shown in FIG.

  960 is a non-overlapping area after keystone correction, 970 is an overlapping area after keystone correction, and an edge blend marker 980 is displayed on the side of the overlapping area 970. In FIG. 9D, the edge blend marker at the boundary between the non-overlap region 960 and the overlap region is black, and the edge blend marker at the screen edge is white in dashed line, but it may be displayed in an easily understandable color. If the user performs the setting end operation, the process ends. However, while the edge blend marker 980 is displayed, the second setting is performed.

  FIG. 10 is a flowchart of the process (step S603) for setting the installation of the second projector (dependent projector). First, the CPU 110 instructs the OSD superimposing unit 320 to display the zoom adjustment menu shown in FIG. 7B and causes the user to adjust the zoom (step S1001).

  FIGS. 11 (a) to 11 (i) are diagrams showing projection areas by the first and second projectors on the screen. In FIG. 11A, 950 to 980 are the same as those with the same reference numerals in FIG. 9, and are projection images of the first projector 420a. 1110 is a projection image before correction of the second projector 420b, and 1120 is a desired projection area to be a target. The user adjusts the zoom amount with the operation unit 113 or a remote controller (not shown), so that the projected image 1130 after zoom adjustment covers the desired projection area 1120 as shown in FIG. Adjust the zoom. Also, the projector body may be moved as needed.

  Next, the CPU 110 instructs the OSD superimposing unit 320 to display an edge blend setting menu shown in FIG. 7D, and allows the user to perform edge blend setting (step S1002).

  When the projector 420 b in FIG. 4 is used as the second projector, edge blending on the left side is enabled here, and the width of the overlapping area is set. The width of the overlapping area is the width of the overlapping area set in the image signal supplied from the image signal source 400 to the projectors 420a and 420b, and is a known amount. As a result, as shown in FIG. 11C, an image in which the superimposed area 1140 is dimmed is projected.

  Next, the CPU 110 performs superimposed region keystone setting processing (step S1003). FIG. 12 is a detailed flowchart of step S1003. First, the CPU 110 calculates the coordinates of the overlapping area (step S1201). The CPU 110 calculates the coordinate value of the superimposed area on the liquid crystal panel based on the equation 1 from the information of the side where the superimposed area is set in step S1002 and the information of the width of the superimposed area.

  Next, the CPU 110 instructs the OSD overlapping unit 320 to display deformation markers at the four corners of the overlapping area. Then, the CPU 110 selects and displays PS1 as a movement target point among the deformation markers PS1 to PS4 (step S1202). As a result, as shown in FIG. 11D, the deformation markers PS1 to PS4 are displayed at the four corners of the overlapping area 1140. These deformation markers are points that are adjusted for alignment.

  Next, the CPU 110 waits for the user to operate the remote control key or the main body switch (step S1210). When receiving the user operation, the CPU 110 determines whether the operated key is the next key (step S1220). If it is the next key (step S1220: YES), the CPU 110 selects and displays the next deformation marker of the currently selected deformation marker as the movement target point (step S1221). Here, the order of selection is, for example, cyclically as PS1, PS2, PS3, PS4, PS1,. Then, the process returns to step S1210. Alternatively, when the adjustment from PS1 to PS4 is completed, the process may be transferred to step S1241 to complete the adjustment operation of the overlapping area keystone setting.

  When the operated key is not the next key (step S1220: No), the CPU 110 determines whether the operated key is any one of the direction keys (up, down, left, right) (step S1230) . When it is the direction key (step S1210: Yes), the CPU 110 moves the movement target point by the predetermined movement amount according to the pressed direction key, and makes the reference to the coordinates of PS1 to 4 after movement as a reference. The coordinates of the projection area after deformation are calculated based on Expression 1 (step S1231).

  For example, in a state where PS1 in FIG. 11D is the movement target point, PS1 moves to the right when the right key is pressed, and PS1 moves to the bottom when the down key is pressed. However, since the movement target point can not be moved outside the panel size, PS1 does not move when the up key or the left key is pressed when PS1 is at the panel vertex.

  Next, the CPU 110 determines whether the coordinates of the projection area after deformation calculated in step S1231 are outside the panel size (step S1235). If the coordinates of the projection area after deformation are not outside the panel size (step S1235: YES), the CPU 110 updates the position of the movement target point of the markers PS1 to PS4 after movement. Then, the projective transformation matrix M and the offset of Expression 1 are obtained according to the positions of them, and they are set in the transformation processing unit 340 to perform transformation processing (step 1236). Then, the process returns to step S1210.

  If the coordinates of the projection area after deformation are outside the panel size (step S1235: No), the CPU 110 moves both the movement target point and the movement target point associated with the movement target point. As an example, FIG. 11 (i) shows a case where PS1 is moved to the position of PS1 '' and PS2 to PS4 are not moved. In FIG. 11I, since the coordinates of the projection area 1130 z after deformation are out of the projection area 1130 before deformation, they can not be projected. The relationship between the movement target point and the movement target point associated with the movement target point is determined according to the positional relationship between the overlapping area and the overlapping area.

  For example, in the case where the superimposed area is in the left position and the superimposed area is in the right positional relationship, if PS1 can not be deformed by moving PS1, the coordinate of the projected area after deformation is outside the panel size by moving PS2. To avoid becoming

  Similarly, move PS2 if it can not be deformed, PS1 if it can not be deformed if PS3 is moved, PS4 if it can not be deformed if PS3 is moved, PS3 if it can not be deformed if PS4 is moved, and so on after projection Make sure that the coordinates of the area do not fall outside the panel size.

  In FIG. 11E, since the coordinates of the projection area 1130 b after deformation do not extend from the projection area 1130 before deformation, projection is possible.

  As described above, the coordinates of the projection area after deformation are calculated so as not to be undeformable (step S1237). However, even if the coordinates after deformation are outside the panel size, the marker can not be moved. Then, the process proceeds to step S1236, and proceeds to a deformation process for actually deforming the projection area.

  If it is determined in step S1230 that the operated key is not the direction key (step S1230: NO), the CPU 110 determines whether the operated key is the completion key (step S1240). If the operated key is the completion key (step S1240: YES), the CPU 110 deletes the deformation marker (step S1241), and ends the overlapping area keystone correction process.

  If the operated key is not the end key (step S1240: NO), the CPU 110 returns to step S1210 and waits for the next user operation because it is an invalid key. Each time the key is pressed, the CPU 110 deforms a quadrangle having four correction points (four corner points of the overlapping area) including the movement target point as vertices, and the entire image area is deformed based on the shape of the overlapping area. The process is performed (step S1236).

  Taking the case of moving PS1 as an example, the user presses the right key and the down key several times while looking at the edge blend marker 980 displayed by the projector 420a, and PS1 is superimposed on the projected image 950 of the projector 420a. Match the top left corner of 970. A state in which the movement of PS1 is completed is shown in FIG.

  PS1 'is a position after completion of movement of the deformation marker PS1. Similarly, a state in which the movement of PS2 is completed is shown in FIG. PS2 'is a position after completion of movement of the deformation marker PS2. Further, FIG. 11 (g) shows a state in which the movement of PS3 is completed. PS3 'is the position after completion of movement of the deformation marker PS3.

  A state in which PS1 to PS4 of the superimposed area 1140 of the projected image of the projector 420b are respectively matched with the four corners of the superimposed area 970 after keystone correction of the projected image of the projector 420a in this way is shown in FIG.

  In FIG. 11, the projected image 1130 of the projector 420b is transformed to 1130e through 1130a, 1130b, 1130c, and 1130d. In addition, the overlapping area 1140 of the projected image of the projector 420b is deformed to 1140e through 1140a, 1140b, 1140c, and 1140d. The deformed markers PS1 'to PS4' after movement coincide with the four corners of the superimposed area 970 after keystone correction of the projected image of the projector 420a. Therefore, the superimposed area 1140e after the keystone correction of the projection image of the projector 420b also matches the superimposed area 970 after the keystone correction of the projection image of the projector 420a.

  Also, the projection image 1130 e after keystone correction of the projector 420 b is subjected to the same deformation processing as the deformation processing unit 340 deforms the superposition region 1140 before correction of the projector 420 b into the superposition region 1140 e after correction. It is generated. The corrected projected image 1130 e automatically becomes a rectangle having a stored aspect ratio. Here, the user turns off the edge blend marker display of the projector 420a, and ends the installation process.

  As described above, according to this embodiment, the target position to move the four corners of the overlapping area is clarified by the edge blend marker display of the reference projector. Therefore, by setting each point to the target position in order, it is possible to perform edge blend setting in which the overlapping regions of the two projectors are exactly matched. Further, since the keystone correction of the entire effective image area of the second and subsequent projectors is performed based on the keystone correction with respect to the superimposed area, a convergence procedure which is adjusted many times is not necessary. Therefore, the positioning of the overlapping area in the case of multi projection and the setting of the keystone correction can be easily performed.

(Example 2)
In the present embodiment, as in the first embodiment, a liquid crystal projector will be described. A perspective view of the multi-projection system of this embodiment is shown in FIG. The difference from the first embodiment is that the projectors 420 a and 420 b can communicate through the communication line 1310. The communication means may be serial communication, network communication, or any other device capable of transmitting and receiving commands. The overall configuration of the liquid crystal projector, the basic operation, and the configuration of the image processing unit are the same as in the first embodiment, and thus the description thereof will be omitted.

  In the present embodiment, the flowchart executed by the CPU 110 is basically the same as that shown in FIG. 6, FIG. 8, FIG. 10 and FIG. In the first embodiment, the start of the installation setting of the second and subsequent projectors is instructed by the user, but in the present embodiment, the reference projector 420a transmits an installation setting start command to the adjacent projector 420b. . The timing for transmitting the command is a stage at which the edge blend setting is performed in step S 803 of FIG. 8 and the edge blend marker is displayed in the setting of the reference projector 420 a.

  When receiving the command, the projector 420b starts the installation setting process of FIG. 10, and transmits an installation setting end notification to the reference projector 420a at the end of the process. When receiving the installation setting end notification, the reference projector 420 a erases the edge blend marker and ends the installation setting.

  According to this embodiment, since the projectors cooperate with each other to start the installation setting, the adjustment procedure of the multi-projection can be further simplified.

(Example 3)
In the present embodiment, as in the first embodiment, a liquid crystal projector will be described. The multi-projection system configuration of the present embodiment, the overall configuration of the liquid crystal projector, the basic operation, and the configuration of the image processing unit are the same as those of the first embodiment, and thus the description thereof will be omitted.

  A flowchart executed by the CPU 110 in the present embodiment is shown in FIG. FIG. 14A is activated when the user starts the installation setting with the operation unit 113 or a remote controller (not shown).

  First, as in step S801 in FIG. 8 or step S1001 in FIG. 10, the CPU 110 instructs the OSD overlapping unit 320 to display the zoom adjustment menu shown in FIG. Step S1401). Next, as in step S 803 in FIG. 8 or step S 1002 in FIG. 10, the CPU 110 instructs the OSD overlapping unit 320 to display an edge blend setting menu shown in FIG. (Step S1402).

  Next, the CPU 110 performs keystone correction (step S1403). The detailed flow of step S1403 is shown in FIG. First, the CPU 110 allows the user to select whether or not multi-projection is performed by OSD (not shown) (step S1411).

  In the case of multi-projection (step S1411: YES), the CPU 110 performs the same process as step S601 in FIG. That is, the user is made to select whether the first projector (reference projector) as a reference of multi-projection or the second or later projector (dependent projector) to be matched with the reference projector (step S1412). In the case of the second and subsequent projectors (step S1412: No), the CPU 110 performs superimposed region keystone setting processing (step S1413) as in step S1003 of FIG.

  When single projection is selected in step S1411 (step S1411: NO) and when the reference projector is selected in step S1412 (step S1412: YES), the CPU 110 performs keystone correction to the user by the OSD display (not shown). Let me choose the method. Here, one of conventional vertical and horizontal keystone correction and four-point specification keystone correction is selected (step S1414).

  If the four-point designation key stone is selected in step S 1414 (step S 1414: YES), the CPU 110 executes effective image area four-point keystone correction (step S 1415). This means that the transformation markers displayed at the four corners of the superposition area 1140 in the superposition area keystone setting in step S1413 are displayed at the four corners of the effective image area and the movement target point is also the effective image area. Is similar to the four-point specification keystone correction. That is, in the four-point keystone correction, parameters of the deformation processing are set based on the relationship between the position of the projected image before deformation and the position of the projected image after deformation.

  Such setting of deformation processing by four-point keystone correction is referred to as a second setting mode. If the vertical and horizontal keystone has been selected in step S 1414 (step S 1414: NO), the CPU 110 causes the user to perform keystone adjustment as in step S 802 in FIG. 8 (step S 1416). Even when any one of steps S1413, S1415, and S1416 ends, the CPU 110 ends the keystone setting process.

In this embodiment, in the case of the second and subsequent projectors of multi-projection, keystone correction can be performed in which four corners of the overlapping area are designated. Therefore, in addition to the same effect as the first embodiment, in the case of non-multi-projection and in the case of a multi-projection reference projector, it is possible to select a desired keystone correction method, depending on the situation. An optimal setting method can be selected.

Other Embodiments The object of the present invention can also be achieved by supplying a storage medium storing program code of software that implements the functions of the above-described embodiments to a device. At this time, a computer (or a CPU or an MPU) including the supplied control unit of the apparatus reads out and executes the program code stored in the storage medium. In this case, the program code itself read out from the storage medium realizes the functions of the above-described embodiments, and the program code itself and the storage medium storing the program code constitute the present invention.

  As a storage medium for supplying the program code, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a non-volatile memory card, a ROM or the like can be used. Also, based on the instructions of the program code described above, an OS (a basic system or an operating system) or the like running on the device performs a part or all of the processing, and the processing of the above-described embodiment is realized by the processing. The case is also included.

  Furthermore, even when the program code read out from the storage medium is written to the memory provided to the function expansion board inserted into the device or the function expansion unit connected to the computer, and the functions of the above-described embodiments are realized. included. At this time, based on the instruction of the program code, a CPU or the like provided in the function expansion board or the function expansion unit performs part or all of the actual processing.

110: CPU
140: Image processing unit 340: Deformation processing unit

Claims (3)

A projector which constitutes an image projection system which projects one image by superimposing a part of a plurality of projection images projected by a plurality of projectors and connecting them on a screen,
Deformation means for geometrically deforming the image to be projected;
Setting means for setting parameters of deformation processing by the deformation means;
The setting means sets the parameter of the deformation process based on the relationship between the position of the superimposed area in the projected image before the deformation by the deformation means and the position of the superimposed area in the projected image after the deformation. And
As the user moves each vertex of the overlap region,
If the vertex of the projection image can be projected, the vertex of the overlapping area can be moved,
Also, when the user moves each vertex of the overlapping area,
If the vertex of the projection image can not be projected, the vertex is fixed, and if it is adjustable by moving the other vertex of the overlapping region, the vertex of the overlapping region can be moved,
Also, when the user moves each vertex of the overlapping area,
If the vertex of the projection image can not be projected, the vertex is fixed, and if it can not be adjusted by moving the other vertex of the superimposed region, control is made so that the vertex of the superimposed region can not be moved. A projector characterized by comprising control means. Furthermore, the control means
The adjustment of each vertex of the overlapping area is in a predetermined order, and
The projector according to claim 1, wherein when the adjustment of each vertex is completed, control is performed so that the next vertex is automatically selected. Furthermore, the control means
As the user moves each vertex of the overlap region,
If the vertex of the projection area is not movable, fix the vertex and adjust the vertices of the other edge blend area on the straight line connecting the vertex of the edge blend area to be adjusted and the vertex of the non-movable projection area The projector according to claim 1 or 2, wherein control is performed to control.