JP2018125809A - Information processing device and control method thereof, system, program, and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize a system for reducing erroneous detection of a pattern for adjustment at low cost.SOLUTION: A projection system includes a plurality of projection devices, an imaging device for photographing a projection area of the projection devices, an information processing device for supplying video, and a video distribution device for distributing the video to the projection devices. The information processing device includes communication means capable of communicating with the projection devices, supply means for supplying the video including a pattern for adjusting the projection area of the projection devices, and control means capable of controlling the projection devices and the imaging device through the communication means. The projection means include projection means for projecting the video input from the video distribution device, and correction means for performing correction processing of the projection area on the basis of an image including the pattern photographed by the imaging device, and the control means of the information processing device supplies the pattern to the video distribution device, and performs control such that the video including the pattern is in a non-display state in projection devices other than the projection device to be an object of the correction processing.SELECTED DRAWING: Figure 9

Description

  The present invention relates to a projection system using a plurality of projection apparatuses.

  In multi-projection in which the projection screens projected by a plurality of projection apparatuses are connected to display one image as a whole, when connecting the plurality of projection screens, the joints are visually recognized unless the positions are precisely aligned. , Degrading. For this purpose, a process called edge blending that makes the joints inconspicuous is performed. With edge blending, a portion of a plurality of projected images is partially overlapped, and with respect to the portion to be overlapped, the illuminance of each projection screen is summed up so that it becomes equal to the illuminance of the non-overlapping portion. It is processing. In addition, a projection method called stack projection is also known in which a plurality of projection apparatuses project the same image so as to be superimposed on the same location, thereby achieving high brightness.

  In addition, when the projection apparatus cannot be installed at a position facing the projection plane, the keystone correction called keystone correction is corrected by signal processing so that the geometric distortion called trapezoid distortion does not occur on the projection plane. Processing may be performed.

  When performing multi-projection or stack projection, it is necessary to achieve both exact alignment of the overlapping region and trapezoidal correction. However, since these installation settings are very complicated, automation of correction is required.

  Patent Document 1 describes an image correction apparatus that performs distortion correction based on image data indicating one image displayed by a plurality of projection apparatuses in cooperation, and transmits corrected partial image data to each projection apparatus. ing.

JP 2011-182079 A

  The above-mentioned patent document 1 is configured by connecting one video cable to each projection apparatus from one adjustment information processing apparatus (PC) that performs the above-described distortion correction. In this case, an adjustment PC having a plurality of video output units made up of GPU (Graphics Processing Unit) or the like is necessary, which increases the cost for constructing the system. For example, when a laptop PC or the like that does not have many video output units is used as an adjustment PC, it cannot be realized by the above-mentioned Patent Document 1.

  In order to solve this, it is conceivable to supply the video from one video output unit to all the projection devices via the video distribution device. The video distribution device is a device that duplicates an input video signal and distributes it to a plurality of devices.

  Generally, when correcting the projection plane, the projection apparatus projects an adjustment pattern one by one, shoots the projection plane including the adjustment pattern, and performs correction based on the captured image. Thus, only by distributing the image to each projection apparatus, the adjustment pattern is projected by a projection apparatus other than the projection apparatus to be corrected. In this case, since the image obtained by photographing the projection plane includes an unnecessary adjustment pattern projected by a projection apparatus other than the projection apparatus to be corrected, the adjustment pattern may not be detected correctly.

  The present invention has been made in view of the above problems, and displays an adjustment pattern only on a projection apparatus to be corrected. Therefore, an object of the present invention is to realize a system that reduces erroneous detection of an adjustment pattern at low cost.

  In order to solve the above problems and achieve the object, a projection system of the present invention includes a plurality of projection apparatuses, an imaging apparatus that captures a projection area of the projection apparatus, an information processing apparatus that supplies an image, and an image. A projection system including a video distribution device that distributes to a projection device, wherein the information processing device includes a communication unit that can communicate with the projection device, and an image including a pattern for adjusting a projection area of the projection device. Supply means for supplying, and control means for controlling the projection apparatus and the imaging apparatus via the communication means, and the projection apparatus projects projection video input from the video distribution apparatus; Correction means for performing a correction process of a projection area based on an image including the pattern photographed by the imaging device, and the control means of the information processing device distributes the pattern to the video distribution Supplies to the location, the image containing the pattern in the correction projection apparatus other than the projection device to be processed is controlled to be non-display state.

  According to the present invention, since the adjustment pattern is displayed only on the projection apparatus to be corrected, a system for reducing erroneous detection of the adjustment pattern can be realized at low cost.

FIG. 3 is a system configuration diagram in the case of stack projection according to the first embodiment. FIG. 3 is a system configuration diagram in the case of multi-projection according to the first embodiment. FIG. 2 is a block diagram illustrating a device configuration according to the first embodiment. FIG. 2 is a block diagram illustrating a detailed configuration of an image processing unit according to the first embodiment. Explanatory drawing of a dimming process. Explanatory drawing of a deformation | transformation process. 3 is a flowchart showing automatic correction processing according to the first embodiment. FIG. 3 is a diagram illustrating a menu screen according to the first embodiment. FIG. 6 is a sequence diagram of automatic correction processing in the case of stack projection according to the first embodiment. FIG. 6 is a sequence diagram of automatic correction processing in the case of multi-projection according to the first embodiment. FIG. 6 is a sequence diagram of automatic correction processing in the case of single projection according to the first embodiment. FIG. 9 is a system configuration diagram in the case of multi-projection according to a second embodiment. FIG. 10 is a sequence diagram of automatic correction processing in the case of stack projection according to the second embodiment.

  Hereinafter, embodiments for carrying out the present invention will be described in detail. The embodiment described below is an example for realizing the present invention, and should be appropriately modified or changed according to the configuration and various conditions of the apparatus to which the present invention is applied. It is not limited to the embodiment. Moreover, you may comprise combining suitably one part of each embodiment mentioned later.

  [Embodiment 1] Embodiment 1 will be described below.

  The projection system according to the present embodiment includes a plurality of projection devices, a video distribution device that distributes video to all the projection devices, an information processing device that supplies video to the video distribution device, and an imaging device. The position of the projection screen can be automatically adjusted by photographing the image including the adjustment pattern projected in step S with the imaging device.

  <System Configuration> First, the configuration of the projection system of this embodiment will be described with reference to FIG.

  FIG. 1 exemplifies a system configuration when stack projection is performed using two projectors. Stack projection is a form in which projection images from a plurality of projection devices are displayed in a superimposed manner in order to improve luminance and 3D display of projection images.

  In FIG. 1, a projection device 100a and a projection device 100b project one image by superimposing and displaying each projection image on a projection surface. Two projectors 100a, 100b and one information processing apparatus 200 are connected to each other via a network 50 such as a LAN (Local Area Network) so as to be able to communicate with each other. The communication method may be wired or wireless.

  The information processing apparatus 200 is a personal computer (PC), for example, and is connected to the video distribution apparatus 300 via a video cable and supplies a video signal. The video distribution device 300 is connected to the projection devices 100a and 100b by a plurality of video cables, and outputs video signals to all the projection devices 100a and 100b. Note that various types of video signal formats such as HDMI (registered trademark), DVI, and VGA can be applied.

  The video distribution device 300 duplicates the video signal received from one information processing device 200, and outputs the duplicated video signal to each of the projection devices 100a and 100b.

  The imaging apparatus 400 is a digital camera, for example, and is connected to the information processing apparatus 200 via a USB cable, a LAN cable, or the like. Send. The imaging device 400 only needs to be able to perform shooting based on an instruction from the information processing device 200, and the type of camera is not limited.

  FIG. 2 exemplifies a system configuration in the case of performing multi-projection using four projection apparatuses in order to increase the screen size and resolution of the projection surface. Multi-projection is a form in which one image is projected as a whole by superimposing a part of projection images of a plurality of projection apparatuses and displaying them on a projection plane. In multi-projection, the overlapped portion is made inconspicuous by applying a light reduction process (edge blending) to the overlapped portion between the projection images of each projection apparatus on the projection surface. Details of the dimming process will be described later.

  In FIG. 2, four projection apparatuses 100a to 100d and one information processing apparatus 200 are connected to each other via a network 50 such as a LAN (Local Area Network) in a state where they can communicate with each other. The information processing apparatus 200 is connected to the video distribution apparatus 300 through a video cable. The communication method and the video signal format are the same as in the case of stack projection shown in FIG.

  In the present embodiment, for easy understanding, a case where stack projection is performed using the two projectors 100a and 100b shown in FIG. 1 and a multi-projection using the four projectors 100a to 100d shown in FIG. However, the number and arrangement of the projection devices are not limited to this.

  <Apparatus Configuration> Next, the configuration and functions of the projection apparatus 100, the information processing apparatus 200, the video distribution apparatus 300, and the imaging apparatus 400 included in the projection system of this embodiment will be described with reference to FIG.

  First, the projection apparatus 100 will be described.

  The projection apparatus 100 of this embodiment includes a CPU 101, a RAM 102, a ROM 103, a projection unit 104, a projection control unit 105, a VRAM 106, an operation unit 107, a network IF 108, an image processing unit 109, a video input unit 110, and a light source control unit 111. 112 is a liquid crystal projector connected by 112.

  The CPU 101 is an arithmetic processing device that controls each operation block of the projection device 100. The RAM 102 is a volatile memory that temporarily stores a control program and data as a work memory. The ROM 103 is a non-volatile memory that stores a control program describing the processing procedure of the CPU 101. The control program referred to here is a program for executing a flowchart and a sequence described later.

  The projection unit 104 projects an image instructed by the projection control unit 105. The projection unit 104 includes a liquid crystal panel (not shown), a lens, and a light source.

  The projection control unit 105 reads the image data stored in the VRAM 106 and outputs a projection instruction to the projection unit 104. The VRAM 106 stores image data projected by the projection unit 104.

  The operation unit 107 receives a user operation and transmits an instruction signal to the CPU 101. The operation unit 107 includes, for example, a switch, a dial, and a touch panel provided on the display unit. For example, the operation unit 107 may receive a signal transmitted from a remote controller (not shown) and output an instruction signal corresponding to the received signal to the CPU 101.

  The network IF 108 can communicate with an external device via the network 50. In the present embodiment, the network IF 108 is used for communication between the projection apparatus 100 and the information processing apparatus 200.

  The image processing unit 109 performs change processing such as the number of frames, the number of pixels, and the image shape on the video signal output from the video distribution device 300 and input from the video input unit 110 and transmits the video signal to the projection control unit 105. The image processing unit 109 includes a microprocessor for image processing, for example. Note that the image processing unit 109 does not have to be a dedicated microprocessor. For example, the CPU 101 may execute the same processing as the image processing unit 109 by a program stored in the ROM 103. The image processing unit 109 can execute processing such as frame thinning processing, frame interpolation processing, resolution conversion processing, OSD superimposition processing such as menus, distortion correction processing (keystone correction processing), and edge blending. In addition to the video signal input from the video input unit 110, the image processing unit 109 can perform the above-described change processing on the video reproduced by the CPU 101. Details of the image processing unit 109 will be described later.

  The video input unit 110 inputs a video signal from an external device. The video input unit 110 includes, for example, a composite terminal, an S video terminal, a D terminal, a component terminal, an analog RGB terminal, a DVI-I terminal, a DVI-D terminal, an HDMI (registered trademark) terminal, and the like. In addition, when receiving an analog video signal, the video input unit 110 converts the received analog video signal into a digital video signal and transmits the digital video signal to the image processing unit 109. Here, the external device may be any device such as a personal computer, a camera, a mobile phone, a smartphone, a hard disk recorder, and a game machine as long as it can output a video signal. In this embodiment, the video distribution device 300 is used as an external device.

  The light source control unit 111 includes a control microprocessor that performs on / off control of a light source (not shown) and light amount control. The light source control unit 111 does not have to be a dedicated microprocessor. For example, the CPU 101 may execute the same processing as the light source control unit 111 by a program stored in the ROM 103. A light source (not shown) outputs light for projecting an image on a screen, and may be, for example, a halogen lamp, a xenon lamp, a high-pressure mercury lamp, or a laser light source.

  Next, the information processing apparatus 200 will be described.

  The information processing apparatus 200 according to this embodiment is a personal computer (PC) in which a CPU 201, a RAM 202, a ROM 203, an operation unit 204, a display unit 205, a network IF 206, a video output unit 207, and a communication unit 208 are connected via an internal bus 209. .

  The CPU 201 is an arithmetic processing device that controls each operation block of the information processing device 200. A RAM 202 is a volatile memory that temporarily stores a control program and data as a work memory. The ROM 203 is a non-volatile memory that stores a control program describing the processing procedure of the CPU 201. The control program referred to here is a program for executing a flowchart and a sequence described later.

  The operation unit 204 includes, for example, a mouse, a keyboard, a touch panel provided on the display unit, and the like, receives a user operation, and transmits an instruction signal to the CPU 201. The display unit 205 is, for example, a liquid crystal panel or an organic EL panel, and displays image data and a UI screen.

  The network IF 206 can communicate with an external device via the network 50. In the present embodiment, communication is performed with the projection apparatus 100 connected via a network 50 such as a LAN. In the present embodiment, the projection apparatus 100 is controlled by communication using a LAN. However, the present invention is not limited to this, and other communication methods such as serial communication (RS-232) may be used. In that case, it connects with the projection apparatus 100 by the communication part 208 mentioned later.

  The video output unit 207 outputs a video signal to an external device. The video output unit 207 includes, for example, a composite terminal, an S video terminal, a D terminal, a component terminal, an analog RGB terminal, a DVI-I terminal, a DVI-D terminal, an HDMI (registered trademark) terminal, and the like. Here, the external device is not limited to the projection device and the video distribution device as long as it can input a video signal, and may be another display device. In this embodiment, the video distribution device 300 is used as an external device.

  In the present embodiment, the display unit 205 is described as displaying a UI screen on which a user can perform an operation related to automatic correction processing, which will be described later. However, the UI is displayed on an external device connected to the video output unit 207. A format for displaying a screen may also be used.

  The communication unit 208 transmits and receives an instruction signal such as start of shooting and exposure correction and a shot image to and from the imaging device 400. The communication unit 208 transmits and receives data by a method such as USB (Universal Serial Bus). In the present embodiment, an example in which the information processing apparatus 200 and the imaging apparatus 400 are USB-connected by the communication unit 208 will be described. However, if the imaging apparatus 400 is configured to be controllable via the network 50, a LAN, etc. The network 50 may be used for connection.

  Note that the processing according to the flowchart and sequence of the present embodiment is realized by reading a program provided by an application. It is assumed that the application has a program for using the basic functions of the OS installed in the information processing apparatus 200. Note that the OS of the information processing apparatus 200 may have a program for realizing the processing in this embodiment.

  Next, a detailed configuration of the image processing unit 109 in the projection apparatus 100 of the present embodiment will be described.

  FIG. 4 is a block diagram illustrating an internal configuration of the image processing unit 109 in the projection apparatus 100 according to the present embodiment.

  The image processing unit 109 includes various image processing units 109a, an OSD superimposing unit 109b, a dimming processing unit 109c, and a deformation processing unit 109d.

  As described above, the original image signal sig01 is input from the video input unit 110, the network IF 108, and the like. The timing signal sig02 is a timing signal such as a vertical synchronization signal, a horizontal synchronization signal, and a clock synchronized with the original image signal sig01, and is supplied from the information processing apparatus 200 that is a supply source of the original image sig01. Each operation block of the image processing unit 109 operates based on the timing signal sig02, but the timing signal may be regenerated and used inside the image processing unit 109.

  The various image processing units 109a input the original image signal sig01 in cooperation with the CPU 101, and output the image processing signal sig03 generated by performing various image processing to the OSD superimposing unit 109b. Various image processing includes acquisition of statistical information such as a histogram of an image signal and APL, IP conversion, frame rate conversion, resolution conversion, gamma conversion, color gamut conversion, color correction, luminance correction, edge enhancement, and the like. Details of these image processes are well-known and will not be described.

  The OSD superimposing unit 109b superimposes the user menu and operation guide information as an OSD image on the image processing signal sig03 in response to an instruction signal from the CPU 101, and outputs the generated OSD superimposing signal sig04 to the dimming processing unit 109c. .

  The dimming processing unit 109c performs an edge blend dimming process on the OSD superimposed signal sig04 received from the OSD superimposing unit 109b in response to an instruction signal from the CPU 101, and the generated superimposed unit dimming signal sig05 is transformed into the deformation processing unit 109d. Output to. The dimming process is a process of applying a gain that gradually dims from the boundary with the non-superimposed area toward the edge in the overlapping area of the projection screen in multi-projection.

  FIG. 5 is a diagram for explaining a dimming method of a projected image by edge blend processing. FIG. 5A shows a projection image of one projector. The projected image 500a includes a non-overlapping area 510a and a superimposed area 520a. FIG. 5B shows a projection image 500b, a non-overlapping area 510b, and a superimposing area 520b of another projection apparatus.

  Diagrams 530a and 530b shown in FIG. 5C represent gains applied to the OSD superimposed signal sig04 by the light reduction processing unit 109c of the projection apparatus 100. The non-overlapping areas 510a and 510b have a gain that is 1.0 times, and the overlapping areas 520a and 520b have a gain that is 0 at the image edge of the projected video, with the boundary with the non-superimposing area being 1.0 depending on the position in the horizontal direction. Become. In FIG. 5C, the gain is a straight line, but may be an S-shaped curve or the like.

  FIG. 5D shows a projected image after synthesis. In the overlapping area 540, overlapping areas 520a and 520b of the projection screen of each projection apparatus 100 are overlapped. When an image with uniform luminance is projected, the luminance of the superimposing region 540 is equal to that of the non-superimposing regions 510a and 510b, and thus the boundary is not noticeable.

  In the present embodiment, edge blending processing by the light reduction processing unit 109c is performed in the case of multi-projection shown in FIG.

  The deformation processing unit 109d can perform a deformation process on the superimposition dimming signal sig05 based on a deformation formula, and can output a post-deformation image signal sig06. Since keystone correction can be realized by projective transformation, parameters for projective transformation are input from the CPU 101 of the projection apparatus 100. If the coordinates of the original image are (xs, ys), the coordinates (xd, yd) of the post-deformation image are expressed by Equation 1.

  Here, M is a 3 × 3 matrix, which is a projective transformation matrix from the original image input from the CPU 101 of the projection apparatus 100 to the transformed image. xso and yso are the coordinates of one vertex of the original image 601 indicated by a solid line in FIG. 6, and xdo and ydo are the vertices (xso and yso) of the original image of the transformed image 602 indicated by a dashed line in FIG. Is the coordinate value of the vertex corresponding to.

  An inverse matrix M-1 of the matrix M in Expression 1 and offsets (xso, yso), (xdo, ydo) are input from the CPU 101 of the projection apparatus 100, and corresponding to the transformed coordinate values (xd, yd) according to Expression 2. The coordinates (xs, ys) of the original image to be obtained are obtained.

  If the coordinates of the original image obtained by Expression 2 are integers, the pixel values of the original image coordinates (xs, ys) may be used as the pixel values of the converted coordinates (xd, yd) as they are. However, since the coordinates of the original image obtained based on Expression 2 are not always integers, the pixel values of the post-deformation coordinates (xd, yd) are obtained by interpolation using the values of the surrounding pixels. The interpolation method may be bilinear, bicubic, or any other method. If the coordinates of the original image obtained based on Equation 2 are outside the range of the original image area, the pixel value is black or a background color set by the user.

  In this manner, pixel values are obtained for all the converted coordinates, and a converted image is created.

  In this embodiment, it is assumed that the matrix M and its inverse matrix M-1 are input from the CPU 101 of the projection apparatus 100 to the image processing unit 109, but only the inverse matrix M-1 is input and the inside of the image processing unit 109 is input. The matrix M may be obtained by Alternatively, only the matrix M may be input to obtain the inverse matrix M−1 within the image processing unit 109.

  Although the present embodiment has been described on the assumption that the deformation process is performed by projective transformation, the deformation process is not limited to the projective conversion, and other methods may be used.

  <Automatic Correction Processing> Next, the automatic correction processing of this embodiment will be described with reference to FIG.

  The processing in FIG. 7 is realized by the CPU 201 of the information processing apparatus 200 developing a program stored in the ROM 203 in the work area of the RAM 202 and controlling each operation block. 7 is executed when a user operation receives an instruction to execute a program via the operation unit 204. The start condition in FIG. 7 is not limited to this, and may be periodically executed using, for example, Linux (registered trademark) Cron or Windows task scheduler. In this case, if projection mode setting information and correction target device information are stored in the RAM 202 or ROM 203 of the information processing device 200, S701 and S702 can be omitted.

  In step S <b> 701, the CPU 201 displays a menu screen that prompts the user to set a projection mode on the display unit 205. A menu screen that prompts the user to set the projection mode is shown in FIG. The user can select a projection mode by operating a pull-down menu 801 on the menu screen 800. As the projection mode, for example, single projection, stack projection, or multi-projection can be selected. In stack projection or multi-projection, settings relating to the number and arrangement can also be made. Regarding the number and arrangement, not only those shown in the pull-down menu 801 in FIG. 8A but also other modes may be selected. After the projection mode is selected, when the user presses the enter button 802 on the menu screen 800, the CPU 201 stores the projection mode setting information in the RAM 202, and the process proceeds to S702.

  In the present embodiment, the pull-down menu 801 is used to select the projection mode. However, the present invention is not limited to this, and for example, input from a radio button or a check box may be performed using a GUI, or a CUI may be used. Alternatively, a setting file including projection mode information may be stored in the ROM 203 in advance, and the CPU 201 may acquire the projection mode from the setting file in the ROM 203.

  After setting the projection mode in S701, in S702, the CPU 201 displays on the display unit 205 a menu screen that prompts the user to set the correction target device. FIG. 8B shows a menu screen 810 that prompts the user to set the correction target device. In the display area 811, the projection mode information set in S701 is displayed. The user inputs the IP address of the projection apparatus to be corrected in the text boxes 812 to 815. If there are two correction target devices, the user inputs the IP address in the text boxes 812 and 813 and does not input anything in the other text boxes, thereby causing the CPU 201 to recognize the number and addresses of the correction target devices. When the user presses the enter button 816 on the menu screen 810 after inputting the IP address, the CPU 201 stores the IP address information of the projection target apparatus in the RAM 202, and the process proceeds to S703.

  The IP address input method is not limited to the text box format, and other formats such as a check box may be used. You may make it input in CUI. Alternatively, a setting file including the IP address of the correction target device may be stored in the ROM 203 in advance, and the CPU 201 may acquire the IP address from the setting file in the ROM 203.

  After the setting of the projection mode and the correction target device in S701 and S702 is completed, in S703, the CPU 201 selects and executes a corresponding correction process based on the projection mode information stored in the RAM 202.

(Automatic correction processing of stack projection (S704))
Automatic correction processing when stack projection is performed using the two projectors 100a and 100b shown in FIG. 1 will be described with reference to the sequence diagram of FIG. ST1 to ST5 in FIG. 9 each show the state of the projection plane during execution of the sequence. In ST1 to ST5, the part indicated by “A” indicates the projection area of the projection apparatus 100a, and the part indicated by “B” indicates the projection area of the projection apparatus 100b. Moreover, the part shown with the dashed-dotted line of ST1-ST5 shows that the projection state of a projection apparatus is OFF.

  The state of the projection plane before the correction processing is executed is a state in which the positions of the projection screens are shifted as shown in ST1. Further, the projection states of the projection apparatuses 100a and 100b are both displayable states (display-on states).

  First, the information processing apparatus 200 transmits a packet including a display off command to the projection apparatuses 100a and 100b via the network IF 206 (S901 and S902). When the network IF 108 of the projection apparatus 100 receives a packet including a display-off command, the CPU 101 of each of the projection apparatuses 100a and 100b outputs an instruction to the image processing unit 109 to project a black image, thereby hiding the projected video. (S903, S904). Hereinafter, the process of projecting a black image is referred to as a blank process. The blanking process is realized, for example, by transmitting a non-display command (display off request) or a BLANK signal to the projection apparatus. Note that since it is necessary to hide the projected video image including the OSD screen, blank processing may be performed on the operation block subsequent to the OSD superimposing unit 109b shown in FIG. For example, the CPU 101 may output an instruction to the deformation processing unit 109d and execute a blank process to make sig06 a black image. In the present embodiment, the projection video is not displayed by the blank process, but other methods may be used. For example, in the case of a projection apparatus having a laser light source, the CPU 101 may output an instruction to the light source control unit 111 to turn off the light source. Even in the case of a projection apparatus having a lamp light source, the processing of this embodiment can be executed by turning off the light source. However, since it takes a lot of time to turn on and off the lamp light source, blank processing is used. It is desirable to do.

  The state of the projection surface after execution of S903 and S904 is shown in ST2. At this time, since the projection states of all the projection apparatuses 100a and 100b are off, nothing is displayed on the projection plane.

  Next, in order to capture a projection image of the projection apparatus 100a, the CPU 201 of the information processing apparatus 200 transmits a packet including a display-on command to the projection apparatus 100a via the network IF 206 (S905). When the network IF 108 of the projection apparatus 100a receives a packet including a display on command, the CPU 101 outputs an instruction to the image processing unit 109 to cancel the blank state (display off state) (S906).

  After the projection apparatus 100a becomes displayable, the CPU 201 of the information processing apparatus 200 transmits an image including an adjustment pattern (not shown) to the image distribution apparatus 300 via the image output unit 207. (S907). The adjustment pattern may be any pattern as long as it can detect the projection area of the projection apparatus. Moreover, you may transmit the pattern which can detect the shape of a projection surface. By using a pattern capable of detecting the shape of the projection surface, correction can be performed not only on a flat projection surface but also on a curved projection surface.

  The video distribution device 300 duplicates the input adjustment pattern and transmits it to the projection devices 100a and 100b (S907 '). The state of the projection surface at this time is shown in ST3 of FIG. Only the adjustment pattern projected from the projection device 100a is displayed on the projection surface. Although the adjustment pattern is also transmitted to the projection apparatus 100b, the adjustment pattern is not displayed due to the blank process (S904).

  Next, the CPU 201 of the information processing apparatus 200 transmits a message requesting to start photographing the projection plane to the imaging apparatus 400 via the communication unit 208 (S908). When receiving the imaging request message, the projection apparatus 100 captures the projection plane and transmits the captured image to the information processing apparatus 200 (S909). At this time, it is desirable that the projection area of the projection device 100 a be within the angle of view of the imaging device 400. In performing the correction process, when it is necessary to project and shoot a plurality of adjustment patterns, the procedures of S907 to S909 may be repeated while changing the adjustment patterns. The same applies to other projection apparatuses (for example, S914 to S916 described later).

  When shooting of the projection plane is completed, the information processing apparatus 200 transmits a packet including a display-off command to the projection apparatus 100a via the network IF 206 (S910). When the network IF 108 of the projection apparatus 100a receives a packet including a display off command, the CPU 101 outputs an instruction to the image processing unit 109 and performs blanking processing (S911).

  Through S905 to S911, the projection device 100a projects the adjustment pattern, and the imaging device 400 performs processing for photographing the projection plane.

  After projecting and photographing the adjustment pattern with the projection apparatus 100a, the same processing is executed in the projection apparatus 100b (S912 to S918). Since the process of S912-S918 is the same as that of S905-S911, description is abbreviate | omitted. ST4 shows a state when the projection apparatus 100b projects the adjustment pattern.

  When the CPU 201 of the information processing apparatus 200 acquires the captured image of the adjustment pattern projected by the projection apparatuses 100a and 100b from the imaging apparatus 400, the correction parameter is calculated (S919).

  The calculation of the correction parameter is performed based on the captured image acquired in S909 and S916. Any method may be used as the correction parameter calculation method. For example, when the projection plane is a plane, the vertex coordinates of the projection area may be detected from the adjustment pattern, and the deformation amount (projection transformation matrix) may be calculated based on the vertex coordinates.

  After calculating the correction parameter in S919, the information processing apparatus 200 transmits a packet including the correction parameter to each of the projection apparatuses 100a and 100b via the network IF 206 (S920 and S921). The correction parameter at this time may be, for example, the vertex coordinates of the projection image after deformation, or a projective transformation matrix.

  When the network IF 108 of each of the projection apparatuses 100a and 100b receives a packet including a display off command, the CPU 101 outputs an instruction to the deformation processing unit 109d to perform correction processing for deforming the projected video (S922 and S923).

  Finally, the information processing apparatus 200 transmits a packet including a display-on command to each of the projection apparatuses 100a and 100b via the network IF 206 (S924 and S925). When the network IF 108 of each projection apparatus 100a, 100b receives a packet including a display on command, the CPU 101 outputs an instruction to the image processing unit 109 to cancel the blank state (S926, S927).

  ST5 in FIG. 9 shows the state of the projection surface after execution of S926 and S927. Through the above-described correction processing (S922, S923), the projection images of the projection device 100a and the projection device 100b are in an overlapping state.

(Multi-projection automatic correction processing (S705))
An automatic correction process when performing multi-projection using the four projection devices 100a to 100d shown in FIG. 2 will be described with reference to the sequence diagram of FIG. Each of MU1 to MU7 in FIG. 10 shows the state of the projection plane during execution of the sequence. In MU1 to MU7, the part indicated by “A” is the projection area of the projection apparatus 100a, the part indicated by “B” is the projection area of the projection apparatus 100b, and the part indicated by “C” is the projection area of the projection apparatus 100c. , “D” indicates the projection area of the projection device 100d. Moreover, the part shown with the dashed-dotted line of MU1-MU7 has shown that the projection state of the projection apparatus is OFF.

  The difference between the sequence in FIG. 10 and the sequence in FIG. 9 is only the number of projection apparatuses and the presence / absence of edge blend processing in the correction processing (S1044, S1041, S1043, S1044), and detailed description thereof will be omitted. For the correction parameter calculation process (S1025) by the CPU 201 of the information processing apparatus 200, an algorithm different from the case of stack projection in S704 may be used.

(Single projection automatic correction processing (S706))
Next, automatic correction processing when performing single projection using the two projectors 100a and 100b will be described with reference to the sequence diagram of FIG. Single projection is a form in which the same image is projected onto the same projection plane by a plurality of projection devices via the image distribution device 300 for applications such as signage. At this time, the difference from multi-projection is that the projection images projected by the respective projection apparatuses do not overlap each other on the projection plane. That is, edge blending processing is not performed for single projection.

  FIG. 11 shows a sequence for correcting only the projection apparatus 100a among the projection apparatuses 100a and 100b connected to the video distribution apparatus 300. Each of SI1 to SI4 in FIG. 11 indicates the state of the projection surface during execution of the sequence. The portions indicated by “A” in SI1 to SI4 indicate the projection region of the projection device 100a, and the portion indicated by “B” indicates the projection region of the projection device 100b. Moreover, the part shown with the dashed-dotted line of SI1-SI4 has shown that the projection state of the projection apparatus is OFF.

  The sequence in FIG. 11 is almost the same as the sequence in FIG. 9, and the difference is only in the number of projection apparatuses to be corrected. In the sequence of FIG. 11, correction can be executed only for the designated projection apparatus. Here, as shown in SI3, while the projection apparatus 100a is projecting the adjustment pattern, the display of the other projection apparatuses is turned off because the projected images may overlap on the projection plane before correction. It is because there is sex.

  Returning to the description of FIG. 7, when the execution of the stack projection automatic correction processing (S704), the multi-projection automatic correction processing (S705), and the single projection automatic correction processing (S706) is completed, the processing ends.

  According to the above-described embodiment, even when a video signal is output from the video distribution device 300 to all the projection devices, other than the correction target projection devices are not displayed, and only the correction target projection device is adjusted. The pattern can be projected. Therefore, a system that reduces erroneous detection of the adjustment pattern can be realized at low cost.

  [Second Embodiment] Next, a second embodiment will be described.

  In the first embodiment, the automatic correction process in the case where the video distribution device 300 distributes the video output from the information processing device 200 to the plurality of projection devices 100 has been described. In contrast, in the present embodiment, the video distribution device is a device having a function capable of controlling the video output destination by the information processing device 200 (hereinafter referred to as a switcher in order to distinguish from the video distribution device of the first embodiment). Explain the case.

  FIG. 12 is a system configuration diagram of this embodiment. The system configuration shown in FIG. 12 is a configuration in which stack projection is performed using two projection apparatuses 100a and 100b, as in FIG. 1 of the first embodiment. The difference between FIG. 1 and FIG. 12 is that the video distribution device 300 is used in the first embodiment, whereas the switcher 1200 is used in the present embodiment.

  The switcher 1200 is connected to the information processing apparatus 200, the projection apparatus 100a, and the projection apparatus 100b through a video cable, as in the video distribution apparatus 300 of the first embodiment. The switcher 1200 is connected to the network IF 108 of the information processing apparatus 200 via the network 50.

  The switcher 1200 can control the video output destination by communication via the network 50. In the present embodiment, the information processing apparatus 200 controls the switcher 1200 via the network 50, but is not limited thereto, and other communication methods such as serial communication (RS-232) may be used.

<Automatic correction processing>
Next, automatic correction processing when stack projection is performed using the switcher 1200 and the two projectors 100a and 100b will be described with reference to the sequence diagram of FIG. Assume that each of the projection apparatuses 100a and 100b does not project anything including the OSD screen when there is no signal. Each of SW1 to SW3 in FIG. 13 shows the state of the projection surface during execution of the sequence. The portions indicated by “A” in SW1 to SW3 indicate the projection region of the projection device 100a, and the portion indicated by “B” indicates the projection region of the projection device 100b. Further, the portion indicated by the alternate long and short dash line in SW1 to SW3 indicates that the projection state of the projection apparatus is OFF.

  First, the CPU 201 of the information processing device 200 transmits a video output destination switching signal to the switcher 1200 in order to project and shoot the adjustment pattern on the projection device 100a (S1301). The projection plane at this time is in a state where only the image projected from the projection apparatus 100a is displayed as indicated by SW1.

  Next, the CPU 201 of the information processing apparatus 200 transmits an adjustment pattern to the switcher 1200 (S1302). At this time, since the output destination of the switcher 1200 is set to the projection apparatus 100a, the adjustment pattern is supplied only to the projection apparatus 100a (S1302 ').

  In this state, the CPU 201 of the information processing apparatus 200 outputs an instruction to start shooting of the imaging apparatus 400 (S1303), and the imaging apparatus 400 transmits the captured image to the information processing apparatus 200 (S1308).

  Similarly for the projection apparatus 100b, the CPU 201 of the information processing apparatus 200 transmits a video output switching signal to the switcher 1200 (S1305). Next, the CPU 201 of the information processing apparatus 200 transmits the adjustment pattern to the projection apparatus 100b via the switcher 1200 (S1306, S1306 '). Next, the CPU 201 of the information processing apparatus 200 outputs an instruction to start shooting to the imaging apparatus 400 (S1307), and the imaging apparatus 400 transmits the captured image to the information processing apparatus 200 (S1308).

  Based on the captured image including the adjustment pattern acquired by the above procedure, the CPU 201 of the information processing apparatus 200 calculates a correction parameter (S1309), and transmits the correction parameter to each projection apparatus (S1310, S1311). Each of the projection apparatuses 100a and 100b performs a correction process based on the received correction parameter (S1312, S1313).

  Finally, the CPU 201 of the information processing apparatus 200 outputs an instruction to change the video output destination to all the projection apparatuses to the switcher 1200, whereby the video signal is input to all the projection apparatuses.

  Although only the case of stack projection has been described in the present embodiment, it can be similarly applied to multi-projection and single projection as in the first embodiment.

  According to the above-described embodiment, the switcher 1200 can output the adjustment pattern only to the projection device to be corrected, and perform projection and shooting with the other devices than the correction target projection device in a non-display state. Therefore, a system that reduces erroneous detection of the adjustment pattern can be realized at low cost.

[Other Embodiments]
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in the computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

DESCRIPTION OF SYMBOLS 50 ... Network, 100 ... Projection apparatus, 108 ... Network IF, 109 ... Image processing part, 200 ... Information processing apparatus, 201 ... CPU, 206 ... Network IF, 208 ... Communication part, 300 ... Video distribution apparatus, 400 ... Imaging apparatus 1200 ... Switcher

Claims (24)

A projection system including a plurality of projection devices, an imaging device that captures a projection area of the projection device, an information processing device that supplies video, and a video distribution device that distributes video to the projection device,
The information processing apparatus includes:
Communication means capable of communicating with the projection device;
Supply means for supplying an image including a pattern for adjusting a projection area of the projection device;
Control means capable of controlling at least the projection apparatus and the imaging apparatus via the communication means,
The projector is
Projecting means for projecting video input from the video distribution device;
Correction means for performing a correction process of the projection area based on the image including the pattern photographed by the imaging device,
The control means of the information processing device supplies the pattern to the video distribution device, and causes the video including the pattern to be in a non-display state in a projection device other than the projection device targeted for the correction process. Projection system characterized by controlling. The video distribution device outputs the pattern to all projection devices,
The control means of the information processing apparatus makes it possible to display an image including the pattern in the projection apparatus targeted for the correction process via the communication means, and to be in a non-display state in other projection apparatuses. The projection system according to claim 1, wherein the projection system is controlled as follows. The video distribution device can control the video output destination by the control means of the information processing device,
2. The projection according to claim 1, wherein the control unit of the information processing apparatus switches the video output destination of the video distribution apparatus to the projection apparatus that is the target of the correction process via the communication unit. system.   The projection system according to claim 2, wherein the control unit of the information processing apparatus performs control so that a projection apparatus other than the projection apparatus targeted for the correction process projects a black image. The information processing apparatus includes a receiving unit that receives an image including the pattern photographed by the imaging device;
Calculation means for calculating a correction parameter for correcting a projection area of each projection device based on an image including the pattern photographed by the imaging device;
Transmitting means for transmitting the correction parameter to the projection device;
5. The projection system according to claim 1, wherein the correction unit of the projection apparatus executes a correction process based on the correction parameter.   The projection system according to claim 1, wherein the correction processing includes at least one of distortion correction, color correction, and luminance correction.   The projection system according to claim 2, wherein the control unit of the information processing apparatus performs control so that an image can be displayed on all the projection apparatuses after the correction processing is completed on all the projection apparatuses. .   The projection system according to claim 3, wherein the control unit of the information processing apparatus switches the video output destination of the video distribution apparatus to all the projection apparatuses after the correction processing is completed in all the projection apparatuses.   The projection system according to any one of claims 1 to 8, wherein the information processing apparatus includes a selection unit that can select a projection apparatus to be subjected to the correction process for the plurality of projection apparatuses. .   10. The projection system according to claim 1, wherein the information processing apparatus includes a setting unit capable of setting a projection mode based on the number and arrangement of the projection apparatuses.   The projection mode includes a stack projection for displaying the projection images of a plurality of projection devices in a superimposed manner, a multi-projection for displaying a part of each projection image of the plurality of projection devices in a superimposed manner, and a plurality of projection devices. The projection system according to claim 10, comprising a single projection for projecting the same image. A plurality of projection devices, and communication means capable of communicating with an imaging device for photographing a projection area of the projection device;
Supply means for supplying an image including a pattern for adjusting a projection area of the projection device;
Control means capable of controlling at least the projection apparatus and the imaging apparatus via the communication means,
The information processing apparatus according to claim 1, wherein the control unit performs control so that an image including the pattern is in a non-display state in a projection apparatus other than the projection apparatus targeted for correction processing of the projection area.   The control unit controls the projection device that is the target of the correction processing to display the image including the pattern in a displayable state and the non-display state in other projection devices via the communication unit. The information processing apparatus according to claim 12. The communication means is capable of communicating with a video distribution device that distributes video to a projection device,
The information processing apparatus according to claim 12, wherein the control unit switches the video output destination of the video distribution apparatus to the projection apparatus that is the target of the correction process via the communication unit.   The information processing apparatus according to claim 13, wherein the control unit performs control so that a projection apparatus other than the projection apparatus targeted for the correction process projects a black image. Receiving means for receiving an image including the pattern photographed by the imaging device;
Calculation means for calculating a correction parameter for correcting a projection area of each projection device based on an image including the pattern photographed by the imaging device;
The information processing apparatus according to claim 12, further comprising: a transmission unit that transmits the correction parameter to the projection apparatus.   The information processing apparatus according to claim 13, wherein the control unit performs control so that an image can be displayed on all the projection apparatuses after the correction processing is completed on all the projection apparatuses.   The information processing apparatus according to claim 14, wherein the control unit switches the video output destination of the video distribution apparatus to all the projection apparatuses after the correction processing is completed in all the projection apparatuses.   19. The information processing apparatus according to claim 12, further comprising: a selection unit that can select a projection apparatus that is a target of the correction process with respect to the plurality of projection apparatuses.   The information processing apparatus according to any one of claims 12 to 19, further comprising setting means capable of setting a projection mode based on the number and arrangement of the projection apparatuses.   The projection mode includes a stack projection for displaying the projection images of a plurality of projection devices in a superimposed manner, a multi-projection for displaying a part of each projection image of the plurality of projection devices in a superimposed manner, and a plurality of projection devices. 21. The information processing apparatus according to claim 20, further comprising a single projection that projects the same image. A plurality of projection devices, and communication means capable of communicating with an imaging device for photographing a projection area of the projection device;
A control unit capable of controlling at least the projection device and the imaging device via the communication unit;
Providing an image including a pattern for adjusting a projection area of the projection device;
And a step of controlling the image including the pattern to be in a non-display state in a projection apparatus other than the projection apparatus that is the target of the correction process of the projection area.   A program for causing a computer to execute the control method for the information processing apparatus according to claim 22.   A computer-readable storage medium storing a program for causing a computer to execute the control method for an information processing apparatus according to claim 22.